Web scraping adalah proses pengambilan data atau informasi dari internet. Sebagaimana kita ketahui bersama, semua yang ada di internet bisa dengan mudah-nya kita ambil dengan teknik yang tepat.
Setidaknya ada beberapa libraries yang digunakan untuk teknik web scraping :
Sekarang saya akan menunjukkan teknik yang sering digunakan untuk web scraping, yaitu menggunakan library(ralger) untuk mengurai html.
Kenapa menggunakan ralger? ralger menawarkan kemudahan dan kepraktisan yang lebih baik bagi scraper pemula yang masih belum paham mengenai .css object.
Langkah pertama yang harus dilakukan yaitu memasang library ralger itu sendiri
library(ralger)## Warning: package 'ralger' was built under R version 4.0.5Sebagai contoh, saya akan mencoba untuk scrape Jaringan Keselamatan Penerbangan terkait insiden kecelakaan pesawat terbang.
url = "https://aviation-safety.net/database/dblist.php?Year=2021"Kemudian data tersebut akan saya buat dalam bentuk data frame.
tabel_hasil = table_scrap(url)Selanjutnya menampilkan data yang paling atas.
head(tabel_hasil)## date type registration operator fat.
## 1 02-JAN-2021 Learjet 31A PP-BBV Brasil Vida Táxi Aéreo 0
## 2 02-JAN-2021 Beech 200 Super King Air N831WP Vagus Group 0
## 3 09-JAN-2021 Boeing 737-524 (WL) PK-CLC Sriwijaya Air 62
## 4 09-JAN-2021 Cessna 560 Citation V N3RB SX Transport LLC 1
## 5 12-JAN-2021 Harbin Y-12-II Kenyan AF 4
## 6 19-JAN-2021 Boeing 737-4Q8 (SF) G-JMCY West Atlantic (UK) 0
## location pic cat
## 1 Diamantina A... NA NA A2
## 2 White Plains... NA NA A2
## 3 near Jakarta-Soek... NA NA A1
## 4 near Pine Grove, OR NA NA A1
## 5 near Voi NA NA A1
## 6 Exeter Airpo... NA NA A2Atau juga bisa menampilkan data secara keseluruhan.
tabel_hasil## date type registration
## 1 02-JAN-2021 Learjet 31A PP-BBV
## 2 02-JAN-2021 Beech 200 Super King Air N831WP
## 3 09-JAN-2021 Boeing 737-524 (WL) PK-CLC
## 4 09-JAN-2021 Cessna 560 Citation V N3RB
## 5 12-JAN-2021 Harbin Y-12-II
## 6 19-JAN-2021 Boeing 737-4Q8 (SF) G-JMCY
## 7 23-JAN-2021 Rockwell Sabreliner 60 XB-JMR
## 8 23-JAN-2021 Canadair Challenger 600 N275JP
## 9 24-JAN-2021 Raytheon Beechjet 400A N476BJ
## 10 26-JAN-2021 Harbin Yunshuji Y-12E AF-222
## 11 28-JAN-2021 Beech B300 King Air 350 N217US
## 12 29-JAN-2021 Beech 100 King Air
## 13 ??-JAN-2021 Antonov An-2
## 14 01-FEB-2021 Boeing 747-8KZF JA13KZ
## 15 08-FEB-2021 Embraer Phenom 100 9H-FAM
## 16 09-FEB-2021 Antonov An-12BK RF-95416
## 17 10-FEB-2021 Airbus A320-214 (WL) HZ-FAB
## 18 13-FEB-2021 Dassault Falcon 900EX N823RC
## 19 14-FEB-2021 DHC-6 Twin Otter 300 8Q-RAE
## 20 18-FEB-2021 Learjet 55C N559RA
## 21 20-FEB-2021 DHC-3T Vazar Turbine Otter C-FFVZ
## 22 21-FEB-2021 Beech B300 King Air 350 NAF201
## 23 21-FEB-2021 Learjet 45XR 3912
## 24 21-FEB-2021 Beech 200 Super King Air
## 25 26-FEB-2021 Antonov An-2T UP-A0351
## 26 28-FEB-2021 Douglas DC-3C HK-2006
## 27 01-MAR-2021 Beech B300 King Air 350i B-10GD
## 28 01-MAR-2021 ATR 72-500 (72-212A) 7T-VUK
## 29 02-MAR-2021 Let L-410UVP-E (HK-4274)
## 30 04-MAR-2021 Fokker 100 EP-CFM
## 31 07-MAR-2021 Embraer EMB-120ER Brasilia N233SW
## 32 10-MAR-2021 Cessna 208B Grand Caravan PK-MAD
## 33 12-MAR-2021 Cessna 208B Grand Caravan N407GV
## 34 13-MAR-2021 Antonov An-26 02 white
## 35 18-MAR-2021 Antonov An-2T YV3312
## 36 18-MAR-2021 Airbus A320-232 XA-VAZ
## 37 20-MAR-2021 Boeing 737-4Y0 PK-YSF
## 38 20-MAR-2021 Cessna 208B Grand Caravan 5Y-JKN
## 39 23-MAR-2021 Saab 340AF SP-KPU
## 40 25-MAR-2021 Embraer
## 41 26-MAR-2021 Beech B200 Super King Air 5Y-NJS
## 42 02-APR-2021 Boeing 737-8AS (WL) 9H-QCJ
## 43 08-APR-2021 Antonov An-2 RA-40...
## 44 09-APR-2021 Boeing C-17A Globemaster III 10-0223
## 45 16-APR-2021 Beech B99 N991AK
## 46 18-APR-2021 Learjet 25B XB-PIZ
## 47 20-APR-2021 Learjet 35A PR-MLA
## 48 05-MAY-2021 Gulfstream G150 N22ST
## 49 06-MAY-2021 Beech B200GT King Air 250 VT-MPQ
## 50 12-MAY-2021 Swearingen SA226-TC Metro II N280KL
## 51 19-MAY-2021 Hawker 800 XB-R..
## 52 20-MAY-2021 IAI 1125 Astra N388WA
## 53 21-MAY-2021 Beech B300 King Air 350i NAF203
## 54 21-MAY-2021 Antonov An-2R RA-33373
## 55 29-MAY-2021 Cessna 501 Citation I/SP N66BK
## 56 03-JUN-2021 Cessna 208B Grand Caravan EX PK-DPT
## 57 05-JUN-2021 Cessna 208B Supervan 900 N103AN
## operator fat.
## 1 Brasil Vida Táxi Aéreo 0
## 2 Vagus Group 0
## 3 Sriwijaya Air 62
## 4 SX Transport LLC 1
## 5 Kenyan AF 4
## 6 West Atlantic (UK) 0
## 7 Aviacion Ejecutiva del Bajio 0
## 8 Global Avionics LLC 0
## 9 Martinair Inc. 0
## 10 Zambian Air Force 0
## 11 MM-Air LLC 0
## 12 private 0
## 13 KPAAF 5
## 14 Nippon Cargo Airlines 0
## 15 Luxwing 0
## 16 Russian AF 0
## 17 Flyadeal 0
## 18 Aerospike Iron LLC 0
## 19 Manta Air 0
## 20 Royal Air Freight 0
## 21 Wings Over Kississing 0
## 22 Nigerian AF 7
## 23 Mexican AF 6
## 24 private 0
## 25 Asia Continental Airlines 0
## 26 ALIANSA Colombia 0
## 27 Beidahuang General Airlines, opf China Meteorological Administrat 5
## 28 Air Algérie 0
## 29 South Sudan Supreme Airlines 10
## 30 Iran Air 0
## 31 Berry Aviation 0
## 32 MAF 0
## 33 Grant Aviation 0
## 34 Kazakhstan Border Guards 4
## 35 Unknown 0
## 36 Viva Aerobus 0
## 37 Trigana Air Service 0
## 38 Aeronav Air Services 2
## 39 0
## 40 Mauritania Airlines International 0
## 41 Unknown 0
## 42 Malta Air 0
## 43 Unknown 0
## 44 USAF 0
## 45 Lake Clark Air Services 0
## 46 Unknown 0
## 47 Eletric Power Construção 1
## 48 TLD Aviation I 0
## 49 Government of Madhya Pradesh 0
## 50 Key Lime Air 0
## 51 private 0
## 52 private 0
## 53 Nigerian AF 11
## 54 Utair 0
## 55 JL&GL Productions LP 7
## 56 Dabi Air Nusantara 0
## 57 Paraclub Wiener Neustadt 0
## location pic cat
## 1 Diamantina A... NA NA A2
## 2 White Plains... NA NA A2
## 3 near Jakarta-Soek... NA NA A1
## 4 near Pine Grove, OR NA NA A1
## 5 near Voi NA NA A1
## 6 Exeter Airpo... NA NA A2
## 7 Rocky Point,... NA NA A1
## 8 Los Mochis-F... NA NA A2
## 9 Binghamton A... NA NA A2
## 10 Mukinge Miss... NA NA A2
## 11 Davenport Ai... NA NA A2
## 12 Crooked Tree... NA NA C1
## 13 near Taechon Air ... NA NA A1
## 14 Tokyo-Narita... NA NA A2
## 15 Paris-Le Bou... NA NA A2
## 16 Iturup Airpo... NA NA A2
## 17 Abha Interna... NA NA C2
## 18 San Diego-Mo... NA NA A2
## 19 Malé-Velana ... NA NA A2
## 20 Jeffersonvil... NA NA A2
## 21 Kaskattama A... NA NA A2
## 22 near Abuja-Nnamdi... NA NA A1
## 23 near Xalapa Airpo... NA NA A1
## 24 San Andrés, ... NA NA C1
## 25 near Boraldai NA NA A1
## 26 Monfort Airp... NA NA A2
## 27 Ji'an County NA NA A1
## 28 Ghardaïa-Nou... NA NA A2
## 29 Pieri NA NA A1
## 30 Isfahan Airport NA NA H2
## 31 Detroit-Will... NA NA A1
## 32 Angguruk Air... NA NA A2
## 33 Chevak Airpo... NA NA A2
## 34 Almaty Airpo... NA NA A1
## 35 within Bolívar State NA NA A2
## 36 Puerto Valla... NA NA A2
## 37 Jakarta-Hali... NA NA A1
## 38 Marsabit NA NA A1
## 39 Gdansk-Lech ... NA NA O2
## 40 Nouakchott-O... NA NA H2
## 41 Nairobi NA NA A1
## 42 Malta-Luqa A... NA NA O2
## 43 Omsk NA NA O1
## 44 Charleston A... NA NA A2
## 45 Chignik-Lago... NA NA A2
## 46 Toluca-Licen... NA NA A2
## 47 Belo Horizon... NA NA A1
## 48 Ridgeland Ai... NA NA A2
## 49 Gwalior Airp... NA NA A2
## 50 near Denver-Cente... NA NA A2
## 51 Sayaxché, Petén NA NA U1
## 52 Parque Lagun... NA NA A2
## 53 near Kaduna Airpo... NA NA A1
## 54 Laytamak Air... NA NA A2
## 55 near Smyrna Airpo... NA NA A1
## 56 Ilaga Airpor... NA NA C1
## 57 Wiener Neust... NA NA A2