First, load relevent R packages
Now, connect to the MySQL database to retrieve the ‘Flights’ data
Check to see if database is connected:
dbListTables(mydb)## [1] "airlines" "airports" "flights" "planes" "weather"Select all the information needed for the flights dataframe
flights<-dbGetQuery(mydb,"SELECT * FROM flights;")
airlines<-dbGetQuery(mydb,"SELECT * FROM airlines;")
airports<-dbGetQuery(mydb,"SELECT * FROM airports;")
planes<-dbGetQuery(mydb,"SELECT * FROM planes;")
weather<-dbGetQuery(mydb,"SELECT * FROM weather;")create data frame for this data within R
mydata <- data.frame(flights)disconnect from mysql
dbDisconnect(mydb)## [1] TRUEnames(mydata)## [1] "year" "month" "day" "dep_time" "dep_delay"
## [6] "arr_time" "arr_delay" "carrier" "tailnum" "flight"
## [11] "origin" "dest" "air_time" "distance" "hour"
## [16] "minute"head(mydata)## year month day dep_time dep_delay arr_time arr_delay carrier tailnum
## 1 2013 1 1 517 2 830 11 UA N14228
## 2 2013 1 1 533 4 850 20 UA N24211
## 3 2013 1 1 542 2 923 33 AA N619AA
## 4 2013 1 1 544 -1 1004 -18 B6 N804JB
## 5 2013 1 1 554 -6 812 -25 DL N668DN
## 6 2013 1 1 554 -4 740 12 UA N39463
## flight origin dest air_time distance hour minute
## 1 1545 EWR IAH 227 1400 5 17
## 2 1714 LGA IAH 227 1416 5 33
## 3 1141 JFK MIA 160 1089 5 42
## 4 725 JFK BQN 183 1576 5 44
## 5 461 LGA ATL 116 762 6 54
## 6 1696 EWR ORD 150 719 6 54Now, I need to see if my connect to mongolite is working (I got a lot of help from this github page: https://jeroen.github.io/mongolite/connecting-to-mongodb.html)
m <- mongo("mtcars", url = "mongodb://readwrite:test@ds043942.mongolab.com:43942/jeroen_test")print(m)## <Mongo collection> 'mtcars'
## $aggregate(pipeline = "{}", options = "{\"allowDiskUse\":true}", handler = NULL, pagesize = 1000)
## $count(query = "{}")
## $distinct(key, query = "{}")
## $drop()
## $export(con = stdout(), bson = FALSE)
## $find(query = "{}", fields = "{\"_id\":0}", sort = "{}", skip = 0, limit = 0, handler = NULL, pagesize = 1000)
## $import(con, bson = FALSE)
## $index(add = NULL, remove = NULL)
## $info()
## $insert(data, pagesize = 1000, ...)
## $iterate(query = "{}", fields = "{\"_id\":0}", sort = "{}", skip = 0, limit = 0)
## $mapreduce(map, reduce, query = "{}", sort = "{}", limit = 0, out = NULL, scope = NULL)
## $remove(query, just_one = FALSE)
## $rename(name, db = NULL)
## $update(query, update = "{\"$set\":{}}", upsert = FALSE, multiple = FALSE)?mongoliteconnect to mongo to database
library(jsonlite)mongo1<- mongo(collection = "mydata", db = "flightsdb", url = "mongodb://localhost",
verbose = TRUE,options = ssl_options())
mongo1$insert(mydata)##
Processed 1000 rows...
Processed 2000 rows...
Processed 3000 rows...
Processed 4000 rows...
Processed 5000 rows...
Processed 6000 rows...
Processed 7000 rows...
Processed 8000 rows...
Processed 9000 rows...
Processed 10000 rows...
Processed 11000 rows...
Processed 12000 rows...
Processed 13000 rows...
Processed 14000 rows...
Processed 15000 rows...
Processed 16000 rows...
Processed 17000 rows...
Processed 18000 rows...
Processed 19000 rows...
Processed 20000 rows...
Processed 21000 rows...
Processed 22000 rows...
Processed 23000 rows...
Processed 24000 rows...
Processed 25000 rows...
Processed 26000 rows...
Processed 27000 rows...
Processed 28000 rows...
Processed 29000 rows...
Processed 30000 rows...
Processed 31000 rows...
Processed 32000 rows...
Processed 33000 rows...
Processed 34000 rows...
Processed 35000 rows...
Processed 36000 rows...
Processed 37000 rows...
Processed 38000 rows...
Processed 39000 rows...
Processed 40000 rows...
Processed 41000 rows...
Processed 42000 rows...
Processed 43000 rows...
Processed 44000 rows...
Processed 45000 rows...
Processed 46000 rows...
Processed 47000 rows...
Processed 48000 rows...
Processed 49000 rows...
Processed 50000 rows...
Processed 51000 rows...
Processed 52000 rows...
Processed 53000 rows...
Processed 54000 rows...
Processed 55000 rows...
Processed 56000 rows...
Processed 57000 rows...
Processed 58000 rows...
Processed 59000 rows...
Processed 60000 rows...
Processed 61000 rows...
Processed 62000 rows...
Processed 63000 rows...
Processed 64000 rows...
Processed 65000 rows...
Processed 66000 rows...
Processed 67000 rows...
Processed 68000 rows...
Processed 69000 rows...
Processed 70000 rows...
Processed 71000 rows...
Processed 72000 rows...
Processed 73000 rows...
Processed 74000 rows...
Processed 75000 rows...
Processed 76000 rows...
Processed 77000 rows...
Processed 78000 rows...
Processed 79000 rows...
Processed 80000 rows...
Processed 81000 rows...
Processed 82000 rows...
Processed 83000 rows...
Processed 84000 rows...
Processed 85000 rows...
Processed 86000 rows...
Processed 87000 rows...
Processed 88000 rows...
Processed 89000 rows...
Processed 90000 rows...
Processed 91000 rows...
Processed 92000 rows...
Processed 93000 rows...
Processed 94000 rows...
Processed 95000 rows...
Processed 96000 rows...
Processed 97000 rows...
Processed 98000 rows...
Processed 99000 rows...
Processed 1e+05 rows...
Processed 101000 rows...
Processed 102000 rows...
Processed 103000 rows...
Processed 104000 rows...
Processed 105000 rows...
Processed 106000 rows...
Processed 107000 rows...
Processed 108000 rows...
Processed 109000 rows...
Processed 110000 rows...
Processed 111000 rows...
Processed 112000 rows...
Processed 113000 rows...
Processed 114000 rows...
Processed 115000 rows...
Processed 116000 rows...
Processed 117000 rows...
Processed 118000 rows...
Processed 119000 rows...
Processed 120000 rows...
Processed 121000 rows...
Processed 122000 rows...
Processed 123000 rows...
Processed 124000 rows...
Processed 125000 rows...
Processed 126000 rows...
Processed 127000 rows...
Processed 128000 rows...
Processed 129000 rows...
Processed 130000 rows...
Processed 131000 rows...
Processed 132000 rows...
Processed 133000 rows...
Processed 134000 rows...
Processed 135000 rows...
Processed 136000 rows...
Processed 137000 rows...
Processed 138000 rows...
Processed 139000 rows...
Processed 140000 rows...
Processed 141000 rows...
Processed 142000 rows...
Processed 143000 rows...
Processed 144000 rows...
Processed 145000 rows...
Processed 146000 rows...
Processed 147000 rows...
Processed 148000 rows...
Processed 149000 rows...
Processed 150000 rows...
Processed 151000 rows...
Processed 152000 rows...
Processed 153000 rows...
Processed 154000 rows...
Processed 155000 rows...
Processed 156000 rows...
Processed 157000 rows...
Processed 158000 rows...
Processed 159000 rows...
Processed 160000 rows...
Processed 161000 rows...
Processed 162000 rows...
Processed 163000 rows...
Processed 164000 rows...
Processed 165000 rows...
Processed 166000 rows...
Processed 167000 rows...
Processed 168000 rows...
Processed 169000 rows...
Processed 170000 rows...
Processed 171000 rows...
Processed 172000 rows...
Processed 173000 rows...
Processed 174000 rows...
Processed 175000 rows...
Processed 176000 rows...
Processed 177000 rows...
Processed 178000 rows...
Processed 179000 rows...
Processed 180000 rows...
Processed 181000 rows...
Processed 182000 rows...
Processed 183000 rows...
Processed 184000 rows...
Processed 185000 rows...
Processed 186000 rows...
Processed 187000 rows...
Processed 188000 rows...
Processed 189000 rows...
Processed 190000 rows...
Processed 191000 rows...
Processed 192000 rows...
Processed 193000 rows...
Processed 194000 rows...
Processed 195000 rows...
Processed 196000 rows...
Processed 197000 rows...
Processed 198000 rows...
Processed 199000 rows...
Processed 2e+05 rows...
Processed 201000 rows...
Processed 202000 rows...
Processed 203000 rows...
Processed 204000 rows...
Processed 205000 rows...
Processed 206000 rows...
Processed 207000 rows...
Processed 208000 rows...
Processed 209000 rows...
Processed 210000 rows...
Processed 211000 rows...
Processed 212000 rows...
Processed 213000 rows...
Processed 214000 rows...
Processed 215000 rows...
Processed 216000 rows...
Processed 217000 rows...
Processed 218000 rows...
Processed 219000 rows...
Processed 220000 rows...
Processed 221000 rows...
Processed 222000 rows...
Processed 223000 rows...
Processed 224000 rows...
Processed 225000 rows...
Processed 226000 rows...
Processed 227000 rows...
Processed 228000 rows...
Processed 229000 rows...
Processed 230000 rows...
Processed 231000 rows...
Processed 232000 rows...
Processed 233000 rows...
Processed 234000 rows...
Processed 235000 rows...
Processed 236000 rows...
Processed 237000 rows...
Processed 238000 rows...
Processed 239000 rows...
Processed 240000 rows...
Processed 241000 rows...
Processed 242000 rows...
Processed 243000 rows...
Processed 244000 rows...
Processed 245000 rows...
Processed 246000 rows...
Processed 247000 rows...
Processed 248000 rows...
Processed 249000 rows...
Processed 250000 rows...
Processed 251000 rows...
Processed 252000 rows...
Processed 253000 rows...
Processed 254000 rows...
Processed 255000 rows...
Processed 256000 rows...
Processed 257000 rows...
Processed 258000 rows...
Processed 259000 rows...
Processed 260000 rows...
Processed 261000 rows...
Processed 262000 rows...
Processed 263000 rows...
Processed 264000 rows...
Processed 265000 rows...
Processed 266000 rows...
Processed 267000 rows...
Processed 268000 rows...
Processed 269000 rows...
Processed 270000 rows...
Processed 271000 rows...
Processed 272000 rows...
Processed 273000 rows...
Processed 274000 rows...
Processed 275000 rows...
Processed 276000 rows...
Processed 277000 rows...
Processed 278000 rows...
Processed 279000 rows...
Processed 280000 rows...
Processed 281000 rows...
Processed 282000 rows...
Processed 283000 rows...
Processed 284000 rows...
Processed 285000 rows...
Processed 286000 rows...
Processed 287000 rows...
Processed 288000 rows...
Processed 289000 rows...
Processed 290000 rows...
Processed 291000 rows...
Processed 292000 rows...
Processed 293000 rows...
Processed 294000 rows...
Processed 295000 rows...
Processed 296000 rows...
Processed 297000 rows...
Processed 298000 rows...
Processed 299000 rows...
Processed 3e+05 rows...
Processed 301000 rows...
Processed 302000 rows...
Processed 303000 rows...
Processed 304000 rows...
Processed 305000 rows...
Processed 306000 rows...
Processed 307000 rows...
Processed 308000 rows...
Processed 309000 rows...
Processed 310000 rows...
Processed 311000 rows...
Processed 312000 rows...
Processed 313000 rows...
Processed 314000 rows...
Processed 315000 rows...
Processed 316000 rows...
Processed 317000 rows...
Processed 318000 rows...
Processed 319000 rows...
Processed 320000 rows...
Processed 321000 rows...
Processed 322000 rows...
Processed 323000 rows...
Processed 324000 rows...
Processed 325000 rows...
Processed 326000 rows...
Processed 327000 rows...
Processed 328000 rows...
Processed 329000 rows...
Processed 330000 rows...
Processed 331000 rows...
Processed 332000 rows...
Processed 333000 rows...
Processed 334000 rows...
Processed 335000 rows...
Processed 336000 rows...
Complete! Processed total of 336776 rows.## List of 5
## $ nInserted : num 336776
## $ nMatched : num 0
## $ nRemoved : num 0
## $ nUpserted : num 0
## $ writeErrors: list()load the rest of the ‘flights’ database
mydata1 = mongo1$find('{}')##
Found 1000 records...
Found 2000 records...
Found 3000 records...
Found 4000 records...
Found 5000 records...
Found 6000 records...
Found 7000 records...
Found 8000 records...
Found 9000 records...
Found 10000 records...
Found 11000 records...
Found 12000 records...
Found 13000 records...
Found 14000 records...
Found 15000 records...
Found 16000 records...
Found 17000 records...
Found 18000 records...
Found 19000 records...
Found 20000 records...
Found 21000 records...
Found 22000 records...
Found 23000 records...
Found 24000 records...
Found 25000 records...
Found 26000 records...
Found 27000 records...
Found 28000 records...
Found 29000 records...
Found 30000 records...
Found 31000 records...
Found 32000 records...
Found 33000 records...
Found 34000 records...
Found 35000 records...
Found 36000 records...
Found 37000 records...
Found 38000 records...
Found 39000 records...
Found 40000 records...
Found 41000 records...
Found 42000 records...
Found 43000 records...
Found 44000 records...
Found 45000 records...
Found 46000 records...
Found 47000 records...
Found 48000 records...
Found 49000 records...
Found 50000 records...
Found 51000 records...
Found 52000 records...
Found 53000 records...
Found 54000 records...
Found 55000 records...
Found 56000 records...
Found 57000 records...
Found 58000 records...
Found 59000 records...
Found 60000 records...
Found 61000 records...
Found 62000 records...
Found 63000 records...
Found 64000 records...
Found 65000 records...
Found 66000 records...
Found 67000 records...
Found 68000 records...
Found 69000 records...
Found 70000 records...
Found 71000 records...
Found 72000 records...
Found 73000 records...
Found 74000 records...
Found 75000 records...
Found 76000 records...
Found 77000 records...
Found 78000 records...
Found 79000 records...
Found 80000 records...
Found 81000 records...
Found 82000 records...
Found 83000 records...
Found 84000 records...
Found 85000 records...
Found 86000 records...
Found 87000 records...
Found 88000 records...
Found 89000 records...
Found 90000 records...
Found 91000 records...
Found 92000 records...
Found 93000 records...
Found 94000 records...
Found 95000 records...
Found 96000 records...
Found 97000 records...
Found 98000 records...
Found 99000 records...
Found 1e+05 records...
Found 101000 records...
Found 102000 records...
Found 103000 records...
Found 104000 records...
Found 105000 records...
Found 106000 records...
Found 107000 records...
Found 108000 records...
Found 109000 records...
Found 110000 records...
Found 111000 records...
Found 112000 records...
Found 113000 records...
Found 114000 records...
Found 115000 records...
Found 116000 records...
Found 117000 records...
Found 118000 records...
Found 119000 records...
Found 120000 records...
Found 121000 records...
Found 122000 records...
Found 123000 records...
Found 124000 records...
Found 125000 records...
Found 126000 records...
Found 127000 records...
Found 128000 records...
Found 129000 records...
Found 130000 records...
Found 131000 records...
Found 132000 records...
Found 133000 records...
Found 134000 records...
Found 135000 records...
Found 136000 records...
Found 137000 records...
Found 138000 records...
Found 139000 records...
Found 140000 records...
Found 141000 records...
Found 142000 records...
Found 143000 records...
Found 144000 records...
Found 145000 records...
Found 146000 records...
Found 147000 records...
Found 148000 records...
Found 149000 records...
Found 150000 records...
Found 151000 records...
Found 152000 records...
Found 153000 records...
Found 154000 records...
Found 155000 records...
Found 156000 records...
Found 157000 records...
Found 158000 records...
Found 159000 records...
Found 160000 records...
Found 161000 records...
Found 162000 records...
Found 163000 records...
Found 164000 records...
Found 165000 records...
Found 166000 records...
Found 167000 records...
Found 168000 records...
Found 169000 records...
Found 170000 records...
Found 171000 records...
Found 172000 records...
Found 173000 records...
Found 174000 records...
Found 175000 records...
Found 176000 records...
Found 177000 records...
Found 178000 records...
Found 179000 records...
Found 180000 records...
Found 181000 records...
Found 182000 records...
Found 183000 records...
Found 184000 records...
Found 185000 records...
Found 186000 records...
Found 187000 records...
Found 188000 records...
Found 189000 records...
Found 190000 records...
Found 191000 records...
Found 192000 records...
Found 193000 records...
Found 194000 records...
Found 195000 records...
Found 196000 records...
Found 197000 records...
Found 198000 records...
Found 199000 records...
Found 2e+05 records...
Found 201000 records...
Found 202000 records...
Found 203000 records...
Found 204000 records...
Found 205000 records...
Found 206000 records...
Found 207000 records...
Found 208000 records...
Found 209000 records...
Found 210000 records...
Found 211000 records...
Found 212000 records...
Found 213000 records...
Found 214000 records...
Found 215000 records...
Found 216000 records...
Found 217000 records...
Found 218000 records...
Found 219000 records...
Found 220000 records...
Found 221000 records...
Found 222000 records...
Found 223000 records...
Found 224000 records...
Found 225000 records...
Found 226000 records...
Found 227000 records...
Found 228000 records...
Found 229000 records...
Found 230000 records...
Found 231000 records...
Found 232000 records...
Found 233000 records...
Found 234000 records...
Found 235000 records...
Found 236000 records...
Found 237000 records...
Found 238000 records...
Found 239000 records...
Found 240000 records...
Found 241000 records...
Found 242000 records...
Found 243000 records...
Found 244000 records...
Found 245000 records...
Found 246000 records...
Found 247000 records...
Found 248000 records...
Found 249000 records...
Found 250000 records...
Found 251000 records...
Found 252000 records...
Found 253000 records...
Found 254000 records...
Found 255000 records...
Found 256000 records...
Found 257000 records...
Found 258000 records...
Found 259000 records...
Found 260000 records...
Found 261000 records...
Found 262000 records...
Found 263000 records...
Found 264000 records...
Found 265000 records...
Found 266000 records...
Found 267000 records...
Found 268000 records...
Found 269000 records...
Found 270000 records...
Found 271000 records...
Found 272000 records...
Found 273000 records...
Found 274000 records...
Found 275000 records...
Found 276000 records...
Found 277000 records...
Found 278000 records...
Found 279000 records...
Found 280000 records...
Found 281000 records...
Found 282000 records...
Found 283000 records...
Found 284000 records...
Found 285000 records...
Found 286000 records...
Found 287000 records...
Found 288000 records...
Found 289000 records...
Found 290000 records...
Found 291000 records...
Found 292000 records...
Found 293000 records...
Found 294000 records...
Found 295000 records...
Found 296000 records...
Found 297000 records...
Found 298000 records...
Found 299000 records...
Found 3e+05 records...
Found 301000 records...
Found 302000 records...
Found 303000 records...
Found 304000 records...
Found 305000 records...
Found 306000 records...
Found 307000 records...
Found 308000 records...
Found 309000 records...
Found 310000 records...
Found 311000 records...
Found 312000 records...
Found 313000 records...
Found 314000 records...
Found 315000 records...
Found 316000 records...
Found 317000 records...
Found 318000 records...
Found 319000 records...
Found 320000 records...
Found 321000 records...
Found 322000 records...
Found 323000 records...
Found 324000 records...
Found 325000 records...
Found 326000 records...
Found 327000 records...
Found 328000 records...
Found 329000 records...
Found 330000 records...
Found 331000 records...
Found 332000 records...
Found 333000 records...
Found 334000 records...
Found 335000 records...
Found 336000 records...
Found 337000 records...
Found 338000 records...
Found 339000 records...
Found 340000 records...
Found 341000 records...
Found 342000 records...
Found 343000 records...
Found 344000 records...
Found 345000 records...
Found 346000 records...
Found 347000 records...
Found 348000 records...
Found 349000 records...
Found 350000 records...
Found 351000 records...
Found 352000 records...
Found 353000 records...
Found 354000 records...
Found 355000 records...
Found 356000 records...
Found 357000 records...
Found 358000 records...
Found 359000 records...
Found 360000 records...
Found 361000 records...
Found 362000 records...
Found 363000 records...
Found 364000 records...
Found 365000 records...
Found 366000 records...
Found 367000 records...
Found 368000 records...
Found 369000 records...
Found 370000 records...
Found 371000 records...
Found 372000 records...
Found 373000 records...
Found 374000 records...
Found 375000 records...
Found 376000 records...
Found 377000 records...
Found 378000 records...
Found 379000 records...
Found 380000 records...
Found 381000 records...
Found 382000 records...
Found 383000 records...
Found 384000 records...
Found 385000 records...
Found 386000 records...
Found 387000 records...
Found 388000 records...
Found 389000 records...
Found 390000 records...
Found 391000 records...
Found 392000 records...
Found 393000 records...
Found 394000 records...
Found 395000 records...
Found 396000 records...
Found 397000 records...
Found 398000 records...
Found 399000 records...
Found 4e+05 records...
Found 401000 records...
Found 402000 records...
Found 403000 records...
Found 404000 records...
Found 405000 records...
Found 406000 records...
Found 407000 records...
Found 408000 records...
Found 409000 records...
Found 410000 records...
Found 411000 records...
Found 412000 records...
Found 413000 records...
Found 414000 records...
Found 415000 records...
Found 416000 records...
Found 417000 records...
Found 418000 records...
Found 419000 records...
Found 420000 records...
Found 421000 records...
Found 422000 records...
Found 423000 records...
Found 424000 records...
Found 425000 records...
Found 426000 records...
Found 427000 records...
Found 428000 records...
Found 429000 records...
Found 430000 records...
Found 431000 records...
Found 432000 records...
Found 433000 records...
Found 434000 records...
Found 435000 records...
Found 436000 records...
Found 437000 records...
Found 438000 records...
Found 439000 records...
Found 440000 records...
Found 441000 records...
Found 442000 records...
Found 443000 records...
Found 444000 records...
Found 445000 records...
Found 446000 records...
Found 447000 records...
Found 448000 records...
Found 449000 records...
Found 450000 records...
Found 451000 records...
Found 452000 records...
Found 453000 records...
Found 454000 records...
Found 455000 records...
Found 456000 records...
Found 457000 records...
Found 458000 records...
Found 459000 records...
Found 460000 records...
Found 461000 records...
Found 462000 records...
Found 463000 records...
Found 464000 records...
Found 465000 records...
Found 466000 records...
Found 467000 records...
Found 468000 records...
Found 469000 records...
Found 470000 records...
Found 471000 records...
Found 472000 records...
Found 473000 records...
Found 474000 records...
Found 475000 records...
Found 476000 records...
Found 477000 records...
Found 478000 records...
Found 479000 records...
Found 480000 records...
Found 481000 records...
Found 482000 records...
Found 483000 records...
Found 484000 records...
Found 485000 records...
Found 486000 records...
Found 487000 records...
Found 488000 records...
Found 489000 records...
Found 490000 records...
Found 491000 records...
Found 492000 records...
Found 493000 records...
Found 494000 records...
Found 495000 records...
Found 496000 records...
Found 497000 records...
Found 498000 records...
Found 499000 records...
Found 5e+05 records...
Found 501000 records...
Found 502000 records...
Found 503000 records...
Found 504000 records...
Found 505000 records...
Found 506000 records...
Found 507000 records...
Found 508000 records...
Found 509000 records...
Found 510000 records...
Found 511000 records...
Found 512000 records...
Found 513000 records...
Found 514000 records...
Found 515000 records...
Found 516000 records...
Found 517000 records...
Found 518000 records...
Found 519000 records...
Found 520000 records...
Found 521000 records...
Found 522000 records...
Found 523000 records...
Found 524000 records...
Found 525000 records...
Found 526000 records...
Found 527000 records...
Found 528000 records...
Found 529000 records...
Found 530000 records...
Found 531000 records...
Found 532000 records...
Found 533000 records...
Found 534000 records...
Found 535000 records...
Found 536000 records...
Found 537000 records...
Found 538000 records...
Found 539000 records...
Found 540000 records...
Found 541000 records...
Found 542000 records...
Found 543000 records...
Found 544000 records...
Found 545000 records...
Found 546000 records...
Found 547000 records...
Found 548000 records...
Found 549000 records...
Found 550000 records...
Found 551000 records...
Found 552000 records...
Found 553000 records...
Found 554000 records...
Found 555000 records...
Found 556000 records...
Found 557000 records...
Found 558000 records...
Found 559000 records...
Found 560000 records...
Found 561000 records...
Found 562000 records...
Found 563000 records...
Found 564000 records...
Found 565000 records...
Found 566000 records...
Found 567000 records...
Found 568000 records...
Found 569000 records...
Found 570000 records...
Found 571000 records...
Found 572000 records...
Found 573000 records...
Found 574000 records...
Found 575000 records...
Found 576000 records...
Found 577000 records...
Found 578000 records...
Found 579000 records...
Found 580000 records...
Found 581000 records...
Found 582000 records...
Found 583000 records...
Found 584000 records...
Found 585000 records...
Found 586000 records...
Found 587000 records...
Found 588000 records...
Found 589000 records...
Found 590000 records...
Found 591000 records...
Found 592000 records...
Found 593000 records...
Found 594000 records...
Found 595000 records...
Found 596000 records...
Found 597000 records...
Found 598000 records...
Found 599000 records...
Found 6e+05 records...
Found 601000 records...
Found 602000 records...
Found 603000 records...
Found 604000 records...
Found 605000 records...
Found 606000 records...
Found 607000 records...
Found 608000 records...
Found 609000 records...
Found 610000 records...
Found 611000 records...
Found 612000 records...
Found 613000 records...
Found 614000 records...
Found 615000 records...
Found 616000 records...
Found 617000 records...
Found 618000 records...
Found 619000 records...
Found 620000 records...
Found 621000 records...
Found 622000 records...
Found 623000 records...
Found 624000 records...
Found 625000 records...
Found 626000 records...
Found 627000 records...
Found 628000 records...
Found 629000 records...
Found 630000 records...
Found 631000 records...
Found 632000 records...
Found 633000 records...
Found 634000 records...
Found 635000 records...
Found 636000 records...
Found 637000 records...
Found 638000 records...
Found 639000 records...
Found 640000 records...
Found 641000 records...
Found 642000 records...
Found 643000 records...
Found 644000 records...
Found 645000 records...
Found 646000 records...
Found 647000 records...
Found 648000 records...
Found 649000 records...
Found 650000 records...
Found 651000 records...
Found 652000 records...
Found 653000 records...
Found 654000 records...
Found 655000 records...
Found 656000 records...
Found 657000 records...
Found 658000 records...
Found 659000 records...
Found 660000 records...
Found 661000 records...
Found 662000 records...
Found 663000 records...
Found 664000 records...
Found 665000 records...
Found 666000 records...
Found 667000 records...
Found 668000 records...
Found 669000 records...
Found 670000 records...
Found 671000 records...
Found 672000 records...
Found 673000 records...
Found 674000 records...
Found 675000 records...
Found 676000 records...
Found 677000 records...
Found 678000 records...
Found 679000 records...
Found 680000 records...
Found 681000 records...
Found 682000 records...
Found 683000 records...
Found 684000 records...
Found 685000 records...
Found 686000 records...
Found 687000 records...
Found 688000 records...
Found 689000 records...
Found 690000 records...
Found 691000 records...
Found 692000 records...
Found 693000 records...
Found 694000 records...
Found 695000 records...
Found 696000 records...
Found 697000 records...
Found 698000 records...
Found 699000 records...
Found 7e+05 records...
Found 701000 records...
Found 702000 records...
Found 703000 records...
Found 704000 records...
Found 705000 records...
Found 706000 records...
Found 707000 records...
Found 708000 records...
Found 709000 records...
Found 710000 records...
Found 711000 records...
Found 712000 records...
Found 713000 records...
Found 714000 records...
Found 715000 records...
Found 716000 records...
Found 717000 records...
Found 718000 records...
Found 719000 records...
Found 720000 records...
Found 721000 records...
Found 722000 records...
Found 723000 records...
Found 724000 records...
Found 725000 records...
Found 726000 records...
Found 727000 records...
Found 728000 records...
Found 729000 records...
Found 730000 records...
Found 731000 records...
Found 732000 records...
Found 733000 records...
Found 734000 records...
Found 735000 records...
Found 736000 records...
Found 737000 records...
Found 738000 records...
Found 739000 records...
Found 740000 records...
Found 741000 records...
Found 742000 records...
Found 743000 records...
Found 744000 records...
Found 745000 records...
Found 746000 records...
Found 747000 records...
Found 748000 records...
Found 749000 records...
Found 750000 records...
Found 751000 records...
Found 752000 records...
Found 753000 records...
Found 754000 records...
Found 755000 records...
Found 756000 records...
Found 757000 records...
Found 758000 records...
Found 759000 records...
Found 760000 records...
Found 761000 records...
Found 762000 records...
Found 763000 records...
Found 764000 records...
Found 765000 records...
Found 766000 records...
Found 767000 records...
Found 768000 records...
Found 769000 records...
Found 770000 records...
Found 771000 records...
Found 772000 records...
Found 773000 records...
Found 774000 records...
Found 775000 records...
Found 776000 records...
Found 777000 records...
Found 778000 records...
Found 779000 records...
Found 780000 records...
Found 781000 records...
Found 782000 records...
Found 783000 records...
Found 784000 records...
Found 785000 records...
Found 786000 records...
Found 787000 records...
Found 788000 records...
Found 789000 records...
Found 790000 records...
Found 791000 records...
Found 792000 records...
Found 793000 records...
Found 794000 records...
Found 795000 records...
Found 796000 records...
Found 797000 records...
Found 798000 records...
Found 799000 records...
Found 8e+05 records...
Found 801000 records...
Found 802000 records...
Found 803000 records...
Found 804000 records...
Found 805000 records...
Found 806000 records...
Found 807000 records...
Found 808000 records...
Found 809000 records...
Found 810000 records...
Found 811000 records...
Found 812000 records...
Found 813000 records...
Found 814000 records...
Found 815000 records...
Found 816000 records...
Found 817000 records...
Found 818000 records...
Found 819000 records...
Found 820000 records...
Found 821000 records...
Found 822000 records...
Found 823000 records...
Found 824000 records...
Found 825000 records...
Found 826000 records...
Found 827000 records...
Found 828000 records...
Found 829000 records...
Found 830000 records...
Found 831000 records...
Found 832000 records...
Found 833000 records...
Found 834000 records...
Found 835000 records...
Found 836000 records...
Found 837000 records...
Found 838000 records...
Found 839000 records...
Found 840000 records...
Found 841000 records...
Found 842000 records...
Found 843000 records...
Found 844000 records...
Found 845000 records...
Found 846000 records...
Found 847000 records...
Found 848000 records...
Found 849000 records...
Found 850000 records...
Found 851000 records...
Found 852000 records...
Found 853000 records...
Found 854000 records...
Found 855000 records...
Found 856000 records...
Found 857000 records...
Found 858000 records...
Found 859000 records...
Found 860000 records...
Found 861000 records...
Found 862000 records...
Found 863000 records...
Found 864000 records...
Found 865000 records...
Found 866000 records...
Found 867000 records...
Found 868000 records...
Found 869000 records...
Found 870000 records...
Found 871000 records...
Found 872000 records...
Found 873000 records...
Found 874000 records...
Found 875000 records...
Found 876000 records...
Found 877000 records...
Found 878000 records...
Found 879000 records...
Found 880000 records...
Found 881000 records...
Found 882000 records...
Found 883000 records...
Found 884000 records...
Found 885000 records...
Found 886000 records...
Found 887000 records...
Found 888000 records...
Found 889000 records...
Found 890000 records...
Found 891000 records...
Found 892000 records...
Found 893000 records...
Found 894000 records...
Found 895000 records...
Found 896000 records...
Found 897000 records...
Found 898000 records...
Found 899000 records...
Found 9e+05 records...
Found 901000 records...
Found 902000 records...
Found 903000 records...
Found 904000 records...
Found 905000 records...
Found 906000 records...
Found 907000 records...
Found 908000 records...
Found 909000 records...
Found 910000 records...
Found 911000 records...
Found 912000 records...
Found 913000 records...
Found 914000 records...
Found 915000 records...
Found 916000 records...
Found 917000 records...
Found 918000 records...
Found 919000 records...
Found 920000 records...
Found 921000 records...
Found 922000 records...
Found 923000 records...
Found 924000 records...
Found 925000 records...
Found 926000 records...
Found 927000 records...
Found 928000 records...
Found 929000 records...
Found 930000 records...
Found 931000 records...
Found 932000 records...
Found 933000 records...
Found 934000 records...
Found 935000 records...
Found 936000 records...
Found 937000 records...
Found 938000 records...
Found 939000 records...
Found 940000 records...
Found 941000 records...
Found 942000 records...
Found 943000 records...
Found 944000 records...
Found 945000 records...
Found 946000 records...
Found 947000 records...
Found 948000 records...
Found 949000 records...
Found 950000 records...
Found 951000 records...
Found 952000 records...
Found 953000 records...
Found 954000 records...
Found 955000 records...
Found 956000 records...
Found 957000 records...
Found 958000 records...
Found 959000 records...
Found 960000 records...
Found 961000 records...
Found 962000 records...
Found 963000 records...
Found 964000 records...
Found 965000 records...
Found 966000 records...
Found 967000 records...
Found 968000 records...
Found 969000 records...
Found 970000 records...
Found 971000 records...
Found 972000 records...
Found 973000 records...
Found 974000 records...
Found 975000 records...
Found 976000 records...
Found 977000 records...
Found 978000 records...
Found 979000 records...
Found 980000 records...
Found 981000 records...
Found 982000 records...
Found 983000 records...
Found 984000 records...
Found 985000 records...
Found 986000 records...
Found 987000 records...
Found 988000 records...
Found 989000 records...
Found 990000 records...
Found 991000 records...
Found 992000 records...
Found 993000 records...
Found 994000 records...
Found 995000 records...
Found 996000 records...
Found 997000 records...
Found 998000 records...
Found 999000 records...
Found 1e+06 records...
Found 1001000 records...
Found 1002000 records...
Found 1003000 records...
Found 1004000 records...
Found 1005000 records...
Found 1006000 records...
Found 1007000 records...
Found 1008000 records...
Found 1009000 records...
Found 1010000 records...
Found 1010328 records...
Imported 1010328 records. Simplifying into dataframe...kable(head(mydata1))| year | month | day | dep_time | dep_delay | arr_time | arr_delay | carrier | tailnum | flight | origin | dest | air_time | distance | hour | minute |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2013 | 1 | 1 | 517 | 2 | 830 | 11 | UA | N14228 | 1545 | EWR | IAH | 227 | 1400 | 5 | 17 |
| 2013 | 1 | 1 | 533 | 4 | 850 | 20 | UA | N24211 | 1714 | LGA | IAH | 227 | 1416 | 5 | 33 |
| 2013 | 1 | 1 | 542 | 2 | 923 | 33 | AA | N619AA | 1141 | JFK | MIA | 160 | 1089 | 5 | 42 |
| 2013 | 1 | 1 | 544 | -1 | 1004 | -18 | B6 | N804JB | 725 | JFK | BQN | 183 | 1576 | 5 | 44 |
| 2013 | 1 | 1 | 554 | -6 | 812 | -25 | DL | N668DN | 461 | LGA | ATL | 116 | 762 | 6 | 54 |
| 2013 | 1 | 1 | 554 | -4 | 740 | 12 | UA | N39463 | 1696 | EWR | ORD | 150 | 719 | 6 | 54 |
| load th | e rest o | f the | datasets in | to the dataf | rame |
mongo1<- mongo(collection = "airlines", db = "airlinesdb", url = "mongodb://localhost",
verbose = TRUE,options = ssl_options())
mongo1$insert(airlines)##
Complete! Processed total of 16 rows.## List of 5
## $ nInserted : num 16
## $ nMatched : num 0
## $ nRemoved : num 0
## $ nUpserted : num 0
## $ writeErrors: list()mongo1<- mongo(collection = "airports", db = "airportsdb", url = "mongodb://localhost",
verbose = TRUE,options = ssl_options())
mongo1$insert(airports)##
Processed 1000 rows...
Complete! Processed total of 1397 rows.## List of 5
## $ nInserted : num 1397
## $ nMatched : num 0
## $ nRemoved : num 0
## $ nUpserted : num 0
## $ writeErrors: list()mongo1<- mongo(collection = "planes", db = "planesdb", url = "mongodb://localhost",
verbose = TRUE,options = ssl_options())
mongo1$insert(planes)##
Processed 1000 rows...
Processed 2000 rows...
Processed 3000 rows...
Complete! Processed total of 3322 rows.## List of 5
## $ nInserted : num 3322
## $ nMatched : num 0
## $ nRemoved : num 0
## $ nUpserted : num 0
## $ writeErrors: list()try another quary
mydata2 = mongo1$find('{}')##
Found 1000 records...
Found 2000 records...
Found 3000 records...
Found 4000 records...
Found 5000 records...
Found 6000 records...
Found 7000 records...
Found 8000 records...
Found 9000 records...
Found 9966 records...
Imported 9966 records. Simplifying into dataframe...I found this assigment to be very difficult! It was tricky to figure out how to install Mongo DB onto my computer and get the server up and running. I’m not sure I can still really tell the differences between using MySQL and NoSQL, but here are some things I’ve researched:
NoSQL: -better for big data -Non-Relational means table-less: NoSQL databases are non-relational, meaning they are easier to manage and provide a higher level of flexiblity -easier scalability -Lack of standardization
MySQL: -Better for structured data -Rational database -Larger community around the product.