US Storms with the most harmful public health and economic consequences
Rashad Ahammed
January 25, 2023
Synopsis
This is an analysis of the U.S. National Oceanic and Atmospheric Administration’s (NOAA) storm database, with the goal of determining which types of storm events have the most harmful impact on 1) population health and 2) the economy across the U.S. The data comes from the national weather service and includes storm events starting in 1950 up through November 2011. The count of injuries and fatalities for each storm type was used as a measure of the harm to public health, and the analysis showed that both heat and excessive heat were most harmful to publich health in terms of both injuries and fatalities. To measure the economic impact, the total US dollar value in damages was used, and the results showed that hurricanes had the highest median damage value of all storm types along with the second highest mean, which suggests that any given hurricane has the most likelihood of having a negative impact on the economy.
Data Processing
Lets load some packages that we will use throughout the analysis for cleaning, graphing, and presenting the data.
library(dplyr)##
## Attaching package: 'dplyr'## The following objects are masked from 'package:stats':
##
## filter, lag## The following objects are masked from 'package:base':
##
## intersect, setdiff, setequal, unionlibrary(ggplot2)
library(xtable)The first step in our analysis is pulling the data from the Coursera website, storing it in a dataframe, and caching the result since it’s a moderately large dataset:
data_url <- "https://d396qusza40orc.cloudfront.net/repdata%2Fdata%2FStormData.csv.bz2"
download.file(data_url,"NOAAdata.csv.bz2", method="curl")
storms <- read.csv("NOAAdata.csv.bz2",stringsAsFactors = FALSE)Let’s quickly check the structure of the dataset to see what fields are available and compare to the online documentation about the storm database.
str(storms)## 'data.frame': 902297 obs. of 37 variables:
## $ STATE__ : num 1 1 1 1 1 1 1 1 1 1 ...
## $ BGN_DATE : chr "4/18/1950 0:00:00" "4/18/1950 0:00:00" "2/20/1951 0:00:00" "6/8/1951 0:00:00" ...
## $ BGN_TIME : chr "0130" "0145" "1600" "0900" ...
## $ TIME_ZONE : chr "CST" "CST" "CST" "CST" ...
## $ COUNTY : num 97 3 57 89 43 77 9 123 125 57 ...
## $ COUNTYNAME: chr "MOBILE" "BALDWIN" "FAYETTE" "MADISON" ...
## $ STATE : chr "AL" "AL" "AL" "AL" ...
## $ EVTYPE : chr "TORNADO" "TORNADO" "TORNADO" "TORNADO" ...
## $ BGN_RANGE : num 0 0 0 0 0 0 0 0 0 0 ...
## $ BGN_AZI : chr "" "" "" "" ...
## $ BGN_LOCATI: chr "" "" "" "" ...
## $ END_DATE : chr "" "" "" "" ...
## $ END_TIME : chr "" "" "" "" ...
## $ COUNTY_END: num 0 0 0 0 0 0 0 0 0 0 ...
## $ COUNTYENDN: logi NA NA NA NA NA NA ...
## $ END_RANGE : num 0 0 0 0 0 0 0 0 0 0 ...
## $ END_AZI : chr "" "" "" "" ...
## $ END_LOCATI: chr "" "" "" "" ...
## $ LENGTH : num 14 2 0.1 0 0 1.5 1.5 0 3.3 2.3 ...
## $ WIDTH : num 100 150 123 100 150 177 33 33 100 100 ...
## $ F : int 3 2 2 2 2 2 2 1 3 3 ...
## $ MAG : num 0 0 0 0 0 0 0 0 0 0 ...
## $ FATALITIES: num 0 0 0 0 0 0 0 0 1 0 ...
## $ INJURIES : num 15 0 2 2 2 6 1 0 14 0 ...
## $ PROPDMG : num 25 2.5 25 2.5 2.5 2.5 2.5 2.5 25 25 ...
## $ PROPDMGEXP: chr "K" "K" "K" "K" ...
## $ CROPDMG : num 0 0 0 0 0 0 0 0 0 0 ...
## $ CROPDMGEXP: chr "" "" "" "" ...
## $ WFO : chr "" "" "" "" ...
## $ STATEOFFIC: chr "" "" "" "" ...
## $ ZONENAMES : chr "" "" "" "" ...
## $ LATITUDE : num 3040 3042 3340 3458 3412 ...
## $ LONGITUDE : num 8812 8755 8742 8626 8642 ...
## $ LATITUDE_E: num 3051 0 0 0 0 ...
## $ LONGITUDE_: num 8806 0 0 0 0 ...
## $ REMARKS : chr "" "" "" "" ...
## $ REFNUM : num 1 2 3 4 5 6 7 8 9 10 ...The dataset appears to have information about a few major categories: location, time span, fatalities/injuries, and damage. Since we know that we want to identify the types of events that have the biggest impact on population health and the economy, we will focus on the fatalities/injuries, damage, and storm event type data.
storms_final_fields <- storms %>%
select(EVTYPE, FATALITIES, INJURIES, PROPDMG:CROPDMGEXP, REMARKS)Let’s look at each of our fields to see what kind of preprocessing we may need to do: ### EVTYPE
storm_types <- storms_final_fields %>% count(EVTYPE) %>% arrange(-n)
storm_types## EVTYPE n
## 1 HAIL 288661
## 2 TSTM WIND 219940
## 3 THUNDERSTORM WIND 82563
## 4 TORNADO 60652
## 5 FLASH FLOOD 54277
## 6 FLOOD 25326
## 7 THUNDERSTORM WINDS 20843
## 8 HIGH WIND 20212
## 9 LIGHTNING 15754
## 10 HEAVY SNOW 15708
## 11 HEAVY RAIN 11723
## 12 WINTER STORM 11433
## 13 WINTER WEATHER 7026
## 14 FUNNEL CLOUD 6839
## 15 MARINE TSTM WIND 6175
## 16 MARINE THUNDERSTORM WIND 5812
## 17 WATERSPOUT 3796
## 18 STRONG WIND 3566
## 19 URBAN/SML STREAM FLD 3392
## 20 WILDFIRE 2761
## 21 BLIZZARD 2719
## 22 DROUGHT 2488
## 23 ICE STORM 2006
## 24 EXCESSIVE HEAT 1678
## 25 HIGH WINDS 1533
## 26 WILD/FOREST FIRE 1457
## 27 FROST/FREEZE 1342
## 28 DENSE FOG 1293
## 29 WINTER WEATHER/MIX 1104
## 30 TSTM WIND/HAIL 1028
## 31 EXTREME COLD/WIND CHILL 1002
## 32 HEAT 767
## 33 HIGH SURF 725
## 34 TROPICAL STORM 690
## 35 FLASH FLOODING 682
## 36 EXTREME COLD 655
## 37 COASTAL FLOOD 650
## 38 LAKE-EFFECT SNOW 636
## 39 FLOOD/FLASH FLOOD 624
## 40 LANDSLIDE 600
## 41 SNOW 587
## 42 COLD/WIND CHILL 539
## 43 FOG 538
## 44 RIP CURRENT 470
## 45 MARINE HAIL 442
## 46 DUST STORM 427
## 47 AVALANCHE 386
## 48 WIND 340
## 49 RIP CURRENTS 304
## 50 STORM SURGE 261
## 51 FREEZING RAIN 250
## 52 URBAN FLOOD 249
## 53 HEAVY SURF/HIGH SURF 228
## 54 EXTREME WINDCHILL 204
## 55 STRONG WINDS 196
## 56 DRY MICROBURST 186
## 57 ASTRONOMICAL LOW TIDE 174
## 58 HURRICANE 174
## 59 RIVER FLOOD 173
## 60 LIGHT SNOW 154
## 61 STORM SURGE/TIDE 148
## 62 RECORD WARMTH 146
## 63 COASTAL FLOODING 143
## 64 DUST DEVIL 141
## 65 MARINE HIGH WIND 135
## 66 UNSEASONABLY WARM 126
## 67 FLOODING 120
## 68 ASTRONOMICAL HIGH TIDE 103
## 69 MODERATE SNOWFALL 101
## 70 URBAN FLOODING 98
## 71 WINTRY MIX 90
## 72 HURRICANE/TYPHOON 88
## 73 FUNNEL CLOUDS 87
## 74 HEAVY SURF 84
## 75 RECORD HEAT 81
## 76 FREEZE 74
## 77 HEAT WAVE 74
## 78 COLD 72
## 79 RECORD COLD 64
## 80 ICE 61
## 81 THUNDERSTORM WINDS HAIL 61
## 82 TROPICAL DEPRESSION 60
## 83 SLEET 59
## 84 UNSEASONABLY DRY 56
## 85 FROST 53
## 86 GUSTY WINDS 53
## 87 THUNDERSTORM WINDSS 51
## 88 MARINE STRONG WIND 48
## 89 OTHER 48
## 90 SMALL HAIL 47
## 91 FUNNEL 46
## 92 FREEZING FOG 45
## 93 THUNDERSTORM 45
## 94 Temperature record 43
## 95 TSTM WIND (G45) 39
## 96 Coastal Flooding 38
## 97 WATERSPOUTS 37
## 98 MONTHLY PRECIPITATION 36
## 99 WINDS 36
## 100 MIXED PRECIPITATION 34
## 101 SNOW AND ICE 33
## 102 FLASH FLOODS 32
## 103 GLAZE 32
## 104 HEAVY SNOW SQUALLS 32
## 105 Snow 30
## 106 URBAN/SMALL STREAM FLOOD 30
## 107 HAIL 75 29
## 108 ICY ROADS 28
## 109 WIND DAMAGE 27
## 110 HEAVY RAINS 26
## 111 EXCESSIVE SNOW 25
## 112 HEAVY LAKE SNOW 25
## 113 RIVER FLOODING 24
## 114 THUNDERSTORM WINDS/HAIL 24
## 115 GUSTY WIND 23
## 116 LAKESHORE FLOOD 23
## 117 LIGHT FREEZING RAIN 23
## 118 SEVERE THUNDERSTORMS 23
## 119 UNSEASONABLY COLD 23
## 120 EXTREME HEAT 22
## 121 FLASH FLOOD/FLOOD 22
## 122 VOLCANIC ASH 22
## 123 LAKE EFFECT SNOW 21
## 124 Light Snow 21
## 125 SEICHE 21
## 126 FREEZING DRIZZLE 20
## 127 TIDAL FLOODING 20
## 128 TSUNAMI 20
## 129 EXTREME WINDCHILL TEMPERATURES 19
## 130 SNOW SQUALL 19
## 131 TORNADO F0 19
## 132 UNSEASONABLY WET 19
## 133 Winter Weather 19
## 134 HAIL 0.75 18
## 135 WIND CHILL 18
## 136 PROLONG COLD 17
## 137 SNOW SQUALLS 17
## 138 SNOW/ICE STORM 17
## 139 Heavy Rain 16
## 140 RAIN 16
## 141 HEAVY SNOW-SQUALLS 15
## 142 BLACK ICE 14
## 143 RECORD RAINFALL 14
## 144 THUNDERSTORMS WINDS 14
## 145 DROUGHT/EXCESSIVE HEAT 13
## 146 HAIL 100 13
## 147 HAIL 175 13
## 148 SEVERE THUNDERSTORM 13
## 149 UNSEASONABLY WARM AND DRY 13
## 150 BLOWING SNOW 12
## 151 SLEET STORM 12
## 152 UNSEASONABLY COOL 12
## 153 WIND ADVISORY 12
## 154 Glaze 11
## 155 MONTHLY RAINFALL 11
## 156 Record temperature 11
## 157 SMOKE 11
## 158 SNOW FREEZING RAIN 11
## 159 TYPHOON 11
## 160 Cold 10
## 161 DENSE SMOKE 10
## 162 Gusty Winds 10
## 163 MIXED PRECIP 10
## 164 SNOW/SLEET 10
## 165 TSTM WIND (G40) 10
## 166 UNSEASONABLY HOT 10
## 167 UNUSUAL WARMTH 10
## 168 WATERSPOUT- 10
## 169 DRY 9
## 170 FIRST SNOW 9
## 171 FREEZING RAIN/SLEET 9
## 172 HEAVY RAINS/FLOODING 9
## 173 HURRICANE OPAL 9
## 174 High Surf 9
## 175 MUDSLIDE 9
## 176 COASTAL STORM 8
## 177 Dust Devil 8
## 178 FLASH FLOODING/FLOOD 8
## 179 GRADIENT WINDS 8
## 180 HEAVY MIX 8
## 181 HIGH SEAS 8
## 182 LANDSLIDES 8
## 183 Mudslide 8
## 184 RECORD SNOW 8
## 185 Record Warmth 8
## 186 UNUSUALLY COLD 8
## 187 URBAN/SMALL STREAM 8
## 188 WATERSPOUT/TORNADO 8
## 189 WILDFIRES 8
## 190 Freezing Rain 7
## 191 HARD FREEZE 7
## 192 HURRICANE ERIN 7
## 193 LOW TEMPERATURE 7
## 194 MUD SLIDE 7
## 195 NON SEVERE HAIL 7
## 196 SMALL STREAM FLOOD 7
## 197 SNOW DROUGHT 7
## 198 SNOW/BLOWING SNOW 7
## 199 SNOW/ICE 7
## 200 Strong Winds 7
## 201 THUNDERSTORM WINDS 7
## 202 THUNDERSTORM WINDS LIGHTNING 7
## 203 AGRICULTURAL FREEZE 6
## 204 COLD WIND CHILL TEMPERATURES 6
## 205 Coastal Flood 6
## 206 Cold and Frost 6
## 207 DAMAGING FREEZE 6
## 208 DRY CONDITIONS 6
## 209 EXTREME WIND CHILL 6
## 210 FLOOD/RAIN/WINDS 6
## 211 FREEZING RAIN AND SLEET 6
## 212 GUSTNADO 6
## 213 HAIL 1.00 6
## 214 HIGH WATER 6
## 215 HIGH WIND/BLIZZARD 6
## 216 RECORD SNOWFALL 6
## 217 SNOW SHOWERS 6
## 218 SNOW/FREEZING RAIN 6
## 219 SNOW/SLEET/FREEZING RAIN 6
## 220 THUNDERSTORMS WIND 6
## 221 TSTM WINDS 6
## 222 URBAN AND SMALL STREAM FLOODIN 6
## 223 WET MICROBURST 6
## 224 WINTER WEATHER MIX 6
## 225 Wind 6
## 226 COASTAL FLOODING/EROSION 5
## 227 DRY MICROBURST WINDS 5
## 228 EARLY SNOWFALL 5
## 229 EXCESSIVE RAIN 5
## 230 FLASH FLOOD FROM ICE JAMS 5
## 231 Funnel Cloud 5
## 232 GUSTY THUNDERSTORM WINDS 5
## 233 HEAVY SNOW/ICE 5
## 234 HIGH SWELLS 5
## 235 HIGH WINDS/COLD 5
## 236 ICE JAM FLOODING 5
## 237 MICROBURST 5
## 238 MICROBURST WINDS 5
## 239 Mudslides 5
## 240 Prolong Cold 5
## 241 RAIN/SNOW 5
## 242 RECORD COOL 5
## 243 RECORD HIGH 5
## 244 RECORD TEMPERATURE 5
## 245 ROTATING WALL CLOUD 5
## 246 River Flooding 5
## 247 SEVERE THUNDERSTORM WINDS 5
## 248 SMALL STREAM/URBAN FLOOD 5
## 249 SNOWMELT FLOODING 5
## 250 TSTM WIND 52 5
## 251 Tidal Flooding 5
## 252 WALL CLOUD 5
## 253 small hail 5
## 254 TSTM WIND 4
## 255 ABNORMAL WARMTH 4
## 256 ACCUMULATED SNOWFALL 4
## 257 BLOWING DUST 4
## 258 COLD AIR FUNNEL 4
## 259 COLD TEMPERATURES 4
## 260 COLD WEATHER 4
## 261 DAM BREAK 4
## 262 DRY SPELL 4
## 263 DRY WEATHER 4
## 264 EXCESSIVE RAINFALL 4
## 265 EXTREME/RECORD COLD 4
## 266 FREEZING RAIN/SNOW 4
## 267 Frost 4
## 268 Gradient wind 4
## 269 HAIL 1.75 4
## 270 HEAVY RAIN/WIND 4
## 271 HIGH SURF ADVISORY 4
## 272 Heavy Rain and Wind 4
## 273 ICE JAM 4
## 274 Icy Roads 4
## 275 MONTHLY TEMPERATURE 4
## 276 MUDSLIDES 4
## 277 Microburst 4
## 278 Other 4
## 279 PROLONG WARMTH 4
## 280 PROLONGED RAIN 4
## 281 RECORD LOW 4
## 282 ROUGH SURF 4
## 283 SMALL STREAM FLOODING 4
## 284 SNOW AND SLEET 4
## 285 Snow Squalls 4
## 286 THUNDERSTORM WIND 60 MPH 4
## 287 THUNDERSTORM WIND G50 4
## 288 THUNDERSTORM WIND/ TREES 4
## 289 THUNDERSTORMS 4
## 290 TORNADO F1 4
## 291 UNUSUALLY WARM 4
## 292 URBAN/SMALL STREAM FLOODING 4
## 293 WILD FIRES 4
## 294 Wet Month 4
## 295 Wet Year 4
## 296 Wind Damage 4
## 297 BEACH EROSION 3
## 298 BITTER WIND CHILL TEMPERATURES 3
## 299 BRUSH FIRE 3
## 300 Black Ice 3
## 301 Blowing Snow 3
## 302 COLD WAVE 3
## 303 EARLY SNOW 3
## 304 FLOOD FLASH 3
## 305 FLOODS 3
## 306 Freezing Drizzle 3
## 307 Freezing rain 3
## 308 GRADIENT WIND 3
## 309 GUSTY THUNDERSTORM WIND 3
## 310 HAIL 275 3
## 311 HAIL/WIND 3
## 312 HAILSTORM 3
## 313 HEAVY RAINFALL 3
## 314 HEAVY SNOW/BLIZZARD 3
## 315 HIGH TEMPERATURE RECORD 3
## 316 HIGH WAVES 3
## 317 HIGH WIND/HEAVY SNOW 3
## 318 HIGH WINDS/SNOW 3
## 319 HURRICANE-GENERATED SWELLS 3
## 320 HYPOTHERMIA/EXPOSURE 3
## 321 Heavy Surf 3
## 322 Heavy rain 3
## 323 Hypothermia/Exposure 3
## 324 ICE/SNOW 3
## 325 LIGHTING 3
## 326 Light Snow/Flurries 3
## 327 MAJOR FLOOD 3
## 328 MINOR FLOODING 3
## 329 Mixed Precipitation 3
## 330 NORMAL PRECIPITATION 3
## 331 PATCHY DENSE FOG 3
## 332 RECORD HIGH TEMPERATURE 3
## 333 RECORD TEMPERATURES 3
## 334 RECORD/EXCESSIVE HEAT 3
## 335 ROUGH SEAS 3
## 336 Record Cold 3
## 337 Record Winter Snow 3
## 338 STREET FLOOD 3
## 339 STREET FLOODING 3
## 340 Strong Wind 3
## 341 THUNDERSTORM WINDS. 3
## 342 THUNDERSTORMW WINDS 3
## 343 THUNDERTORM WINDS 3
## 344 TORNADO F2 3
## 345 TROPICAL STORM JERRY 3
## 346 TSTM HEAVY RAIN 3
## 347 TSTM WIND 55 3
## 348 URBAN AND SMALL STREAM 3
## 349 URBAN AND SMALL STREAM FLOOD 3
## 350 URBAN FLOODS 3
## 351 URBAN/STREET FLOODING 3
## 352 VOLCANIC ASHFALL 3
## 353 WIND GUSTS 3
## 354 WINTER MIX 3
## 355 WINTER STORMS 3
## 356 Wintry mix 3
## 357 ABNORMALLY DRY 2
## 358 BEACH FLOOD 2
## 359 BELOW NORMAL PRECIPITATION 2
## 360 BLIZZARD AND EXTREME WIND CHIL 2
## 361 BLIZZARD/HEAVY SNOW 2
## 362 BLOWING SNOW & EXTREME WIND CH 2
## 363 COASTAL SURGE 2
## 364 COASTAL/TIDAL FLOOD 2
## 365 COLD AIR FUNNELS 2
## 366 CSTL FLOODING/EROSION 2
## 367 Coastal Storm 2
## 368 Cold Temperature 2
## 369 DOWNBURST 2
## 370 DOWNBURST WINDS 2
## 371 DRY MICROBURST 58 2
## 372 Damaging Freeze 2
## 373 Early snowfall 2
## 374 Erosion/Cstl Flood 2
## 375 Excessive Cold 2
## 376 Extreme Cold 2
## 377 FALLING SNOW/ICE 2
## 378 FLASH FLOOD - HEAVY RAIN 2
## 379 FLASH FLOOD/ FLOOD 2
## 380 FLOOD & HEAVY RAIN 2
## 381 FLOOD/FLASH 2
## 382 FLOOD/FLASH FLOODING 2
## 383 Freeze 2
## 384 GLAZE ICE 2
## 385 GROUND BLIZZARD 2
## 386 Gusty winds 2
## 387 HAIL 150 2
## 388 HAIL 80 2
## 389 HAIL DAMAGE 2
## 390 HAIL/WINDS 2
## 391 HEAT WAVES 2
## 392 HEAVY RAIN/FLOODING 2
## 393 HEAVY RAIN/SEVERE WEATHER 2
## 394 HEAVY SEAS 2
## 395 HEAVY SHOWER 2
## 396 HEAVY SNOW AND HIGH WINDS 2
## 397 HEAVY SNOW AND ICE 2
## 398 HEAVY SNOW AND ICE STORM 2
## 399 HEAVY SNOW/FREEZING RAIN 2
## 400 HEAVY SNOW/ICE STORM 2
## 401 HEAVY SNOW/SQUALLS 2
## 402 HIGH TIDES 2
## 403 HIGH WIND (G40) 2
## 404 HIGH WIND AND HIGH TIDES 2
## 405 HIGH WIND DAMAGE 2
## 406 HIGH WINDS 63 2
## 407 HIGH WINDS 66 2
## 408 HIGH WINDS 80 2
## 409 HOT SPELL 2
## 410 HURRICANE FELIX 2
## 411 HVY RAIN 2
## 412 Heavy Precipitation 2
## 413 High Wind 2
## 414 Hot and Dry 2
## 415 Hurricane Edouard 2
## 416 ICE FLOES 2
## 417 Ice Fog 2
## 418 Ice/Snow 2
## 419 LANDSPOUT 2
## 420 LATE SNOW 2
## 421 LIGHT SNOW AND SLEET 2
## 422 Lake Effect Snow 2
## 423 Late Season Snowfall 2
## 424 MARINE MISHAP 2
## 425 Monthly Rainfall 2
## 426 NON TSTM WIND 2
## 427 NONE 2
## 428 RECORD COLD/FROST 2
## 429 RECORD DRYNESS 2
## 430 RECORD LOW RAINFALL 2
## 431 RED FLAG CRITERIA 2
## 432 RED FLAG FIRE WX 2
## 433 REMNANTS OF FLOYD 2
## 434 RIP CURRENTS/HEAVY SURF 2
## 435 RIVER AND STREAM FLOOD 2
## 436 ROCK SLIDE 2
## 437 RURAL FLOOD 2
## 438 Record High 2
## 439 Record Temperatures 2
## 440 SAHARAN DUST 2
## 441 SLEET/FREEZING RAIN 2
## 442 SLEET/SNOW 2
## 443 SMALL STREAM AND URBAN FLOOD 2
## 444 SNOW AND COLD 2
## 445 SNOW AND HEAVY SNOW 2
## 446 SNOW/COLD 2
## 447 SNOW/HIGH WINDS 2
## 448 STRONG WIND GUST 2
## 449 Saharan Dust 2
## 450 Sml Stream Fld 2
## 451 Summary August 10 2
## 452 Summary August 11 2
## 453 Summary September 23 2
## 454 Summary of April 12 2
## 455 Summary of April 21 2
## 456 Summary of June 13 2
## 457 Summary of June 3 2
## 458 Summary of March 23 2
## 459 Summary: Nov. 16 2
## 460 THUDERSTORM WINDS 2
## 461 THUNDEERSTORM WINDS 2
## 462 THUNDERSTORM DAMAGE 2
## 463 THUNDERSTORM WIND 50 2
## 464 THUNDERSTORM WIND G52 2
## 465 THUNDERSTORM WIND G60 2
## 466 THUNDERSTORM WINDS AND 2
## 467 THUNDERSTORM WINDS FUNNEL CLOU 2
## 468 THUNDERSTORM WINDS G 2
## 469 THUNDERSTORM WINDS/ FLOOD 2
## 470 THUNDERSTROM WINDS 2
## 471 THUNDESTORM WINDS 2
## 472 TORNADO F3 2
## 473 TORNADOES 2
## 474 TROPICAL STORM DEAN 2
## 475 TSTM WIND 51 2
## 476 Tstm Wind 2
## 477 UNSEASONABLY COOL & WET 2
## 478 UNSEASONABLY WARM YEAR 2
## 479 UNSEASONABLY WARM/WET 2
## 480 UNSEASONAL LOW TEMP 2
## 481 UNSEASONAL RAIN 2
## 482 UNUSUAL/RECORD WARMTH 2
## 483 URBAN AND SMALL 2
## 484 URBAN SMALL STREAM FLOOD 2
## 485 URBAN/SMALL 2
## 486 URBAN/SMALL STREAM FLOOD 2
## 487 VERY DRY 2
## 488 VOLCANIC ERUPTION 2
## 489 WAKE LOW WIND 2
## 490 WATERSPOUT-TORNADO 2
## 491 WATERSPOUT/ TORNADO 2
## 492 WINTERY MIX 2
## 493 Whirlwind 2
## 494 blowing snow 2
## 495 coastal flooding 2
## 496 gradient wind 2
## 497 HIGH SURF ADVISORY 1
## 498 COASTAL FLOOD 1
## 499 FLASH FLOOD 1
## 500 LIGHTNING 1
## 501 TSTM WIND (G45) 1
## 502 WATERSPOUT 1
## 503 WIND 1
## 504 ? 1
## 505 ABNORMALLY WET 1
## 506 APACHE COUNTY 1
## 507 AVALANCE 1
## 508 BEACH EROSIN 1
## 509 BEACH EROSION/COASTAL FLOOD 1
## 510 BITTER WIND CHILL 1
## 511 BLIZZARD AND HEAVY SNOW 1
## 512 BLIZZARD WEATHER 1
## 513 BLIZZARD/FREEZING RAIN 1
## 514 BLIZZARD/HIGH WIND 1
## 515 BLIZZARD/WINTER STORM 1
## 516 BLOW-OUT TIDE 1
## 517 BLOW-OUT TIDES 1
## 518 BLOWING SNOW- EXTREME WIND CHI 1
## 519 BLOWING SNOW/EXTREME WIND CHIL 1
## 520 BREAKUP FLOODING 1
## 521 BRUSH FIRES 1
## 522 Beach Erosion 1
## 523 Blizzard Summary 1
## 524 COASTAL FLOODING/EROSION 1
## 525 COASTAL EROSION 1
## 526 COASTALFLOOD 1
## 527 COASTALSTORM 1
## 528 COLD AIR TORNADO 1
## 529 COLD AND FROST 1
## 530 COLD AND SNOW 1
## 531 COLD AND WET CONDITIONS 1
## 532 COLD/WINDS 1
## 533 COOL AND WET 1
## 534 COOL SPELL 1
## 535 DAM FAILURE 1
## 536 DEEP HAIL 1
## 537 DRIEST MONTH 1
## 538 DROWNING 1
## 539 DRY HOT WEATHER 1
## 540 DRY MICROBURST 50 1
## 541 DRY MICROBURST 53 1
## 542 DRY MICROBURST 61 1
## 543 DRY MICROBURST 84 1
## 544 DRY MIRCOBURST WINDS 1
## 545 DRY PATTERN 1
## 546 DRYNESS 1
## 547 DUST DEVEL 1
## 548 DUST DEVIL WATERSPOUT 1
## 549 DUST STORM/HIGH WINDS 1
## 550 DUSTSTORM 1
## 551 Drifting Snow 1
## 552 EARLY FREEZE 1
## 553 EARLY FROST 1
## 554 EARLY RAIN 1
## 555 EXCESSIVE 1
## 556 EXCESSIVE HEAT/DROUGHT 1
## 557 EXCESSIVE PRECIPITATION 1
## 558 EXCESSIVE WETNESS 1
## 559 EXCESSIVELY DRY 1
## 560 EXTREME WIND CHILL/BLOWING SNO 1
## 561 EXTREME WIND CHILLS 1
## 562 EXTREMELY WET 1
## 563 Early Frost 1
## 564 Extended Cold 1
## 565 FIRST FROST 1
## 566 FLASH FLOOD LANDSLIDES 1
## 567 FLASH FLOOD WINDS 1
## 568 FLASH FLOOD/ 1
## 569 FLASH FLOOD/ STREET 1
## 570 FLASH FLOOD/HEAVY RAIN 1
## 571 FLASH FLOOD/LANDSLIDE 1
## 572 FLASH FLOODING/THUNDERSTORM WI 1
## 573 FLASH FLOOODING 1
## 574 FLOOD FLOOD/FLASH 1
## 575 FLOOD WATCH/ 1
## 576 FLOOD/FLASH/FLOOD 1
## 577 FLOOD/FLASHFLOOD 1
## 578 FLOOD/RAIN/WIND 1
## 579 FLOOD/RIVER FLOOD 1
## 580 FLOODING/HEAVY RAIN 1
## 581 FOG AND COLD TEMPERATURES 1
## 582 FOREST FIRES 1
## 583 FREEZING DRIZZLE AND FREEZING 1
## 584 FREEZING RAIN AND SNOW 1
## 585 FREEZING RAIN SLEET AND 1
## 586 FREEZING RAIN SLEET AND LIGHT 1
## 587 FROST\\FREEZE 1
## 588 FUNNEL CLOUD. 1
## 589 FUNNEL CLOUD/HAIL 1
## 590 FUNNELS 1
## 591 Flood 1
## 592 Flood/Flash Flood 1
## 593 Flood/Strong Wind 1
## 594 Freezing Fog 1
## 595 Freezing Spray 1
## 596 Freezing drizzle 1
## 597 Frost/Freeze 1
## 598 GLAZE/ICE STORM 1
## 599 GRASS FIRES 1
## 600 GUSTNADO AND 1
## 601 GUSTY LAKE WIND 1
## 602 GUSTY WIND/HAIL 1
## 603 GUSTY WIND/HVY RAIN 1
## 604 Gusty Wind 1
## 605 Gusty wind/rain 1
## 606 HAIL 0.88 1
## 607 HAIL 075 1
## 608 HAIL 088 1
## 609 HAIL 1.75) 1
## 610 HAIL 125 1
## 611 HAIL 200 1
## 612 HAIL 225 1
## 613 HAIL 450 1
## 614 HAIL 88 1
## 615 HAIL ALOFT 1
## 616 HAIL FLOODING 1
## 617 HAIL STORM 1
## 618 HAIL/ICY ROADS 1
## 619 HAILSTORMS 1
## 620 HAZARDOUS SURF 1
## 621 HEAT DROUGHT 1
## 622 HEAT WAVE DROUGHT 1
## 623 HEAT/DROUGHT 1
## 624 HEAVY PRECIPATATION 1
## 625 HEAVY PRECIPITATION 1
## 626 HEAVY RAIN AND FLOOD 1
## 627 HEAVY RAIN EFFECTS 1
## 628 HEAVY RAIN/LIGHTNING 1
## 629 HEAVY RAIN/MUDSLIDES/FLOOD 1
## 630 HEAVY RAIN/SMALL STREAM URBAN 1
## 631 HEAVY RAIN/SNOW 1
## 632 HEAVY RAIN/URBAN FLOOD 1
## 633 HEAVY RAIN; URBAN FLOOD WINDS; 1
## 634 HEAVY SHOWERS 1
## 635 HEAVY SNOW FREEZING RAIN 1
## 636 HEAVY SNOW & ICE 1
## 637 HEAVY SNOW AND 1
## 638 HEAVY SNOW AND STRONG WINDS 1
## 639 HEAVY SNOW ANDBLOWING SNOW 1
## 640 HEAVY SNOW/BLIZZARD/AVALANCHE 1
## 641 HEAVY SNOW/BLOWING SNOW 1
## 642 HEAVY SNOW/HIGH 1
## 643 HEAVY SNOW/HIGH WIND 1
## 644 HEAVY SNOW/HIGH WINDS 1
## 645 HEAVY SNOW/HIGH WINDS & FLOOD 1
## 646 HEAVY SNOW/HIGH WINDS/FREEZING 1
## 647 HEAVY SNOW/SLEET 1
## 648 HEAVY SNOW/WIND 1
## 649 HEAVY SNOW/WINTER STORM 1
## 650 HEAVY SNOWPACK 1
## 651 HEAVY SURF COASTAL FLOODING 1
## 652 HEAVY SWELLS 1
## 653 HEAVY WET SNOW 1
## 654 HIGH 1
## 655 HIGH SWELLS 1
## 656 HIGH WINDS 1
## 657 HIGH SURF ADVISORIES 1
## 658 HIGH WIND 48 1
## 659 HIGH WIND 63 1
## 660 HIGH WIND 70 1
## 661 HIGH WIND AND HEAVY SNOW 1
## 662 HIGH WIND AND SEAS 1
## 663 HIGH WIND/ BLIZZARD 1
## 664 HIGH WIND/BLIZZARD/FREEZING RA 1
## 665 HIGH WIND/LOW WIND CHILL 1
## 666 HIGH WIND/SEAS 1
## 667 HIGH WIND/WIND CHILL 1
## 668 HIGH WIND/WIND CHILL/BLIZZARD 1
## 669 HIGH WINDS 55 1
## 670 HIGH WINDS 57 1
## 671 HIGH WINDS 58 1
## 672 HIGH WINDS 67 1
## 673 HIGH WINDS 73 1
## 674 HIGH WINDS 76 1
## 675 HIGH WINDS 82 1
## 676 HIGH WINDS AND WIND CHILL 1
## 677 HIGH WINDS DUST STORM 1
## 678 HIGH WINDS HEAVY RAINS 1
## 679 HIGH WINDS/ 1
## 680 HIGH WINDS/COASTAL FLOOD 1
## 681 HIGH WINDS/FLOODING 1
## 682 HIGH WINDS/HEAVY RAIN 1
## 683 HIGHWAY FLOODING 1
## 684 HOT PATTERN 1
## 685 HOT WEATHER 1
## 686 HOT/DRY PATTERN 1
## 687 HURRICANE EMILY 1
## 688 HURRICANE GORDON 1
## 689 HURRICANE OPAL/HIGH WINDS 1
## 690 HYPERTHERMIA/EXPOSURE 1
## 691 HYPOTHERMIA 1
## 692 Hail(0.75) 1
## 693 Heat Wave 1
## 694 Heatburst 1
## 695 Heavy Rain/High Surf 1
## 696 Heavy snow shower 1
## 697 Heavy surf and wind 1
## 698 ICE AND SNOW 1
## 699 ICE ON ROAD 1
## 700 ICE PELLETS 1
## 701 ICE ROADS 1
## 702 ICE STORM AND SNOW 1
## 703 ICE STORM/FLASH FLOOD 1
## 704 ICE/STRONG WINDS 1
## 705 Ice jam flood (minor 1
## 706 Icestorm/Blizzard 1
## 707 LACK OF SNOW 1
## 708 LAKE FLOOD 1
## 709 LANDSLIDE/URBAN FLOOD 1
## 710 LANDSLUMP 1
## 711 LARGE WALL CLOUD 1
## 712 LATE FREEZE 1
## 713 LATE SEASON HAIL 1
## 714 LATE SEASON SNOW 1
## 715 LIGHT SNOW/FREEZING PRECIP 1
## 716 LIGHTNING WAUSEON 1
## 717 LIGHTNING AND HEAVY RAIN 1
## 718 LIGHTNING AND THUNDERSTORM WIN 1
## 719 LIGHTNING AND WINDS 1
## 720 LIGHTNING DAMAGE 1
## 721 LIGHTNING FIRE 1
## 722 LIGHTNING INJURY 1
## 723 LIGHTNING THUNDERSTORM WINDS 1
## 724 LIGHTNING THUNDERSTORM WINDSS 1
## 725 LIGHTNING. 1
## 726 LIGHTNING/HEAVY RAIN 1
## 727 LIGNTNING 1
## 728 LOCAL FLASH FLOOD 1
## 729 LOCAL FLOOD 1
## 730 LOCALLY HEAVY RAIN 1
## 731 LOW TEMPERATURE RECORD 1
## 732 LOW WIND CHILL 1
## 733 Landslump 1
## 734 Late-season Snowfall 1
## 735 Light Snowfall 1
## 736 Light snow 1
## 737 MILD PATTERN 1
## 738 MILD/DRY PATTERN 1
## 739 MINOR FLOOD 1
## 740 MODERATE SNOW 1
## 741 MONTHLY SNOWFALL 1
## 742 MUD SLIDES 1
## 743 MUD SLIDES URBAN FLOODING 1
## 744 MUD/ROCK SLIDE 1
## 745 MUDSLIDE/LANDSLIDE 1
## 746 Marine Accident 1
## 747 Metro Storm, May 26 1
## 748 Mild and Dry Pattern 1
## 749 Minor Flooding 1
## 750 Monthly Snowfall 1
## 751 Mountain Snows 1
## 752 NEAR RECORD SNOW 1
## 753 NON-SEVERE WIND DAMAGE 1
## 754 NON-TSTM WIND 1
## 755 NORTHERN LIGHTS 1
## 756 No Severe Weather 1
## 757 PATCHY ICE 1
## 758 PROLONG COLD/SNOW 1
## 759 RAIN (HEAVY) 1
## 760 RAIN AND WIND 1
## 761 RAIN/WIND 1
## 762 RAINSTORM 1
## 763 RAPIDLY RISING WATER 1
## 764 RECORD COLD 1
## 765 RECORD COLD AND HIGH WIND 1
## 766 RECORD HEAT WAVE 1
## 767 RECORD HIGH TEMPERATURES 1
## 768 RECORD PRECIPITATION 1
## 769 RECORD SNOW/COLD 1
## 770 RECORD WARM 1
## 771 RECORD WARM TEMPS. 1
## 772 RECORD/EXCESSIVE RAINFALL 1
## 773 RIP CURRENTS HEAVY SURF 1
## 774 ROGUE WAVE 1
## 775 Rain Damage 1
## 776 Record Heat 1
## 777 Record May Snow 1
## 778 Record dry month 1
## 779 SEVERE COLD 1
## 780 SEVERE TURBULENCE 1
## 781 SLEET & FREEZING RAIN 1
## 782 SLEET/ICE STORM 1
## 783 SLEET/RAIN/SNOW 1
## 784 SMALL STREAM 1
## 785 SMALL STREAM AND 1
## 786 SMALL STREAM AND URBAN FLOODIN 1
## 787 SMALL STREAM URBAN FLOOD 1
## 788 SNOW ACCUMULATION 1
## 789 SNOW ADVISORY 1
## 790 SNOW AND ICE STORM 1
## 791 SNOW AND WIND 1
## 792 SNOW SLEET 1
## 793 SNOW- HIGH WIND- WIND CHILL 1
## 794 SNOW/ BITTER COLD 1
## 795 SNOW/ ICE 1
## 796 SNOW/HEAVY SNOW 1
## 797 SNOW/RAIN 1
## 798 SNOW/RAIN/SLEET 1
## 799 SNOW/SLEET/RAIN 1
## 800 SNOWFALL RECORD 1
## 801 SNOWSTORM 1
## 802 SNOW\\COLD 1
## 803 SOUTHEAST 1
## 804 STORM FORCE WINDS 1
## 805 STREAM FLOODING 1
## 806 SUMMARY OF MARCH 24-25 1
## 807 SUMMARY OF MARCH 27 1
## 808 SUMMARY OF MARCH 29 1
## 809 Seasonal Snowfall 1
## 810 Small Hail 1
## 811 Snow Accumulation 1
## 812 Snow and Ice 1
## 813 Snow and sleet 1
## 814 Snow squalls 1
## 815 Strong winds 1
## 816 Summary August 17 1
## 817 Summary August 2-3 1
## 818 Summary August 21 1
## 819 Summary August 28 1
## 820 Summary August 4 1
## 821 Summary August 7 1
## 822 Summary August 9 1
## 823 Summary Jan 17 1
## 824 Summary July 23-24 1
## 825 Summary June 18-19 1
## 826 Summary June 5-6 1
## 827 Summary June 6 1
## 828 Summary Sept. 25-26 1
## 829 Summary September 20 1
## 830 Summary September 3 1
## 831 Summary September 4 1
## 832 Summary of April 13 1
## 833 Summary of April 27 1
## 834 Summary of April 3rd 1
## 835 Summary of August 1 1
## 836 Summary of July 11 1
## 837 Summary of July 2 1
## 838 Summary of July 22 1
## 839 Summary of July 26 1
## 840 Summary of July 29 1
## 841 Summary of July 3 1
## 842 Summary of June 10 1
## 843 Summary of June 11 1
## 844 Summary of June 12 1
## 845 Summary of June 15 1
## 846 Summary of June 16 1
## 847 Summary of June 18 1
## 848 Summary of June 23 1
## 849 Summary of June 24 1
## 850 Summary of June 30 1
## 851 Summary of June 4 1
## 852 Summary of June 6 1
## 853 Summary of March 14 1
## 854 Summary of March 24 1
## 855 Summary of May 10 1
## 856 Summary of May 13 1
## 857 Summary of May 14 1
## 858 Summary of May 22 1
## 859 Summary of May 22 am 1
## 860 Summary of May 22 pm 1
## 861 Summary of May 26 am 1
## 862 Summary of May 26 pm 1
## 863 Summary of May 31 am 1
## 864 Summary of May 31 pm 1
## 865 Summary of May 9-10 1
## 866 Summary: Nov. 6-7 1
## 867 Summary: Oct. 20-21 1
## 868 Summary: October 31 1
## 869 Summary: Sept. 18 1
## 870 THUNDERESTORM WINDS 1
## 871 THUNDERSNOW 1
## 872 THUNDERSTORM DAMAGE TO 1
## 873 THUNDERSTORM HAIL 1
## 874 THUNDERSTORM W INDS 1
## 875 THUNDERSTORM WIND (G40) 1
## 876 THUNDERSTORM WIND 52 1
## 877 THUNDERSTORM WIND 56 1
## 878 THUNDERSTORM WIND 59 1
## 879 THUNDERSTORM WIND 59 MPH 1
## 880 THUNDERSTORM WIND 59 MPH. 1
## 881 THUNDERSTORM WIND 65 MPH 1
## 882 THUNDERSTORM WIND 65MPH 1
## 883 THUNDERSTORM WIND 69 1
## 884 THUNDERSTORM WIND 98 MPH 1
## 885 THUNDERSTORM WIND G51 1
## 886 THUNDERSTORM WIND G55 1
## 887 THUNDERSTORM WIND G61 1
## 888 THUNDERSTORM WIND TREES 1
## 889 THUNDERSTORM WIND. 1
## 890 THUNDERSTORM WIND/ TREE 1
## 891 THUNDERSTORM WIND/AWNING 1
## 892 THUNDERSTORM WIND/HAIL 1
## 893 THUNDERSTORM WIND/LIGHTNING 1
## 894 THUNDERSTORM WINDS LE CEN 1
## 895 THUNDERSTORM WINDS 13 1
## 896 THUNDERSTORM WINDS 2 1
## 897 THUNDERSTORM WINDS 50 1
## 898 THUNDERSTORM WINDS 52 1
## 899 THUNDERSTORM WINDS 53 1
## 900 THUNDERSTORM WINDS 60 1
## 901 THUNDERSTORM WINDS 61 1
## 902 THUNDERSTORM WINDS 62 1
## 903 THUNDERSTORM WINDS 63 MPH 1
## 904 THUNDERSTORM WINDS G60 1
## 905 THUNDERSTORM WINDS HEAVY RAIN 1
## 906 THUNDERSTORM WINDS SMALL STREA 1
## 907 THUNDERSTORM WINDS URBAN FLOOD 1
## 908 THUNDERSTORM WINDS/ HAIL 1
## 909 THUNDERSTORM WINDS/FLASH FLOOD 1
## 910 THUNDERSTORM WINDS/FLOODING 1
## 911 THUNDERSTORM WINDS/FUNNEL CLOU 1
## 912 THUNDERSTORM WINDS/HEAVY RAIN 1
## 913 THUNDERSTORM WINDS53 1
## 914 THUNDERSTORM WINDSHAIL 1
## 915 THUNDERSTORM WINS 1
## 916 THUNDERSTORMW 1
## 917 THUNDERSTORMW 50 1
## 918 THUNDERSTORMWINDS 1
## 919 THUNDERSTROM WIND 1
## 920 THUNDERTSORM WIND 1
## 921 THUNERSTORM WINDS 1
## 922 TIDAL FLOOD 1
## 923 TORNADO DEBRIS 1
## 924 TORNADO/WATERSPOUT 1
## 925 TORNADOES, TSTM WIND, HAIL 1
## 926 TORNADOS 1
## 927 TORNDAO 1
## 928 TORRENTIAL RAIN 1
## 929 TROPICAL STORM ALBERTO 1
## 930 TROPICAL STORM GORDON 1
## 931 TSTM 1
## 932 TSTM WIND (G45) 1
## 933 TSTM WIND (41) 1
## 934 TSTM WIND (G35) 1
## 935 TSTM WIND 40 1
## 936 TSTM WIND 45 1
## 937 TSTM WIND 50 1
## 938 TSTM WIND 65) 1
## 939 TSTM WIND AND LIGHTNING 1
## 940 TSTM WIND DAMAGE 1
## 941 TSTM WIND G45 1
## 942 TSTM WIND G58 1
## 943 TSTM WND 1
## 944 TSTMW 1
## 945 TUNDERSTORM WIND 1
## 946 Thundersnow shower 1
## 947 Thunderstorm Wind 1
## 948 Torrential Rainfall 1
## 949 UNSEASONABLY WARM & WET 1
## 950 UNUSUALLY LATE SNOW 1
## 951 URBAN FLOOD LANDSLIDE 1
## 952 URBAN SMALL 1
## 953 URBAN/SMALL FLOODING 1
## 954 URBAN/SMALL STRM FLDG 1
## 955 URBAN/SML STREAM FLDG 1
## 956 Unseasonable Cold 1
## 957 Urban Flood 1
## 958 Urban Flooding 1
## 959 Urban flood 1
## 960 VERY WARM 1
## 961 VOG 1
## 962 Volcanic Ash 1
## 963 Volcanic Ash Plume 1
## 964 WALL CLOUD/FUNNEL CLOUD 1
## 965 WARM DRY CONDITIONS 1
## 966 WARM WEATHER 1
## 967 WATER SPOUT 1
## 968 WATERSPOUT FUNNEL CLOUD 1
## 969 WATERSPOUT TORNADO 1
## 970 WATERSPOUT/ 1
## 971 WAYTERSPOUT 1
## 972 WET SNOW 1
## 973 WET WEATHER 1
## 974 WHIRLWIND 1
## 975 WILD/FOREST FIRES 1
## 976 WIND AND WAVE 1
## 977 WIND CHILL/HIGH WIND 1
## 978 WIND STORM 1
## 979 WIND/HAIL 1
## 980 WINTER STORM HIGH WINDS 1
## 981 WINTER STORM/HIGH WIND 1
## 982 WINTER STORM/HIGH WINDS 1
## 983 WND 1
## 984 Wintry Mix 1
## 985 wet micoburst 1summary(storm_types$n)## Min. 1st Qu. Median Mean 3rd Qu. Max.
## 1 1 2 916 5 288661We can see that there are 985 different labels for storms, and looking at the summary of the counts for each type, at least 75% of the labels have occurences of 5 or less. We will need to go through and clean up some of the labels, but let’s see if we can reduce the total number of labels by focusing on the types of storms that effect population health or the economy. ### Population Health factors According to the National Weather Service Documentation, Direct fatalities and injuries from storms are classified in the FATALITIES and INJURIES columns. We will use these columns without any additional processing to evaluate population health. ### Economic factors There are four fields that are utilized to provide information about the economic impact of the storms: PROPDMG, PROPDMGEXP, CROPDMG, and CROPDMGEXP. Both PROPDMG and CROPDMG list the damage amounts for property and crops, respectively, and the other two columns give a unit of measure. We will need to combine the values and unit of measure columns to compare damage across all storms. Let’s check out the different units of measure:
table(storms_final_fields$PROPDMGEXP)##
## - ? + 0 1 2 3 4 5 6
## 465934 1 8 5 216 25 13 4 4 28 4
## 7 8 B h H K m M
## 5 1 40 1 6 424665 7 11330table(storms_final_fields$CROPDMGEXP)##
## ? 0 2 B k K m M
## 618413 7 19 1 9 21 281832 1 1994From these tables we can see units of measure for thousands (k/K), millions (M/m), and billions (B/b). I will also assume that (h/H) is hundreds, and we will have to investigate the (?,-,+) and the single number values:
check_uom <- c('?','+','-','0','1','2','3','4','5','6','7','8')
questions <- storms_final_fields %>% filter((PROPDMGEXP %in% check_uom) |
(CROPDMGEXP %in% check_uom))After looking into all the strange units of measure it appears that there isn’t any specific pattern to having a number as the unit of measure, but there are multiple instances in the Remarks that mentions damage of some kind. Since the most common unit of measure by far is thousands, I will simply replace any of these strange units of measure with thousands.
storms_clean <- storms_final_fields %>%
mutate(PROPDMGEXP = ifelse(PROPDMGEXP %in% check_uom, 'K',
toupper(PROPDMGEXP)),
CROPDMGEXP = ifelse(CROPDMGEXP %in% check_uom, 'K',
toupper(CROPDMGEXP)))
## Replace the units of measure with numbers
clean_uom <- data.frame(old_uom = c('H','K','M','B',''),
new_uom = c(100,1000,1000000,1000000000,0))
storms_clean <- storms_clean %>% left_join(clean_uom,
by = c('PROPDMGEXP' = 'old_uom'))
storms_clean <- storms_clean %>% left_join(clean_uom,
by = c('CROPDMGEXP' = 'old_uom'))
storms_clean <- storms_clean %>% mutate(TOTDMG = PROPDMG * new_uom.x +
CROPDMG * new_uom.y)
storms_final <- storms_clean %>% select(EVTYPE, FATALITIES, INJURIES, TOTDMG)
head(storms_final)## EVTYPE FATALITIES INJURIES TOTDMG
## 1 TORNADO 0 15 25000
## 2 TORNADO 0 0 2500
## 3 TORNADO 0 2 25000
## 4 TORNADO 0 2 2500
## 5 TORNADO 0 2 2500
## 6 TORNADO 0 6 2500Now that we have clean measures of damage, injuries, and fatalities, all that is left to do is clean the EVTYPE for analysis. Let’s examine only the EVTYPEs that have had damage, fatalities, or injuries:
storm_types_new <- storms_final %>%
filter((FATALITIES > 0) | (INJURIES > 0) | (TOTDMG > 0)) %>%
count(EVTYPE) %>% arrange(-n)
storm_types_new## EVTYPE n
## 1 TSTM WIND 63234
## 2 THUNDERSTORM WIND 43654
## 3 TORNADO 39943
## 4 HAIL 26124
## 5 FLASH FLOOD 20948
## 6 LIGHTNING 13293
## 7 THUNDERSTORM WINDS 12052
## 8 FLOOD 10173
## 9 HIGH WIND 5522
## 10 STRONG WIND 3370
## 11 WINTER STORM 1508
## 12 HEAVY SNOW 1342
## 13 HEAVY RAIN 1105
## 14 WILDFIRE 857
## 15 ICE STORM 708
## 16 URBAN/SML STREAM FLD 702
## 17 EXCESSIVE HEAT 698
## 18 HIGH WINDS 656
## 19 TSTM WIND/HAIL 441
## 20 TROPICAL STORM 416
## 21 WINTER WEATHER 407
## 22 RIP CURRENT 400
## 23 WILD/FOREST FIRE 388
## 24 FLASH FLOODING 301
## 25 FLOOD/FLASH FLOOD 279
## 26 AVALANCHE 268
## 27 DROUGHT 266
## 28 BLIZZARD 253
## 29 RIP CURRENTS 241
## 30 HEAT 215
## 31 EXTREME COLD 197
## 32 LAKE-EFFECT SNOW 194
## 33 LANDSLIDE 193
## 34 STORM SURGE 177
## 35 COASTAL FLOOD 164
## 36 URBAN FLOOD 139
## 37 WINTER WEATHER/MIX 139
## 38 HIGH SURF 130
## 39 HURRICANE 129
## 40 LIGHT SNOW 119
## 41 FROST/FREEZE 116
## 42 EXTREME COLD/WIND CHILL 111
## 43 MARINE TSTM WIND 109
## 44 FOG 107
## 45 RIVER FLOOD 107
## 46 DUST STORM 103
## 47 COLD/WIND CHILL 90
## 48 DUST DEVIL 89
## 49 WIND 83
## 50 URBAN FLOODING 80
## 51 DRY MICROBURST 78
## 52 DENSE FOG 74
## 53 HURRICANE/TYPHOON 72
## 54 FLOODING 58
## 55 COASTAL FLOODING 55
## 56 SNOW 52
## 57 HEAVY SURF/HIGH SURF 50
## 58 STRONG WINDS 50
## 59 STORM SURGE/TIDE 47
## 60 WATERSPOUT 47
## 61 MARINE STRONG WIND 46
## 62 THUNDERSTORM WINDS HAIL 37
## 63 TSTM WIND (G45) 36
## 64 FREEZING RAIN 35
## 65 TROPICAL DEPRESSION 35
## 66 HEAT WAVE 34
## 67 THUNDERSTORM WINDSS 34
## 68 MARINE THUNDERSTORM WIND 33
## 69 OTHER 33
## 70 COLD 32
## 71 HEAVY SURF 30
## 72 EXCESSIVE SNOW 25
## 73 ICE 24
## 74 ICY ROADS 22
## 75 LIGHT FREEZING RAIN 22
## 76 THUNDERSTORM WINDS/HAIL 22
## 77 GUSTY WINDS 21
## 78 Light Snow 21
## 79 HEAVY RAINS 20
## 80 HEAVY SNOW SQUALLS 20
## 81 EXTREME WINDCHILL 19
## 82 GLAZE 19
## 83 MARINE HIGH WIND 19
## 84 THUNDERSTORM 19
## 85 WINDS 18
## 86 EXTREME HEAT 17
## 87 FLASH FLOOD/FLOOD 16
## 88 FREEZE 16
## 89 SNOW SQUALL 16
## 90 HEAVY SNOW-SQUALLS 15
## 91 MIXED PRECIPITATION 15
## 92 TSUNAMI 14
## 93 FLASH FLOODS 13
## 94 FUNNEL CLOUD 13
## 95 GUSTY WIND 13
## 96 RIVER FLOODING 13
## 97 SMALL HAIL 11
## 98 DROUGHT/EXCESSIVE HEAT 10
## 99 Gusty Winds 10
## 100 SNOW FREEZING RAIN 10
## 101 SNOW SQUALLS 10
## 102 HEAVY RAINS/FLOODING 9
## 103 SEICHE 9
## 104 TSTM WIND (G40) 9
## 105 TYPHOON 9
## 106 URBAN/SMALL STREAM FLOOD 9
## 107 ASTRONOMICAL HIGH TIDE 8
## 108 FLASH FLOODING/FLOOD 8
## 109 HEAVY MIX 8
## 110 HIGH SEAS 8
## 111 HURRICANE OPAL 8
## 112 WIND DAMAGE 8
## 113 FREEZING FOG 7
## 114 FROST 7
## 115 HURRICANE ERIN 7
## 116 LOW TEMPERATURE 7
## 117 SEVERE THUNDERSTORM 7
## 118 UNSEASONABLY WARM 7
## 119 WATERSPOUT- 7
## 120 Coastal Flooding 6
## 121 Cold 6
## 122 Dust Devil 6
## 123 High Surf 6
## 124 MIXED PRECIP 6
## 125 RAIN 6
## 126 THUNDERSTORM WINDS LIGHTNING 6
## 127 THUNDERSTORMS WINDS 6
## 128 WATERSPOUT/TORNADO 6
## 129 FLASH FLOOD FROM ICE JAMS 5
## 130 FLOOD/RAIN/WINDS 5
## 131 GUSTNADO 5
## 132 HIGH WINDS/COLD 5
## 133 ICE JAM FLOODING 5
## 134 LAKESHORE FLOOD 5
## 135 RECORD COLD 5
## 136 River Flooding 5
## 137 SNOW/SLEET 5
## 138 TORNADO F0 5
## 139 TSTM WINDS 5
## 140 COLD WEATHER 4
## 141 Coastal Flood 4
## 142 DAMAGING FREEZE 4
## 143 FREEZING DRIZZLE 4
## 144 FREEZING RAIN/SNOW 4
## 145 HIGH WATER 4
## 146 MUDSLIDE 4
## 147 THUNDERSTORM WIND/ TREES 4
## 148 TORNADO F1 4
## 149 UNSEASONABLY COLD 4
## 150 WILD FIRES 4
## 151 AGRICULTURAL FREEZE 3
## 152 BRUSH FIRE 3
## 153 COASTAL FLOODING/EROSION 3
## 154 COASTAL STORM 3
## 155 FLOODS 3
## 156 Gradient wind 3
## 157 HAIL 275 3
## 158 HAILSTORM 3
## 159 HEAVY SNOW/ICE 3
## 160 HIGH WINDS/SNOW 3
## 161 HURRICANE-GENERATED SWELLS 3
## 162 HYPOTHERMIA/EXPOSURE 3
## 163 Hypothermia/Exposure 3
## 164 LAKE EFFECT SNOW 3
## 165 LANDSLIDES 3
## 166 MAJOR FLOOD 3
## 167 MICROBURST 3
## 168 MUD SLIDE 3
## 169 Mixed Precipitation 3
## 170 ROUGH SEAS 3
## 171 SEVERE THUNDERSTORM WINDS 3
## 172 SNOW AND ICE 3
## 173 THUNDERSTORM WINDS 3
## 174 THUNDERSTORMS WIND 3
## 175 THUNDERTORM WINDS 3
## 176 TIDAL FLOODING 3
## 177 WET MICROBURST 3
## 178 WILDFIRES 3
## 179 WINTRY MIX 3
## 180 TSTM WIND 2
## 181 ASTRONOMICAL LOW TIDE 2
## 182 Cold Temperature 2
## 183 DAM BREAK 2
## 184 Damaging Freeze 2
## 185 Erosion/Cstl Flood 2
## 186 Extreme Cold 2
## 187 FALLING SNOW/ICE 2
## 188 FLASH FLOOD - HEAVY RAIN 2
## 189 FLOOD & HEAVY RAIN 2
## 190 Freeze 2
## 191 Freezing Drizzle 2
## 192 GLAZE ICE 2
## 193 GROUND BLIZZARD 2
## 194 Glaze 2
## 195 HAIL 175 2
## 196 HAIL/WIND 2
## 197 HAIL/WINDS 2
## 198 HARD FREEZE 2
## 199 HEAVY SEAS 2
## 200 HEAVY SNOW/SQUALLS 2
## 201 HIGH SWELLS 2
## 202 HIGH WIND (G40) 2
## 203 HIGH WIND DAMAGE 2
## 204 Heavy Surf 2
## 205 ICE FLOES 2
## 206 LANDSPOUT 2
## 207 MARINE HAIL 2
## 208 MARINE MISHAP 2
## 209 MINOR FLOODING 2
## 210 Mudslide 2
## 211 RAIN/SNOW 2
## 212 RECORD HEAT 2
## 213 RECORD SNOW 2
## 214 RIP CURRENTS/HEAVY SURF 2
## 215 RIVER AND STREAM FLOOD 2
## 216 ROUGH SURF 2
## 217 SEVERE THUNDERSTORMS 2
## 218 SNOW AND HEAVY SNOW 2
## 219 SNOW/COLD 2
## 220 SNOW/FREEZING RAIN 2
## 221 SNOW/HIGH WINDS 2
## 222 SNOW/ICE STORM 2
## 223 SNOW/SLEET/FREEZING RAIN 2
## 224 SNOWMELT FLOODING 2
## 225 Snow 2
## 226 Snow Squalls 2
## 227 Strong Wind 2
## 228 Strong Winds 2
## 229 THUNDERSTORM WIND 60 MPH 2
## 230 THUNDERSTORM WINDS/ FLOOD 2
## 231 TORNADO F2 2
## 232 TORNADO F3 2
## 233 TORNADOES 2
## 234 TROPICAL STORM JERRY 2
## 235 TSTM WIND 55 2
## 236 UNSEASONAL RAIN 2
## 237 URBAN FLOODS 2
## 238 VOLCANIC ASH 2
## 239 WINTER WEATHER MIX 2
## 240 Whirlwind 2
## 241 gradient wind 2
## 242 HIGH SURF ADVISORY 1
## 243 FLASH FLOOD 1
## 244 TSTM WIND (G45) 1
## 245 ? 1
## 246 APACHE COUNTY 1
## 247 AVALANCE 1
## 248 BLACK ICE 1
## 249 BLIZZARD/WINTER STORM 1
## 250 BLOWING DUST 1
## 251 BLOWING SNOW 1
## 252 BREAKUP FLOODING 1
## 253 Beach Erosion 1
## 254 COASTAL FLOODING/EROSION 1
## 255 COASTAL EROSION 1
## 256 COASTAL SURGE 1
## 257 COASTALSTORM 1
## 258 COLD AIR TORNADO 1
## 259 COLD AND SNOW 1
## 260 COLD AND WET CONDITIONS 1
## 261 COLD WAVE 1
## 262 COLD/WINDS 1
## 263 COOL AND WET 1
## 264 Coastal Storm 1
## 265 DENSE SMOKE 1
## 266 DOWNBURST 1
## 267 DROWNING 1
## 268 DRY MIRCOBURST WINDS 1
## 269 DUST DEVIL WATERSPOUT 1
## 270 DUST STORM/HIGH WINDS 1
## 271 EXCESSIVE RAINFALL 1
## 272 EXCESSIVE WETNESS 1
## 273 EXTREME WIND CHILL 1
## 274 Early Frost 1
## 275 Extended Cold 1
## 276 FLASH FLOOD LANDSLIDES 1
## 277 FLASH FLOOD/ 1
## 278 FLASH FLOOD/ STREET 1
## 279 FLASH FLOOD/LANDSLIDE 1
## 280 FLASH FLOODING/THUNDERSTORM WI 1
## 281 FLOOD FLASH 1
## 282 FLOOD/FLASH 1
## 283 FLOOD/FLASH/FLOOD 1
## 284 FLOOD/FLASHFLOOD 1
## 285 FLOOD/RIVER FLOOD 1
## 286 FLOODING/HEAVY RAIN 1
## 287 FOG AND COLD TEMPERATURES 1
## 288 FOREST FIRES 1
## 289 FREEZING RAIN/SLEET 1
## 290 FROST\\FREEZE 1
## 291 Freezing Rain 1
## 292 Freezing Spray 1
## 293 Freezing drizzle 1
## 294 Frost/Freeze 1
## 295 GLAZE/ICE STORM 1
## 296 GRADIENT WIND 1
## 297 GRASS FIRES 1
## 298 GUSTY WIND/HAIL 1
## 299 GUSTY WIND/HVY RAIN 1
## 300 Gusty wind/rain 1
## 301 Gusty winds 1
## 302 HAIL 0.75 1
## 303 HAIL 075 1
## 304 HAIL 100 1
## 305 HAIL 125 1
## 306 HAIL 150 1
## 307 HAIL 200 1
## 308 HAIL 450 1
## 309 HAIL 75 1
## 310 HAIL DAMAGE 1
## 311 HAZARDOUS SURF 1
## 312 HEAT WAVE DROUGHT 1
## 313 HEAT WAVES 1
## 314 HEAVY LAKE SNOW 1
## 315 HEAVY PRECIPITATION 1
## 316 HEAVY RAIN AND FLOOD 1
## 317 HEAVY RAIN/LIGHTNING 1
## 318 HEAVY RAIN/SEVERE WEATHER 1
## 319 HEAVY RAIN/SMALL STREAM URBAN 1
## 320 HEAVY RAIN/SNOW 1
## 321 HEAVY SHOWER 1
## 322 HEAVY SNOW AND HIGH WINDS 1
## 323 HEAVY SNOW AND STRONG WINDS 1
## 324 HEAVY SNOW/BLIZZARD 1
## 325 HEAVY SNOW/BLIZZARD/AVALANCHE 1
## 326 HEAVY SNOW/FREEZING RAIN 1
## 327 HEAVY SNOW/HIGH WINDS & FLOOD 1
## 328 HEAVY SNOW/WIND 1
## 329 HEAVY SNOW/WINTER STORM 1
## 330 HEAVY SNOWPACK 1
## 331 HEAVY SURF COASTAL FLOODING 1
## 332 HEAVY SWELLS 1
## 333 HIGH 1
## 334 HIGH WINDS 1
## 335 HIGH TIDES 1
## 336 HIGH WAVES 1
## 337 HIGH WIND 48 1
## 338 HIGH WIND AND SEAS 1
## 339 HIGH WIND/BLIZZARD 1
## 340 HIGH WIND/HEAVY SNOW 1
## 341 HIGH WIND/SEAS 1
## 342 HIGH WINDS HEAVY RAINS 1
## 343 HIGH WINDS/ 1
## 344 HIGH WINDS/COASTAL FLOOD 1
## 345 HIGH WINDS/HEAVY RAIN 1
## 346 HURRICANE EMILY 1
## 347 HURRICANE FELIX 1
## 348 HURRICANE GORDON 1
## 349 HURRICANE OPAL/HIGH WINDS 1
## 350 HVY RAIN 1
## 351 HYPERTHERMIA/EXPOSURE 1
## 352 HYPOTHERMIA 1
## 353 Heat Wave 1
## 354 Heavy Rain/High Surf 1
## 355 Heavy snow shower 1
## 356 Heavy surf and wind 1
## 357 Hurricane Edouard 1
## 358 ICE AND SNOW 1
## 359 ICE JAM 1
## 360 ICE ON ROAD 1
## 361 ICE ROADS 1
## 362 ICE STORM/FLASH FLOOD 1
## 363 ICE/STRONG WINDS 1
## 364 Ice jam flood (minor 1
## 365 LAKE FLOOD 1
## 366 LATE SEASON SNOW 1
## 367 LIGHTING 1
## 368 LIGHTNING WAUSEON 1
## 369 LIGHTNING AND HEAVY RAIN 1
## 370 LIGHTNING AND THUNDERSTORM WIN 1
## 371 LIGHTNING FIRE 1
## 372 LIGHTNING INJURY 1
## 373 LIGHTNING THUNDERSTORM WINDS 1
## 374 LIGHTNING. 1
## 375 LIGHTNING/HEAVY RAIN 1
## 376 LIGNTNING 1
## 377 Lake Effect Snow 1
## 378 Landslump 1
## 379 Light Snowfall 1
## 380 Light snow 1
## 381 MICROBURST WINDS 1
## 382 MUD SLIDES 1
## 383 MUD SLIDES URBAN FLOODING 1
## 384 MUDSLIDES 1
## 385 Marine Accident 1
## 386 Microburst 1
## 387 Mudslides 1
## 388 NON TSTM WIND 1
## 389 NON-SEVERE WIND DAMAGE 1
## 390 NON-TSTM WIND 1
## 391 Other 1
## 392 RAIN/WIND 1
## 393 RAINSTORM 1
## 394 RAPIDLY RISING WATER 1
## 395 RECORD RAINFALL 1
## 396 RECORD/EXCESSIVE HEAT 1
## 397 ROCK SLIDE 1
## 398 ROGUE WAVE 1
## 399 RURAL FLOOD 1
## 400 SEVERE TURBULENCE 1
## 401 SLEET 1
## 402 SLEET/ICE STORM 1
## 403 SMALL STREAM FLOOD 1
## 404 SNOW ACCUMULATION 1
## 405 SNOW AND ICE STORM 1
## 406 SNOW/ BITTER COLD 1
## 407 SNOW/ ICE 1
## 408 SNOW/BLOWING SNOW 1
## 409 SNOW/HEAVY SNOW 1
## 410 SNOW/ICE 1
## 411 STORM FORCE WINDS 1
## 412 THUDERSTORM WINDS 1
## 413 THUNDEERSTORM WINDS 1
## 414 THUNDERESTORM WINDS 1
## 415 THUNDERSNOW 1
## 416 THUNDERSTORM DAMAGE TO 1
## 417 THUNDERSTORM HAIL 1
## 418 THUNDERSTORM WIND (G40) 1
## 419 THUNDERSTORM WIND 65 MPH 1
## 420 THUNDERSTORM WIND 65MPH 1
## 421 THUNDERSTORM WIND 98 MPH 1
## 422 THUNDERSTORM WIND G50 1
## 423 THUNDERSTORM WIND G52 1
## 424 THUNDERSTORM WIND G55 1
## 425 THUNDERSTORM WIND G60 1
## 426 THUNDERSTORM WIND TREES 1
## 427 THUNDERSTORM WIND. 1
## 428 THUNDERSTORM WIND/ TREE 1
## 429 THUNDERSTORM WIND/AWNING 1
## 430 THUNDERSTORM WIND/HAIL 1
## 431 THUNDERSTORM WIND/LIGHTNING 1
## 432 THUNDERSTORM WINDS 13 1
## 433 THUNDERSTORM WINDS 63 MPH 1
## 434 THUNDERSTORM WINDS AND 1
## 435 THUNDERSTORM WINDS G60 1
## 436 THUNDERSTORM WINDS. 1
## 437 THUNDERSTORM WINDS/FLOODING 1
## 438 THUNDERSTORM WINDS/FUNNEL CLOU 1
## 439 THUNDERSTORM WINDS53 1
## 440 THUNDERSTORM WINDSHAIL 1
## 441 THUNDERSTORM WINS 1
## 442 THUNDERSTORMS 1
## 443 THUNDERSTORMW 1
## 444 THUNDERSTORMWINDS 1
## 445 THUNDERSTROM WIND 1
## 446 THUNERSTORM WINDS 1
## 447 TORNADOES, TSTM WIND, HAIL 1
## 448 TORNDAO 1
## 449 TROPICAL STORM ALBERTO 1
## 450 TROPICAL STORM DEAN 1
## 451 TROPICAL STORM GORDON 1
## 452 TSTM WIND (G45) 1
## 453 TSTM WIND (41) 1
## 454 TSTM WIND (G35) 1
## 455 TSTM WIND 40 1
## 456 TSTM WIND 45 1
## 457 TSTM WIND 65) 1
## 458 TSTM WIND AND LIGHTNING 1
## 459 TSTM WIND DAMAGE 1
## 460 TSTM WIND G45 1
## 461 TSTM WIND G58 1
## 462 TSTMW 1
## 463 TUNDERSTORM WIND 1
## 464 Tidal Flooding 1
## 465 Torrential Rainfall 1
## 466 Tstm Wind 1
## 467 UNSEASONABLY WARM AND DRY 1
## 468 URBAN AND SMALL 1
## 469 URBAN AND SMALL STREAM FLOODIN 1
## 470 URBAN SMALL 1
## 471 URBAN/SMALL STREAM 1
## 472 Unseasonable Cold 1
## 473 WARM WEATHER 1
## 474 WATERSPOUT TORNADO 1
## 475 WATERSPOUT-TORNADO 1
## 476 WATERSPOUT/ TORNADO 1
## 477 WHIRLWIND 1
## 478 WILD/FOREST FIRES 1
## 479 WIND AND WAVE 1
## 480 WIND STORM 1
## 481 WIND/HAIL 1
## 482 WINTER STORM HIGH WINDS 1
## 483 WINTER STORMS 1
## 484 Wind 1
## 485 Wind Damage 1
## 486 Wintry Mix 1
## 487 blowing snow 1summary(storm_types_new$n)## Min. 1st Qu. Median Mean 3rd Qu. Max.
## 1.0 1.0 1.0 522.7 6.0 63234.0There are now only half as many storm categorizations, but we can make a few clean ups to try and consolidate them even more:
storms_final$EVTYPE_NEW <- gsub("TSTM ","THUNDERSTORM ",storms_final$EVTYPE)
storms_final$EVTYPE_NEW <- gsub("WINDS","WIND",storms_final$EVTYPE_NEW)
storms_final$EVTYPE_NEW <- toupper(storms_final$EVTYPE_NEW)There are many more cleanups that could be done, but if we also filter out all the storms that have less than 100 occurrences, we will have a much more clean data set.
storm_types_new <- storms_final %>%
filter((FATALITIES > 0) | (INJURIES > 0) | (TOTDMG > 0)) %>%
count(EVTYPE_NEW) %>% filter(n >= 100)
storms_final2 <- storms_final %>%
filter(EVTYPE_NEW %in% storm_types_new$EVTYPE_NEW)
perc_remain <- nrow(storms_final2)/nrow(storms_final)*100We lost some of the original data but still have 97.7552846% of the original data good for analysis.
Results
We can now use our clean storm data to analyze which storm types have the largest impact on population health and the economy on average. ### Analysis of Impact on Population Health To analyze which storm types most adversely affect population health we can analyze fatalities and injuries separately and combine our analysis as appropriate.
average_fatalities <- storms_final2 %>% group_by(EVTYPE_NEW) %>%
summarise(n = n(), AVG_FAT = round(mean(FATALITIES),2),
MED_FAT = median(FATALITIES),
MAX_FAT = max(FATALITIES)) %>%
arrange(-AVG_FAT) %>% top_n(10, wt = AVG_FAT)
average_fatalities_table <- xtable(average_fatalities)
print(average_fatalities_table, type = "html")| EVTYPE_NEW | n | AVG_FAT | MED_FAT | MAX_FAT | |
|---|---|---|---|---|---|
| 1 | HEAT | 767 | 1.22 | 0.00 | 583.00 |
| 2 | EXCESSIVE HEAT | 1678 | 1.13 | 0.00 | 99.00 |
| 3 | RIP CURRENT | 470 | 0.78 | 1.00 | 6.00 |
| 4 | RIP CURRENTS | 304 | 0.67 | 1.00 | 3.00 |
| 5 | AVALANCHE | 386 | 0.58 | 0.00 | 6.00 |
| 6 | HURRICANE | 174 | 0.35 | 0.00 | 13.00 |
| 7 | EXTREME COLD | 657 | 0.25 | 0.00 | 7.00 |
| 8 | HIGH SURF | 734 | 0.14 | 0.00 | 10.00 |
| 9 | EXTREME COLD/WIND CHILL | 1002 | 0.12 | 0.00 | 10.00 |
| 10 | FOG | 538 | 0.12 | 0.00 | 11.00 |
This data shows us that heat/excessive heat have by far the highest mean fatalities of any storm type, and some very large maximums for any single storm. To see if those high maximums are just driving up the mean let’s look at the percentage of occurrences that had a fatality:
top_fatality_storms <- storms_final2 %>%
filter(EVTYPE_NEW %in% average_fatalities$EVTYPE_NEW) %>%
group_by(EVTYPE_NEW) %>%
summarise(fatality_perc = mean(FATALITIES > 0)) %>%
arrange(-fatality_perc)
p <- ggplot(top_fatality_storms, aes(y = fatality_perc,
x = factor(EVTYPE_NEW,
levels = top_fatality_storms$EVTYPE_NEW))) +
geom_bar(stat='identity')
p <- p + ggtitle("Fatality % for High Average-Fatality Storm Types") +
labs(x = "Storm Type", y = "% of Occurrences with Fatality")
p <- p + theme(axis.text.x = element_text(angle = 45, vjust = 1, hjust=1))
p## Warning: Use of `top_fatality_storms$EVTYPE_NEW` is discouraged.
## ℹ Use `EVTYPE_NEW` instead.
Rip currents have the highest percentage of fatalities, but after
looking into the documentation it looks like this number is driven up
because a rip current is only recorded if a drowning or near-drowning
rescue is attempted. Because of this we can feel comfortable stating
that heat/excessive heat is the most deadly storm type.
Let’s take a look at just general injuries to see if our results are
similar:
average_injuries <- storms_final2 %>% group_by(EVTYPE_NEW) %>%
summarise(n = n(), AVG_INJ = round(mean(INJURIES),2),
MED_INJ = median(INJURIES),
MAX_INJ = max(INJURIES)) %>%
arrange(-AVG_INJ) %>% top_n(10, wt = AVG_INJ)
average_injuries_table <- xtable(average_injuries)
print(average_injuries_table, type = "html")| EVTYPE_NEW | n | AVG_INJ | MED_INJ | MAX_INJ | |
|---|---|---|---|---|---|
| 1 | EXCESSIVE HEAT | 1678 | 3.89 | 0.00 | 519.00 |
| 2 | HEAT | 767 | 2.74 | 0.00 | 230.00 |
| 3 | TORNADO | 60652 | 1.51 | 0.00 | 1700.00 |
| 4 | FOG | 538 | 1.36 | 0.00 | 78.00 |
| 5 | DUST STORM | 427 | 1.03 | 0.00 | 40.00 |
| 6 | ICE STORM | 2006 | 0.98 | 0.00 | 1568.00 |
| 7 | RIP CURRENTS | 304 | 0.98 | 0.00 | 35.00 |
| 8 | RIP CURRENT | 470 | 0.49 | 0.00 | 10.00 |
| 9 | TROPICAL STORM | 690 | 0.49 | 0.00 | 200.00 |
| 10 | AVALANCHE | 386 | 0.44 | 0.00 | 11.00 |
The table data for injuries shows heat and excessive heat as having the most average injuries per occurrence as well. This even lines up with our fatality information as tornadoes come in third despite having some high outliers driving up the mean.
####Result: Heat & Excessive Heat are the most harmful storm types to health
Analysis of Economic Impact
To analyze the effect on the economy of the different storm types we can calculate some different summary statistics by storm like mean, median, and maximum:
average_damage <- storms_final2 %>% group_by(EVTYPE_NEW) %>%
summarise(n = n(), AVG_DMG = mean(TOTDMG), MED_DMG = median(TOTDMG),
MAX_DMG = max(TOTDMG)) %>%
arrange(-AVG_DMG) %>% top_n(5, wt = AVG_DMG)Despite the fact that storm surges have the highest mean total damage of any other storm type, Hurricanes come in second and have a much higher median of total damage, suggesting that any given hurricane has a higher likelihood of impacting the economy more drastically than any other storm type.
####Result: Hurricanes are the most harmful storm type for the economy