Human and Economic Impact of Weather Related Events in the US.
Synopsis
In this study I will be looking at meteorological events from the U.S. National Oceanic and Atmospheric Administration’s (NOAA) Storm Database (1950-2011). Given that not all the events were initially tracked I will focus on events starting in 1989. In total I will be looking at 22 years and 758482 observations once all the data is preprocessed and cleaned (84% of the original set). There are 48 distincts events coded in the Storm Database.
From our analysis, in terms of Fatalities and Injuries I can conclude that the most severe weather events were Tornado, Excesive Heat and Lightning. In terms of Property Damages and Crop Damages the most severe weather events were Flood, Hail and Hurricane/Typhoon. For each type of category I will highlight the top 5 events in terms of severity.
## Installing needed packages
library(R.utils)
library(stringdist)
library(dplyr)
library(reshape2)
library(scales)
library(ggplot2)Data Processing
Step 1: Load the data (i.e. 𝚛𝚎𝚊𝚍.𝚌𝚜𝚟())
Check that the .zip file is in the directory. Otherwise download and unzip. The data will be loaded into the StormData dataframe.
## Load the Data
if (!file.exists("StormData.csv.bz2")) {
fileUrl <- "https://d396qusza40orc.cloudfront.net/repdata%2Fdata%2FStormData.csv.bz2"
download.file(fileUrl, destfile = "StormData.csv.bz2")
}
if (!file.exists("StormData.csv")) {
bunzip2("StormData.csv.bz2", remove=FALSE)
}
StormData <- read.csv("StormData.csv")Step 2: Preprocessing Data Frame (Original set: 902297 obs. of 37 Variables):
Keep only relevant variables: BGN_DATE, STATE, EVTYPE, FATALITIES, INJURIES, PROPDMG, PROPDMGEXP, CROPDMG, CROPDMGEXP
StormData2 <- StormData[,c("BGN_DATE", "STATE", "EVTYPE", "FATALITIES", "INJURIES", "PROPDMG", "PROPDMGEXP", "CROPDMG", "CROPDMGEXP")]
## Make sure variables are expressed in their correct type
StormData2$BGN_DATE <- as.Date(StormData2$BGN_DATE, format = "%m/%d/%Y")
StormData2$STATE <- as.character(StormData2$STATE)
StormData2$EVTYPE <- as.character(StormData2$EVTYPE)
StormData2$PROPDMGEXP <- as.character(StormData2$PROPDMGEXP)
StormData2$CROPDMGEXP <- as.character(StormData2$CROPDMGEXP)Keep rows that are significant by number of observations and reported events. Looking at events per year, I will keep only years that reported at least 9000 events (~1% of the total sample). This happens in all years starting on 1989 for a total of 762150 observations (84% of the complete set). See table below for further references.
table(format(StormData2$BGN_DATE,"%Y"))##
## 1950 1951 1952 1953 1954 1955 1956 1957 1958 1959 1960 1961
## 223 269 272 492 609 1413 1703 2184 2213 1813 1945 2246
## 1962 1963 1964 1965 1966 1967 1968 1969 1970 1971 1972 1973
## 2389 1968 2348 2855 2388 2688 3312 2926 3215 3471 2168 4463
## 1974 1975 1976 1977 1978 1979 1980 1981 1982 1983 1984 1985
## 5386 4975 3768 3728 3657 4279 6146 4517 7132 8322 7335 7979
## 1986 1987 1988 1989 1990 1991 1992 1993 1994 1995 1996 1997
## 8726 7367 7257 10410 10946 12522 13534 12607 20631 27970 32270 28680
## 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009
## 38128 31289 34471 34962 36293 39752 39363 39184 44034 43289 55663 45817
## 2010 2011
## 48161 62174StormData3 <- StormData2[format(StormData2$BGN_DATE,"%Y") >= "1989",]Create an array with the EvTypes as presented on the documentation to “clean” EvType column. I will compare this list with the list of unique events as entered in our database (see list below).
EvType <- c("ASTRONOMICAL LOW TIDE","AVALANCHE","BLIZZARD","COASTAL FLOOD","COLD/WIND CHILL","DEBRIS FLOW","DENSE FOG","DENSE SMOKE","DROUGHT","DUST DEVIL","DUST STORM","EXCESSIVE HEAT","EXTREME COLD/WIND CHILL","FLASH FLOOD","FLOOD","FREEZING FOG","FROST/FREEZE","FUNNEL CLOUD","HAIL","HEAT","HEAVY RAIN","HEAVY SNOW","HIGH SURF","HIGH WIND","HURRICANE/TYPHOON","ICE STORM","LAKESHORE FLOOD","LAKE-EFFECT SNOW","LIGHTNING","MARINE HAIL","MARINE HIGH WIND","MARINE STRONG WIND","MARINE THUNDERSTORM WIND","RIP CURRENT","SEICHE","SLEET","STORM TIDE","STRONG WIND","THUNDERSTORM WIND","TORNADO","TROPICAL DEPRESSION","TROPICAL STORM","TSUNAMI","VOLCANIC ASH","WATERSPOUT","WILDFIRE","WINTER STORM","WINTER WEATHER")
unique(StormData3$EVTYPE)## [1] "TORNADO" "TSTM WIND"
## [3] "HAIL" "FREEZING RAIN"
## [5] "SNOW" "ICE STORM/FLASH FLOOD"
## [7] "SNOW/ICE" "WINTER STORM"
## [9] "HURRICANE OPAL/HIGH WINDS" "THUNDERSTORM WINDS"
## [11] "RECORD COLD" "HURRICANE ERIN"
## [13] "HURRICANE OPAL" "HEAVY RAIN"
## [15] "LIGHTNING" "THUNDERSTORM WIND"
## [17] "DENSE FOG" "RIP CURRENT"
## [19] "THUNDERSTORM WINS" "FLASH FLOOD"
## [21] "FLASH FLOODING" "HIGH WINDS"
## [23] "FUNNEL CLOUD" "TORNADO F0"
## [25] "THUNDERSTORM WINDS LIGHTNING" "THUNDERSTORM WINDS/HAIL"
## [27] "HEAT" "WIND"
## [29] "LIGHTING" "HEAVY RAINS"
## [31] "LIGHTNING AND HEAVY RAIN" "FUNNEL"
## [33] "WALL CLOUD" "FLOODING"
## [35] "THUNDERSTORM WINDS HAIL" "FLOOD"
## [37] "COLD" "HEAVY RAIN/LIGHTNING"
## [39] "FLASH FLOODING/THUNDERSTORM WI" "WALL CLOUD/FUNNEL CLOUD"
## [41] "THUNDERSTORM" "WATERSPOUT"
## [43] "EXTREME COLD" "HAIL 1.75)"
## [45] "LIGHTNING/HEAVY RAIN" "HIGH WIND"
## [47] "BLIZZARD" "BLIZZARD WEATHER"
## [49] "WIND CHILL" "BREAKUP FLOODING"
## [51] "HIGH WIND/BLIZZARD" "RIVER FLOOD"
## [53] "HEAVY SNOW" "FREEZE"
## [55] "COASTAL FLOOD" "HIGH WIND AND HIGH TIDES"
## [57] "HIGH WIND/BLIZZARD/FREEZING RA" "HIGH TIDES"
## [59] "HIGH WIND AND HEAVY SNOW" "RECORD COLD AND HIGH WIND"
## [61] "RECORD HIGH TEMPERATURE" "RECORD HIGH"
## [63] "HIGH WINDS HEAVY RAINS" "HIGH WIND/ BLIZZARD"
## [65] "ICE STORM" "BLIZZARD/HIGH WIND"
## [67] "HIGH WIND/LOW WIND CHILL" "HEAVY SNOW/HIGH"
## [69] "RECORD LOW" "HIGH WINDS AND WIND CHILL"
## [71] "HEAVY SNOW/HIGH WINDS/FREEZING" "LOW TEMPERATURE RECORD"
## [73] "AVALANCHE" "MARINE MISHAP"
## [75] "WIND CHILL/HIGH WIND" "HIGH WIND/WIND CHILL/BLIZZARD"
## [77] "HIGH WIND/WIND CHILL" "HIGH WIND/HEAVY SNOW"
## [79] "HIGH TEMPERATURE RECORD" "FLOOD WATCH/"
## [81] "RECORD HIGH TEMPERATURES" "HIGH WIND/SEAS"
## [83] "HIGH WINDS/HEAVY RAIN" "HIGH SEAS"
## [85] "SEVERE TURBULENCE" "RECORD RAINFALL"
## [87] "RECORD SNOWFALL" "RECORD WARMTH"
## [89] "HEAVY SNOW/WIND" "EXTREME HEAT"
## [91] "WIND DAMAGE" "DUST STORM"
## [93] "APACHE COUNTY" "SLEET"
## [95] "HAIL STORM" "FUNNEL CLOUDS"
## [97] "FLASH FLOODS" "DUST DEVIL"
## [99] "EXCESSIVE HEAT" "THUNDERSTORM WINDS/FUNNEL CLOU"
## [101] "WINTER STORM/HIGH WIND" "WINTER STORM/HIGH WINDS"
## [103] "GUSTY WINDS" "STRONG WINDS"
## [105] "FLOODING/HEAVY RAIN" "SNOW AND WIND"
## [107] "HEAVY SURF COASTAL FLOODING" "HEAVY SURF"
## [109] "HEAVY PRECIPATATION" "URBAN FLOODING"
## [111] "HIGH SURF" "BLOWING DUST"
## [113] "URBAN/SMALL" "WILD FIRES"
## [115] "HIGH" "URBAN/SMALL FLOODING"
## [117] "WATER SPOUT" "HIGH WINDS DUST STORM"
## [119] "WINTER STORM HIGH WINDS" "LOCAL FLOOD"
## [121] "WINTER STORMS" "MUDSLIDES"
## [123] "RAINSTORM" "SEVERE THUNDERSTORM"
## [125] "SEVERE THUNDERSTORMS" "SEVERE THUNDERSTORM WINDS"
## [127] "THUNDERSTORMS WINDS" "DRY MICROBURST"
## [129] "FLOOD/FLASH FLOOD" "FLOOD/RAIN/WINDS"
## [131] "WINDS" "DRY MICROBURST 61"
## [133] "THUNDERSTORMS" "FLASH FLOOD WINDS"
## [135] "URBAN/SMALL STREAM FLOODING" "MICROBURST"
## [137] "STRONG WIND" "HIGH WIND DAMAGE"
## [139] "STREAM FLOODING" "URBAN AND SMALL"
## [141] "HEAVY SNOWPACK" "ICE"
## [143] "FLASH FLOOD/" "DOWNBURST"
## [145] "GUSTNADO AND" "FLOOD/RAIN/WIND"
## [147] "WET MICROBURST" "DOWNBURST WINDS"
## [149] "DRY MICROBURST WINDS" "DRY MIRCOBURST WINDS"
## [151] "DRY MICROBURST 53" "SMALL STREAM URBAN FLOOD"
## [153] "MICROBURST WINDS" "HIGH WINDS 57"
## [155] "DRY MICROBURST 50" "HIGH WINDS 66"
## [157] "HIGH WINDS 76" "HIGH WINDS 63"
## [159] "HIGH WINDS 67" "BLIZZARD/HEAVY SNOW"
## [161] "HEAVY SNOW/HIGH WINDS" "BLOWING SNOW"
## [163] "HIGH WINDS 82" "HIGH WINDS 80"
## [165] "HIGH WINDS 58" "FREEZING DRIZZLE"
## [167] "LIGHTNING THUNDERSTORM WINDSS" "DRY MICROBURST 58"
## [169] "HAIL 75" "HIGH WINDS 73"
## [171] "HIGH WINDS 55" "LIGHT SNOW AND SLEET"
## [173] "URBAN FLOOD" "DRY MICROBURST 84"
## [175] "THUNDERSTORM WINDS 60" "HEAVY RAIN/FLOODING"
## [177] "THUNDERSTORM WINDSS" "TORNADOS"
## [179] "GLAZE" "RECORD HEAT"
## [181] "COASTAL FLOODING" "HEAT WAVE"
## [183] "FIRST SNOW" "FREEZING RAIN AND SLEET"
## [185] "UNSEASONABLY DRY" "UNSEASONABLY WET"
## [187] "WINTRY MIX" "WINTER WEATHER"
## [189] "UNSEASONABLY COLD" "EXTREME/RECORD COLD"
## [191] "RIP CURRENTS HEAVY SURF" "SLEET/RAIN/SNOW"
## [193] "UNSEASONABLY WARM" "DROUGHT"
## [195] "NORMAL PRECIPITATION" "HIGH WINDS/FLOODING"
## [197] "DRY" "RAIN/SNOW"
## [199] "SNOW/RAIN/SLEET" "WATERSPOUT/TORNADO"
## [201] "WATERSPOUTS" "WATERSPOUT TORNADO"
## [203] "URBAN/SMALL STREAM FLOOD" "STORM SURGE"
## [205] "WATERSPOUT-TORNADO" "WATERSPOUT-"
## [207] "TORNADOES, TSTM WIND, HAIL" "TROPICAL STORM ALBERTO"
## [209] "TROPICAL STORM" "TROPICAL STORM GORDON"
## [211] "TROPICAL STORM JERRY" "LIGHTNING THUNDERSTORM WINDS"
## [213] "WAYTERSPOUT" "MINOR FLOODING"
## [215] "LIGHTNING INJURY" "URBAN/SMALL STREAM FLOOD"
## [217] "LIGHTNING AND THUNDERSTORM WIN" "THUNDERSTORM WINDS53"
## [219] "URBAN AND SMALL STREAM FLOOD" "URBAN AND SMALL STREAM"
## [221] "WILDFIRE" "DAMAGING FREEZE"
## [223] "THUNDERSTORM WINDS 13" "SMALL HAIL"
## [225] "HEAVY SNOW/HIGH WIND" "HURRICANE"
## [227] "WILD/FOREST FIRE" "SMALL STREAM FLOODING"
## [229] "MUD SLIDE" "LIGNTNING"
## [231] "FROST" "FREEZING RAIN/SNOW"
## [233] "HIGH WINDS/" "THUNDERSNOW"
## [235] "FLOODS" "EXTREME WIND CHILLS"
## [237] "COOL AND WET" "HEAVY RAIN/SNOW"
## [239] "SMALL STREAM AND URBAN FLOODIN" "SMALL STREAM/URBAN FLOOD"
## [241] "SNOW/SLEET/FREEZING RAIN" "SEVERE COLD"
## [243] "GLAZE ICE" "COLD WAVE"
## [245] "EARLY SNOW" "SMALL STREAM AND URBAN FLOOD"
## [247] "HIGH WINDS" "RURAL FLOOD"
## [249] "SMALL STREAM AND" "MUD SLIDES"
## [251] "HAIL 80" "EXTREME WIND CHILL"
## [253] "COLD AND WET CONDITIONS" "EXCESSIVE WETNESS"
## [255] "GRADIENT WINDS" "HEAVY SNOW/BLOWING SNOW"
## [257] "SLEET/ICE STORM" "THUNDERSTORM WINDS URBAN FLOOD"
## [259] "THUNDERSTORM WINDS SMALL STREA" "ROTATING WALL CLOUD"
## [261] "LARGE WALL CLOUD" "COLD AIR FUNNEL"
## [263] "GUSTNADO" "COLD AIR FUNNELS"
## [265] "BLOWING SNOW- EXTREME WIND CHI" "SNOW AND HEAVY SNOW"
## [267] "GROUND BLIZZARD" "MAJOR FLOOD"
## [269] "SNOW/HEAVY SNOW" "FREEZING RAIN/SLEET"
## [271] "ICE JAM FLOODING" "SNOW- HIGH WIND- WIND CHILL"
## [273] "STREET FLOOD" "COLD AIR TORNADO"
## [275] "SMALL STREAM FLOOD" "FOG"
## [277] "THUNDERSTORM WINDS 2" "FUNNEL CLOUD/HAIL"
## [279] "ICE/SNOW" "TSTM WIND 51"
## [281] "TSTM WIND 50" "TSTM WIND 52"
## [283] "TSTM WIND 55" "HEAVY SNOW/BLIZZARD"
## [285] "THUNDERSTORM WINDS 61" "HAIL 0.75"
## [287] "THUNDERSTORM DAMAGE" "THUNDERTORM WINDS"
## [289] "HAIL 1.00" "HAIL/WINDS"
## [291] "SNOW AND ICE" "WIND STORM"
## [293] "SNOWSTORM" "GRASS FIRES"
## [295] "LAKE FLOOD" "PROLONG COLD"
## [297] "HAIL/WIND" "HAIL 1.75"
## [299] "THUNDERSTORMW 50" "WIND/HAIL"
## [301] "SNOW AND ICE STORM" "URBAN AND SMALL STREAM FLOODIN"
## [303] "THUNDERSTORMS WIND" "THUNDERSTORM WINDS"
## [305] "HEAVY SNOW/SLEET" "AGRICULTURAL FREEZE"
## [307] "DROUGHT/EXCESSIVE HEAT" "TUNDERSTORM WIND"
## [309] "TROPICAL STORM DEAN" "THUNDERTSORM WIND"
## [311] "THUNDERSTORM WINDS/ HAIL" "THUNDERSTORM WIND/LIGHTNING"
## [313] "HEAVY RAIN/SEVERE WEATHER" "THUNDESTORM WINDS"
## [315] "WATERSPOUT/ TORNADO" "LIGHTNING."
## [317] "WARM DRY CONDITIONS" "HURRICANE-GENERATED SWELLS"
## [319] "HEAVY SNOW/ICE STORM" "RIVER AND STREAM FLOOD"
## [321] "HIGH WIND 63" "COASTAL SURGE"
## [323] "HEAVY SNOW AND ICE STORM" "MINOR FLOOD"
## [325] "HIGH WINDS/COASTAL FLOOD" "RAIN"
## [327] "RIVER FLOODING" "SNOW/RAIN"
## [329] "ICE FLOES" "HIGH WAVES"
## [331] "SNOW SQUALLS" "SNOW SQUALL"
## [333] "THUNDERSTORM WIND G50" "LIGHTNING FIRE"
## [335] "BLIZZARD/FREEZING RAIN" "HEAVY LAKE SNOW"
## [337] "HEAVY SNOW/FREEZING RAIN" "LAKE EFFECT SNOW"
## [339] "HEAVY WET SNOW" "DUST DEVIL WATERSPOUT"
## [341] "THUNDERSTORM WINDS/HEAVY RAIN" "THUNDERSTROM WINDS"
## [343] "THUNDERSTORM WINDS LE CEN" "HAIL 225"
## [345] "BLIZZARD AND HEAVY SNOW" "HEAVY SNOW AND ICE"
## [347] "ICE STORM AND SNOW" "HEAVY SNOW ANDBLOWING SNOW"
## [349] "HEAVY SNOW/ICE" "BLIZZARD AND EXTREME WIND CHIL"
## [351] "LOW WIND CHILL" "BLOWING SNOW & EXTREME WIND CH"
## [353] "WATERSPOUT/" "URBAN/SMALL STREAM"
## [355] "TORNADO F3" "FUNNEL CLOUD."
## [357] "TORNDAO" "HAIL 0.88"
## [359] "FLOOD/RIVER FLOOD" "MUD SLIDES URBAN FLOODING"
## [361] "TORNADO F1" "THUNDERSTORM WINDS G"
## [363] "DEEP HAIL" "GLAZE/ICE STORM"
## [365] "HEAVY SNOW/WINTER STORM" "AVALANCE"
## [367] "BLIZZARD/WINTER STORM" "DUST STORM/HIGH WINDS"
## [369] "ICE JAM" "FOREST FIRES"
## [371] "THUNDERSTORM WIND G60" "FROST\\FREEZE"
## [373] "THUNDERSTORM WINDS." "HAIL 88"
## [375] "HAIL 175" "HVY RAIN"
## [377] "HAIL 100" "HAIL 150"
## [379] "HAIL 075" "THUNDERSTORM WIND G55"
## [381] "HAIL 125" "THUNDERSTORM WINDS G60"
## [383] "HARD FREEZE" "HAIL 200"
## [385] "THUNDERSTORM WINDS FUNNEL CLOU" "THUNDERSTORM WINDS 62"
## [387] "WILDFIRES" "RECORD HEAT WAVE"
## [389] "HEAVY SNOW AND HIGH WINDS" "HEAVY SNOW/HIGH WINDS & FLOOD"
## [391] "HAIL FLOODING" "THUNDERSTORM WINDS/FLASH FLOOD"
## [393] "HIGH WIND 70" "WET SNOW"
## [395] "HEAVY RAIN AND FLOOD" "LOCAL FLASH FLOOD"
## [397] "THUNDERSTORM WINDS 53" "FLOOD/FLASH FLOODING"
## [399] "TORNADO/WATERSPOUT" "RAIN AND WIND"
## [401] "THUNDERSTORM WIND 59" "THUNDERSTORM WIND 52"
## [403] "COASTAL/TIDAL FLOOD" "SNOW/ICE STORM"
## [405] "BELOW NORMAL PRECIPITATION" "RIP CURRENTS/HEAVY SURF"
## [407] "FLASH FLOOD/FLOOD" "EXCESSIVE RAIN"
## [409] "RECORD/EXCESSIVE HEAT" "HEAT WAVES"
## [411] "LIGHT SNOW" "THUNDERSTORM WIND 69"
## [413] "HAIL DAMAGE" "LIGHTNING DAMAGE"
## [415] "RECORD TEMPERATURES" "LIGHTNING AND WINDS"
## [417] "FOG AND COLD TEMPERATURES" "OTHER"
## [419] "RECORD SNOW" "SNOW/COLD"
## [421] "FLASH FLOOD FROM ICE JAMS" "TSTM WIND G58"
## [423] "MUDSLIDE" "HEAVY SNOW SQUALLS"
## [425] "HEAVY SNOW/SQUALLS" "HEAVY SNOW-SQUALLS"
## [427] "ICY ROADS" "HEAVY MIX"
## [429] "SNOW FREEZING RAIN" "LACK OF SNOW"
## [431] "SNOW/SLEET" "SNOW/FREEZING RAIN"
## [433] "SNOW DROUGHT" "THUNDERSTORMW WINDS"
## [435] "THUNDERSTORM WIND 60 MPH" "THUNDERSTORM WIND 65MPH"
## [437] "THUNDERSTORM WIND/ TREES" "THUNDERSTORM WIND/AWNING"
## [439] "THUNDERSTORM WIND 98 MPH" "THUNDERSTORM WIND TREES"
## [441] "TORRENTIAL RAIN" "TORNADO F2"
## [443] "RIP CURRENTS" "HURRICANE EMILY"
## [445] "HURRICANE GORDON" "HURRICANE FELIX"
## [447] "THUNDERSTORM WIND 59 MPH" "THUNDERSTORM WINDS 63 MPH"
## [449] "THUNDERSTORM WIND/ TREE" "THUNDERSTORM DAMAGE TO"
## [451] "THUNDERSTORM WIND 65 MPH" "FLASH FLOOD - HEAVY RAIN"
## [453] "THUNDERSTORM WIND." "FLASH FLOOD/ STREET"
## [455] "THUNDERSTORM WIND 59 MPH." "HEAVY SNOW FREEZING RAIN"
## [457] "DAM FAILURE" "THUNDERSTORM HAIL"
## [459] "HAIL 088" "THUNDERSTORM WINDSHAIL"
## [461] "LIGHTNING WAUSEON" "THUDERSTORM WINDS"
## [463] "ICE AND SNOW" "RECORD COLD/FROST"
## [465] "STORM FORCE WINDS" "FREEZING RAIN AND SNOW"
## [467] "FREEZING RAIN SLEET AND" "SOUTHEAST"
## [469] "HEAVY SNOW & ICE" "FREEZING DRIZZLE AND FREEZING"
## [471] "THUNDERSTORM WINDS AND" "HAIL/ICY ROADS"
## [473] "FLASH FLOOD/HEAVY RAIN" "HEAVY RAIN; URBAN FLOOD WINDS;"
## [475] "HEAVY PRECIPITATION" "TSTM WIND DAMAGE"
## [477] "HIGH WATER" "FLOOD FLASH"
## [479] "RAIN/WIND" "THUNDERSTORM WINDS 50"
## [481] "THUNDERSTORM WIND G52" "FLOOD FLOOD/FLASH"
## [483] "THUNDERSTORM WINDS 52" "SNOW SHOWERS"
## [485] "THUNDERSTORM WIND G51" "HEAT WAVE DROUGHT"
## [487] "HEAVY SNOW/BLIZZARD/AVALANCHE" "RECORD SNOW/COLD"
## [489] "WET WEATHER" "UNSEASONABLY WARM AND DRY"
## [491] "FREEZING RAIN SLEET AND LIGHT" "RECORD/EXCESSIVE RAINFALL"
## [493] "TIDAL FLOOD" "BEACH EROSIN"
## [495] "THUNDERSTORM WIND G61" "FLOOD/FLASH"
## [497] "LOW TEMPERATURE" "SLEET & FREEZING RAIN"
## [499] "HEAVY RAINS/FLOODING" "THUNDERESTORM WINDS"
## [501] "THUNDERSTORM WINDS/FLOODING" "THUNDEERSTORM WINDS"
## [503] "HIGHWAY FLOODING" "THUNDERSTORM W INDS"
## [505] "HYPOTHERMIA" "FLASH FLOOD/ FLOOD"
## [507] "THUNDERSTORM WIND 50" "THUNERSTORM WINDS"
## [509] "HEAVY RAIN/MUDSLIDES/FLOOD" "MUD/ROCK SLIDE"
## [511] "HIGH WINDS/COLD" "BEACH EROSION/COASTAL FLOOD"
## [513] "COLD/WINDS" "SNOW/ BITTER COLD"
## [515] "THUNDERSTORM WIND 56" "SNOW SLEET"
## [517] "DRY HOT WEATHER" "COLD WEATHER"
## [519] "RAPIDLY RISING WATER" "HAIL ALOFT"
## [521] "EARLY FREEZE" "ICE/STRONG WINDS"
## [523] "EXTREME WIND CHILL/BLOWING SNO" "SNOW/HIGH WINDS"
## [525] "HIGH WINDS/SNOW" "EARLY FROST"
## [527] "SNOWMELT FLOODING" "HEAVY SNOW AND STRONG WINDS"
## [529] "SNOW ACCUMULATION" "BLOWING SNOW/EXTREME WIND CHIL"
## [531] "SNOW/ ICE" "SNOW/BLOWING SNOW"
## [533] "TORNADOES" "THUNDERSTORM WIND/HAIL"
## [535] "FLASH FLOODING/FLOOD" "HAIL 275"
## [537] "HAIL 450" "FLASH FLOOODING"
## [539] "EXCESSIVE RAINFALL" "THUNDERSTORMW"
## [541] "HAILSTORM" "TSTM WINDS"
## [543] "BEACH FLOOD" "HAILSTORMS"
## [545] "TSTMW" "FUNNELS"
## [547] "TSTM WIND 65)" "THUNDERSTORM WINDS/ FLOOD"
## [549] "HEAVY RAINFALL" "HEAT/DROUGHT"
## [551] "HEAT DROUGHT" "NEAR RECORD SNOW"
## [553] "LANDSLIDE" "HIGH WIND AND SEAS"
## [555] "THUNDERSTORMWINDS" "THUNDERSTORM WINDS HEAVY RAIN"
## [557] "SLEET/SNOW" "EXCESSIVE"
## [559] "SNOW/SLEET/RAIN" "WILD/FOREST FIRES"
## [561] "HEAVY SEAS" "DUSTSTORM"
## [563] "FLOOD & HEAVY RAIN" "?"
## [565] "THUNDERSTROM WIND" "FLOOD/FLASHFLOOD"
## [567] "SNOW AND COLD" "HOT PATTERN"
## [569] "PROLONG COLD/SNOW" "BRUSH FIRES"
## [571] "SNOW\\COLD" "WINTER MIX"
## [573] "EXCESSIVE PRECIPITATION" "SNOWFALL RECORD"
## [575] "HOT/DRY PATTERN" "DRY PATTERN"
## [577] "MILD/DRY PATTERN" "MILD PATTERN"
## [579] "LANDSLIDES" "HEAVY SHOWERS"
## [581] "HEAVY SNOW AND" "HIGH WIND 48"
## [583] "LAKE-EFFECT SNOW" "BRUSH FIRE"
## [585] "WATERSPOUT FUNNEL CLOUD" "URBAN SMALL STREAM FLOOD"
## [587] "SAHARAN DUST" "HEAVY SHOWER"
## [589] "URBAN FLOOD LANDSLIDE" "HEAVY SWELLS"
## [591] "URBAN SMALL" "URBAN FLOODS"
## [593] "SMALL STREAM" "HEAVY RAIN/URBAN FLOOD"
## [595] "FLASH FLOOD/LANDSLIDE" "LANDSLIDE/URBAN FLOOD"
## [597] "HEAVY RAIN/SMALL STREAM URBAN" "FLASH FLOOD LANDSLIDES"
## [599] "EXTREME WINDCHILL" "URBAN/SML STREAM FLD"
## [601] "TSTM WIND/HAIL" "Other"
## [603] "Record dry month" "Temperature record"
## [605] "Minor Flooding" "Ice jam flood (minor"
## [607] "High Wind" "Tstm Wind"
## [609] "ROUGH SURF" "Wind"
## [611] "Heavy Surf" "Dust Devil"
## [613] "Wind Damage" "Marine Accident"
## [615] "Snow" "Freeze"
## [617] "Snow Squalls" "Coastal Flooding"
## [619] "Heavy Rain" "Strong Wind"
## [621] "COASTAL STORM" "COASTALFLOOD"
## [623] "Erosion/Cstl Flood" "Heavy Rain and Wind"
## [625] "Light Snow/Flurries" "Wet Month"
## [627] "Wet Year" "Tidal Flooding"
## [629] "River Flooding" "Damaging Freeze"
## [631] "Beach Erosion" "Hot and Dry"
## [633] "Flood/Flash Flood" "Icy Roads"
## [635] "High Surf" "Heavy Rain/High Surf"
## [637] "Thunderstorm Wind" "Rain Damage"
## [639] "Unseasonable Cold" "Early Frost"
## [641] "Wintry Mix" "blowing snow"
## [643] "STREET FLOODING" "Record Cold"
## [645] "Extreme Cold" "Ice Fog"
## [647] "Excessive Cold" "Torrential Rainfall"
## [649] "Freezing Rain" "Landslump"
## [651] "Late-season Snowfall" "Hurricane Edouard"
## [653] "Coastal Storm" "Flood"
## [655] "HEAVY RAIN/WIND" "TIDAL FLOODING"
## [657] "Winter Weather" "Snow squalls"
## [659] "Strong Winds" "Strong winds"
## [661] "RECORD WARM TEMPS." "Ice/Snow"
## [663] "Mudslide" "Glaze"
## [665] "Extended Cold" "Snow Accumulation"
## [667] "Freezing Fog" "Drifting Snow"
## [669] "Whirlwind" "Heavy snow shower"
## [671] "Heavy rain" "LATE SNOW"
## [673] "Record May Snow" "Record Winter Snow"
## [675] "Heavy Precipitation" " COASTAL FLOOD"
## [677] "Record temperature" "Light snow"
## [679] "Late Season Snowfall" "Gusty Wind"
## [681] "small hail" "Light Snow"
## [683] "MIXED PRECIP" "Black Ice"
## [685] "Mudslides" "Gradient wind"
## [687] "Snow and Ice" "Freezing Spray"
## [689] "Summary Jan 17" "Summary of March 14"
## [691] "Summary of March 23" "Summary of March 24"
## [693] "Summary of April 3rd" "Summary of April 12"
## [695] "Summary of April 13" "Summary of April 21"
## [697] "Summary August 11" "Summary of April 27"
## [699] "Summary of May 9-10" "Summary of May 10"
## [701] "Summary of May 13" "Summary of May 14"
## [703] "Summary of May 22 am" "Summary of May 22 pm"
## [705] "Heatburst" "Summary of May 26 am"
## [707] "Summary of May 26 pm" "Metro Storm, May 26"
## [709] "Summary of May 31 am" "Summary of May 31 pm"
## [711] "Summary of June 3" "Summary of June 4"
## [713] "Summary June 5-6" "Summary June 6"
## [715] "Summary of June 11" "Summary of June 12"
## [717] "Summary of June 13" "Summary of June 15"
## [719] "Summary of June 16" "Summary June 18-19"
## [721] "Summary of June 23" "Summary of June 24"
## [723] "Summary of June 30" "Summary of July 2"
## [725] "Summary of July 3" "Summary of July 11"
## [727] "Summary of July 22" "Summary July 23-24"
## [729] "Summary of July 26" "Summary of July 29"
## [731] "Summary of August 1" "Summary August 2-3"
## [733] "Summary August 7" "Summary August 9"
## [735] "Summary August 10" "Summary August 17"
## [737] "Summary August 21" "Summary August 28"
## [739] "Summary September 4" "Summary September 20"
## [741] "Summary September 23" "Summary Sept. 25-26"
## [743] "Summary: Oct. 20-21" "Summary: October 31"
## [745] "Summary: Nov. 6-7" "Summary: Nov. 16"
## [747] "Microburst" "wet micoburst"
## [749] "Hail(0.75)" "Funnel Cloud"
## [751] "Urban Flooding" "No Severe Weather"
## [753] "Urban flood" "Urban Flood"
## [755] "Cold" "Summary of May 22"
## [757] "Summary of June 6" "Summary August 4"
## [759] "Summary of June 10" "Summary of June 18"
## [761] "Summary September 3" "Summary: Sept. 18"
## [763] "Coastal Flood" "coastal flooding"
## [765] "Small Hail" "Record Temperatures"
## [767] "Light Snowfall" "Freezing Drizzle"
## [769] "Gusty wind/rain" "GUSTY WIND/HVY RAIN"
## [771] "Blowing Snow" "Early snowfall"
## [773] "Monthly Snowfall" "Record Heat"
## [775] "Seasonal Snowfall" "Monthly Rainfall"
## [777] "Cold Temperature" "Sml Stream Fld"
## [779] "Heat Wave" "MUDSLIDE/LANDSLIDE"
## [781] "Saharan Dust" "Volcanic Ash"
## [783] "Volcanic Ash Plume" "Thundersnow shower"
## [785] "NONE" "COLD AND SNOW"
## [787] "DAM BREAK" "TSTM WIND (G45)"
## [789] "SLEET/FREEZING RAIN" "BLACK ICE"
## [791] "BLOW-OUT TIDES" "UNSEASONABLY COOL"
## [793] "TSTM HEAVY RAIN" "Gusty Winds"
## [795] "GUSTY WIND" "TSTM WIND 40"
## [797] "TSTM WIND 45" "TSTM WIND (41)"
## [799] "TSTM WIND (G40)" "TSTM WND"
## [801] "Wintry mix" " TSTM WIND"
## [803] "Frost" "Frost/Freeze"
## [805] "RAIN (HEAVY)" "Record Warmth"
## [807] "Prolong Cold" "Cold and Frost"
## [809] "URBAN/SML STREAM FLDG" "STRONG WIND GUST"
## [811] "LATE FREEZE" "BLOW-OUT TIDE"
## [813] "Hypothermia/Exposure" "HYPOTHERMIA/EXPOSURE"
## [815] "Lake Effect Snow" "Mixed Precipitation"
## [817] "Record High" "COASTALSTORM"
## [819] "Snow and sleet" "Freezing rain"
## [821] "Gusty winds" "Blizzard Summary"
## [823] "SUMMARY OF MARCH 24-25" "SUMMARY OF MARCH 27"
## [825] "SUMMARY OF MARCH 29" "GRADIENT WIND"
## [827] "Icestorm/Blizzard" "Flood/Strong Wind"
## [829] "TSTM WIND AND LIGHTNING" "gradient wind"
## [831] "Freezing drizzle" "Mountain Snows"
## [833] "URBAN/SMALL STRM FLDG" "Heavy surf and wind"
## [835] "Mild and Dry Pattern" "COLD AND FROST"
## [837] "TYPHOON" "HIGH SWELLS"
## [839] "HIGH SWELLS" "VOLCANIC ASH"
## [841] "DRY SPELL" " LIGHTNING"
## [843] "BEACH EROSION" "UNSEASONAL RAIN"
## [845] "EARLY RAIN" "PROLONGED RAIN"
## [847] "WINTERY MIX" "COASTAL FLOODING/EROSION"
## [849] "HOT SPELL" "UNSEASONABLY HOT"
## [851] " TSTM WIND (G45)" "TSTM WIND (G45)"
## [853] "HIGH WIND (G40)" "TSTM WIND (G35)"
## [855] "DRY WEATHER" "ABNORMAL WARMTH"
## [857] "UNUSUAL WARMTH" "WAKE LOW WIND"
## [859] "MONTHLY RAINFALL" "COLD TEMPERATURES"
## [861] "COLD WIND CHILL TEMPERATURES" "MODERATE SNOW"
## [863] "MODERATE SNOWFALL" "URBAN/STREET FLOODING"
## [865] "COASTAL EROSION" "UNUSUAL/RECORD WARMTH"
## [867] "BITTER WIND CHILL" "BITTER WIND CHILL TEMPERATURES"
## [869] "SEICHE" "TSTM"
## [871] "COASTAL FLOODING/EROSION" "UNSEASONABLY WARM YEAR"
## [873] "HYPERTHERMIA/EXPOSURE" "ROCK SLIDE"
## [875] "ICE PELLETS" "PATCHY DENSE FOG"
## [877] "RECORD COOL" "RECORD WARM"
## [879] "HOT WEATHER" "RECORD TEMPERATURE"
## [881] "TROPICAL DEPRESSION" "VOLCANIC ERUPTION"
## [883] "COOL SPELL" "WIND ADVISORY"
## [885] "GUSTY WIND/HAIL" "RED FLAG FIRE WX"
## [887] "FIRST FROST" "EXCESSIVELY DRY"
## [889] "SNOW AND SLEET" "LIGHT SNOW/FREEZING PRECIP"
## [891] "VOG" "MONTHLY PRECIPITATION"
## [893] "MONTHLY TEMPERATURE" "RECORD DRYNESS"
## [895] "EXTREME WINDCHILL TEMPERATURES" "MIXED PRECIPITATION"
## [897] "DRY CONDITIONS" "REMNANTS OF FLOYD"
## [899] "EARLY SNOWFALL" "FREEZING FOG"
## [901] "LANDSPOUT" "DRIEST MONTH"
## [903] "RECORD COLD" "LATE SEASON HAIL"
## [905] "EXCESSIVE SNOW" "DRYNESS"
## [907] "FLOOD/FLASH/FLOOD" "WIND AND WAVE"
## [909] "LIGHT FREEZING RAIN" " WIND"
## [911] "MONTHLY SNOWFALL" "RECORD PRECIPITATION"
## [913] "ICE ROADS" "ROUGH SEAS"
## [915] "UNSEASONABLY WARM/WET" "UNSEASONABLY COOL & WET"
## [917] "UNUSUALLY WARM" "TSTM WIND G45"
## [919] "NON SEVERE HAIL" "NON-SEVERE WIND DAMAGE"
## [921] "UNUSUALLY COLD" "WARM WEATHER"
## [923] "LANDSLUMP" "THUNDERSTORM WIND (G40)"
## [925] "UNSEASONABLY WARM & WET" " FLASH FLOOD"
## [927] "LOCALLY HEAVY RAIN" "WIND GUSTS"
## [929] "UNSEASONAL LOW TEMP" "HIGH SURF ADVISORY"
## [931] "LATE SEASON SNOW" "GUSTY LAKE WIND"
## [933] "ABNORMALLY DRY" "WINTER WEATHER MIX"
## [935] "RED FLAG CRITERIA" "WND"
## [937] "CSTL FLOODING/EROSION" "SMOKE"
## [939] " WATERSPOUT" "SNOW ADVISORY"
## [941] "EXTREMELY WET" "UNUSUALLY LATE SNOW"
## [943] "VERY DRY" "RECORD LOW RAINFALL"
## [945] "ROGUE WAVE" "PROLONG WARMTH"
## [947] "ACCUMULATED SNOWFALL" "FALLING SNOW/ICE"
## [949] "DUST DEVEL" "NON-TSTM WIND"
## [951] "NON TSTM WIND" "GUSTY THUNDERSTORM WINDS"
## [953] "PATCHY ICE" "HEAVY RAIN EFFECTS"
## [955] "EXCESSIVE HEAT/DROUGHT" "NORTHERN LIGHTS"
## [957] "MARINE TSTM WIND" " HIGH SURF ADVISORY"
## [959] "HAZARDOUS SURF" "FROST/FREEZE"
## [961] "WINTER WEATHER/MIX" "ASTRONOMICAL HIGH TIDE"
## [963] "WHIRLWIND" "VERY WARM"
## [965] "ABNORMALLY WET" "TORNADO DEBRIS"
## [967] "EXTREME COLD/WIND CHILL" "ICE ON ROAD"
## [969] "DROWNING" "GUSTY THUNDERSTORM WIND"
## [971] "MARINE HAIL" "HIGH SURF ADVISORIES"
## [973] "HURRICANE/TYPHOON" "HEAVY SURF/HIGH SURF"
## [975] "SLEET STORM" "STORM SURGE/TIDE"
## [977] "COLD/WIND CHILL" "MARINE HIGH WIND"
## [979] "TSUNAMI" "DENSE SMOKE"
## [981] "LAKESHORE FLOOD" "MARINE THUNDERSTORM WIND"
## [983] "MARINE STRONG WIND" "ASTRONOMICAL LOW TIDE"
## [985] "VOLCANIC ASHFALL"While I have 48 different types of events, our data shows 985 unique descriptions. Need to clean these! I will apply the following transformations: (# of events with no match after transformation applied) * Make all descriptions upper-case to match the design of our events table. (200k no-matches) * Replace TSTM with THUNDERSTORM (40k no-matches) * Increase MaxDist parameter in amatch function to 3 (15k no-matches) * Apply miscelaneous transformations using GREP, based on existing non-matched events and similarities with the events table. After this last transformations I will be left with 0.48% of the data not-matched. This is small enough to be removed so I can proceed with the analysis.
## make sure all evtypes are in upper case
StormData3$EVTYPE <- toupper(StormData3$EVTYPE)
## find matches within EvType array using amatch. Store the result in new column
for (i in 1:nrow(StormData3)) {
StormData3[i,"EVTYPECODE"] <- amatch(StormData3[i,"EVTYPE"], EvType)
}
## check for NAs (no matches)
SDNAs <- is.na(StormData3$EVTYPECODE)
sum(SDNAs)## [1] 200764## I still have 200764 events with not match!
## Look at unique events within these 200k to start a deeper cleaning
unique(StormData3[SDNAs, "EVTYPE"])## [1] "TSTM WIND" "FREEZING RAIN"
## [3] "SNOW" "ICE STORM/FLASH FLOOD"
## [5] "SNOW/ICE" "HURRICANE OPAL/HIGH WINDS"
## [7] "THUNDERSTORM WINDS" "RECORD COLD"
## [9] "HURRICANE ERIN" "HURRICANE OPAL"
## [11] "THUNDERSTORM WINS" "FLASH FLOODING"
## [13] "HIGH WINDS" "TORNADO F0"
## [15] "THUNDERSTORM WINDS LIGHTNING" "THUNDERSTORM WINDS/HAIL"
## [17] "WIND" "LIGHTING"
## [19] "HEAVY RAINS" "LIGHTNING AND HEAVY RAIN"
## [21] "FUNNEL" "WALL CLOUD"
## [23] "FLOODING" "THUNDERSTORM WINDS HAIL"
## [25] "COLD" "HEAVY RAIN/LIGHTNING"
## [27] "FLASH FLOODING/THUNDERSTORM WI" "WALL CLOUD/FUNNEL CLOUD"
## [29] "THUNDERSTORM" "EXTREME COLD"
## [31] "HAIL 1.75)" "LIGHTNING/HEAVY RAIN"
## [33] "BLIZZARD WEATHER" "WIND CHILL"
## [35] "BREAKUP FLOODING" "HIGH WIND/BLIZZARD"
## [37] "RIVER FLOOD" "FREEZE"
## [39] "HIGH WIND AND HIGH TIDES" "HIGH WIND/BLIZZARD/FREEZING RA"
## [41] "HIGH TIDES" "HIGH WIND AND HEAVY SNOW"
## [43] "RECORD COLD AND HIGH WIND" "RECORD HIGH TEMPERATURE"
## [45] "RECORD HIGH" "HIGH WINDS HEAVY RAINS"
## [47] "HIGH WIND/ BLIZZARD" "BLIZZARD/HIGH WIND"
## [49] "HIGH WIND/LOW WIND CHILL" "HEAVY SNOW/HIGH"
## [51] "RECORD LOW" "HIGH WINDS AND WIND CHILL"
## [53] "HEAVY SNOW/HIGH WINDS/FREEZING" "LOW TEMPERATURE RECORD"
## [55] "MARINE MISHAP" "WIND CHILL/HIGH WIND"
## [57] "HIGH WIND/WIND CHILL/BLIZZARD" "HIGH WIND/WIND CHILL"
## [59] "HIGH WIND/HEAVY SNOW" "HIGH TEMPERATURE RECORD"
## [61] "FLOOD WATCH/" "RECORD HIGH TEMPERATURES"
## [63] "HIGH WIND/SEAS" "HIGH WINDS/HEAVY RAIN"
## [65] "HIGH SEAS" "SEVERE TURBULENCE"
## [67] "RECORD RAINFALL" "RECORD SNOWFALL"
## [69] "RECORD WARMTH" "HEAVY SNOW/WIND"
## [71] "EXTREME HEAT" "WIND DAMAGE"
## [73] "APACHE COUNTY" "HAIL STORM"
## [75] "FUNNEL CLOUDS" "FLASH FLOODS"
## [77] "THUNDERSTORM WINDS/FUNNEL CLOU" "WINTER STORM/HIGH WIND"
## [79] "WINTER STORM/HIGH WINDS" "GUSTY WINDS"
## [81] "STRONG WINDS" "FLOODING/HEAVY RAIN"
## [83] "SNOW AND WIND" "HEAVY SURF COASTAL FLOODING"
## [85] "HEAVY SURF" "HEAVY PRECIPATATION"
## [87] "URBAN FLOODING" "BLOWING DUST"
## [89] "URBAN/SMALL" "WILD FIRES"
## [91] "HIGH" "URBAN/SMALL FLOODING"
## [93] "WATER SPOUT" "HIGH WINDS DUST STORM"
## [95] "WINTER STORM HIGH WINDS" "LOCAL FLOOD"
## [97] "WINTER STORMS" "MUDSLIDES"
## [99] "RAINSTORM" "SEVERE THUNDERSTORM"
## [101] "SEVERE THUNDERSTORMS" "SEVERE THUNDERSTORM WINDS"
## [103] "THUNDERSTORMS WINDS" "DRY MICROBURST"
## [105] "FLOOD/FLASH FLOOD" "FLOOD/RAIN/WINDS"
## [107] "WINDS" "DRY MICROBURST 61"
## [109] "THUNDERSTORMS" "FLASH FLOOD WINDS"
## [111] "URBAN/SMALL STREAM FLOODING" "MICROBURST"
## [113] "HIGH WIND DAMAGE" "STREAM FLOODING"
## [115] "URBAN AND SMALL" "HEAVY SNOWPACK"
## [117] "ICE" "FLASH FLOOD/"
## [119] "DOWNBURST" "GUSTNADO AND"
## [121] "FLOOD/RAIN/WIND" "WET MICROBURST"
## [123] "DOWNBURST WINDS" "DRY MICROBURST WINDS"
## [125] "DRY MIRCOBURST WINDS" "DRY MICROBURST 53"
## [127] "SMALL STREAM URBAN FLOOD" "MICROBURST WINDS"
## [129] "HIGH WINDS 57" "DRY MICROBURST 50"
## [131] "HIGH WINDS 66" "HIGH WINDS 76"
## [133] "HIGH WINDS 63" "HIGH WINDS 67"
## [135] "BLIZZARD/HEAVY SNOW" "HEAVY SNOW/HIGH WINDS"
## [137] "BLOWING SNOW" "HIGH WINDS 82"
## [139] "HIGH WINDS 80" "HIGH WINDS 58"
## [141] "FREEZING DRIZZLE" "LIGHTNING THUNDERSTORM WINDSS"
## [143] "DRY MICROBURST 58" "HAIL 75"
## [145] "HIGH WINDS 73" "HIGH WINDS 55"
## [147] "LIGHT SNOW AND SLEET" "URBAN FLOOD"
## [149] "DRY MICROBURST 84" "THUNDERSTORM WINDS 60"
## [151] "HEAVY RAIN/FLOODING" "THUNDERSTORM WINDSS"
## [153] "TORNADOS" "GLAZE"
## [155] "RECORD HEAT" "COASTAL FLOODING"
## [157] "HEAT WAVE" "FIRST SNOW"
## [159] "FREEZING RAIN AND SLEET" "UNSEASONABLY DRY"
## [161] "UNSEASONABLY WET" "WINTRY MIX"
## [163] "UNSEASONABLY COLD" "EXTREME/RECORD COLD"
## [165] "RIP CURRENTS HEAVY SURF" "SLEET/RAIN/SNOW"
## [167] "UNSEASONABLY WARM" "NORMAL PRECIPITATION"
## [169] "HIGH WINDS/FLOODING" "DRY"
## [171] "RAIN/SNOW" "SNOW/RAIN/SLEET"
## [173] "WATERSPOUT/TORNADO" "WATERSPOUTS"
## [175] "WATERSPOUT TORNADO" "URBAN/SMALL STREAM FLOOD"
## [177] "STORM SURGE" "WATERSPOUT-TORNADO"
## [179] "WATERSPOUT-" "TORNADOES, TSTM WIND, HAIL"
## [181] "TROPICAL STORM ALBERTO" "TROPICAL STORM GORDON"
## [183] "TROPICAL STORM JERRY" "LIGHTNING THUNDERSTORM WINDS"
## [185] "WAYTERSPOUT" "MINOR FLOODING"
## [187] "LIGHTNING INJURY" "URBAN/SMALL STREAM FLOOD"
## [189] "LIGHTNING AND THUNDERSTORM WIN" "THUNDERSTORM WINDS53"
## [191] "URBAN AND SMALL STREAM FLOOD" "URBAN AND SMALL STREAM"
## [193] "DAMAGING FREEZE" "THUNDERSTORM WINDS 13"
## [195] "SMALL HAIL" "HEAVY SNOW/HIGH WIND"
## [197] "HURRICANE" "WILD/FOREST FIRE"
## [199] "SMALL STREAM FLOODING" "MUD SLIDE"
## [201] "LIGNTNING" "FROST"
## [203] "FREEZING RAIN/SNOW" "HIGH WINDS/"
## [205] "THUNDERSNOW" "FLOODS"
## [207] "EXTREME WIND CHILLS" "COOL AND WET"
## [209] "HEAVY RAIN/SNOW" "SMALL STREAM AND URBAN FLOODIN"
## [211] "SMALL STREAM/URBAN FLOOD" "SNOW/SLEET/FREEZING RAIN"
## [213] "SEVERE COLD" "GLAZE ICE"
## [215] "COLD WAVE" "EARLY SNOW"
## [217] "SMALL STREAM AND URBAN FLOOD" "HIGH WINDS"
## [219] "RURAL FLOOD" "SMALL STREAM AND"
## [221] "MUD SLIDES" "HAIL 80"
## [223] "EXTREME WIND CHILL" "COLD AND WET CONDITIONS"
## [225] "EXCESSIVE WETNESS" "GRADIENT WINDS"
## [227] "HEAVY SNOW/BLOWING SNOW" "SLEET/ICE STORM"
## [229] "THUNDERSTORM WINDS URBAN FLOOD" "THUNDERSTORM WINDS SMALL STREA"
## [231] "ROTATING WALL CLOUD" "LARGE WALL CLOUD"
## [233] "COLD AIR FUNNEL" "GUSTNADO"
## [235] "COLD AIR FUNNELS" "BLOWING SNOW- EXTREME WIND CHI"
## [237] "SNOW AND HEAVY SNOW" "GROUND BLIZZARD"
## [239] "MAJOR FLOOD" "SNOW/HEAVY SNOW"
## [241] "FREEZING RAIN/SLEET" "ICE JAM FLOODING"
## [243] "SNOW- HIGH WIND- WIND CHILL" "STREET FLOOD"
## [245] "COLD AIR TORNADO" "SMALL STREAM FLOOD"
## [247] "FOG" "THUNDERSTORM WINDS 2"
## [249] "FUNNEL CLOUD/HAIL" "ICE/SNOW"
## [251] "TSTM WIND 51" "TSTM WIND 50"
## [253] "TSTM WIND 52" "TSTM WIND 55"
## [255] "HEAVY SNOW/BLIZZARD" "THUNDERSTORM WINDS 61"
## [257] "HAIL 0.75" "THUNDERSTORM DAMAGE"
## [259] "THUNDERTORM WINDS" "HAIL 1.00"
## [261] "HAIL/WINDS" "SNOW AND ICE"
## [263] "WIND STORM" "SNOWSTORM"
## [265] "GRASS FIRES" "LAKE FLOOD"
## [267] "PROLONG COLD" "HAIL/WIND"
## [269] "HAIL 1.75" "THUNDERSTORMW 50"
## [271] "WIND/HAIL" "SNOW AND ICE STORM"
## [273] "URBAN AND SMALL STREAM FLOODIN" "THUNDERSTORMS WIND"
## [275] "THUNDERSTORM WINDS" "HEAVY SNOW/SLEET"
## [277] "AGRICULTURAL FREEZE" "DROUGHT/EXCESSIVE HEAT"
## [279] "TUNDERSTORM WIND" "TROPICAL STORM DEAN"
## [281] "THUNDERTSORM WIND" "THUNDERSTORM WINDS/ HAIL"
## [283] "THUNDERSTORM WIND/LIGHTNING" "HEAVY RAIN/SEVERE WEATHER"
## [285] "THUNDESTORM WINDS" "WATERSPOUT/ TORNADO"
## [287] "LIGHTNING." "WARM DRY CONDITIONS"
## [289] "HURRICANE-GENERATED SWELLS" "HEAVY SNOW/ICE STORM"
## [291] "RIVER AND STREAM FLOOD" "HIGH WIND 63"
## [293] "COASTAL SURGE" "HEAVY SNOW AND ICE STORM"
## [295] "MINOR FLOOD" "HIGH WINDS/COASTAL FLOOD"
## [297] "RAIN" "RIVER FLOODING"
## [299] "SNOW/RAIN" "ICE FLOES"
## [301] "HIGH WAVES" "SNOW SQUALLS"
## [303] "SNOW SQUALL" "THUNDERSTORM WIND G50"
## [305] "LIGHTNING FIRE" "BLIZZARD/FREEZING RAIN"
## [307] "HEAVY LAKE SNOW" "HEAVY SNOW/FREEZING RAIN"
## [309] "LAKE EFFECT SNOW" "HEAVY WET SNOW"
## [311] "DUST DEVIL WATERSPOUT" "THUNDERSTORM WINDS/HEAVY RAIN"
## [313] "THUNDERSTROM WINDS" "THUNDERSTORM WINDS LE CEN"
## [315] "HAIL 225" "BLIZZARD AND HEAVY SNOW"
## [317] "HEAVY SNOW AND ICE" "ICE STORM AND SNOW"
## [319] "HEAVY SNOW ANDBLOWING SNOW" "HEAVY SNOW/ICE"
## [321] "BLIZZARD AND EXTREME WIND CHIL" "LOW WIND CHILL"
## [323] "BLOWING SNOW & EXTREME WIND CH" "WATERSPOUT/"
## [325] "URBAN/SMALL STREAM" "TORNADO F3"
## [327] "FUNNEL CLOUD." "TORNDAO"
## [329] "HAIL 0.88" "FLOOD/RIVER FLOOD"
## [331] "MUD SLIDES URBAN FLOODING" "TORNADO F1"
## [333] "THUNDERSTORM WINDS G" "DEEP HAIL"
## [335] "GLAZE/ICE STORM" "HEAVY SNOW/WINTER STORM"
## [337] "AVALANCE" "BLIZZARD/WINTER STORM"
## [339] "DUST STORM/HIGH WINDS" "ICE JAM"
## [341] "FOREST FIRES" "THUNDERSTORM WIND G60"
## [343] "FROST\\FREEZE" "THUNDERSTORM WINDS."
## [345] "HAIL 88" "HAIL 175"
## [347] "HVY RAIN" "HAIL 100"
## [349] "HAIL 150" "HAIL 075"
## [351] "THUNDERSTORM WIND G55" "HAIL 125"
## [353] "THUNDERSTORM WINDS G60" "HARD FREEZE"
## [355] "HAIL 200" "THUNDERSTORM WINDS FUNNEL CLOU"
## [357] "THUNDERSTORM WINDS 62" "WILDFIRES"
## [359] "RECORD HEAT WAVE" "HEAVY SNOW AND HIGH WINDS"
## [361] "HEAVY SNOW/HIGH WINDS & FLOOD" "HAIL FLOODING"
## [363] "THUNDERSTORM WINDS/FLASH FLOOD" "HIGH WIND 70"
## [365] "WET SNOW" "HEAVY RAIN AND FLOOD"
## [367] "LOCAL FLASH FLOOD" "THUNDERSTORM WINDS 53"
## [369] "FLOOD/FLASH FLOODING" "TORNADO/WATERSPOUT"
## [371] "RAIN AND WIND" "THUNDERSTORM WIND 59"
## [373] "THUNDERSTORM WIND 52" "COASTAL/TIDAL FLOOD"
## [375] "SNOW/ICE STORM" "BELOW NORMAL PRECIPITATION"
## [377] "RIP CURRENTS/HEAVY SURF" "FLASH FLOOD/FLOOD"
## [379] "EXCESSIVE RAIN" "RECORD/EXCESSIVE HEAT"
## [381] "HEAT WAVES" "LIGHT SNOW"
## [383] "THUNDERSTORM WIND 69" "HAIL DAMAGE"
## [385] "LIGHTNING DAMAGE" "RECORD TEMPERATURES"
## [387] "LIGHTNING AND WINDS" "FOG AND COLD TEMPERATURES"
## [389] "OTHER" "RECORD SNOW"
## [391] "SNOW/COLD" "FLASH FLOOD FROM ICE JAMS"
## [393] "TSTM WIND G58" "MUDSLIDE"
## [395] "HEAVY SNOW SQUALLS" "HEAVY SNOW/SQUALLS"
## [397] "HEAVY SNOW-SQUALLS" "ICY ROADS"
## [399] "HEAVY MIX" "SNOW FREEZING RAIN"
## [401] "LACK OF SNOW" "SNOW/SLEET"
## [403] "SNOW/FREEZING RAIN" "SNOW DROUGHT"
## [405] "THUNDERSTORMW WINDS" "THUNDERSTORM WIND 60 MPH"
## [407] "THUNDERSTORM WIND 65MPH" "THUNDERSTORM WIND/ TREES"
## [409] "THUNDERSTORM WIND/AWNING" "THUNDERSTORM WIND 98 MPH"
## [411] "THUNDERSTORM WIND TREES" "TORRENTIAL RAIN"
## [413] "TORNADO F2" "RIP CURRENTS"
## [415] "HURRICANE EMILY" "HURRICANE GORDON"
## [417] "HURRICANE FELIX" "THUNDERSTORM WIND 59 MPH"
## [419] "THUNDERSTORM WINDS 63 MPH" "THUNDERSTORM WIND/ TREE"
## [421] "THUNDERSTORM DAMAGE TO" "THUNDERSTORM WIND 65 MPH"
## [423] "FLASH FLOOD - HEAVY RAIN" "THUNDERSTORM WIND."
## [425] "FLASH FLOOD/ STREET" "THUNDERSTORM WIND 59 MPH."
## [427] "HEAVY SNOW FREEZING RAIN" "DAM FAILURE"
## [429] "THUNDERSTORM HAIL" "HAIL 088"
## [431] "THUNDERSTORM WINDSHAIL" "LIGHTNING WAUSEON"
## [433] "THUDERSTORM WINDS" "ICE AND SNOW"
## [435] "RECORD COLD/FROST" "STORM FORCE WINDS"
## [437] "FREEZING RAIN AND SNOW" "FREEZING RAIN SLEET AND"
## [439] "SOUTHEAST" "HEAVY SNOW & ICE"
## [441] "FREEZING DRIZZLE AND FREEZING" "THUNDERSTORM WINDS AND"
## [443] "HAIL/ICY ROADS" "FLASH FLOOD/HEAVY RAIN"
## [445] "HEAVY RAIN; URBAN FLOOD WINDS;" "HEAVY PRECIPITATION"
## [447] "TSTM WIND DAMAGE" "HIGH WATER"
## [449] "FLOOD FLASH" "RAIN/WIND"
## [451] "THUNDERSTORM WINDS 50" "THUNDERSTORM WIND G52"
## [453] "FLOOD FLOOD/FLASH" "THUNDERSTORM WINDS 52"
## [455] "SNOW SHOWERS" "THUNDERSTORM WIND G51"
## [457] "HEAT WAVE DROUGHT" "HEAVY SNOW/BLIZZARD/AVALANCHE"
## [459] "RECORD SNOW/COLD" "WET WEATHER"
## [461] "UNSEASONABLY WARM AND DRY" "FREEZING RAIN SLEET AND LIGHT"
## [463] "RECORD/EXCESSIVE RAINFALL" "TIDAL FLOOD"
## [465] "BEACH EROSIN" "THUNDERSTORM WIND G61"
## [467] "FLOOD/FLASH" "LOW TEMPERATURE"
## [469] "SLEET & FREEZING RAIN" "HEAVY RAINS/FLOODING"
## [471] "THUNDERESTORM WINDS" "THUNDERSTORM WINDS/FLOODING"
## [473] "THUNDEERSTORM WINDS" "HIGHWAY FLOODING"
## [475] "THUNDERSTORM W INDS" "HYPOTHERMIA"
## [477] "FLASH FLOOD/ FLOOD" "THUNDERSTORM WIND 50"
## [479] "THUNERSTORM WINDS" "HEAVY RAIN/MUDSLIDES/FLOOD"
## [481] "MUD/ROCK SLIDE" "HIGH WINDS/COLD"
## [483] "BEACH EROSION/COASTAL FLOOD" "COLD/WINDS"
## [485] "SNOW/ BITTER COLD" "THUNDERSTORM WIND 56"
## [487] "SNOW SLEET" "DRY HOT WEATHER"
## [489] "COLD WEATHER" "RAPIDLY RISING WATER"
## [491] "HAIL ALOFT" "EARLY FREEZE"
## [493] "ICE/STRONG WINDS" "EXTREME WIND CHILL/BLOWING SNO"
## [495] "SNOW/HIGH WINDS" "HIGH WINDS/SNOW"
## [497] "EARLY FROST" "SNOWMELT FLOODING"
## [499] "HEAVY SNOW AND STRONG WINDS" "SNOW ACCUMULATION"
## [501] "BLOWING SNOW/EXTREME WIND CHIL" "SNOW/ ICE"
## [503] "SNOW/BLOWING SNOW" "TORNADOES"
## [505] "THUNDERSTORM WIND/HAIL" "FLASH FLOODING/FLOOD"
## [507] "HAIL 275" "HAIL 450"
## [509] "FLASH FLOOODING" "EXCESSIVE RAINFALL"
## [511] "THUNDERSTORMW" "HAILSTORM"
## [513] "TSTM WINDS" "BEACH FLOOD"
## [515] "HAILSTORMS" "TSTMW"
## [517] "FUNNELS" "TSTM WIND 65)"
## [519] "THUNDERSTORM WINDS/ FLOOD" "HEAVY RAINFALL"
## [521] "HEAT/DROUGHT" "HEAT DROUGHT"
## [523] "NEAR RECORD SNOW" "LANDSLIDE"
## [525] "HIGH WIND AND SEAS" "THUNDERSTORMWINDS"
## [527] "THUNDERSTORM WINDS HEAVY RAIN" "SLEET/SNOW"
## [529] "EXCESSIVE" "SNOW/SLEET/RAIN"
## [531] "WILD/FOREST FIRES" "HEAVY SEAS"
## [533] "DUSTSTORM" "FLOOD & HEAVY RAIN"
## [535] "?" "THUNDERSTROM WIND"
## [537] "FLOOD/FLASHFLOOD" "SNOW AND COLD"
## [539] "HOT PATTERN" "PROLONG COLD/SNOW"
## [541] "BRUSH FIRES" "SNOW\\COLD"
## [543] "WINTER MIX" "EXCESSIVE PRECIPITATION"
## [545] "SNOWFALL RECORD" "HOT/DRY PATTERN"
## [547] "DRY PATTERN" "MILD/DRY PATTERN"
## [549] "MILD PATTERN" "LANDSLIDES"
## [551] "HEAVY SHOWERS" "HEAVY SNOW AND"
## [553] "HIGH WIND 48" "BRUSH FIRE"
## [555] "WATERSPOUT FUNNEL CLOUD" "URBAN SMALL STREAM FLOOD"
## [557] "SAHARAN DUST" "HEAVY SHOWER"
## [559] "URBAN FLOOD LANDSLIDE" "HEAVY SWELLS"
## [561] "URBAN SMALL" "URBAN FLOODS"
## [563] "SMALL STREAM" "HEAVY RAIN/URBAN FLOOD"
## [565] "FLASH FLOOD/LANDSLIDE" "LANDSLIDE/URBAN FLOOD"
## [567] "HEAVY RAIN/SMALL STREAM URBAN" "FLASH FLOOD LANDSLIDES"
## [569] "EXTREME WINDCHILL" "URBAN/SML STREAM FLD"
## [571] "TSTM WIND/HAIL" "RECORD DRY MONTH"
## [573] "TEMPERATURE RECORD" "ICE JAM FLOOD (MINOR"
## [575] "ROUGH SURF" "MARINE ACCIDENT"
## [577] "COASTAL STORM" "COASTALFLOOD"
## [579] "EROSION/CSTL FLOOD" "HEAVY RAIN AND WIND"
## [581] "LIGHT SNOW/FLURRIES" "WET MONTH"
## [583] "WET YEAR" "TIDAL FLOODING"
## [585] "BEACH EROSION" "HOT AND DRY"
## [587] "HEAVY RAIN/HIGH SURF" "RAIN DAMAGE"
## [589] "UNSEASONABLE COLD" "STREET FLOODING"
## [591] "ICE FOG" "EXCESSIVE COLD"
## [593] "TORRENTIAL RAINFALL" "LANDSLUMP"
## [595] "LATE-SEASON SNOWFALL" "HURRICANE EDOUARD"
## [597] "HEAVY RAIN/WIND" "RECORD WARM TEMPS."
## [599] "EXTENDED COLD" "DRIFTING SNOW"
## [601] "WHIRLWIND" "HEAVY SNOW SHOWER"
## [603] "LATE SNOW" "RECORD MAY SNOW"
## [605] "RECORD WINTER SNOW" " COASTAL FLOOD"
## [607] "RECORD TEMPERATURE" "LATE SEASON SNOWFALL"
## [609] "GUSTY WIND" "MIXED PRECIP"
## [611] "BLACK ICE" "GRADIENT WIND"
## [613] "FREEZING SPRAY" "SUMMARY JAN 17"
## [615] "SUMMARY OF MARCH 14" "SUMMARY OF MARCH 23"
## [617] "SUMMARY OF MARCH 24" "SUMMARY OF APRIL 3RD"
## [619] "SUMMARY OF APRIL 12" "SUMMARY OF APRIL 13"
## [621] "SUMMARY OF APRIL 21" "SUMMARY AUGUST 11"
## [623] "SUMMARY OF APRIL 27" "SUMMARY OF MAY 9-10"
## [625] "SUMMARY OF MAY 10" "SUMMARY OF MAY 13"
## [627] "SUMMARY OF MAY 14" "SUMMARY OF MAY 22 AM"
## [629] "SUMMARY OF MAY 22 PM" "HEATBURST"
## [631] "SUMMARY OF MAY 26 AM" "SUMMARY OF MAY 26 PM"
## [633] "METRO STORM, MAY 26" "SUMMARY OF MAY 31 AM"
## [635] "SUMMARY OF MAY 31 PM" "SUMMARY OF JUNE 3"
## [637] "SUMMARY OF JUNE 4" "SUMMARY JUNE 5-6"
## [639] "SUMMARY JUNE 6" "SUMMARY OF JUNE 11"
## [641] "SUMMARY OF JUNE 12" "SUMMARY OF JUNE 13"
## [643] "SUMMARY OF JUNE 15" "SUMMARY OF JUNE 16"
## [645] "SUMMARY JUNE 18-19" "SUMMARY OF JUNE 23"
## [647] "SUMMARY OF JUNE 24" "SUMMARY OF JUNE 30"
## [649] "SUMMARY OF JULY 2" "SUMMARY OF JULY 3"
## [651] "SUMMARY OF JULY 11" "SUMMARY OF JULY 22"
## [653] "SUMMARY JULY 23-24" "SUMMARY OF JULY 26"
## [655] "SUMMARY OF JULY 29" "SUMMARY OF AUGUST 1"
## [657] "SUMMARY AUGUST 2-3" "SUMMARY AUGUST 7"
## [659] "SUMMARY AUGUST 9" "SUMMARY AUGUST 10"
## [661] "SUMMARY AUGUST 17" "SUMMARY AUGUST 21"
## [663] "SUMMARY AUGUST 28" "SUMMARY SEPTEMBER 4"
## [665] "SUMMARY SEPTEMBER 20" "SUMMARY SEPTEMBER 23"
## [667] "SUMMARY SEPT. 25-26" "SUMMARY: OCT. 20-21"
## [669] "SUMMARY: OCTOBER 31" "SUMMARY: NOV. 6-7"
## [671] "SUMMARY: NOV. 16" "WET MICOBURST"
## [673] "HAIL(0.75)" "NO SEVERE WEATHER"
## [675] "SUMMARY OF MAY 22" "SUMMARY OF JUNE 6"
## [677] "SUMMARY AUGUST 4" "SUMMARY OF JUNE 10"
## [679] "SUMMARY OF JUNE 18" "SUMMARY SEPTEMBER 3"
## [681] "SUMMARY: SEPT. 18" "LIGHT SNOWFALL"
## [683] "GUSTY WIND/RAIN" "GUSTY WIND/HVY RAIN"
## [685] "EARLY SNOWFALL" "MONTHLY SNOWFALL"
## [687] "SEASONAL SNOWFALL" "MONTHLY RAINFALL"
## [689] "COLD TEMPERATURE" "SML STREAM FLD"
## [691] "MUDSLIDE/LANDSLIDE" "VOLCANIC ASH PLUME"
## [693] "THUNDERSNOW SHOWER" "NONE"
## [695] "COLD AND SNOW" "DAM BREAK"
## [697] "TSTM WIND (G45)" "SLEET/FREEZING RAIN"
## [699] "BLOW-OUT TIDES" "UNSEASONABLY COOL"
## [701] "TSTM HEAVY RAIN" "TSTM WIND 40"
## [703] "TSTM WIND 45" "TSTM WIND (41)"
## [705] "TSTM WIND (G40)" "TSTM WND"
## [707] " TSTM WIND" "RAIN (HEAVY)"
## [709] "COLD AND FROST" "URBAN/SML STREAM FLDG"
## [711] "STRONG WIND GUST" "LATE FREEZE"
## [713] "BLOW-OUT TIDE" "HYPOTHERMIA/EXPOSURE"
## [715] "MIXED PRECIPITATION" "COASTALSTORM"
## [717] "SNOW AND SLEET" "BLIZZARD SUMMARY"
## [719] "SUMMARY OF MARCH 24-25" "SUMMARY OF MARCH 27"
## [721] "SUMMARY OF MARCH 29" "ICESTORM/BLIZZARD"
## [723] "FLOOD/STRONG WIND" "TSTM WIND AND LIGHTNING"
## [725] "MOUNTAIN SNOWS" "URBAN/SMALL STRM FLDG"
## [727] "HEAVY SURF AND WIND" "MILD AND DRY PATTERN"
## [729] "TYPHOON" "HIGH SWELLS"
## [731] "HIGH SWELLS" "DRY SPELL"
## [733] " LIGHTNING" "UNSEASONAL RAIN"
## [735] "EARLY RAIN" "PROLONGED RAIN"
## [737] "WINTERY MIX" "COASTAL FLOODING/EROSION"
## [739] "HOT SPELL" "UNSEASONABLY HOT"
## [741] " TSTM WIND (G45)" "TSTM WIND (G45)"
## [743] "HIGH WIND (G40)" "TSTM WIND (G35)"
## [745] "DRY WEATHER" "ABNORMAL WARMTH"
## [747] "UNUSUAL WARMTH" "WAKE LOW WIND"
## [749] "COLD TEMPERATURES" "COLD WIND CHILL TEMPERATURES"
## [751] "MODERATE SNOW" "MODERATE SNOWFALL"
## [753] "URBAN/STREET FLOODING" "COASTAL EROSION"
## [755] "UNUSUAL/RECORD WARMTH" "BITTER WIND CHILL"
## [757] "BITTER WIND CHILL TEMPERATURES" "TSTM"
## [759] "COASTAL FLOODING/EROSION" "UNSEASONABLY WARM YEAR"
## [761] "HYPERTHERMIA/EXPOSURE" "ROCK SLIDE"
## [763] "ICE PELLETS" "PATCHY DENSE FOG"
## [765] "RECORD COOL" "RECORD WARM"
## [767] "HOT WEATHER" "VOLCANIC ERUPTION"
## [769] "COOL SPELL" "WIND ADVISORY"
## [771] "GUSTY WIND/HAIL" "RED FLAG FIRE WX"
## [773] "FIRST FROST" "EXCESSIVELY DRY"
## [775] "LIGHT SNOW/FREEZING PRECIP" "VOG"
## [777] "MONTHLY PRECIPITATION" "MONTHLY TEMPERATURE"
## [779] "RECORD DRYNESS" "EXTREME WINDCHILL TEMPERATURES"
## [781] "DRY CONDITIONS" "REMNANTS OF FLOYD"
## [783] "LANDSPOUT" "DRIEST MONTH"
## [785] "RECORD COLD" "LATE SEASON HAIL"
## [787] "EXCESSIVE SNOW" "DRYNESS"
## [789] "FLOOD/FLASH/FLOOD" "WIND AND WAVE"
## [791] "LIGHT FREEZING RAIN" " WIND"
## [793] "RECORD PRECIPITATION" "ICE ROADS"
## [795] "ROUGH SEAS" "UNSEASONABLY WARM/WET"
## [797] "UNSEASONABLY COOL & WET" "UNUSUALLY WARM"
## [799] "TSTM WIND G45" "NON SEVERE HAIL"
## [801] "NON-SEVERE WIND DAMAGE" "UNUSUALLY COLD"
## [803] "WARM WEATHER" "THUNDERSTORM WIND (G40)"
## [805] "UNSEASONABLY WARM & WET" " FLASH FLOOD"
## [807] "LOCALLY HEAVY RAIN" "WIND GUSTS"
## [809] "UNSEASONAL LOW TEMP" "HIGH SURF ADVISORY"
## [811] "LATE SEASON SNOW" "GUSTY LAKE WIND"
## [813] "ABNORMALLY DRY" "WINTER WEATHER MIX"
## [815] "RED FLAG CRITERIA" "WND"
## [817] "CSTL FLOODING/EROSION" "SMOKE"
## [819] " WATERSPOUT" "SNOW ADVISORY"
## [821] "EXTREMELY WET" "UNUSUALLY LATE SNOW"
## [823] "VERY DRY" "RECORD LOW RAINFALL"
## [825] "ROGUE WAVE" "PROLONG WARMTH"
## [827] "ACCUMULATED SNOWFALL" "FALLING SNOW/ICE"
## [829] "DUST DEVEL" "NON-TSTM WIND"
## [831] "NON TSTM WIND" "GUSTY THUNDERSTORM WINDS"
## [833] "PATCHY ICE" "HEAVY RAIN EFFECTS"
## [835] "EXCESSIVE HEAT/DROUGHT" "NORTHERN LIGHTS"
## [837] "MARINE TSTM WIND" " HIGH SURF ADVISORY"
## [839] "HAZARDOUS SURF" "WINTER WEATHER/MIX"
## [841] "ASTRONOMICAL HIGH TIDE" "VERY WARM"
## [843] "ABNORMALLY WET" "TORNADO DEBRIS"
## [845] "ICE ON ROAD" "DROWNING"
## [847] "GUSTY THUNDERSTORM WIND" "HIGH SURF ADVISORIES"
## [849] "HEAVY SURF/HIGH SURF" "SLEET STORM"
## [851] "STORM SURGE/TIDE" "VOLCANIC ASHFALL"## Look for instances where "Thunderstorm" is expressed as "TSTM"
sum(grepl("TSTM", StormData3$EVTYPE[SDNAs]))## [1] 160994## I have 160k of the NAs with TSTM (about 75% of what we were missing!!!)
## Replace TSTM with "THUNDERSTORM" and rerun the amatch only for these records
TSTMs <- grepl("TSTM", StormData3$EVTYPE)
StormData3$EVTYPE[TSTMs] <- gsub("TSTM", "THUNDERSTORM", StormData3$EVTYPE[TSTMs])
## Checking to see that there are no more occurrences of "TSTM"
sum(grepl("TSTM", StormData3$EVTYPE[SDNAs]))## [1] 0## Run amatch for the "new" "THUNDERSTORM" records
StormData3[TSTMs, "EVTYPECODE"] <- amatch(StormData3[TSTMs, "EVTYPE"], EvType)
## Recalculate SDNAs
SDNAs <- is.na(StormData3$EVTYPECODE)
sum(SDNAs)## [1] 40889## I'm down to 40k! (about 5.5% of StormData3)
## Run amatch with maxDist = 3 (expanding the parameter to catch 'minor' discrepancies)
StormData3[SDNAs, "EVTYPECODE"] <- amatch(StormData3[SDNAs, "EVTYPE"], EvType, maxDist = 3)
## Recalculate SDNAs
SDNAs <- is.na(StormData3$EVTYPECODE)
sum(SDNAs)## [1] 15685## I'm down to 15k! (about 2% of StormData3)
## Detailed cleaning based on what is left in unique(EVTYPE) and similarities to the
## descriptions on EvType
## Assign all of the "FLASH" evtypes to "FLASH FLOOD" (14)
StormData3$EVTYPECODE[SDNAs] <- ifelse(grepl("FLASH", StormData3$EVTYPE[SDNAs]), 14, NA)
SDNAs <- is.na(StormData3$EVTYPECODE)
## Assign all of the "FLD" evtypes to "FLOOD" (15)
StormData3$EVTYPECODE[SDNAs] <- ifelse(grepl("FLD", StormData3$EVTYPE[SDNAs]), 15, NA)
SDNAs <- is.na(StormData3$EVTYPECODE)
## Assign all the "FLOOD" evtypes to "FLOOD" (15)
StormData3$EVTYPECODE[SDNAs] <- ifelse(grepl("FLOOD", StormData3$EVTYPE[SDNAs]), 15, NA)
SDNAs <- is.na(StormData3$EVTYPECODE)
## Assign all the "HAIL" evtypes to "HAIL" (19)
StormData3$EVTYPECODE[SDNAs] <- ifelse(grepl("HAIL", StormData3$EVTYPE[SDNAs]), 19, NA)
SDNAs <- is.na(StormData3$EVTYPECODE)
## Assign all the "THUNDERSTORM" evtypes to "THUNDERSTORM WIND" (39)
StormData3$EVTYPECODE[SDNAs] <- ifelse(grepl("THUNDERSTORM", StormData3$EVTYPE[SDNAs]), 39, NA)
SDNAs <- is.na(StormData3$EVTYPECODE)
## Assign all the "SNOW" evtypes to "HEAVY SNOW" (22)
StormData3$EVTYPECODE[SDNAs] <- ifelse(grepl("SNOW", StormData3$EVTYPE[SDNAs]), 22, NA)
SDNAs <- is.na(StormData3$EVTYPECODE)
## Assign all the "EXTREME WIND" to "EXTREME COLD/WIND CHILL" (13)
StormData3$EVTYPECODE[SDNAs] <- ifelse(grepl("EXTREME WIND", StormData3$EVTYPE[SDNAs]), 13, NA)
SDNAs <- is.na(StormData3$EVTYPECODE)
## Assign all the "EXTREME COLD" to "EXTREME COLD/WIND CHILL" (13)"
StormData3$EVTYPECODE[SDNAs] <- ifelse(grepl("EXTREME COLD", StormData3$EVTYPE[SDNAs]), 13, NA)
SDNAs <- is.na(StormData3$EVTYPECODE)
## Assign all the "WINTER WEATHER" to "WINTER WEATHER" (48)"
StormData3$EVTYPECODE[SDNAs] <- ifelse(grepl("WINTER WEATHER", StormData3$EVTYPE[SDNAs]), 48, NA)
SDNAs <- is.na(StormData3$EVTYPECODE)
## Assign all the "WILD/FOREST" to "WILDFIRE" (46)"
StormData3$EVTYPECODE[SDNAs] <- ifelse(grepl("WILD/FOREST", StormData3$EVTYPE[SDNAs]), 46, NA)
SDNAs <- is.na(StormData3$EVTYPECODE)
## Assign all the "FREEZ" to "FROST/FREEZE" (17)"
StormData3$EVTYPECODE[SDNAs] <- ifelse(grepl("FREEZ", StormData3$EVTYPE[SDNAs]), 17, NA)
SDNAs <- is.na(StormData3$EVTYPECODE)
## Assign all the "SURF" to "HIGH SURF" (23)"
StormData3$EVTYPECODE[SDNAs] <- ifelse(grepl("SURF", StormData3$EVTYPE[SDNAs]), 23, NA)
SDNAs <- is.na(StormData3$EVTYPECODE)
## Assign all the "WARM" to "HEAT" (20)"
StormData3$EVTYPECODE[SDNAs] <- ifelse(grepl("HEAT", StormData3$EVTYPE[SDNAs]), 20, NA)
SDNAs <- is.na(StormData3$EVTYPECODE)
## Assign all the "HIGH WIND" to "HIGH WIND" (24)"
StormData3$EVTYPECODE[SDNAs] <- ifelse(grepl("HIGH WIND", StormData3$EVTYPE[SDNAs]), 24, NA)
SDNAs <- is.na(StormData3$EVTYPECODE)
## How many NAs left? (as a percentage of StormData3)
sum(is.na(StormData3))/nrow(StormData3)## [1] 0.004812701## We have less than .5% of data being NA... let's move on!I need to address now the consistency on PROPDMG and CROPDMG as both have to be adjusted by exponent (see NOAA documentation)
## Look at the distribution on both EXP columns
## Note, as we don't want to work with the rows that stil contain NA on EVTYPECODE we will use
## !SDNAs as our logical reference for the rows that we want to work with
table(StormData3$PROPDMGEXP[!SDNAs])##
## - ? + 0 1 2 3 4 5
## 353326 1 8 5 215 25 13 4 4 28
## 6 7 8 B h H K m M
## 4 5 1 31 1 6 395919 6 8880table(StormData3$CROPDMGEXP[!SDNAs])##
## ? 0 2 B k K M
## 475217 7 19 1 9 20 281270 1939## I will create adjusted columns for each, in each case I will keep the original number as it
## is or I will multiply it by 10^x if x is in (0..8), or I will multiply it by 1000 if x is in (kK) or by 1000000 if x is in (mM) or by 1000000000 if x is in (bB)
for (i in 1:nrow(StormData3)) {
if (!is.na(StormData3$EVTYPECODE[i])) {
if (StormData3$PROPDMGEXP[i] %in% 0:8)
StormData3$PROPDMGNORM[i] <- StormData3$PROPDMG[i] * (10 ^ as.integer(as.character(StormData3$PROPDMGEXP[i])))
else if (StormData3$PROPDMGEXP[i] %in% c("h", "H"))
StormData3$PROPDMGNORM[i] <- StormData3$PROPDMG[i] * 100
else if (StormData3$PROPDMGEXP[i] %in% c("k", "K"))
StormData3$PROPDMGNORM[i] <- StormData3$PROPDMG[i] * 1000
else if (StormData3$PROPDMGEXP[i] %in% c("m", "M"))
StormData3$PROPDMGNORM[i] <- StormData3$PROPDMG[i] * 1000000
else if (StormData3$PROPDMGEXP[i] %in% c("b", "B"))
StormData3$PROPDMGNORM[i] <- StormData3$PROPDMG[i] * 1000000000
else if (StormData3$PROPDMGEXP[i] == "+")
StormData3$PROPDMGNORM[i] <- StormData3$PROPDMG[i] * 10
else
StormData3$PROPDMGNORM[i] <- StormData3$PROPDMG[i]
}
}
for (i in 1:nrow(StormData3)) {
if (!is.na(StormData3$EVTYPECODE[i])) {
if (StormData3$CROPDMGEXP[i] %in% 0:8)
StormData3$CROPDMGNORM[i] <- StormData3$CROPDMG[i] * (10 ^ as.integer(as.character(StormData3$CROPDMGEXP[i])))
else if (StormData3$CROPDMGEXP[i] %in% c("h", "H"))
StormData3$CROPDMGNORM[i] <- StormData3$CROPDMG[i] * 100
else if (StormData3$CROPDMGEXP[i] %in% c("k", "K"))
StormData3$CROPDMGNORM[i] <- StormData3$CROPDMG[i] * 1000
else if (StormData3$CROPDMGEXP[i] %in% c("m", "M"))
StormData3$CROPDMGNORM[i] <- StormData3$CROPDMG[i] * 1000000
else if (StormData3$CROPDMGEXP[i] %in% c("b", "B"))
StormData3$CROPDMGNORM[i] <- StormData3$CROPDMG[i] * 1000000000
else if (StormData3$CROPDMGEXP[i] == "+")
StormData3$CROPDMGNORM[i] <- StormData3$CROPDMG[i] * 10
else
StormData3$CROPDMGNORM[i] <- StormData3$CROPDMG[i]
}
}With the data clean I’m going to group by year and event and get the totals for each.
by_year <- StormData3[!SDNAs,] %>% group_by(format(BGN_DATE, "%Y"), EVTYPECODE)
by_year_sum <- by_year %>% summarise(FATALITIES = sum(FATALITIES), INJURIES = sum(INJURIES), PROPDMGNORM = sum(PROPDMGNORM), CROPDMGNORM = sum(CROPDMGNORM))
names(by_year_sum)[1] <- "YEAR"Given that I can only use two graphs, I will melt the data on fatalities and injuries to plot both bar charts using facets
by_year_melt <- melt(by_year_sum, measure.vars = c("FATALITIES", "INJURIES"))Results
Bar charts for fatalities and injuries by event type
options(scipen=999)
ggplot(by_year_melt,aes(EVTYPECODE,value)) + geom_col() + xlab("Event Code") + ylab("# of People Affected (Total)") + facet_grid(~variable) + ggtitle("Fatalities and Injuries by Event Type", "1989-2011") + theme(plot.title = element_text(hjust = 0.5), plot.subtitle = element_text(hjust = 0.5))
From the graph I can see that the events with the largest number of fatalities are: (in desc order)
fat12 <- sum(by_year_melt[by_year_melt$EVTYPECODE == 12 & by_year_melt$variable == "FATALITIES","value"])
fat40 <- sum(by_year_melt[by_year_melt$EVTYPECODE == 40 & by_year_melt$variable == "FATALITIES","value"])
fat20 <- sum(by_year_melt[by_year_melt$EVTYPECODE == 20 & by_year_melt$variable == "FATALITIES","value"])
fat14 <- sum(by_year_melt[by_year_melt$EVTYPECODE == 14 & by_year_melt$variable == "FATALITIES","value"])
fat29 <- sum(by_year_melt[by_year_melt$EVTYPECODE == 29 & by_year_melt$variable == "FATALITIES","value"])- 12 - EXCESIVE HEAT:
1903 - 40 - TORNADO:
1802 - 20 - HEAT:
1235 - 14 - FLASH FLOOD:
1035 - 29 - LIGHTNING
817
From the graph on the right I can see that the events with the largest number of injuries are: (in desc order)
inj40 <- sum(by_year_melt[by_year_melt$EVTYPECODE == 40 & by_year_melt$variable == "INJURIES","value"])
inj39 <- sum(by_year_melt[by_year_melt$EVTYPECODE == 39 & by_year_melt$variable == "INJURIES","value"])
inj15 <- sum(by_year_melt[by_year_melt$EVTYPECODE == 15 & by_year_melt$variable == "INJURIES","value"])
inj12 <- sum(by_year_melt[by_year_melt$EVTYPECODE == 12 & by_year_melt$variable == "INJURIES","value"])
inj29 <- sum(by_year_melt[by_year_melt$EVTYPECODE == 29 & by_year_melt$variable == "INJURIES","value"])- 40 - TORNADO:
27962 - 39 - THUNDERSTORM WIND:
7861 - 15 - FLOOD:
7664 - 12 - EXCESIVE HEAT:
6525 - 29 - LIGHTNING:
5230
Bar chart of Property Damages by event type
ggplot(by_year_sum, aes(EVTYPECODE,PROPDMGNORM))+geom_col(na.rm = TRUE) + xlab("Event Code") + ylab("Total Damages in $")+ggtitle("Property damages by Event Type", "1989-2011") + theme(plot.title = element_text(hjust = 0.5), plot.subtitle = element_text(hjust = 0.5))+ scale_y_continuous(labels = dollar_format())
From the graph I can see that the events with the largest value of property damages are: (in desc order)
prp15 <- dollar(sum(by_year_sum[by_year_sum$EVTYPECODE==15, "PROPDMGNORM"]))
prp25 <- dollar(sum(by_year_sum[by_year_sum$EVTYPECODE==25, "PROPDMGNORM"]))
prp40 <- dollar(sum(by_year_sum[by_year_sum$EVTYPECODE==40, "PROPDMGNORM"]))
prp19 <- dollar(sum(by_year_sum[by_year_sum$EVTYPECODE==19, "PROPDMGNORM"]))
prp14 <- dollar(sum(by_year_sum[by_year_sum$EVTYPECODE==14, "PROPDMGNORM"]))- 15 - FLOOD:
$150,294,332,027 - 25 - HURRICANE/TYPHOON:
$69,305,840,000 - 40 - TORNADO:
$32,233,558,796 - 19 - HAIL:
$17,628,287,587 - 14 - FLASH FLOOD:
$17,589,842,096
Bar chart of Crop Damages by event type
ggplot(by_year_sum, aes(EVTYPECODE,CROPDMGNORM))+geom_col(na.rm = TRUE) + xlab("Event Code") + ylab("Total Damages in $")+ggtitle("Crop damages by Event Type", "1989-2011")+theme(plot.title = element_text(hjust = 0.5), plot.subtitle = element_text(hjust = 0.5)) + scale_y_continuous(labels = dollar_format())
From the graph I can see that the events with the largest value of crop damages are: (in desc order)
crp9 <- dollar(sum(by_year_sum[by_year_sum$EVTYPECODE==9, "CROPDMGNORM"]))
crp15 <- dollar(sum(by_year_sum[by_year_sum$EVTYPECODE==15, "CROPDMGNORM"]))
crp26 <- dollar(sum(by_year_sum[by_year_sum$EVTYPECODE==26, "CROPDMGNORM"]))
crp19 <- dollar(sum(by_year_sum[by_year_sum$EVTYPECODE==19, "CROPDMGNORM"]))
crp25 <- dollar(sum(by_year_sum[by_year_sum$EVTYPECODE==25, "CROPDMGNORM"]))- 9 - DROUGHT:
$13,972,566,000 - 15 - FLOOD:
$10,922,344,050 - 26 - ICE STORM:
$5,022,113,500 - 19 - HAIL:
$3,114,962,873 - 25 - HURRICANE/TYPHOON:
$2,607,872,800