Set your database connection info

server <- "usdbsvr8"  #SQL server
database <-"nws"     #sql DB name
fileName1 <- "wban_094973" ## must enter SQL table name
tablenumber <- 094973
#startDate <- "20160101"   #options,by default we dont use dates and just find all outliers
#endDate <- "20170202"  
type <- "extreme"  ## select type, can me mild or extreme -- ie. mild removes even 'mild' outliers, extreme, just very big ones
#directory<- "C:/Users/sspinetto/Desktop/ForClip.csv"  ##local location for  file creation

#### Don't touch anything below this, just select all & run!! #####
#set connections
setServ <- paste0("driver={SQL Server};server=",server,";database=",database,";trusted_connection=true")
myServer2 <- odbcDriverConnect(setServ)

Reads in your weather station

Summary Stats for each weather input w/o -99s + data availability

##      TEMPF            HUMID           WINDMPH            WDIR      
##  Min.   :-32.00   Min.   :  7.00   Min.   : 0.000   Min.   :  0.0  
##  1st Qu.: 27.00   1st Qu.: 58.00   1st Qu.: 0.000   1st Qu.:  0.0  
##  Median : 43.00   Median : 75.00   Median : 5.000   Median : 60.0  
##  Mean   : 42.55   Mean   : 71.64   Mean   : 4.589   Mean   :103.4  
##  3rd Qu.: 61.00   3rd Qu.: 87.00   3rd Qu.: 7.000   3rd Qu.:190.0  
##  Max.   :105.00   Max.   :833.00   Max.   :32.000   Max.   :360.0  
##  NA's   :14052    NA's   :1852     NA's   :2553     NA's   :34992  
##      CLOUD8          RAININ           year          
##  Min.   :0.000   Min.   :0.01     Length:183430     
##  1st Qu.:0.000   1st Qu.:0.01     Class :character  
##  Median :3.000   Median :0.02     Mode  :character  
##  Mean   :3.747   Mean   :0.05                       
##  3rd Qu.:8.000   3rd Qu.:0.05                       
##  Max.   :8.000   Max.   :2.60                       
##  NA's   :3562    NA's   :172165

Plot weather variables WITh -99s, Temperature is first

Graph of relative variance of weather inputs

Calculate % of -99s in each weather input

## Observations: 183,430
## Variables: 10
## $ .id         <chr> "01", "01", "01", "01", "01", "01", "01", "01", "0...
## $ obsDateTime <dttm> 1997-01-01, 1997-01-01, 1997-01-01, 1997-01-01, 1...
## $ TEMPF       <chr> "25", "BAD DATA", "BAD DATA", "BAD DATA", "BAD DAT...
## $ HUMID       <int> 92, -99, 96, 96, 96, 100, 100, 100, 96, 96, 96, 10...
## $ WINDMPH     <int> 10, -99, 9, 8, 8, 7, 8, 5, 4, 3, 4, 0, 6, 4, 3, 3,...
## $ WDIR        <int> 180, -99, 210, 210, 190, 200, 210, -99, 210, 210, ...
## $ CLOUD8      <int> 8, -99, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, ...
## $ RAININ      <dbl> -99, -99, -99, -99, -99, -99, -99, -99, -99, -99, ...
## $ year        <chr> "1997", "1997", "1997", "1997", "1997", "1997", "1...
## $ month       <chr> "01", "01", "01", "01", "01", "01", "01", "01", "0...