On August 4, 2011, the Power New York Act of 2011 was signed into law, which directed New York State Energy Research and Development Authority (NYSERDA) to conduct a Study on Increasing Generation from Photovoltaic (PV) Devices in New York (the Solar Study). While the current contribution of solar electric (PV) energy generation is small and the cost of the technology is at a premium compared with market electricity prices, the Act sought analysis of the benefits and costs of PV, acknowledging that costs are declining and noting the potential for PV energy generation to contribute to economic development and job creation in the State.
Specifically, the Act directed that the Solar Study should:
Identify administrative and policy options that could be used to achieve goals of 2,500 Megawatts (MW) of PV installations operating by 2020 and 5,000 MW operating by 2025 (the “Goals”);
Estimate the per MW cost of achieving increased generation from PV devices and the costs of achieving the Goals using the options identified in the analysis;
Analyze the net economic and job creation benefits of achieving the Goals using each of the options identified in the analysis; and
Conduct an analysis of the environmental benefits of achieving the Goals using the options identified in the analysis.
The goal of the final project is to interactively analyze the available data to -
Plot NYSERDA reported data on NY state map capturing summarized gnerated metrics at county and/or city level from 2000 to September’2019
Create visualizations and analyze annual trends of Cumulative Vs. Annual growth for metrics like Total Capacity Generated, Number of Solar Projects Completed, Cost & Incentive per Watt, Expected Annual production etc.
Create summary visualization and comparatives between various sectors (Residential Vs. Commercial etc.) for metrics like Total Capacity (in MW), No. of projects etc. for projects already Completed and on Pipeline by county and/or city
Use Cross filtering and other techniques across different charts to create a more coherent user experience
For this project I am going to use Solar Electric Programs data provided by New York State Energy Research and Development Authority (NYSREDA). The detailed description of the data set is hosted on the below DATA.NY.GOV site - Data Site
The Data Dictionary for the data set is available at Link
This dataset includes information on solar photovoltaic (PV) installations supported by NYSERDA throughout New York State since 2000 by county, region, or statewide.
Since the primary source mentioned above provides only the details of the NYSREDA supported solar projects, I am planning to incorporate summary level aggregated data including the projects that didn’t receive state funding to create a comprehensive statewide view of available total installed solar capacity for all of New York. Apart from aggregated data from NYSERDA, this summary view includes data from NYS Department of Public Service (DPS), and the New York Independent System Operator (NYISO). I am planning to export tabular summarized data from the below NYSREDA page -
library(jsonlite)
library(kableExtra)
url = "https://data.ny.gov/resource/3x8r-34rs.json?$limit=20&$offset=0"
nysolardata <- fromJSON(url, simplifyVector = TRUE, flatten = TRUE)
names(nysolardata) ## [1] "reporting_period"
## [2] "project_number"
## [3] "city"
## [4] "county"
## [5] "state"
## [6] "zip_code"
## [7] "sector"
## [8] "program_type"
## [9] "solicitation"
## [10] "electric_utility"
## [11] "purchase_type"
## [12] "date_application_received"
## [13] "date_install"
## [14] "project_status"
## [15] "contractor"
## [16] "inverter_manufacturer"
## [17] "primary_inverter_model_number"
## [18] "inverter_quantity"
## [19] "pv_module_manufacturer"
## [20] "pv_module_model_number"
## [21] "pv_module_quantity"
## [22] "project_cost"
## [23] "incentive"
## [24] "totalnameplatekwdc"
## [25] "expected_kwh_annual_production"
## [26] "affordable_solar"
## [27] "community_distributed_generation"
## [28] ":@computed_region_yamh_8v7k"
## [29] ":@computed_region_wbg7_3whc"
## [30] ":@computed_region_kjdx_g34t"
## [31] ":@computed_region_n8jy_tbqr"
## [32] "remote_net_metering"
## [33] "green_jobs_green_new_york_participant"
## [34] "location_1.latitude"
## [35] "location_1.longitude"
## [36] "location_1.human_address"nysolardata %>% kable() %>% kable_styling(bootstrap_options = c("striped", "hover", "condensed", "responsive")) %>% scroll_box(width="100%",height="300px")| reporting_period | project_number | city | county | state | zip_code | sector | program_type | solicitation | electric_utility | purchase_type | date_application_received | date_install | project_status | contractor | inverter_manufacturer | primary_inverter_model_number | inverter_quantity | pv_module_manufacturer | pv_module_model_number | pv_module_quantity | project_cost | incentive | totalnameplatekwdc | expected_kwh_annual_production | affordable_solar | community_distributed_generation | :@computed_region_yamh_8v7k | :@computed_region_wbg7_3whc | :@computed_region_kjdx_g34t | :@computed_region_n8jy_tbqr | remote_net_metering | green_jobs_green_new_york_participant | location_1.latitude | location_1.longitude | location_1.human_address |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2019-09-30T00:00:00.000 | 4643-27509 | Slingerlands | Albany | NY | 12159 | Residential | Residential/Small Commercial | PON 2112 | National Grid | Lease | 2012-05-01T00:00:00.000 | 2012-12-06T00:00:00.000 | Complete | Tesla Energy Operations Inc. | Fronius USA | IG Plus 3.0-240 | 1 | Yingli Energy (China) | YL240P-29b | 12 | 14328.00 | 2722.00 | 3 | 3381 | No | No | 830 | 1406 | 2030 | 81 | NA | NA | 42.646421 | -73.874892 | {“address”: “”, “city”: “Slingerlands”, “state”: “NY”, “zip”: “12159”} |
| 2019-09-30T00:00:00.000 | 213607 | Brooklyn | Kings | NY | 11225 | Residential | Residential/Small Commercial | PON 2112 | Consolidated Edison | Purchase | 2019-09-25T00:00:00.000 | NA | Pipeline | NA | SMA America | SB5.0-1SP-US-40 [208V] | 1 | LG Electronics Inc. | LG365Q1C-A5 | 14 | 40074.64 | 1533.00 | 5.11 | 5998 | No | No | 894 | 809 | 2090 | 52 | NA | NA | 40.663779 | -73.953905 | {“address”: “”, “city”: “Brooklyn”, “state”: “NY”, “zip”: “11225”} |
| 2019-09-30T00:00:00.000 | 194980 | Brooklyn | Kings | NY | 11215 | Residential | Residential/Small Commercial | PON 2112 | Consolidated Edison | Purchase | 2019-07-11T00:00:00.000 | NA | Pipeline | NA | Enphase Energy Inc. | IQ7-60-x-US [208V] | 8 | LG Electronics Inc. | LG335N1C-A5 | 8 | 12086.80 | 804.00 | 2.68 | 3146 | No | No | 894 | 893 | 2090 | 45 | NA | NA | 40.666202 | -73.982561 | {“address”: “”, “city”: “Brooklyn”, “state”: “NY”, “zip”: “11215”} |
| 2019-09-30T00:00:00.000 | 213276 | Lisle | Broome | NY | 13797 | Residential | Residential/Small Commercial | PON 2112 | NYS Electric and Gas | Purchase | 2019-09-24T00:00:00.000 | NA | Pipeline | NA | SMA America | SB7.0-1SP-US-41 [240V] | 2 | Hanwha Q CELLS | Q.PLUS L-G4.2 345W | 48 | 41115.00 | 5796.00 | 16.56 | 19439 | No | No | 943 | 433 | 2033 | 98 | NA | NA | 42.337886 | -76.031586 | {“address”: “”, “city”: “Lisle”, “state”: “NY”, “zip”: “13797”} |
| 2019-09-30T00:00:00.000 | 205922 | Brooklyn | Kings | NY | 11233 | Residential | Residential/Small Commercial | PON 2112 | Consolidated Edison | Purchase | 2019-08-27T00:00:00.000 | NA | Pipeline | NA | SunPower | SPR-X22-370-D-AC [208V] | 12 | Sunpower | SPR-X22-370-D-AC | 12 | 26334.62 | 759.00 | 4.44 | 5212 | No | No | 894 | 816 | 2090 | 74 | NA | NA | 40.67783 | -73.919096 | {“address”: “”, “city”: “Brooklyn”, “state”: “NY”, “zip”: “11233”} |
| 2019-09-30T00:00:00.000 | 206644 | Queens | Queens | NY | 11357 | Residential | Residential/Small Commercial | PON 2112 | Consolidated Edison | Purchase | 2019-08-09T00:00:00.000 | NA | Pipeline | NA | Enphase Energy Inc. | IQ7-60-x-US [208V] | 12 | LG Electronics Inc. | LG335N1C-A5 | 12 | 25527.00 | 724.00 | 4.02 | 4719 | No | No | 196 | 827 | 2137 | 27 | NA | NA | 40.785459 | -73.811044 | {“address”: “”, “city”: “Queens”, “state”: “NY”, “zip”: “11357”} |
| 2019-09-30T00:00:00.000 | 4224-39686 | Niskayuna | Schenectady | NY | 12309 | Residential | Residential/Small Commercial | PON 2112 | National Grid | Purchase | 2014-02-21T00:00:00.000 | 2015-01-20T00:00:00.000 | Complete | Inverters Unlimited, Inc. | Fronius USA | IG Plus A 10.0-240 | 1 | Trina Solar | TSM-300PA14 | 30 | 30162.00 | 9000.00 | 9 | 10565 | No | No | 107 | 78 | 2142 | 82 | No | NA | 42.799243 | -73.875502 | {“address”: “”, “city”: “Niskayuna”, “state”: “NY”, “zip”: “12309”} |
| 2019-09-30T00:00:00.000 | 189479 | Syracuse | New York | NY | 13219 | Residential | Residential/Small Commercial | PON 2112 | National Grid | Purchase | 2019-06-20T00:00:00.000 | NA | Pipeline | NA | Enphase Energy Inc. | IQ7-60-x-US [240V] | 28 | Silfab Solar Inc | SLA310M [Blk] | 28 | 19946.00 | 3038.00 | 8.68 | 10189 | No | No | 699 | 733 | 2132 | 106 | NA | NA | 43.04093 | -76.224174 | {“address”: “”, “city”: “Syracuse”, “state”: “NY”, “zip”: “13219”} |
| 2019-09-30T00:00:00.000 | 210605 | Brooklyn | Kings | NY | 11212 | Residential | Residential/Small Commercial | PON 2112 | Consolidated Edison | Purchase | 2019-09-04T00:00:00.000 | NA | Pipeline | NA | SunPower | SPR-X22-360-E-AC [208V] | 12 | Sunpower | SPR-X22-360-E-AC | 12 | 35996.00 | 1296.00 | 4.32 | 5071 | No | No | 894 | 890 | 2090 | 76 | NA | NA | 40.661868 | -73.913254 | {“address”: “”, “city”: “Brooklyn”, “state”: “NY”, “zip”: “11212”} |
| 2019-09-30T00:00:00.000 | 212714 | Warwick | Orange | NY | 10990 | Residential | Residential/Small Commercial | PON 2112 | NYS Electric and Gas | Purchase | 2019-09-26T00:00:00.000 | NA | Pipeline | NA | Delta Electronics | SOLIVIA 5.2 NA G4 TL [240V] | 2 | SolarCity | SC330 | 33 | 45547.25 | 3811.00 | 10.89 | 12783 | No | No | 885 | 1656 | 2134 | 64 | NA | NA | 41.263165 | -74.365461 | {“address”: “”, “city”: “Warwick”, “state”: “NY”, “zip”: “10990”} |
| 2019-09-30T00:00:00.000 | 208136 | Brooklyn | Kings | NY | 11210 | Residential | Residential/Small Commercial | PON 2112 | Consolidated Edison | Lease | 2019-08-16T00:00:00.000 | NA | Pipeline | NA | Enphase Energy Inc. | IQ7-60-x-US [208V] | 17 | LG Electronics Inc. | LG335N1C-V5 | 17 | 24180.98 | 1709.00 | 5.7 | 6685 | No | No | 894 | 888 | 2090 | 44 | NA | NA | 40.627743 | -73.946445 | {“address”: “”, “city”: “Brooklyn”, “state”: “NY”, “zip”: “11210”} |
| 2019-09-30T00:00:00.000 | 4629-53165-GJ | Holtsville | Suffolk | NY | 501 | Residential | Residential/Small Commercial | PON 2112LI | PSEG Long Island | Purchase | 2014-12-19T00:00:00.000 | 2015-02-05T00:00:00.000 | Complete | Harvest Power | SolarEdge Technologies | SE 10000A-US (240V) | 1 | SunPower | SPR-X21-335-BLK | 31 | 51816.50 | 4154.00 | 10 | 12190 | No | No | NA | NA | NA | NA | No | Residential | NA | NA | NA |
| 2019-09-30T00:00:00.000 | 4629-58007 | Babylon | Suffolk | NY | 11702 | Residential | Residential/Small Commercial | PON 2112LI | PSEG Long Island | Purchase | 2015-02-26T00:00:00.000 | 2015-05-04T00:00:00.000 | Complete | Harvest Power | SMA America | SB4000US-12 (240V) | 1 | SunPower | SPR-E20-245 | 18 | 19845.00 | 1323.00 | 4 | 5177 | No | No | 1023 | NA | 2179 | 9 | No | NA | 40.653301 | -73.380416 | {“address”: “”, “city”: “Babylon”, “state”: “NY”, “zip”: “11702”} |
| 2019-09-30T00:00:00.000 | 206659 | Bronx | Bronx | NY | 10462 | Residential | Residential/Small Commercial | PON 2112 | Consolidated Edison | Lease | 2019-08-15T00:00:00.000 | NA | Pipeline | NA | SMA America | SB7.0-1SP-US-40 [240V] | 1 | REC Solar | REC290TP2 BLK | 26 | 18220.00 | 1516.00 | 7.54 | 8851 | No | No | 307 | 675 | 2032 | 137 | NA | NA | 40.841597 | -73.857475 | {“address”: “”, “city”: “Bronx”, “state”: “NY”, “zip”: “10462”} |
| 2019-09-30T00:00:00.000 | 210316 | Queens | Queens | NY | 11004 | Residential | Residential/Small Commercial | PON 2112 | Consolidated Edison | Lease | 2019-08-29T00:00:00.000 | NA | Pipeline | NA | SolarEdge Technologies Ltd. | SE3800H-US [240V] | 1 | REC Solar | REC290TP2 BLK | 10 | 7468.00 | 870.00 | 2.9 | 3404 | No | No | 196 | 861 | 2137 | 24 | NA | NA | 40.745241 | -73.712092 | {“address”: “”, “city”: “Queens”, “state”: “NY”, “zip”: “11004”} |
| 2019-09-30T00:00:00.000 | 185753 | Queens | Queens | NY | 11427 | Residential | Residential/Small Commercial | PON 2112 | Consolidated Edison | Lease | 2019-05-14T00:00:00.000 | NA | Pipeline | NA | Enphase Energy Inc. | IQ6-60-x-US [208V] | 10 | Trina Solar | TSM-280DD05A.05(II) | 10 | 10760.40 | 840.00 | 2.8 | 3287 | No | No | 196 | 1212 | 2137 | 24 | NA | NA | 40.729539 | -73.749551 | {“address”: “”, “city”: “Queens”, “state”: “NY”, “zip”: “11427”} |
| 2019-09-30T00:00:00.000 | 211978 | Queens | Queens | NY | 11412 | Residential | Residential/Small Commercial | PON 2112 | Consolidated Edison | Purchase | 2019-09-12T00:00:00.000 | NA | Pipeline | NA | Enphase Energy Inc. | IQ7-60-x-US [208V] | 17 | LG Electronics Inc. | LG335N1C-A5 | 17 | 29386.20 | 1709.00 | 5.7 | 6685 | No | No | 196 | 851 | 2137 | 36 | NA | NA | 40.698064 | -73.759234 | {“address”: “”, “city”: “Queens”, “state”: “NY”, “zip”: “11412”} |
| 2019-09-30T00:00:00.000 | 207592 | Queens | Queens | NY | 11365 | Residential | Residential/Small Commercial | PON 2112 | Consolidated Edison | Purchase | 2019-08-14T00:00:00.000 | NA | Pipeline | NA | SunPower | SPR-A400-G-AC [240V] | 15 | Sunpower | SPR-A400-G-AC | 15 | 25286.00 | 1800.00 | 6 | 7043 | No | No | 196 | 835 | 2137 | 26 | NA | NA | 40.739381 | -73.793039 | {“address”: “”, “city”: “Queens”, “state”: “NY”, “zip”: “11365”} |
| 2019-09-30T00:00:00.000 | 4116-37435 | Ithaca | Tompkins | NY | 14850 | Residential | Residential/Small Commercial | PON 2112 | NYS Electric and Gas | Purchase | 2014-01-02T00:00:00.000 | 2015-01-12T00:00:00.000 | Complete | Solar Liberty Energy Systems, Inc. | Enphase Energy | M215-60-2LL-S2X | 28 | Solar Liberty | SLX 255 USB | 28 | 32200.00 | 7000.00 | 7 | 8381 | No | No | 709 | 1786 | 2181 | 101 | No | NA | 42.443738 | -76.497069 | {“address”: “”, “city”: “Ithaca”, “state”: “NY”, “zip”: “14850”} |
| 2019-09-30T00:00:00.000 | 208449 | The Bronx | Bronx | NY | 10466 | Residential | Residential/Small Commercial | PON 2112 | Consolidated Edison | Lease | 2019-08-17T00:00:00.000 | NA | Pipeline | NA | SunPower | SPR-A400-G-AC [240V] | 15 | Sunpower | SPR-A400-G-AC | 15 | 38265.83 | 1800.00 | 6 | 7043 | No | No | 307 | 679 | 2032 | 133 | NA | NA | 40.891057 | -73.846822 | {“address”: “”, “city”: “The Bronx”, “state”: “NY”, “zip”: “10466”} |
I am planning to build an interactive Visualization application with either R Shiny OR Python Dash with Plotly as the primary visualization library. Also, I am planning to use SOCRATA JSON API to dynamically query data with SoSQL queries to optimize data extraction process for this project.
Solar energy is one of the major alternative clean sources of energy and State of New York is a national leader in the deployment and production of renewable energy. As part of this journey towards clean energy transition with the most aggressive climate change program in the nation, the State is on the path to be entirely carbon-neutral across all sectors of the economy.
Governor Andrew M. Cuomo’s Green New Deal calls for 70 percent of the State’s electricity to come from renewable sources by 2030 and 5,000 megawatts of solar by 2025. NY-Sun, the Governor’s $1 billion solar initiative advances the scale-up of solar is moving the State to a more sustainable, self-sufficient solar industry.
However, there is significant uncertainty in estimating the cost of PV out to 2025. Experts project that the installed cost of PV by 2025 could range from $1.4 to $4.3 million per installed MW. This range and various assumptions about the renewal of the federal tax credit, set to expire in 2016, formed the basis of the scenarios analyzed in the Solar Study.
The Low Cost scenario is based on the DOE SunShot goal for PV cost reduction and assumed extension of the federal tax credit through 2025.
The High Cost scenario is based on long-term historical trends and assumed the federal tax credit would revert to a pre-federal stimulus level following expiration of the current credit in 2016.
The most likely scenario, referred to as the Base Case, is based on a survey of experts by the DOE and assumed a moderate reduction of the federal tax credit beyond 2016. The Base Case estimates $2.5 million per installed MW for large-scale systems and $3.1 million per installed MW for small-scale systems.
The cost of achieving a 5,000 MW goal exceeds the benefits using the Base Case scenario.
The cost of PV and the availability of federal tax credits through 2025 are the driving factors of cost in a 5,000 MW goal.
Modeling of the Base Case scenario found that while direct PV jobs would be created, the impact on New York’s economy as a whole would be a net negative primarily due to the ratepayer impact.
Approximately 2,300 jobs associated directly with PV installation would be created for the installation period through 2025.
Economy-wide jobs would be reduced by 750 through 2049 because of a loss of discretionary income that would have supported employment in other sectors in the economy.
The Gross State Product (GSP) would be reduced by $3 billion through 2049, representing an annual decrease in GSP of less than 0.1%.
The Low Cost scenario would lead to a creation of 700 jobs economy-wide through 2049, while the High Cost scenario would lead to a loss of 2,500 jobs.
A 5,000 MW goal would yield the following environmental benefits through 2049:
A 4% reduction in fossil fuel consumption equal to 1,100 trillion Btus.
A 3% reduction in carbon dioxide (CO2) emissions equal to 47 million tons.
A reduction of nitrogen oxides (NOx), which produces smog and acid rain, by 33,000 tons (4%); sulfur dioxide (SO2), which also produces smog and acid rain, by 67,000 tons (10%); and mercury by 120 pounds (3%).
Various artifacts related to this study conducted by NYSERDA can be found below -