This repository contains the processing code and source data in developing the Puerto Rico observed hydropower generation dataset.
The Energy Information Administration (EIA) collects generation and facility nameplate capacity data every year. Utilities report generation data either monthly or annually. EIA started collecting data for Puerto Rico in 2017 reported on Form EIA-923.
EIA does not collect nameplate capacities for Puerto Rico facilities
In the EIA monthly generation data (in the data/processed directory), a 'freq' column is used to indicate data reporting frequency. This flag is consistent with reporting frequency on EIA forms, but modified in some instance for consistency.
| Flag | Description |
|---|---|
| M | data reported monthly |
| A | data reported annually |
| AM | data reported monthly and annually |
| AM/A | data reported monthly and annually |
| NR | reporting frequency not indicateda |
a even though not all EIA forms report frequency prior to 1996, they are given a 'M' reporting flag as EIA states that reporting was done monthly
1_process_EIA.R -
- reads in EIA annual generation forms (EIA-923), extracts hydropower generation data for Puerto Rixo, and standardizes data
- reporting frequency is retrieved from forms, and filled in where needed.
- compiled EIA data, including generation and generating capacity, are written to the
data/processeddirectory
2_compile_generation.R -
- reads in data from EIA
- standardizes monthly and annual data with consistent column names and plant identifiers
- data reported monthly are used in the monthly dataset
- data reported annually, along with data reported monthly and aggregated to annual (when all 12 monthly values are available) when annual data for that year and source are not available are used in the annual dataset
- merges together data from all sources and these data are written to the
data/processeddirectory - performs QA/QC to check for outliers, negative values, and discrepencies across data sources
The final generation datasets containing the highest-ranked data source passing QA/QC checks are found in -
| File | Description |
|---|---|
| generation_pr_annual_final.csv | compiled and qa/qc'd annual generation data |
| generation_pr_monthly_final.csv | compiled and qa/qc'd monthly generation data |
The annual generation file has the following structure -
| Column | Description |
|---|---|
| EIA_ID | Energy Information Administration plant ID |
| PtName | Existing Hydropower Assets plant name |
| year | year |
| generation_mwh | generation in MWh |
| source | data source (reported as source dataset and it's data source if not reported directly e.g. AES compiles data from EIA, ) |
| source_simple | simplified data source for plotting and evaluation (matches source_name_tbl) |
| type | net or gross generation |
| quality_flag | QA/QC flags (see below) |
The monthly generation file has the same structure, with the addition of a 'month' column.
| Flag | Description |
|---|---|
| A | acceptable |
| N | generation is < 0 MWh |
| R | generation falls outside 2 standard deviations of the long-term mean |
Data processing code for EIA forms were modified from code developed for RectifHyd dataset and for the RectifHydPlus dataset.