This repository contains the processing code and source data in developing the Hawaii observed hydropower generation dataset.
The Energy Information Administration (EIA) collects generation and facility nameplate capacity data every year. Utilities report generation data either monthly or annually. Generation data prior to 2008 were reported on Form EIA-759 and Forms EIA-906/920. From 2008 through the present, generation data are reported on Form EIA-923. Nameplate capacity until 1989 were reported on Form EIA-759. Nameplate capacity from 1989 through the present are reported on Form EIA-860.
In the EIA monthly generation data (in the data/processed directory), a 'freq' column is used to indicate data reporting frequency. This flag is consistent with reporting frequency on EIA forms, but modified in some instance for consistency.
| Flag | Description |
|---|---|
| M | data reported monthly |
| A | data reported annually |
| AM | data reported monthly and annually |
| AM/A | data reported monthly and annually |
| NR | reporting frequency not indicateda |
a even though not all EIA forms report frequency prior to 1996, they are given a 'M' reporting flag as EIA states that reporting was done monthly
In the FERC datasets, data are either provided monthly or annually by utilities.
Monthly data are aggregated to annual data and used if annual data are not available for that year and plant for that data source.
1_process_EIA.R -
- reads in EIA annual generation forms (EIA-759; EIA-609/EIA-920; EIA-923), extracts hydropower generation data for Hawaii, and standardizes data
- reporting frequency is retrieved from forms, and filled in where needed. from EiA, reporting was done monthly prior to 1996. between 1996 and 2000, reporting was done monthly and annually on separate forms. starting in 2001, reporting was done monthly and annually, with a disaggregation performed to estimate monthly data when only annual data were available
- reads in EIA reported generating capacity (EIA-759; EIA-860), extracts hydropower facility capacities for Hawaii, and standardizes data
- compiled EIA data, including generation and generating capacity, are written to the
data/processeddirectory
2_compile_generation.R -
- reads in data from EIA
- standardizes monthly and annual data with consistent column names and plant identifiers
- data reported monthly are used in the monthly dataset
- data reported annually, along with data reported monthly and aggregated to annual (when all 12 monthly values are available) when annual data for that year and source are not available are used in the annual dataset
- merges together data from all sources and these data are written to the
data/processeddirectory - performs QA/QC to check for outliers and negative values
The final generation datasets with data passing QA/QC checks are found in -
| File | Description |
|---|---|
| generation_hi_annual_final.csv | compiled and qa/qc'd annual generation data |
| generation_hi_monthly_final.csv | compiled and qa/qc'd monthly generation data |
The annual generation file has the following structure -
| Column | Description |
|---|---|
| EIA_ID | Energy Information Administration plant ID |
| PtName | Existing Hydropower Assets plant name |
| year | year |
| generation_mwh | generation in MWh |
| source | data source |
| type | net or gross generation |
| quality_flag | QA/QC flags (see below) |
The monthly generation file has the same structure, with the addition of a 'month' column.
| Flag | Description |
|---|---|
| A | acceptable |
| N | generation is < 0 MWh |
| R | generation falls outside 2 standard deviations of the long-term mean |
Data processing code for EIA forms were modified from code developed for RectifHyd dataset and for the RectifHydPlus dataset.