Data engineeringCatalyst Cooperative · PUDL
Turning energy records into analysis-ready tables
Added tables, validation checks and spreadsheet extraction to Public Utility Data Liberation (PUDL) for consistent energy-storage analysis.
Result
Three analysis-ready tables and two merged contributions.
The challenge
Public energy records arrive in annual spreadsheets. Energy-storage analysis needs consistent tables and clear field definitions, with validation checks before the records are used.
My contribution
- Added base, monthly and yearly tables for EIA-923 energy-storage operations, with metadata and documentation.
- Added an Alembic database migration and dbt validation checks for the new outputs.
- Extended raw extraction across 15 annual workbooks in a separate contribution.
Results and validation
Both contributions were merged into PUDL. Energy-storage data is available through three documented tables, while the separate extraction change extends coverage across 15 annual workbooks.
Technical details
Open-source contributions to Catalyst Cooperative's existing pipeline. Storage outputs and raw-workbook extraction were delivered in separate pull requests.