Source code for pudl.dagster.partitions

"""Dagster partition definitions for PUDL.

This module is the shared home for reusable partition definitions that multiple assets,
asset checks, sensors, or jobs need to reference consistently. Define partition objects
here when they represent orchestration-time slicing of the workload, such as a fixed
set of reporting periods, rather than resource configuration or dataset metadata.

For the underlying Dagster concept, see
https://docs.dagster.io/guides/build/partitions-and-backfills/partitioning-assets
"""

import dagster as dg

from pudl.metadata.classes import DataSource

# Ordered newest quarter first. FERC EQR filing volume grows over time (recent
# quarters are ~10x the early ones), and a backfill's wall time is bound by the
# slowest run in its final wave -- so the heavy quarters must be processed up
# front rather than bunched at the tail. Consumers use this only as a
# ``partitions_def`` (keyed by partition name), so the order affects just
# backfill/UI iteration, not materialization.


ferceqr_year_quarters: dg.StaticPartitionsDefinition = dg.StaticPartitionsDefinition(
    list(reversed(DataSource.from_id("ferceqr").working_partitions["year_quarters"]))
)


__all__ = ["ferceqr_year_quarters"]