pudl.resources

Collection of Dagster resources for PUDL.

Classes

RuntimeSettings

Encodes runtime settings for the ferc_to_sqlite graphs.

Functions

dataset_settings(→ pudl.settings.DatasetsSettings)

Dagster resource for parameterizing PUDL ETL assets.

ferc_to_sqlite_settings(...)

Dagster resource for parameterizing the ferc_to_sqlite graph.

datastore(→ pudl.workspace.datastore.Datastore)

Dagster resource to interact with Zenodo archives.

Module Contents

class pudl.resources.RuntimeSettings[source]

Bases: dagster.ConfigurableResource

Encodes runtime settings for the ferc_to_sqlite graphs.

xbrl_num_workers: None | int = None[source]
xbrl_batch_size: int = 50[source]
pudl.resources.dataset_settings(init_context) → pudl.settings.DatasetsSettings[source]

Dagster resource for parameterizing PUDL ETL assets.

This resource allows us to specify the years we want to process for each datasource in the Dagit UI.

pudl.resources.ferc_to_sqlite_settings(init_context) → pudl.settings.FercToSqliteSettings[source]

Dagster resource for parameterizing the ferc_to_sqlite graph.

This resource allows us to specify the years we want to process for each datasource in the Dagit UI.

pudl.resources.datastore(init_context) → pudl.workspace.datastore.Datastore[source]

Dagster resource to interact with Zenodo archives.