dagster-io/dagster 0.7.4

on GitHub

New

• It is now possible to use Postgres to back schedule storage by configuring
  dagster_postgres.PostgresScheduleStorage on the instance.
• Added the execute_pipeline_with_mode API to allow executing a pipeline in test with a specific
  mode without having to specify RunConfig.
• Experimental support for retries in the Celery executor.
• It is now possible to set run-level priorities for backfills run using the Celery executor by
  passing --celery-base-priority to dagster pipeline backfill.
• Added the @weekly schedule decorator.

Deprecations

• The dagster-ge library has been removed from this release due to drift from the underlying
  Great Expectations implementation.

dagster-pandas

• PandasColumn now includes an is_optional flag, replacing the previous
  ColumnExistsConstraint.
• You can now pass the ignore_missing_values flag to PandasColumn in order to apply column
  constraints only to the non-missing rows in a column.

dagster-k8s

• The Helm chart now includes provision for an Ingress and for multiple Celery queues.

Documentation

• Improvements and fixes.