- [FEATURE] ZEP - PG
BatchSorter
loading + dumping (#6580) - [FEATURE] Ensure
result_format
accessed is through Checkpoint, and warns users ifExpectation
orValidator
-level (#6562) - [FEATURE] ZEP - PG
SqlYearMonthSplitter
serialization + deserialization (#6595) - [FEATURE] ID/PK -
unexpected_index_list
updated to include actual unexpected value, and EVR to includeunexpected_index_column_names
(#6586) - [FEATURE] Atomic rendering of Evaluation Parameters (#6232)
- [FEATURE] Add zep datasource data assistant e2e tests. (#6612)
- [FEATURE] F/great 1400/sql datasource (#6623)
- [FEATURE] Accept a
pathlib.Path
context_root_dir
(#6613) - [FEATURE] Atomic rendering of meta notes (#6627)
- [FEATURE] Docstring linter for public api (#6638)
- [FEATURE] ZEP - Load/dump new style config from DataContext (#6631)
- [FEATURE] ID/PK Rendering in DataDocs (#6637)
- [FEATURE] Use docstring linter for public api to catch missing parameters (#6642)
- [FEATURE] ZEP - load from shared config (#6655)
- [FEATURE] Added new expectation: ExpectYesterdayCountComparedToAvgEquivalentDaysOfWeek… (#6622) (thanks @HadasManor)
- [FEATURE] Add sqlite datasource (#6657)
- [FEATURE] ExpectDaySumToBeCloseToEquivalentWeekDayMean (#6664) (thanks @HadasManor)
- [FEATURE] ID/PK flag
return_unexpected_index_query
that allowsQUERY
output to be suppressed (#6660) - [FEATURE] F/great 1400/postgres constr (#6674)
- [FEATURE] Ensure Pandas ID/PK can use named indices (#6656)
- [FEATURE] Support to include ID/PK in validation result for each row - Spark (#6676)
- [FEATURE] ID/PK Pandas query returned as all unexpected indices (#6692)
- [BUGFIX] Support non-string
datetime
evaluation parameters (#6571) - [BUGFIX] Use v3.3.6 or higher of google-cloud-bigquery (with shapely bugfix) (#6590)
- [BUGFIX] Remove rendered header from Cloud-rendering tests (#6597)
- [BUGFIX] Patch broken
Validator
test afterDataContext
refactor (#6605) - [BUGFIX] Column value counts metric
dtype
inference due tonumpy
deprecation ofobject
dtype
(#6604) - [BUGFIX]
delete_datasource()
was getting passed in incorrect parameter for Spark Docs test (#6601) - [BUGFIX] Stop overwriting query with static string in RuntimeBatchRequests for SQL (#6614)
- [BUGFIX] Simplify metric results processing and improve detection of Decimal types in columns (#6610)
- [BUGFIX] Do not round output of proportion computing metrics (#6619)
- [BUGFIX] Add sqrt on connect to sqlite database. (#6635)
- [BUGFIX]
RendererConfiguration
min_value
andmax_value
withdatetime
s (#6632) - [BUGFIX] Fix a typo in contrib queried expectation (and add type hints to its implementation) (#6650)
- [BUGFIX] Avoid key collisions between Rule-Based Profiler terminal literals and MetricConfiguration value keys (#6675)
- [BUGFIX] Add connect args to execution engine schema (#6663) (thanks @itaise)
- [BUGFIX] Increase minimum
numpy
versions for Python 3.8 and 3.9 due to support in latest release ofscipy
(#6704) - [BUGFIX] Format current branch name properly for tag branches in docker tests (#6711)
- [DOCS] Patch broken snippet around Validation Actions (#6606)
- [DOCS] Fix formatting of 0.15.35 and 0.15.36 in changelogs (#6603)
- [DOCS] Convert broken snippet to named snippets (#6611)
- [DOCS] - add anonymous_usage_statistics configutation in documentation (#6626) (thanks @tmilitino)
- [DOCS] fixing wrong line reference on docs (#6599) (thanks @wagneralbjr)
- [DOCS] Sidebar changes for Integrations and how-tos (#6649)
- [DOCS] edit term(data_conext, checkpoints)-link in with airflow (#6646) (thanks @jx2lee)
- [DOCS] DOC-400 remove an outdated video link (#6667)
- [DOCS] doc-356 importable prerequisite box with correct theme applied and default entries (#6666)
- [MAINTENANCE]
mypy
config update (#6589) - [MAINTENANCE] Small refactor of ExecutionEngine.resolve_metrics() for better code readability (and miscellaneous additional clean up) (#6587)
- [MAINTENANCE] Remove
ExplorerDataContext
(#6592) - [MAINTENANCE] Leverage
RendererConfiguration
in existing prescriptive templates (2 of 3) (#6488) - [MAINTENANCE] Leverage
RendererConfiguration
in existing prescriptive templates (3 of 3) (#6530) - [MAINTENANCE] Add docs snippet checker to
dev
CI (#6594) - [MAINTENANCE] Utilize a
StrEnum
forConfigPeer
modes (#6596) - [MAINTENANCE] Refactor
BaseDataContext
andDataContext
into factory functions (#6531) - [MAINTENANCE] flake8 coverage -
render
,juptyer_ux
,checkpoint
sub-packages (#6607) - [MAINTENANCE] filter
RemovedInMarshmallow4
warnings (#6602) - [MAINTENANCE] Generate public API candidates (#6600)
- [MAINTENANCE] partial
cli
+usage_stats
typing (#6335) - [MAINTENANCE] update pip installs in pipelines (#6609)
- [MAINTENANCE] create cache as part of
--ci
type-checking step (#6621) - [MAINTENANCE] Add
row_condition
logic toRendererConfiguration
and remove from atomic renderer implementations (#6616) - [MAINTENANCE] install
pydantic
in develop pipeline (#6624) - [MAINTENANCE] Fix develop static type-check stage (#6628)
- [MAINTENANCE] Unexpected Counts table in DataDocs able to show counts for sampled values (#6634)
- [MAINTENANCE] CI - install from
requirements-types.txt
(#6639) - [MAINTENANCE] Add docstring linter for public api to CI (#6641)
- [MAINTENANCE] Batch ID must incorporate batch_spec_passthrough. Instantiate Validator with DataContext in test modules. Query metrics/expectations types cleanup. (#6636)
- [MAINTENANCE] Skip postgres tests in spark. (#6643)
- [MAINTENANCE] Enrich
RendererConfiguration
primitive types (#6629) - [MAINTENANCE] M/great 1225/async builds branch (#6644)
- [MAINTENANCE] Comment out calling _disable_progress_bars in build_gallery.py (#6648)
- [MAINTENANCE] Update generate_expectation_tests func to only log an ERROR message if there is an error (#6651)
- [MAINTENANCE] Use the correct test for positive_test__exact_min_and_max on trino (#6652)
- [MAINTENANCE] Update evaluate_json_test_v3_api func to use the debug_logger with useful info when exception occurs (#6653)
- [MAINTENANCE] Make only column y data_alt different in col_pair_equal tests (#6661)
- [MAINTENANCE] Add separate tests for exact stdev for redshift and snowflake (#6658)
- [MAINTENANCE] Add redshift/snowflake casting for sample data on expect_column_values_to_be_of_type (#6659)
- [MAINTENANCE] Add redshift/snowflake casting for sample data on expect_column_values_to_be_in_type_list (#6668)
- [MAINTENANCE] Make only column y data_alt different in col_pair_in_set tests (#6670)
- [MAINTENANCE] Only spark v2 for special test in not_be_in_set (#6669)
- [MAINTENANCE] Don't attempt any regex Expectation tests with snowflake (#6672)
- [MAINTENANCE] Clean up returns style and type hints in CardinalityChecker utility (#6677)
- [MAINTENANCE] begin flake8 linting on tests (#6679)
- [MAINTENANCE] Clean up packaging & installation pipeline (#6687)
- [MAINTENANCE] Misc updates to dev Azure pipeline (#6686)
- [MAINTENANCE]
mypy
typing forcore/util.py
(#6617) - [MAINTENANCE] Update
get_context
return type (#6684) - [MAINTENANCE] Get datetime tests working for trino/snowflake/spark in values_to_be_in_set (#6671)
- [MAINTENANCE] Cleanup typing errors. (#6691)
- [MAINTENANCE] Remove unused Metric and BatchMetric classes and consolidate ValidationMetricIdentifier with other identifiers (#6693)
- [MAINTENANCE] Refactor
BaseDataContext
to leverageget_context
(#6689) - [MAINTENANCE] expect day count to be close to equivalent week day mean (#6680) (thanks @HadasManor)
- [MAINTENANCE] ID/PK squashed tests re-added (#6694)
- [MAINTENANCE] initial type checking for
rules_based_profiler
(#6681) - [MAINTENANCE] Improve type checking for Expectations with atomic renderers leveraging
RendererConfiguration
(#6633) - [MAINTENANCE] Add deprecated Cloud variables to
_CloudConfigurationProvider.get_values()
output (#6708) - [MAINTENANCE] Autobuild markdown stubs (#6700)
- [MAINTENANCE] API docs styling (#6712)