✨ Highlight ✨
Pandera now supports the configuration environment variable PANDERA_VALIDATION_ENABLED. export PANDERA_VALIDATION_ENABLED=False` now globally deactivates validation.
What's Changed
- Bump urllib3 from 2.0.4 to 2.0.7 by @dependabot in #1383
- Bump urllib3 from 2.0.5 to 2.0.7 in /dev by @dependabot in #1382
- Bump urllib3 from 2.0.4 to 2.0.7 in /ci by @dependabot in #1381
- Bugfix/1278 add_missing_columns assorted bugfixes by @derinwalters in #1372
- Fix lack of support for new TimestampNTZType in Spark 3.4 datatypes by @filipeo2-mck in #1385
- Current
pip-compileusage does not have--no-emit-index-urlby @filipeo2-mck in #1390 - Avoid throwing exception on Union types by @mjgp2 in #1378
- Fix optional fields in PySpark SQL by @filipeo2-mck in #1387
- Add support for
uniquevalidation in PySpark by @filipeo2-mck in #1396 - Enhancement to support GeoDataFrame, Geometry coercion, and CRS (Feature/1108) by @derinwalters in #1392
- fix issue for optional fields by @coobas in #1258
- Fix validating pyspark dataframes with regex columns by @lexanth in #1397
- Bump pyarrow from 13.0.0 to 14.0.1 by @dependabot in #1417
- Bump pyarrow from 13.0.0 to 14.0.1 in /dev by @dependabot in #1416
- Bump pyarrow from 13.0.0 to 14.0.1 in /ci by @dependabot in #1415
- [BUGFIX] [PYSPARK] Avoid running nullable checks if
nullable=Trueby @filipeo2-mck in #1403 - Add Date type to pandera.all by @diederikperdok in #1419
- Fix disabling validation for PySpark DataFrame Schemas by @maxispeicher in #1407
- Bump actions/checkout from 3 to 4 by @dependabot in #1361
- [PySpark] Improve validation performance by enabling
cache()/unpersist()toggles by @filipeo2-mck in #1414 - Bump urllib3 from 2.0.5 to 2.0.7 by @dependabot in #1420
- Generate localized timestamps in multiindex examples by @rob-sil in #1426
- feature: support string column validation for pandas 2.1.3 by @karlma821 in #1425
- Add support for
PANDERA_VALIDATION_ENABLEDfor pandas and Configuration docs by @noklam in #1354 - update total download badge and fix contributing instructions by @cosmicBboy in #1436
- update cache dataframe config args, fix tests by @cosmicBboy in #1437
- Bump jupyter-server from 2.7.3 to 2.11.2 in /dev by @dependabot in #1440
- Bump cryptography from 41.0.4 to 41.0.6 by @dependabot in #1435
- Bump jupyter-server from 2.7.2 to 2.11.2 by @dependabot in #1441
New Contributors
- @filipeo2-mck made their first contribution in #1385
- @mjgp2 made their first contribution in #1378
- @coobas made their first contribution in #1258
- @lexanth made their first contribution in #1397
- @diederikperdok made their first contribution in #1419
- @maxispeicher made their first contribution in #1407
- @rob-sil made their first contribution in #1426
- @karlma821 made their first contribution in #1425
- @noklam made their first contribution in #1354
Full Changelog: v0.17.2...v0.18.0