🏆 Highlights
🚀 Performance improvements
- improve list explode perf (#8974)
- Improve explodes:
offsets_to_indexes
performance (#8964) - avoid quadratic
exclude
behaviour when selecting against dtypes and/or wildcards (#8953) - use simd-json for all json parsing (#8922)
- improve performance of
align_frames
, and add new alignment option (#8899)
✨ Enhancements
- error on invalid sortby expr (#8986)
- Pushdown
is_in
to pyarrow dataset (#8930) - allow set column list input to 'drop' and 'drop_nulls' (#8962)
Array
(backed byarrow::FixedSizeList
datatype (#8943)- Add
dtype
argument forrepeat
(#8946) - Use schema keys to define the columns if only the schema is provided to
pl.struct
(#8952) - multiple enhancements for
SQLContext
(#8944) - add sql UNION, UNION ALL & UNION DISTINCT (#8936)
- add sql compound identifiers (#8934)
- add sql EXCLUDE (#8913)
- add sql CASE (#8911)
- add sql EXPLAIN (#8897)
- Write dataframes as delta tables (#7616)
- improve performance of
align_frames
, and add new alignment option (#8899) - improved inference from type annotations (#8895)
🐞 Bug fixes
- Fix erroneous warning in
hist
(#8982) - don't modify
Series
with empty names in-place onDataFrame
init (#8956) - respect rechunk in parquet (#8935)
- Add hint on PyArrow to ADBC import error (#8898)
- Simplify offsets_to_indexes, fix empty offsets edge cases (#8920)
- sql qualified wildcards (#8916)
- address edge cases with in-place modification of
Series
objects (#8915) - don't check sortedness in asof by (#8906)
- check for object type in csv writer (#8894)
- improve performance of
align_frames
, and add new alignment option (#8899) - window function with filtered groups (#8880)
🛠️ Other improvements
- deprecate
rename
"in_place" parameter (#8960) - Clean up tests for
repeat
(#8979) - Deprecate
name
argument forrepeat
(#8977) - simplify
take_every
(#8971) - Clean up
repeat
/ones
/zeros
(#8963) - further enhance
SQLContext
docstrings (#8948) - docs(python) Fix typo in
lazygroupby.rs
error message (#8937) - fix docstring for
time()
(#8939) - refactor tzinfo-related tests (#8883)
Thank you to all our contributors for making this release possible!
@CloseChoice, @MarcoGorelli, @alexander-beedie, @avimallu, @cbowdon, @chitralverma, @jonashaag, @kpberry, @mcrumiller, @petar-savov, @ritchie46, @stinodego and @universalmind303