explorer 0.5.0

v0.5.0

on Hex

Added

• Add DataFrame.describe/2 to gather some statistics from a dataframe.

• Add Series.nil_count/1 to count nil values.

• Add Series.in/2 to check if a given value is inside a series.

• Add Series float predicates: is_finite/1, is_infinite/1 and is_nan/1.

• Add Series string functions: contains/2, trim/1, trim_leading/1, trim_trailing/1,
  upcase/1 and downcase/1.

• Enable slicing of lazy frames (LazyFrame).

• Add IO operations "from/load" to the lazy frame implementation.

• Add support for the :lazy option in the DataFrame.new/2 function.

• Add Series float rounding methods: round/2, floor/1 and ceil/1.

• Add support for precompiling to Linux running on RISCV CPUs.

• Add support for precompiling to Linux - with musl - running on AARCH64 computers.

• Allow DataFrame.new/1 to receive the :dtypes option.

• Accept :nan as an option for Series.fill_missing/2 with float series.

• Add basic support for the categorical dtype - the :category dtype.

• Add Series.categories/1 to return categories from a categorical series.

• Add Series.categorise/2 to categorise a series of integers using predefined categories.

• Add Series.replace/2 to replace the contents of a series.

• Support selecting columns with unusual names (like with spaces) inside Explorer.Query
  with col/1.

  The usage is like this:

  Explorer.DataFrame.filter(df, col("my col") > 42)

Fixed

• Fix DataFrame.mutate/2 using a boolean scalar value.
• Stop leaking UInt32 series to Elixir.
• Cast numeric columns to our supported dtypes after IO read.
  This fix is only applied for the eager implementation for now.

Changed

• Rename Series.bintype/1 to Series.iotype/1.

Pull requests made for this release

• Add DF describe by @cristineguadelupe in #444
• Fix mutate using a boolean scalar value by @miXwui in #445
• Add s_nil_count by @cristineguadelupe in #446
• Adds Series.in/2 function by @kimjoaoun in #420
• Add Series float predicates: is_finite/1, is_infinite/1, is_nan/1 by @sasikumar87 in #448
• Add Series string functions by @cigrainger in #449
• Enables the slicing of LazyFrames by @kimjoaoun in #450
• Add IO operations "from/load" to the LazyFrame implementation by @philss in #451
• Add Series float rounding methods: round/2, floor/1 and ceil/1 by @sasikumar87 in #455
• Percentiles for describe by @cristineguadelupe in #454
• Add support for RISCV and Linux on M1/2 with musl by @philss in #456
• Update polars to v0.26.1 by @philss in #459
• Allow DataFrame.new/1 to receive the dtypes option by @Jhonatannunessilva in #460
• Add basic support for categorical dtype by @philss in #464
• Add Series.categories/1 by @philss in #465
• Add Series.categorise/2 by @philss in #466
• Normalize numeric dtypes when loading/reading from IO by @philss in #470
• Prepare release v0.5.0 by @philss in #469

New Contributors

• @cristineguadelupe made their first contribution in #444
• @miXwui made their first contribution in #445
• @Jhonatannunessilva made their first contribution in #460

The official Changelog: https://github.com/elixir-nx/explorer/blob/main/CHANGELOG.md#v050---2023-01-12
Full diff of this version: v0.4.0...v0.5.0

Checksums

Below are the checksums of the precompiled files.

53ae33bcf9f56416706bcd20e1b995c86e03ff4e3332668121ededfc7571f1fb  explorer-v0.5.0-nif-2.15-x86_64-pc-windows-gnu.dll.tar.gz
af21cbd83a4f4c6a66f3f575803947f8c4c030800d2e50640c306efec8ba3276  explorer-v0.5.0-nif-2.15-x86_64-pc-windows-msvc.dll.tar.gz
88a045e498d8bc92e72a67a212609cdf9c19e30f508632dcf1c1aaa11654eb49  explorer-v0.5.0-nif-2.16-x86_64-pc-windows-gnu.dll.tar.gz
340fc42a6f82783e6691fe2d65df71634453c9b0c18df603e4e0bff3d1509bbe  explorer-v0.5.0-nif-2.16-x86_64-pc-windows-msvc.dll.tar.gz
2b3036a5911381090df6ff9ee850a8fb7bad67a0f45ffe534b40f83a24b54fb6  libexplorer-v0.5.0-nif-2.15-aarch64-apple-darwin.so.tar.gz
0c2505a8162fab9f966d319c577778aa8243c9c2c4aafd6139b5fb05dfa040b7  libexplorer-v0.5.0-nif-2.15-aarch64-unknown-linux-gnu.so.tar.gz
707b1b8417463ef21fca8e68047c0fcca14188bdc2841222ce4de57d0d10a0b9  libexplorer-v0.5.0-nif-2.15-aarch64-unknown-linux-musl.so.tar.gz
40cd4a3450755723fdec39c2c2a974de5e3003e67b612e30a524611da3b4b6a0  libexplorer-v0.5.0-nif-2.15-arm-unknown-linux-gnueabihf.so.tar.gz
5e176c2b7bbbbef9f7baf07a507cf72638b60f36629543e3c8ba169a90bfc484  libexplorer-v0.5.0-nif-2.15-riscv64gc-unknown-linux-gnu.so.tar.gz
81d542d98c78dcc49a09ef56457b143e345c24a4a04ce9c718a026f6754a27aa  libexplorer-v0.5.0-nif-2.15-x86_64-apple-darwin.so.tar.gz
1923583ef16fd2c7575b1149d76fa88a95ad8a2395a6aabd6b8aa04f0f81507b  libexplorer-v0.5.0-nif-2.15-x86_64-unknown-linux-gnu.so.tar.gz
43fd64d5c41e3255da0aec2b5516be3739574b582cc8794e0aeb73b9a3d80cc6  libexplorer-v0.5.0-nif-2.15-x86_64-unknown-linux-musl.so.tar.gz
c966b3db56b9484af6e4d8ab53da720d7022c37246e6363d7042d6629a37074d  libexplorer-v0.5.0-nif-2.16-aarch64-apple-darwin.so.tar.gz
c198f27bb94c0e50fd7012283538756d25025d8e52560931a8d198a551b5c594  libexplorer-v0.5.0-nif-2.16-aarch64-unknown-linux-gnu.so.tar.gz
8a0fcff821590a872480b634421b2fab9673a6649a2943b47c7f4bc83111e683  libexplorer-v0.5.0-nif-2.16-aarch64-unknown-linux-musl.so.tar.gz
f23a0df9e39b7e26d5f84035019ee81e3f43e8556707937e14bfc12fcfa841e5  libexplorer-v0.5.0-nif-2.16-arm-unknown-linux-gnueabihf.so.tar.gz
4b36fc0b4d0b83fd8784b71f45ddb720d5319b3b1d0548481f09541dca4b2bc3  libexplorer-v0.5.0-nif-2.16-riscv64gc-unknown-linux-gnu.so.tar.gz
af5220707b55c73e5eecf9839173822dc6d3215e3cc09e92782363771a42e59e  libexplorer-v0.5.0-nif-2.16-x86_64-apple-darwin.so.tar.gz
197eaea18bd4e05e2cb86ceee607119ffccb671816b28d5fc060e568303a0b7e  libexplorer-v0.5.0-nif-2.16-x86_64-unknown-linux-gnu.so.tar.gz
10d244fa00c6abe000936a8649e87c6e71690e33267407bf5d945084c027ba0e  libexplorer-v0.5.0-nif-2.16-x86_64-unknown-linux-musl.so.tar.gz