infiniflow/infinity v0.3.0 on GitHub

What's Changed

Support simd functions dispatch at runtime by @yangzq50 in #1473
Add Qdrant benchmark on sparse embedding of SPLADE by @Ami11111 in #1478
Update simd support for aarch64 by @yangzq50 in #1481
Fix document error by @JinHai-CN in #1483
Update performance image by @JinHai-CN in #1482
Update performance information by @JinHai-CN in #1487
Refactor document by @JinHai-CN in #1488
VFS first phrase by @yuzhichang in #1485
Refactor examples by @JinHai-CN in #1489
Memidx refactor by @small-turtle-1 in #1484
Add Milvus benchmark on sparse embedding of SPLADE by @Ami11111 in #1491
Add: const column vector. by @small-turtle-1 in #1486
Add Milvus benchmark on dataset sift by @Ami11111 in #1494
Add symbolic links to large files in vfs by @Ma-cat in #1495
Initial updates to tensor_search.py by @writinwaters in #1499
Add asking user beforing downloading dataset and add support for precision calculation for Qdrant by @Ami11111 in #1498
Support float16 type and bfloat16 type for column data type by @yangzq50 in #1503
Add Qdrant sparse vector support for benchmark framework by @Ami11111 in #1504
Initial updates to filter_data.py by @writinwaters in #1505
Initial updates to hybrid_search.py by @writinwaters in #1507
Add infinity sparse vector support for benchmark framework by @Ami11111 in #1506
Fix: support tensor insert for local infinity in python sdk by @yangzq50 in #1502
Support basic import/export for parquet format. by @Ognimalf in #1446
Fix: python api error detect. by @small-turtle-1 in #1508
Update version info and document by @JinHai-CN in #1511
Updare benchmark framework README by @Ami11111 in #1513
Update the identifier to lower case when the request is from API but not SQL by @JinHai-CN in #1514
Add test case for upper and lower cases when creating a database, table or index from python api. by @Ami11111 in #1517
Updated export_data API reference by @writinwaters in #1518
Fix bug: upper case column name, type and parameter are not cast to lower case. by @JinHai-CN in #1519
Add SNAPPY as the third_party by @JinHai-CN in #1520
Added zstd, bzip2 and brotli to builder image by @yuzhichang in #1523
Parquet import/export by @small-turtle-1 in #1521
Refactored Python API reference. by @writinwaters in #1522
Add insert row limit and change chunk size to 64K again by @JinHai-CN in #1526
Supports cleaning up vfs by @Ma-cat in #1529
Simplified python code example by @writinwaters in #1531
Fix mem leak by @small-turtle-1 in #1532
Support int8 embedding and uint8 embedding by @yangzq50 in #1527
Add test cases for tensor in test_knn.py by @Ami11111 in #1528
Fix compact by @small-turtle-1 in #1537
Updated setuptools by @yuzhichang in #1524
Fix corruption if no outputs from analyzer by @yingfeng in #1539
Add knn test cases for tensor and sparse vector by @Ami11111 in #1536
Editorial updates to python API by @writinwaters in #1538
Fix bool column default value for python sdk by @yangzq50 in #1543
Fix: delta ckp commit ts. by @small-turtle-1 in #1548
Limit the embedding dimension to 65536 by @JinHai-CN in #1547
Standard analyzer could output unicode tokens by @yingfeng in #1541
Fix creating fulltext index oom in debug mode by @Ma-cat in #1550
Fix: cleanup block when import/compact fail. by @small-turtle-1 in #1551
Refactor conflictcheck by @small-turtle-1 in #1552
Refactor WAL Manager by @JinHai-CN in #1553
Support VFS for fulltext index. by @Ognimalf in #1546
Merge programs under cases folder and internal folder together by @Ami11111 in #1540
Editorial updates to Python API reference by @writinwaters in #1557
Fix: compact with delete bug. by @small-turtle-1 in #1558
Refactor the txn commit and rollback by @JinHai-CN in #1555
Editorial updates to the API by @writinwaters in #1560
Fix bug by @small-turtle-1 in #1559
Updated return values by @writinwaters in #1564
Minor editorial updates. by @writinwaters in #1566
Fix: get cleanup ts by @small-turtle-1 in #1567
Add http api test cases support for the test framework by @Ami11111 in #1562
add diskann create_index api by @YReddice in #1556
Obtains the path to the environment variable in the documentation by @YReddice in #1568
Add bvecs file import support and fix its bug by @Ami11111 in #1572
Updated create_index by @writinwaters in #1571
Fix memory index multiple bugs when using vfs by @Ma-cat in #1561
Enable wal and ckp unit tests for VFS by @Ognimalf in #1570
Support float16 and bfloat16 embedding data type by @yangzq50 in #1579
Fix http api bug that create and drop table with invalid conflict type will not raise exception by @Ami11111 in #1576
Enable http api delete with empty filter by @Ami11111 in #1577
Show SIMD support in welcome info by @yangzq50 in #1585
Update version info of 0.3.0.dev3 by @JinHai-CN in #1584
Updated example codes by @writinwaters in #1581
Add debug/admin mode by @JinHai-CN in #1573
Memidx quota1 by @small-turtle-1 in #1580
Remove redundant test cases by @JinHai-CN in #1586
Updated index-related apis by @writinwaters in #1590
Fix bvecs import use int8 rather than uint8 by @Ami11111 in #1574
Fix bug and add python test for float16 and bfloat16 embedding type by @yangzq50 in #1588
Minor editorial udpates. by @writinwaters in #1594
Update http_adapter to create table with non-empty default field by @Ami11111 in #1593
Update python SDK by @JinHai-CN in #1592
delete and update api updates by @writinwaters in #1597
Fix http adapter and http api bug and add fvecs file export support for http api by @Ami11111 in #1595
User can set background operation interval by @JinHai-CN in #1596
minor by @writinwaters in #1600
Fix error reporting in CMake by @Smertig in #1599
Fix http adapter bug and update some test cases by @Ami11111 in #1598
Add list_indexes for embedded python SDK by @JinHai-CN in #1602
Fixed inconsistent behavior between local and remote on fusion by @Ma-cat in #1603
Enable http api create table with spares, tensor, tensorarray column type by @Ami11111 in #1604
Fix: can't connect other local directory by @JinHai-CN in #1610
Fix http api bug that creating and droping index with invalid conflict type will not return error by @Ami11111 in #1608
Updated filter and update methods by @writinwaters in #1611
Restart test 1 by @small-turtle-1 in #1591
Update version info to 0.3.0.dev4 by @JinHai-CN in #1612
Drop created database after function test by @JinHai-CN in #1614
Refactor fulltext search by @yuzhichang in #1613
Minor editorial updates by @writinwaters in #1616
Enable http api to insert sparce vector by @Ami11111 in #1618
Updated knn by @writinwaters in #1626
Fix some vfs bugs and implement vfs related unit tests by @Ma-cat in #1617
Enable http api insert tensor and tensorarray by @Ami11111 in #1621
Enable http api to output _row_id, _distance, _similarity, _score by @Ami11111 in #1623
Fix: fulltext optimize bug. by @small-turtle-1 in #1619
minor editorial updates by @writinwaters in #1629
Add show statement for persistent files by @JinHai-CN in #1624
Add "operator" option for fulltext query by @yangzq50 in #1622
Support function expression when filter data. by @JinHai-CN in #1630
Enable match_sparse in http api by @Ami11111 in #1633
Refactor varchar1 by @small-turtle-1 in #1632
Updated match_sparse by @writinwaters in #1631
Refactor create index interface by @JinHai-CN in #1634
Enable "match_tensor" fusion method in http api by @Ami11111 in #1635
Use new index parameter by @JinHai-CN in #1638
Add multiple datatype support and enable match tensor array for http api by @Ami11111 in #1639
Add: new varchar storage. by @small-turtle-1 in #1637
Fix update bug and remove column type validation when inserting multipe data in http api by @Ami11111 in #1641
Miscellaneous updates by @writinwaters in #1640
Enable mutiple fusion in http api by @Ami11111 in #1642
Allow user to give index name to search dense vector or ignore index to search dense vector by @JinHai-CN in #1643
Add test cases for given index name and ignore index by @Ami11111 in #1648
Fix: compact wal. by @small-turtle-1 in #1645
Add sqllogictest for given index name and ignore index by @Ami11111 in #1650
Sort results by rowid if they have the same distance result by @yangzq50 in #1651
pass arguments to infinity inside docker by @yuzhichang in #1653
Refactor sparse by @small-turtle-1 in #1649
Rename and move http adapter and update python benchmark by @Ami11111 in #1654
Update version info by @JinHai-CN in #1652
Updated match_tensor by @writinwaters in #1644
Parallelize pysdk and http api test by @Ami11111 in #1656
add test cases of test_show in http_test by @zjbpaul1317 in #1659
Update python interface for fusion operator by @yangzq50 in #1657
Updated fusion() by @writinwaters in #1660
Add pysdk and http api test for vfs by @Ami11111 in #1658
Refactor tensor by @small-turtle-1 in #1663
Enable explain in http api by @Ami11111 in #1666
Fix: persistent manager write adv. by @small-turtle-1 in #1668
Fix mem leak bug of http api update by @Ami11111 in #1669
Update python interface for match_text, match_sparse and match_dense by @yangzq50 in #1667
Updates Python API reference by @writinwaters in #1671
Fix file worker dir for secondary index by @yangzq50 in #1672
Refactor: knn api & Recover sqllogic test. by @small-turtle-1 in #1664
Column prune on delete operation and refactor some code by @JinHai-CN in #1673
Refactor code by @JinHai-CN in #1677
Initial updates to the REST APIs by @writinwaters in #1682
Update doc by @JinHai-CN in #1683
Fix vfs by @yuzhichang in #1674
Support MultiVector data type: part 1 by @yangzq50 in #1680
Fix insert by @small-turtle-1 in #1675
Update version info to 0.3.0.dev6 by @JinHai-CN in #1678
Fix wal size by @small-turtle-1 in #1686
Add: restart test by @small-turtle-1 in #1681
Refactor UT by @JinHai-CN in #1684
Update python doc by @yangzq50 in #1690
Add code coverage option for unit test by @Ami11111 in #1688
Support MultiVector data type: part 2 by @yangzq50 in #1692
Opt unit test by @small-turtle-1 in #1693
Fix: paramter check in match sparse expression. by @small-turtle-1 in #1695
Update doc for function test by @Ami11111 in #1696
Ensure MemIndexRecover actually done by @yuzhichang in #1698
Benchmark vs golden by @yuzhichang in #1685
Update LogicalType enum and EmbeddingDataType enum by @yangzq50 in #1699
Fix: unordered_map memory not release by @small-turtle-1 in #1700
Support MultiVector data type: part 3 by @yangzq50 in #1701
Fix memory leak by @JinHai-CN in #1704
Remove unused code. by @small-turtle-1 in #1705
Fix sparse search vector example by @JinHai-CN in #1710
Update examples by @JinHai-CN in #1711
add doc for configuration files by @vsian in #1708
updated create_index syntax by @writinwaters in #1712
Support MultiVector data type: part 4 by @yangzq50 in #1707
Updates to RESTful APIs by @writinwaters in #1697
Update python doc for MultiVector data type by @yangzq50 in #1713
Fix: var buffer. by @small-turtle-1 in #1714
Update version info to 0.3.0-dev7 by @JinHai-CN in #1716
Add UDF python tokenizer and term weight by @JinHai-CN in #1717
Fix bug by @small-turtle-1 in #1719
Add configuration file unit test by @vsian in #1715
Update test script by @yangzq50 in #1722
Make Infinity compilable for Mac by @yingfeng in #1721
Miscellaneous updates by @writinwaters in #1723
Update fulltext query by @yangzq50 in #1724
Add test cases for unit test by @Ami11111 in #1725
Fix: close bgtask when running unittest. by @small-turtle-1 in #1727
Fixed a docusaurus display issue by @writinwaters in #1732
Disable python script supporting by @JinHai-CN in #1730
Fix mem tracer by @small-turtle-1 in #1731
Update the syntax of HTTP request create_table by @Ami11111 in #1737
Update fulltext index by @yangzq50 in #1734
Enable system info for Mac by @yingfeng in #1735
Fix show tables error by @JinHai-CN in #1733
Add storage/io unit tests by @vsian in #1736
Miscellaneous updates by @writinwaters in #1743
HTTP API: refactor list tables by @JinHai-CN in #1744
Add test cases for unit test by @Ami11111 in #1741
Fix admin mode by @JinHai-CN in #1745
Enable thread affinity for Mac by @yingfeng in #1746
Add restart test by @small-turtle-1 in #1703
Add check for unused parameters in match_tensor() by @yangzq50 in #1742
Add test cases for unit test by @Ami11111 in #1747
Update python interface for update by @yangzq50 in #1740
Fix sql command SHOW DATABASE by @yangzq50 in #1751
Add table_meta and table_index_meta test cases for unit test by @Ami11111 in #1752
Issue error use thrift / http in maintenance mode by @JinHai-CN in #1753
Add db_entry and table entry test cases for unit test by @Ami11111 in #1754
Updated example code of RESTful APIs by @writinwaters in #1755
HTTP API: remove some show statements by @JinHai-CN in #1758
add test cases by @zjbpaul1317 in #1760
Fix bugs: http only listen on localhost by @JinHai-CN in #1759
Add pip3 source images by @JinHai-CN in #1764
Fix vfs varchar by @small-turtle-1 in #1750
Add table_entry test cases for unit test by @Ami11111 in #1763
Fix: add lvq avg interface. by @small-turtle-1 in #1765
Fix default value for http api by @yangzq50 in #1762
miscellaneous updates by @writinwaters in #1768
Add table_entry and table_index_entry test cases for unit test by @Ami11111 in #1767
Add testcases for storage/io by @vsian in #1769
Update HTTP interface and fix memory leak by @JinHai-CN in #1766
Miscellaneous updates to the RESTful APIs by @writinwaters in #1771
Add segment_entry test cases for unit test by @Ami11111 in #1772
Update python test check_data by @yangzq50 in #1773
Enable vfs by default by @yuzhichang in #1726
Add segment_index_entry and table_index_entry test cases for unit test by @Ami11111 in #1774
Fix ShowTable by @yangzq50 in #1775
Updated RESTful sample code by @writinwaters in #1777
Add test2 by @small-turtle-1 in #1776
Introduced base_test.cppm by @yuzhichang in #1781
Fix restart test by @small-turtle-1 in #1783
Disallow absolute path in wal by @yuzhichang in #1784
Support admin mode. by @JinHai-CN in #1770
Update version info of 0.3.0.dev8 by @JinHai-CN in #1779
Fix: move dump index wal to background task. by @small-turtle-1 in #1791
Add block_version test cases for unit test by @Ami11111 in #1778
Updated search method by @writinwaters in #1794
Fix: check batch insert value count by @yangzq50 in #1790
Update show configs by @JinHai-CN in #1795
Avoid to persist empty files by @yuzhichang in #1797
add : unittest for existing date type by @vsian in #1796
Updated search api by @writinwaters in #1800
Update restful api by @yangzq50 in #1799
Added index type settings. by @writinwaters in #1802
Update version info to 0.3.0 by @JinHai-CN in #1798

New Contributors

@Smertig made their first contribution in #1599

Full Changelog: v0.2.1...v0.3.0