infiniflow/infinity v0.6.0-dev4 on GitHub

What's Changed

Add order by wrong column check. by @small-turtle-1 in #2515
Refactor txn inferface before refactoring META data engine by @JinHai-CN in #2490
Unnest2 by @small-turtle-1 in #2514
Support rank features query:part2 by @yingfeng in #2518
Fix empty datablock array. by @small-turtle-1 in #2516
Fix column mismatch by @small-turtle-1 in #2520
Add CurrentDate, CurrentTime and CurrentTimestamp Functions Part2 by @kche0169 in #2524
Fix current_date by @JinHai-CN in #2526
Fix bug in scalar fuction by @MaYangrui6 in #2528
MemIndexRecover batchlize by @dwxiayi in #2527
Optimize current time fuction and add some http examples by @MaYangrui6 in #2531
Fix parser error and add explain examples by @JinHai-CN in #2538
Fix bmp bp reorder by @small-turtle-1 in #2543
Implement explain analyze by @JinHai-CN in #2541
Fix config error by @JinHai-CN in #2546
Fix lsg build with cosine type. by @small-turtle-1 in #2551
Update build_from_source.mdx by @joy-joy-joy-joy-joy-joy-joy in #2558
Update logical_planner.cpp by @joy-joy-joy-joy-joy-joy-joy in #2559
Fix build for Linux/aarch64 on MacOS Apple Silicon by @min-mwei in #2564
Updated code examples by @writinwaters in #2570
fix path construction in BaseUrl::BuildUrl() by @MikeIvanichev in #2572
Update CI script by @JinHai-CN in #2576
Add third_party rocksdb by @JinHai-CN in #2486
Fix and add parallel test by @JinHai-CN in #2578
Implement SHOW CATALOG and SHOW CATALOG TO FILE_PATH; Fix bug in meta_tree by @euvre in #2577
Fix tranform_meta test by @euvre in #2583
some cases in chaos by @joy-joy-joy-joy-joy-joy-joy in #2580
Added sqllogictest CI by @yuzhichang in #2579
Check confict for add column and drop column by @qinling0210 in #2582
Fix memory leak and import by @JinHai-CN in #2586
Remove lock/unlock table by @qinling0210 in #2588
complete chaos_test except update by @joy-joy-joy-joy-joy-joy-joy in #2589
Remove use_new_catalog in physical_show.cpp by @qinling0210 in #2590
Remove use_new_catalog - 2 by @qinling0210 in #2591
Remove use_new_catalog - 3 by @qinling0210 in #2592
Remove use_new_catalog - 4 by @qinling0210 in #2593
Restore catalog cache, part1 by @JinHai-CN in #2594
Added BottomExecutor by @yuzhichang in #2598
conflict check using txn store by @qinling0210 in #2602
Refactor catalog cache by @JinHai-CN in #2599
Implement check statement by @euvre in #2601
Refactor : Enable conflict check using txn store by @qinling0210 in #2604
Fix the conflict issues within the transaction by @euvre in #2606
Implement catalog cache by @JinHai-CN in #2605
Fix txn create index by @euvre in #2611
Remove unused code by @JinHai-CN in #2608
More conflict check by @qinling0210 in #2612
Fix compact conflict by @JinHai-CN in #2614
Remove rollback transaction from bottom executor by @euvre in #2610
Fix rollbacked txn isn't removed from check txn structure by @JinHai-CN in #2616
Wrap the AbstractHnsw type (implemented using variant) in the HNSW index. by @19-hanhan in #2615
Add 'ApplyChunkID' interface by @JinHai-CN in #2618
Use RocksDB to store clean information by @euvre in #2617
Wrap the AbstractBMP type (implemented using variant) in the BMP index. by @19-hanhan in #2620
Fix the database clean-up fails after checkpoint and restart by @euvre in #2626
Fix txn and commit timestamp error after restart by @JinHai-CN in #2624
Fix catalog cache restore by @JinHai-CN in #2627
Fix HNSW index load failure during infinity restart by @19-hanhan in #2630
Remove empty dir or pm meta data after clean by @euvre in #2631
Fix index store path by @euvre in #2632
Fix restart test case, part1 by @JinHai-CN in #2628
Fix memory leak by @JinHai-CN in #2633
Remove python embedded in python test by @euvre in #2634
Restart test, part2 by @JinHai-CN in #2635
Refactor code by @JinHai-CN in #2637
Fix memory leak and output in kv_store by @euvre in #2639
Clear embedded_infinity from CI script and CMakeLists.txt by @euvre in #2636
Docs: Removed embedded mode by @writinwaters in #2644
Docs: Fixed a Docusaurus display issue by @writinwaters in #2645
Docs: Updated readme by @writinwaters in #2646
Refactor TxnStore and Append by @yuzhichang in #2619
Fix drop key construction by @JinHai-CN in #2650
Fix the restart test by @euvre in #2651
Fix python test run_parallel_test.py by @euvre in #2647
Fix the issue where items that failed during this clean could never be deleted by @euvre in #2643
Fix the restart test2 by @euvre in #2653
Fix replay create table and create index by @JinHai-CN in #2652
Remove delta checkpoint by @JinHai-CN in #2655
Remove old compact process by @JinHai-CN in #2657
Remove old compaction process, part2 by @JinHai-CN in #2658
Refactor bg task by @JinHai-CN in #2659
Refactor dump mem index by @qinling0210 in #2656
Fix background tasks by @JinHai-CN in #2663
Remove old txn by @JinHai-CN in #2667
Solve deadlock of mem index mutex and table index reader cache mutex by @qinling0210 in #2665
Refactor bottom executor by @JinHai-CN in #2666
Remove SetMemIndexDump and check conflict between dump mem index commands in a table by @qinling0210 in #2669
Fixed fulltext_index_scan by @yuzhichang in #2671
Introduce mem index process by @JinHai-CN in #2670
Tidy up test scripts by @yuzhichang in #2673
Add dump index background processor by @JinHai-CN in #2674
Remove AddChunkWal(), use Map in CompactTxnStore and ImportTxnStore by @qinling0210 in #2672
Adapted realtime inverted index building by @JinHai-CN in #2675
Dump mem index for sealed segments generated by Append in dump index processor by @qinling0210 in #2676
Refactor code by @JinHai-CN in #2642
Avoid rollback txn again on commit failure by @qinling0210 in #2679
Remove unused code by @JinHai-CN in #2678
Remove old catalog by @JinHai-CN in #2680
Refactor code by @JinHai-CN in #2681
Tidy up slow test scripts by @yuzhichang in #2684
Add show tasks framework by @JinHai-CN in #2682
Dump index in dump index processor by @qinling0210 in #2683
Fix show tasks by @JinHai-CN in #2687
Add dumping emvb index to dump index process by @qinling0210 in #2688
Fix optimize index task info by @JinHai-CN in #2689
Modify optimize index txn store by @qinling0210 in #2690
Fixed test_fulltext.py, refactored GetFtInfo by @yuzhichang in #2692
Show tasks for background activities by @qinling0210 in #2695
Add clean data command by @JinHai-CN in #2691
Make import and compact support rollback by @euvre in #2668
Fix a bug where deleting a scheduled entity removed all entities with the same name by @euvre in #2697
Remove old txn_manager instance in storage by @JinHai-CN in #2696
Remove code by @JinHai-CN in #2699
Remove multiple phase compact code by @JinHai-CN in #2701
Optimize knn benchmark test. by @19-hanhan in #2662
Remove create index do and finish by @JinHai-CN in #2702
Remove more code on old txn by @JinHai-CN in #2703
Fix select(*) when there is no data in the table by @qinling0210 in #2698
Remove code by @JinHai-CN in #2706
Remove src/storage/meta code in HNSW & BMP. by @19-hanhan in #2708
Modify data collection script by @qinling0210 in #2705
Add dump cmd by @qinling0210 in #2707
Remove code by @JinHai-CN in #2709
Rollback dump index by @qinling0210 in #2710
Cleanup conflict check and avoid by @euvre in #2711
Make optimize index support rollback by @euvre in #2716
Remove code by @JinHai-CN in #2712
Add & Optimize Knn Benchmark. by @19-hanhan in #2720
Remove Entry Method from AbstractHnsw & AbstractBMP. by @19-hanhan in #2715
Remove code by @JinHai-CN in #2721
Removed TableEntry, SegmentEntry and etc. by @yuzhichang in #2722
Remove unused third party lib by @JinHai-CN in #2725
Update spdlog to v1.15.3 by @JinHai-CN in #2723
Update thrift version to 0.22.0 by @JinHai-CN in #2724
Remove unused code by @JinHai-CN in #2729
Fix compile under Mac/X86 by @yingfeng in #2732
Add simdjson for benchmark. by @19-hanhan in #2727
Refactor cleanup by @euvre in #2731
Fix a crash in VFS mode when MakeMetaTree is called between a write transaction and its checkpoint by @euvre in #2736
Removed PersistenceManager::local_path_obj_ by @yuzhichang in #2734
Refactor some code by @euvre in #2738
Fixed ObjectStatAccessor race condition by @yuzhichang in #2743
Fixed PersistenceManager::PutObjCache by @yuzhichang in #2746
Fix an issue where Cleanup wasn't working correctly by @euvre in #2726
MVCC Refactor: db, table, index, column, segment by @qinling0210 in #2745
Update config: remove description of full checkpoint by @JinHai-CN in #2750
Rollback create index by @qinling0210 in #2751
Add to flush meta data by @JinHai-CN in #2752
Introduced TableMeeta::InvalidateFtIndexCache by @yuzhichang in #2753
Fix NewTxn::Import to request more than one segment when needed by @yuzhoumao in #2748
Disable conditions for kEmbedding type in expression binder. by @19-hanhan in #2749
export with deleted rows by @qinling0210 in #2754
Implement check system for checking the diference between catalog and the data in file system by @euvre in #2747
Add index examples by @qinling0210 in #2759
Add testunit in new_txn_replay.cpp by @qinling0210 in #2760
Introduced SegmentIndexMeta::PopMemIndex() by @yuzhichang in #2756
Fix memoty leak in HnswHandler. by @19-hanhan in #2739
Fix bug in GetTableSegments() and more testunit in new_txn_replay.cpp by @qinling0210 in #2763
Avoid printing value of fast_rough_filter by @qinling0210 in #2764
Enhance check system perfermance by @euvre in #2765
Disallow drop-ops after latest checkpoint by @euvre in #2757
Refactor replay by @JinHai-CN in #2733
Replace json operation by simdjson by @19-hanhan in #2755
Refactor secondary index by @yingfeng in #2771
Fix test_index.py in slow test by @qinling0210 in #2768
Ensure that module imports occur after module exports by @euvre in #2776
Fix heap-buffer-overflow error during search using BMP index by @qinling0210 in #2775
Implement secondary index with low cardinality by @yingfeng in #2779
Trigger dump by memory or row count by @yuzhichang in #2769
Replace #include with module imports by @euvre in #2778
Improve performance for in memory secondary index using rcu map by @yingfeng in #2783
Fix restart test_insert_import.py in slow test by @qinling0210 in #2785
Fix restart test_insert.py in slow test by @qinling0210 in #2784
Fix txn conflict check bug, which lead to drop db cache error by @JinHai-CN in #2780
Refactor system cache by @JinHai-CN in #2781
Use rcu map to improve concurrent accessing performance of full-text in-memory index by @yingfeng in #2787
Modularize query_node and search_driver for full text search by @yingfeng in #2789
Fix memory leak by @JinHai-CN in #2793
Update sdk version by @JinHai-CN in #2796
Fix data race in UT by @JinHai-CN in #2797
Implement FDE algorithm for Tensor query by @yingfeng in #2801
Refactor column vector by @JinHai-CN in #2792
Fix slow_test test_alter_complex failure by @yuzhichang in #2788
Fix flush type by @JinHai-CN in #2790
Add fde function to select by @yingfeng in #2805
Fix check system & slow_test.yml by @qinling0210 in #2803
Add flush catalog interface on pysdk by @JinHai-CN in #2782
Fix MemIndexTracer::DecreaseMemUsed and IVFIndexInMemT::BuildIndex by @yuzhichang in #2815
Finalize object when dump mem index / optimize / compact / import by @JinHai-CN in #2814
Fix dump index issue by @qinling0210 in #2809
Refactored MemIndexTracer::DecreaseMemUsed by @yuzhichang in #2816
Replace serialize by simdjson by @19-hanhan in #2807
Refactor destructor of derived class by @JinHai-CN in #2817
Fixed rwlock bugs found in slow test by @yuzhichang in #2821
Update test tool by @JinHai-CN in #2813
Remove unused code by @JinHai-CN in #2823
Update CI workflow by @JinHai-CN in #2831
Fix ref count issue in test_big_many_import.slt by @qinling0210 in #2825
Fix clean data issue in show.slt by @qinling0210 in #2820
Added cpptrace by @yuzhichang in #2806
Add mutex protection for BlockVersion by @qinling0210 in #2833
Add more mutex protection in NewTxnManager by @qinling0210 in #2834
Fix sort issue in GetAllMemIndexes() by @qinling0210 in #2838
Use the relevent commit_ts to perform the deletion by @euvre in #2837
Fixed data race by @yuzhichang in #2839
Feature/snapshot thrift support by @james-zhengql in #2795
Fix the out-of-bound issue in column_inverter.cpp by @euvre in #2841
Fix test_insert.py in restart by @qinling0210 in #2843
Fix skipping replaying import command by @JinHai-CN in #2810
Add PD in PickForCleanup by @qinling0210 in #2845
Fix buffer object status error by @JinHai-CN in #2846
Fix data race by @yuzhichang in #2844
FIx test_insert_import.py in restart, modify slow_test.yml by @qinling0210 in #2849
Fix check txn bug by @JinHai-CN in #2850
Fix data race, avoid query retry on conflicts by @qinling0210 in #2852
Fixed Dockerfile_infinity_builder_centos7 by @yuzhichang in #2853
Fix error conflict range by @JinHai-CN in #2851
Fix data race in PositionListEncoder and DocListEncoder by @qinling0210 in #2856
Fix show segment idx by @qinling0210 in #2860
Added test_rank_features.py by @yuzhichang in #2859
Update SDK version by @JinHai-CN in #2822

New Contributors

@dwxiayi made their first contribution in #2527
@joy-joy-joy-joy-joy-joy-joy made their first contribution in #2558
@min-mwei made their first contribution in #2564
@MikeIvanichev made their first contribution in #2572
@yuzhoumao made their first contribution in #2748
@james-zhengql made their first contribution in #2795

Full Changelog: v0.6.0-dev3...v0.6.0-dev4