risingwavelabs/risingwave v0.1.8 on GitHub

What's Changed

Click to Expand

release: v0.1.7 by @TennyZhuang in #2521
refactor: remove legacy java frontend by @fuyufjh in #2523
refactor(binder): organize bind_expr arms into groups by @xiangjinwu in #2500
fix(batch): support incomplete timestamp literal by @likzn in #2478
refactor(common): use next_visible_row_idx for data chunk iter by @lmatz in #2528
test: migrate legacy e2e tests by @TennyZhuang in #2536
fix(ci): fix doc check by @BowenXiao1999 in #2505
feat: Add query_mode session config by @liurenjie1024 in #2540
refactor: Remove unused file by @liurenjie1024 in #2543
docs: update for 0.1.7 release by @skyzh in #2542
feat(storage): conflict detector in no order by @xxhZs in #2365
docs: clearify HummockClient's location by @skyzh in #2544
refactor(stream): remove STREAM_NULL_BY_ROW_COUNT by @TennyZhuang in #2549
refactor: remove epoch service in meta by @yezizp2012 in #2554
fix(streaming): avoid sync states when forcing stop actors in recovery by @yezizp2012 in #2497
refactor(batch): Remove unnecessary executor by @liurenjie1024 in #2548
refactor: remove catalog v1 service by @BugenZhao in #2556
refactor(batch): Remove join v1 by @liurenjie1024 in #2559
refactor(batch): remove frontend v2 in insert executor and fix some ut by @yezizp2012 in #2550
feat(compaction): make compaction output be partitioned by parallel unit by @soundOfDestiny in #2406
refactor(batch): Remove fuse and trace v1 by @liurenjie1024 in #2562
refactor(meta): remove some legacy frontend support in meta, including StreamServiceImpl by @yezizp2012 in #2563
fix(batch): fix a bug of exchange and project. by @likg227 in #2545
chore(batch): remove unnecessary compact by @skyzh in #2565
fix(optimizer): predicate pushdown when there's no filter above join by @xxchan in #2516
chore: remove v2 naming related to legacy frontend by @BugenZhao in #2572
refactor: move fragmenter from meta to frontend by @xxchan in #2263
feat(storage): suppport disk object store by @wenym1 in #2389
feat(expr): Implement evaluation for CONCAT_WS expression by @kwannoel in #2470
refactor(optimizer): LogicalProject::with_mapping should return Self by @Enter-tainer in #2566
fix(frontend): check arguments for agg call by @BugenZhao in #2567
refactor(batch): Remove executor v1 by @liurenjie1024 in #2575
refactor(proto): remove TypeName::Symbol and Char by @fuyufjh in #2574
refactor(meta): remove legacy frontend support in fragmenter by @yezizp2012 in #2560
refactor: remove function pg_sleep by @fuyufjh in #2576
fix(source): remove epoch in state user key and no flush on idle by @hzxa21 in #2547
feat(expr): support cast from number to varchar by @xiaoyong-z in #2522
feat: create table contains nested column by @cykbls01 in #2434
fix: error returned when creating a source from a non-existent topic by @shanicky in #2496
refactor(batch): Remove some dead code in scheduler. by @liurenjie1024 in #2586
refactor: remove test_utils in batch execution by @neverchanje in #2587
refactor(prost): use src as default build path for prost by @Little-Wallace in #2581
refactor(stream-scan): remove stream scan after java removed by @BowenXiao1999 in #2590
feat(frontend): add LogicalMultijoin by @jon-chuang in #2526
chore: add Column for connectors by @shanicky in #2593
feat(array): use compact encoding for bitmap and bool array by @BugenZhao in #2585
feat(expr): IN-list support non-literals by @xiangjinwu in #2588
chore: add RFC template to issue templates by @fuyufjh in #2594
chore: update design-rfc by @fuyufjh in #2596
refactor(batch): use wrapper executor to impl time and i32 generate series by @D2Lark in #2524
chore: ignore generated prost/sim files by @xiangjinwu in #2597
chore(meta): remove old catalog definition in proto by @yezizp2012 in #2599
fix(connector): make too big struct a Box by @tabVersion in #2606
test(frontend): update TPC-H Q16 planner test by @xiangjinwu in #2605
feat(storage): Add metrics for compaction and object store by @Little-Wallace in #2573
fix(connector): make kinesis work again by @tabVersion in #2432
feat(frontend): Bind concat_ws expression by @kwannoel in #2589
fix(binder): handle ambiguous names in order by by @xiangjinwu in #2604
test(optimizer): ensure column prune correctly handle reorder by @Enter-tainer in #2603
feat(expr): Implement IS [NOT] DISTINCT FROM expression by @Graphcalibur in #2582
chore(streaming): enable actor metrics in release mode by @skyzh in #2612
chore: switch avro to fork by @skyzh in #2617
fix(streaming): revert "feat(streaming): split chunks in source executor" by @tabVersion in #2608
refactor(batch): use generatic type replace generate_series_wrapper_executor by @D2Lark in #2624
chore(ci): remove unused e2e test by @BowenXiao1999 in #2616
feat(binder): bind UPDATE by @BugenZhao in #2602
feat(frontend): support alias for window table function by @TennyZhuang in #2633
feat(expr): add support for abs function by @xiaoyong-z in #2531
feat: add parallel source connector by @shanicky in #2601
chore(connector): add some log and fix typo by @shanicky in #2639
feat(ctl) add args ( epoch , table ) in list-kv by @xxhZs in #2640
chore: add some logging on pgwire and frontend by @neverchanje in #2642
fix(docs): use host network mode to start playground by @skyzh in #2652
refactor(common): impl CheckedAdd for NavieDateTimeWrapper by @D2Lark in #2635
feat(storage): support sstable store with local object store by @wenym1 in #2558
refactor(frontend): eliminate PlanNode rest panic by @likzn in #2417
refactor(frontend): ignore stmts START TRANSACTION and ABORT by @likzn in #2607
chore(e2e): move v2 tests to be the first citizen by @BowenXiao1999 in #2658
feat(frontend): plan UPDATE by @BugenZhao in #2641
fix(batch & optimizer): 0-column chunk handling in filter & agg by @xiangjinwu in #2637
fix: frontend crashed on invalid sql input by @cykbls01 in #2510
chore(risedev): directly use risedev-prometheus as datasource instead of replacing by @skyzh in #2669
chore(risedev): disable env info by @skyzh in #2665
feat: add user and privilege proto definition by @yezizp2012 in #2645
feat(optimizer): change create mv field name by @st1page in #2662
feat(connector): Integrate avro format parser to SourceParserImpl by @pangzhenzhou in #2671
feat(streaming): limit source ingestion rate based on barrier by @skyzh in #2661
feat(meta): convert vnode mapping from a state of whole cluster to results of scheduling by @xx01cyx in #2648
refactor(optimizer): make LogicalHopWindow column order aware by @Enter-tainer in #2667
chore(connector): Simplifying connector/base.rs with macro by @shanicky in #2674
chore: add a reminder about a new label by @hengm3467 in #2677
feat(optimizer): Multi join reordering by @jon-chuang in #2651
feat(batch): update executor by @BugenZhao in #2670
feat(config): human-readable config by @skyzh in #2686
fix: fix get_sql error and test by @cykbls01 in #2685
feat(streaming): split chunks in hash join by @pleiadesian in #2357
chore(connector): add columns for trait when creating split reader by @shanicky in #2695
feat: support array expression by @neverchanje in #2682
feat(ci): pr title checker by @lmatz in #2693
refactor(storage): remove async_checkpoint_enabled option in storage config by @wenym1 in #2689
feat(expression): Implement IS [NOT] DISTINCT FROM in backend by @Graphcalibur in #2676
refactor(pgwire): use generic for session manager by @BugenZhao in #2694
feat(storage): prefetch data for compaction by @Little-Wallace in #2630
refactor(compaction): trigger compaction on hummock version update. by @zwang28 in #2591
fix(streaming): unstable lifetime compiling bug in join state by @BugenZhao in #2704
chore(connector):replace connector ErrorCode to ConnectorError by @shanicky in #2705
feat(streaming): implement append-only hash join exectuor by @StrikeW in #2702
feat: sqlparser supports array index by @neverchanje in #2703
feat(risedev): support compose grafana by @skyzh in #2426
fix(streaming): correct JoinRow serialization by @yuhao-su in #2701
chore: ignore .gitpod.yml by @D2Lark in #2714
feat(frontend): use trait to impl predicate pushdown. by @likg227 in #2687
feat(connect): :Implement the DataGen connector and source by @D2Lark in #2488
feat(optimizer): add multijoin filter merge rule by @jon-chuang in #2723
feat(frontend): support booleq and boolne function by @likzn in #2680
refactor(batch): Refactor batch task context for execution. by @liurenjie1024 in #2631
refactor(rpc): move stream and compute client pool into rpc crate by @lmatz in #2729
test: move v2/batch/const.slt out of v2 by @xiangjinwu in #2735
feat(batch): Add correct single distribution in to_local. by @liurenjie1024 in #2734
feat(streaming): rearranged chain without spawning by @BugenZhao in #2700
refactor(meta): do not pick files which generated by intra-L0 by @Little-Wallace in #2609
feat(storage): add local metrics for iterator and cache by @Little-Wallace in #2709
refactor(optimizer): split required and provided distribution property by @st1page in #2726
fix(storage): fix cache shard size too small by @Little-Wallace in #2722
feat(relational_table_iter): implement relational iter by @wcy-fdu in #2699
fix: support show index in describe table by @cykbls01 in #2579
feat(cell-based-table): compute value meta on distribution keys instead of pk by @xx01cyx in #2744
fix(test): fix state table tests by @xx01cyx in #2753
fix: fix missing update on dependent table downstream info by @yezizp2012 in #2765
refactor(frontend): use compute client pool to get ComputeClient by @lmatz in #2739
fix(batch): join remaining panic when build table is empty by @yuhao-su in #2778
refactor(storage): remove add_sstables RPC. by @zwang28 in #2715
test(stream): add e2e time window join test case by @TennyZhuang in #2659
doc: fix a misleading statement in the state store doc by @Sunt-ing in #2780
chore(build): use lld for linux by @skyzh in #2781
fix: forcing chain distribution to different actor in fragmenter by @yezizp2012 in #2775
feat: support e2e test for struct type by @cykbls01 in #2679
doc: fix a typo by @hengm3467 in #2784
fix(build): lock madsim version by @wangrunji0408 in #2787
fix(ci, doc): make pr title labeler and checker consistent with the doc by @lmatz in #2788
test: support nexmark q4 and q5 by @KeXiangWang in #2756
feat(batch): Introducing local execution mode by @liurenjie1024 in #2776
refactor(storage): avoid passing backward flag in iter_inner of hummock storage by @wenym1 in #2799
chore(build): add Cargo.lock into docker image by @skyzh in #2802
feat(metrics): add metric for compaction to measure compaction time cost and write-amplification by @Little-Wallace in #2761
feat(storage): add dedicate compaction runtime by @zwang28 in #2779
feat(batch): abort task by @lmatz in #2757
feat(meta): track the progress of creating mview by @BugenZhao in #2773
style(frontend): do some cleanup for predicate pushdown. by @likg227 in #2803
doc: move dev instructions to a new dev guide by @hengm3467 in #2783
doc: remove extra parentheses by @skyzh in #2807
refactor: use oneshot channel for shutdown by @lmatz in #2804
chore: bump toolchain by @lmatz in #2806
fix(frontend): allow source as 1st arg in tumble/hop by @TennyZhuang in #2790
feat(risedev): support generate benchmark deploy script by @skyzh in #2763
chore(relational_tests): refactor relational table unit tests by @wcy-fdu in #2760
chore(stream): change default local channel size to 16 by @skyzh in #2812
fix: docker builder and wrapper should be the same version by @mikechesterwang in #2813
feat(test): deterministic testing for more crates by @wangrunji0408 in #2718
feat(doc): Add design doc for batch local execution mode by @liurenjie1024 in #2797
feat(grafana): use job @ instance as legend by @skyzh in #2805
feat(streaming): report create mv progress continuously by @BugenZhao in #2810
feat(optimizer): Add 2-phase aggregation for queries with no group keys by @kwannoel in #2746
chore(risedev): kill on compose deploy instead of stop by @skyzh in #2816
test(optimizer): test simple-agg with different input distributions by @kwannoel in #2818
refactor(source): remove ConnectorState by @tabVersion in #2717
feat(frontend): add common table expression by @WindowsXp-Beta in #2741
feat(risedev): more message when deploy by @skyzh in #2819
refactor(storage): remove backward_range flag and reverse the range order only at the topest level by @wenym1 in #2827
refactor(frontend): unpin epoch when all leaf stages are scheduled by @lmatz in #2825
feat(pgwire): introduce extended query mode init by @BowenXiao1999 in #2730
fix: batch TopN sort_util handles null by @xiangjinwu in #2830
refactor(array): replace arrow-rs Buffer with Bytes by @BugenZhao in #2831
refactor(batch,rpc): move get_data's concrete implementation to BatchManager by @lmatz in #2834
fix(storage): multitasked compaction executor by @zwang28 in #2839
test(frontend): add e2e tests for common table expressions by @WindowsXp-Beta in #2837
refactor(batch): rename executor2 to executor by @lmatz in #2842
feat: support nested and list type comparison by @cykbls01 in #2796
fix(bitmap): make vnode bits same as upstream by @soundOfDestiny in #2849
fix(streaming): fix biased aligner by @skyzh in #2846
feat(metrics): add actor processing latency by @skyzh in #2838
fix(relational_iter): handle case that pk exist in both storage and memory and need to be deleted by @wcy-fdu in #2801
feat(stream): add a fair scheduler for select_all by @Little-Wallace in #2847
chore: remove redundant output by @wcy-fdu in #2855
chore(build): bundle ca-certificates by @skyzh in #2853
chore(frontend): comment for do-apply-planner-test updated files by @alissa-tung in #2857
refactor(stream): remove ManagedMViewState by @lmatz in #2859
refactor(frontend): schedule tasks of a stage concurrently by @lmatz in #2856
feat(ci): migrating ci services to buildkite. by @huangjw806 in #2743
refactor(streaming): extract the first barrier by @BugenZhao in #2861
feat(frontend): support single_value(c) by @TennyZhuang in #2869
fix(doc): fix typos by @ryanrussell in #2845
feat: implement function split_part by @alissa-tung in #2822
refactor(batch): Simplify task context by removing get_task_error. by @liurenjie1024 in #2872
refactor(batch): use iter instead of scan in CellBasedTableRowIter by @lmatz in #2835
feat(relational-state): use relational state for value state by @BowenXiao1999 in #2453
refactor(test): use DataChunk::from_pretty for literals in unit tests rather than DataChunkBuilder by @xiangjinwu in #2874
feat(frontend): support using in join constraint by @WindowsXp-Beta in #2683
feat(common): replace select_all by @Little-Wallace in #2865
refactor(test): use DataChunk::from_pretty for literals in unit tests rather than try_from or new by @xiangjinwu in #2877
chore(ci): tag docker image with nightly tags by @skyzh in #2879
feat(expr): Add eval_row to Expression trait by @Graphcalibur in #2829
chore(docker): update to match latest risedev compose by @skyzh in #2878
fix(batch): find out stages that have table scan instead of using leaf stages by @lmatz in #2886
fix(optimizer): fix col prune for logical hop by @st1page in #2889
refactor(storage): move uncommitted ssts to shared buffer by @wenym1 in #2832
feat(expr) support ceil, floor, round function by @xiaoyong-z in #2716
ci: add deterministic simulation test by @wangrunji0408 in #2888
chore(build): add --pull=always, more hint for AWS builds by @skyzh in #2892
chore(grafana): collapse actor metrics by default by @skyzh in #2851
feat(meta): inform executors of the vnodes they own by @xx01cyx in #2887
feat(meta): introduce user service in meta, to support user and privilege management by @yezizp2012 in #2745
refactor(batch): Little refactor for executor builder by @liurenjie1024 in #2896
chore(batch): remove repetitive definition of TaskOutputId by @lmatz in #2891
chore(ci): rename CI name by @skyzh in #2895
fix(storage): ensure at least one split in compaction task by @zwang28 in #2894
refactor: rewrite StateTableRowIter by futures_async_stream by @lmatz in #2885
feat(stream): introduce change_split mutation by @tabVersion in #2862
feat(compaction): do not schedule too small compaction task by @Little-Wallace in #2873
chore: try add source e2e test mv part back by @shanicky in #2900
feat(expr): add to_char(timestamp,text) by @TennyZhuang in #2904
chore(ci): rename CI scripts name by @huangjw806 in #2905
feat(optimizer): add output_indices for LogicalHopWindow by @Enter-tainer in #2769
feat(expr): add md5 expr by @cnissnzg in #2909
feat(optimizer): Add output indices to LogicalJoin by @jon-chuang in #2748
chore: bump all deps by @TennyZhuang in #2918
doc(source): update doc to catch up new design by @tabVersion in #2902
feat(metrics): add streaming exchange metrics by @StrikeW in #2906
chore(cmd): allow listen 0.0.0.0 for playground by @skyzh in #2921
feat(connect):Support (min/max) constraints for DataGen connector by @D2Lark in #2737
fix(docs/frontend): remove some out-of-date docs by @alissa-tung in #2916
feat(frontend): use libtest-mimic for planner test by @alissa-tung in #2917
refactor(error): impl From to tonic::Status by @lmatz in #2926
feat(batch): add rpc for local execution mode by @lmatz in #2913
feat(storage): zero-copy state table iterator by @BugenZhao in #2927
refactor(test): only need to pin_mut instead of Box::pin by @lmatz in #2929
refactor: use DispatchStrategy in StreamActorDownstream by @xxchan in #2930
chore(proto): allow same type for rpc response by @lmatz in #2931
refactor(DataChunk): consolidate visibility bitmap and cardinality by @xiangjinwu in #2928
chore: mention ./risedev check in PR template (wrong spell in commit, please squash) by @alissa-tung in #2932
refactor(frontend): remove Distribution::Broadcast by @xxchan in #2933
refactor(DataChunk): new requires either a bitmap or a cardinality number by @xiangjinwu in #2934
feat: support e2e test for list type by @cykbls01 in #2876
refactor(hash_join_state): Improve Code Readability by @ryanrussell in #2935
refactor(DataChunk): use new rather than DataChunkBuilder or try_from in simple cases by @xiangjinwu in #2936
feat(executor): add output indices to HopWindow executor by @Enter-tainer in #2922
refactor(meta): use IdGenerator for compaction task id by @zwang28 in #2937
refactor(mem_table): refator pk type in mem_table by @wcy-fdu in #2910
refactor(batch): Executor builder should not create their children by @liurenjie1024 in #2946
feat(steaming): use table_id as topN prefix for keyspace by @Li0k in #2942
feat(state_table): add pk_indices in state_table by @wcy-fdu in #2940
feat(ci): remove github action based workflows by @skyzh in #2948
refactor(streaming): refactor assign table_id logic by @Li0k in #2950
feat(risedev): support compose etcd in docker by @skyzh in #2941
test(streaming): add test for assign table id for build fragment by @Li0k in #2955
refactor(test_decimal_e_m): Fix exponents by @ryanrussell in #2958
chore: do not #[allow(unused)] by @xxchan in #2956
refactor: tweak mod visibility & structure of frontend/scheduler by @xxchan in #2959
refactor(meta): remove RefId proto in hummock by @zwang28 in #2963
feat: new split discovery in meta node by @shanicky in #2844
feat(frontend): support user manager in frontend by @yezizp2012 in #2943
refactor(storage): support zstd compression in block by @shmiwy in #2960
refactor(object store): make object store a separate crate by @wenym1 in #2939
chore(config): set meta cache to 1gb by @skyzh in #2966
feat(expr): add array access support by @nanderstabel in #2883
release: v0.1.8 by @skyzh in #2971

New Contributors

@kwannoel made their first contribution in #2470
@Graphcalibur made their first contribution in #2582
@alissa-tung made their first contribution in #2857
@huangjw806 made their first contribution in #2743
@ryanrussell made their first contribution in #2845
@cnissnzg made their first contribution in #2909
@Li0k made their first contribution in #2942
@shmiwy made their first contribution in #2960

Full Changelog: v0.1.7...v0.1.8