taosdata/TDengine ver-3.0.2.0 on GitHub

New Features:

Replica 3 can be specified when creating a database
RAFT protocol is enabled automatically in case of replica 3
Replica 1 and 3 can be switched by "alter database" command

Enhancements:

Performance optimization for inserting data in SQL mode
Performance optimization for replica 3
Performance optimization for querying data in a lot of scenarios
Stability improvement for replica 3
Execute "alter database replica" in async way

Fixed Bugs:

Some coredump problems
Some OOM issues
A series of functional bugs

What's Changed

Revert "Revert "enh: row optimize2"" by @guanshengliang in #18418
test：add test case for TS-1939 by @jiacy-jcy in #18394
fix:initialize maxts by @54liuyao in #18400
refactor: enable continue query when the buffer of sink node is empty by @hjxilinx in #18395
fix(shell): add help command and fix create table filed complete by @DuanKuanJun in #18422
test: adjust asan case by @guanshengliang in #18423
test: add asan case by @guanshengliang in #18425
refactor(sync): add timestamp trace log when elect and heartbeat by @castermode in #18424
fix(query): fix error in seq fetch data block. by @hjxilinx in #18426
test: add asan case and adjust python test frame by @guanshengliang in #18427
fix: memory leak while schedule stream by @guanshengliang in #18421
docs: add StackOverflow link by @arielyang in #18428
fix(stream): heap uaf by @cosmic-jc in #18429
enh: last cache optimize by @xiao-yu-wang in #18384
fix:Explicit null dereferenced by @54liuyao in #18419
fix(sync): if msg commit, put it into apply-queue, do not care return code by @castermode in #18431
fix: auto creating table failed issue when table already exists by @dapan1121 in #18435
test: add asan case by @guanshengliang in #18432
fix(tdb): zero pOlds[i]'s nOverflow and assert it's zero when committing by @stephenkgu in #18434
fix(meta): return invalid message if cannot getting value from uididx by @stephenkgu in #18437
fix: fix invalid packet by @yihaoDeng in #18439
enh: set max restart time of taosd to 3; allow disable alert in pod by @tangfangzhi in #18397
fix(shell) add one blank after affected word by @DuanKuanJun in #18444
fix: [ASAN] fix nullpointer issue in tdatablock.c by @glzhao89 in #18441
fix(tdb/pcache): type nPages as nPage by @stephenkgu in #18442
test/update vnode by @wenzhouwww in #18440
fix(query): check for null ptr before extracting info by @hjxilinx in #18450
fix： query failed issue caused of db dropped by @dapan1121 in #18398
fix(tmq): time wait by @cosmic-jc in #18454
fix: duplicated explain response issue by @dapan1121 in #18455
fix:support scalar function with fill by @54liuyao in #18456
fix: asan problems for rsma by @kailixu in #18458
docs: release 3.0.1.8 by @xleili in #18466
fix: memory leak while subscribe by @guanshengliang in #18462
refactor(sync): add trace log by @castermode in #18463
fix: fix mem leak by @yihaoDeng in #18438
test: add asan case by @guanshengliang in #18453
doc: upgrade grafana plugin version by @sunpe in #18460
fix(query): check the error code, if the downstream is an exchange operator. by @hjxilinx in #18464
enh(stream): new api for stream queue by @cosmic-jc in #18459
test: add asan case by @guanshengliang in #18469
refactor: adjust syncLogHeartbeat by @guanshengliang in #18467
Release/ver 3.0.1.8 by @xleili in #18474
test:add test case into ci by @jiacy-jcy in #18448
build: release ver-3.0.1.8 by @guanshengliang in #18475
enh: add debug info by @yihaoDeng in #18452
refactor(sync): optimized heartbeat timer by @castermode in #18472
test: add asan case by @guanshengliang in #18473
chore: taos-tools use localfile asdeps by @sangshuduo in #18471
coverity problem fixed by @DuanKuanJun in #18461
fix: memory leak and defects in covrity by @wangmm0220 in #18465
Revert "enh: add debug info" by @guanshengliang in #18479
fix: memory leak by @cosmic-jc in #18476
test: add asan case by @guanshengliang in #18478
test: add asan case by @guanshengliang in #18482
fix: disable taos-tools cunit test on windows by @sangshuduo in #18484
test: adjust case for asan mode by @guanshengliang in #18487
test: add asan case and fix tmqSim error by @guanshengliang in #18489
Update number of stars in README by @saivishwak in #18488
docs: Update number of stars in README by @guanshengliang in #18490
test: add tmq case by @guanshengliang in #18491
fix: memory leak while subscribe by @guanshengliang in #18495
test: add asan case by @guanshengliang in #18493
feat: taosbenchmark supports retry by @sangshuduo in #18496
refactor: improve the perf in query by @hjxilinx in #18468
docs: update examples/jdbc demo readme by @sangshuduo in #18499
fix: memory leak while subscribe by @guanshengliang in #18497
refactor: do some internal refactor. by @hjxilinx in #18500
test:add win testcase in ci by @tomchon in #18492
fix: memory leak by @cosmic-jc in #18504
test: adjust cluster case for asan mode by @guanshengliang in #18507
test: add asan case by @guanshengliang in #18510
fix(tdb/flush): make drop two-child rbtree node works by @stephenkgu in #18513
refactor: do some internal refactor. by @hjxilinx in #18509
fix: select null error by @xiao-yu-wang in #18508
fix(stream): fill combine with subtable by @cosmic-jc in #18515
fix:installer,The installation cannot be completed on the mac by @facetosea in #18512
fix(sync): fix asan error, TD-20801 by @castermode in #18520
fix: deadlock while alter db replica by @guanshengliang in #18523
refactor: do some internal refactor. by @hjxilinx in #18516
fix: [ASAN] stack buffer overflow by @glzhao89 in #18519
fix:during installation,dll file cannot overwrite. by @facetosea in #18526
enh: support multiple query groups in exchange operator by @dapan1121 in #18524
feat: taosdump for windows by @sangshuduo in #18529
enh: adjust para by @yihaoDeng in #18502
test:add testcase of win ci by @tomchon in #18517
fix(query): memory leak with pPageIdList on sort by @DuanKuanJun in #18527
fix: alter db pages memory leak by @hzcheng in #18528
修改可能导致读取额外内容的BUG by @maikebing in #18518
test: add asan case by @guanshengliang in #18538
fix: cpuid.h error in mac for M1 cpu type by @wangmm0220 in #18536
test: add test cases by @xiaopingcs in #18530
merge from main to 3.0 branch by @guanshengliang in #18540
fix: planner error by @xiao-yu-wang in #18542
refactor(sync): add trace log for elect count, become leader count, c… by @castermode in #18544
enh: add dropping status for vgroups by @guanshengliang in #18548
chore: re-enable old style sanitizer config for taos-tools by @sangshuduo in #18539
fix:calculate the correct deletion range by @54liuyao in #18543
fix: get cpuid on x86 only by @sangshuduo in #18552
fix:add interface with ttl for schemaless by @wangmm0220 in #18537
fix: stream plan error by @xiao-yu-wang in #18549
refactor(sync): add interface syncSnapshotSending, syncSnapshotRecving by @castermode in #18551
enh: refactor retry by @yihaoDeng in #18533
chore: taos-tools add sanitizer workflow by @sangshuduo in #18555
fix(stream): delete multiple row by @cosmic-jc in #18554
fix:end ts of data block by @54liuyao in #18558
fix(query): handle countAlwaysReturnValue behavior by @glzhao89 in #18501
fix:[TD-20612] error if write raw with some cols by @wangmm0220 in #18553
refactor(sync): modify info log by @castermode in #18563
test: modify limit2.sim to limit.py by @plum-lihui in #18565
fix(query): add an null ptr checking before copying memory. by @hjxilinx in #18566
docs: Update number of stars in 02-intro.md by @fenghuazzm in #18567
fix:concurrency conflicts occur when obtaining windows system time by @facetosea in #18556
refacotr(sync), force stop snapshot sender/receiver when stop node by @castermode in #18568
enh: show more info while drop dnode by @guanshengliang in #18561
enh: add trace info by @yihaoDeng in #18535
fix: taosbenchmark printf format by @sangshuduo in #18569
fix:stream scan handles empty datablcok by @54liuyao in #18570
fix(query): fix avg calculation error after SIMD optimize by @glzhao89 in #18574
enh: show more info while drop dnode by @guanshengliang in #18577
fix: benchmark query result precision by @sangshuduo in #18581
refactor: do some internal refactor. by @hjxilinx in #18579
refactor(sync): if already start, force close snapshot receiver by @castermode in #18587
refactor: do some internal refactor. by @hjxilinx in #18591
fix: fix index filter crash by @yihaoDeng in #18588
opti:get meta cost for schemaless & add config for write batch in schemaless by @wangmm0220 in #18571
fix(query): fix interp with fill(prev) error by @glzhao89 in #18580
fix: build taosdump release by default for windows by @sangshuduo in #18594
test:modify base version from 3.0.1.0 to 3.0.1.8 in compatibility testcase by @tomchon in #18586
test: remove unstable case by @guanshengliang in #18601
feat: sql command 'show user privileges' by @xiao-yu-wang in #18584
refactor(sync): help to display leader** by @castermode in #18589
refactor(sync): add traceId log by @castermode in #18604
refactor(sync): delete code wait snapshot end in pre-close by @castermode in #18605
enh: show leader ** if vnode can read and can't write by @guanshengliang in #18593
Update 01-faq.md by @boxiaobj in #18608
fix: show Permission denied error in mac by @guanshengliang in #18610
fix:stream crash && add debug log by @54liuyao in #18607
feat: implement pipelining of sync by @bgzhao66 in #18449
refactor(sync): put heartbeat-reply msg into sync-ctrl-queue by @castermode in #18614
opti: get meta in schemaless by @wangmm0220 in #18615
fix(sync): delete duplicate code by @castermode in #18619
enh: add topic privilege in mnode by @guanshengliang in #18603
fix: taosbenchmark set config by @sangshuduo in #18616
fix: get prevLogTerm of index zero as 0 only when firstVer is zero by @bgzhao66 in #18622
refactor(stream): distributed checkpoint by @cosmic-jc in #18596
fix:window time wait by @facetosea in #18613
enh: refactor retry code by @yihaoDeng in #18611
fix: compatility after update stream by @guanshengliang in #18625
refact: adust error code while dnode startup by @guanshengliang in #18629
fix: check subquery time series error by @xiao-yu-wang in #18630
doc: update grafana version in English doc and modifythe way grafana plugin installed in application doc by @sunpe in #18635
doc: writting from kafka by @sunpe in #18626
enh: support query retry cause of dnode stopped by @dapan1121 in #18599
feat: sql command 'show user privileges' by @xiao-yu-wang in #18636
enh: ins_table count optimize by @xiao-yu-wang in #18618
fix: filter memory leak cause of same const strings by @dapan1121 in #18632
refact: remove TSDB_CODE_APP_NOT_READY and TSDB_CODE_NODE_NOT_DEPLOYED by @guanshengliang in #18642
test: add asan case by @guanshengliang in #18645
enh: remove sync batch propose in vnode by @guanshengliang in #18647
fix(tsdb/cache): use lru erase to invalidate cache entries by @stephenkgu in #18640
enh(query): optimize query perf. by @hjxilinx in #18592
enhancement: table count scan by @shenglian-zhou in #18590
fix: remove invalid table by @yihaoDeng in #18621
enh: remove TSDB_CODE_RPC_REDIRECT by @guanshengliang in #18651
enh: change rpc log level by @yihaoDeng in #18653
refactor: add function for extract the required buffer during query. by @hjxilinx in #18652
enh(taosAdapter): support loongArch64 by @huskar-t in #18654
fix: get result of tmsPutToQueue for FpCommitCb by @bgzhao66 in #18656
refact: remove some error codes by @guanshengliang in #18659
enh(query): improve the performance and add some todo by @hjxilinx in #18661
fix: synchronize syncPropose for executing blocking msgs in vnodeProposeMsg by @bgzhao66 in #18668
fix: truncate WAL on need while syncLogBufferRollback by @bgzhao66 in #18671
refactor(sync): add config item and default value in sync by @castermode in #18672
enh(query): avoid repeatly load del file. by @hjxilinx in #18670
feat: taosbenchmark supports vgid by @sangshuduo in #18657
feat(api): add new api int64_t taos_affected_rows64 by @DuanKuanJun in #18646
enh: optimize multiple table insert by @dapan1121 in #18643
fix: dataDir process of multi-tier storage conform to 2.6 by @kailixu in #18675
feat: async commit by @hzcheng in #18674
release: build 3.0.2.0 by @guanshengliang in #18680
fix: tsdb do retention fix by @kailixu in #18679
docs: update connector matrix with nodejs ws sql support by @sangshuduo in #18687
docs: update connector matrix for go ws stmt by @sangshuduo in #18688
docs: update connector matrix for go ws tmq by @sangshuduo in #18690
docs: update connector matrix for go ws bulkpulling by @sangshuduo in #18691
fix(sync): fix snapshot receiver waiting time by @castermode in #18685
fix: fix compiler warning in taosudf.h by @shenglian-zhou in #18686
test:comment commit of tmq consumer in crashGen by @tomchon in #18700
fix: commit tdb in write thread by @stephenkgu in #18692
fix: disable crashgen tmq callback temporarily by @sangshuduo in #18702
fix: add 'JNI_RESULT_SET_NULL' error code by @huolibo in #18697
fix: use tdbTrace to reduce 135 debug log output by @stephenkgu in #18684
enh(query): add timetruncate function ignore timezone option for 1d by @glzhao89 in #18694
refactor(sync): modify/use default config value by @castermode in #18695
fix(shell): forbid .taos_history record password for security by @DuanKuanJun in #18698
fix(log): ignore create log error by @DuanKuanJun in #18715
fix:stddev\fisrt\last combine function by @54liuyao in #18705
fix: csharp test case by @sangshuduo in #18706
fix: walSaveMeta ahead of deleting WAL files as gc in walEndSnapshot by @bgzhao66 in #18701
fix(sync): close snapshot receiver in pre-close by @castermode in #18716
refact: remove redundant error codes by @guanshengliang in #18681
fix: add redirect error code and fix no error msg issue by @dapan1121 in #18717
feat: update taosadapter branch by @sunpe in #18729
fix: synchronize access of pWalHandle with mutex in raftLogGetEntry by @bgzhao66 in #18732
fix: dataDir process for multi-tier storage by @kailixu in #18733
enh: allow any user to create a topic by @guanshengliang in #18731
test: add cases for create and drop topic by @guanshengliang in #18735
feat: add stream option 'delete_mark' by @xiao-yu-wang in #18740
enh: enable timeout checking of sync Resp with ttl as 30s by @bgzhao66 in #18745
fix(query): check null ptr before dereferencing it. by @hjxilinx in #18708
refactor(sync): add reserved field in message by @castermode in #18746
fix: fix count VAR type column error cause of reading incorrect sma results by @glzhao89 in #18742
enh: add fail-fast by @yihaoDeng in #18725
fix:read data and compute group id by @54liuyao in #18741
fix: fix tbnameIn bug on normal table by @yihaoDeng in #18747
enh: speed up drop dnode and avoid snapshot transfer by @guanshengliang in #18738
fix: add stmt sort merge case by @dapan1121 in #18749
fix; add msg type by @yihaoDeng in #18751
enh: support more fail-fast msgtype by @yihaoDeng in #18752
fix: fix task redirect not finished issue by @dapan1121 in #18743
fix: modify qnode query thread min number by @dapan1121 in #18757
fix: query message compatibility by @xiao-yu-wang in #18764
fix: taosdump atomic static link by @sangshuduo in #18763
fix: client retry insert based on some error code by @dapan1121 in #18768
fix: retention by @hzcheng in #18766
enh: check contiguousness of indexes applied to vnode by @bgzhao66 in #18769
fix: fix mem leak by @yihaoDeng in #18777
fix(query):fix the invalid write operation. by @hjxilinx in #18778
fix: taosbenchmark vgid ntb by @sangshuduo in #18780
refactor(sync): re send snapshot in timer-routine when response timeout by @castermode in #18783
refact: adjust some assert cases by @guanshengliang in #18775
enh: add tassert funcs (TD-20045) by @guanshengliang in #18772
Revert "refact: adjust some assert cases" by @guanshengliang in #18786
fix: make invalid_commandline.py and demo.py back to test by @sangshuduo in #18784
enh: add tassert by @guanshengliang in #18788
fix: query message compatibility by @xiao-yu-wang in #18774
fix: add default command line to start udfd when taosd is started directly from command line by @shenglian-zhou in #18727
enh: alter db replica return quickly, operation executed asynchronously by @guanshengliang in #18787
fix(query): ensure the SMA SArray* capacity is enough big to save all the columns for scanning by @DuanKuanJun in #18779
enh: merge getmetafromcache and getvgroupfromcache interface by @xiao-yu-wang in #18800
fix: mem leak by @cosmic-jc in #18794
enh: collect and record the signal which the dnode was killed in the log file by @guanshengliang in #18793
fix: dismiss coverity issues by @stephenkgu in #18799
fix:stream update data by @54liuyao in #18803
fix(query): fix percentile crash when input has more than 10 million records by @glzhao89 in #18758
fix: update diskId when migrate DFileSet by @kailixu in #18791
fix: keep option of database with ns precision by @kailixu in #18790
enh: print dnode startup parameters by @guanshengliang in #18798
enh: merge getmetafromcache and getvgroupfromcache interface by @xiao-yu-wang in #18809
enh: merge getmetafromcache and getvgroupfromcache interface by @xiao-yu-wang in #18814
fix:taos.dll export taosDatatype by @facetosea in #18806
fix: update epset by @yihaoDeng in #18810
fix(sync): checkout NULL pointer by @castermode in #18808
fix:read the deleted data by @54liuyao in #18762
fix: compile warn by @xiao-yu-wang in #18819
fix: taos shell prompt for websocket by @sangshuduo in #18826
enh: check topic privilege by @cosmic-jc in #18817
fix(build):centos7 x64 makeinstall cannt write taod service to systemctl by @xleili in #18827
fix: taosbenchmark use fully rest interface by @sangshuduo in #18828
Fix/xsren/td 20141 mac os os type empty by @facetosea in #18807
fix: dismiss coverity issues by @stephenkgu in #18805
Fix: vnode snapshot problem by @hzcheng in #18830
enh: TD-20975 by @yihaoDeng in #18829
release: build 3.0.2.0 by @guanshengliang in #18832
enh: tolerate exec error by @cosmic-jc in #18835
enh: insert multi tables optimize by @xiao-yu-wang in #18815
build: upgrade taosadapter version by @sunpe in #18834
test: temporarily disable go.sh test by @sangshuduo in #18845
Revert "fix(build):centos7 x64 makeinstall cannt write taod service to systemctl" by @sangshuduo in #18836
fix: release lock and memory in exceptional cases by @stephenkgu in #18837
fix: check topic privilege only by @guanshengliang in #18841
fix: supportVnodes config is not in effect by @guanshengliang in #18838
release: build 3.0.2.0 by @guanshengliang in #18846
fix: use taos-connector-rust in packaging scripts by @zitsen in #18663
release: build 3.0.2.0 by @guanshengliang in #18847
feat:add delete mark for sma by @54liuyao in #18842
fix: exhandle mem leak by @yihaoDeng in #18848
fix: fix udfd crash by @yihaoDeng in #18850
release: build 3.0.2.0 by @guanshengliang in #18861
fix: change default sch value by @yihaoDeng in #18857
fix: mem leak by @cosmic-jc in #18854
fix: donot print log while assert by @guanshengliang in #18867
fix: shell crash TD-21115 by @yihaoDeng in #18869
fix:fix mem leak by @yihaoDeng in #18864
fix(query): remove invalid assert and fix the error in memcpy data. by @guanshengliang in #18873
release: build 3.0.2.0 by @guanshengliang in #18871
fix: shell crash TD-21115 by @yihaoDeng in #18870
fix: donot print log while assert by @guanshengliang in #18868
fix(query): remove invalid assert and fix the error in memcpy data. by @hjxilinx in #18872
fix(query): keep the correct value. by @guanshengliang in #18877
release/ver-3.0.2.0 by @guanshengliang in #18878
fix(query): return with error code if the table does not exist by @hjxilinx in #18862
fix: show queries crash issue by @dapan1121 in #18876
fix: control rpc qitem memory by @guanshengliang in #18874
fix(query): does not return error code if queried table does not exists. by @guanshengliang in #18880

New Contributors

@saivishwak made their first contribution in #18488
@facetosea made their first contribution in #18512

Full Changelog: ver-3.0.1.8...ver-3.0.2.0

taosdata/TDengine ver-3.0.2.0 3.0.2.0 on GitHub

What's Changed

New Contributors

taosdata/TDengine ver-3.0.2.0
3.0.2.0

on GitHub