taosdata/TDengine ver-3.0.2.5 on GitHub

Enhancements:

tar.gz installer can detect RPM/Deb installation and remove them per user's confirmation
Performance improvement of partition by
Performance improvement of "select * limit 0"
Performance improvement of "select count(*)" when there is out-of-order data
Performance improvement for query by caching head files

Fixed Bugs:

taosd crashs when querying information_schema with filter conditions
taosd crashs when inserting data rows with duplicate timestamp in some extreme cases
taosd crashs when executing some very complicated queries
taosd crashs on Windows
keepColumnName doesn't work in sub-query
min(), max() and some functions don't return correct result when all data are in data files
taoskeeper failed to start because "create database" is not executed prior to "create table" in some cases
Some memory leak problems in taosd
Memory leak in taosadpater when using line protocol
No result is returned using "order by asc limit offset"
interp() doesn't work properly in sub-query
Error "WAL failed to remove log file" on Windows
A lot of internal bugs to improve stability

What's Changed

chore: add comp postfix for taos-tools by @sangshuduo in #19169
enh: drop stream eagerly by @cosmic-jc in #19167
fix: skip msg by @cosmic-jc in #19174
refactor: do some internal refactor. by @hjxilinx in #19172
enh: set scan limit by @cosmic-jc in #19178
enh: check existence of msg head at SRpcMsg pCont in vmPutMsgToQueue by @bgzhao66 in #19177
fix: display the correct log information by @guanshengliang in #19176
fix: taosbenchmark no vgroup if host specified for main by @sangshuduo in #19180
fix: semaphore is not destroyed issue by @dapan1121 in #19183
fix:calculate next sliding window error by @54liuyao in #19187
fix: double free on append log failed by @guanshengliang in #19189
fix: escape error in create topic by @xiao-yu-wang in #19198
fix: change system error code and avoid mem leak by @yihaoDeng in #19197
test: add test case for tmq replica 3 by @xiaopingcs in #19193
fix: disable fma by default for old cpu by @sangshuduo in #19207
fix: handle except on taosd rpc-client by @yihaoDeng in #19215
fix: prohibit triggering modes other than at_once in non window stream by @xiao-yu-wang in #19217
fix memory leak by @cosmic-jc in #19190
test:add client-server compatibility test by @tomchon in #19222
enh: adjusting the operation mode of the stream thread pool by @guanshengliang in #19210
test:add client-server compatibility test by @tomchon in #19225
fix: covert scalar param to data block by @shenglian-zhou in #19205
fix: set dnode online after status check success by @guanshengliang in #19223
fix: support_vnodes and the max supported vgroups mis-match by @guanshengliang in #19219
fix:fill operator fill next issue by @54liuyao in #19213
Fix/xsren/win sort & mac fqdn by @facetosea in #19232
fix(query): fix count/hyperloglog return additional row in group by when queryPolicy is set to 3. by @glzhao89 in #19224
refact: adjust sync log by @guanshengliang in #19242
fix(tdb): free stack celldecoder's pVal by @stephenkgu in #19249
fix: escape error in create topic/stream by @xiao-yu-wang in #19250
fix(meta/snap): return -1 when decoder meta entry failed by @stephenkgu in #19253
avoid invalid free by @yihaoDeng in #19247
fix: some query tasks not end when vnode stopped by @dapan1121 in #19239
enh: put func state into tdb by @cosmic-jc in #19244
enh: optimize drop when scan exec by @cosmic-jc in #19255
new API taos_stmt_reclaim_fields to reclaim TAOS_FIELD_E in a uniform… by @freemine in #19245
fix: error in deleting only tag columns by @xiao-yu-wang in #19256
enhance: remove assert by @shenglian-zhou in #19175
fix: select tbname from system tables by @shenglian-zhou in #19147
refactor: stream dispatch by @cosmic-jc in #19257
fix(query): opt filter perf. by @hjxilinx in #19188
fix:modify parameter type by @54liuyao in #19266
test:add test case info ci by @jiacy-jcy in #19273
fix: invalid msg order issue by @dapan1121 in #19277
Enh/xsren/win print trace mainbase by @facetosea in #19279
build: update taosadapter by @sunpe in #19292
test: update script for crash_gen by @xiaopingcs in #19294
Release/ver 3.0.2.2 by @plum-lihui in #19293
fix: reset stream status when load from disk by @cosmic-jc in #19290
enh: remove assert by @yihaoDeng in #19264
feat(util): new ASSERT work by @DuanKuanJun in #19126
fix: allow the ip resolved by fqdn different between dnodes by @guanshengliang in #19297
fix: insert into select with disorder column issue by @dapan1121 in #19280
refactor: disable all asserts. by @hjxilinx in #19312
fix mem leak by @cosmic-jc in #19318
enh: add log by @hzcheng in #19322
fix(query): fix floating type handle sma error by @glzhao89 in #19262
fix: evac page failed issue cause of disk full by @dapan1121 in #19327
fix(utility): fix the bug in creating auto delete files. by @hjxilinx in #19321
fix: skiplist concurrent access by @hzcheng in #19336
fix: load wal ref when init by @cosmic-jc in #19334
fix: vnode set the wrong replica info after snapshot transfered by @guanshengliang in #19344
enh: remove assert from mnode by @guanshengliang in #19333
Enh/xsren/td 21652/win file lock base main by @facetosea in #19317
test: update tmq test cases by @xiaopingcs in #19289
fix: add test for select tbname from systable by @shenglian-zhou in #19310
fix: drop task while task executing issue by @dapan1121 in #19339
fix: varchar type order by rule different with nchar type by @DuanKuanJun in #19337
enh: use diff atomic op by @hzcheng in #19350
fix: update taos-tools 4776778 for main by @sangshuduo in #19349
enh(query): opt filter perf. by @hjxilinx in #19345
feat: add batch get table vgId API by @dapan1121 in #19358
fix: fix ASSERTs by @glzhao89 in #19325
fix: 'show user privilegs' command echo user name incomplete by @xiao-yu-wang in #19360
fix: send rpc response on closing sync or failing to enqueue by @bgzhao66 in #19372
enh(query): handle getBufPage return NULL when no available disk spaces by @glzhao89 in #19370
ci:add ci for keepColumnName by @54liuyao in #19376
fix(vnode/mgmt): pre close vnode after queue's empty by @stephenkgu in #19369
feat: update taos-tools 69964a0 for main by @sangshuduo in #19382
fix: update taos-tools 4efbc10 for main by @sangshuduo in #19398
fix: crash if reader is already dropped by @guanshengliang in #19389
fix: rsma commit without table by @kailixu in #19406
fix: tsdb snap wrong suid by @hzcheng in #19396
fix: fix no available disk error by @glzhao89 in #19415
fix: remove privilege info on drop db / topic by @guanshengliang in #19411
fix: handle error while write vnodes.json by @guanshengliang in #19418
feat: support crash report to telemetry server by @dapan1121 in #19278
fix(vnd/snap): keep vnode stats transfered from leader by @stephenkgu in #19422
change default config value by @yihaoDeng in #19403
fix: td-21697 by @yihaoDeng in #19338
fix; fix invalid vgroup id by @yihaoDeng in #19298
fix: set operator precision miss by @xiao-yu-wang in #19412
fix: taosbenchmark ctrl-c handle for main by @sangshuduo in #19433
fix(query): do not merge rows in last file when no data blocks exist. by @hjxilinx in #19435
enh: vnodeCommit on consensus only by @bgzhao66 in #19125
fix: use pInfo->info.state.committed for WAL snapshot instead of the current one for async vnodeCommit by @bgzhao66 in #19436
fix(taosAdapter): get vgid in batch by @huskar-t in #19437
fix: rename global variables by @guanshengliang in #19438
enh: refact raft store file read write by @guanshengliang in #19445
fix:table name error in schemaless by @wangmm0220 in #19401
fix: error code not returned issue by @dapan1121 in #19446
enh: add version for show cluster by @guanshengliang in #19454
fix: install script don't install new cfg on fresh new system by @sangshuduo in #19451
fix(query): fix error for retrieve data only in last files. by @hjxilinx in #19457
enh: read mnode file by @guanshengliang in #19456
enh: vote for higher lastLogTerm despite commitIndex by @bgzhao66 in #19408
fix: no core file generated issue on linux by @dapan1121 in #19461
fix: return dropping dnode in status resp by @guanshengliang in #19452
fix(query): fix error for retrieve data only in last files. by @hjxilinx in #19467
test: add cases for ts-2440 by @jiajingbin in #19462
fix: synchronize access within walFsync by @bgzhao66 in #19469
fix: reset table scan status by @cosmic-jc in #19477
fix: tsdb read invalid memory read issue by @dapan1121 in #19425
fix: taos-tools deb rpm compn for main by @sangshuduo in #19489
test: refine query cases by @happyguoxy in #19494
enh: adjust some json file reader by @guanshengliang in #19495
enh(query): disable the memset when allocate the memory for dataBlock. by @hjxilinx in #19486
fix(tdb/ofp): upgrade large key ofp case by @stephenkgu in #19503
test：add test case into ci by @jiacy-jcy in #19498
fix(tdb/ofp): upgrade ofp cell with large key by @stephenkgu in #19505
fix: wait for trans completion in testcase 5dnode3mnodeDrop.py by @bgzhao66 in #19509
enh: fsync each WAL log after appending when wal_level=2 and wal_fsync_period=0 by @bgzhao66 in #19518
fix: allow mnode start even dnode in dropping state by @guanshengliang in #19493
fix: repeat malloc sdb raw by @guanshengliang in #19506
fix: coverity issues by @guanshengliang in #19508
fix: taosbenchmark sanitize for main by @sangshuduo in #19530
test: refine query cases by @happyguoxy in #19549
refact: adjust return value of tmsgUpdateDnodeInfo by @guanshengliang in #19542
test:modify failed cases in ci by @tomchon in #19544
fix: no stable null group when no normal table by @shenglian-zhou in #19523
fix: concurrency issue by @cosmic-jc in #19537
enh(driver-go): redesign of go tmq api by @huskar-t in #19554
fix: update epset on dnode info changed by @guanshengliang in #19555
fix(query): use the recycled blocks to reduce the cached buffer. by @hjxilinx in #19559
fix: taosbenchmark schemaless refine main by @sangshuduo in #19567
fix:memory leak by @wangmm0220 in #19541
fix: add stt_trigger to show create database processing by @shenglian-zhou in #19569
test: add new sim to CI. by @hjxilinx in #19576
ci:modify the filename of the error log by @tomchon in #19585
fix: insert into select can't be stopped issue by @dapan1121 in #19589
fix: move crash report to shell by @dapan1121 in #19596
enh: skip WAL forceSync for single replica vgroup by @bgzhao66 in #19533
bugfix: stack-buffer-overflow by @freemine in #19584
Fix/xsren/td 21762/sem mem leak basemain by @facetosea in #19587
fix: packaging/release.sh don't catch error temporarily for main by @sangshuduo in #19611
fix: tsdb read snapshot take/untake by @kailixu in #19602
fix: fix vgroup dead lock issue by @dapan1121 in #19601
fix: crash caused of wrong task phase issue by @dapan1121 in #19613
chore: release script add comp for taostools formain by @sangshuduo in #19619
fix: tsdb fs nRef by @kailixu in #19624
fix: rows number exceeds block capacity issue by @dapan1121 in #19632
release: update main version to 3.0.2.4 by @xleili in #19635
fix: atexit memory leak issue by @dapan1121 in #19638
enh: optimize execute plan when 'tail' function is used with 'partition by' clause by @xiao-yu-wang in #19643
fix: packaging/tools/install.sh for main by @sangshuduo in #19649
fix: reenable -e in release.sh for main by @sangshuduo in #19650
fix: row schema version for row merger by @kailixu in #19655
feat: taosbenchmark specfying vgroups for main by @sangshuduo in #19660
fix(query): check for failure during add new buf pages. by @hjxilinx in #19657
typo correction by @freemine in #19667
refactor:do some internal refactor. by @hjxilinx in #19666
fix: task db by @cosmic-jc in #19675
fix: taosbenchmark ignore drop db failure for cloud by @sangshuduo in #19671
fix:getTimeOfDay on windows by @facetosea in #19680
fix: wal ref by @cosmic-jc in #19681
fix: not keep wal log vnodeCommit'ed for single replica db by @bgzhao66 in #19636
enh: remove unused old routines in sync by @bgzhao66 in #19621
Fix/TD-21761 by @hzcheng in #19688
fix(query): add qsort for alpine. by @hjxilinx in #19686
ci:add taosx compilation in ci by @tomchon in #19695
fix: round lastApplyIndex up to beginIndex -1 in syncBeginSnapshot by @bgzhao66 in #19696
enh: trim the last WAL idx file which is not fsynced by @bgzhao66 in #19578
enh: flush database in testcase alter_replica_13.sim to trigger snapshot repl by @bgzhao66 in #19693
fix: assert coredump by @hzcheng in #19691
fix: add node stopped and get/accquire ctx return node stopped by @shenglian-zhou in #19629
fix:process data with incorrect timestamp by @54liuyao in #19705
fix: install script refine sentence for main by @sangshuduo in #19703
build: add python demo to ci by @sunpe in #19699
fix: invalid read by @hzcheng in #19716
fix(taosAdapter): set option TSDB_OPTION_USE_ADAPTER = true by @huskar-t in #19711
fix: not try to propose commit on vmCloseVnode by @bgzhao66 in #19718
fix: no cache auto create table error by @xiao-yu-wang in #19723
fix: taosbenchmark schemaless refine for main by @sangshuduo in #19714
fix(query): reset the del file index when beginning last file check. by @hjxilinx in #19728
fix: update taos-tools a0234fe for main by @sangshuduo in #19737
fix(query): move the reset to other place. by @hjxilinx in #19735
refactor: add some logs. by @hjxilinx in #19740
fix(stream): use tdb page replacement with stream state by @stephenkgu in #19733
fix(meta): use metaAbort instead of tdbAbort with metaClose by @stephenkgu in #19748
fix: a time point can be fill by @xiao-yu-wang in #19749
ci:add ci docker file to TD-rep by @tomchon in #19759
fix: taosbenchmark handle mem better patch2 for main by @sangshuduo in #19743
fix(query): do some internal refactor, and identify a bug. by @hjxilinx in #19652
fix: tq open by @cosmic-jc in #19745
fix: snode timer by @cosmic-jc in #19731
fix: interp support filter and scalar calc by @dapan1121 in #19751
fix: mem leak by @cosmic-jc in #19746
fix: check dup rebalance by @cosmic-jc in #19771
enh: improve logging msgs for sync snapshot repl by @bgzhao66 in #19768
fix:add ttl drop response for mnode by @wangmm0220 in #19760
fix(tdb): return success if txn is commited by @stephenkgu in #19764
fix: snapshot coredump caused by type by @hzcheng in #19782
fix: not apply to mnode if trans createTime not matched by @guanshengliang in #19786
docs: revert go mod file by @sunpe in #19791
enhance: optimize building table delete skyline performance by @dapan1121 in #19744
fix: add get ip addr result validation by @dapan1121 in #19774
fix(query): set the correct number of rows when calculating using sma by @hjxilinx in #19790
fix: update taos-tools 6a2d9fc for main by @sangshuduo in #19802
fix: show table distributed only works on super table, child table, and normal table by @shenglian-zhou in #19753
fix: request snapshot from maximum of commit vers of tsdb and wal by @bgzhao66 in #19799
fix: insert syntax error by @xiao-yu-wang in #19804
fix(query): add null ptr check when retrieving the block info. by @hjxilinx in #19809
enh(query): add check for limit reach status. by @hjxilinx in #19811
enh(tsdb/cache): new block index cache for querying by @stephenkgu in #19813
fix: client update epset crash issue by @dapan1121 in #19812
fix: fix return invalid code by @yihaoDeng in #19810
opt: change transport param by @yihaoDeng in #19800
fix: no resp when host machine shutdown by @yihaoDeng in #19779
fix: fix fd limit crash by @yihaoDeng in #19777
fix: fix not msg to send by @yihaoDeng in #19763
fix(query): set the correct timestamp value in case that only imem has data. by @hjxilinx in #19816
fix: set transId to 0 while timeout or in follower state by @guanshengliang in #19826
fix: should not execute trans if not leader by @guanshengliang in #19827
fix(query):set null for if the queried table is dropped by @hjxilinx in #19825
enh: stream number limit by @cosmic-jc in #19808
fix: query res freed when fetch handling drop event by @dapan1121 in #19815
enh(taosAdapter): add whether to disable the collection clientIP configuration option by @huskar-t in #19819
fix(query):add check for no disk error. by @hjxilinx in #19836
docs: add more details about interp subclause en by @glzhao89 in #19835
docs: add more detail about interp subclause zh by @glzhao89 in #19833
feat: support force fill in interval clause by @dapan1121 in #19817
fix: fix return invalid err by @yihaoDeng in #19838
feat: taosbenchmark support childtable from a range for main by @sangshuduo in #19858
fix(query): check if table exists or not during build data blocks by @hjxilinx in #19846
fix(vnd): no rlock on writing thread's path by @stephenkgu in #19840
fix(stream/state): switch tdb rollback on to restore from journals by @stephenkgu in #19839
Test/td 22219 by @happyguoxy in #19834
ci:modify stream state window test by @54liuyao in #19832
fix: setting logKeepDays to -1 result in empty compressed logs. by @glzhao89 in #19849
fix(tdb/defragment): use nlogn page defragment instead of n^2 by @stephenkgu in #19850
fix: keepcolumnname is invalid in nested query by @xiao-yu-wang in #19851
Update CMakeLists.txt by @hjxilinx in #19867
fix(query): reset the data load flag when build clean file block. by @hjxilinx in #19859
test: add case double comma check in insert_drop.py by @DuanKuanJun in #19866
enh: reset wal reader after walReadVer by @bgzhao66 in #19869
enh: return error on unexpected snapshot msg by @bgzhao66 in #19852
enh: set terrno as Invalid table ID while tdbTbGet suid failure in metaUpdateTagIdx by @bgzhao66 in #19848

Full Changelog: ver-3.0.2.2...ver-3.0.2.5

taosdata/TDengine ver-3.0.2.5 3.0.2.5 on GitHub

What's Changed

taosdata/TDengine ver-3.0.2.5
3.0.2.5

on GitHub