taosdata/TDengine ver-3.0.4.2

3.0.4.2

on GitHub

Enhancements:

1. Improved performance for last() without cache enabled
2. Minimize the impact on data writing caused by data subscription
3. Improved rebalance performance

Fixed bugs:

1. taosd exit may take too much time when there is a long query
2. data subscription may hang in some extreme cases
3. order by _wstart with partition by doesn't work
4. A few crashe problems when using stream
5. The result of sum + case when is not correct
6. The result of interp is incorrect
7. Schemaless writing reported error "table not exist"
8. taosd keeps logging "database not exist"

What's Changed

• enh(stream): the stream will start after vnode restore being completed. by @hjxilinx in #20873
• fix: udf plan error by @xiao-yu-wang in #20940
• fix:stream memory leak by @54liuyao in #20953
• opti:the logic of mndDoRebalance for clear by @wangmm0220 in #20938
• chore(deps): bump spring-core from 5.3.26 to 5.3.27 in /examples/JDBC/taosdemo by @dependabot in #20955
• enh: remove unused functions in sync by @bgzhao66 in #20954
• fix(stream): set the correct initial checkpoint versions. by @hjxilinx in #20947
• fix: atoi on int64 config item for main by @sangshuduo in #20956
• fix: jdbc connector illegal accesses by @huolibo in #20962
• fix: fix double free caused crash by @glzhao89 in #20952
• fix(stream): update the reference count value to be int32 by @hjxilinx in #20967
• fix: duplicate calling shellWriteHistory by @DuanKuanJun in #20958
• enh: ignore single row null data type validation by @dapan1121 in #20973
• fix(os): fix a deadlock. by @hjxilinx in #20977
• fix: tdengine swarm cluster(3 mnodes) startup error by @lazyky in #20966
• fix: trim database db from mnd by @kailixu in #20983
• test:add testcase of compatibility.py for TS-3209 by @tomchon in #20984
• test: modify test case by @plum-lihui in #20934
• test: add cases for TS-3150 by @jiajingbin in #20911
• ci: enable Jemalloc in compilation by @tomchon in #20616
• fix: invalid identifier check by @xiao-yu-wang in #20993
• fix(stream): add lock during check wal to create new stream task. by @hjxilinx in #20995
• enh(stream): add more check to stop stream asap. by @hjxilinx in #20998
• add the cast that select field include two udf function by @DuanKuanJun in #20991
• enhance: enterprise package include jdbc driver by @xleili in #21001
• fix: do not performace table count scan optimized where there are no agg functions by @shenglian-zhou in #20989
• fix(stream): set the correct number of tasks. by @hjxilinx in #21002
• fix:[TS-3082] change offset to firstver if offset is smller than firs… by @wangmm0220 in #21006
• fix:[TS-3250] change strtegy in schemaless if modifyDBSchema error by @wangmm0220 in #21005
• opti:escape logic in schemaless by @wangmm0220 in #20970
• feat: support table_prefix/table_suffix new mode by @dapan1121 in #21007
• fix: taosdump escape dbname by @sangshuduo in #21014
• fix: topic name supports capital by @wangmm0220 in #21012
• fix: when db_name!=xxx can not be used in systable scan index by @shenglian-zhou in #21008
• fix: vnode errcode setting error by @xiao-yu-wang in #21028
• fix: taosbenchmark rest socket in stb section for main by @sangshuduo in #21020
• fix: change tdbTbInsert to tdbTbUpsert for meta update in tdb by @bgzhao66 in #21013
• fix:add log for locale setting by @cadem in #21023
• fix: release resources if node open/start failed by @kailixu in #21032
• fix filter err by @yihaoDeng in #21019
• test:modify base version in compatibility.py by @tomchon in #21044
• fix(query): add null ptr check. by @hjxilinx in #21030
• Test/ts 3249 by @happyguoxy in #21047
• fix: delete table error by @hzcheng in #21064
• fix: restore ci buildPath by @tomchon in #21067
• opti:test cases for tmq by @wangmm0220 in #21046
• enhance: packaging keeper in deb rpm main by @xleili in #21071
• fix: the latest schema may delete columns by @shenglian-zhou in #21074
• feat: subtable level privilege by @xiao-yu-wang in #21056
• fix: more fix by @hzcheng in #21078
• enh(query): opt last row read performance. TD-23313 by @hjxilinx in #21070
• fix: schema/tag version update to int32 by @dapan1121 in #21088
• fix: log file size over 4G report error on windows by @DuanKuanJun in #21077
• fix: fix crash caused by deleting from system table by @glzhao89 in #21029
• refactor: do some internal refactor. by @hjxilinx in #21087
• test：add test case for multistage by @jiacy-jcy in #20997
• Lihui3.0/test by @plum-lihui in #21094
• log: disable some logs. TD-23861 by @hjxilinx in #21097
• fix(taosAdapter): tmq lift blocking time limit by @huskar-t in #21100
• enhance: relase enterpise pull jdbc from tag 3.1.0 by @xleili in #21102
• fix(query): check the init status for pReader->status.merger TD-23903 by @hjxilinx in #21105
• fix:[TD-23881] check the max row's length in schemaless by @wangmm0220 in #21090
• release: upgrade default version to 3.0.4.1 by @xleili in #21110
• enh(query): stop tsdb reader ASAP. TD-23249 by @hjxilinx in #21111
• fix(query): stop tsdbreade ASAP, and do some internal refactor. TD-23249 by @hjxilinx in #21116
• refactor: do some internal refactor. by @hjxilinx in #21119
• other: add some logs. by @hjxilinx in #21120
• refactor: remove assert. by @hjxilinx in #21123
• enh: optimize tbname condition by @dapan1121 in #21126
• opti:change push mgr to consume msg for subscribe by @wangmm0220 in #21060
• refactor: do some internal refactor. by @hjxilinx in #21131
• fix:change field bytes if length is bigger than 1024 by @wangmm0220 in #21137
• fix(query): stop tsdb reader asap. TD-23964 by @hjxilinx in #21148
• fix: subtable grant is not allowed by @dapan1121 in #21158
• fix(stream): secure the delete task operation. TD-23966 by @hjxilinx in #21164
• fix: stable name not responsed while stable removed issue by @dapan1121 in #21150
• update crash gen push message by @xiaopingcs in #21170
• fix(stream): opt task scan performance. by @hjxilinx in #21169
• fix(tdb/decoder): free decoder's value if not needed by user by @stephenkgu in #21167
• refactor: do some internal refactor. by @hjxilinx in #21139
• enh: declare mndSplitVgroup in mndVgroup.h by @bgzhao66 in #21172
• int16 overflow by @cadem in #21140
• fix: print float with 20 width limit by @DuanKuanJun in #21174
• fix:[TS-3277]table not exist if drop stable in another client when in… by @wangmm0220 in #21163
• fix:change field bytes if length is bigger than 1024 by @wangmm0220 in #21153
• fix:[TS-3303]use stable name + child table name as key to save uid to… by @wangmm0220 in #21152
• [TS-3140]: add test case for user privilege by @xiaopingcs in #21042
• fix: clear null bitmap bit when set value by @shenglian-zhou in #21180
• refactor: do some internal refactor. by @hjxilinx in #21183
• fix: fix taosd not exit when press ctrl+c by @glzhao89 in #21184
• fix:[TS-3347]set ver to first version if version stored is smaller th… by @wangmm0220 in #21190
• use wrong usedb map by @cadem in #21195
• test: fix tsim/db/error1.sim random failed by @DuanKuanJun in #21185
• docs: add wal args by @AdamEECS in #21203
• colid overflow by @cadem in #21206
• fix: forbid some stream computing by @shenglian-zhou in #21187
• fix: protect against nullptr in syncRespCleanRsp by @bgzhao66 in #21211
• update push message by @xiaopingcs in #21171
• fix:[TD-23972] push subscribe msg to vnode even though consumer not c… by @wangmm0220 in #21177
• fix:[TD-24010] subscribeStb.py failed in windows CI by @wangmm0220 in #21194
• fix: fix invalid read by @yihaoDeng in #21212
• fix: data compare of signed and unsigned integers by @wangjiaming0909 in #21213
• Test/update push message by @xiaopingcs in #21228
• fix: fix crash caused by tsdbReaderResume error not handled by @glzhao89 in #21224
• fix: show table distributed t; set the unit of Size to KB by @wangjiaming0909 in #21218
• fix:after restarting taosd, stream does not work. by @54liuyao in #21216
• fix:after restarting taosd, stream does not work. by @54liuyao in #21226
• fix: check varchar/nchar column length for alter normal table by @shenglian-zhou in #21221
• fix:[TD-24058]send poll result to client if no data 5 times to avoid … by @wangmm0220 in #21227
• Optimize scripts for packaging/docker by @muicoder in #21225
• fix: set telemetry reporting service url from telemetry.taosdata.com … by @wangjiaming0909 in #21219
• test:add testcases of learner in election by @tomchon in #21229
• fix: connect error when login with information_schema/performance_sc… by @wangjiaming0909 in #21232
• fix: not to set ignoring signals in dmLogCrash by @bgzhao66 in #21244
• fix: repair timestamps of wal log files in meta by @bgzhao66 in #21249
• fix:compile error in release mode by @wangmm0220 in #21252
• test: add test case by @xiaopingcs in #21251
• docs: update readme with tdengin1 wechat by @sangshuduo in #21268
• enh: remove group_key from subsidiaries if multiple different select function present by @glzhao89 in #21250
• fix: column length check when update/add column by @kailixu in #21262
• fix:[TD-24111]avoid exec pHandle task in multi query thread by @wangmm0220 in #21269
• fix: func ctgHandleGetTbMetasRsp invalid read SName by @wangjiaming0909 in #21254
• fix: bypass projection pruning if union set op and subquery by @shenglian-zhou in #21258
• fix(tmq): check handle status before close sub. by @hjxilinx in #21289
• fix: disable table count scan optimization when filters and group by both exist by @shenglian-zhou in #21283
• docs: update readme with libgflags by @sangshuduo in #21294
• refactor: do some internal refactor. by @hjxilinx in #21296
• enh(taosAdapter): update taosAdapter by @huskar-t in #21297
• fix: fix linear interpolation error by @glzhao89 in #21301
• fix: ignore crash signals in dmLogCrash by @bgzhao66 in #21309
• fix:add lock to pHandle for safety by @wangmm0220 in #21311
• Enh/tsbs perf.4 by @dapan1121 in #21271
• fix(stream):extract delete msg from wal. TD-24207 by @hjxilinx in #21314
• fix: join push down condition issue by @dapan1121 in #21346
• docs(connector-rust): update documents of connector for rust by @bioinformatist in #21345
• Update cases.task by @plum-lihui in #21356
• fix(stream): fix memory leak for stream processing. by @hjxilinx in #21359
• fix: select , <expr1##sth else> from ... return error data whe… by @wangjiaming0909 in #21310
• fix: union clause error message by @dapan1121 in #21337
• fix: memory size overflow issue by @dapan1121 in #21361
• fix: join improvement by @shenglian-zhou in #21328
• enh: optimize order by for partition by clause by @dapan1121 in #21365
• fix: last table scan issue by @dapan1121 in #21379
• fix: join eq conditions optimization work on not only for tag by @shenglian-zhou in #21384
• fix(query): add null check. by @hjxilinx in #21385
• fix: distinct wrong result issue by @dapan1121 in #21371
• fix(query): do some internal refactor, and fix the bug when calender duration exists in sliding and offset. by @hjxilinx in #21378
• fix: result block ensure capacity when finalize may produce serveral … by @shenglian-zhou in #21382
• fix:error in pHandle lock by @wangmm0220 in #21355
• docs: update readme main by @sangshuduo in #21401
• fix: select last(*) ..group by tag return wrong rows of data by @wangjiaming0909 in #21388
• fix:set task code success after kill by @wangmm0220 in #21407
• add parameter by @yihaoDeng in #21406
• fix:remove get schema from previous for taosx by @wangmm0220 in #21411
• update crash_gen by @xiaopingcs in #21421
• fix:lost data because tsdbreader or task is killed by @wangmm0220 in #21427
• Remove taosx, connector, explorer and taoskeeper in cloud tdengine by @wingwing2005 in #21423

New Contributors

• @lazyky made their first contribution in #20966
• @muicoder made their first contribution in #21225
• @bioinformatist made their first contribution in #21345

Full Changelog: ver-3.0.4.0...ver-3.0.4.2