Behavior change and compatibility
Features
- feat: taosX add KingHistorian data-in
- feat: taosX add new datasource: pulsar & tuya
Enhancements
- enh: active-active support enable WAL marker to lock WAL
- enh: C WebSocket connector performance optimized
- enh: improve startup speed of stream with historical data
- enh: support caching filter results of tag equality conditions in stream
- enh: c/rust websocket connection support conn_timeout
- enh: clarified error messages for white noise check failures in the data completion algorithm
- enh: enhanced error messages for unresolvable or unreachable hostnames to indicate the root cause more clearly
- enh: TDgpt's imputation function supports arbitrary sampling intervals
- enh: taosX data migration supports conn_timeout
- enh: Add debug commands like vi, ps, etc. to Docker
- enh: improve corner case memory usage to avoid oom
- enh: taosX improve mem usage and speedup for flat stream
- enh: Explorer extracted columns can be extracted in chain
- enh: add maxSQLLength to set the maximum length of SQL statements
- enh: Rust websocket connection support read timeout
- enh: taosX archive file size and count limit
- enh: simplified the retry logic in the query process, and uniformly used maxRetryWaitTimes to control the maximum retry time
- enh: remove info log for points in opcda
- enh: OpenTSDB data-in support customized table name
- enh: speedup perf when table not exist for tmq to td
- enh: taosX import csv in batches
- enh: improve recovery speed after restart in clusters with multiple vnodes requiring data synchronization
- enh: allow TMQ subscription to TSDB v3.1.x
- enh: taosX support migration with additional WHERE condition
- enh: taosX support reclaim memory by interval or sighup
Fixes
- fix: event window of stream does not create output table when no data output.
- fix: taosX data synchronization included extra non-qualifying table structures.
- fix: fix a mem-leak issue of taosBenchmark
- fix: stream trigger incorrectly handles NULL values during DELETE-triggered recalculation
- fix: historical data triggering of stream state window does not support the extend parameter
- fix: stream compatibility issues when upgrading from version 3.3.7 to 3.3.8
- fix: incorrect calculation result of the state window when the data block boundary is a null value
- fix: incorrect window splitting in RSMA function when the timestamp is negative
- fix: leader switchover failure of dual-replica mnode.
- fix: election during snapshot transmission in the synchronization module causes a deadlock
- fix: stream sliding windows for virtual super tables lacked sub-table names in message notifications
- fix: resolve the issue where virtual super tables do not support SELECT DISTINCT TAGS queries
- fix: resolve the issue where a UNION query returns incorrect results if one of its subqueries contains only constant conditions in the WHERE clause
- fix: memory leak when MQTT subscription exits
- fix: resolve the memory leak issue when referencing virtual tables in stream
- fix: resolve the issue where virtual super tables do not support SELECT COUNT(1) queries
- fix: resolve the issue where the DERIVATIVE function returns an extra row in the result set when the query includes the tbname column
- fix: Resolved Docker image upgrade start-up failure after changing the taosd password, affecting versions 3.3.8.0–3.3.8.4
- fix: virtual table stream does not trigger computing as expected
- fix: time resolution processing error in TDgpt's Prophet algorithm model
- fix: query result error when the state window's extend value is 1 and the end of the window is all empty data
- fix: explorer input eroro when extract or filter preview
- fix: taosX fix mem increase and panic in archive in case of taosd errors
- fix: fix schema only backup restore error
- fix: crash caused by memory cleanup when sync message sending fails
- fix: TSDB Lite Explorer loading is slow
- fix: fix description attribute error in some special OPC-UA servers
- fix: multiple selections of namespaces cause error
- fix: fix unexpected taosX filtered metrics
- fix: query does not return the correct error code when it is killed
- fix: precision error in decimal constant conversion
- fix: stream cannot restart after adding new column mappings to the virtual table
- fix: failed to restore vnode when there are a large number of null values
- fix: resolved issue where virtual table queries failed after adding or removing Schema in their corresponding sub-tables.
- fix: time precision error in the last_compact column of the ins_filesets system table
- fix: stream repeatedly reports window opening events after restart
- fix: upgrade arrow dependencies for jdk21
- fix: reduce OpenTSDB log file size for taosX
- fix: InfluxDB data source table name inconsistent with disorder tags
- fix: error writing BLOB data type via super table auto-creation statements
What's Changed
- enh(stream): merge from main by @wangmm0220 in #33284
- enh(test): insert data in parallel by @kailixu in #33429
- test: support multi vm run CI by @SallyHuo-TAOS in #33436
- fix(docker): remove openjdk-17-jre-headless entry from Dockerfile.base by @tomchon in #33445
- Enh/stream/only createtable supported main2 by @facetosea in #33420
- fix explore-sys metric's sub table name by @sheyanjie-qq in #33441
- fix: Fix Docker command port mapping in documentation by @tomchon in #33449
- docs: update release note for 3.3.8.4 in office web by @feici02 in #33456
- enh/TD-38474-modify-sdb-data by @cadem in #33457
- ci: update branch configuration for taoskeeper build workflow by @qevolg in #33443
- feat(csv): docs update #TS-7450 by @zyyang90 in #33461
- enh: use TAOS_FQDN to start taosd by @tomchon in #33462
- feat: optimize the usage instructions of taosdump by @YamingPei in #33460
- enh: Remove macOS 13 from build matrix because of image Deprecated by @tomchon in #33466
- avoid cpu occupied by @yihaoDeng in #33465
- Fix/TS-7588 by @yihaoDeng in #33468
- merge: from 3.3.6 to main branch by @guanshengliang in #33474
- feat(taos): add connector info for perf_connections by @wangmm0220 in #33458
- fix: state window handle all-null datablock error by @Tony2h in #33439
- fix/TD-38490-reset-heartbeat-after-mnode-leader-restart by @cadem in #33473
- fix(rsma): window split for negative ts by @kailixu in #33467
- feat: write results of the super table query to a json file by @YamingPei in #33470
- case: tidy up cases (10.31) Migrate system-test by @DuanKuanJun in #33444
- merge: from 3.3.6 to main branch by @guanshengliang in #33486
- docs: update network by @guanshengliang in #33488
- fix[TD-38515]: fix ci return value check issue by @localvar in #33489
- docs: add window interval description by @dapan1121 in #33493
- fix/TS-7542-double-free by @cadem in #33494
- docs: update network by @guanshengliang in #33492
- feat:auth server by @Pengrongkun in #33469
- fix/TD-38495-snapshot-start-receiver-writer-error by @cadem in #33477
- merge: from 3.3.6 to main branch by @guanshengliang in #33503
- refactor(query): refactor failed task retry control procedure. by @hjxilinx in #33498
- refactor(query): refactor query task redirect process. by @hjxilinx in #33502
- merge: from 3.3.6 to main branch by @guanshengliang in #33504
- docs: update the Python documentation and upgrade taos-ws-py by @qevolg in #33496
- test: enhance the debugging information and exception handlingcapabilities by @YamingPei in #33497
- fix:stmt2 ut by @Pengrongkun in #33505
- Enh/add stream latency marks by @wangmm0220 in #33518
- Enh/add stream latency marks by @wangmm0220 in #33527
- fix: possible snapshot message size error and log info by @hzcheng in #33526
- Fix/336/csv-parse-error by @xiao-77 in #33500
- fix: possible snapshot message size error and log info by @hzcheng in #33525
- Enh/add stream latency marks by @wangmm0220 in #33534
- Enh/add stream latency marks by @wangmm0220 in #33536
- enh: add error log when scan meta data by @hzcheng in #33278
- enh: output vgroup id in vnode query for debug purpose by @hzcheng in #33268
- Enh/add stream latency marks by @wangmm0220 in #33538
- fix(tmqtt/unsub): release topic info when unpined from hash by @stephenkgu in #33539
- Enh/add stream latency marks by @wangmm0220 in #33540
- merge: from 3.3.6 to main branch by @guanshengliang in #33535
- Fix/ts 7621/decimal by @facetosea in #33541
- fix: nchar convert to decimal error by @facetosea in #33516
- fix:auth config by @Pengrongkun in #33528
- fix: return error when killed query by @facetosea in #33522
- Enh/add stream latency marks by @wangmm0220 in #33545
- merge: from 3.3.6 to main branch by @guanshengliang in #33543
- Enh/add stream latency marks by @wangmm0220 in #33546
- case: adjust case describe and show by @DuanKuanJun in #33487
- Enh/add stream latency marks by @JinqingKuang in #33551
- enh(stream): optimize indexHash for datablock by @wangmm0220 in #33553
- fix: variable-length type fields distinguish between null and empty values for taosdump by @YamingPei in #33550
- chore: use org level template by @feici02 in #33556
- Enh/add stream latency group val by @wangmm0220 in #33560
- Enh/add stream latency marks by @JinqingKuang in #33562
- fix(query): Check the type of the subclause before treating it as a DELETE statement. by @hjxilinx in #33558
- fix:migrate stream case to 100 priority ci failed by @DuanKuanJun in #33552
- fix: enhance failure logging to include 'Invalid' and 'Error' statuts and extend the return-value filter to ignore some void functions by @tomchon in #33531
- Enh/add stream latency marks by @wangmm0220 in #33565
- enh: Add timerange expr type check and Relax the criteria for determining external windows. by @Simon9997 in #33480
- fix:[TD-38550] Fix mem leak in exchagne operator. by @Simon9997 in #33561
- enh(wal): [TS-7567]set wal keep version to avoid deleting by @wangmm0220 in #33517
- enh: clear dangling files even file system is corrupted by @hzcheng in #33542
- enh(stream): optimize the performance of nevados by @wangmm0220 in #33519
- enh/TD-38561-remove-error-log by @cadem in #33547
- feat(query): retrieve first/last for the child table in a given uid list. by @hjxilinx in #33568
- enh: [TD-38369] Split vtable test case to accelerate ci. by @Simon9997 in #33548
- fix:[TD-38544] Fix error when using const condition like 'where 1=0' in union query. by @Simon9997 in #33569
- fix:[TD-38544] Fix error when using const condition like 'where 1=0' in union query. by @Simon9997 in #33554
- fix: output rows of DERIVATIVE funciton by @facetosea in #33555
- jdbc release 3.7.7 by @sheyanjie-qq in #33575
- docs: add doc for trim wal and keep vrsion. by @xiao-77 in #33579
- fix:[TD-38557] Fix select count(1) from virtual super table. by @Simon9997 in #33577
- fix:[TD-38557] Fix select count(1) from virtual super table. by @Simon9997 in #33567
- docs: update WebSocket connection parameters by @qevolg in #33574
- Fix/336/TD-38578 by @xiao-77 in #33584
- fix: [TD-38520] Fix select tbname/tags tbname from virtual super table get wrong ans. by @Simon9997 in #33576
- fix: [TD-38520] Fix select tbname/tags tbname from virtual super table get wrong ans. by @Simon9997 in #33549
- feat: add taosGetFqdnWithTimeCost function to measure FQDN retrieval time by @yihaoDeng in #33582
- enh: support specify grant items during packaging by @kailixu in #33573
- merge: from 3.3.6 to main branch by @guanshengliang in #33572
- fix: Invalid snapshot data size estimation by @hzcheng in #33589
- fix(taosBenchmark): fix memory leak issue in the tags stmt data by @YamingPei in #33588
- case: uniform case title by @DuanKuanJun in #33587
- feat: add taosGetFqdnWithTimeCost function to measure FQDN retrieval time by @yihaoDeng in #33580
- fix: exchangeId's type shouble be int64 by @facetosea in #33594
- fix: exchangeId's type shouble be int64 by @facetosea in #33592
- fix: ins_table type error by @Tony2h in #33586
- fix/TS-7645-mark-restore-status-when-role-is-follower by @cadem in #33595
- fix: revert 3.3.6's vtable case. by @Simon9997 in #33596
- fix(query): fix memory leak and update the caculation of cached content. by @hjxilinx in #33590
- Fix/smj 336tomainfix by @Simon9997 in #33601
- merge: from 3.3.6 to main by @guanshengliang in #33603
- docs: update the description of the automatic table creation by @guanshengliang in #33606
- Enh/add stream latency marks by @wangmm0220 in #33609
- Enh/add stream latency marks by @wangmm0220 in #33611
- Enh/add stream latency marks by @JinqingKuang in #33616
- refactor: check the rsp msg from tdgpt for white noise error. by @hjxilinx in #33608
- docs(taosgen): optimize the description and correct errors by @YamingPei in #33617
- fix/TD-38575-perf-case-fail by @cadem in #33581
- enh(stream): merge from nevados branch by @wangmm0220 in #33610
- enh: add one ci test for stable tag filter cache by @Tony2h in #33597
- merge: from 3.3.6 to main branch by @guanshengliang in #33627
- fix: [TS-7649] Fix table schema is old. by @Simon9997 in #33623
- fix: [TS-7649] Fix table schema is old. by @Simon9997 in #33621
- fix(taosBenchmark): fix disorder data count verification logic and support setting tolerance by @YamingPei in #33607
- fix: [TD-38520] Fix wrong behaviour when using TAGS in vtable query. by @Simon9997 in #33622
- fix: [TD-38520] Fix wrong behaviour when using TAGS in vtable query. by @Simon9997 in #33629
- fix: [TS-7649] Add new case to ci task. by @Simon9997 in #33630
- fix(taosBenchmark): fix failed test case test_benchmark_website by @YamingPei in #33631
- fix: needn't use pk state on ts column by @facetosea in #33571
- docs: add stream pass super table tags demo by @DuanKuanJun in #33632
- Optimize CPU usage with transaction caching by @yihaoDeng in #33604
- feat: freqs with numeric prefix are allowed, such as: 1ms, 9s by @hjxilinx in #33634
- Auto tab: from 3.3.5.0 ~ 3.3.8.0 new keyword add by @DuanKuanJun in #33612
- Feat/new-rocksdb-reader by @xiao-77 in #33637
- fix(tmq): [TS-7662] fix getting more creating table message because o… by @wangmm0220 in #33639
- merge: from 3.3.6 to main branch by @guanshengliang in #33646
- fix: stream notify has not tbName by @facetosea in #33600
- fix: checkResultsBySql query new result for each retry by @DuanKuanJun in #33640
- fix: comment failed case in win_cases.task by @tomchon in #33650
- merge: from 3.3.6 to main branch by @guanshengliang in #33649
- fix(stream): case error by @wangmm0220 in #33648
- fix: stream compatibility between 3.3.7 and 3.3.8 by @Tony2h in #33599
- fix(gpt): set correct time precision for Prophet model. by @hjxilinx in #33643
- enh(stream): optimize first/las ts interface by @wangmm0220 in #33602
- fix(tsdb): convert time precision for file set reader by @hzcheng in #33644
- fix/TD-38642-snapshot-stop-by-leader-change by @cadem in #33645
- fix/TD-38654-improve-sync-election-log by @cadem in #33656
- fix/TD-38647-fix-balance-leader-case by @cadem in #33655
- merge: from 3.3.6 to main branch by @guanshengliang in #33657
- docs(taosX): add store and forward section in datain docs by @bitcapybara in #33658
- fix(tmq): modify test case by @wangmm0220 in #33653
- docs(jdbc): jdbc release 3.7.8 by @sheyanjie-qq in #33661
- fix(stream): ignore redundant mgmt msg for trigger by @JinqingKuang in #33636
- doc: Clarify Python version requirements for TDgpt by @hjxilinx in #33668
- fix: stream mgmt request error handling issue by @dapan1121 in #33665
- enh/TD-38668-remove-incorrect-error-log by @cadem in #33667
- ci:update build matrix to remove macOS 13 by @tomchon in #33674
- fix(TS-7689): fix s3 grant update when restoring by @stephenkgu in #33670
- merge: from 3.3.6 to main branch by @guanshengliang in #33681
- Update macOS version requirement to 14.0 by @tomchon in #33678
- refactor(installer): more logging during uninstallation by @tomchon in #33680
- change 02-concept.md by @Aries-Lee1991 in #33651
- enh: enhanced C WS version information processing by @qevolg in #33683
- fix[state win]: handle end all-null blocks error by @Tony2h in #33669
- enh: make stableTagFilterCache and tagFilterCache mutually exclusive by @Tony2h in #33642
- enh(privilege): execute 'show cluster alive' irrespective of the sysinfo value by @kailixu in #33685
- add some assert in tdb by @localvar in #33684
- enh(stream): fix table not exists in processTag by @wangmm0220 in #33625
- docs: add time range expression description by @dapan1121 in #33696
- Docs/time range expr by @dapan1121 in #33699
- docs: fix kafka download link issue by @sheyanjie-qq in #33693
- enh: support restart taosd while wal corrupted. by @xiao-77 in #33618
- fix: fix the errors in doc and add some test cases. by @hjxilinx in #33677
- fix: insert blob data error using auto create table sql by @Tony2h in #33697
- fix: column name too long cause coredump by @Pengrongkun in #33686
- docs: Revise Docker guide for TDengine TSDB-Enterprise by @feici02 in #33708
- docs: update nodejs docs by @qevolg in #33707
- fix(state window): status is null if window data start with null by @Tony2h in #33679
- merge: from 3.3.6 to main branch by @guanshengliang in #33712
- enh: refactor remote command functions and add debug directory transfer by @tomchon in #33692
- feat: add moment model files to Dockerfile for full TDGpt image by @tomchon in #33652
- fix: fix faq docs links by @tomchon in #33701
- test: sleep before check status while exec compatilibility cases. by @xiao-77 in #33695
- feat(taosdump): supports retry mechanism when dumping out data by @YamingPei in #33706
- enh(test): wait revoke clause to take effect by @kailixu in #33721
- feat:add client config maxSQLLength by @Pengrongkun in #33719
- docs: update taosAdapter diable query sql configuration by @huskar-t in #33700
- fix(stream): ignore window open when trigger is recovering from checkpoint by @JinqingKuang in #33698
- docs: update subscription docs in english by @danielclow in #33447
- fix: create /etc/taos directory in run case by @tomchon in #33732
- Revert "fix: create /etc/taos directory in run case" by @guanshengliang in #33735
- docs: fix formatting and clarify notes in query documentation by @tomchon in #33718
- docs: GLIBC version required modify by @DuanKuanJun in #33730
- fix: create /etc/taos directory in run case shell by @tomchon in #33736
- merge: from 3.3.6 to main branch by @guanshengliang in #33739
- fix/TD-38741-fix-audit-case by @cadem in #33715
- fix: correct formatting and punctuation in error code documentation by @tomchon in #33750
- fix(stream): fix state window extend option in history calculation by @JinqingKuang in #33742
- merge: from 3.3.6 to main branch by @guanshengliang in #33747
- enh: fix error in optimizer for ins_tables by @Tony2h in #33725
- fix: simplify directory creation for scan result files by @tomchon in #33752
- feat: Windows installer copy dll files to driver dir by @SallyHuo-TAOS in #33258
- merge: from 3.3.6 to main by @guanshengliang in #33761
- fix(tmq): tmq_get_json_meta return null if alter stable in schemaless by @wangmm0220 in #33754
- fix(build): update Maven command to skip tests during packaging by @tomchon in #33762
Full Changelog: ver-3.3.8.4...ver-3.3.8.8