github StarRocks/starrocks 4.1.2

latest releases: 4.1.8, 4.0.18, 4.0.17...
18 days ago

4.1.2

Release Date: June 18, 2026

Behavior Changes

  • Connecting to a database that the user has no privilege on now returns a proper MySQL error packet instead of closing the connection with ERROR 2013. #70072
  • SHOW FUNCTIONS now masks UDF file and object-file paths as *** for users who can see a function through function-level privileges but do not hold the create-function scope privilege. #73425
  • Ranger row filter and column masking policies are now correctly applied when querying Hive views from external catalogs. #73265
  • ALTER TABLE ... ADD COLUMN ... DEFAULT current_timestamp now correctly preserves the current_timestamp generator expression. DESCRIBE and information_schema now reflect the expression rather than the backfill-time literal. #73455
  • information_schema.loads load-time filtering no longer shifts filter bounds on clusters whose session timezone differs from UTC+8. Load times are now exchanged as UTC epoch milliseconds across the FE–BE boundary. #73365
  • The connector_max_split_size session variable now correctly applies to Paimon scan split calculation instead of always using the default value. #71756
  • pipeline_enable_large_column_checker is now enabled by default. #72798
  • Hive partition statistics are no longer refreshed automatically per key on a timer. Partition stats are now only refreshed during explicit refreshTable() calls, reducing HMS load on large partitioned tables. #73563
  • When an Iceberg or external-catalog base table undergoes schema drift (column type change, column drop, or table drop), the dependent materialized view is now marked inactive at the next refresh instead of silently producing NULL rows or opaque errors. #73770
  • The Iceberg connector now partially pushes down the convertible side of AND compound predicates instead of discarding the entire predicate when only one side is convertible, improving partition pruning and data skipping. #70293
  • Explicit-transaction COMMIT now correctly waits up to query_timeout seconds (not milliseconds) for the database write lock, preventing spurious lock-timeout failures under brief concurrent write activity. #73549
  • IVM refresh now surfaces strict-load filter errors to the caller instead of silently dropping filtered rows. #73938
  • count_combine(nullable_col) now correctly excludes NULL rows, matching COUNT(col) semantics. Incremental MVs backed by COUNT(<nullable column>) were previously materializing inflated counts. #74029
  • SHOW ALTER TABLE COLUMN now also displays asynchronous metadata-only alter jobs triggered by ALTER TABLE ... SET (...) for properties such as file_bundling and enable_persistent_index on cloud-native (shared-data) tables. #74198
  • Creating an incremental MV with a HAVING clause that references an aggregate function now fails at CREATE time with a clear error instead of producing an internal plan error on first refresh. #74054
  • IVM now supports MIN/MAX(DECIMAL) aggregate functions in incremental materialized views. #73969
  • IVM adaptive refresh now correctly bounds the delta window when the first delta trait already exceeds mv_max_rows_per_refresh, preventing the entire backlog from being refreshed in one task run. #74464
  • GROUP-BY-only incremental MVs (for example, SELECT k FROM t GROUP BY k) now correctly encode __ROW_ID__ as VARCHAR, fixing a crash on the second refresh. #74030

Improvements

  • Supports Paimon views, including CREATE/REPLACE/DROP, SHOW/DESC, and querying Paimon views from external catalogs. Table references inside Paimon views are now resolved against the Paimon catalog instead of default_catalog. #56058 #70217
  • Supports an explicit schema parameter in FILES() for stable schema control when reading files with schema drift or complex nested types. #72033
  • get_query_profile() now retrieves query profile information across all FE nodes, not only the connected FE. #71123
  • Added the query_id() built-in function, which returns the UUID of the currently executing query. #73621
  • CREATE/ALTER STORAGE VOLUME in shared-data mode now validates storage location accessibility (credentials and endpoints) before persisting metadata, failing early on misconfiguration. #70053
  • Added WebIdentity token provider support for AWS S3 credentials in BE, matching the existing FE support for AWS_S3_USE_WEB_IDENTITY_TOKEN_FILE. #69966
  • Added the ADMIN SKIP COMMITTED TRANSACTION command to unblock stuck COMMITTED transactions on shared-data tables when publish is permanently blocked by missing txnlog, lost segments, or slow remote I/O. #73553
  • information_schema.tables_config now pushes down table_name predicates to the FE, greatly reducing overhead for single-table lookups. #73210
  • Added missing MySQL 8 columns to information_schema tables to improve compatibility with BI tools and JDBC drivers that inspect MySQL 8 schemas during connection introspection. #73370
  • Added the enable_pipeline_event_scheduler BE configuration as a cluster-wide kill switch that overrides the per-session variable when set to false. #73264
  • Added opt-in wide-string column isolation for statistics collection to reduce per-query memory peaks when collecting statistics on tables with multiple wide string columns. #73258
  • Slow-lock logging now supports per-event rate limiting and configurable stack-capture controls to prevent JVM safepoint stalls under high lock contention. #73647
  • MV refresh log entries now include the database name in the prefix, making log lines distinguishable in multi-tenant deployments where the same MV name exists in multiple schemas. #73521
  • enable_profile_log FE configuration is now mutable and can be toggled at runtime via ADMIN SET FRONTEND CONFIG without an FE restart. #73894
  • Added the enable_print_load_profile_to_log FE configuration (default false) to write load profiles (stream load, routine load, broker load, and merge-commit load) to fe.profile.log, preserving them even when the in-memory store is evicted by query-profile bursts. #74150
  • SHOW ROUTINE LOAD now correctly renders column mappings in JobProperties instead of Java object references. #74199
  • CachingIcebergCatalog now uses table-level locking instead of catalog-level locking, reducing refresh serialization lag on catalogs with many concurrently active tables. #73079
  • Meta scan (background statistics collection) now handles ADD COLUMN, DROP COLUMN, RENAME COLUMN, and REORDER COLUMN schema changes gracefully instead of failing with a not-found error on post-change segment files. #72901
  • Sample-based tablet pre-split now covers multi-partition range-distribution tables and Broker Load, enabling first-load parallelism without an existing data-tier baseline. #73101 #73912 #74048
  • MySQL result serialization no longer uses per-row virtual dispatch; a typed column writer is built once per chunk, reducing serialization overhead for wide or large result sets. #66316
  • DATETIME/DATE-to-string casts now write directly to the output buffer, eliminating per-row heap allocations. #73801
  • Query statistics merge path replaced a SpinLock with a lock-free parallel map, reducing CPU usage on large clusters when workers send intermediate or final statistics. #73796
  • Aggregation hash-map and hash-set prefetch is now gated on L2-cache residency, avoiding a 4–9% regression when the bucket array fits in L2. The prefetch distance is now configurable. #73943
  • Pipelined per-segment .lcrm reads for light-compaction publish on shared-data Primary Key tables reduce sequential object-storage round-trips. #73992
  • Cold PK-index rebuild scan in shared-data mode is now parallelized across segments, reducing rebuild time when segment reads are remote-I/O bound. #74249
  • Internal queries (statistics collection, task runs, MV refreshes) are now visible in SHOW PROC '/current_queries' and can be killed with KILL QUERY. #74488
  • Added lake vacuum batch-size and retry-count bvar metrics for monitoring S3 throttling and tuning lake_vacuum_min_batch_delete_size. #74112
  • Added CatalogRecycleBin size gauge metrics to surface recycle-bin growth before it pressures FE heap. #74440
  • LIST-partitioned tables now open all partitions in OlapTableSink instead of applying the latest-N heuristic designed for range-partition tables, reducing incremental-open RPC overhead. #74099
  • Supports loading LARGE_LIST and FIXED_SIZE_LIST Arrow types into JSON columns via FILES() or Broker Load. #73714 #73718
  • Supports combined transaction log and file bundling for merge-commit (FRONTEND_STREAMING) loads on shared-data tables, aligning them with other load types. #74460
  • Added the mutable FE configuration slow_publish_partition_log_threshold_ms (default 3000 ms) to control the lake publish phase-breakdown warning threshold without an FE restart. #74043

Security

Bug Fixes

The following issues have been fixed:

  • parse_url() returned a wrong host when the URL contained : outside a host:port pattern. #63542
  • Dictionary-translated expressions incorrectly assumed f(null) = null for expressions where this does not hold (for example, IF(col = '1', NULL, 'ok')). #69376
  • Transaction stream load used the default RPC timeout instead of the user-specified timeout, causing premature timeouts. #67584
  • Iceberg equality delete files with NULL values in identity columns failed to delete matching rows because NULL = NULL evaluates to UNKNOWN in the join predicate. #67321
  • Error messages for tables with INJECTED partition-projection columns are now more descriptive, showing which columns are causing the issue. #68052
  • Queries on insert-only ACID Hive tables returned more rows than expected because insert-overwrite operations were not recognized. #71460
  • Disk cache overflowed its configured capacity when Iceberg metadata entries were pinned during concurrent reads. #71651
  • Paimon primary key columns were incorrectly marked as non-nullable when querying external catalogs. #71660
  • Optimizer timed out when MultiDistinctByMultiFuncRewriter applied the same rule repeatedly on queries with multiple ARRAY_AGG(DISTINCT <const>) inputs. #70605
  • Oracle JDBC date predicates pushed down without the DATE/TIMESTAMP keyword caused NLS format errors. #71412
  • Partition TopN could lose required output columns from its child operator. #72848
  • Unpartitioned MVs could not be created on Iceberg tables with partition evolution. #72285
  • Compaction task stats were overwritten and lost for parallel subtasks in information_schema.be_cloud_native_compactions. #72331
  • SHOW CREATE MATERIALIZED VIEW for sync MVs failed with "Table is not found". #73396
  • Lake publish multi-statement transactions deadlocked during schema change when statement .log files landed at the 4-segment path. #73423
  • Sort merge provider errors were not propagated to the fragment context, causing silent query failures. #73337
  • ConnectorTableId overflowed from int to negative values on long-running follower FEs, causing Iceberg and Hive queries to fail with misleading "Invalid table type" errors. #73344
  • ALTER TABLE with an empty optimize clause (no distribution or partition spec) was incorrectly parsed and could corrupt the table's default distribution on FE replay. #73352
  • FE startup failed during ADLS2 shared-data disaster recovery because AZURE_PATH_KEY was not recognized as a valid StorageVolumeMgr parameter. #73509
  • Avro complex-type decoding failed when the optimizer pruned part of a nested type to UNKNOWN_TYPE, or when nullable array, map, or struct schemas were used. #73474
  • COW column mutation optimization caused a crash in map_apply and similar functions due to two NullableColumns sharing the same NullColumn object. #73480
  • Iceberg tables with a custom LocationProvider failed on SELECT queries with ClassNotFoundException because the provider was eagerly instantiated on FE. #73482
  • JDBC getTable() performed an extra getTableComment() round-trip on every cache miss, extending the intensive planning-phase lock hold and blocking concurrent DDL. #73488
  • Nested MV refresh threw NullPointerException when a nested MV returned FULL or UNKNOWN timeliness. #73644
  • FE worker blocked indefinitely sending query results to a slow MySQL client. The result-send path now enforces a write timeout. #73646
  • PK .del files were not transcoded when replicating Primary Key tables from a V1-encoded (shared-nothing) to a V2-encoded (shared-data) cluster, or between two shared-data clusters. #73649 #73958
  • Duplicate replicas accumulated in TabletInvertedIndex during VERSION_INCOMPLETE recovery because the stale replica reference was not removed before adding the live one. #73661
  • Shared-data lake replication file-copy crashed the CN because REPLICATE_SNAPSHOT tasks and per-file copy sub-tasks shared the same thread pool. #73666
  • RuntimeProfileParser threw NumberFormatException when unit counters were formatted with a .000 decimal suffix by the BE. #73683
  • Physical rowid encoding for shared segments in shared-data PK tablet split was incorrect, causing wrong rss_rowid entries. #73686
  • Mixed range-colocate × hash-distributed JOIN queries returned Unknown error instead of valid results. #73702
  • TimeUtils.longToTimeString used a fixed UTC+8 formatter; output now respects the session time_zone. #73619
  • Decimal-typed columns lost scale when all values were NULL and the column passed through the nullable unary function path, corrupting downstream result types. #73789
  • JSON partial-append for nested types caused an ASAN crash. #73715
  • Privilege cache for the public role was not invalidated on GRANT/REVOKE, leaving stale privileges in effect until expiration. #73717
  • FlatJson crashed when sub-writers had no appends. #73730
  • Aggregate MV rewrite was incorrectly applied when the MV itself had a HAVING predicate, potentially returning incomplete results. #73610
  • Data race on the spill writer's auto_flush flag when entering parallel merge mode caused unintended segment flushes on ARM. #73616
  • Routine load scheduler held a per-job write lock while making blocking BE RPCs to fetch Kafka or Pulsar partition metadata, causing lock-hold times of up to 33.6 s. #73591
  • Colocate tablets on dead BEs were incorrectly reported as HEALTHY when tablet_sched_disable_colocate_balance was enabled. #73550
  • ADMIN SHOW REPLICA STATUS desynchronized the MySQL result stream when a MISSING (phantom) replica row was present, causing client hangs or disconnects. #74393
  • Per-partition coordinator claim was not re-recorded on every sender's open RPC in shared-data mode, causing some senders to be missed in the coordinator election and leaving combined_txn_log files unwritten. #73962
  • _statistics_.pipe_file_list internal table was not re-created after the _statistics_ database or table was dropped. #73970
  • Task runs force-killed by TaskCleaner were not archived, causing them to disappear from information_schema.task_runs with no trace. #74146
  • RENAME TABLE and SWAP TABLE/SWAP MATERIALIZED VIEW held only an intensive table lock instead of a database write lock, allowing concurrent readers to observe a torn intermediate name-to-table mapping. #74100
  • PK index compaction output sstables were opened without tablet metadata, causing permanent metadata is null when loading delvec failures. #74037
  • A partial-update INSERT inside an explicit transaction targeting a table already modified in the same transaction silently corrupted data at COMMIT. #74344
  • ALTER TABLE operations incompatible with range distribution (schema change, sort-key change) are now rejected with actionable errors instead of silently corrupting metadata. #74020
  • Aggregate functions with type-mismatched children in the optimizer caused incorrect query results. #74159
  • ALTER ROUTINE LOAD with a reserved-keyword table name wrote an unparseable origStmt, causing column mappings to be lost after FE restart. #74188
  • IVM state_union compatibility check did not recurse into nested types (for example, ARRAY<VARCHAR>), causing CREATE MATERIALIZED VIEW to fail for ARRAY_AGG IMVs. #73627
  • Parquet temporary dictionary-code columns leaked to upper layers when a scan range was fully filtered out, causing downstream type mismatches. #74452
  • CASE WHEN with mixed float and integer WHEN and result types produced invalid JIT IR, causing incorrect results or crashes. #74382
  • JIT compilation failure caused use-after-free of LLVMContext, resulting in SIGSEGV. #74396
  • Background statistics tasks overwrote the session WAREHOUSE setting, affecting subsequent user queries on the same connection context. #74385
  • CatalogRecycleBin stopped erasing entries when no cluster snapshot had ever completed successfully, causing unbounded FE memory growth under heavy INSERT OVERWRITE workloads. #74379
  • Non-PK replica version holes were not detected by the FE; queries were permanently routed to holed replicas with a frozen max_version. #74408
  • Data race on MaterializedIndexMeta.updateSchemaBackendId (a HashSet mutated under a shared read lock) could cause lost entries or set corruption. #74412
  • Vacuum watermark was not reported correctly when retain-boundary metadata had already been vacuumed, stalling the file_bundling switch-version cleanup. #74429
  • Lake vacuum retry used deterministic exponential backoff; decorrelated jitter is now added to spread retries across CNs under S3 throttling. #74108
  • Memory accounting in OlapTableSink was inflated because RPC requests allocated from the query memory pool were released in the process context. #73807
  • Race condition in TabletSinkSender::_send_chunk_by_node when automatic partition creation triggered _incremental_open_node_channel concurrently. #73820
  • UDAF context created by a backport of upstream changes caused a memory leak via unique_ptr::release. #74025
  • Potential out-of-bounds in partitioned join probe caused by inaccurate memory accounting in append_selective. #74315
  • azure_adls2_oauth2_client_endpoint config field had a typo in its name. #74581
  • StarMgrMetaSyncer incorrectly reaped range-colocate PACK shard groups as orphans, permanently deleting active shards in shared-data mode. #74117
  • Sort-key arity for colocate tablet split was resolved from the base schema instead of the materialized schema for PRIMARY KEY tables and tables without an explicit ORDER BY, causing split jobs to complete without reducing tablet size. #74409
  • Auto-merge daemon merged pre-split tablets back together when partition data was below the merge threshold, undoing the parallelism benefit of sample-based pre-split. #74583
  • db-level UDFs were missing on follower FEs after RESTORE ... AS <new_db> because the function's FunctionName.db still pointed at the source database. #74313
  • Wrong CN group was assigned for immutable-partition tablet locations in shared-data DISTRIBUTED BY RANDOM CTAS/INSERT when the warehouse had multiple CN groups. #74316
  • NullPointerException in StatisticsCalcUtils when a partition was dropped concurrently during statistics estimation. #73711
  • InformationSchemaDataSource and FrontendServiceImpl metadata RPC handlers held full database READ locks, blocking DDL on unrelated tables. #73936 #73913
  • Pipeline operators that flipped their finished state without notifying shared-context observers could stall peer drivers under the event scheduler. #74055 #74056
  • Non-root compound predicates in predicate pushdown yielded NotPushDown instead of a scan-level EOF, causing OlapScanNode to emit no rows when an impossible nested AND branch was present under UNION. #74218
  • BackendLoadStatistic.init performed an expensive per-replica scan on BEs with a single storage medium; the check is now O(1) for homogeneous-disk BEs. #73555
  • Thread-name setting race on data-dir load threads caused noisy failed to set thread name warnings on every BE startup. #73862
  • Task manager wrote an illegal RUNNING→RUNNING edit log, causing task runs to appear stuck in the running map indefinitely. #73882
  • PK multi-statement batch transactions did not accumulate num_rows, data_size, and num_dels across composite rowsets, causing incorrect row-count statistics on shared-data Primary Key tables. #74059
  • Lake load spill cleanup now uses txn-id-based vacuum-driven reclaim, preventing orphaned spill files after BE crash or OOM. #73064
  • PostgreSQL JDBC time values starting from year 0000 caused incorrect type mapping results. #70842
  • Null-check was missing before reading gtid from a rowset during schema change, causing an NPE crash. #74855

Don't miss a new starrocks release

NewReleases is sending notifications on new releases.