Sling v1.2.19 (2024-09-22T20:03:08Z)

Summary of Changes

Configuration and Templates

• Updated various database templates (e.g., Azure SQL, BigQuery, Clickhouse, DuckDB, MariaDB, MySQL, Oracle, Postgres, Redshift, Snowflake, SQLite, SQL Server, StarRocks, Trino) to include:

  • Added schema_name and is_view columns to table and view queries
  • Modified queries to support optional schema filtering
  • Standardized ordering of results

• Updated DuckDB template:

  • Added stream scanner functions for various file formats
  • Added timestamp layout variables

• Updated Motherduck template:

  • Added scan functions for Iceberg, Delta, and Parquet formats

Core Functionality

• Enhanced environment variable handling in env.go
• Improved error handling and panic recovery in config unmarshalling
• Added support for SQL-based streaming in file sources
• Enhanced incremental value handling for database sources
• Improved wildcard processing for replication configs
• Added dataset output option for file targets

Build and CI Scripts

• Added connection discovery step to build scripts
• Created new preparation scripts for Linux, macOS, and Windows

Testing

• Updated test scripts to use a centralized CLI test

Dependencies

• Updated various Go module dependencies