What's Changed

🎉 Exciting New Features

🔔 Telegram notification

Support for setting up Telegram notification channel for alerts is now available.
Check out the doc for details

by @luthfir-rahman in #4632

🔄 Runtime variables and concurrency config in Backfills

Backfills support configuring global variables override and concurrency limit is now available.

by @dy46 in #4618

☁️ Export raw files to S3 and GCS

Using S3 and GCS data exporter templates, you can now directly upload raw files in addition to dataframes.

    bucket_name = 'test-bucket'
    object_key = 'test_file_copy.csv'

    S3.with_config(ConfigFileLoader(config_path, config_profile)).export(
        '/home/src/test_file.csv',
        bucket_name,
        object_key,
    )
    GoogleCloudStorage.with_config(ConfigFileLoader(config_path, config_profile)).export(
        '/home/src/test_file.csv',
        bucket_name,
        object_key,
    )

by @wangxiaoyou1993 in #4607

🐛 Bug Fixes

• Luthfir/discord notification by @luthfir-rahman in #4590
• [xy] Support exporting to mysql with selected columns. by @wangxiaoyou1993 in #4605
• [xy] Update the port check to use specified host. by @wangxiaoyou1993 in #4606
• [xy] Set default host when checking port. by @wangxiaoyou1993 in #4610
• [dy] Refactor duplicate git code by @dy46 in #4611
• [jk] Fix unclickable minimized windows by @johnson-mage in #4613
• [dy] Attempt to resolve network issues by @dy46 in #4620
• [jk] Fix block caching when renaming/detaching blocks by @johnson-mage in #4626
• [jk] Update tag and block cache when cloning pipeline by @johnson-mage in #4627
• [jk] Various bugfixes for pipeline search and filter by @johnson-mage in #4631
• [xy] Use milliseconds in parquet by default. by @wangxiaoyou1993 in #4634
• Fixed MongoDB reading input by @Luishfs in #4639
• Fixed random input inside singer destinations by @Luishfs in #4642
• [jk] Fix double scrollbars and draggable height by @johnson-mage in #4643
• [jk] UI bugfixes on Version Control page by @johnson-mage in #4644
• [dy] Fix unit test logging by @dy46 in #4630
• [dy] Add DB locking by @dy46 in #4629
• [jk] Bugfixes for Overview Dashboard by @johnson-mage in #4659
• [jk] Bugfix for save block shortcut by @johnson-mage in #4667
• Fixed postgreSQL reserved words by @Luishfs in #4640
• [dy] Minor workspace fixes by @dy46 in #4658
• [jk] Sync block contents for replica block when minimizing by @johnson-mage in #4672
• Incorrect spelling for the word level in documentation by @Sa1tyBiscuit in #4635

💅 Enhancements & Polish

• [xy] Support filtering google sheets by sheet names by @wangxiaoyou1993 in #4604
• [xy] Combine schedulers. by @wangxiaoyou1993 in #4614
• [xy] Separate scheduler logs and pipeline logs. by @wangxiaoyou1993 in #4621
• [xy] Update initial load of log_based replication to use incremental sync by @wangxiaoyou1993 in #4623
• [jk] Redirect to login page immediately by @johnson-mage in #4662
• [jk] Clean up chart block widths in Pipeline Editor by @johnson-mage in #4665
• [xy] Support extra connection arguments in mysql source and destination. by @wangxiaoyou1993 in #4668
• [xy] Fix image build by @wangxiaoyou1993 in #4671
• Add DEFAULT_EXECUTOR_TYPE by @danieldiamond in #4597
• [dy] Filter out sensitive config by @dy46 in #4594
• mage_ai/io MSSQL connection: add support for DATETIMEOFFSET by @hugabora in #4619
• [xy] Bump up more versions to resolve vulnerabilities. by @wangxiaoyou1993 in #4444

New Contributors

• @danieldiamond made their first contribution in #4597
• @carillpower made their first contribution in #4625
• @Sa1tyBiscuit made their first contribution in #4635

Full Changelog: 0.9.64...0.9.65