1.6.0-rc.6 (2023-02-22)
Features
- adaptive payload size limits (#2949) (fbfd845)
- add webhook source error logging (#2958) (042d9b3)
- filter events based on destination consent management rules (#2973) (47a12bd)
- introduce upload id to associate staging files to uploads (#2908) (d127a82)
- processor: add support for workspace-level isolation (#2891) (e8dfff3)
- warehouse: added use rudder storage option to deltalake (#2929) (6885ba1)
- warehouse: clickhouse s3 table engine for load tables (#2739) (074e789)
- warehouse: databricks unity catalog (#2878) (074e789)
- warehouse: error tagging (#2956) (3131b96)
- warehouse: glue partitions (#2899) (9a928d4)
Bug Fixes
- adding throttling stats in router (#2923) (61109e2)
- adding throttling stats in router (#2923) (5a36692)
- create index concurrently cannot run inside a transaction block (#3008) (a9f0192)
- handle NULL on upload timings (#2967) (58381db)
- limit entire transformationStatus struct when caching them (#2928) (2283aef)
- move recovery from scheduler to upload (#2959) (df7a491)
- processor read of dest consent categories (#3028) (c83582c)
- router: wrong job order keys used in batching job order logic (#3019) (e9314cf)
- suppression syncer using wrong credentials in multi-tenant mode (#2936) (0eb3abb)
- upload missing metric (#2947) (b1fc5ee)
- warehouse: added check for nil warehouse manager during error mapping (#2981) (a258f74)
- warehouse: consolidaiton for merged schema to give preference for text datatype (#2983) (b262f1d)
- warehouse: deltalake client crashing when failing on connectionstep (#2961) (3373144)
- warehouse: fix db migration to add upload_id to wh_staging_files… (#2948) (7fa1c9e)
- warehouse: fix upload error and add additional logs (#2972) (d1d2338)
- warehouse: redshift dedup window (#3013) (1dbe505)
- warehouse: skipping deprecated columns (#3000) (82a35d6)
- warehouse: use single protocol source category while doing dedup for new record (#2937) (c46ba75)
- warehouse: warehouse successful upload exists (#2931) (c46ba75)
- warehouse: warehouse validations fixed to lookup secrets using sshKeyId (#2950) (017d8ba)
Miscellaneous
- add workspace id in wh_async_jobs table (#2848) (074e789)
- capture cgroup-aware memory stats (#2945) (4e6cf3b)
- decouple loadfile logic and repo (#2753) (074e789)
- dedup destination metadata in router based on job id (#2982) (dfc2273)
- deps: bump github.com/gofrs/uuid from 4.2.0+incompatible to 4.4.0+incompatible (#2906) (e8ecf32)
- deps: bump github.com/samber/lo from 1.35.0 to 1.37.0 (#2913) (6718048)
- drop column only if exists (#2979) (03e7390)
- enhance data sent to reporting (#2914) (c58100c)
- introduce stat for skip upload syncs (#2938) (b1fc5ee)
- jobsdb: support query filtering by workspaceID (#2911) (d049f2b)
- make GC discard ratio configurable (#3023) (0801818)
- processor: stop using global variables (#2881) (074e789)
- protect measurement & tag names from empty strings (#2946) (f20a6f3)
- refactored gateway marshalling (#2915) (2625f1a)
- remove gorate throttling algorithm (#2918) (772187a)
- remove reports down migrations (#2920) (2fa72d6)
- replace readme v1 announcement header (#2893) (074e789)
- staging files to uploads (#2863) (692f55c)
- tunable badgerDB config params (#3027) (0742fd7)
- use a partition lock when updating badger live events cache (#2902) (a4d1a71)
- use badgerdb for live events cache (#2833) (074e789)
- use gauge for capturing pending events (#2960) (169ab96)
- warehouse: alter handling for redshift (#2888) (e1918c1)
- warehouse: filemanager nil fix for validations (#2986) (306d55b)
- warehouse: log improvements for total count in warehouse integrations (#2976) (994c89b)
- warehouse: move warehouse destinations to integrations package (#2885) (074e789)
- warehouse: remove unused stats from deltalake integration (#2977) (d8639ee)
- warehouse: use warn while getting total count in warehouse (#2944) (4f225f5)
- warmup gcra algorithms in throttling test (#2909) (2754027)