1.7.0-rc.1 (2023-03-16)
Features
- default retention period set to 7 days for rudder backups (#3038) (0d9af35)
- gateway: support new event type extract (#2999) (63dc940)
- kafka over ssh (#3007) (99262c3)
- warehouse: added duplicates stats for snowflake (#3097) (0eeaeb5)
- warehouse: snowflake roles support. (#3031) (98a413c)
- warehouse: temp table support for postgres (#2964) (9a80f45)
Bug Fixes
- enabled data race (#3041) (7136be4)
- inconsistent and leaky retry delay logic in router (#3002) (20c8644)
- kafka create topic (#3102) (10ccbf3)
- limiter deadlock while trying to notify a dynamic priority item (#3056) (ade2e4d)
- payload limiter gauge reports invalid value type (#3048) (828f70d)
- pending events all (#3075) (1d9f63b)
- router: retry backoff causing out-of-order job processing (#3098) (eda4525)
- user/anonymous id read at gateway (#3051) (828f70d)
- warehouse: added support for filtering on the uploads and calculating aborted events for task_run_id (#2975) (8ab58b8)
- warehouse: grouping uploads for processing pickup (#3039) (4832630)
- warehouse: infinites retries (#3050) (d3320fa)
- warehouse: snowflake default timestamp to timestamp with time zone (#3100) (cef4a18)
Miscellaneous
- abort job after 5 attempts at deletion-worker (#3012) (ed83eaa)
- add live events stats (#2930) (7ca1b0b)
- add transformations challenge announcement (#3072) (f128b93)
- badgerDB improvements for debugger (#3101) (0c525d0)
- debugger's badgerdb cache optimisations (#3042) (e6e9933)
- deps: bump github.com/minio/minio-go/v7 from 7.0.48 to 7.0.49 (#3018) (f4ea7b3)
- deps: bump github.com/onsi/ginkgo/v2 from 2.1.6 to 2.9.0 (#3068) (6bdbb7a)
- deps: bump github.com/prometheus/common from 0.37.0 to 0.41.0 (#3062) (bb04a8b)
- deps: bump github.com/urfave/cli/v2 from 2.20.3 to 2.25.0 (#3067) (6b429b7)
- deps: bump go.uber.org/goleak from 1.2.0 to 1.2.1 (#3017) (2eb92ca)
- don't include prereleases in docker latest tag (#3006) (20c8644)
- enable pipeline level sync frequency (#3094) (ea3bbd5)
- improve regulation-worker status capture (#2837) (6f1d07d)
- increase parallel loads (#3073) (7dcc756)
- jobsdb: omit workspaceId tag when it doesn't correspond to an actual workspace (#3057) (f936260)
- migrate stats to otel (#2989) (a4243de)
- perform rss/wss-aware cgroups memory usage calculation (#3052) (1b6af85)
- prefer using lo.BufferWithTimeout (#2998) (20c8644)
- reduce parquet file size datalake (#3035) (4cb5907)
- remove workerID tag (#3055) (b732919)
- upgrade all dependencies (#2996) (20c8644)
- use gcra rate limiter gateway (#3086) (61d9275)
- use official bitnami images for arm64 (#3047) (3aeb4f6)
- use token on protoc setup to avoid rate-limit (#3083) (0f89b26)
- use upload_id for staging files (#3066) (3ec2433)
- warehouse: added support for observability for loading tables and made dedup optional for Redshift (#3037) (63fd288)
- warehouse: added warehouse handling for s3 with glue and other improvements (#2940) (3495797)
- warehouse: additional error mappings (#2994) (20c8644)
- warehouse: allow empty properties schema for event models (#3095) (b9deb4a)
- warehouse: default warehouse priority set to 100 (#3026) (20c8644)
- warehouse: encoding package with readers, loaders, writers (#3077) (06c0a71)
- warehouse: naming conventions (#3076) (f2e99c7)
- warehouse: use first_event_at while pickup for warehouse processing jobs (#3036) (7aeed3b)
- warehouse: warehouse integration tests improvements (#3059) (e57362e)