1.8.0-rc.4 (2023-05-09)
Features
- databricks compatible go driver (#3148) (7660520)
- destination: support event filtering in a scalable way for hybrid & cloud modes (#3188) (2c2c0e1)
- embed avro schema id (#3118) (8c98631)
- kafka compression (#3179) (acb3918)
- modifed kafka to use config received from config-be. (#3205) (0d1c75f)
- processor: enhance reports to hold transformation and tracking plan metrics (#3138) (865ad6c)
- processor: forward events to new events-schema jobsDB (#3201) (5a69ce9)
- router: limit number of jobs with the same ordering key in worker's queue (#3243) (ed5722d)
- rudder-server modification to use suppression-backup service. (#3116) (daf3e26)
- schema forwarder (#3146) (9accebf)
- source level isolation at processor (#3187) (a3f687e)
- suppression backup service (#2910) (5b68307)
- update transformer image to rudderstack org (#3115) (8f74bbb)
- warehouse: middleware for sql warehouse integrations queries (#3190) (85f064a)
- warehouse: warehouse schema repository (#3087) (7becd87)
Bug Fixes
- add externalID to S3 file uploader config (#3153) (d7ac3a8)
- add mandatory env for shopify oss (#3227) (460890d)
- add numeric scale precision to snowflake (#3239) (ef127ef)
- controller conn (#3142) (f65a67a)
- error messages map !initialized in gateway (#3191) (03cd911)
- identity tables load files are not generated (0aab933)
- illegal job order with maxRetriesLimitReached (#3163) (f328e43)
- kafka with CP admin client (#3297) (c9fcb8c)
- no need for setup during warehouse crash recovery (#3203) (1f7d542)
- postgres support for loading users and identifies in same transactions (#3237) (2c3697a)
- redshift staging table creation (#3180) (8ec737d)
- remove logging in messages potentially leaking creds (#3195) (04a31a0)
- roleBasedAuth parameter wasn't being set correctly (#3134) (c2f6dd8)
- stash loop is not sleeping even though query limits are not being reached (#3291) (5a0947e)
- stats come first (#3159) (c7210fa)
- update lo to slices in eventfilter package (#3238) (0a91574)
- warehouse: all staging files processing failed (#3137) (9dc4b8f)
- warehouse: table uploads were not getting updated (6dec777)
Miscellaneous
- access denied for s3 datalake (#3186) (29c818a)
- add metrics for file sizes for badgerDB (#3092) (f659b49)
- add sql middleware to for warehouse (#3212) (b8bc531)
- added postgres legacy and new implementation tests (#3216) (e22428c)
- added threshold for commit for sqlwrapper (#3273) (a4f3b56)
- added transactions to sqlquerywrapper (#3231) (bba4894)
- adding BeginTx to sqlwrapper (#3260) (d4b30d6)
- addressing snyk vulnerabilities (#3224) (9f5dc99)
- bigquery query rate limited (#3185) (60437df)
- bq column count error mappings (#3184) (0b47f65)
- bump github.com/rudderlabs/sql-tunnels from 0.1.2 to 0.1.3 (#3225) (698fe5e)
- bump kafka-go and gosnowflake (#3217) (1b4698e)
- change stash defaults (#3136) (e2f019d)
- cleanup of unnecessary connection-tester (#3208) (4204f7a)
- cleanup warehouse handlers (#3211) (f65f0e7)
- deltalake parquet support (#3135) (f54b9fd)
- deps: bump cloud.google.com/go/bigquery from 1.46.0 to 1.50.0 (#3171) (07cde26)
- deps: bump cloud.google.com/go/pubsub from 1.30.0 to 1.30.1 (#3277) (c9d12c1)
- deps: bump github.com/aws/aws-sdk-go from 1.44.245 to 1.44.246 (#3229) (cae0093)
- deps: bump github.com/aws/aws-sdk-go from 1.44.246 to 1.44.252 (#3254) (42ee1b5)
- deps: bump github.com/aws/aws-sdk-go from 1.44.252 to 1.44.253 (#3258) (be1fef9)
- deps: bump github.com/aws/aws-sdk-go from 1.44.253 to 1.44.254 (#3261) (0f87463)
- deps: bump github.com/aws/aws-sdk-go from 1.44.254 to 1.44.256 (#3276) (804ec2c)
- deps: bump github.com/databricks/databricks-sql-go from 1.1.0 to 1.2.0 (#3234) (7b7cfe7)
- deps: bump github.com/docker/docker from 20.10.21+incompatible to 23.0.3+incompatible (#3167) (0600834)
- deps: bump github.com/lib/pq from 1.10.8 to 1.10.9 (#3247) (15baff9)
- deps: bump github.com/onsi/ginkgo/v2 from 2.9.2 to 2.9.4 (#3278) (114f710)
- deps: bump github.com/onsi/gomega from 1.27.1 to 1.27.6 (#3213) (48e6913)
- deps: bump github.com/opencontainers/runc from 1.1.4 to 1.1.5 (#3140) (e3bd948)
- deps: bump github.com/rudderlabs/sql-tunnels from 0.1.2 to 0.1.3 (698fe5e)
- deps: bump github.com/samber/lo from 1.37.0 to 1.38.1 (#3194) (d66b63f)
- deps: bump github.com/shirou/gopsutil/v3 from 3.23.1 to 3.23.3 (#3170) (e9bb277)
- deps: bump github.com/shirou/gopsutil/v3 from 3.23.3 to 3.23.4 (#3259) (4eb3a64)
- deps: bump github.com/stretchr/testify from 1.8.1 to 1.8.2 (#3082) (109b652)
- deps: bump github.com/urfave/cli/v2 from 2.25.1 to 2.25.3 (#3262) (b1bab9a)
- deps: bump go.uber.org/automaxprocs from 1.5.1 to 1.5.2 (#3193) (833a4f7)
- deps: bump golang.org/x/oauth2 from 0.6.0 to 0.7.0 (#3196) (10b62ea)
- deps: bump google.golang.org/api from 0.110.0 to 0.116.0 (#3177) (4227912)
- deps: bump google.golang.org/api from 0.118.0 to 0.120.0 (#3246) (a05ae14)
- disable KeepAlives by default in transformer HTTP clients (#3147) (6c308c4)
- enable backoff when event ordering is disabled (#3121) (bbc14c1)
- enable setting of
embedAvroSchemaIDfrom config (#3282) (e2d729d) - error enrichment for redshift (#3182) (3e8a962)
- fix deadlock issue uploader (#3272) (71b5ac8)
- fix typecast panic (#3269) (e0280e4)
- improve pending events api (#3253) (3704619)
- initiate db handle warehouse slave (#3270) (bb897b4)
- kafka batching (#3151) (cdbbc7f)
- kit v0.12.0 (#3209) (1475ece)
- lock bitnami test image versions (#3232) (7087f63)
- otel buckets (#3120) (803ac03)
- refactor regulation worker integration test (#3230) (381ca72)
- remove global pkglogger from warehouse integrations (#3202) (1211e51)
- remove jobsdb status handler (#3192) (73c295a)
- remove readonlyjobsdb and some status handlers (#3168) (7d82354)
- replace readme header link with slack link (#3183) (db9fdc5)
- restore sample configuration files (#3122) (0ac3a6e)
- router: don't include job in metadata during transformation requests (#3111) (d2910d2)
- router: skip full workers during the generator loop (#3206) (bed02f7)
- start server in normal mode when there is no instruction by scheduler (#3103) (bad6a82)
- stop warehouse panics (#3105) (7becd87)
- updating error mappings (#3150) (0851cb9)
- upgrade direct dependencies (#3223) (309727d)
- upgrading workflow to use action v3. (#3164) (f7cf6c9)
- use rudder-go-kit (#3104) (7becd87)
- use the common PAT for release-please (#3204) (14e3b91)
- warehouse: cleanup for test connection (#3226) (51c1ac0)
- warehouse: snowflake application identifier (#3124) (cdff792)