rudderlabs/rudder-server v1.20.0-rc.1 on GitHub

1.20.0-rc.1 (2024-02-09)

Features

add 'config' field to proxy request (#4264) (1c3fb01)
add 'config' field to proxy request for v0 (#4352) (4fdd81c)
add destinationID to rETL endpoint (#4234) (2c02dc2)
add support for regulation from features.json (#4304) (3c2fcf6)
add version deprecation error-code identification logic (#3995) (866393d)
added sprig in supportedDestionations for user deletion (#4285) (e3b8018)
adding sourceId and destinationId in pipeline info metrics (#4332) (6c1f1c4)
filter destinations for events from rETL in processor (#4247) (2b82920)
lower retry limits(fail-fast) for sources jobs in batchrouter (#4310) (d7cbc8c)
support for adaptive rate limiting [PIPE-481] (#4160) (40586e5)
tracing support for gateway, processor and router (#4248) (7dc7747)
update error table with new columns (#4356) (b8b5527)
warehouse append vs merge (#4139) (40586e5)

Bug Fixes

adapt connection timeout for sql for redshift (#4253) (1ff6f90)
adaptiveWindow default value should be more than 0 (#4312) (5108d45)
add wait for get supported destinations in regulation worker (#4311) (cfed04a)
batchrouter async dest pending event counts aren't being decreased (#4346) (5d78ab6)
bigquery job statistics for rate limit (#4272) (9842f64)
changing eventNames longer than configured max length to ":max-length-exceeded:" before sending to reporting (#4244) (719396f)
ci: fix distpatch event action typo (#4252) (1057ee1)
exhaust error index jobs when work is called (#4295) (b7b75ad)
gateway stat tags when source is disabled (#4215) (85235bb)
handle consent management configuration fallback for gcm (#4355) (7e47ee9)
ignore destinationID in gateway rsources.statCollector (#4299) (eece12b)
ignore gwJobs' destinationID in processor rsources.statCollector (#4321) (ec91612)
ignore gwJobs' destinationID in processor rsources.statCollector (#4321) (5276978)
jobs not draining as fast as we'd like because of rate-limiting etc. (#4327) (bc755cf)
marketo bulk upload's upload url preparation fix (#4358) (f6396f9)
nil load statistics for bigquery (#4328) (ec91612)
processor: duplicate rsources out stats can be recorded in case of a retry due to an operation timeout (#4223) (a7c373a)
pubsub channel not closing during close if no value has been published (#4269) (ab0e0d9)
return only the latest namespace entry when fetching tables from warehouse (#4287) (8f1e6b1)
server panics during shutdown with reporting metrics: failed to store jobs: context canceled (#4228) (68e52d5)

Miscellaneous

adapt rudder-go-kit v0.19.0 changes (#4227) (08c0864)
add env to enable throttlerV2 (#4313) (139d46e)
add tests for aiokafka consumer (#4372) (db9b6d9)
additional error mappings for deltalake (#4265) (35cc8e9)
autofix corrupted job-status stats (#4224) (781f24f)
backend config calls metric (#4306) (b03aaba)
backend config response size metric (#4309) (2fbf4c5)
change the max limit to take multiplier of the existing limits (#4263) (7c4cc03)
ci: automated deployment (875cc54)
custom buckets for gw request size (#4275) (6466a9b)
deps: bump actions/download-artifact from 3 to 4 (#4240) (d8d980d)
deps: bump actions/labeler from 4 to 5 (#4192) (21c5fab)
deps: bump actions/setup-go from 4 to 5 (#4212) (c306dff)
deps: bump actions/stale from 8 to 9 (#4216) (6f88c3f)
deps: bump actions/upload-artifact from 3 to 4 (#4239) (426d3bf)
deps: bump arduino/setup-protoc from 2 to 3 (#4363) (b0498bf)
deps: bump cloud.google.com/go/bigquery from 1.58.0 to 1.59.0 (#4374) (e6d59d0)
deps: bump cloud.google.com/go/pubsub from 1.36.0 to 1.36.1 (#4369) (2a2ac89)
deps: bump cloud.google.com/go/storage from 1.34.1 to 1.36.0 (#4236) (db00c39)
deps: bump codecov/codecov-action from 3 to 4 (#4362) (e8ec845)
deps: bump github.com/aws/aws-sdk-go from 1.48.11 to 1.49.15 (#4283) (78a64d3)
deps: bump github.com/aws/aws-sdk-go from 1.49.15 to 1.49.17 (#4294) (3088bba)
deps: bump github.com/aws/aws-sdk-go from 1.49.21 to 1.50.0 (#4341) (8f63eb8)
deps: bump github.com/aws/aws-sdk-go from 1.50.10 to 1.50.13 (#4378) (49e1573)
deps: bump github.com/aws/aws-sdk-go from 1.50.6 to 1.50.10 (#4365) (cf531a4)
deps: bump github.com/DATA-DOG/go-sqlmock from 1.5.0 to 1.5.2 (#4301) (709d348)
deps: bump github.com/DATA-DOG/go-sqlmock from 1.5.0 to 1.5.2 (#4301) (e4e643c)
deps: bump github.com/dvsekhvalnov/jose2go from 1.5.0 to 1.6.0 (#4260) (bfa407f)
deps: bump github.com/go-chi/chi/v5 from 5.0.10 to 5.0.11 (#4303) (709d348)
deps: bump github.com/go-chi/chi/v5 from 5.0.10 to 5.0.11 (#4303) (0771999)
deps: bump github.com/golang-migrate/migrate/v4 from 4.16.2 to 4.17.0 (#4302) (85e7497)
deps: bump github.com/grpc-ecosystem/grpc-gateway/v2 from 2.18.1 to 2.19.0 (#4336) (977c4b7)
deps: bump github.com/marcboeker/go-duckdb from 1.5.1 to 1.5.6 (#4277) (854242c)
deps: bump github.com/mkmik/multierror from 0.3.0 to 0.4.0 (#4276) (47a2d14)
deps: bump github.com/onsi/ginkgo/v2 from 2.13.2 to 2.15.0 (#4345) (68adbe8)
deps: bump github.com/onsi/gomega from 1.30.0 to 1.31.1 (#4348) (46aea35)
deps: bump github.com/redis/go-redis/v9 from 9.3.0 to 9.4.0 (#4292) (5bdc43c)
deps: bump github.com/rudderlabs/bing-ads-go-sdk from 0.2.0 to 0.2.1 (#4339) (a831c13)
deps: bump github.com/rudderlabs/rudder-go-kit from 0.19.0 to 0.19.1 (#4338) (7d270e3)
deps: bump github.com/samber/lo from 1.38.1 to 1.39.0 (#4320) (6e4812f)
deps: bump github.com/segmentio/kafka-go from 0.4.44 to 0.4.47 (#4343) (0452e5b)
deps: bump github.com/snowflakedb/gosnowflake from 1.6.25 to 1.7.0 (#4190) (40586e5)
deps: bump github.com/snowflakedb/gosnowflake from 1.6.25 to 1.7.0 (#4190) (2072e2e)
deps: bump github.com/snowflakedb/gosnowflake from 1.7.0 to 1.7.1 (#4300) (cad4c62)
deps: bump github.com/spf13/cast from 1.5.1 to 1.6.0 (#4191) (8aa4294)
deps: bump github.com/urfave/cli/v2 from 2.25.7 to 2.27.1 (#4318) (763fbb8)
deps: bump go.etcd.io/etcd/api/v3 from 3.5.11 to 3.5.12 (#4367) (f39b729)
deps: bump go.etcd.io/etcd/client/v3 from 3.5.10 to 3.5.11 (#4254) (c1758a6)
deps: bump go.etcd.io/etcd/client/v3 from 3.5.11 to 3.5.12 (#4368) (f233fdb)
deps: bump golang.org/x/oauth2 from 0.15.0 to 0.16.0 (#4319) (2eb816b)
deps: bump golang.org/x/sync from 0.5.0 to 0.6.0 (#4291) (266fb11)
deps: bump google.golang.org/api from 0.153.0 to 0.155.0 (#4282) (3ecc0a6)
deps: bump google.golang.org/api from 0.156.0 to 0.157.0 (#4342) (e1789a5)
deps: bump google.golang.org/api from 0.160.0 to 0.161.0 (#4366) (c26be5e)
deps: bump peter-evans/repository-dispatch from 2 to 3 (#4354) (6cb46c5)
enabling gateway to ingest events even when sharedDB is down (#4262) (bd365b5)
error index file path collision (#4297) (37b2e35)
fix code cov breaking change (#4379) (26d4729)
fix flaky test for tables for connections from wh schemas as ordering for tables can be different (#4307) (ac2e155)
flaky docker test (#4286) (b928bfe)
flaky oauth test (#4280) (d078c93)
improve error logging (#4288) (9cb9caf)
improve error logs during jobsdb backup table test (#4308) (aea58d7)
improve error logs during jobsdb backup table test: (aea58d7)
improve error logs during processor stash test (#4317) (709d348)
improve error logs during processor stash test (#4317) (a09f39f)
improve error logs during processor stash test: (a09f39f)
include the component in application_name of postgres connection (#4225) (dcf73f0)
integration test for rETL flow (#4324) (3a41222)
reduce cardinality of warehouse metrics (#4364) (95553f2)
remove events schemas v1 (#3923) (40586e5)
remove events schemas v1 (#3923) (14466dc)
remove namespace tag from error_detail_reporting_failures metric (#4305) (6c2d900)
revert update error table with new columns (#4380) (ed22a74)
set container and account name for load file does not exist test for databricks (#4361) (1ff9432)
source category set to event stream as default (#4226) (af82a6f)
support concurrent addition of failed keys for the same target (#4241) (95ff5ae)
tune shared db connection pooling (#4213) (cfe458a)
upgrade 'pinned' go package versions (#4270) (befbc96)
upgrade sql tunnels to v0.1.6 (#4296) (47dc055)
use local db in rsources handler for verifying job completed status (#4245) (d53aa80)
using new kit kafka client and docker resources (#4350) (f5d8de3)