1.10.0 (2023-06-23)
Features
- add config param for batch router for name customize (#3461) (c16e692)
- error detail reporting (#3265) (34f4c0d)
- router: support for isolation modes using limiters (#3379) (fbe109f)
- warehouse: staging file schema consolidation (#3088) (b245915)
Bug Fixes
- batchrouter: batchrouter stops processing events for destinations where a destType-specific config option is set (#3421) (ee87636)
- clickhouse flaky test (#3392) (a89ef27)
- error extraction for errors in destination transformation (#3499) (5c43457)
- flag for warehouse altering (#3460) (c23ffb2)
- gateway flaky test (#3356) (b245915)
- gateway: use get method for /fetch-tables (#3528) (08cd99c)
- gw transient errors crash (#3397) (6ad51e8)
- jobsforwarder panics with slice bounds out of range (#3414) (0bda13f)
- kafka flaky batching test (#3447) (fcd49e4)
- migration fails with error pq: VACUUM cannot run inside a transaction block (#3464) (9e32802)
- regulation-worker flaky test (#3374) (b245915)
- respect user schema modification by user in warehouse (#3419) (fda4baf)
- router panics with limit for rt_pickup must be greater than 0 (#3467) (cc56b56)
- router: using wrong partition tag in limiter stats (#3518) (893504f)
- stats duplicated labels (#3411) (0bda13f)
- warehouse flaky test (#3402) (3f88f50)
- warehouse proxy endpoints (#3476) (c23ffb2)
Miscellaneous
- add missing index warehouse load files table (#3519) (9dcea7b)
- add resp body status check (#3446) (e0d7b6d)
- add support for detecting bot events in gateway (#3504) (51a4c45)
- applying 1.9.3 hotfixes to main branch (#3423) (ee1630d)
- avoid querying a dataset in case AfterJobID falls after said dataset (#3478) (f612aae)
- batch event schema messages for faster processing (#3406) (0bda13f)
- clean up warehouse indexes and queries (#3448) (7a3589a)
- cleanup for integration tests for warehouse (#3412) (3323427)
- deps: bump cloud.google.com/go/pubsub from 1.30.1 to 1.31.0 (#3399) (ef8e86c)
- deps: bump github.com/aws/aws-sdk-go from 1.44.264 to 1.44.265 (#3361) (b245915)
- deps: bump github.com/aws/aws-sdk-go from 1.44.265 to 1.44.266 (#3368) (b245915)
- deps: bump github.com/aws/aws-sdk-go from 1.44.266 to 1.44.271 (#3409) (fc48d93)
- deps: bump github.com/aws/aws-sdk-go from 1.44.271 to 1.44.275 (#3442) (8b179b6)
- deps: bump github.com/aws/aws-sdk-go from 1.44.275 to 1.44.280 (#3481) (9c0a4e7)
- deps: bump github.com/aws/aws-sdk-go from 1.44.280 to 1.44.281 (#3488) (af72e90)
- deps: bump github.com/aws/aws-sdk-go from 1.44.281 to 1.44.282 (#3494) (aa6e194)
- deps: bump github.com/databricks/databricks-sql-go from 1.2.0 to 1.3.0 (#3466) (3f187d9)
- deps: bump github.com/golang-migrate/migrate/v4 from 4.15.2 to 4.16.1 (#3441) (ef16663)
- deps: bump github.com/golang-migrate/migrate/v4 from 4.16.1 to 4.16.2 (#3480) (7465dd4)
- deps: bump github.com/hashicorp/go-retryablehttp from 0.7.2 to 0.7.4 (#3457) (b3cd0f6)
- deps: bump github.com/hashicorp/golang-lru/v2 from 2.0.2 to 2.0.3 (#3475) (74b4163)
- deps: bump github.com/minio/minio-go/v7 from 7.0.52 to 7.0.53 (#3370) (b245915)
- deps: bump github.com/minio/minio-go/v7 from 7.0.53 to 7.0.56 (#3437) (dbd9bf1)
- deps: bump github.com/onsi/ginkgo/v2 from 2.9.5 to 2.9.7 (#3449) (1af6b90)
- deps: bump github.com/onsi/ginkgo/v2 from 2.9.7 to 2.10.0 (#3458) (dacfdc8)
- deps: bump github.com/onsi/gomega from 1.27.6 to 1.27.7 (#3360) (b245915)
- deps: bump github.com/onsi/gomega from 1.27.7 to 1.27.8 (#3459) (d64c405)
- deps: bump github.com/rudderlabs/rudder-go-kit from 0.14.3 to 0.15.0 (#3473) (6eea667)
- deps: bump github.com/snowflakedb/gosnowflake from 1.6.20 to 1.6.21 (#3385) (4a06f44)
- deps: bump github.com/snowflakedb/gosnowflake from 1.6.21 to 1.6.22 (#3503) (0f9c816)
- deps: bump github.com/stretchr/testify from 1.8.2 to 1.8.3 (#3359) (b245915)
- deps: bump github.com/stretchr/testify from 1.8.3 to 1.8.4 (#3450) (f5367ed)
- deps: bump github.com/urfave/cli/v2 from 2.25.3 to 2.25.5 (#3418) (63a24eb)
- deps: bump github.com/urfave/cli/v2 from 2.25.5 to 2.25.6 (#3489) (3a00ee6)
- deps: bump golang.org/x/oauth2 from 0.8.0 to 0.9.0 (#3495) (5021989)
- deps: bump golang.org/x/sync from 0.2.0 to 0.3.0 (#3502) (f3391d7)
- deps: bump google.golang.org/api from 0.122.0 to 0.123.0 (#3362) (b245915)
- deps: bump google.golang.org/api from 0.123.0 to 0.124.0 (#3386) (da6215c)
- deps: bump google.golang.org/api from 0.124.0 to 0.125.0 (#3427) (a81b684)
- deps: bump google.golang.org/api from 0.125.0 to 0.126.0 (#3472) (0f573e4)
- deps: bump google.golang.org/api from 0.126.0 to 0.127.0 (#3487) (b525949)
- drop merged schema column (#3493) (ba797a4)
- fix flaky dedup test (#3417) (2f0a684)
- fix idle query (#3430) (3cf342d)
- gateway health endpoint should return 503 if db is down (#3351) (e22c790)
- gateway stores singular event batches (#3256) (1ccec6e)
- getUploadsToProcess error handling (#3380) (b245915)
- jobsdb max age for jobs, cleanup routine (#3420) (5025a72)
- kafka manager errors (#3465) (21487c2)
- make tests required for passing (#3347) (b245915)
- move suppression-backup-service from rudderlabs to rudderstack directory in dockerhub (#3505) (6c9b25b)
- nil check for health handler (#3500) (195e2a0)
- pass context (#3326) (990a405)
- periodically push zero output measurement for detecting stuck processing pipelines (#3453) (4116f37)
- processor: support multiple jobsdb writers when source isolation is enabled (#3428) (b25003d)
- remove deprecated merged schema field (#3482) (39a0915)
- remove namespace tag from measurements (#3468) (a6ac7bd)
- replace announcement header with data learning centre link (#3358) (b245915)
- revert drop merged schema column (#3501) (c8861ee)
- router: observability on job iterator discards & stop iteration if throttled with destination isolation enabled #3491 (66e32ad)
- router: periodic flush during pickup (#3497) (1193acc)
- set limits for event schema messages and discard messages above these limits (#3435) (b70c075)
- source transformation failures stat (#3524) (1146217)
- source transformation failures stat tag correction (#3541) (b17dec9)
- split unit tests (#3416) (471a562)
- split unit tests (#3492) (1d0c720)
- tests coverage (#3349) (b245915)
- timeout for warehouse sql queries (#3433) (ca512a0)
- upgrade golangci version and lint fixes (#3443) (3d03653)
- upgrade to badgerV4 (#3340) (3ecea32)
- using parquet-rudderlabs-go (#3490) (fbbf101)
- vaccum status tables if they cross threshold (#3434) (8d35882)