github mozilla-services/syncstorage-rs 0.24.0

2 hours ago

Refactor

  • simplify BsoQueryParam extractors (da840e1a)
  • table-drive method_tag and scope the GCS attribution note (8515c49e)
  • simplify w/ from_fn (38db116e)
  • extract and share common code between transaction_http{,_then} (#2520) (bd857e79)
  • convert BsoBodies extractor to async await (#2469) (570fe7ce)

Features

  • delete last-seen BQ rows as part of record purge (#2672) (f2154b8f)
  • write account last-seen timestamp in a BigQuery table (#2663) (a62d063e)
  • require header to confirm collection deletion, optionally (#2667) (3606b838)
  • time every request by route, method and status (8c7efa15)
  • add reconciler finalize lag and run telemetry (#2584) (59a3f131)
  • emit timing metrics for offloading (#2585) (f5331162)
  • track offloaded payload sizes in spanner (#2572) (1eac2c96)
  • update off-loaded gcs object name format (#2564) (534000a0)
  • hard limit payload reads in extractors (#2552) (b293bb56)
  • add metrics for gcs payload cleanup on failed db transactions (#2528) (6ea5e37b)
  • tag the batch commit transaction so the reconciler keeps its payloads (#2518) (6417c0be)
  • support the metadataTableName option (#2543) (a40f1a95)
  • support assuming a spanner database role in payload-link-dataflow (#2519) (e1a2314d)
  • use statsd with tags in the payload link reconciler (#2509) (de2417cb)
  • add a fine grained access role for reading the change stream (#2507) (0d4b14c3)
  • implements allow_new_users setting (#2304) (3a673696)
  • allow per collection overrides for max_request/post_bytes (#2484) (dc5afd0f)
  • upload/download to/from gcs concurrently (#2476) (37a63b73)
  • restrict gcs offload to spanner (#2471) (de108fda)
  • attempt deleting gcs objects if db transaction failed (#2460) (6835a6b7)
  • use per-collection limits in the load tester (#2461) (27785fb4)
  • add compose e2e stack for payload-link reconciliation pipeline (#2442) (b1f1891e)
  • loadtest expanded payloads (#2453) (3bfef9e6)
  • add the change stream pipeline (#2441) (8e57355f)
  • payload column nullable expanded storage (#2451) (bd52fb37)
  • add optional per-collection storage limit overrides (#2450) (48e01c2f)
  • ssdlc security scan workflow (#2445) (dc690714)
  • add payload offloading to GCS read/write paths (#2407) (a22fc76a)
  • combine dependabot PRs via github/combine-prs (#2401) (9237698c)
  • allow quota enforcement for all db backends (#2381) (d7b89112)
  • ci:
    • publish the payload-link dataflow spec to stage (#2582) (5d34b734)
    • write payload-link dataflow spec to dev on publish (#2491) (61287ddd)

Chore

Doc

Test

Bug Fixes

  • treat DELETE collection w/ empty ids as an error (05de5012)
  • backdate created_at in flaky purge test (#2635) (7477d64f)
  • ignore escaped braces and character classes in route_tag (7776fab0)
  • read the request.duration status from the rendered error response (fa3139c9)
  • bound the request.duration method tag and correct the GCS timing note (4fe35a7f)
  • don't overflow GCS custom-time (#2541) (3f0f985c)
  • SpannerIO requires the v2 runner (#2522) (ad555240)
  • stop the reconciler deleting live payload files on batch commit (#2486) (615c4ecd)
  • add explicit hamcrest dep (#2514) (68e1dd5a)
  • use beam's provided jackson-databind (#2512) (b5f9be6c)
  • auth: scope info/collections expiry exemption to its exact route (#2435) (e480bb90)
  • ci: publish payload-link spec as the dedicated tmpl-pub SA (#2516) (1b215f7d)
  • sentry: redact sensitive request header values in captured events (#2432) (8ee7d02d)
  • tokenserver: return generic description for db errors in responses (#2425) (b49c10f8)

Don't miss a new syncstorage-rs release

NewReleases is sending notifications on new releases.