In the spirit of open-source software community, we strongly encourage you to test the new features of pgwatch2 v1.9 in your systems to help us eliminate any bugs or other issues that may exist. While we do not advise you to run pgwatch2 v1.9.0-beta in your production environments, we encourage you to find ways to run your typical application workloads against this beta release.
What's Changed
- upgrade to Go 1.17, closes #440 by @pashagolub in #441
- Grafana updated to the latest version by @yanchenko-igor in #428
- bigger upstream merge batch by @kmoppel-cognite in #431
- Prometheus mode optimization by @kmoppel-cognite in #401
- metrics: add new metrics for the upcoming Postgres v14 release. by @kmoppel-cognite in #399
- metrics: also skip tables just waiting for AccessExclusiveLock by @eshkinkot in #404
- fix file descriptors leak, fix race conditions in opening and closing database pool by @eshkinkot in #411
- gatherer: improve variable expansion in YAML configs by @kmoppel-cognite in #414
- gatherer: add a new --min-db-size-mb flag to ignore empty DBs by @kmoppel-cognite in #402
- gatherer: full redesign of connection pooling, relying on
sqlx.DBby @kmoppel-cognite in #418 - daemon: introduce a 5s connect timeout on opening Postgres connections by @kmoppel-cognite in #419
- add Aiven as a cloud provider offering managed PostgreSQL by @carobme in #421
- give possibility to add an extra container by @pmpetit in #429
- add
releaseGitHub Action by @pashagolub in #437 - fix incorrect conversion between integer types, fixes #438 by @pashagolub in #439
- add docker job to the Release workflow, closes #446 by @pashagolub in #448
- improve release action for beta versions by @pashagolub in #450
New Contributors
- @kmoppel-cognite made their first contribution in #401
- @carobme made their first contribution in #421
- @yanchenko-igor made their first contribution in #428
Full Changelog: v1.8.5...v1.9.0-beta
Changelog
- Grafana updated to the latest version e164d6f
- Improve release action for beta versions (#450) 6445187
- add v7 dashboards for influxdb af1d434
- add Dockerfile location to
build-docker-influx.sh46dab01 - use grafana 8.3.4 dd17c1e
- add v7 dashboards f101c40
- add docker job to the Release workflow, closes #446 (#448) 431ed06
- use explicit export for
psqlENV vars in smoke test script efc289e - install
libffi-devinDockerfile, fixes #444 44f7cc2 - Metrics: make reco_drop_index query more performance friendly ed06ed8
- Gatherer: improve the --no-helper-functions handling 05340b5
- install
libffi-devinDockerfile-nonroot, fixes #444 e811c20 - use
golang:1.17in all Dockerfiles f682ffb - install
libffi-devinDockerfile-nonroot, fixes #443 363f457 - use
set -aforsmoke_test_docker.shto mark variables export, fixes #442 1023f86 - use go 1.17 in go.mod and upgrade packages f2a141e
- fix incorrect conversion between integer types, fixes #438 d1026c3
- publish
pgwatch2-nonrootimage to the registry duringreleaseworkflow 859c73f - use
cpinstead ofgit archivein GHA c39d47a - update vendor info a721155
- change hooks code to be file system agnostic 205b658
- add GHA workflows 969305d
- Dashboards: add Prom "Query details" (w/o query text) 77ec67f
- "stat_statements" metric: add special 'insufficient-privileges' queryid 7b76e40
- Gatherer: allow creation of extensions / helpers also in conn. pooling mode 0b35135
- new gatherer flag / option: --try-create-listed-exts-if-missing 78c52ac
- Prom mode cache handling: clear old metric data immediately if last result gave 0 result 54a257f
- typo correction de0af87
- feat: give possibility to add an extra container 3b387a5
- Metrics: remove unnecessary sort from table_stats_approx and add to SQL 45b6e9b
- Metrics: make db_size_approx more precise - count also for Catalog TOAST 6f09209
- Daemon conn. pool handling - don't use TX if not using pools c5b9d4a
- Daemon: simplify GetDBTotalApproxSize SQL 5c9c164
- Metrics: update db_size.catalog_size_b calculation b7cc94b
- Metrics: add new 'db_size_approx' metric dbac80a
- Reroute table_stats to table_stats_approx for 1TB+ Azure Single Server daeb3de
- Gatherer: use an approximate DB size for Azure Single server d2bb16e
- Gatherer: make re-mapping of metric names work for async Prom mode 0fc9445
- New 'table_stats_approx' metric - a light version of old 'table_stats' 3bf53e5
- Gatherer: switch to explicit read only tranactions for metrics reading 6dc0489
- Gatherer: increase DB / table size fetching timeouts heavily to 5min 9bafa1e
- Metrics: add a new "major_version" column to "settings" 19e8cb7
- Gatherer: make metric fetching less disruptive by setting a short lock_timeout 3b7b628
- Add a new "Wait events" Prom dash be5a2be
- Gatherer: full redesign of connection pooling, relying on
*sqlx.DB6932b6e - Gatherer: better error messages in
DBGetPGVersion()a217aea - Preset configs: stat_ssl had been accidentally commented out b83b12a
- Prom async mode - don't emit metrics cached for more than 10min 4631997
- Metrics: fix stat_ssl to work with Prom mode bb6b4a1
- Metrics: change db_size.catalog_size_b return type to int8 bb2c88f
- add
/* pgwatch2_generated */to all metric SQLs f186fd5 - Docs: add Aiven as a cloud provider offering managed PostgreSQL b8d8b3c
wait_events metric: add alsomax_query_duration_usin addition to avg d40a0ea- add new
wait_eventsmetrics to theprometheus-asyncpreset 4ed96a3 - Metrics: add "wait_events" 58118f3
- Metrics: add "catalog_size_b" to "db_size" b69c3b5
- Preset configs: make 'prometheus-async' a bit more lightweight af0435c
- Non-async Prom mode: fix instance_state fetching for dormant DBs 8165081
- Daemon: add --no-helper-functions / PW2_NO_HELPER_FUNCTIONS parameter feda43e
- Daemon: introduce a 5s connect timeout on opening Postgres connections bd826ff
- Daemon: introduce a 5s connect timeout on opening Postgres connections 82bcb48
- New flag: --emergency-pause-triggerfile to quickly shut down collectors 6291d1d
- Conn pooling - allow setting max. conns also from ENV 331a316
- Conn pooling - reduce errors for dormant DBs feca8d2
- Correct cleaning up of conn pool + async cache when DB removed from config bf0b297
- Cleaning up conn pool when DB removed from config WIP d158db6
- Remoce custom limiting of connections and trust sqlx.DB fully 2b76022
- Avoid closing sql.DB connections as it has some internal cleverness 50c2084
- Daemon prom async mode - use also cached "instance_up" value as for 0ce1dc2
- Daemon: ignore scrape request until main loop not initialized 8edb7b0
- Docker: update daemon Go + Ubuntu base image to latest c5b70f5
- Fix a rare lock contention bug in getting DB version code 210c34d
- Add Prom "PG ver. overview" dash f02eb8f
- Gatherer: improve variable expansion in YAML configs 61e385f
- Gatherer: improve variable expansion in YAML configs 8415ef6
- Fix file descriptors leak, fix race conditions in opening and closing database pool 564b2dd
- Gatherer: protect against "DB unique" names containing ":" b370e9f
- Metrics: add new metrics for the upcoming Postgres v14 release. 268b2b6
- Remove grant for removed table 9205fd0
- Typo fix 217ebf7
- Metrics: also skip tables just waiting for AccessExclusiveLock 26d1a24
- Gatherer: make the new --min-db-size-mb flag work with Prometheus mode d8316a0
- Gatherer: add a new --min-db-size-mb flag to ignore empty DBs c2b79b5
- Prom dashboards: add handling of duplicate metric data 28e6afb
- Preset configs: make non-multiplied "prom-async" metric intervals more aggressive 4a34a8a
- Prom DB overview dash - 1 panel had fixed datasource c1af995
- Make recently added Prom dashboards handle quoted DB names 8094ca9
- Add .secrets.yaml to make gitleaksbot happy v3 dbf673c
- Add .secrets.yaml to make gitleaksbot happy v2 7babc90
- Add .secrets.yaml to make gitleaksbot happy 89783c4
- New Prom dashes - minor corrections 1b51a7f
- Prom: add "Tables top" dash 6625cac
- Prom v7 dashes: minor corrections 1dd424a
- Tag recently added Prom dashes with pgwatch2 + postgres f211eab
- Add "Sessions overview" Prom dash 5401494
- Add title.txt files for recently added Prom dashboards 7304104
- Add Prom "DB overview" dash re-worked for Grafana v7 2a8b580
- New Prom "Table details" dash 283adb4
- Preset configs: add a new "prometheus-async" preset to feed the new Prom Health-check dash 8a737d5
- New Prom "Health-chech" dash to cover most imprtant KPI-s 600be84
- Prom mode: WARN -> INFO for "change_events" skipping messages de6c084
- Prom async mode: avoid unnecessary memory hogging, drop cache if instance removed from config fa321c5
- Prom: introduce a new flag for optional "async" mode, i.e. background collection 11ecf2f
- v14 metrics: another correction on pg_wal_stats.wal_bytes handling 0c661d4
- v14 metrics: retain "byte" precision of pg_wal_stats.wal_bytes 04bb6d7
- Metrics: add new metrics for the upcoming Postgres v14 release. 8ef5bf4
- Docs: mention that "systemd-escape" can be used for specifying connect strings 70cf1c5
- Docs: document Prometheus scraping under advanced features d26a7f0
- Gatherer server log parsing: don't show warnings for "C" collation 72fd630
- Gatherer: fix a Prometheus mode bug when "instance_up" metric was explicitly specified 5c29bc9
- Gatherer Prometheus mode: fill stats port "secondsFromLastSuccessfulDatastoreWrite" field 04d1080
- Docs: list also the missing "patroni-namespace-discovery" DB type 2bca437
- Sample YAML config - list all supported "DB types" in comments 8ae8929
- Docker: sync Web UI Dockerfile with the main images e521a05
- Docker: pip install pyyaml to be able to use rollout_helper.py out of the box 94d43c2
- Gatherer: default values for DBtype and Port attributes in YAML configs 0a0c871
- Gatherer: Go modules update 3fe206d
- Docker: add also the "db-bootstrapper" image to the build set e5a1aa3
- Update v1.8.5 CHANGELOG about metric schema update when using an old TimescaleDB setup ba7bdc5
- Gatherer: make UniqueDbnamesListingMaintainer more passive 8b17b92
- Update new "Sessions overview" screenshot bd97b48
- Another Goreleaser correction: SQL schema not considered as "config" a38ec22
- Goreleaser building: restore some missing files b39dfdf
- Goreleaser: fix config file deprecation notices 1cf014b
- Docker test: increase smoke test wait delays 4264897