vaticle/typedb 2.28.3

TypeDB 2.28.3

on GitHub

Install & Run: https://typedb.com/docs/home/install

Download from TypeDB Package Repository:

Server only: Distributions for 2.28.3

Server + Console: Distributions for 2.28.3

New Features

Bugs Fixed

Code Refactors

Other Improvements

• Add development-mode for local and CI set ups

  We add a new server's config parameter called development-mode.enable. This parameter can be used to separate real "release" application runs from our testing.

  This parameter can influence many different sides of the server (logging settings, networking behavior?.., anything we want).development-mode.enable is an optional parameter, and the absence of it in the config is equivalent to development-mode.enable=false. It is expected to be set to true for all the config.yml files used by local environments, tests, and snapshots.

  We add a new Bazel build flag --//server:config=[development/release] that helps choose the server configuration for all the build jobs, addressing the newly added development-mode.enable option.

  Example of a release configuration build:

  bazel build --//server:config=release //server:assemble-mac-x86_64-zip
  

  Example of a development configuration build:

  bazel build //server:assemble-mac-x86_64-zip
  bazel build --//server:config=development //server:assemble-mac-x86_64-zip
  

• Update diagnostics service to version 1
  We introduce an updated version of diagnostics sent from a TypeDB server.

  1. The updated diagnostics data contains more information about the server resources and details for each separate database. More details can be found in the examples below.
  2. For the JSON reporting, we calculated diffs between the current timestamp and the sinceTimestamp (the previous hour when the data had to be sent: it's updated even if we had errors sending the data for simplicity). For the Prometheus data, we send raw counts as Prometheus calculates diffs based on its queries and expects raw diagnostics from our side.
  3. For the JSON monitoring, we show only the incrementing counters from the start of the server just as for the Prometheus diagnostics data (also available through the monitoring page). This way, the content is different from the reporting data.
  4. The schema and data diagnostics about each specific database are sent only from the primary replica of a deployment at the moment of the diagnostics collection. The connection peak values diagnostics regarding a database are still reported by a non-primary replica if the database exists or there were established transactions within the last hour before the database had been deleted.
  5. If the statistics reporting is turned off in the config, we send a totally safe part of the diagnostics data once to notify the server about the moment when the diagnostics were turned off. No user data is shared in this snapshot. This action is performed only if the server is up for 1 hour (to avoid our CI tests report data), and only if the server has not successfully sent such a snapshot after turning the statistics reporting off the last time. If there is an error in sending this snapshot, the server will try again after a restart (no extra logic here).

  Example diagnostics data for Prometheus (http://localhost:4104/metrics?format=prometheus):

  # distribution: TypeDB Core
  # version: 2.28.0
  # os: Mac OS X x86_64 14.2.1
  
  # TYPE server_resources_count gauge
  server_resources_count{kind="memoryUsedInBytes"} 68160245760
  server_resources_count{kind="memoryAvailableInBytes"} 559230976
  server_resources_count{kind="diskUsedInBytes"} 175619862528
  server_resources_count{kind="diskAvailableInBytes"} 1819598303232
  
  # TYPE typedb_schema_data_count gauge
  typedb_schema_data_count{database="212487319", kind="typeCount"} 74
  typedb_schema_data_count{database="212487319", kind="entityCount"} 2891
  typedb_schema_data_count{database="212487319", kind="relationCount"} 2466
  typedb_schema_data_count{database="212487319", kind="attributeCount"} 5832
  typedb_schema_data_count{database="212487319", kind="hasCount"} 13325
  typedb_schema_data_count{database="212487319", kind="roleCount"} 7984
  typedb_schema_data_count{database="212487319", kind="storageInBytes"} 2164793
  typedb_schema_data_count{database="212487319", kind="storageKeyCount"} 94028
  typedb_schema_data_count{database="3717486", kind="typeCount"} 5
  typedb_schema_data_count{database="3717486", kind="entityCount"} 0
  typedb_schema_data_count{database="3717486", kind="relationCount"} 0
  typedb_schema_data_count{database="3717486", kind="attributeCount"} 0
  typedb_schema_data_count{database="3717486", kind="hasCount"} 0
  typedb_schema_data_count{database="3717486", kind="roleCount"} 0
  typedb_schema_data_count{database="3717486", kind="storageInBytes"} 0
  typedb_schema_data_count{database="3717486", kind="storageKeyCount"} 0
  
  # TYPE typedb_attempted_requests_total counter
  typedb_attempted_requests_total{kind="CONNECTION_OPEN"} 4
  typedb_attempted_requests_total{kind="DATABASES_ALL"} 4
  typedb_attempted_requests_total{kind="DATABASES_GET"} 4
  typedb_attempted_requests_total{kind="SERVERS_ALL"} 4
  typedb_attempted_requests_total{database="212487319", kind="DATABASES_CONTAINS"} 2
  typedb_attempted_requests_total{database="212487319", kind="SESSION_OPEN"} 2
  typedb_attempted_requests_total{database="212487319", kind="TRANSACTION_EXECUTE"} 70
  typedb_attempted_requests_total{database="212487319", kind="SESSION_CLOSE"} 1
  typedb_attempted_requests_total{database="3717486", kind="DATABASES_CONTAINS"} 2
  typedb_attempted_requests_total{database="3717486", kind="SESSION_OPEN"} 2
  typedb_attempted_requests_total{database="3717486", kind="TRANSACTION_EXECUTE"} 54
  typedb_attempted_requests_total{database="3717486", kind="SESSION_CLOSE"} 1
  
  # TYPE typedb_successful_requests_total counter
  typedb_successful_requests_total{kind="CONNECTION_OPEN"} 4
  typedb_successful_requests_total{kind="DATABASES_ALL"} 4
  typedb_successful_requests_total{kind="DATABASES_GET"} 4
  typedb_successful_requests_total{kind="SERVERS_ALL"} 4
  typedb_successful_requests_total{kind="USER_TOKEN"} 8
  typedb_successful_requests_total{database="212487319", kind="DATABASES_CONTAINS"} 2
  typedb_successful_requests_total{database="212487319", kind="SESSION_OPEN"} 2
  typedb_successful_requests_total{database="212487319", kind="TRANSACTION_EXECUTE"} 67
  typedb_successful_requests_total{database="212487319", kind="SESSION_CLOSE"} 1
  typedb_successful_requests_total{database="3717486", kind="DATABASES_CONTAINS"} 2
  typedb_successful_requests_total{database="3717486", kind="SESSION_OPEN"} 2
  typedb_successful_requests_total{database="3717486", kind="TRANSACTION_EXECUTE"} 47
  typedb_successful_requests_total{database="3717486", kind="SESSION_CLOSE"} 1
  
  # TYPE typedb_error_total counter
  typedb_error_total{database="3717486", code="TYR03"} 5
  typedb_error_total{database="3717486", code="TXN08"} 2