The second alpha of the milestone 2.0 comes after a week of full debugging. This release is more usable and stable than the
alpha1. As there are changes in the replica catalog if upgrading from the alpha1 there will be need to do a drop_replica_schema
followed by a create_replica_schema. This will drop any existing replica and will require re adding the sources and
re initialise them with init_replica.
The full list of changes is in the CHANGELOG file. However there are few notable remarks.
There is a detailed display of the show_status command when a source is specified. In particular the number of replicated and
not replicated tables is displayed. Also if any table as been pulled out from the replica it appears on the bottom.
From this release there is an error log which saves the exception's data during the replay phase.
The error log can be queried with the new command show_errors.
A new source parameter replay_max_rows has been added to set the amount of rows to replay.
Previously the value was set by the parameter replica_batch_size. If upgrading from alpha1 you may need to add
this parameter to your existing configuration.
Finally there is a new class called pgsql_source, not yet functional though.
This class will add a very basic support for the postgres source type.
More details will come in the alpha3.
Changelog from v2.0alpha1
- Fix wrong position when determining the destination schema in read_replica_stream
- Fix wrong log position stored in the source's high watermark
- Fix wrong table inclusion/exclusion in read_replica_steam
- Add source parameter
replay_max_rowsto set the amount of rows to replay. Previously the value was set byreplica_batch_size - Fix crash when an alter table affected a table not replicated
- Fixed issue with alter table during the drop/set default for the column (thanks to psycopg2's sql.Identifier)
- add type display to source status
- Add fix for issue #33 cleanup NUL markers from the rows before trying to insert them in PostgreSQL
- Fix broken save_discarded_row
- Add more detail to show_status when specifying the source with --source
- Changed some methods to private
- ensure the match for the alter table's commands are enclosed by word boundaries
- add if exists when trying to drop the table in swap tables. previously adding a new table failed because the table wasn't there
- fix wrong drop enum type when adding a new field
- add log error for storing the errors generated during the replay
- add not functional class pgsql_source for source type pgsql
- allow
type_overrideto be empty - add show_status command for displaying the log error entries
- add separate logs for per source
- change log line formatting inspired by the super clean look in pgbackrest (thanks you guys)