feat: mysql2json import/export tool #2
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
new tool that allows quickly export and import data without modifying database structure feat(config): created JSONSchema for configuration files it allows to show nice errors messages for each incorrect value and defines defaults for configuration feat(config): added `includeTables` and `excludeTables` rules it is possible to define various table matching rules for the tool feat(config): added `concurrency` settings it is possible to control number of processes to use for parallel export/import feat(config): added `batchSize` setting it is possible to specify in configuration how many rows to import per batch feat(config): added `importMode` setting of `truncate` and `update` it is possible to specify if import replaces table completely or update current rows in it feat(command): added `mysql2jsonl export` command it exports data into JSONL file into desired directory with possibility to override concurrency feat(command): added `mysql2jsonl import` command it imports data form directory with JSONL files with possibility to override both concurrency and batch size feat(build): added Phar version to release pipeline it is possible to download now phar file with the tool, without installing it via composer
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
new tool that allows quickly export and import data without modifying database structure
feat(config): created JSONSchema for configuration files
it allows to show nice errors messages for each incorrect value and defines defaults for configuration
feat(config): added
includeTablesandexcludeTablesrulesit is possible to define various table matching rules for the tool
feat(config): added
concurrencysettingsit is possible to control number of processes to use for parallel export/import
feat(config): added
batchSizesettingit is possible to specify in configuration how many rows to import per batch
feat(config): added
importModesetting oftruncateandupdateit is possible to specify if import replaces table completely or update current rows in it
feat(command): added
mysql2jsonl exportcommandit exports data into JSONL file into desired directory with possibility to override concurrency
feat(command): added
mysql2jsonl importcommandit imports data form directory with JSONL files with possibility to override both concurrency and batch size
feat(build): added Phar version to release pipeline
it is possible to download now phar file with the tool, without installing it via composer