Add plumbing command for manually creating commit

[nicktobey]

dolt admin createchunk is a set of undocumented commands for manually writing chunks into the chunkstore. They're a useful tool for writing tests, fixing repos that somehow get into an unexpected state, and hacking on Dolt in ways that the higher-level commands don't support.

dolt admin createchunk commit is the first such command; it creates a commit chunk and prints the new commit hash to standard output.

I picked createchunk committo implement first because it already has utility: it can be used to flatten commit history. Dolt already allows flattening commit history via dolt rebase, but this method introduces a lot of overhead: it walks the commit history to build the rebase table, then walks it again to apply the rebase. For large histories (the kind of histories you might want to squash to save space), this is unacceptably slow.

With this command, flattening a history can be done with dolt admin createchunk commit --root "$rootValueHash" --desc "flattened history" --parents "refs/internal/create" --branch "$branchname" --force

The --branch flag causes the named branch to point to the newly created commit. This flag is mandatory when using the CLI, because the chunk journal is required to end with a root hash and chunks are only flushed to the chunk journal when there's a new root hash.

[coffeegoddd]

@nicktobey DOLT

comparing_percentages
100.000000 to 100.000000

version	result	total
b18122e	ok	5937457

version	total_tests
b18122e	5937457

correctness_percentage
100.0

[coffeegoddd]

@coffeegoddd DOLT

comparing_percentages
100.000000 to 100.000000

version	result	total
25c15cf	ok	5937457

version	total_tests
25c15cf	5937457

correctness_percentage
100.0

[coffeegoddd]

@nicktobey DOLT

comparing_percentages
100.000000 to 100.000000

version	result	total
eedaa78	ok	5937457

version	total_tests
eedaa78	5937457

correctness_percentage
100.0

[coffeegoddd]

@nicktobey DOLT

comparing_percentages
100.000000 to 100.000000

version	result	total
9ccd483	ok	5937457

version	total_tests
9ccd483	5937457

correctness_percentage
100.0

[macneale4]

Looks like there is some dead code in there. Drop it and ship it!

[macneale4]

generateCreateCommitSQL is dead code now, right?

[nicktobey]

Fixed.

[macneale4]

Seems like it does.

[nicktobey]

Fixed

[coffeegoddd]

@nicktobey DOLT

comparing_percentages
100.000000 to 100.000000

version	result	total
bab5647	ok	5937457

version	total_tests
bab5647	5937457

correctness_percentage
100.0

[github-actions]

@coffeegoddd DOLT

test_name	detail	row_cnt	sorted	mysql_time	sql_mult	cli_mult
batching	LOAD DATA	10000	1	0.07	1.29
batching	batch sql	10000	1	0.09	1.33
batching	by line sql	10000	1	0.1	1.2
blob	1 blob	200000	1	0.93	3.72	4.57
blob	2 blobs	200000	1	0.9	4.23	4.6
blob	no blob	200000	1	0.97	2.35	2.7
col type	datetime	200000	1	0.85	2.41	2.76
col type	varchar	200000	1	0.81	3.19	3.37
config width	2 cols	200000	1	0.88	2.31	2.67
config width	32 cols	200000	1	1.94	1.96	2.7
config width	8 cols	200000	1	1	2.37	2.65
pk type	float	200000	1	0.89	2.34	2.69
pk type	int	200000	1	0.84	2.45	2.77
pk type	varchar	200000	1	1.5	1.75	1.93
row count	1.6mm	1600000	1	5.89	2.94	3.01
row count	400k	400000	1	1.57	2.69	2.88
row count	800k	800000	1	3.01	2.85	2.91
secondary index	four index	200000	1	3.7	1.4	1.34
secondary index	no secondary	200000	1	0.96	2.36	2.76
secondary index	one index	200000	1	1.17	2.44	2.51
secondary index	two index	200000	1	2.06	1.76	1.85
sorting	shuffled 1mm	1000000	0	5.7	2.76	2.81
sorting	sorted 1mm	1000000	1	5.87	2.68	2.73

[github-actions]

@coffeegoddd DOLT

name	detail	mean_mult
dolt_blame_basic	system table	1.2
dolt_blame_commit_filter	system table	2.88
dolt_commit_ancestors_commit_filter	system table	0.61
dolt_commits_commit_filter	system table	1.1
dolt_diff_log_join_from_commit	system table	2.8
dolt_diff_log_join_to_commit	system table	2.72
dolt_diff_table_from_commit_filter	system table	1.19
dolt_diff_table_to_commit_filter	system table	1.21
dolt_diffs_commit_filter	system table	1.06
dolt_history_commit_filter	system table	1.44
dolt_log_commit_filter	system table	1.1

[github-actions]

@coffeegoddd DOLT

name	add_cnt	delete_cnt	update_cnt	latency
adds_only	60000	0	0	1.12
adds_updates_deletes	60000	60000	60000	4.56
deletes_only	0	60000	0	2.48
updates_only	0	0	60000	3.04