You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
fix(asap-tools): batch ClickHouse JSON-lines bulk load instead of a single oversized INSERT #541
Bulk-loading JSON-lines datasets into ClickHouse currently pipes the entire file through a single SSH → docker exec → one INSERT … FORMAT JSONEachRow command. That works for small fixtures but is unreliable for the multi-GB datasets used in the ClickHouse benchmark (experiment_run_clickhouse.py), where a single oversized INSERT gives no partial progress and no useful diagnostics when it fails.
We should load in bounded batches, wait for ClickHouse to actually be reachable first, and fail with an actionable message when input data is malformed.
Activity