orcaLog in

Runs · run 1366

load_day 2023-08-06, attempt 1 succeeded

Host
3c2b29713ce8:200559
Started
2026-11-07T23:39:00Z
Ended
2026-11-07T23:41:27Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1366/load_day/2023-08-06/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:39:00Z [load_day 2023-08-06] attempt 1 started
2026-11-07T23:39:02Z [load_day 2023-08-06] 2023-08-06: 2 hours in flight, about 1200 MB
2026-11-07T23:39:23Z [load_day 2023-08-06] 2023-08-06 hour 0: 118229 events in 3 files, snapshot 2398372341369048033 (task 9864 ms: download 1941 ms overlapping gunzip 618 ms, parse 2723 ms, sort 71 ms, write 5239 ms, index 466 ms: 4 candidates, 65327 repo-hours, 936 releases; waiting 495 ms; commit 8885 ms)
2026-11-07T23:39:26Z [load_day 2023-08-06] 2023-08-06 hour 1: 117827 events in 3 files, snapshot 3999657066832242305 (task 9303 ms: download 2052 ms overlapping gunzip 493 ms, parse 2344 ms, sort 96 ms, write 5124 ms, index 543 ms: 1 candidates, 69002 repo-hours, 717 releases; waiting 476 ms; commit 3507 ms)
2026-11-07T23:39:30Z [load_day 2023-08-06] 2023-08-06 hour 2: 91299 events in 2 files, snapshot 4888415024773304297 (task 7622 ms: download 2069 ms overlapping gunzip 457 ms, parse 2111 ms, sort 106 ms, write 3908 ms, index 236 ms: 0 candidates, 37783 repo-hours, 571 releases; waiting 532 ms; commit 3928 ms)
2026-11-07T23:39:33Z [load_day 2023-08-06] 2023-08-06 hour 3: 90621 events in 2 files, snapshot 3792055492669272257 (task 7177 ms: download 1670 ms overlapping gunzip 398 ms, parse 1816 ms, sort 69 ms, write 3862 ms, index 269 ms: 2 candidates, 37174 repo-hours, 708 releases; waiting 490 ms; commit 2415 ms)
2026-11-07T23:39:38Z [load_day 2023-08-06] 2023-08-06 hour 4: 92070 events in 2 files, snapshot 5876001792467498517 (task 7152 ms: download 1581 ms overlapping gunzip 371 ms, parse 1739 ms, sort 72 ms, write 3673 ms, index 477 ms: 1 candidates, 37012 repo-hours, 440 releases; waiting 520 ms; commit 3620 ms)
2026-11-07T23:39:42Z [load_day 2023-08-06] 2023-08-06 hour 5: 100590 events in 3 files, snapshot 764802061907547217 (task 7675 ms: download 1842 ms overlapping gunzip 405 ms, parse 1762 ms, sort 69 ms, write 4324 ms, index 318 ms: 5 candidates, 40895 repo-hours, 585 releases; waiting 518 ms; commit 2634 ms)
2026-11-07T23:39:47Z [load_day 2023-08-06] 2023-08-06 hour 6: 112213 events in 3 files, snapshot 1240851336836672315 (task 8074 ms: download 1546 ms overlapping gunzip 441 ms, parse 1978 ms, sort 98 ms, write 4536 ms, index 355 ms: 2 candidates, 49940 repo-hours, 595 releases; waiting 398 ms; commit 3258 ms)
2026-11-07T23:39:53Z [load_day 2023-08-06] 2023-08-06 hour 7: 110749 events in 3 files, snapshot 7845711599686173118 (task 8960 ms: download 1805 ms overlapping gunzip 487 ms, parse 2202 ms, sort 91 ms, write 4881 ms, index 471 ms: 8 candidates, 45610 repo-hours, 567 releases; waiting 221 ms; commit 3003 ms)
2026-11-07T23:39:58Z [load_day 2023-08-06] 2023-08-06 hour 8: 115138 events in 3 files, snapshot 9137345355912111740 (task 8902 ms: download 1850 ms overlapping gunzip 548 ms, parse 2517 ms, sort 76 ms, write 4538 ms, index 463 ms: 4 candidates, 48960 repo-hours, 619 releases; waiting 498 ms; commit 3835 ms)
2026-11-07T23:40:04Z [load_day 2023-08-06] 2023-08-06 hour 9: 118031 events in 3 files, snapshot 6165174707851616393 (task 9772 ms: download 3206 ms overlapping gunzip 565 ms, parse 2438 ms, sort 89 ms, write 5281 ms, index 425 ms: 1 candidates, 49557 repo-hours, 727 releases; waiting 675 ms; commit 3273 ms)
2026-11-07T23:40:08Z [load_day 2023-08-06] 2023-08-06 hour 10: 118449 events in 3 files, snapshot 6262473678646659486 (task 9713 ms: download 2187 ms overlapping gunzip 555 ms, parse 2570 ms, sort 151 ms, write 5263 ms, index 422 ms: 4 candidates, 50994 repo-hours, 663 releases; waiting 487 ms; commit 3301 ms)
2026-11-07T23:40:12Z [load_day 2023-08-06] 2023-08-06 hour 11: 120370 events in 3 files, snapshot 4669247634981476101 (task 8340 ms: download 2465 ms overlapping gunzip 443 ms, parse 2010 ms, sort 72 ms, write 4459 ms, index 370 ms: 2 candidates, 49371 repo-hours, 706 releases; waiting 623 ms; commit 2095 ms)
2026-11-07T23:40:18Z [load_day 2023-08-06] 2023-08-06 hour 12: 199903 events in 4 files, snapshot 4356417829091569561 (task 10149 ms: download 3103 ms overlapping gunzip 519 ms, parse 2637 ms, sort 114 ms, write 5875 ms, index 572 ms: 5 candidates, 84561 repo-hours, 761 releases; waiting 190 ms; commit 1979 ms)
2026-11-07T23:40:23Z [load_day 2023-08-06] 2023-08-06 hour 13: 154002 events in 4 files, snapshot 3959457461456636453 (task 9633 ms: download 3292 ms overlapping gunzip 512 ms, parse 2459 ms, sort 96 ms, write 5336 ms, index 488 ms: 4 candidates, 78237 repo-hours, 707 releases; waiting 478 ms; commit 2151 ms)
2026-11-07T23:40:30Z [load_day 2023-08-06] 2023-08-06 hour 14: 141414 events in 3 files, snapshot 7744052312261468029 (task 10773 ms: download 3215 ms overlapping gunzip 609 ms, parse 2771 ms, sort 121 ms, write 5978 ms, index 506 ms: 5 candidates, 61471 repo-hours, 816 releases; waiting 186 ms; commit 2503 ms)
2026-11-07T23:40:37Z [load_day 2023-08-06] 2023-08-06 hour 15: 143721 events in 3 files, snapshot 2707806119297083377 (task 12043 ms: download 5128 ms overlapping gunzip 664 ms, parse 3069 ms, sort 91 ms, write 6942 ms, index 463 ms: 5 candidates, 63602 repo-hours, 845 releases; waiting 520 ms; commit 2815 ms)
2026-11-07T23:40:43Z [load_day 2023-08-06] 2023-08-06 hour 16: 139180 events in 3 files, snapshot 735921252487041553 (task 11021 ms: download 2289 ms overlapping gunzip 572 ms, parse 2699 ms, sort 119 ms, write 6331 ms, index 506 ms: 9 candidates, 60473 repo-hours, 754 releases; waiting 499 ms; commit 3549 ms)
2026-11-07T23:40:48Z [load_day 2023-08-06] 2023-08-06 hour 17: 128731 events in 3 files, snapshot 2662890331364053066 (task 10594 ms: download 2458 ms overlapping gunzip 590 ms, parse 2565 ms, sort 145 ms, write 6027 ms, index 423 ms: 3 candidates, 54657 repo-hours, 656 releases; waiting 516 ms; commit 2441 ms)
2026-11-07T23:40:53Z [load_day 2023-08-06] 2023-08-06 hour 18: 134996 events in 3 files, snapshot 3925039959039371167 (task 10060 ms: download 2298 ms overlapping gunzip 513 ms, parse 2383 ms, sort 95 ms, write 5706 ms, index 565 ms: 3 candidates, 60785 repo-hours, 912 releases; waiting 511 ms; commit 2882 ms)
2026-11-07T23:41:00Z [load_day 2023-08-06] 2023-08-06 hour 19: 121287 events in 3 files, snapshot 7404059527385050120 (task 10194 ms: download 2055 ms overlapping gunzip 545 ms, parse 2545 ms, sort 76 ms, write 5735 ms, index 499 ms: 2 candidates, 49077 repo-hours, 762 releases; waiting 503 ms; commit 2819 ms)
2026-11-07T23:41:04Z [load_day 2023-08-06] 2023-08-06 hour 20: 116109 events in 3 files, snapshot 4111472748683215337 (task 9847 ms: download 2432 ms overlapping gunzip 585 ms, parse 2651 ms, sort 78 ms, write 5242 ms, index 507 ms: 2 candidates, 48879 repo-hours, 654 releases; waiting 485 ms; commit 2457 ms)
2026-11-07T23:41:10Z [load_day 2023-08-06] 2023-08-06 hour 21: 104933 events in 3 files, snapshot 5004699921151785806 (task 9315 ms: download 1851 ms overlapping gunzip 481 ms, parse 2155 ms, sort 102 ms, write 5432 ms, index 333 ms: 6 candidates, 43074 repo-hours, 694 releases; waiting 520 ms; commit 2868 ms)
2026-11-07T23:41:14Z [load_day 2023-08-06] 2023-08-06 hour 22: 97133 events in 2 files, snapshot 939351728034605536 (task 8261 ms: download 1676 ms overlapping gunzip 422 ms, parse 1867 ms, sort 70 ms, write 4623 ms, index 491 ms: 3 candidates, 39147 repo-hours, 678 releases; waiting 492 ms; commit 3174 ms)
2026-11-07T23:41:18Z [load_day 2023-08-06] 2023-08-06 hour 23: 95255 events in 2 files, snapshot 2656480061456985077 (task 7977 ms: download 1294 ms overlapping gunzip 487 ms, parse 2251 ms, sort 75 ms, write 4358 ms, index 277 ms: 3 candidates, 39919 repo-hours, 601 releases; waiting 194 ms; commit 2108 ms)
2026-11-07T23:41:24Z [load_day 2023-08-06] 2023-08-06: repo_hour merged from 24 files to 1 (1265507 rows, 5960 ms)
2026-11-07T23:41:27Z [load_day 2023-08-06] 2023-08-06: index committed in 8467 ms (23 + 1 + 24 files)
2026-11-07T23:41:27Z [load_day 2023-08-06] 2023-08-06: 2882250 events in 24 hours
2026-11-07T23:41:27Z [load_day 2023-08-06] attempt 1 succeeded