orcaLog in

Runs · run 1483

load_day 2023-09-10, attempt 1 succeeded

Host
3c2b29713ce8:316002
Started
2026-11-08T00:42:19Z
Ended
2026-11-08T00:44:51Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1483/load_day/2023-09-10/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T00:42:19Z [load_day 2023-09-10] attempt 1 started
2026-11-08T00:42:20Z [load_day 2023-09-10] 2023-09-10: 2 hours in flight, about 1200 MB
2026-11-08T00:42:33Z [load_day 2023-09-10] 2023-09-10 hour 0: 125937 events in 3 files, snapshot 3909236690132143891 (task 9117 ms: download 3254 ms overlapping gunzip 439 ms, parse 2121 ms, sort 75 ms, write 4525 ms, index 514 ms: 8 candidates, 68345 repo-hours, 891 releases; waiting 1165 ms; commit 1866 ms)
2026-11-08T00:42:35Z [load_day 2023-09-10] 2023-09-10 hour 1: 119554 events in 3 files, snapshot 6552025031231458813 (task 8763 ms: download 4594 ms overlapping gunzip 396 ms, parse 1924 ms, sort 69 ms, write 4300 ms, index 472 ms: 15 candidates, 69020 repo-hours, 793 releases; waiting 1102 ms; commit 1979 ms)
2026-11-08T00:42:40Z [load_day 2023-09-10] 2023-09-10 hour 2: 93231 events in 2 files, snapshot 4714355668537320322 (task 6465 ms: download 2894 ms overlapping gunzip 315 ms, parse 1430 ms, sort 63 ms, write 2823 ms, index 261 ms: 4 candidates, 37590 repo-hours, 710 releases; waiting 1273 ms; commit 1949 ms)
2026-11-08T00:42:43Z [load_day 2023-09-10] 2023-09-10 hour 3: 93194 events in 2 files, snapshot 6657705420044855475 (task 5409 ms: download 1384 ms overlapping gunzip 294 ms, parse 1415 ms, sort 49 ms, write 2693 ms, index 261 ms: 1 candidates, 37616 repo-hours, 745 releases; waiting 494 ms; commit 2958 ms)
2026-11-08T00:42:49Z [load_day 2023-09-10] 2023-09-10 hour 4: 94233 events in 2 files, snapshot 3867977683494175304 (task 7262 ms: download 1223 ms overlapping gunzip 419 ms, parse 1961 ms, sort 106 ms, write 3932 ms, index 332 ms: 7 candidates, 38758 repo-hours, 502 releases; waiting 220 ms; commit 2564 ms)
2026-11-08T00:42:53Z [load_day 2023-09-10] 2023-09-10 hour 5: 103500 events in 3 files, snapshot 6999913960393695150 (task 9119 ms: download 2460 ms overlapping gunzip 589 ms, parse 2550 ms, sort 109 ms, write 4674 ms, index 356 ms: 7 candidates, 42011 repo-hours, 652 releases; waiting 521 ms; commit 2460 ms)
2026-11-08T00:42:59Z [load_day 2023-09-10] 2023-09-10 hour 6: 117294 events in 3 files, snapshot 301308330184921431 (task 9112 ms: download 2173 ms overlapping gunzip 469 ms, parse 2106 ms, sort 106 ms, write 4948 ms, index 345 ms: 8 candidates, 51401 repo-hours, 743 releases; waiting 851 ms; commit 2392 ms)
2026-11-08T00:43:04Z [load_day 2023-09-10] 2023-09-10 hour 7: 114906 events in 3 files, snapshot 8069569865059563467 (task 9593 ms: download 2787 ms overlapping gunzip 620 ms, parse 2476 ms, sort 94 ms, write 5204 ms, index 352 ms: 14 candidates, 46967 repo-hours, 699 releases; waiting 543 ms; commit 2652 ms)
2026-11-08T00:43:11Z [load_day 2023-09-10] 2023-09-10 hour 8: 124176 events in 3 files, snapshot 4212374458911380986 (task 10478 ms: download 2423 ms overlapping gunzip 523 ms, parse 2160 ms, sort 130 ms, write 6512 ms, index 336 ms: 12 candidates, 51365 repo-hours, 680 releases; waiting 510 ms; commit 2727 ms)
2026-11-08T00:43:16Z [load_day 2023-09-10] 2023-09-10 hour 9: 123806 events in 3 files, snapshot 6789903719554420604 (task 10507 ms: download 3019 ms overlapping gunzip 653 ms, parse 2824 ms, sort 130 ms, write 5620 ms, index 555 ms: 9 candidates, 51239 repo-hours, 766 releases; waiting 514 ms; commit 4025 ms)
2026-11-08T00:43:23Z [load_day 2023-09-10] 2023-09-10 hour 10: 127940 events in 3 files, snapshot 1681549828581050756 (task 11098 ms: download 2693 ms overlapping gunzip 647 ms, parse 2906 ms, sort 87 ms, write 5514 ms, index 447 ms: 9 candidates, 52638 repo-hours, 684 releases; waiting 1204 ms; commit 2588 ms)
2026-11-08T00:43:27Z [load_day 2023-09-10] 2023-09-10 hour 11: 132280 events in 3 files, snapshot 1333249347708454937 (task 10955 ms: download 2003 ms overlapping gunzip 613 ms, parse 2766 ms, sort 94 ms, write 6184 ms, index 542 ms: 12 candidates, 51663 repo-hours, 767 releases; waiting 486 ms; commit 2797 ms)
2026-11-08T00:43:38Z [load_day 2023-09-10] 2023-09-10 hour 12: 207649 events in 5 files, snapshot 5184253607568781283 (task 13464 ms: download 4411 ms overlapping gunzip 699 ms, parse 3557 ms, sort 128 ms, write 7671 ms, index 702 ms: 13 candidates, 86104 repo-hours, 933 releases; waiting 501 ms; commit 3542 ms)
2026-11-08T00:43:41Z [load_day 2023-09-10] 2023-09-10 hour 13: 165919 events in 4 files, snapshot 4108029658211616045 (task 13034 ms: download 4412 ms overlapping gunzip 755 ms, parse 3391 ms, sort 108 ms, write 7037 ms, index 1032 ms: 11 candidates, 79110 repo-hours, 856 releases; waiting 420 ms; commit 2832 ms)
2026-11-08T00:43:51Z [load_day 2023-09-10] 2023-09-10 hour 14: 153738 events in 4 files, snapshot 814077612137243685 (task 13136 ms: download 4679 ms overlapping gunzip 744 ms, parse 3507 ms, sort 152 ms, write 7307 ms, index 578 ms: 11 candidates, 64105 repo-hours, 831 releases; waiting 487 ms; commit 2170 ms)
2026-11-08T00:43:56Z [load_day 2023-09-10] 2023-09-10 hour 15: 154891 events in 4 files, snapshot 9050338539406977169 (task 12150 ms: download 4987 ms overlapping gunzip 684 ms, parse 3016 ms, sort 119 ms, write 7070 ms, index 529 ms: 9 candidates, 65561 repo-hours, 1031 releases; waiting 463 ms; commit 3739 ms)
2026-11-08T00:44:05Z [load_day 2023-09-10] 2023-09-10 hour 16: 149820 events in 3 files, snapshot 838567229808766189 (task 12055 ms: download 4277 ms overlapping gunzip 618 ms, parse 2813 ms, sort 142 ms, write 7088 ms, index 528 ms: 7 candidates, 63328 repo-hours, 710 releases; waiting 493 ms; commit 2556 ms)
2026-11-08T00:44:07Z [load_day 2023-09-10] 2023-09-10 hour 17: 141074 events in 3 files, snapshot 175109323471018031 (task 11256 ms: download 2004 ms overlapping gunzip 633 ms, parse 2805 ms, sort 124 ms, write 6314 ms, index 534 ms: 5 candidates, 59176 repo-hours, 746 releases; waiting 505 ms; commit 2729 ms)
2026-11-08T00:44:17Z [load_day 2023-09-10] 2023-09-10 hour 18: 146949 events in 3 files, snapshot 8161980229151290316 (task 11295 ms: download 4114 ms overlapping gunzip 642 ms, parse 3085 ms, sort 119 ms, write 6195 ms, index 418 ms: 7 candidates, 64675 repo-hours, 861 releases; waiting 481 ms; commit 2370 ms)
2026-11-08T00:44:22Z [load_day 2023-09-10] 2023-09-10 hour 19: 133732 events in 3 files, snapshot 8803286877891887176 (task 10393 ms: download 2385 ms overlapping gunzip 620 ms, parse 2490 ms, sort 119 ms, write 6105 ms, index 365 ms: 9 candidates, 54088 repo-hours, 748 releases; waiting 320 ms; commit 4967 ms)
2026-11-08T00:44:29Z [load_day 2023-09-10] 2023-09-10 hour 20: 130758 events in 3 files, snapshot 3597634392601590014 (task 11139 ms: download 2114 ms overlapping gunzip 564 ms, parse 2781 ms, sort 193 ms, write 6179 ms, index 574 ms: 9 candidates, 53377 repo-hours, 820 releases; waiting 507 ms; commit 2165 ms)
2026-11-08T00:44:32Z [load_day 2023-09-10] 2023-09-10 hour 21: 113979 events in 3 files, snapshot 3006269867970162761 (task 9856 ms: download 1957 ms overlapping gunzip 481 ms, parse 2101 ms, sort 68 ms, write 5911 ms, index 483 ms: 4 candidates, 45582 repo-hours, 763 releases; waiting 503 ms; commit 2863 ms)
2026-11-08T00:44:39Z [load_day 2023-09-10] 2023-09-10 hour 22: 103892 events in 3 files, snapshot 1332196086090626566 (task 8997 ms: download 2253 ms overlapping gunzip 531 ms, parse 2401 ms, sort 102 ms, write 4781 ms, index 388 ms: 6 candidates, 40926 repo-hours, 659 releases; waiting 489 ms; commit 2079 ms)
2026-11-08T00:44:42Z [load_day 2023-09-10] 2023-09-10 hour 23: 100601 events in 3 files, snapshot 1641700943703186972 (task 8848 ms: download 2710 ms overlapping gunzip 574 ms, parse 2367 ms, sort 81 ms, write 4694 ms, index 290 ms: 3 candidates, 41015 repo-hours, 551 releases; waiting 487 ms; commit 2195 ms)
2026-11-08T00:44:48Z [load_day 2023-09-10] 2023-09-10: repo_hour merged from 24 files to 1 (1315660 rows, 6826 ms)
2026-11-08T00:44:50Z [load_day 2023-09-10] 2023-09-10: index committed in 8960 ms (24 + 1 + 24 files)
2026-11-08T00:44:50Z [load_day 2023-09-10] 2023-09-10: 3073053 events in 24 hours
2026-11-08T00:44:50Z [load_day 2023-09-10] attempt 1 succeeded