orcaLog in

Runs · run 332

load_day 2026-07-30, attempt 1 succeeded

Host
4e84322b8c45:60467
Started
2026-11-07T04:50:52Z
Ended
2026-11-07T04:51:57Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/332/load_day/2026-07-30/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:50:52Z [load_day 2026-07-30] attempt 1 started
2026-11-07T04:51:00Z [load_day 2026-07-30] 2026-07-30 hour 0: 165848 events in 4 files, snapshot 6517773331679425383 (task 4631 ms: download 1716 ms overlapping gunzip 213 ms, parse 779 ms, sort 149 ms, write 1607 ms, index 349 ms: 9 candidates, 50537 repo-hours, 30 releases; waiting 1210 ms; commit 1019 ms)
2026-11-07T04:51:01Z [load_day 2026-07-30] 2026-07-30 hour 1: 167258 events in 4 files, snapshot 2738056284675349184 (task 4062 ms: download 1154 ms overlapping gunzip 202 ms, parse 791 ms, sort 117 ms, write 1732 ms, index 460 ms: 7 candidates, 65578 repo-hours, 18 releases; waiting 512 ms; commit 892 ms)
2026-11-07T04:51:04Z [load_day 2026-07-30] 2026-07-30 hour 2: 165565 events in 4 files, snapshot 892931226644549741 (task 3680 ms: download 1207 ms overlapping gunzip 204 ms, parse 792 ms, sort 103 ms, write 1444 ms, index 330 ms: 7 candidates, 53969 repo-hours, 16 releases; waiting 515 ms; commit 913 ms)
2026-11-07T04:51:05Z [load_day 2026-07-30] 2026-07-30 hour 3: 166567 events in 4 files, snapshot 1490838782721433882 (task 3737 ms: download 1472 ms overlapping gunzip 214 ms, parse 782 ms, sort 106 ms, write 1531 ms, index 235 ms: 6 candidates, 31231 repo-hours, 20 releases; waiting 515 ms; commit 910 ms)
2026-11-07T04:51:09Z [load_day 2026-07-30] 2026-07-30 hour 4: 171292 events in 4 files, snapshot 1891300512876321874 (task 3829 ms: download 1784 ms overlapping gunzip 203 ms, parse 801 ms, sort 118 ms, write 1716 ms, index 173 ms: 2 candidates, 25642 repo-hours, 8 releases; waiting 500 ms; commit 867 ms)
2026-11-07T04:51:10Z [load_day 2026-07-30] 2026-07-30 hour 5: 168482 events in 4 files, snapshot 4894779990912463743 (task 3573 ms: download 1258 ms overlapping gunzip 191 ms, parse 741 ms, sort 107 ms, write 1481 ms, index 198 ms: 3 candidates, 25287 repo-hours, 11 releases; waiting 533 ms; commit 768 ms)
2026-11-07T04:51:13Z [load_day 2026-07-30] 2026-07-30 hour 6: 167285 events in 4 files, snapshot 669122097683783810 (task 3740 ms: download 1256 ms overlapping gunzip 211 ms, parse 851 ms, sort 106 ms, write 1579 ms, index 204 ms: 4 candidates, 29362 repo-hours, 9 releases; waiting 507 ms; commit 924 ms)
2026-11-07T04:51:14Z [load_day 2026-07-30] 2026-07-30 hour 7: 168876 events in 4 files, snapshot 4133595772410576676 (task 3763 ms: download 1584 ms overlapping gunzip 199 ms, parse 793 ms, sort 106 ms, write 1615 ms, index 208 ms: 3 candidates, 31246 repo-hours, 25 releases; waiting 526 ms; commit 870 ms)
2026-11-07T04:51:17Z [load_day 2026-07-30] 2026-07-30 hour 8: 164753 events in 4 files, snapshot 7276959337869931289 (task 3590 ms: download 1377 ms overlapping gunzip 194 ms, parse 772 ms, sort 101 ms, write 1437 ms, index 249 ms: 3 candidates, 37847 repo-hours, 15 releases; waiting 526 ms; commit 850 ms)
2026-11-07T04:51:18Z [load_day 2026-07-30] 2026-07-30 hour 9: 164375 events in 4 files, snapshot 4829628734550511774 (task 3560 ms: download 1431 ms overlapping gunzip 208 ms, parse 774 ms, sort 110 ms, write 1398 ms, index 198 ms: 4 candidates, 29857 repo-hours, 13 releases; waiting 532 ms; commit 802 ms)
2026-11-07T04:51:23Z [load_day 2026-07-30] 2026-07-30 hour 10: 164478 events in 4 files, snapshot 9011791953152082558 (task 3624 ms: download 1121 ms overlapping gunzip 194 ms, parse 756 ms, sort 108 ms, write 1568 ms, index 211 ms: 1 candidates, 29978 repo-hours, 9 releases; waiting 524 ms; commit 2052 ms)
2026-11-07T04:51:24Z [load_day 2026-07-30] 2026-07-30 hour 11: 170480 events in 4 files, snapshot 6057863222019336593 (task 3671 ms: download 1179 ms overlapping gunzip 197 ms, parse 785 ms, sort 114 ms, write 1598 ms, index 213 ms: 3 candidates, 30790 repo-hours, 19 releases; waiting 534 ms; commit 875 ms)
2026-11-07T04:51:26Z [load_day 2026-07-30] 2026-07-30 hour 12: 167255 events in 4 files, snapshot 4805243193712571477 (task 3530 ms: download 1532 ms overlapping gunzip 199 ms, parse 763 ms, sort 103 ms, write 1421 ms, index 199 ms: 7 candidates, 30415 repo-hours, 7 releases; waiting 521 ms; commit 962 ms)
2026-11-07T04:51:28Z [load_day 2026-07-30] 2026-07-30 hour 13: 159189 events in 4 files, snapshot 4879154645637016747 (task 3533 ms: download 1395 ms overlapping gunzip 186 ms, parse 743 ms, sort 94 ms, write 1382 ms, index 304 ms: 5 candidates, 34760 repo-hours, 11 releases; waiting 522 ms; commit 1023 ms)
2026-11-07T04:51:30Z [load_day 2026-07-30] 2026-07-30 hour 14: 160455 events in 4 files, snapshot 7398700931076025814 (task 3670 ms: download 1257 ms overlapping gunzip 191 ms, parse 746 ms, sort 102 ms, write 1486 ms, index 327 ms: 7 candidates, 39447 repo-hours, 7 releases; waiting 533 ms; commit 853 ms)
2026-11-07T04:51:32Z [load_day 2026-07-30] 2026-07-30 hour 15: 157355 events in 4 files, snapshot 3820982099838007299 (task 3535 ms: download 1637 ms overlapping gunzip 192 ms, parse 740 ms, sort 112 ms, write 1364 ms, index 299 ms: 6 candidates, 41608 repo-hours, 13 releases; waiting 539 ms; commit 871 ms)
2026-11-07T04:51:34Z [load_day 2026-07-30] 2026-07-30 hour 16: 163739 events in 4 files, snapshot 1373204911290797858 (task 3761 ms: download 1103 ms overlapping gunzip 198 ms, parse 782 ms, sort 117 ms, write 1432 ms, index 393 ms: 8 candidates, 47737 repo-hours, 11 releases; waiting 217 ms; commit 1025 ms)
2026-11-07T04:51:36Z [load_day 2026-07-30] 2026-07-30 hour 17: 160712 events in 4 files, snapshot 4078381090764081489 (task 3740 ms: download 1283 ms overlapping gunzip 191 ms, parse 736 ms, sort 100 ms, write 1530 ms, index 325 ms: 10 candidates, 51414 repo-hours, 18 releases; waiting 538 ms; commit 824 ms)
2026-11-07T04:51:38Z [load_day 2026-07-30] 2026-07-30 hour 18: 161764 events in 4 files, snapshot 1002384590634595746 (task 3315 ms: download 922 ms overlapping gunzip 191 ms, parse 722 ms, sort 103 ms, write 1407 ms, index 385 ms: 5 candidates, 50757 repo-hours, 14 releases; waiting 196 ms; commit 833 ms)
2026-11-07T04:51:41Z [load_day 2026-07-30] 2026-07-30 hour 19: 162352 events in 4 files, snapshot 1603909989725002689 (task 3739 ms: download 1392 ms overlapping gunzip 199 ms, parse 756 ms, sort 101 ms, write 1520 ms, index 351 ms: 4 candidates, 54610 repo-hours, 20 releases; waiting 508 ms; commit 1014 ms)
2026-11-07T04:51:42Z [load_day 2026-07-30] 2026-07-30 hour 20: 164069 events in 4 files, snapshot 1844509026660342598 (task 3399 ms: download 839 ms overlapping gunzip 204 ms, parse 742 ms, sort 100 ms, write 1541 ms, index 341 ms: 9 candidates, 54218 repo-hours, 23 releases; waiting 185 ms; commit 947 ms)
2026-11-07T04:51:45Z [load_day 2026-07-30] 2026-07-30 hour 21: 164693 events in 4 files, snapshot 5139428684575082702 (task 3866 ms: download 1353 ms overlapping gunzip 223 ms, parse 833 ms, sort 120 ms, write 1522 ms, index 336 ms: 12 candidates, 54262 repo-hours, 14 releases; waiting 524 ms; commit 897 ms)
2026-11-07T04:51:47Z [load_day 2026-07-30] 2026-07-30 hour 22: 168198 events in 4 files, snapshot 6017543536272958575 (task 3726 ms: download 1479 ms overlapping gunzip 210 ms, parse 796 ms, sort 111 ms, write 1466 ms, index 351 ms: 8 candidates, 53698 repo-hours, 18 releases; waiting 536 ms; commit 892 ms)
2026-11-07T04:51:50Z [load_day 2026-07-30] 2026-07-30 hour 23: 168367 events in 4 files, snapshot 2781263776310790565 (task 3678 ms: download 1385 ms overlapping gunzip 206 ms, parse 764 ms, sort 106 ms, write 1433 ms, index 328 ms: 9 candidates, 52004 repo-hours, 18 releases; waiting 542 ms; commit 999 ms)
2026-11-07T04:51:54Z [load_day 2026-07-30] 2026-07-30: repo_hour merged from 24 files to 1 (1006254 rows, 4620 ms)
2026-11-07T04:51:57Z [load_day 2026-07-30] 2026-07-30: index committed in 6640 ms (24 + 1 + 24 files)
2026-11-07T04:51:57Z [load_day 2026-07-30] 2026-07-30: 3963407 events in 24 hours
2026-11-07T04:51:57Z [load_day 2026-07-30] attempt 1 succeeded