orcaLog in

Runs · run 404

load_day 2026-07-06, attempt 1 succeeded

Host
4e84322b8c45:80971
Started
2026-11-07T05:16:59Z
Ended
2026-11-07T05:18:06Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/404/load_day/2026-07-06/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:16:59Z [load_day 2026-07-06] attempt 1 started
2026-11-07T05:17:07Z [load_day 2026-07-06] 2026-07-06 hour 0: 167025 events in 4 files, snapshot 5034202192798272931 (task 4202 ms: download 1706 ms overlapping gunzip 221 ms, parse 849 ms, sort 125 ms, write 1805 ms, index 524 ms: 7 candidates, 62331 repo-hours, 51 releases; waiting 376 ms; commit 1115 ms)
2026-11-07T05:17:08Z [load_day 2026-07-06] 2026-07-06 hour 1: 166238 events in 4 files, snapshot 2208190476934283778 (task 3965 ms: download 1432 ms overlapping gunzip 202 ms, parse 800 ms, sort 136 ms, write 1615 ms, index 446 ms: 4 candidates, 64973 repo-hours, 49 releases; waiting 495 ms; commit 1083 ms)
2026-11-07T05:17:12Z [load_day 2026-07-06] 2026-07-06 hour 2: 169726 events in 4 files, snapshot 6828955753794038908 (task 4003 ms: download 1272 ms overlapping gunzip 202 ms, parse 784 ms, sort 105 ms, write 1514 ms, index 504 ms: 8 candidates, 77217 repo-hours, 35 releases; waiting 529 ms; commit 921 ms)
2026-11-07T05:17:13Z [load_day 2026-07-06] 2026-07-06 hour 3: 166128 events in 4 files, snapshot 4697495842446223669 (task 3960 ms: download 1361 ms overlapping gunzip 220 ms, parse 807 ms, sort 106 ms, write 1533 ms, index 471 ms: 12 candidates, 73454 repo-hours, 46 releases; waiting 506 ms; commit 1007 ms)
2026-11-07T05:17:16Z [load_day 2026-07-06] 2026-07-06 hour 4: 165250 events in 4 files, snapshot 3262717330388288611 (task 3920 ms: download 1469 ms overlapping gunzip 216 ms, parse 799 ms, sort 108 ms, write 1543 ms, index 465 ms: 9 candidates, 65833 repo-hours, 40 releases; waiting 519 ms; commit 1006 ms)
2026-11-07T05:17:17Z [load_day 2026-07-06] 2026-07-06 hour 5: 168958 events in 4 files, snapshot 2143888767384279635 (task 3839 ms: download 1630 ms overlapping gunzip 205 ms, parse 776 ms, sort 103 ms, write 1491 ms, index 416 ms: 4 candidates, 63817 repo-hours, 20 releases; waiting 515 ms; commit 875 ms)
2026-11-07T05:17:21Z [load_day 2026-07-06] 2026-07-06 hour 6: 165332 events in 4 files, snapshot 7648103655792783981 (task 3776 ms: download 1137 ms overlapping gunzip 210 ms, parse 830 ms, sort 104 ms, write 1437 ms, index 460 ms: 16 candidates, 67072 repo-hours, 18 releases; waiting 521 ms; commit 990 ms)
2026-11-07T05:17:22Z [load_day 2026-07-06] 2026-07-06 hour 7: 161136 events in 4 files, snapshot 2211949033123464559 (task 3725 ms: download 1076 ms overlapping gunzip 203 ms, parse 717 ms, sort 96 ms, write 1460 ms, index 417 ms: 6 candidates, 62680 repo-hours, 15 releases; waiting 478 ms; commit 883 ms)
2026-11-07T05:17:25Z [load_day 2026-07-06] 2026-07-06 hour 8: 165251 events in 4 files, snapshot 1158937137107128202 (task 3767 ms: download 1231 ms overlapping gunzip 199 ms, parse 773 ms, sort 98 ms, write 1423 ms, index 450 ms: 12 candidates, 67650 repo-hours, 26 releases; waiting 520 ms; commit 1096 ms)
2026-11-07T05:17:26Z [load_day 2026-07-06] 2026-07-06 hour 9: 162870 events in 4 files, snapshot 9042024788357834394 (task 3783 ms: download 1308 ms overlapping gunzip 202 ms, parse 758 ms, sort 97 ms, write 1426 ms, index 493 ms: 9 candidates, 69726 repo-hours, 20 releases; waiting 508 ms; commit 930 ms)
2026-11-07T05:17:29Z [load_day 2026-07-06] 2026-07-06 hour 10: 165037 events in 4 files, snapshot 4106401915826746369 (task 3525 ms: download 930 ms overlapping gunzip 218 ms, parse 782 ms, sort 116 ms, write 1460 ms, index 490 ms: 4 candidates, 69250 repo-hours, 19 releases; waiting 183 ms; commit 1114 ms)
2026-11-07T05:17:31Z [load_day 2026-07-06] 2026-07-06 hour 11: 167436 events in 4 files, snapshot 1659761089296634579 (task 3826 ms: download 1184 ms overlapping gunzip 211 ms, parse 802 ms, sort 113 ms, write 1479 ms, index 470 ms: 9 candidates, 68855 repo-hours, 19 releases; waiting 537 ms; commit 1085 ms)
2026-11-07T05:17:34Z [load_day 2026-07-06] 2026-07-06 hour 12: 163833 events in 4 files, snapshot 6907712462531453943 (task 3901 ms: download 1601 ms overlapping gunzip 197 ms, parse 746 ms, sort 106 ms, write 1510 ms, index 499 ms: 6 candidates, 66458 repo-hours, 22 releases; waiting 540 ms; commit 967 ms)
2026-11-07T05:17:35Z [load_day 2026-07-06] 2026-07-06 hour 13: 161752 events in 4 files, snapshot 917102633249257236 (task 3687 ms: download 1270 ms overlapping gunzip 210 ms, parse 754 ms, sort 101 ms, write 1361 ms, index 499 ms: 8 candidates, 68002 repo-hours, 14 releases; waiting 528 ms; commit 1055 ms)
2026-11-07T05:17:38Z [load_day 2026-07-06] 2026-07-06 hour 14: 164551 events in 4 files, snapshot 3519191751506029472 (task 3867 ms: download 1460 ms overlapping gunzip 210 ms, parse 818 ms, sort 108 ms, write 1395 ms, index 503 ms: 9 candidates, 70917 repo-hours, 22 releases; waiting 531 ms; commit 1048 ms)
2026-11-07T05:17:40Z [load_day 2026-07-06] 2026-07-06 hour 15: 164328 events in 4 files, snapshot 9184853095554225702 (task 3923 ms: download 1374 ms overlapping gunzip 214 ms, parse 770 ms, sort 114 ms, write 1463 ms, index 488 ms: 7 candidates, 74971 repo-hours, 23 releases; waiting 505 ms; commit 1011 ms)
2026-11-07T05:17:43Z [load_day 2026-07-06] 2026-07-06 hour 16: 162925 events in 4 files, snapshot 8339436658354764053 (task 3768 ms: download 1295 ms overlapping gunzip 198 ms, parse 743 ms, sort 101 ms, write 1482 ms, index 408 ms: 5 candidates, 62916 repo-hours, 24 releases; waiting 549 ms; commit 1126 ms)
2026-11-07T05:17:44Z [load_day 2026-07-06] 2026-07-06 hour 17: 163111 events in 4 files, snapshot 5264035594594635572 (task 3604 ms: download 1312 ms overlapping gunzip 203 ms, parse 730 ms, sort 95 ms, write 1401 ms, index 382 ms: 7 candidates, 62200 repo-hours, 17 releases; waiting 504 ms; commit 1137 ms)
2026-11-07T05:17:48Z [load_day 2026-07-06] 2026-07-06 hour 18: 159143 events in 4 files, snapshot 773362959519564849 (task 4036 ms: download 1262 ms overlapping gunzip 193 ms, parse 733 ms, sort 99 ms, write 1458 ms, index 390 ms: 7 candidates, 60839 repo-hours, 17 releases; waiting 628 ms; commit 1071 ms)
2026-11-07T05:17:49Z [load_day 2026-07-06] 2026-07-06 hour 19: 159345 events in 4 files, snapshot 7792814393728307495 (task 3608 ms: download 1459 ms overlapping gunzip 186 ms, parse 719 ms, sort 103 ms, write 1375 ms, index 408 ms: 8 candidates, 61902 repo-hours, 11 releases; waiting 538 ms; commit 980 ms)
2026-11-07T05:17:52Z [load_day 2026-07-06] 2026-07-06 hour 20: 163031 events in 4 files, snapshot 5916123181525111342 (task 4018 ms: download 2024 ms overlapping gunzip 205 ms, parse 779 ms, sort 127 ms, write 1615 ms, index 400 ms: 9 candidates, 61814 repo-hours, 20 releases; waiting 526 ms; commit 1145 ms)
2026-11-07T05:17:53Z [load_day 2026-07-06] 2026-07-06 hour 21: 167333 events in 4 files, snapshot 533431454031676195 (task 4023 ms: download 1293 ms overlapping gunzip 209 ms, parse 778 ms, sort 110 ms, write 1666 ms, index 454 ms: 9 candidates, 66732 repo-hours, 14 releases; waiting 516 ms; commit 929 ms)
2026-11-07T05:17:56Z [load_day 2026-07-06] 2026-07-06 hour 22: 165463 events in 4 files, snapshot 8630479477742640609 (task 3753 ms: download 1437 ms overlapping gunzip 204 ms, parse 747 ms, sort 104 ms, write 1402 ms, index 495 ms: 6 candidates, 61634 repo-hours, 32 releases; waiting 521 ms; commit 890 ms)
2026-11-07T05:17:58Z [load_day 2026-07-06] 2026-07-06 hour 23: 168578 events in 4 files, snapshot 8088848105567920040 (task 3907 ms: download 1375 ms overlapping gunzip 210 ms, parse 809 ms, sort 106 ms, write 1578 ms, index 371 ms: 10 candidates, 60129 repo-hours, 31 releases; waiting 513 ms; commit 915 ms)
2026-11-07T05:18:05Z [load_day 2026-07-06] 2026-07-06: repo_hour merged from 24 files to 1 (1591372 rows, 6818 ms)
2026-11-07T05:18:06Z [load_day 2026-07-06] 2026-07-06: index committed in 8356 ms (24 + 1 + 24 files)
2026-11-07T05:18:06Z [load_day 2026-07-06] 2026-07-06: 3953780 events in 24 hours
2026-11-07T05:18:06Z [load_day 2026-07-06] attempt 1 succeeded