orcaLog in

Runs · run 329

load_day 2026-07-31, attempt 1 succeeded

Host
4e84322b8c45:59611
Started
2026-11-07T04:49:49Z
Ended
2026-11-07T04:50:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/329/load_day/2026-07-31/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:49:49Z [load_day 2026-07-31] attempt 1 started
2026-11-07T04:49:56Z [load_day 2026-07-31] 2026-07-31 hour 0: 167765 events in 4 files, snapshot 6390429566214653717 (task 3896 ms: download 1456 ms overlapping gunzip 225 ms, parse 824 ms, sort 120 ms, write 1509 ms, index 324 ms: 10 candidates, 51016 repo-hours, 11 releases; waiting 558 ms; commit 762 ms)
2026-11-07T04:49:56Z [load_day 2026-07-31] 2026-07-31 hour 1: 168773 events in 4 files, snapshot 3330040441730816360 (task 3927 ms: download 1330 ms overlapping gunzip 212 ms, parse 817 ms, sort 120 ms, write 1614 ms, index 386 ms: 3 candidates, 61461 repo-hours, 15 releases; waiting 471 ms; commit 808 ms)
2026-11-07T04:50:00Z [load_day 2026-07-31] 2026-07-31 hour 2: 167375 events in 4 files, snapshot 2269039744002711314 (task 3928 ms: download 1533 ms overlapping gunzip 201 ms, parse 786 ms, sort 112 ms, write 1526 ms, index 367 ms: 5 candidates, 57479 repo-hours, 15 releases; waiting 549 ms; commit 850 ms)
2026-11-07T04:50:01Z [load_day 2026-07-31] 2026-07-31 hour 3: 168292 events in 4 files, snapshot 5676444218660868815 (task 3552 ms: download 1287 ms overlapping gunzip 188 ms, parse 778 ms, sort 105 ms, write 1456 ms, index 208 ms: 3 candidates, 31522 repo-hours, 6 releases; waiting 517 ms; commit 834 ms)
2026-11-07T04:50:05Z [load_day 2026-07-31] 2026-07-31 hour 4: 170590 events in 4 files, snapshot 2338902827709890036 (task 3710 ms: download 1365 ms overlapping gunzip 195 ms, parse 797 ms, sort 109 ms, write 1577 ms, index 174 ms: 3 candidates, 26306 repo-hours, 4 releases; waiting 521 ms; commit 799 ms)
2026-11-07T04:50:06Z [load_day 2026-07-31] 2026-07-31 hour 5: 171990 events in 4 files, snapshot 7744716841799581623 (task 3678 ms: download 1307 ms overlapping gunzip 189 ms, parse 770 ms, sort 106 ms, write 1566 ms, index 208 ms: 2 candidates, 25572 repo-hours, 10 releases; waiting 530 ms; commit 947 ms)
2026-11-07T04:50:09Z [load_day 2026-07-31] 2026-07-31 hour 6: 166377 events in 4 files, snapshot 7293971097683225271 (task 3633 ms: download 1274 ms overlapping gunzip 187 ms, parse 763 ms, sort 102 ms, write 1587 ms, index 182 ms: 2 candidates, 25070 repo-hours, 7 releases; waiting 513 ms; commit 1014 ms)
2026-11-07T04:50:10Z [load_day 2026-07-31] 2026-07-31 hour 7: 163961 events in 4 files, snapshot 2804536257571722181 (task 3516 ms: download 1076 ms overlapping gunzip 182 ms, parse 725 ms, sort 99 ms, write 1632 ms, index 178 ms: 4 candidates, 27030 repo-hours, 9 releases; waiting 393 ms; commit 829 ms)
2026-11-07T04:50:13Z [load_day 2026-07-31] 2026-07-31 hour 8: 161414 events in 4 files, snapshot 6033835855878999504 (task 3514 ms: download 1412 ms overlapping gunzip 187 ms, parse 741 ms, sort 97 ms, write 1509 ms, index 167 ms: 3 candidates, 26769 repo-hours, 8 releases; waiting 517 ms; commit 866 ms)
2026-11-07T04:50:14Z [load_day 2026-07-31] 2026-07-31 hour 9: 163085 events in 4 files, snapshot 2785467744314395697 (task 3540 ms: download 1381 ms overlapping gunzip 184 ms, parse 727 ms, sort 96 ms, write 1502 ms, index 188 ms: 2 candidates, 29086 repo-hours, 6 releases; waiting 535 ms; commit 876 ms)
2026-11-07T04:50:18Z [load_day 2026-07-31] 2026-07-31 hour 10: 161881 events in 4 files, snapshot 2732172212500957493 (task 3425 ms: download 1447 ms overlapping gunzip 191 ms, parse 756 ms, sort 110 ms, write 1353 ms, index 209 ms: 2 candidates, 31296 repo-hours, 16 releases; waiting 515 ms; commit 1107 ms)
2026-11-07T04:50:19Z [load_day 2026-07-31] 2026-07-31 hour 11: 167480 events in 4 files, snapshot 6568255345699537133 (task 3754 ms: download 1345 ms overlapping gunzip 197 ms, parse 757 ms, sort 100 ms, write 1523 ms, index 225 ms: 2 candidates, 33288 repo-hours, 10 releases; waiting 536 ms; commit 854 ms)
2026-11-07T04:50:21Z [load_day 2026-07-31] 2026-07-31 hour 12: 165378 events in 4 files, snapshot 8667087441749861880 (task 3353 ms: download 910 ms overlapping gunzip 185 ms, parse 751 ms, sort 100 ms, write 1514 ms, index 191 ms: 3 candidates, 30190 repo-hours, 9 releases; waiting 308 ms; commit 955 ms)
2026-11-07T04:50:23Z [load_day 2026-07-31] 2026-07-31 hour 13: 170991 events in 4 files, snapshot 6067304007323639055 (task 3589 ms: download 1324 ms overlapping gunzip 194 ms, parse 763 ms, sort 100 ms, write 1457 ms, index 246 ms: 2 candidates, 34061 repo-hours, 4 releases; waiting 525 ms; commit 997 ms)
2026-11-07T04:50:26Z [load_day 2026-07-31] 2026-07-31 hour 14: 164783 events in 4 files, snapshot 8244069228631760536 (task 3631 ms: download 1117 ms overlapping gunzip 188 ms, parse 753 ms, sort 109 ms, write 1505 ms, index 257 ms: 7 candidates, 36096 repo-hours, 5 releases; waiting 529 ms; commit 855 ms)
2026-11-07T04:50:27Z [load_day 2026-07-31] 2026-07-31 hour 15: 170194 events in 4 files, snapshot 7602540039988308802 (task 3699 ms: download 1399 ms overlapping gunzip 200 ms, parse 768 ms, sort 107 ms, write 1531 ms, index 266 ms: 3 candidates, 37858 repo-hours, 8 releases; waiting 523 ms; commit 842 ms)
2026-11-07T04:50:30Z [load_day 2026-07-31] 2026-07-31 hour 16: 166290 events in 4 files, snapshot 346314092745927563 (task 3775 ms: download 1399 ms overlapping gunzip 207 ms, parse 803 ms, sort 111 ms, write 1487 ms, index 291 ms: 2 candidates, 41786 repo-hours, 10 releases; waiting 540 ms; commit 830 ms)
2026-11-07T04:50:32Z [load_day 2026-07-31] 2026-07-31 hour 17: 168972 events in 4 files, snapshot 2792137607075682919 (task 3708 ms: download 1343 ms overlapping gunzip 206 ms, parse 799 ms, sort 107 ms, write 1490 ms, index 320 ms: 5 candidates, 45865 repo-hours, 11 releases; waiting 464 ms; commit 1187 ms)
2026-11-07T04:50:34Z [load_day 2026-07-31] 2026-07-31 hour 18: 164679 events in 4 files, snapshot 5006632846112515970 (task 3725 ms: download 1249 ms overlapping gunzip 204 ms, parse 771 ms, sort 118 ms, write 1434 ms, index 320 ms: 4 candidates, 45550 repo-hours, 14 releases; waiting 536 ms; commit 960 ms)
2026-11-07T04:50:36Z [load_day 2026-07-31] 2026-07-31 hour 19: 168078 events in 4 files, snapshot 1871947515910381465 (task 3717 ms: download 1484 ms overlapping gunzip 206 ms, parse 775 ms, sort 105 ms, write 1415 ms, index 318 ms: 6 candidates, 47129 repo-hours, 12 releases; waiting 532 ms; commit 966 ms)
2026-11-07T04:50:39Z [load_day 2026-07-31] 2026-07-31 hour 20: 170278 events in 4 files, snapshot 8518221779395348647 (task 3815 ms: download 1814 ms overlapping gunzip 204 ms, parse 770 ms, sort 110 ms, write 1605 ms, index 328 ms: 5 candidates, 46932 repo-hours, 15 releases; waiting 516 ms; commit 937 ms)
2026-11-07T04:50:41Z [load_day 2026-07-31] 2026-07-31 hour 21: 167280 events in 4 files, snapshot 1439289829242155781 (task 3747 ms: download 1561 ms overlapping gunzip 204 ms, parse 760 ms, sort 105 ms, write 1433 ms, index 344 ms: 17 candidates, 46230 repo-hours, 15 releases; waiting 545 ms; commit 1029 ms)
2026-11-07T04:50:43Z [load_day 2026-07-31] 2026-07-31 hour 22: 166779 events in 4 files, snapshot 6373035137425529641 (task 3753 ms: download 1330 ms overlapping gunzip 203 ms, parse 756 ms, sort 105 ms, write 1391 ms, index 259 ms: 2 candidates, 37678 repo-hours, 12 releases; waiting 541 ms; commit 925 ms)
2026-11-07T04:50:45Z [load_day 2026-07-31] 2026-07-31 hour 23: 170395 events in 4 files, snapshot 1758856509999964684 (task 3593 ms: download 1426 ms overlapping gunzip 204 ms, parse 778 ms, sort 100 ms, write 1441 ms, index 218 ms: 1 candidates, 32753 repo-hours, 25 releases; waiting 508 ms; commit 987 ms)
2026-11-07T04:50:50Z [load_day 2026-07-31] 2026-07-31: repo_hour merged from 24 files to 1 (908023 rows, 4443 ms)
2026-11-07T04:50:52Z [load_day 2026-07-31] 2026-07-31: index committed in 6580 ms (24 + 1 + 24 files)
2026-11-07T04:50:52Z [load_day 2026-07-31] 2026-07-31: 4013080 events in 24 hours
2026-11-07T04:50:52Z [load_day 2026-07-31] attempt 1 succeeded