orcaLog in

Runs · run 383

load_day 2026-07-13, attempt 1 succeeded

Host
4e84322b8c45:74951
Started
2026-11-07T05:09:25Z
Ended
2026-11-07T05:10:28Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/383/load_day/2026-07-13/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:09:25Z [load_day 2026-07-13] attempt 1 started
2026-11-07T05:09:31Z [load_day 2026-07-13] 2026-07-13 hour 0: 170983 events in 4 files, snapshot 1196614876033805697 (task 3659 ms: download 1451 ms overlapping gunzip 193 ms, parse 762 ms, sort 109 ms, write 1488 ms, index 272 ms: 3 candidates, 38836 repo-hours, 11 releases; waiting 544 ms; commit 891 ms)
2026-11-07T05:09:32Z [load_day 2026-07-13] 2026-07-13 hour 1: 168778 events in 4 files, snapshot 1578215557891245104 (task 3881 ms: download 1728 ms overlapping gunzip 224 ms, parse 862 ms, sort 113 ms, write 1479 ms, index 347 ms: 5 candidates, 47065 repo-hours, 9 releases; waiting 512 ms; commit 929 ms)
2026-11-07T05:09:36Z [load_day 2026-07-13] 2026-07-13 hour 2: 167792 events in 4 files, snapshot 7154086902781668693 (task 3873 ms: download 1544 ms overlapping gunzip 197 ms, parse 771 ms, sort 109 ms, write 1524 ms, index 311 ms: 5 candidates, 47069 repo-hours, 6 releases; waiting 524 ms; commit 975 ms)
2026-11-07T05:09:37Z [load_day 2026-07-13] 2026-07-13 hour 3: 168783 events in 4 files, snapshot 8638911669251276831 (task 3707 ms: download 1229 ms overlapping gunzip 198 ms, parse 771 ms, sort 105 ms, write 1500 ms, index 285 ms: 5 candidates, 39307 repo-hours, 9 releases; waiting 542 ms; commit 772 ms)
2026-11-07T05:09:40Z [load_day 2026-07-13] 2026-07-13 hour 4: 165884 events in 4 files, snapshot 1906063283874810434 (task 3495 ms: download 1330 ms overlapping gunzip 190 ms, parse 750 ms, sort 100 ms, write 1410 ms, index 219 ms: 5 candidates, 32205 repo-hours, 9 releases; waiting 535 ms; commit 992 ms)
2026-11-07T05:09:41Z [load_day 2026-07-13] 2026-07-13 hour 5: 166435 events in 4 files, snapshot 3679409862125508799 (task 3690 ms: download 1377 ms overlapping gunzip 210 ms, parse 778 ms, sort 108 ms, write 1476 ms, index 240 ms: 4 candidates, 34627 repo-hours, 51 releases; waiting 537 ms; commit 768 ms)
2026-11-07T05:09:45Z [load_day 2026-07-13] 2026-07-13 hour 6: 161565 events in 4 files, snapshot 7410448956002532243 (task 3778 ms: download 1666 ms overlapping gunzip 207 ms, parse 749 ms, sort 98 ms, write 1371 ms, index 286 ms: 2 candidates, 43435 repo-hours, 56 releases; waiting 538 ms; commit 941 ms)
2026-11-07T05:09:45Z [load_day 2026-07-13] 2026-07-13 hour 7: 164979 events in 4 files, snapshot 5228255929055551956 (task 3430 ms: download 1485 ms overlapping gunzip 213 ms, parse 757 ms, sort 104 ms, write 1374 ms, index 278 ms: 1 candidates, 41932 repo-hours, 13 releases; waiting 395 ms; commit 951 ms)
2026-11-07T05:09:49Z [load_day 2026-07-13] 2026-07-13 hour 8: 166773 events in 4 files, snapshot 6656899427195824220 (task 3605 ms: download 1185 ms overlapping gunzip 199 ms, parse 778 ms, sort 105 ms, write 1422 ms, index 283 ms: 2 candidates, 40762 repo-hours, 13 releases; waiting 529 ms; commit 956 ms)
2026-11-07T05:09:50Z [load_day 2026-07-13] 2026-07-13 hour 9: 168082 events in 4 files, snapshot 4755758036440658310 (task 3602 ms: download 1369 ms overlapping gunzip 205 ms, parse 746 ms, sort 96 ms, write 1418 ms, index 280 ms: 2 candidates, 39630 repo-hours, 5 releases; waiting 523 ms; commit 824 ms)
2026-11-07T05:09:53Z [load_day 2026-07-13] 2026-07-13 hour 10: 165584 events in 4 files, snapshot 599630894196562048 (task 3736 ms: download 1381 ms overlapping gunzip 199 ms, parse 785 ms, sort 114 ms, write 1489 ms, index 302 ms: 2 candidates, 45044 repo-hours, 12 releases; waiting 520 ms; commit 834 ms)
2026-11-07T05:09:54Z [load_day 2026-07-13] 2026-07-13 hour 11: 166081 events in 4 files, snapshot 2887838475968981670 (task 3643 ms: download 1311 ms overlapping gunzip 192 ms, parse 745 ms, sort 100 ms, write 1480 ms, index 305 ms: 4 candidates, 43599 repo-hours, 10 releases; waiting 519 ms; commit 875 ms)
2026-11-07T05:09:58Z [load_day 2026-07-13] 2026-07-13 hour 12: 168181 events in 4 files, snapshot 2478680782788843495 (task 3777 ms: download 1623 ms overlapping gunzip 216 ms, parse 766 ms, sort 103 ms, write 1520 ms, index 335 ms: 6 candidates, 43483 repo-hours, 12 releases; waiting 519 ms; commit 934 ms)
2026-11-07T05:09:58Z [load_day 2026-07-13] 2026-07-13 hour 13: 166069 events in 4 files, snapshot 4066357662435355599 (task 3568 ms: download 1244 ms overlapping gunzip 195 ms, parse 741 ms, sort 99 ms, write 1400 ms, index 310 ms: 2 candidates, 45599 repo-hours, 11 releases; waiting 527 ms; commit 859 ms)
2026-11-07T05:10:02Z [load_day 2026-07-13] 2026-07-13 hour 14: 160676 events in 4 files, snapshot 6554479365000962191 (task 3734 ms: download 1296 ms overlapping gunzip 199 ms, parse 756 ms, sort 98 ms, write 1483 ms, index 352 ms: 3 candidates, 50971 repo-hours, 12 releases; waiting 518 ms; commit 1524 ms)
2026-11-07T05:10:03Z [load_day 2026-07-13] 2026-07-13 hour 15: 163458 events in 4 files, snapshot 1265544430885720966 (task 3811 ms: download 1280 ms overlapping gunzip 193 ms, parse 741 ms, sort 104 ms, write 1632 ms, index 360 ms: 3 candidates, 48566 repo-hours, 15 releases; waiting 515 ms; commit 949 ms)
2026-11-07T05:10:06Z [load_day 2026-07-13] 2026-07-13 hour 16: 165172 events in 4 files, snapshot 7969294525540525103 (task 3708 ms: download 1243 ms overlapping gunzip 196 ms, parse 734 ms, sort 105 ms, write 1510 ms, index 419 ms: 6 candidates, 56527 repo-hours, 15 releases; waiting 529 ms; commit 816 ms)
2026-11-07T05:10:08Z [load_day 2026-07-13] 2026-07-13 hour 17: 161670 events in 4 files, snapshot 5979593512320427915 (task 3778 ms: download 1315 ms overlapping gunzip 200 ms, parse 740 ms, sort 103 ms, write 1500 ms, index 403 ms: 12 candidates, 62318 repo-hours, 20 releases; waiting 523 ms; commit 928 ms)
2026-11-07T05:10:11Z [load_day 2026-07-13] 2026-07-13 hour 18: 165281 events in 4 files, snapshot 4141792956097691053 (task 4030 ms: download 1519 ms overlapping gunzip 207 ms, parse 756 ms, sort 105 ms, write 1641 ms, index 450 ms: 6 candidates, 63106 repo-hours, 20 releases; waiting 519 ms; commit 975 ms)
2026-11-07T05:10:12Z [load_day 2026-07-13] 2026-07-13 hour 19: 163775 events in 4 files, snapshot 6550534451365237952 (task 3902 ms: download 1262 ms overlapping gunzip 206 ms, parse 754 ms, sort 105 ms, write 1550 ms, index 426 ms: 3 candidates, 63146 repo-hours, 17 releases; waiting 550 ms; commit 861 ms)
2026-11-07T05:10:16Z [load_day 2026-07-13] 2026-07-13 hour 20: 163266 events in 4 files, snapshot 4868340973147012676 (task 3918 ms: download 1349 ms overlapping gunzip 214 ms, parse 787 ms, sort 105 ms, write 1483 ms, index 479 ms: 8 candidates, 60903 repo-hours, 26 releases; waiting 511 ms; commit 973 ms)
2026-11-07T05:10:17Z [load_day 2026-07-13] 2026-07-13 hour 21: 166817 events in 4 files, snapshot 2274214985315348244 (task 3848 ms: download 1639 ms overlapping gunzip 201 ms, parse 771 ms, sort 103 ms, write 1526 ms, index 396 ms: 7 candidates, 59621 repo-hours, 28 releases; waiting 537 ms; commit 917 ms)
2026-11-07T05:10:20Z [load_day 2026-07-13] 2026-07-13 hour 22: 162920 events in 4 files, snapshot 8267229089608506103 (task 3514 ms: download 1008 ms overlapping gunzip 194 ms, parse 748 ms, sort 108 ms, write 1566 ms, index 426 ms: 2 candidates, 58867 repo-hours, 34 releases; waiting 253 ms; commit 996 ms)
2026-11-07T05:10:21Z [load_day 2026-07-13] 2026-07-13 hour 23: 168968 events in 4 files, snapshot 6527661735564707690 (task 3890 ms: download 1428 ms overlapping gunzip 204 ms, parse 766 ms, sort 110 ms, write 1547 ms, index 411 ms: 2 candidates, 61546 repo-hours, 17 releases; waiting 545 ms; commit 1055 ms)
2026-11-07T05:10:27Z [load_day 2026-07-13] 2026-07-13: repo_hour merged from 24 files to 1 (1168164 rows, 5264 ms)
2026-11-07T05:10:28Z [load_day 2026-07-13] 2026-07-13: index committed in 6931 ms (24 + 1 + 24 files)
2026-11-07T05:10:28Z [load_day 2026-07-13] 2026-07-13: 3977972 events in 24 hours
2026-11-07T05:10:28Z [load_day 2026-07-13] attempt 1 succeeded