orcaLog in

Runs · run 548

load_day 2026-05-19, attempt 1 succeeded

Host
4e84322b8c45:121615
Started
2026-11-07T06:23:16Z
Ended
2026-11-07T06:24:28Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/548/load_day/2026-05-19/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:23:16Z [load_day 2026-05-19] attempt 1 started
2026-11-07T06:23:25Z [load_day 2026-05-19] 2026-05-19 hour 0: 145104 events in 3 files, snapshot 983143796375281454 (task 5266 ms: download 1698 ms overlapping gunzip 328 ms, parse 1146 ms, sort 227 ms, write 2226 ms, index 471 ms: 7 candidates, 71775 repo-hours, 441 releases; waiting 527 ms; commit 1000 ms)
2026-11-07T06:23:26Z [load_day 2026-05-19] 2026-05-19 hour 1: 149757 events in 3 files, snapshot 6830741761870168258 (task 5159 ms: download 1443 ms overlapping gunzip 315 ms, parse 1082 ms, sort 148 ms, write 2347 ms, index 516 ms: 4 candidates, 76504 repo-hours, 364 releases; waiting 508 ms; commit 946 ms)
2026-11-07T06:23:30Z [load_day 2026-05-19] 2026-05-19 hour 2: 157886 events in 4 files, snapshot 231794067522382927 (task 4446 ms: download 1279 ms overlapping gunzip 244 ms, parse 877 ms, sort 114 ms, write 1857 ms, index 546 ms: 9 candidates, 88868 repo-hours, 161 releases; waiting 531 ms; commit 992 ms)
2026-11-07T06:23:31Z [load_day 2026-05-19] 2026-05-19 hour 3: 154814 events in 4 files, snapshot 6105036230975116971 (task 4467 ms: download 1624 ms overlapping gunzip 256 ms, parse 879 ms, sort 107 ms, write 1781 ms, index 522 ms: 6 candidates, 83179 repo-hours, 241 releases; waiting 571 ms; commit 1055 ms)
2026-11-07T06:23:35Z [load_day 2026-05-19] 2026-05-19 hour 4: 152095 events in 4 files, snapshot 2592385784602370457 (task 4531 ms: download 1313 ms overlapping gunzip 259 ms, parse 902 ms, sort 104 ms, write 1983 ms, index 495 ms: 5 candidates, 78939 repo-hours, 267 releases; waiting 521 ms; commit 1017 ms)
2026-11-07T06:23:36Z [load_day 2026-05-19] 2026-05-19 hour 5: 151637 events in 4 files, snapshot 4204577334521505636 (task 4796 ms: download 1646 ms overlapping gunzip 283 ms, parse 946 ms, sort 120 ms, write 2087 ms, index 487 ms: 3 candidates, 74624 repo-hours, 322 releases; waiting 531 ms; commit 1072 ms)
2026-11-07T06:23:40Z [load_day 2026-05-19] 2026-05-19 hour 6: 155112 events in 4 files, snapshot 6176592357752253642 (task 4315 ms: download 1687 ms overlapping gunzip 268 ms, parse 914 ms, sort 124 ms, write 1669 ms, index 533 ms: 9 candidates, 80193 repo-hours, 168 releases; waiting 542 ms; commit 1001 ms)
2026-11-07T06:23:41Z [load_day 2026-05-19] 2026-05-19 hour 7: 154736 events in 4 files, snapshot 7767013333999413493 (task 3992 ms: download 1580 ms overlapping gunzip 221 ms, parse 768 ms, sort 103 ms, write 1452 ms, index 535 ms: 9 candidates, 80604 repo-hours, 93 releases; waiting 519 ms; commit 958 ms)
2026-11-07T06:23:45Z [load_day 2026-05-19] 2026-05-19 hour 8: 148270 events in 3 files, snapshot 3436240473829861325 (task 4159 ms: download 1406 ms overlapping gunzip 235 ms, parse 842 ms, sort 98 ms, write 1388 ms, index 534 ms: 7 candidates, 81374 repo-hours, 86 releases; waiting 744 ms; commit 996 ms)
2026-11-07T06:23:46Z [load_day 2026-05-19] 2026-05-19 hour 9: 150916 events in 4 files, snapshot 7196413394532045878 (task 3563 ms: download 823 ms overlapping gunzip 207 ms, parse 728 ms, sort 104 ms, write 1538 ms, index 546 ms: 7 candidates, 81626 repo-hours, 78 releases; waiting 185 ms; commit 1070 ms)
2026-11-07T06:23:49Z [load_day 2026-05-19] 2026-05-19 hour 10: 153159 events in 4 files, snapshot 6367520919824576819 (task 3962 ms: download 1404 ms overlapping gunzip 226 ms, parse 815 ms, sort 95 ms, write 1506 ms, index 515 ms: 4 candidates, 79866 repo-hours, 68 releases; waiting 503 ms; commit 1072 ms)
2026-11-07T06:23:50Z [load_day 2026-05-19] 2026-05-19 hour 11: 149335 events in 3 files, snapshot 4484297733916482088 (task 3852 ms: download 1325 ms overlapping gunzip 218 ms, parse 810 ms, sort 102 ms, write 1357 ms, index 533 ms: 4 candidates, 82084 repo-hours, 63 releases; waiting 519 ms; commit 998 ms)
2026-11-07T06:23:53Z [load_day 2026-05-19] 2026-05-19 hour 12: 147393 events in 3 files, snapshot 5352788524683794951 (task 3626 ms: download 1104 ms overlapping gunzip 197 ms, parse 714 ms, sort 94 ms, write 1369 ms, index 552 ms: 6 candidates, 82486 repo-hours, 56 releases; waiting 487 ms; commit 1055 ms)
2026-11-07T06:23:54Z [load_day 2026-05-19] 2026-05-19 hour 13: 95980 events in 2 files, snapshot 1301711617657885246 (task 3008 ms: download 1090 ms overlapping gunzip 136 ms, parse 494 ms, sort 64 ms, write 1038 ms, index 393 ms: 8 candidates, 59752 repo-hours, 51 releases; waiting 547 ms; commit 914 ms)
2026-11-07T06:23:58Z [load_day 2026-05-19] 2026-05-19 hour 14: 147436 events in 3 files, snapshot 4642189588750692188 (task 3870 ms: download 1328 ms overlapping gunzip 198 ms, parse 707 ms, sort 98 ms, write 1469 ms, index 596 ms: 6 candidates, 88590 repo-hours, 47 releases; waiting 538 ms; commit 1088 ms)
2026-11-07T06:23:59Z [load_day 2026-05-19] 2026-05-19 hour 15: 146727 events in 3 files, snapshot 3595757459857236169 (task 3891 ms: download 1496 ms overlapping gunzip 198 ms, parse 730 ms, sort 103 ms, write 1455 ms, index 576 ms: 6 candidates, 85796 repo-hours, 88 releases; waiting 536 ms; commit 1095 ms)
2026-11-07T06:24:02Z [load_day 2026-05-19] 2026-05-19 hour 16: 153643 events in 4 files, snapshot 3284743614773846327 (task 3960 ms: download 1257 ms overlapping gunzip 218 ms, parse 807 ms, sort 113 ms, write 1472 ms, index 597 ms: 6 candidates, 82766 repo-hours, 65 releases; waiting 526 ms; commit 1209 ms)
2026-11-07T06:24:04Z [load_day 2026-05-19] 2026-05-19 hour 17: 154828 events in 4 files, snapshot 4479018244402823208 (task 4281 ms: download 1540 ms overlapping gunzip 224 ms, parse 793 ms, sort 118 ms, write 1691 ms, index 571 ms: 5 candidates, 81298 repo-hours, 118 releases; waiting 536 ms; commit 1269 ms)
2026-11-07T06:24:07Z [load_day 2026-05-19] 2026-05-19 hour 18: 154948 events in 4 files, snapshot 8398838590413382373 (task 4022 ms: download 1580 ms overlapping gunzip 208 ms, parse 783 ms, sort 111 ms, write 1536 ms, index 533 ms: 7 candidates, 80834 repo-hours, 72 releases; waiting 523 ms; commit 1054 ms)
2026-11-07T06:24:09Z [load_day 2026-05-19] 2026-05-19 hour 19: 155024 events in 4 files, snapshot 6890403005550728865 (task 3931 ms: download 1396 ms overlapping gunzip 205 ms, parse 771 ms, sort 101 ms, write 1456 ms, index 553 ms: 6 candidates, 82840 repo-hours, 58 releases; waiting 517 ms; commit 1029 ms)
2026-11-07T06:24:12Z [load_day 2026-05-19] 2026-05-19 hour 20: 154847 events in 4 files, snapshot 736883916149446851 (task 4183 ms: download 1417 ms overlapping gunzip 228 ms, parse 802 ms, sort 109 ms, write 1616 ms, index 560 ms: 7 candidates, 79498 repo-hours, 128 releases; waiting 519 ms; commit 1311 ms)
2026-11-07T06:24:14Z [load_day 2026-05-19] 2026-05-19 hour 21: 155206 events in 4 files, snapshot 4696850185232396128 (task 4213 ms: download 1395 ms overlapping gunzip 248 ms, parse 857 ms, sort 108 ms, write 1570 ms, index 495 ms: 7 candidates, 76561 repo-hours, 106 releases; waiting 514 ms; commit 1063 ms)
2026-11-07T06:24:17Z [load_day 2026-05-19] 2026-05-19 hour 22: 153265 events in 4 files, snapshot 351966456096258011 (task 4463 ms: download 1501 ms overlapping gunzip 273 ms, parse 994 ms, sort 120 ms, write 1763 ms, index 514 ms: 6 candidates, 76006 repo-hours, 234 releases; waiting 528 ms; commit 1113 ms)
2026-11-07T06:24:19Z [load_day 2026-05-19] 2026-05-19 hour 23: 150538 events in 4 files, snapshot 164031030130011366 (task 4688 ms: download 1538 ms overlapping gunzip 301 ms, parse 1031 ms, sort 143 ms, write 1988 ms, index 443 ms: 7 candidates, 70275 repo-hours, 472 releases; waiting 465 ms; commit 1008 ms)
2026-11-07T06:24:27Z [load_day 2026-05-19] 2026-05-19: repo_hour merged from 24 files to 1 (1906338 rows, 7677 ms)
2026-11-07T06:24:28Z [load_day 2026-05-19] 2026-05-19: index committed in 9243 ms (24 + 1 + 24 files)
2026-11-07T06:24:28Z [load_day 2026-05-19] 2026-05-19: 3592656 events in 24 hours
2026-11-07T06:24:28Z [load_day 2026-05-19] attempt 1 succeeded