orcaLog in

Runs · run 11

load_day 2023-01-05, attempt 1 succeeded

Host
4e84322b8c45:5483
Started
2026-11-07T02:59:25Z
Ended
2026-11-07T03:03:05Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/11/load_day/2023-01-05/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T02:59:25Z [load_day 2023-01-05] attempt 1 started
2026-11-07T02:59:44Z [load_day 2023-01-05] 2023-01-05 hour 0: 177308 events in 4 files, snapshot 6621012546910588037 (task 16527 ms: download 4866 ms overlapping gunzip 1269 ms, parse 5684 ms, sort 554 ms, write 7613 ms, index 496 ms: 2 candidates, 83898 repo-hours, 893 releases; waiting 557 ms; commit 566 ms)
2026-11-07T02:59:44Z [load_day 2023-01-05] 2023-01-05 hour 1: 180241 events in 4 files, snapshot 6585751985804711298 (task 16557 ms: download 5095 ms overlapping gunzip 1300 ms, parse 5729 ms, sort 608 ms, write 7594 ms, index 528 ms: 1 candidates, 90895 repo-hours, 812 releases; waiting 451 ms; commit 294 ms)
2026-11-07T03:00:01Z [load_day 2023-01-05] 2023-01-05 hour 2: 154508 events in 4 files, snapshot 5558001966185956631 (task 16642 ms: download 4099 ms overlapping gunzip 1554 ms, parse 6314 ms, sort 711 ms, write 7035 ms, index 457 ms: 7 candidates, 74071 repo-hours, 490 releases; waiting 310 ms; commit 616 ms)
2026-11-07T03:00:02Z [load_day 2023-01-05] 2023-01-05 hour 3: 172932 events in 4 files, snapshot 7279156690172517078 (task 16049 ms: download 6522 ms overlapping gunzip 1283 ms, parse 5735 ms, sort 459 ms, write 6346 ms, index 458 ms: 9 candidates, 70293 repo-hours, 773 releases; waiting 1447 ms; commit 620 ms)
2026-11-07T03:00:14Z [load_day 2023-01-05] 2023-01-05 hour 4: 142973 events in 3 files, snapshot 4736504925528245829 (task 12009 ms: download 4666 ms overlapping gunzip 932 ms, parse 4571 ms, sort 315 ms, write 4803 ms, index 467 ms: 4 candidates, 58098 repo-hours, 597 releases; waiting 569 ms; commit 840 ms)
2026-11-07T03:00:18Z [load_day 2023-01-05] 2023-01-05 hour 5: 178294 events in 4 files, snapshot 8594462375285964131 (task 16244 ms: download 4814 ms overlapping gunzip 1288 ms, parse 6113 ms, sort 517 ms, write 6751 ms, index 712 ms: 3 candidates, 75980 repo-hours, 700 releases; waiting 506 ms; commit 515 ms)
2026-11-07T03:00:31Z [load_day 2023-01-05] 2023-01-05 hour 6: 181887 events in 4 files, snapshot 7102001890513886403 (task 16497 ms: download 4014 ms overlapping gunzip 1276 ms, parse 6154 ms, sort 486 ms, write 7225 ms, index 527 ms: 4 candidates, 79207 repo-hours, 853 releases; waiting 518 ms; commit 522 ms)
2026-11-07T03:00:36Z [load_day 2023-01-05] 2023-01-05 hour 7: 186584 events in 4 files, snapshot 5440494611057351586 (task 16637 ms: download 4380 ms overlapping gunzip 1271 ms, parse 6092 ms, sort 559 ms, write 7209 ms, index 662 ms: 2 candidates, 79465 repo-hours, 811 releases; waiting 515 ms; commit 655 ms)
2026-11-07T03:00:48Z [load_day 2023-01-05] 2023-01-05 hour 8: 198686 events in 4 files, snapshot 2606343179890523302 (task 15873 ms: download 5594 ms overlapping gunzip 1302 ms, parse 5898 ms, sort 383 ms, write 6756 ms, index 563 ms: 9 candidates, 86057 repo-hours, 888 releases; waiting 670 ms; commit 622 ms)
2026-11-07T03:00:53Z [load_day 2023-01-05] 2023-01-05 hour 9: 203058 events in 5 files, snapshot 6672024328172111047 (task 16595 ms: download 4289 ms overlapping gunzip 1368 ms, parse 6285 ms, sort 375 ms, write 7290 ms, index 490 ms: 6 candidates, 88452 repo-hours, 1016 releases; waiting 540 ms; commit 716 ms)
2026-11-07T03:01:06Z [load_day 2023-01-05] 2023-01-05 hour 10: 203410 events in 5 files, snapshot 2690189449700204035 (task 17303 ms: download 4314 ms overlapping gunzip 1391 ms, parse 6427 ms, sort 504 ms, write 7337 ms, index 532 ms: 3 candidates, 87500 repo-hours, 986 releases; waiting 557 ms; commit 583 ms)
2026-11-07T03:01:09Z [load_day 2023-01-05] 2023-01-05 hour 11: 195535 events in 4 files, snapshot 2174586102155157498 (task 15575 ms: download 5653 ms overlapping gunzip 1285 ms, parse 5971 ms, sort 390 ms, write 6620 ms, index 483 ms: 3 candidates, 82272 repo-hours, 955 releases; waiting 520 ms; commit 668 ms)
2026-11-07T03:01:22Z [load_day 2023-01-05] 2023-01-05 hour 12: 210375 events in 5 files, snapshot 235518134420255598 (task 15476 ms: download 4549 ms overlapping gunzip 1103 ms, parse 5163 ms, sort 367 ms, write 7369 ms, index 562 ms: 2 candidates, 101321 repo-hours, 1071 releases; waiting 599 ms; commit 656 ms)
2026-11-07T03:01:25Z [load_day 2023-01-05] 2023-01-05 hour 13: 209422 events in 5 files, snapshot 8383024422080516650 (task 14608 ms: download 4219 ms overlapping gunzip 1037 ms, parse 4764 ms, sort 325 ms, write 7144 ms, index 541 ms: 7 candidates, 96597 repo-hours, 1029 releases; waiting 515 ms; commit 683 ms)
2026-11-07T03:01:37Z [load_day 2023-01-05] 2023-01-05 hour 14: 201341 events in 5 files, snapshot 2237172940270188003 (task 14902 ms: download 4155 ms overlapping gunzip 1042 ms, parse 4886 ms, sort 372 ms, write 7049 ms, index 486 ms: 0 candidates, 85557 repo-hours, 1067 releases; waiting 694 ms; commit 597 ms)
2026-11-07T03:01:41Z [load_day 2023-01-05] 2023-01-05 hour 15: 199286 events in 4 files, snapshot 6146234958796367896 (task 15375 ms: download 6628 ms overlapping gunzip 1054 ms, parse 4922 ms, sort 455 ms, write 6751 ms, index 503 ms: 5 candidates, 85721 repo-hours, 1198 releases; waiting 1221 ms; commit 536 ms)
2026-11-07T03:01:54Z [load_day 2023-01-05] 2023-01-05 hour 16: 193582 events in 4 files, snapshot 5202541832593038088 (task 16395 ms: download 3860 ms overlapping gunzip 1249 ms, parse 5689 ms, sort 384 ms, write 7666 ms, index 500 ms: 5 candidates, 87730 repo-hours, 1018 releases; waiting 533 ms; commit 559 ms)
2026-11-07T03:01:59Z [load_day 2023-01-05] 2023-01-05 hour 17: 201941 events in 5 files, snapshot 7250284224935810295 (task 17595 ms: download 7680 ms overlapping gunzip 1281 ms, parse 5972 ms, sort 409 ms, write 7030 ms, index 559 ms: 4 candidates, 86567 repo-hours, 965 releases; waiting 1926 ms; commit 443 ms)
2026-11-07T03:02:12Z [load_day 2023-01-05] 2023-01-05 hour 18: 203733 events in 5 files, snapshot 841576383983112197 (task 17288 ms: download 4457 ms overlapping gunzip 1293 ms, parse 6061 ms, sort 547 ms, write 7992 ms, index 529 ms: 3 candidates, 90580 repo-hours, 1021 releases; waiting 520 ms; commit 612 ms)
2026-11-07T03:02:16Z [load_day 2023-01-05] 2023-01-05 hour 19: 198933 events in 4 files, snapshot 6476812835653213611 (task 16660 ms: download 4548 ms overlapping gunzip 1175 ms, parse 5758 ms, sort 597 ms, write 7574 ms, index 586 ms: 5 candidates, 84641 repo-hours, 892 releases; waiting 527 ms; commit 577 ms)
2026-11-07T03:02:31Z [load_day 2023-01-05] 2023-01-05 hour 20: 200835 events in 5 files, snapshot 5317752071421316619 (task 18268 ms: download 5642 ms overlapping gunzip 1506 ms, parse 6689 ms, sort 713 ms, write 7935 ms, index 529 ms: 7 candidates, 84413 repo-hours, 832 releases; waiting 548 ms; commit 500 ms)
2026-11-07T03:02:36Z [load_day 2023-01-05] 2023-01-05 hour 21: 196460 events in 4 files, snapshot 2808331049807038247 (task 19321 ms: download 5193 ms overlapping gunzip 1514 ms, parse 6836 ms, sort 748 ms, write 8619 ms, index 489 ms: 4 candidates, 81250 repo-hours, 907 releases; waiting 695 ms; commit 492 ms)
2026-11-07T03:02:53Z [load_day 2023-01-05] 2023-01-05 hour 22: 195318 events in 4 files, snapshot 3388746128662368644 (task 20683 ms: download 5234 ms overlapping gunzip 1746 ms, parse 7522 ms, sort 748 ms, write 9306 ms, index 453 ms: 5 candidates, 78966 repo-hours, 825 releases; waiting 528 ms; commit 655 ms)
2026-11-07T03:02:54Z [load_day 2023-01-05] 2023-01-05 hour 23: 175887 events in 4 files, snapshot 527603644298649896 (task 17636 ms: download 6177 ms overlapping gunzip 1496 ms, parse 6063 ms, sort 621 ms, write 8126 ms, index 392 ms: 3 candidates, 67819 repo-hours, 718 releases; waiting 579 ms; commit 479 ms)
2026-11-07T03:03:03Z [load_day 2023-01-05] 2023-01-05: repo_hour merged from 24 files to 1 (1987350 rows, 8169 ms)
2026-11-07T03:03:05Z [load_day 2023-01-05] 2023-01-05: index committed in 10313 ms (23 + 1 + 24 files)
2026-11-07T03:03:05Z [load_day 2023-01-05] 2023-01-05: 4562529 events in 24 hours
2026-11-07T03:03:05Z [load_day 2023-01-05] attempt 1 succeeded