orcaLog in

Runs · run 2037

load_day 2024-02-02, attempt 1 succeeded

Host
73ccef5e07c2:81744
Started
2026-11-08T04:27:04Z
Ended
2026-11-08T04:29:09Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
682 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
181.2 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2037/load_day/2024-02-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:27:04Z [load_day 2024-02-02] attempt 1 started
2026-11-08T04:27:05Z [load_day 2024-02-02] 2024-02-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:27:15Z [load_day 2024-02-02] 2024-02-02 hour 0: 223217 events in 0 files, snapshot none (task 9573 ms: download 5618 ms overlapping gunzip 1343 ms, parse 5511 ms, sort 0 ms, write 0 ms, index 1902 ms: 8 candidates, 91997 repo-hours, 1127 releases; waiting 507 ms; commit 0 ms)
2026-11-08T04:27:15Z [load_day 2024-02-02] 2024-02-02 hour 1: 225586 events in 0 files, snapshot none (task 7556 ms: download 4828 ms overlapping gunzip 1113 ms, parse 5053 ms, sort 0 ms, write 0 ms, index 656 ms: 6 candidates, 95204 repo-hours, 832 releases; waiting 495 ms; commit 0 ms)
2026-11-08T04:27:27Z [load_day 2024-02-02] 2024-02-02 hour 2: 198432 events in 0 files, snapshot none (task 7419 ms: download 4566 ms overlapping gunzip 1159 ms, parse 4702 ms, sort 0 ms, write 0 ms, index 707 ms: 7 candidates, 64527 repo-hours, 810 releases; waiting 510 ms; commit 0 ms)
2026-11-08T04:27:27Z [load_day 2024-02-02] 2024-02-02 hour 3: 197262 events in 0 files, snapshot none (task 7105 ms: download 4458 ms overlapping gunzip 1117 ms, parse 4511 ms, sort 0 ms, write 0 ms, index 609 ms: 8 candidates, 63092 repo-hours, 775 releases; waiting 531 ms; commit 0 ms)
2026-11-08T04:27:34Z [load_day 2024-02-02] 2024-02-02 hour 4: 184284 events in 0 files, snapshot none (task 6308 ms: download 3837 ms overlapping gunzip 934 ms, parse 4004 ms, sort 0 ms, write 0 ms, index 645 ms: 3 candidates, 57963 repo-hours, 617 releases; waiting 511 ms; commit 0 ms)
2026-11-08T04:27:35Z [load_day 2024-02-02] 2024-02-02 hour 5: 193600 events in 0 files, snapshot none (task 7580 ms: download 4218 ms overlapping gunzip 1093 ms, parse 4818 ms, sort 0 ms, write 0 ms, index 540 ms: 3 candidates, 62734 repo-hours, 737 releases; waiting 499 ms; commit 0 ms)
2026-11-08T04:27:42Z [load_day 2024-02-02] 2024-02-02 hour 6: 217757 events in 0 files, snapshot none (task 8279 ms: download 5031 ms overlapping gunzip 1263 ms, parse 5385 ms, sort 0 ms, write 0 ms, index 768 ms: 8 candidates, 74758 repo-hours, 843 releases; waiting 497 ms; commit 0 ms)
2026-11-08T04:27:44Z [load_day 2024-02-02] 2024-02-02 hour 7: 215954 events in 0 files, snapshot none (task 8891 ms: download 5756 ms overlapping gunzip 1317 ms, parse 5977 ms, sort 0 ms, write 0 ms, index 871 ms: 8 candidates, 72744 repo-hours, 785 releases; waiting 466 ms; commit 0 ms)
2026-11-08T04:27:52Z [load_day 2024-02-02] 2024-02-02 hour 8: 234001 events in 0 files, snapshot none (task 8801 ms: download 5331 ms overlapping gunzip 1276 ms, parse 5759 ms, sort 0 ms, write 0 ms, index 938 ms: 11 candidates, 78438 repo-hours, 936 releases; waiting 530 ms; commit 0 ms)
2026-11-08T04:27:54Z [load_day 2024-02-02] 2024-02-02 hour 9: 261674 events in 0 files, snapshot none (task 9271 ms: download 6662 ms overlapping gunzip 1559 ms, parse 6337 ms, sort 0 ms, write 0 ms, index 650 ms: 3 candidates, 86080 repo-hours, 1169 releases; waiting 485 ms; commit 0 ms)
2026-11-08T04:28:01Z [load_day 2024-02-02] 2024-02-02 hour 10: 260008 events in 0 files, snapshot none (task 9155 ms: download 5471 ms overlapping gunzip 1355 ms, parse 6011 ms, sort 0 ms, write 0 ms, index 957 ms: 7 candidates, 83989 repo-hours, 1083 releases; waiting 538 ms; commit 0 ms)
2026-11-08T04:28:03Z [load_day 2024-02-02] 2024-02-02 hour 11: 249878 events in 0 files, snapshot none (task 8720 ms: download 6002 ms overlapping gunzip 1285 ms, parse 5849 ms, sort 0 ms, write 0 ms, index 767 ms: 5 candidates, 78212 repo-hours, 1427 releases; waiting 525 ms; commit 0 ms)
2026-11-08T04:28:10Z [load_day 2024-02-02] 2024-02-02 hour 12: 306593 events in 0 files, snapshot none (task 8617 ms: download 4549 ms overlapping gunzip 1183 ms, parse 5517 ms, sort 0 ms, write 0 ms, index 1022 ms: 6 candidates, 109711 repo-hours, 1185 releases; waiting 543 ms; commit 0 ms)
2026-11-08T04:28:15Z [load_day 2024-02-02] 2024-02-02 hour 13: 274568 events in 0 files, snapshot none (task 11296 ms: download 7941 ms overlapping gunzip 1701 ms, parse 7127 ms, sort 0 ms, write 0 ms, index 764 ms: 5 candidates, 100310 repo-hours, 1144 releases; waiting 1443 ms; commit 0 ms)
2026-11-08T04:28:19Z [load_day 2024-02-02] 2024-02-02 hour 14: 269236 events in 0 files, snapshot none (task 8115 ms: download 5325 ms overlapping gunzip 1293 ms, parse 5280 ms, sort 0 ms, write 0 ms, index 831 ms: 10 candidates, 91753 repo-hours, 1178 releases; waiting 501 ms; commit 0 ms)
2026-11-08T04:28:23Z [load_day 2024-02-02] 2024-02-02 hour 15: 275643 events in 0 files, snapshot none (task 8034 ms: download 5326 ms overlapping gunzip 1257 ms, parse 5195 ms, sort 0 ms, write 0 ms, index 735 ms: 12 candidates, 95025 repo-hours, 1475 releases; waiting 528 ms; commit 0 ms)
2026-11-08T04:28:27Z [load_day 2024-02-02] 2024-02-02 hour 16: 268538 events in 0 files, snapshot none (task 7768 ms: download 5082 ms overlapping gunzip 1184 ms, parse 4904 ms, sort 0 ms, write 0 ms, index 865 ms: 12 candidates, 90832 repo-hours, 1234 releases; waiting 538 ms; commit 0 ms)
2026-11-08T04:28:33Z [load_day 2024-02-02] 2024-02-02 hour 17: 253885 events in 0 files, snapshot none (task 8974 ms: download 4875 ms overlapping gunzip 1355 ms, parse 5737 ms, sort 0 ms, write 0 ms, index 1064 ms: 10 candidates, 85430 repo-hours, 1105 releases; waiting 556 ms; commit 0 ms)
2026-11-08T04:28:38Z [load_day 2024-02-02] 2024-02-02 hour 18: 255471 events in 0 files, snapshot none (task 10160 ms: download 7456 ms overlapping gunzip 1651 ms, parse 7080 ms, sort 0 ms, write 0 ms, index 755 ms: 9 candidates, 87637 repo-hours, 1028 releases; waiting 443 ms; commit 0 ms)
2026-11-08T04:28:42Z [load_day 2024-02-02] 2024-02-02 hour 19: 235734 events in 0 files, snapshot none (task 8243 ms: download 5087 ms overlapping gunzip 1317 ms, parse 5305 ms, sort 0 ms, write 0 ms, index 735 ms: 9 candidates, 74174 repo-hours, 949 releases; waiting 519 ms; commit 0 ms)
2026-11-08T04:28:47Z [load_day 2024-02-02] 2024-02-02 hour 20: 235739 events in 0 files, snapshot none (task 8589 ms: download 5207 ms overlapping gunzip 1402 ms, parse 5749 ms, sort 0 ms, write 0 ms, index 676 ms: 8 candidates, 72602 repo-hours, 886 releases; waiting 477 ms; commit 0 ms)
2026-11-08T04:28:50Z [load_day 2024-02-02] 2024-02-02 hour 21: 225101 events in 0 files, snapshot none (task 7812 ms: download 5175 ms overlapping gunzip 1163 ms, parse 5076 ms, sort 0 ms, write 0 ms, index 656 ms: 11 candidates, 66550 repo-hours, 1010 releases; waiting 584 ms; commit 0 ms)
2026-11-08T04:28:55Z [load_day 2024-02-02] 2024-02-02 hour 22: 212909 events in 0 files, snapshot none (task 7559 ms: download 5132 ms overlapping gunzip 1228 ms, parse 4948 ms, sort 0 ms, write 0 ms, index 613 ms: 13 candidates, 61749 repo-hours, 990 releases; waiting 512 ms; commit 0 ms)
2026-11-08T04:28:57Z [load_day 2024-02-02] 2024-02-02 hour 23: 197984 events in 0 files, snapshot none (task 6566 ms: download 4182 ms overlapping gunzip 1008 ms, parse 4353 ms, sort 0 ms, write 0 ms, index 378 ms: 9 candidates, 55050 repo-hours, 826 releases; waiting 516 ms; commit 0 ms)
2026-11-08T04:29:06Z [load_day 2024-02-02] 2024-02-02: repo_hour merged from 24 files to 1 (1900561 rows, 8791 ms)
2026-11-08T04:29:09Z [load_day 2024-02-02] 2024-02-02: index committed in 11456 ms (24 + 1 + 24 files)
2026-11-08T04:29:09Z [load_day 2024-02-02] 2024-02-02: 5673054 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:29:09Z [load_day 2024-02-02] attempt 1 succeeded