orcaLog in

Runs · run 2058

load_day 2024-02-07, attempt 1 succeeded

Host
73ccef5e07c2:84074
Started
2026-11-08T04:32:10Z
Ended
2026-11-08T04:34:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
732 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
186.7 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2058/load_day/2024-02-07/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:32:10Z [load_day 2024-02-07] attempt 1 started
2026-11-08T04:32:11Z [load_day 2024-02-07] 2024-02-07: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:32:21Z [load_day 2024-02-07] 2024-02-07 hour 0: 235410 events in 0 files, snapshot none (task 9627 ms: download 6365 ms overlapping gunzip 1494 ms, parse 6515 ms, sort 0 ms, write 0 ms, index 815 ms: 8 candidates, 95343 repo-hours, 1080 releases; waiting 504 ms; commit 0 ms)
2026-11-08T04:32:21Z [load_day 2024-02-07] 2024-02-07 hour 1: 226136 events in 0 files, snapshot none (task 8790 ms: download 5462 ms overlapping gunzip 1267 ms, parse 5548 ms, sort 0 ms, write 0 ms, index 808 ms: 6 candidates, 92928 repo-hours, 700 releases; waiting 476 ms; commit 0 ms)
2026-11-08T04:32:29Z [load_day 2024-02-07] 2024-02-07 hour 2: 200475 events in 0 files, snapshot none (task 8016 ms: download 4740 ms overlapping gunzip 1261 ms, parse 5544 ms, sort 0 ms, write 0 ms, index 510 ms: 6 candidates, 60913 repo-hours, 715 releases; waiting 389 ms; commit 0 ms)
2026-11-08T04:32:29Z [load_day 2024-02-07] 2024-02-07 hour 3: 197095 events in 0 files, snapshot none (task 7611 ms: download 4634 ms overlapping gunzip 1180 ms, parse 5146 ms, sort 0 ms, write 0 ms, index 507 ms: 4 candidates, 60013 repo-hours, 843 releases; waiting 521 ms; commit 0 ms)
2026-11-08T04:32:37Z [load_day 2024-02-07] 2024-02-07 hour 4: 198413 events in 0 files, snapshot none (task 7027 ms: download 3260 ms overlapping gunzip 1068 ms, parse 4354 ms, sort 0 ms, write 0 ms, index 704 ms: 3 candidates, 58168 repo-hours, 762 releases; waiting 555 ms; commit 0 ms)
2026-11-08T04:32:38Z [load_day 2024-02-07] 2024-02-07 hour 5: 205406 events in 0 files, snapshot none (task 7779 ms: download 4058 ms overlapping gunzip 1270 ms, parse 5035 ms, sort 0 ms, write 0 ms, index 623 ms: 4 candidates, 61804 repo-hours, 735 releases; waiting 295 ms; commit 0 ms)
2026-11-08T04:32:44Z [load_day 2024-02-07] 2024-02-07 hour 6: 226323 events in 0 files, snapshot none (task 6229 ms: download 3646 ms overlapping gunzip 936 ms, parse 3960 ms, sort 0 ms, write 0 ms, index 645 ms: 8 candidates, 75807 repo-hours, 863 releases; waiting 395 ms; commit 0 ms)
2026-11-08T04:32:45Z [load_day 2024-02-07] 2024-02-07 hour 7: 228857 events in 0 files, snapshot none (task 6390 ms: download 4683 ms overlapping gunzip 925 ms, parse 3892 ms, sort 0 ms, write 0 ms, index 582 ms: 11 candidates, 73539 repo-hours, 770 releases; waiting 675 ms; commit 0 ms)
2026-11-08T04:32:50Z [load_day 2024-02-07] 2024-02-07 hour 8: 226343 events in 0 files, snapshot none (task 6079 ms: download 3579 ms overlapping gunzip 910 ms, parse 3794 ms, sort 0 ms, write 0 ms, index 587 ms: 7 candidates, 77689 repo-hours, 921 releases; waiting 513 ms; commit 0 ms)
2026-11-08T04:32:53Z [load_day 2024-02-07] 2024-02-07 hour 9: 254769 events in 0 files, snapshot none (task 7642 ms: download 5020 ms overlapping gunzip 1182 ms, parse 4866 ms, sort 0 ms, write 0 ms, index 674 ms: 11 candidates, 87564 repo-hours, 1183 releases; waiting 544 ms; commit 0 ms)
2026-11-08T04:33:00Z [load_day 2024-02-07] 2024-02-07 hour 10: 256328 events in 0 files, snapshot none (task 9626 ms: download 5922 ms overlapping gunzip 1430 ms, parse 6061 ms, sort 0 ms, write 0 ms, index 636 ms: 5 candidates, 87455 repo-hours, 1013 releases; waiting 640 ms; commit 0 ms)
2026-11-08T04:33:02Z [load_day 2024-02-07] 2024-02-07 hour 11: 243413 events in 0 files, snapshot none (task 8309 ms: download 5594 ms overlapping gunzip 1248 ms, parse 5560 ms, sort 0 ms, write 0 ms, index 696 ms: 5 candidates, 81105 repo-hours, 909 releases; waiting 512 ms; commit 0 ms)
2026-11-08T04:33:10Z [load_day 2024-02-07] 2024-02-07 hour 12: 303370 events in 0 files, snapshot none (task 9357 ms: download 6145 ms overlapping gunzip 1386 ms, parse 6423 ms, sort 0 ms, write 0 ms, index 845 ms: 9 candidates, 114857 repo-hours, 1064 releases; waiting 497 ms; commit 0 ms)
2026-11-08T04:33:13Z [load_day 2024-02-07] 2024-02-07 hour 13: 277692 events in 0 files, snapshot none (task 10980 ms: download 7284 ms overlapping gunzip 1538 ms, parse 7105 ms, sort 0 ms, write 0 ms, index 1542 ms: 9 candidates, 108434 repo-hours, 1227 releases; waiting 524 ms; commit 0 ms)
2026-11-08T04:33:20Z [load_day 2024-02-07] 2024-02-07 hour 14: 275723 events in 0 files, snapshot none (task 9904 ms: download 6544 ms overlapping gunzip 1544 ms, parse 6540 ms, sort 0 ms, write 0 ms, index 943 ms: 8 candidates, 98448 repo-hours, 1340 releases; waiting 518 ms; commit 0 ms)
2026-11-08T04:33:23Z [load_day 2024-02-07] 2024-02-07 hour 15: 277784 events in 0 files, snapshot none (task 9641 ms: download 6492 ms overlapping gunzip 1376 ms, parse 6339 ms, sort 0 ms, write 0 ms, index 1120 ms: 6 candidates, 104025 repo-hours, 1515 releases; waiting 521 ms; commit 0 ms)
2026-11-08T04:33:32Z [load_day 2024-02-07] 2024-02-07 hour 16: 275277 events in 0 files, snapshot none (task 10910 ms: download 7550 ms overlapping gunzip 1707 ms, parse 7534 ms, sort 0 ms, write 0 ms, index 871 ms: 11 candidates, 101162 repo-hours, 1220 releases; waiting 516 ms; commit 0 ms)
2026-11-08T04:33:34Z [load_day 2024-02-07] 2024-02-07 hour 17: 259903 events in 0 files, snapshot none (task 9883 ms: download 6793 ms overlapping gunzip 1591 ms, parse 6381 ms, sort 0 ms, write 0 ms, index 1045 ms: 9 candidates, 90411 repo-hours, 1224 releases; waiting 515 ms; commit 0 ms)
2026-11-08T04:33:42Z [load_day 2024-02-07] 2024-02-07 hour 18: 267636 events in 0 files, snapshot none (task 10065 ms: download 7239 ms overlapping gunzip 1687 ms, parse 6832 ms, sort 0 ms, write 0 ms, index 787 ms: 10 candidates, 97245 repo-hours, 1154 releases; waiting 468 ms; commit 0 ms)
2026-11-08T04:33:44Z [load_day 2024-02-07] 2024-02-07 hour 19: 266255 events in 0 files, snapshot none (task 9307 ms: download 6628 ms overlapping gunzip 1564 ms, parse 6565 ms, sort 0 ms, write 0 ms, index 733 ms: 9 candidates, 85436 repo-hours, 1065 releases; waiting 167 ms; commit 0 ms)
2026-11-08T04:33:52Z [load_day 2024-02-07] 2024-02-07 hour 20: 256227 events in 0 files, snapshot none (task 9418 ms: download 6625 ms overlapping gunzip 1418 ms, parse 6418 ms, sort 0 ms, write 0 ms, index 770 ms: 11 candidates, 80590 repo-hours, 993 releases; waiting 494 ms; commit 0 ms)
2026-11-08T04:33:53Z [load_day 2024-02-07] 2024-02-07 hour 21: 240766 events in 0 files, snapshot none (task 8905 ms: download 6154 ms overlapping gunzip 1395 ms, parse 6109 ms, sort 0 ms, write 0 ms, index 619 ms: 9 candidates, 76243 repo-hours, 1023 releases; waiting 488 ms; commit 0 ms)
2026-11-08T04:34:01Z [load_day 2024-02-07] 2024-02-07 hour 22: 225959 events in 0 files, snapshot none (task 8158 ms: download 5213 ms overlapping gunzip 1272 ms, parse 5331 ms, sort 0 ms, write 0 ms, index 761 ms: 5 candidates, 67375 repo-hours, 1029 releases; waiting 510 ms; commit 0 ms)
2026-11-08T04:34:01Z [load_day 2024-02-07] 2024-02-07 hour 23: 209679 events in 0 files, snapshot none (task 7641 ms: download 4907 ms overlapping gunzip 1180 ms, parse 5173 ms, sort 0 ms, write 0 ms, index 559 ms: 8 candidates, 60748 repo-hours, 773 releases; waiting 473 ms; commit 0 ms)
2026-11-08T04:34:11Z [load_day 2024-02-07] 2024-02-07: repo_hour merged from 24 files to 1 (1997302 rows, 9661 ms)
2026-11-08T04:34:13Z [load_day 2024-02-07] 2024-02-07: index committed in 12332 ms (24 + 1 + 24 files)
2026-11-08T04:34:13Z [load_day 2024-02-07] 2024-02-07: 5835239 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:34:13Z [load_day 2024-02-07] attempt 1 succeeded