orcaLog in

Runs · run 3929

load_day 2025-05-21, attempt 1 succeeded

Host
73ccef5e07c2:309219
Started
2026-11-08T12:03:58Z
Ended
2026-11-08T12:06:28Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
901 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
217.1 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3929/load_day/2025-05-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:03:58Z [load_day 2025-05-21] attempt 1 started
2026-11-08T12:03:59Z [load_day 2025-05-21] 2025-05-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:04:08Z [load_day 2025-05-21] 2025-05-21 hour 0: 202491 events in 0 files, snapshot none (task 8589 ms: download 5560 ms overlapping gunzip 1434 ms, parse 5543 ms, sort 0 ms, write 0 ms, index 723 ms: 12 candidates, 95148 repo-hours, 1213 releases; waiting 582 ms; commit 0 ms)
2026-11-08T12:04:08Z [load_day 2025-05-21] 2025-05-21 hour 1: 235284 events in 0 files, snapshot none (task 8323 ms: download 4835 ms overlapping gunzip 1252 ms, parse 5513 ms, sort 0 ms, write 0 ms, index 1042 ms: 9 candidates, 132371 repo-hours, 1019 releases; waiting 221 ms; commit 0 ms)
2026-11-08T12:04:19Z [load_day 2025-05-21] 2025-05-21 hour 2: 208020 events in 0 files, snapshot none (task 9801 ms: download 6822 ms overlapping gunzip 1530 ms, parse 6263 ms, sort 0 ms, write 0 ms, index 685 ms: 6 candidates, 96845 repo-hours, 863 releases; waiting 1065 ms; commit 0 ms)
2026-11-08T12:04:19Z [load_day 2025-05-21] 2025-05-21 hour 3: 216102 events in 0 files, snapshot none (task 9354 ms: download 6306 ms overlapping gunzip 1508 ms, parse 6140 ms, sort 0 ms, write 0 ms, index 872 ms: 8 candidates, 93477 repo-hours, 2773 releases; waiting 481 ms; commit 0 ms)
2026-11-08T12:04:28Z [load_day 2025-05-21] 2025-05-21 hour 4: 200780 events in 0 files, snapshot none (task 8658 ms: download 5359 ms overlapping gunzip 1326 ms, parse 5686 ms, sort 0 ms, write 0 ms, index 773 ms: 3 candidates, 81142 repo-hours, 809 releases; waiting 475 ms; commit 0 ms)
2026-11-08T12:04:28Z [load_day 2025-05-21] 2025-05-21 hour 5: 212086 events in 0 files, snapshot none (task 9066 ms: download 6376 ms overlapping gunzip 1509 ms, parse 6146 ms, sort 0 ms, write 0 ms, index 607 ms: 9 candidates, 85897 repo-hours, 1068 releases; waiting 502 ms; commit 0 ms)
2026-11-08T12:04:37Z [load_day 2025-05-21] 2025-05-21 hour 6: 240041 events in 0 files, snapshot none (task 8386 ms: download 5640 ms overlapping gunzip 1355 ms, parse 5726 ms, sort 0 ms, write 0 ms, index 763 ms: 3 candidates, 110014 repo-hours, 1176 releases; waiting 188 ms; commit 0 ms)
2026-11-08T12:04:38Z [load_day 2025-05-21] 2025-05-21 hour 7: 245468 events in 0 files, snapshot none (task 8736 ms: download 6135 ms overlapping gunzip 1390 ms, parse 5837 ms, sort 0 ms, write 0 ms, index 795 ms: 12 candidates, 103075 repo-hours, 1211 releases; waiting 464 ms; commit 0 ms)
2026-11-08T12:04:47Z [load_day 2025-05-21] 2025-05-21 hour 8: 259966 events in 0 files, snapshot none (task 9280 ms: download 6536 ms overlapping gunzip 1467 ms, parse 6178 ms, sort 0 ms, write 0 ms, index 813 ms: 13 candidates, 113776 repo-hours, 1370 releases; waiting 541 ms; commit 0 ms)
2026-11-08T12:04:48Z [load_day 2025-05-21] 2025-05-21 hour 9: 261177 events in 0 files, snapshot none (task 9289 ms: download 6510 ms overlapping gunzip 1436 ms, parse 6043 ms, sort 0 ms, write 0 ms, index 854 ms: 8 candidates, 114849 repo-hours, 1392 releases; waiting 591 ms; commit 0 ms)
2026-11-08T12:05:01Z [load_day 2025-05-21] 2025-05-21 hour 10: 252468 events in 0 files, snapshot none (task 13764 ms: download 10993 ms overlapping gunzip 1524 ms, parse 6525 ms, sort 0 ms, write 0 ms, index 814 ms: 12 candidates, 107571 repo-hours, 1294 releases; waiting 4568 ms; commit 0 ms)
2026-11-08T12:05:01Z [load_day 2025-05-21] 2025-05-21 hour 11: 259869 events in 0 files, snapshot none (task 10248 ms: download 6319 ms overlapping gunzip 1537 ms, parse 6560 ms, sort 0 ms, write 0 ms, index 1094 ms: 8 candidates, 106609 repo-hours, 1317 releases; waiting 746 ms; commit 0 ms)
2026-11-08T12:05:16Z [load_day 2025-05-21] 2025-05-21 hour 12: 280109 events in 0 files, snapshot none (task 14201 ms: download 10447 ms overlapping gunzip 1816 ms, parse 8190 ms, sort 0 ms, write 0 ms, index 1312 ms: 9 candidates, 144767 repo-hours, 1544 releases; waiting 2532 ms; commit 0 ms)
2026-11-08T12:05:16Z [load_day 2025-05-21] 2025-05-21 hour 13: 270495 events in 0 files, snapshot none (task 14507 ms: download 10903 ms overlapping gunzip 1925 ms, parse 8656 ms, sort 0 ms, write 0 ms, index 1210 ms: 6 candidates, 134777 repo-hours, 1258 releases; waiting 2342 ms; commit 0 ms)
2026-11-08T12:05:27Z [load_day 2025-05-21] 2025-05-21 hour 14: 265532 events in 0 files, snapshot none (task 11227 ms: download 7439 ms overlapping gunzip 1746 ms, parse 7501 ms, sort 0 ms, write 0 ms, index 1340 ms: 18 candidates, 118302 repo-hours, 1293 releases; waiting 384 ms; commit 0 ms)
2026-11-08T12:05:29Z [load_day 2025-05-21] 2025-05-21 hour 15: 267188 events in 0 files, snapshot none (task 11769 ms: download 8378 ms overlapping gunzip 1869 ms, parse 7925 ms, sort 0 ms, write 0 ms, index 1069 ms: 9 candidates, 121511 repo-hours, 1536 releases; waiting 600 ms; commit 0 ms)
2026-11-08T12:05:40Z [load_day 2025-05-21] 2025-05-21 hour 16: 257613 events in 0 files, snapshot none (task 12225 ms: download 8857 ms overlapping gunzip 1923 ms, parse 8207 ms, sort 0 ms, write 0 ms, index 1042 ms: 15 candidates, 113453 repo-hours, 1545 releases; waiting 788 ms; commit 0 ms)
2026-11-08T12:05:41Z [load_day 2025-05-21] 2025-05-21 hour 17: 257658 events in 0 files, snapshot none (task 12223 ms: download 8987 ms overlapping gunzip 2039 ms, parse 8502 ms, sort 0 ms, write 0 ms, index 827 ms: 10 candidates, 106672 repo-hours, 1280 releases; waiting 525 ms; commit 0 ms)
2026-11-08T12:05:52Z [load_day 2025-05-21] 2025-05-21 hour 18: 259057 events in 0 files, snapshot none (task 11190 ms: download 7860 ms overlapping gunzip 1737 ms, parse 7643 ms, sort 0 ms, write 0 ms, index 938 ms: 10 candidates, 114759 repo-hours, 1428 releases; waiting 531 ms; commit 0 ms)
2026-11-08T12:05:53Z [load_day 2025-05-21] 2025-05-21 hour 19: 259789 events in 0 files, snapshot none (task 10728 ms: download 7831 ms overlapping gunzip 1735 ms, parse 7230 ms, sort 0 ms, write 0 ms, index 808 ms: 11 candidates, 93963 repo-hours, 1390 releases; waiting 548 ms; commit 0 ms)
2026-11-08T12:06:04Z [load_day 2025-05-21] 2025-05-21 hour 20: 234652 events in 0 files, snapshot none (task 11006 ms: download 7486 ms overlapping gunzip 1831 ms, parse 7375 ms, sort 0 ms, write 0 ms, index 956 ms: 12 candidates, 96414 repo-hours, 1221 releases; waiting 518 ms; commit 0 ms)
2026-11-08T12:06:04Z [load_day 2025-05-21] 2025-05-21 hour 21: 217815 events in 0 files, snapshot none (task 10068 ms: download 6473 ms overlapping gunzip 1665 ms, parse 6968 ms, sort 0 ms, write 0 ms, index 683 ms: 18 candidates, 86125 repo-hours, 1274 releases; waiting 421 ms; commit 0 ms)
2026-11-08T12:06:15Z [load_day 2025-05-21] 2025-05-21 hour 22: 201513 events in 0 files, snapshot none (task 10515 ms: download 6742 ms overlapping gunzip 1660 ms, parse 7343 ms, sort 0 ms, write 0 ms, index 717 ms: 13 candidates, 77339 repo-hours, 1083 releases; waiting 506 ms; commit 0 ms)
2026-11-08T12:06:15Z [load_day 2025-05-21] 2025-05-21 hour 23: 193406 events in 0 files, snapshot none (task 9740 ms: download 5895 ms overlapping gunzip 1447 ms, parse 6439 ms, sort 0 ms, write 0 ms, index 959 ms: 7 candidates, 73311 repo-hours, 1208 releases; waiting 581 ms; commit 0 ms)
2026-11-08T12:06:25Z [load_day 2025-05-21] 2025-05-21: repo_hour merged from 24 files to 1 (2522167 rows, 10561 ms)
2026-11-08T12:06:28Z [load_day 2025-05-21] 2025-05-21: index committed in 13128 ms (24 + 1 + 24 files)
2026-11-08T12:06:28Z [load_day 2025-05-21] 2025-05-21: 5758579 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:06:28Z [load_day 2025-05-21] attempt 1 succeeded