orcaLog in

Runs · run 3615

load_day 2025-02-28, attempt 1 succeeded

Host
73ccef5e07c2:262811
Started
2026-11-08T10:35:13Z
Ended
2026-11-08T10:37:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
782 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
195.3 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3615/load_day/2025-02-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:35:13Z [load_day 2025-02-28] attempt 1 started
2026-11-08T10:35:13Z [load_day 2025-02-28] 2025-02-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:35:23Z [load_day 2025-02-28] 2025-02-28 hour 0: 204869 events in 0 files, snapshot none (task 8814 ms: download 5469 ms overlapping gunzip 1359 ms, parse 5716 ms, sort 0 ms, write 0 ms, index 1023 ms: 13 candidates, 98298 repo-hours, 1310 releases; waiting 474 ms; commit 0 ms)
2026-11-08T10:35:24Z [load_day 2025-02-28] 2025-02-28 hour 1: 228278 events in 0 files, snapshot none (task 9527 ms: download 5842 ms overlapping gunzip 1580 ms, parse 6362 ms, sort 0 ms, write 0 ms, index 878 ms: 6 candidates, 123105 repo-hours, 979 releases; waiting 453 ms; commit 0 ms)
2026-11-08T10:35:31Z [load_day 2025-02-28] 2025-02-28 hour 2: 206287 events in 0 files, snapshot none (task 7827 ms: download 4338 ms overlapping gunzip 1180 ms, parse 4780 ms, sort 0 ms, write 0 ms, index 927 ms: 7 candidates, 90642 repo-hours, 913 releases; waiting 680 ms; commit 0 ms)
2026-11-08T10:35:31Z [load_day 2025-02-28] 2025-02-28 hour 3: 222289 events in 0 files, snapshot none (task 7317 ms: download 4214 ms overlapping gunzip 1092 ms, parse 4641 ms, sort 0 ms, write 0 ms, index 837 ms: 6 candidates, 89623 repo-hours, 3867 releases; waiting 488 ms; commit 0 ms)
2026-11-08T10:35:39Z [load_day 2025-02-28] 2025-02-28 hour 4: 204020 events in 0 files, snapshot none (task 7093 ms: download 4279 ms overlapping gunzip 955 ms, parse 4027 ms, sort 0 ms, write 0 ms, index 884 ms: 7 candidates, 74862 repo-hours, 757 releases; waiting 965 ms; commit 0 ms)
2026-11-08T10:35:39Z [load_day 2025-02-28] 2025-02-28 hour 5: 205816 events in 0 files, snapshot none (task 7026 ms: download 4118 ms overlapping gunzip 1011 ms, parse 4156 ms, sort 0 ms, write 0 ms, index 994 ms: 4 candidates, 80013 repo-hours, 1038 releases; waiting 520 ms; commit 0 ms)
2026-11-08T10:35:47Z [load_day 2025-02-28] 2025-02-28 hour 6: 227500 events in 0 files, snapshot none (task 7945 ms: download 5209 ms overlapping gunzip 1291 ms, parse 5418 ms, sort 0 ms, write 0 ms, index 750 ms: 10 candidates, 101267 repo-hours, 971 releases; waiting 187 ms; commit 0 ms)
2026-11-08T10:35:47Z [load_day 2025-02-28] 2025-02-28 hour 7: 228243 events in 0 files, snapshot none (task 8011 ms: download 5412 ms overlapping gunzip 1217 ms, parse 5355 ms, sort 0 ms, write 0 ms, index 653 ms: 5 candidates, 88586 repo-hours, 958 releases; waiting 490 ms; commit 0 ms)
2026-11-08T10:35:56Z [load_day 2025-02-28] 2025-02-28 hour 8: 240868 events in 0 files, snapshot none (task 8564 ms: download 5954 ms overlapping gunzip 1459 ms, parse 5898 ms, sort 0 ms, write 0 ms, index 755 ms: 11 candidates, 98125 repo-hours, 1257 releases; waiting 233 ms; commit 0 ms)
2026-11-08T10:35:57Z [load_day 2025-02-28] 2025-02-28 hour 9: 256755 events in 0 files, snapshot none (task 9454 ms: download 6780 ms overlapping gunzip 1529 ms, parse 6606 ms, sort 0 ms, write 0 ms, index 778 ms: 10 candidates, 107084 repo-hours, 1389 releases; waiting 230 ms; commit 0 ms)
2026-11-08T10:36:04Z [load_day 2025-02-28] 2025-02-28 hour 10: 253851 events in 0 files, snapshot none (task 7611 ms: download 4863 ms overlapping gunzip 1197 ms, parse 5137 ms, sort 0 ms, write 0 ms, index 773 ms: 9 candidates, 101652 repo-hours, 1192 releases; waiting 181 ms; commit 0 ms)
2026-11-08T10:36:05Z [load_day 2025-02-28] 2025-02-28 hour 11: 245482 events in 0 files, snapshot none (task 7144 ms: download 4741 ms overlapping gunzip 1179 ms, parse 4890 ms, sort 0 ms, write 0 ms, index 665 ms: 11 candidates, 94445 repo-hours, 1205 releases; waiting 173 ms; commit 0 ms)
2026-11-08T10:36:12Z [load_day 2025-02-28] 2025-02-28 hour 12: 283969 events in 0 files, snapshot none (task 7433 ms: download 4462 ms overlapping gunzip 1100 ms, parse 4700 ms, sort 0 ms, write 0 ms, index 1011 ms: 15 candidates, 139322 repo-hours, 1237 releases; waiting 294 ms; commit 0 ms)
2026-11-08T10:36:14Z [load_day 2025-02-28] 2025-02-28 hour 13: 271067 events in 0 files, snapshot none (task 8427 ms: download 5224 ms overlapping gunzip 1227 ms, parse 5043 ms, sort 0 ms, write 0 ms, index 1348 ms: 8 candidates, 121893 repo-hours, 1177 releases; waiting 511 ms; commit 0 ms)
2026-11-08T10:36:23Z [load_day 2025-02-28] 2025-02-28 hour 14: 266682 events in 0 files, snapshot none (task 10932 ms: download 8045 ms overlapping gunzip 1696 ms, parse 7503 ms, sort 0 ms, write 0 ms, index 874 ms: 8 candidates, 109493 repo-hours, 1435 releases; waiting 517 ms; commit 0 ms)
2026-11-08T10:36:25Z [load_day 2025-02-28] 2025-02-28 hour 15: 269128 events in 0 files, snapshot none (task 9982 ms: download 7137 ms overlapping gunzip 1657 ms, parse 6944 ms, sort 0 ms, write 0 ms, index 854 ms: 8 candidates, 114744 repo-hours, 1526 releases; waiting 206 ms; commit 0 ms)
2026-11-08T10:36:33Z [load_day 2025-02-28] 2025-02-28 hour 16: 257756 events in 0 files, snapshot none (task 9358 ms: download 5860 ms overlapping gunzip 1451 ms, parse 6188 ms, sort 0 ms, write 0 ms, index 988 ms: 11 candidates, 108347 repo-hours, 1372 releases; waiting 510 ms; commit 0 ms)
2026-11-08T10:36:34Z [load_day 2025-02-28] 2025-02-28 hour 17: 249386 events in 0 files, snapshot none (task 9373 ms: download 6826 ms overlapping gunzip 1481 ms, parse 6385 ms, sort 0 ms, write 0 ms, index 729 ms: 10 candidates, 100866 repo-hours, 1334 releases; waiting 506 ms; commit 0 ms)
2026-11-08T10:36:43Z [load_day 2025-02-28] 2025-02-28 hour 18: 250514 events in 0 files, snapshot none (task 9290 ms: download 5860 ms overlapping gunzip 1431 ms, parse 6086 ms, sort 0 ms, write 0 ms, index 1209 ms: 6 candidates, 110324 repo-hours, 1396 releases; waiting 249 ms; commit 0 ms)
2026-11-08T10:36:45Z [load_day 2025-02-28] 2025-02-28 hour 19: 225433 events in 0 files, snapshot none (task 9892 ms: download 6707 ms overlapping gunzip 1507 ms, parse 6684 ms, sort 0 ms, write 0 ms, index 949 ms: 7 candidates, 88085 repo-hours, 1234 releases; waiting 510 ms; commit 0 ms)
2026-11-08T10:36:54Z [load_day 2025-02-28] 2025-02-28 hour 20: 216168 events in 0 files, snapshot none (task 9885 ms: download 6780 ms overlapping gunzip 1611 ms, parse 6863 ms, sort 0 ms, write 0 ms, index 666 ms: 7 candidates, 84276 repo-hours, 1065 releases; waiting 480 ms; commit 0 ms)
2026-11-08T10:36:55Z [load_day 2025-02-28] 2025-02-28 hour 21: 220478 events in 0 files, snapshot none (task 9217 ms: download 6485 ms overlapping gunzip 1457 ms, parse 6168 ms, sort 0 ms, write 0 ms, index 796 ms: 7 candidates, 85750 repo-hours, 1181 releases; waiting 473 ms; commit 0 ms)
2026-11-08T10:37:02Z [load_day 2025-02-28] 2025-02-28 hour 22: 201956 events in 0 files, snapshot none (task 8149 ms: download 5302 ms overlapping gunzip 1232 ms, parse 5318 ms, sort 0 ms, write 0 ms, index 776 ms: 2 candidates, 74704 repo-hours, 1202 releases; waiting 495 ms; commit 0 ms)
2026-11-08T10:37:03Z [load_day 2025-02-28] 2025-02-28 hour 23: 197943 events in 0 files, snapshot none (task 7282 ms: download 4631 ms overlapping gunzip 1128 ms, parse 4613 ms, sort 0 ms, write 0 ms, index 798 ms: 8 candidates, 69202 repo-hours, 1087 releases; waiting 474 ms; commit 0 ms)
2026-11-08T10:37:14Z [load_day 2025-02-28] 2025-02-28: repo_hour merged from 24 files to 1 (2354708 rows, 10975 ms)
2026-11-08T10:37:16Z [load_day 2025-02-28] 2025-02-28: index committed in 13785 ms (24 + 1 + 24 files)
2026-11-08T10:37:16Z [load_day 2025-02-28] 2025-02-28: 5634738 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:37:16Z [load_day 2025-02-28] attempt 1 succeeded