orcaLog in

Runs · run 3553

load_day 2025-02-12, attempt 1 succeeded

Host
73ccef5e07c2:254074
Started
2026-11-08T10:17:51Z
Ended
2026-11-08T10:20:12Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
867 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
214.5 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3553/load_day/2025-02-12/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:17:51Z [load_day 2025-02-12] attempt 1 started
2026-11-08T10:17:52Z [load_day 2025-02-12] 2025-02-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:18:02Z [load_day 2025-02-12] 2025-02-12 hour 0: 235228 events in 0 files, snapshot none (task 9333 ms: download 5648 ms overlapping gunzip 1386 ms, parse 5795 ms, sort 0 ms, write 0 ms, index 1297 ms: 7 candidates, 103439 repo-hours, 1326 releases; waiting 523 ms; commit 0 ms)
2026-11-08T10:18:02Z [load_day 2025-02-12] 2025-02-12 hour 1: 246976 events in 0 files, snapshot none (task 9621 ms: download 5600 ms overlapping gunzip 1397 ms, parse 5859 ms, sort 0 ms, write 0 ms, index 1544 ms: 7 candidates, 120819 repo-hours, 1273 releases; waiting 551 ms; commit 0 ms)
2026-11-08T10:18:13Z [load_day 2025-02-12] 2025-02-12 hour 2: 217521 events in 0 files, snapshot none (task 10601 ms: download 6521 ms overlapping gunzip 1734 ms, parse 7166 ms, sort 0 ms, write 0 ms, index 960 ms: 4 candidates, 89575 repo-hours, 1034 releases; waiting 493 ms; commit 0 ms)
2026-11-08T10:18:13Z [load_day 2025-02-12] 2025-02-12 hour 3: 234704 events in 0 files, snapshot none (task 10648 ms: download 6711 ms overlapping gunzip 1761 ms, parse 7131 ms, sort 0 ms, write 0 ms, index 793 ms: 6 candidates, 87685 repo-hours, 3900 releases; waiting 464 ms; commit 0 ms)
2026-11-08T10:18:23Z [load_day 2025-02-12] 2025-02-12 hour 4: 221712 events in 0 files, snapshot none (task 9842 ms: download 6822 ms overlapping gunzip 1678 ms, parse 6639 ms, sort 0 ms, write 0 ms, index 645 ms: 7 candidates, 74708 repo-hours, 742 releases; waiting 484 ms; commit 0 ms)
2026-11-08T10:18:23Z [load_day 2025-02-12] 2025-02-12 hour 5: 226509 events in 0 files, snapshot none (task 9639 ms: download 6683 ms overlapping gunzip 1665 ms, parse 6536 ms, sort 0 ms, write 0 ms, index 659 ms: 4 candidates, 79823 repo-hours, 940 releases; waiting 498 ms; commit 0 ms)
2026-11-08T10:18:33Z [load_day 2025-02-12] 2025-02-12 hour 6: 247034 events in 0 files, snapshot none (task 9106 ms: download 5933 ms overlapping gunzip 1400 ms, parse 5987 ms, sort 0 ms, write 0 ms, index 869 ms: 5 candidates, 101123 repo-hours, 1207 releases; waiting 518 ms; commit 0 ms)
2026-11-08T10:18:33Z [load_day 2025-02-12] 2025-02-12 hour 7: 250193 events in 0 files, snapshot none (task 9668 ms: download 6631 ms overlapping gunzip 1634 ms, parse 6481 ms, sort 0 ms, write 0 ms, index 724 ms: 8 candidates, 91418 repo-hours, 968 releases; waiting 522 ms; commit 0 ms)
2026-11-08T10:18:42Z [load_day 2025-02-12] 2025-02-12 hour 8: 258794 events in 0 files, snapshot none (task 9234 ms: download 6363 ms overlapping gunzip 1464 ms, parse 6075 ms, sort 0 ms, write 0 ms, index 780 ms: 9 candidates, 101250 repo-hours, 1093 releases; waiting 540 ms; commit 0 ms)
2026-11-08T10:18:43Z [load_day 2025-02-12] 2025-02-12 hour 9: 271770 events in 0 files, snapshot none (task 9325 ms: download 6725 ms overlapping gunzip 1627 ms, parse 6465 ms, sort 0 ms, write 0 ms, index 807 ms: 3 candidates, 109460 repo-hours, 1373 releases; waiting 174 ms; commit 0 ms)
2026-11-08T10:18:53Z [load_day 2025-02-12] 2025-02-12 hour 10: 260443 events in 0 files, snapshot none (task 10353 ms: download 7517 ms overlapping gunzip 1772 ms, parse 7152 ms, sort 0 ms, write 0 ms, index 812 ms: 9 candidates, 103867 repo-hours, 1341 releases; waiting 365 ms; commit 0 ms)
2026-11-08T10:18:53Z [load_day 2025-02-12] 2025-02-12 hour 11: 264155 events in 0 files, snapshot none (task 9679 ms: download 7155 ms overlapping gunzip 1527 ms, parse 6692 ms, sort 0 ms, write 0 ms, index 699 ms: 4 candidates, 97737 repo-hours, 1280 releases; waiting 472 ms; commit 0 ms)
2026-11-08T10:19:02Z [load_day 2025-02-12] 2025-02-12 hour 12: 291123 events in 0 files, snapshot none (task 8776 ms: download 5919 ms overlapping gunzip 1372 ms, parse 5603 ms, sort 0 ms, write 0 ms, index 1030 ms: 9 candidates, 137883 repo-hours, 1396 releases; waiting 540 ms; commit 0 ms)
2026-11-08T10:19:03Z [load_day 2025-02-12] 2025-02-12 hour 13: 276271 events in 0 files, snapshot none (task 9108 ms: download 6257 ms overlapping gunzip 1439 ms, parse 5913 ms, sort 0 ms, write 0 ms, index 852 ms: 6 candidates, 124477 repo-hours, 1306 releases; waiting 472 ms; commit 0 ms)
2026-11-08T10:19:11Z [load_day 2025-02-12] 2025-02-12 hour 14: 264973 events in 0 files, snapshot none (task 8185 ms: download 5474 ms overlapping gunzip 1312 ms, parse 5425 ms, sort 0 ms, write 0 ms, index 832 ms: 7 candidates, 109385 repo-hours, 1367 releases; waiting 334 ms; commit 0 ms)
2026-11-08T10:19:12Z [load_day 2025-02-12] 2025-02-12 hour 15: 265524 events in 0 files, snapshot none (task 8710 ms: download 6049 ms overlapping gunzip 1327 ms, parse 5561 ms, sort 0 ms, write 0 ms, index 763 ms: 7 candidates, 114167 repo-hours, 1332 releases; waiting 708 ms; commit 0 ms)
2026-11-08T10:19:27Z [load_day 2025-02-12] 2025-02-12 hour 16: 274922 events in 0 files, snapshot none (task 15062 ms: download 12180 ms overlapping gunzip 1748 ms, parse 7401 ms, sort 0 ms, write 0 ms, index 1015 ms: 10 candidates, 112538 repo-hours, 1292 releases; waiting 4551 ms; commit 0 ms)
2026-11-08T10:19:27Z [load_day 2025-02-12] 2025-02-12 hour 17: 260695 events in 0 files, snapshot none (task 10630 ms: download 7268 ms overlapping gunzip 1671 ms, parse 6897 ms, sort 0 ms, write 0 ms, index 982 ms: 9 candidates, 102966 repo-hours, 1202 releases; waiting 778 ms; commit 0 ms)
2026-11-08T10:19:38Z [load_day 2025-02-12] 2025-02-12 hour 18: 264410 events in 0 files, snapshot none (task 10962 ms: download 6750 ms overlapping gunzip 1668 ms, parse 7131 ms, sort 0 ms, write 0 ms, index 1381 ms: 39 candidates, 113846 repo-hours, 1303 releases; waiting 161 ms; commit 0 ms)
2026-11-08T10:19:38Z [load_day 2025-02-12] 2025-02-12 hour 19: 244714 events in 0 files, snapshot none (task 10775 ms: download 6982 ms overlapping gunzip 1703 ms, parse 7264 ms, sort 0 ms, write 0 ms, index 991 ms: 5 candidates, 94602 repo-hours, 1305 releases; waiting 519 ms; commit 0 ms)
2026-11-08T10:19:48Z [load_day 2025-02-12] 2025-02-12 hour 20: 228280 events in 0 files, snapshot none (task 9833 ms: download 6559 ms overlapping gunzip 1522 ms, parse 6404 ms, sort 0 ms, write 0 ms, index 667 ms: 13 candidates, 91962 repo-hours, 1523 releases; waiting 535 ms; commit 0 ms)
2026-11-08T10:19:48Z [load_day 2025-02-12] 2025-02-12 hour 21: 231222 events in 0 files, snapshot none (task 9416 ms: download 6126 ms overlapping gunzip 1592 ms, parse 6091 ms, sort 0 ms, write 0 ms, index 928 ms: 7 candidates, 91585 repo-hours, 1542 releases; waiting 520 ms; commit 0 ms)
2026-11-08T10:19:58Z [load_day 2025-02-12] 2025-02-12 hour 22: 227498 events in 0 files, snapshot none (task 8664 ms: download 5600 ms overlapping gunzip 1330 ms, parse 5340 ms, sort 0 ms, write 0 ms, index 947 ms: 6 candidates, 81658 repo-hours, 1541 releases; waiting 707 ms; commit 0 ms)
2026-11-08T10:19:58Z [load_day 2025-02-12] 2025-02-12 hour 23: 216103 events in 0 files, snapshot none (task 8589 ms: download 5490 ms overlapping gunzip 1376 ms, parse 5413 ms, sort 0 ms, write 0 ms, index 1047 ms: 13 candidates, 75216 repo-hours, 1314 releases; waiting 495 ms; commit 0 ms)
2026-11-08T10:20:09Z [load_day 2025-02-12] 2025-02-12: repo_hour merged from 24 files to 1 (2411189 rows, 11159 ms)
2026-11-08T10:20:12Z [load_day 2025-02-12] 2025-02-12: index committed in 14298 ms (24 + 1 + 24 files)
2026-11-08T10:20:12Z [load_day 2025-02-12] 2025-02-12: 5980774 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:20:12Z [load_day 2025-02-12] attempt 1 succeeded