orcaLog in

Runs · run 4984

load_day 2026-02-28, attempt 1 succeeded

Host
73ccef5e07c2:448961
Started
2026-11-08T15:26:33Z
Ended
2026-11-08T15:27:38Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
734 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
76.6 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4984/load_day/2026-02-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:26:33Z [load_day 2026-02-28] attempt 1 started
2026-11-08T15:26:34Z [load_day 2026-02-28] 2026-02-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:26:38Z [load_day 2026-02-28] 2026-02-28 hour 0: 148172 events in 0 files, snapshot none (task 3713 ms: download 2430 ms overlapping gunzip 434 ms, parse 1367 ms, sort 0 ms, write 0 ms, index 656 ms: 5 candidates, 74203 repo-hours, 1127 releases; waiting 913 ms; commit 0 ms)
2026-11-08T15:26:38Z [load_day 2026-02-28] 2026-02-28 hour 1: 156541 events in 0 files, snapshot none (task 3647 ms: download 2209 ms overlapping gunzip 445 ms, parse 1409 ms, sort 0 ms, write 0 ms, index 704 ms: 7 candidates, 90994 repo-hours, 971 releases; waiting 743 ms; commit 0 ms)
2026-11-08T15:26:42Z [load_day 2026-02-28] 2026-02-28 hour 2: 151978 events in 0 files, snapshot none (task 3355 ms: download 1891 ms overlapping gunzip 431 ms, parse 1297 ms, sort 0 ms, write 0 ms, index 734 ms: 8 candidates, 83153 repo-hours, 783 releases; waiting 527 ms; commit 0 ms)
2026-11-08T15:26:43Z [load_day 2026-02-28] 2026-02-28 hour 3: 149542 events in 0 files, snapshot none (task 4058 ms: download 3002 ms overlapping gunzip 500 ms, parse 1515 ms, sort 0 ms, write 0 ms, index 594 ms: 11 candidates, 73318 repo-hours, 934 releases; waiting 1180 ms; commit 0 ms)
2026-11-08T15:26:48Z [load_day 2026-02-28] 2026-02-28 hour 4: 153240 events in 0 files, snapshot none (task 5642 ms: download 3568 ms overlapping gunzip 551 ms, parse 1855 ms, sort 0 ms, write 0 ms, index 717 ms: 5 candidates, 78007 repo-hours, 1700 releases; waiting 2150 ms; commit 0 ms)
2026-11-08T15:26:48Z [load_day 2026-02-28] 2026-02-28 hour 5: 150110 events in 0 files, snapshot none (task 4343 ms: download 2733 ms overlapping gunzip 527 ms, parse 1656 ms, sort 0 ms, write 0 ms, index 848 ms: 6 candidates, 73499 repo-hours, 995 releases; waiting 1005 ms; commit 0 ms)
2026-11-08T15:26:53Z [load_day 2026-02-28] 2026-02-28 hour 6: 154778 events in 0 files, snapshot none (task 4210 ms: download 2388 ms overlapping gunzip 462 ms, parse 1456 ms, sort 0 ms, write 0 ms, index 578 ms: 7 candidates, 81188 repo-hours, 1247 releases; waiting 1254 ms; commit 0 ms)
2026-11-08T15:26:53Z [load_day 2026-02-28] 2026-02-28 hour 7: 154788 events in 0 files, snapshot none (task 3533 ms: download 2407 ms overlapping gunzip 491 ms, parse 1485 ms, sort 0 ms, write 0 ms, index 567 ms: 6 candidates, 77605 repo-hours, 1042 releases; waiting 737 ms; commit 0 ms)
2026-11-08T15:26:57Z [load_day 2026-02-28] 2026-02-28 hour 8: 155655 events in 0 files, snapshot none (task 3620 ms: download 2167 ms overlapping gunzip 512 ms, parse 1602 ms, sort 0 ms, write 0 ms, index 645 ms: 6 candidates, 79011 repo-hours, 1135 releases; waiting 548 ms; commit 0 ms)
2026-11-08T15:26:57Z [load_day 2026-02-28] 2026-02-28 hour 9: 151194 events in 0 files, snapshot none (task 3245 ms: download 2155 ms overlapping gunzip 451 ms, parse 1374 ms, sort 0 ms, write 0 ms, index 595 ms: 4 candidates, 77983 repo-hours, 1077 releases; waiting 510 ms; commit 0 ms)
2026-11-08T15:27:01Z [load_day 2026-02-28] 2026-02-28 hour 10: 153201 events in 0 files, snapshot none (task 3191 ms: download 2030 ms overlapping gunzip 446 ms, parse 1540 ms, sort 0 ms, write 0 ms, index 610 ms: 2 candidates, 76754 repo-hours, 1130 releases; waiting 326 ms; commit 0 ms)
2026-11-08T15:27:02Z [load_day 2026-02-28] 2026-02-28 hour 11: 150603 events in 0 files, snapshot none (task 3668 ms: download 2386 ms overlapping gunzip 546 ms, parse 1664 ms, sort 0 ms, write 0 ms, index 584 ms: 5 candidates, 74020 repo-hours, 822 releases; waiting 629 ms; commit 0 ms)
2026-11-08T15:27:05Z [load_day 2026-02-28] 2026-02-28 hour 12: 164287 events in 0 files, snapshot none (task 3267 ms: download 1889 ms overlapping gunzip 365 ms, parse 1201 ms, sort 0 ms, write 0 ms, index 835 ms: 6 candidates, 98519 repo-hours, 723 releases; waiting 584 ms; commit 0 ms)
2026-11-08T15:27:05Z [load_day 2026-02-28] 2026-02-28 hour 13: 159613 events in 0 files, snapshot none (task 3319 ms: download 1902 ms overlapping gunzip 377 ms, parse 1305 ms, sort 0 ms, write 0 ms, index 680 ms: 9 candidates, 90706 repo-hours, 764 releases; waiting 590 ms; commit 0 ms)
2026-11-08T15:27:09Z [load_day 2026-02-28] 2026-02-28 hour 14: 159187 events in 0 files, snapshot none (task 3764 ms: download 2502 ms overlapping gunzip 468 ms, parse 1424 ms, sort 0 ms, write 0 ms, index 667 ms: 5 candidates, 81133 repo-hours, 981 releases; waiting 973 ms; commit 0 ms)
2026-11-08T15:27:10Z [load_day 2026-02-28] 2026-02-28 hour 15: 159474 events in 0 files, snapshot none (task 3605 ms: download 2148 ms overlapping gunzip 534 ms, parse 1543 ms, sort 0 ms, write 0 ms, index 630 ms: 3 candidates, 81408 repo-hours, 1005 releases; waiting 598 ms; commit 0 ms)
2026-11-08T15:27:14Z [load_day 2026-02-28] 2026-02-28 hour 16: 160377 events in 0 files, snapshot none (task 4212 ms: download 2481 ms overlapping gunzip 614 ms, parse 1871 ms, sort 0 ms, write 0 ms, index 711 ms: 6 candidates, 83507 repo-hours, 768 releases; waiting 741 ms; commit 0 ms)
2026-11-08T15:27:14Z [load_day 2026-02-28] 2026-02-28 hour 17: 159313 events in 0 files, snapshot none (task 4168 ms: download 2660 ms overlapping gunzip 647 ms, parse 1770 ms, sort 0 ms, write 0 ms, index 674 ms: 6 candidates, 79614 repo-hours, 707 releases; waiting 776 ms; commit 0 ms)
2026-11-08T15:27:18Z [load_day 2026-02-28] 2026-02-28 hour 18: 160072 events in 0 files, snapshot none (task 3680 ms: download 2420 ms overlapping gunzip 448 ms, parse 1438 ms, sort 0 ms, write 0 ms, index 741 ms: 9 candidates, 86072 repo-hours, 737 releases; waiting 740 ms; commit 0 ms)
2026-11-08T15:27:18Z [load_day 2026-02-28] 2026-02-28 hour 19: 154200 events in 0 files, snapshot none (task 3306 ms: download 2183 ms overlapping gunzip 470 ms, parse 1372 ms, sort 0 ms, write 0 ms, index 540 ms: 15 candidates, 74178 repo-hours, 1067 releases; waiting 597 ms; commit 0 ms)
2026-11-08T15:27:22Z [load_day 2026-02-28] 2026-02-28 hour 20: 156678 events in 0 files, snapshot none (task 3933 ms: download 2463 ms overlapping gunzip 588 ms, parse 1832 ms, sort 0 ms, write 0 ms, index 647 ms: 7 candidates, 74436 repo-hours, 1011 releases; waiting 552 ms; commit 0 ms)
2026-11-08T15:27:22Z [load_day 2026-02-28] 2026-02-28 hour 21: 156441 events in 0 files, snapshot none (task 3745 ms: download 2301 ms overlapping gunzip 546 ms, parse 1632 ms, sort 0 ms, write 0 ms, index 660 ms: 9 candidates, 75327 repo-hours, 1026 releases; waiting 574 ms; commit 0 ms)
2026-11-08T15:27:27Z [load_day 2026-02-28] 2026-02-28 hour 22: 152238 events in 0 files, snapshot none (task 3771 ms: download 2712 ms overlapping gunzip 543 ms, parse 1518 ms, sort 0 ms, write 0 ms, index 539 ms: 8 candidates, 71694 repo-hours, 1230 releases; waiting 945 ms; commit 0 ms)
2026-11-08T15:27:27Z [load_day 2026-02-28] 2026-02-28 hour 23: 148050 events in 0 files, snapshot none (task 3443 ms: download 2010 ms overlapping gunzip 510 ms, parse 1552 ms, sort 0 ms, write 0 ms, index 567 ms: 8 candidates, 69453 repo-hours, 1030 releases; waiting 550 ms; commit 0 ms)
2026-11-08T15:27:35Z [load_day 2026-02-28] 2026-02-28: repo_hour merged from 24 files to 1 (1905782 rows, 8125 ms)
2026-11-08T15:27:38Z [load_day 2026-02-28] 2026-02-28: index committed in 10892 ms (24 + 1 + 24 files)
2026-11-08T15:27:38Z [load_day 2026-02-28] 2026-02-28: 3719732 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:27:38Z [load_day 2026-02-28] attempt 1 succeeded