orcaLog in

Runs · run 2352

load_day 2024-04-21, attempt 1 succeeded

Host
73ccef5e07c2:112367
Started
2026-11-08T05:43:18Z
Ended
2026-11-08T05:44:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
611 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
126.2 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2352/load_day/2024-04-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:43:18Z [load_day 2024-04-21] attempt 1 started
2026-11-08T05:43:19Z [load_day 2024-04-21] 2024-04-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:43:24Z [load_day 2024-04-21] 2024-04-21 hour 0: 173738 events in 0 files, snapshot none (task 4513 ms: download 2011 ms overlapping gunzip 580 ms, parse 2739 ms, sort 0 ms, write 0 ms, index 503 ms: 11 candidates, 73889 repo-hours, 1019 releases; waiting 493 ms; commit 0 ms)
2026-11-08T05:43:24Z [load_day 2024-04-21] 2024-04-21 hour 1: 161574 events in 0 files, snapshot none (task 4595 ms: download 2189 ms overlapping gunzip 573 ms, parse 2656 ms, sort 0 ms, write 0 ms, index 622 ms: 4 candidates, 82559 repo-hours, 755 releases; waiting 488 ms; commit 0 ms)
2026-11-08T05:43:28Z [load_day 2024-04-21] 2024-04-21 hour 2: 128337 events in 0 files, snapshot none (task 3767 ms: download 2151 ms overlapping gunzip 468 ms, parse 2139 ms, sort 0 ms, write 0 ms, index 330 ms: 3 candidates, 45398 repo-hours, 699 releases; waiting 527 ms; commit 0 ms)
2026-11-08T05:43:28Z [load_day 2024-04-21] 2024-04-21 hour 3: 131777 events in 0 files, snapshot none (task 3598 ms: download 1884 ms overlapping gunzip 455 ms, parse 1961 ms, sort 0 ms, write 0 ms, index 361 ms: 2 candidates, 46517 repo-hours, 863 releases; waiting 529 ms; commit 0 ms)
2026-11-08T05:43:34Z [load_day 2024-04-21] 2024-04-21 hour 4: 135730 events in 0 files, snapshot none (task 4596 ms: download 2780 ms overlapping gunzip 579 ms, parse 2659 ms, sort 0 ms, write 0 ms, index 423 ms: 5 candidates, 46533 repo-hours, 634 releases; waiting 511 ms; commit 0 ms)
2026-11-08T05:43:34Z [load_day 2024-04-21] 2024-04-21 hour 5: 142424 events in 0 files, snapshot none (task 5008 ms: download 2839 ms overlapping gunzip 707 ms, parse 3016 ms, sort 0 ms, write 0 ms, index 551 ms: 6 candidates, 48907 repo-hours, 665 releases; waiting 488 ms; commit 0 ms)
2026-11-08T05:43:39Z [load_day 2024-04-21] 2024-04-21 hour 6: 162231 events in 0 files, snapshot none (task 5195 ms: download 2538 ms overlapping gunzip 755 ms, parse 3219 ms, sort 0 ms, write 0 ms, index 464 ms: 1 candidates, 59614 repo-hours, 1054 releases; waiting 505 ms; commit 0 ms)
2026-11-08T05:43:40Z [load_day 2024-04-21] 2024-04-21 hour 7: 165381 events in 0 files, snapshot none (task 5203 ms: download 3004 ms overlapping gunzip 770 ms, parse 3275 ms, sort 0 ms, write 0 ms, index 402 ms: 5 candidates, 55495 repo-hours, 862 releases; waiting 499 ms; commit 0 ms)
2026-11-08T05:43:46Z [load_day 2024-04-21] 2024-04-21 hour 8: 186029 events in 0 files, snapshot none (task 6594 ms: download 3459 ms overlapping gunzip 1055 ms, parse 4538 ms, sort 0 ms, write 0 ms, index 446 ms: 6 candidates, 59556 repo-hours, 1000 releases; waiting 193 ms; commit 0 ms)
2026-11-08T05:43:46Z [load_day 2024-04-21] 2024-04-21 hour 9: 177199 events in 0 files, snapshot none (task 6103 ms: download 3697 ms overlapping gunzip 934 ms, parse 3893 ms, sort 0 ms, write 0 ms, index 531 ms: 8 candidates, 60861 repo-hours, 1086 releases; waiting 498 ms; commit 0 ms)
2026-11-08T05:43:53Z [load_day 2024-04-21] 2024-04-21 hour 10: 185462 events in 0 files, snapshot none (task 6489 ms: download 3298 ms overlapping gunzip 930 ms, parse 4141 ms, sort 0 ms, write 0 ms, index 628 ms: 5 candidates, 61208 repo-hours, 833 releases; waiting 528 ms; commit 0 ms)
2026-11-08T05:43:53Z [load_day 2024-04-21] 2024-04-21 hour 11: 168439 events in 0 files, snapshot none (task 5952 ms: download 2991 ms overlapping gunzip 835 ms, parse 3767 ms, sort 0 ms, write 0 ms, index 564 ms: 7 candidates, 60545 repo-hours, 816 releases; waiting 502 ms; commit 0 ms)
2026-11-08T05:44:00Z [load_day 2024-04-21] 2024-04-21 hour 12: 252242 events in 0 files, snapshot none (task 6924 ms: download 3417 ms overlapping gunzip 860 ms, parse 4425 ms, sort 0 ms, write 0 ms, index 926 ms: 10 candidates, 98267 repo-hours, 937 releases; waiting 487 ms; commit 0 ms)
2026-11-08T05:44:00Z [load_day 2024-04-21] 2024-04-21 hour 13: 214645 events in 0 files, snapshot none (task 6876 ms: download 3932 ms overlapping gunzip 986 ms, parse 4306 ms, sort 0 ms, write 0 ms, index 831 ms: 13 candidates, 86025 repo-hours, 1742 releases; waiting 508 ms; commit 0 ms)
2026-11-08T05:44:09Z [load_day 2024-04-21] 2024-04-21 hour 14: 203874 events in 0 files, snapshot none (task 8120 ms: download 5266 ms overlapping gunzip 1329 ms, parse 5405 ms, sort 0 ms, write 0 ms, index 609 ms: 10 candidates, 74274 repo-hours, 1145 releases; waiting 486 ms; commit 0 ms)
2026-11-08T05:44:09Z [load_day 2024-04-21] 2024-04-21 hour 15: 212109 events in 0 files, snapshot none (task 8121 ms: download 4585 ms overlapping gunzip 1191 ms, parse 5466 ms, sort 0 ms, write 0 ms, index 640 ms: 7 candidates, 76854 repo-hours, 1908 releases; waiting 506 ms; commit 0 ms)
2026-11-08T05:44:17Z [load_day 2024-04-21] 2024-04-21 hour 16: 199169 events in 0 files, snapshot none (task 7795 ms: download 4728 ms overlapping gunzip 1200 ms, parse 5163 ms, sort 0 ms, write 0 ms, index 681 ms: 7 candidates, 72712 repo-hours, 1153 releases; waiting 489 ms; commit 0 ms)
2026-11-08T05:44:17Z [load_day 2024-04-21] 2024-04-21 hour 17: 189657 events in 0 files, snapshot none (task 7896 ms: download 4773 ms overlapping gunzip 1183 ms, parse 5411 ms, sort 0 ms, write 0 ms, index 612 ms: 17 candidates, 68364 repo-hours, 1611 releases; waiting 489 ms; commit 0 ms)
2026-11-08T05:44:24Z [load_day 2024-04-21] 2024-04-21 hour 18: 201203 events in 0 files, snapshot none (task 6403 ms: download 3658 ms overlapping gunzip 930 ms, parse 4111 ms, sort 0 ms, write 0 ms, index 647 ms: 12 candidates, 77638 repo-hours, 1659 releases; waiting 508 ms; commit 0 ms)
2026-11-08T05:44:24Z [load_day 2024-04-21] 2024-04-21 hour 19: 182118 events in 0 files, snapshot none (task 6379 ms: download 3869 ms overlapping gunzip 868 ms, parse 4261 ms, sort 0 ms, write 0 ms, index 530 ms: 14 candidates, 64641 repo-hours, 1573 releases; waiting 474 ms; commit 0 ms)
2026-11-08T05:44:30Z [load_day 2024-04-21] 2024-04-21 hour 20: 175917 events in 0 files, snapshot none (task 5683 ms: download 3045 ms overlapping gunzip 804 ms, parse 3685 ms, sort 0 ms, write 0 ms, index 449 ms: 12 candidates, 62297 repo-hours, 861 releases; waiting 488 ms; commit 0 ms)
2026-11-08T05:44:31Z [load_day 2024-04-21] 2024-04-21 hour 21: 162213 events in 0 files, snapshot none (task 5828 ms: download 3500 ms overlapping gunzip 808 ms, parse 3710 ms, sort 0 ms, write 0 ms, index 388 ms: 11 candidates, 55979 repo-hours, 881 releases; waiting 513 ms; commit 0 ms)
2026-11-08T05:44:36Z [load_day 2024-04-21] 2024-04-21 hour 22: 149069 events in 0 files, snapshot none (task 5392 ms: download 3397 ms overlapping gunzip 795 ms, parse 3311 ms, sort 0 ms, write 0 ms, index 476 ms: 5 candidates, 50425 repo-hours, 775 releases; waiting 499 ms; commit 0 ms)
2026-11-08T05:44:36Z [load_day 2024-04-21] 2024-04-21 hour 23: 144471 events in 0 files, snapshot none (task 4970 ms: download 3132 ms overlapping gunzip 696 ms, parse 2993 ms, sort 0 ms, write 0 ms, index 516 ms: 9 candidates, 49154 repo-hours, 609 releases; waiting 498 ms; commit 0 ms)
2026-11-08T05:44:43Z [load_day 2024-04-21] 2024-04-21: repo_hour merged from 24 files to 1 (1537712 rows, 6910 ms)
2026-11-08T05:44:45Z [load_day 2024-04-21] 2024-04-21: index committed in 9118 ms (24 + 1 + 24 files)
2026-11-08T05:44:45Z [load_day 2024-04-21] 2024-04-21: 4205008 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:44:45Z [load_day 2024-04-21] attempt 1 succeeded