orcaLog in

Runs · run 2460

load_day 2024-05-16, attempt 1 succeeded

Host
73ccef5e07c2:122833
Started
2026-11-08T06:06:43Z
Ended
2026-11-08T06:08:47Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
906 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
184.1 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2460/load_day/2024-05-16/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:06:43Z [load_day 2024-05-16] attempt 1 started
2026-11-08T06:06:44Z [load_day 2024-05-16] 2024-05-16: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:06:51Z [load_day 2024-05-16] 2024-05-16 hour 0: 189780 events in 0 files, snapshot none (task 6393 ms: download 3162 ms overlapping gunzip 932 ms, parse 4093 ms, sort 0 ms, write 0 ms, index 768 ms: 15 candidates, 98609 repo-hours, 1115 releases; waiting 315 ms; commit 0 ms)
2026-11-08T06:06:51Z [load_day 2024-05-16] 2024-05-16 hour 1: 197439 events in 0 files, snapshot none (task 6407 ms: download 4497 ms overlapping gunzip 876 ms, parse 3869 ms, sort 0 ms, write 0 ms, index 789 ms: 14 candidates, 106838 repo-hours, 833 releases; waiting 487 ms; commit 0 ms)
2026-11-08T06:06:58Z [load_day 2024-05-16] 2024-05-16 hour 2: 169912 events in 0 files, snapshot none (task 6813 ms: download 4054 ms overlapping gunzip 1170 ms, parse 4641 ms, sort 0 ms, write 0 ms, index 550 ms: 3 candidates, 67858 repo-hours, 765 releases; waiting 182 ms; commit 0 ms)
2026-11-08T06:06:58Z [load_day 2024-05-16] 2024-05-16 hour 3: 179535 events in 0 files, snapshot none (task 6613 ms: download 3533 ms overlapping gunzip 1001 ms, parse 4134 ms, sort 0 ms, write 0 ms, index 710 ms: 6 candidates, 73521 repo-hours, 3048 releases; waiting 501 ms; commit 0 ms)
2026-11-08T06:07:06Z [load_day 2024-05-16] 2024-05-16 hour 4: 152873 events in 0 files, snapshot none (task 7470 ms: download 3806 ms overlapping gunzip 1154 ms, parse 4741 ms, sort 0 ms, write 0 ms, index 801 ms: 1 candidates, 60347 repo-hours, 648 releases; waiting 528 ms; commit 0 ms)
2026-11-08T06:07:08Z [load_day 2024-05-16] 2024-05-16 hour 5: 176219 events in 0 files, snapshot none (task 8990 ms: download 5056 ms overlapping gunzip 1463 ms, parse 5811 ms, sort 0 ms, write 0 ms, index 887 ms: 7 candidates, 69428 repo-hours, 968 releases; waiting 519 ms; commit 0 ms)
2026-11-08T06:07:16Z [load_day 2024-05-16] 2024-05-16 hour 6: 209705 events in 0 files, snapshot none (task 8858 ms: download 4957 ms overlapping gunzip 1234 ms, parse 5435 ms, sort 0 ms, write 0 ms, index 1424 ms: 4 candidates, 92736 repo-hours, 997 releases; waiting 468 ms; commit 0 ms)
2026-11-08T06:07:17Z [load_day 2024-05-16] 2024-05-16 hour 7: 227718 events in 0 files, snapshot none (task 8842 ms: download 5211 ms overlapping gunzip 1344 ms, parse 5865 ms, sort 0 ms, write 0 ms, index 908 ms: 8 candidates, 86669 repo-hours, 968 releases; waiting 473 ms; commit 0 ms)
2026-11-08T06:07:27Z [load_day 2024-05-16] 2024-05-16 hour 8: 234515 events in 0 files, snapshot none (task 10508 ms: download 6666 ms overlapping gunzip 1477 ms, parse 6632 ms, sort 0 ms, write 0 ms, index 1652 ms: 15 candidates, 95287 repo-hours, 1197 releases; waiting 486 ms; commit 0 ms)
2026-11-08T06:07:28Z [load_day 2024-05-16] 2024-05-16 hour 9: 242882 events in 0 files, snapshot none (task 10073 ms: download 6362 ms overlapping gunzip 1590 ms, parse 6923 ms, sort 0 ms, write 0 ms, index 816 ms: 21 candidates, 100056 repo-hours, 1326 releases; waiting 485 ms; commit 0 ms)
2026-11-08T06:07:35Z [load_day 2024-05-16] 2024-05-16 hour 10: 241326 events in 0 files, snapshot none (task 7589 ms: download 4744 ms overlapping gunzip 1144 ms, parse 4833 ms, sort 0 ms, write 0 ms, index 803 ms: 11 candidates, 90143 repo-hours, 1130 releases; waiting 494 ms; commit 0 ms)
2026-11-08T06:07:36Z [load_day 2024-05-16] 2024-05-16 hour 11: 237496 events in 0 files, snapshot none (task 8129 ms: download 5077 ms overlapping gunzip 1263 ms, parse 5285 ms, sort 0 ms, write 0 ms, index 860 ms: 19 candidates, 88448 repo-hours, 1121 releases; waiting 507 ms; commit 0 ms)
2026-11-08T06:07:45Z [load_day 2024-05-16] 2024-05-16 hour 12: 287704 events in 0 files, snapshot none (task 9933 ms: download 5836 ms overlapping gunzip 1594 ms, parse 6732 ms, sort 0 ms, write 0 ms, index 1125 ms: 13 candidates, 130032 repo-hours, 1338 releases; waiting 225 ms; commit 0 ms)
2026-11-08T06:07:47Z [load_day 2024-05-16] 2024-05-16 hour 13: 265815 events in 0 files, snapshot none (task 9725 ms: download 6782 ms overlapping gunzip 1553 ms, parse 6585 ms, sort 0 ms, write 0 ms, index 843 ms: 19 candidates, 114030 repo-hours, 1354 releases; waiting 475 ms; commit 0 ms)
2026-11-08T06:07:55Z [load_day 2024-05-16] 2024-05-16 hour 14: 249667 events in 0 files, snapshot none (task 8962 ms: download 6256 ms overlapping gunzip 1411 ms, parse 5944 ms, sort 0 ms, write 0 ms, index 780 ms: 7 candidates, 104327 repo-hours, 1460 releases; waiting 534 ms; commit 0 ms)
2026-11-08T06:07:56Z [load_day 2024-05-16] 2024-05-16 hour 15: 247002 events in 0 files, snapshot none (task 8688 ms: download 5969 ms overlapping gunzip 1306 ms, parse 5839 ms, sort 0 ms, write 0 ms, index 781 ms: 19 candidates, 106452 repo-hours, 1562 releases; waiting 485 ms; commit 0 ms)
2026-11-08T06:08:08Z [load_day 2024-05-16] 2024-05-16 hour 16: 240409 events in 0 files, snapshot none (task 8397 ms: download 4795 ms overlapping gunzip 1271 ms, parse 5394 ms, sort 0 ms, write 0 ms, index 971 ms: 9 candidates, 94523 repo-hours, 1226 releases; waiting 510 ms; commit 0 ms)
2026-11-08T06:08:08Z [load_day 2024-05-16] 2024-05-16 hour 17: 232094 events in 0 files, snapshot none (task 8684 ms: download 5151 ms overlapping gunzip 1368 ms, parse 5340 ms, sort 0 ms, write 0 ms, index 796 ms: 16 candidates, 92816 repo-hours, 1351 releases; waiting 756 ms; commit 0 ms)
2026-11-08T06:08:18Z [load_day 2024-05-16] 2024-05-16 hour 18: 239329 events in 0 files, snapshot none (task 10222 ms: download 7379 ms overlapping gunzip 1592 ms, parse 6482 ms, sort 0 ms, write 0 ms, index 704 ms: 15 candidates, 102593 repo-hours, 1218 releases; waiting 1022 ms; commit 0 ms)
2026-11-08T06:08:18Z [load_day 2024-05-16] 2024-05-16 hour 19: 218129 events in 0 files, snapshot none (task 8582 ms: download 5199 ms overlapping gunzip 1439 ms, parse 5714 ms, sort 0 ms, write 0 ms, index 734 ms: 9 candidates, 84306 repo-hours, 1111 releases; waiting 76 ms; commit 0 ms)
2026-11-08T06:08:27Z [load_day 2024-05-16] 2024-05-16 hour 20: 212435 events in 0 files, snapshot none (task 8606 ms: download 5881 ms overlapping gunzip 1386 ms, parse 5796 ms, sort 0 ms, write 0 ms, index 687 ms: 23 candidates, 83728 repo-hours, 1051 releases; waiting 497 ms; commit 0 ms)
2026-11-08T06:08:28Z [load_day 2024-05-16] 2024-05-16 hour 21: 203419 events in 0 files, snapshot none (task 8800 ms: download 6399 ms overlapping gunzip 1429 ms, parse 6024 ms, sort 0 ms, write 0 ms, index 602 ms: 15 candidates, 80545 repo-hours, 1109 releases; waiting 513 ms; commit 0 ms)
2026-11-08T06:08:35Z [load_day 2024-05-16] 2024-05-16 hour 22: 173288 events in 0 files, snapshot none (task 6876 ms: download 4396 ms overlapping gunzip 1059 ms, parse 4441 ms, sort 0 ms, write 0 ms, index 485 ms: 11 candidates, 63615 repo-hours, 1015 releases; waiting 532 ms; commit 0 ms)
2026-11-08T06:08:35Z [load_day 2024-05-16] 2024-05-16 hour 23: 161773 events in 0 files, snapshot none (task 6286 ms: download 3670 ms overlapping gunzip 1005 ms, parse 4059 ms, sort 0 ms, write 0 ms, index 420 ms: 6 candidates, 59076 repo-hours, 839 releases; waiting 496 ms; commit 0 ms)
2026-11-08T06:08:44Z [load_day 2024-05-16] 2024-05-16: repo_hour merged from 24 files to 1 (2145983 rows, 9328 ms)
2026-11-08T06:08:47Z [load_day 2024-05-16] 2024-05-16: index committed in 12005 ms (24 + 1 + 24 files)
2026-11-08T06:08:47Z [load_day 2024-05-16] 2024-05-16: 5190464 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:08:47Z [load_day 2024-05-16] attempt 1 succeeded