orcaLog in

Runs · run 3181

load_day 2024-11-08, attempt 1 succeeded

Host
73ccef5e07c2:204634
Started
2026-11-08T08:43:19Z
Ended
2026-11-08T08:45:34Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
791 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
209.6 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3181/load_day/2024-11-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:43:19Z [load_day 2024-11-08] attempt 1 started
2026-11-08T08:43:21Z [load_day 2024-11-08] 2024-11-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:43:29Z [load_day 2024-11-08] 2024-11-08 hour 0: 193390 events in 0 files, snapshot none (task 7353 ms: download 4593 ms overlapping gunzip 1114 ms, parse 4609 ms, sort 0 ms, write 0 ms, index 772 ms: 8 candidates, 93170 repo-hours, 1334 releases; waiting 529 ms; commit 0 ms)
2026-11-08T08:43:29Z [load_day 2024-11-08] 2024-11-08 hour 1: 204432 events in 0 files, snapshot none (task 7539 ms: download 4520 ms overlapping gunzip 1112 ms, parse 4692 ms, sort 0 ms, write 0 ms, index 945 ms: 11 candidates, 109646 repo-hours, 917 releases; waiting 524 ms; commit 0 ms)
2026-11-08T08:43:38Z [load_day 2024-11-08] 2024-11-08 hour 2: 193450 events in 0 files, snapshot none (task 9151 ms: download 6430 ms overlapping gunzip 1471 ms, parse 6177 ms, sort 0 ms, write 0 ms, index 725 ms: 8 candidates, 80002 repo-hours, 826 releases; waiting 493 ms; commit 0 ms)
2026-11-08T08:43:38Z [load_day 2024-11-08] 2024-11-08 hour 3: 207603 events in 0 files, snapshot none (task 8335 ms: download 5804 ms overlapping gunzip 1368 ms, parse 5499 ms, sort 0 ms, write 0 ms, index 724 ms: 7 candidates, 81270 repo-hours, 3916 releases; waiting 472 ms; commit 0 ms)
2026-11-08T08:43:47Z [load_day 2024-11-08] 2024-11-08 hour 4: 186254 events in 0 files, snapshot none (task 8268 ms: download 6135 ms overlapping gunzip 1340 ms, parse 5670 ms, sort 0 ms, write 0 ms, index 462 ms: 2 candidates, 63587 repo-hours, 732 releases; waiting 519 ms; commit 0 ms)
2026-11-08T08:43:48Z [load_day 2024-11-08] 2024-11-08 hour 5: 190986 events in 0 files, snapshot none (task 8825 ms: download 6515 ms overlapping gunzip 1416 ms, parse 6061 ms, sort 0 ms, write 0 ms, index 562 ms: 2 candidates, 66663 repo-hours, 800 releases; waiting 510 ms; commit 0 ms)
2026-11-08T08:43:55Z [load_day 2024-11-08] 2024-11-08 hour 6: 215026 events in 0 files, snapshot none (task 7202 ms: download 4784 ms overlapping gunzip 1130 ms, parse 4544 ms, sort 0 ms, write 0 ms, index 666 ms: 4 candidates, 89164 repo-hours, 1004 releases; waiting 558 ms; commit 0 ms)
2026-11-08T08:43:55Z [load_day 2024-11-08] 2024-11-08 hour 7: 209777 events in 0 files, snapshot none (task 7055 ms: download 4807 ms overlapping gunzip 1173 ms, parse 4563 ms, sort 0 ms, write 0 ms, index 609 ms: 4 candidates, 77057 repo-hours, 903 releases; waiting 500 ms; commit 0 ms)
2026-11-08T08:44:04Z [load_day 2024-11-08] 2024-11-08 hour 8: 233814 events in 0 files, snapshot none (task 7996 ms: download 5771 ms overlapping gunzip 1285 ms, parse 4982 ms, sort 0 ms, write 0 ms, index 625 ms: 5 candidates, 86677 repo-hours, 1092 releases; waiting 838 ms; commit 0 ms)
2026-11-08T08:44:05Z [load_day 2024-11-08] 2024-11-08 hour 9: 245212 events in 0 files, snapshot none (task 9741 ms: download 5787 ms overlapping gunzip 1347 ms, parse 5331 ms, sort 0 ms, write 0 ms, index 2223 ms: 4 candidates, 95433 repo-hours, 1250 releases; waiting 528 ms; commit 0 ms)
2026-11-08T08:44:17Z [load_day 2024-11-08] 2024-11-08 hour 10: 238693 events in 0 files, snapshot none (task 10599 ms: download 7878 ms overlapping gunzip 1758 ms, parse 7117 ms, sort 0 ms, write 0 ms, index 956 ms: 12 candidates, 89675 repo-hours, 1156 releases; waiting 516 ms; commit 0 ms)
2026-11-08T08:44:17Z [load_day 2024-11-08] 2024-11-08 hour 11: 236862 events in 0 files, snapshot none (task 10728 ms: download 7914 ms overlapping gunzip 1761 ms, parse 7060 ms, sort 0 ms, write 0 ms, index 1106 ms: 5 candidates, 83586 repo-hours, 1102 releases; waiting 517 ms; commit 0 ms)
2026-11-08T08:44:29Z [load_day 2024-11-08] 2024-11-08 hour 12: 264335 events in 0 files, snapshot none (task 11533 ms: download 7283 ms overlapping gunzip 1747 ms, parse 7956 ms, sort 0 ms, write 0 ms, index 1041 ms: 5 candidates, 129125 repo-hours, 1164 releases; waiting 548 ms; commit 0 ms)
2026-11-08T08:44:29Z [load_day 2024-11-08] 2024-11-08 hour 13: 263580 events in 0 files, snapshot none (task 12175 ms: download 9300 ms overlapping gunzip 2028 ms, parse 8261 ms, sort 0 ms, write 0 ms, index 779 ms: 10 candidates, 113937 repo-hours, 1117 releases; waiting 746 ms; commit 0 ms)
2026-11-08T08:44:40Z [load_day 2024-11-08] 2024-11-08 hour 14: 255478 events in 0 files, snapshot none (task 11211 ms: download 8497 ms overlapping gunzip 1835 ms, parse 7415 ms, sort 0 ms, write 0 ms, index 971 ms: 8 candidates, 101214 repo-hours, 1242 releases; waiting 715 ms; commit 0 ms)
2026-11-08T08:44:41Z [load_day 2024-11-08] 2024-11-08 hour 15: 257603 events in 0 files, snapshot none (task 11154 ms: download 7869 ms overlapping gunzip 1750 ms, parse 7106 ms, sort 0 ms, write 0 ms, index 1275 ms: 5 candidates, 104901 repo-hours, 1404 releases; waiting 546 ms; commit 0 ms)
2026-11-08T08:44:52Z [load_day 2024-11-08] 2024-11-08 hour 16: 248377 events in 0 files, snapshot none (task 10626 ms: download 7782 ms overlapping gunzip 1770 ms, parse 7223 ms, sort 0 ms, write 0 ms, index 828 ms: 6 candidates, 96377 repo-hours, 1496 releases; waiting 482 ms; commit 0 ms)
2026-11-08T08:44:52Z [load_day 2024-11-08] 2024-11-08 hour 17: 234576 events in 0 files, snapshot none (task 9997 ms: download 7523 ms overlapping gunzip 1660 ms, parse 6900 ms, sort 0 ms, write 0 ms, index 686 ms: 7 candidates, 88222 repo-hours, 1058 releases; waiting 485 ms; commit 0 ms)
2026-11-08T08:45:03Z [load_day 2024-11-08] 2024-11-08 hour 18: 242212 events in 0 files, snapshot none (task 10669 ms: download 7601 ms overlapping gunzip 1674 ms, parse 6949 ms, sort 0 ms, write 0 ms, index 1227 ms: 6 candidates, 98875 repo-hours, 1227 releases; waiting 495 ms; commit 0 ms)
2026-11-08T08:45:03Z [load_day 2024-11-08] 2024-11-08 hour 19: 225406 events in 0 files, snapshot none (task 9878 ms: download 7286 ms overlapping gunzip 1706 ms, parse 6338 ms, sort 0 ms, write 0 ms, index 924 ms: 3 candidates, 80131 repo-hours, 1002 releases; waiting 628 ms; commit 0 ms)
2026-11-08T08:45:12Z [load_day 2024-11-08] 2024-11-08 hour 20: 212375 events in 0 files, snapshot none (task 9263 ms: download 6856 ms overlapping gunzip 1591 ms, parse 6271 ms, sort 0 ms, write 0 ms, index 596 ms: 4 candidates, 74968 repo-hours, 1008 releases; waiting 493 ms; commit 0 ms)
2026-11-08T08:45:12Z [load_day 2024-11-08] 2024-11-08 hour 21: 208602 events in 0 files, snapshot none (task 9304 ms: download 7044 ms overlapping gunzip 1518 ms, parse 6383 ms, sort 0 ms, write 0 ms, index 595 ms: 10 candidates, 74856 repo-hours, 1155 releases; waiting 525 ms; commit 0 ms)
2026-11-08T08:45:21Z [load_day 2024-11-08] 2024-11-08 hour 22: 192763 events in 0 files, snapshot none (task 8554 ms: download 6408 ms overlapping gunzip 1453 ms, parse 5831 ms, sort 0 ms, write 0 ms, index 481 ms: 6 candidates, 64846 repo-hours, 1174 releases; waiting 521 ms; commit 0 ms)
2026-11-08T08:45:21Z [load_day 2024-11-08] 2024-11-08 hour 23: 174744 events in 0 files, snapshot none (task 7576 ms: download 5403 ms overlapping gunzip 1236 ms, parse 5116 ms, sort 0 ms, write 0 ms, index 420 ms: 8 candidates, 58585 repo-hours, 831 releases; waiting 495 ms; commit 0 ms)
2026-11-08T08:45:31Z [load_day 2024-11-08] 2024-11-08: repo_hour merged from 24 files to 1 (2101967 rows, 9290 ms)
2026-11-08T08:45:34Z [load_day 2024-11-08] 2024-11-08: index committed in 12113 ms (24 + 1 + 24 files)
2026-11-08T08:45:34Z [load_day 2024-11-08] 2024-11-08: 5335550 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:45:34Z [load_day 2024-11-08] attempt 1 succeeded