orcaLog in

Runs · run 2870

load_day 2024-08-21, attempt 1 succeeded

Host
73ccef5e07c2:167130
Started
2026-11-08T07:32:29Z
Ended
2026-11-08T07:34:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
749 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
178.8 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2870/load_day/2024-08-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:32:29Z [load_day 2024-08-21] attempt 1 started
2026-11-08T07:32:30Z [load_day 2024-08-21] 2024-08-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:32:38Z [load_day 2024-08-21] 2024-08-21 hour 0: 191018 events in 0 files, snapshot none (task 7787 ms: download 4347 ms overlapping gunzip 1121 ms, parse 4989 ms, sort 0 ms, write 0 ms, index 907 ms: 8 candidates, 99243 repo-hours, 1106 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:32:39Z [load_day 2024-08-21] 2024-08-21 hour 1: 199658 events in 0 files, snapshot none (task 7820 ms: download 4984 ms overlapping gunzip 1142 ms, parse 4946 ms, sort 0 ms, write 0 ms, index 886 ms: 5 candidates, 110525 repo-hours, 882 releases; waiting 480 ms; commit 0 ms)
2026-11-08T07:32:47Z [load_day 2024-08-21] 2024-08-21 hour 2: 167134 events in 0 files, snapshot none (task 8003 ms: download 4870 ms overlapping gunzip 1316 ms, parse 5313 ms, sort 0 ms, write 0 ms, index 595 ms: 9 candidates, 68707 repo-hours, 833 releases; waiting 514 ms; commit 0 ms)
2026-11-08T07:32:47Z [load_day 2024-08-21] 2024-08-21 hour 3: 183398 events in 0 files, snapshot none (task 7925 ms: download 4290 ms overlapping gunzip 1284 ms, parse 5358 ms, sort 0 ms, write 0 ms, index 701 ms: 5 candidates, 76888 repo-hours, 4707 releases; waiting 309 ms; commit 0 ms)
2026-11-08T07:32:54Z [load_day 2024-08-21] 2024-08-21 hour 4: 158410 events in 0 files, snapshot none (task 6177 ms: download 3464 ms overlapping gunzip 887 ms, parse 3641 ms, sort 0 ms, write 0 ms, index 677 ms: 3 candidates, 60748 repo-hours, 705 releases; waiting 699 ms; commit 0 ms)
2026-11-08T07:32:55Z [load_day 2024-08-21] 2024-08-21 hour 5: 179539 events in 0 files, snapshot none (task 7198 ms: download 4385 ms overlapping gunzip 1212 ms, parse 4513 ms, sort 0 ms, write 0 ms, index 661 ms: 7 candidates, 66784 repo-hours, 843 releases; waiting 489 ms; commit 0 ms)
2026-11-08T07:33:02Z [load_day 2024-08-21] 2024-08-21 hour 6: 206104 events in 0 files, snapshot none (task 7351 ms: download 4643 ms overlapping gunzip 1130 ms, parse 4706 ms, sort 0 ms, write 0 ms, index 710 ms: 10 candidates, 91895 repo-hours, 956 releases; waiting 504 ms; commit 0 ms)
2026-11-08T07:33:03Z [load_day 2024-08-21] 2024-08-21 hour 7: 206555 events in 0 files, snapshot none (task 7876 ms: download 5013 ms overlapping gunzip 1154 ms, parse 4972 ms, sort 0 ms, write 0 ms, index 918 ms: 8 candidates, 82418 repo-hours, 1028 releases; waiting 491 ms; commit 0 ms)
2026-11-08T07:33:11Z [load_day 2024-08-21] 2024-08-21 hour 8: 222447 events in 0 files, snapshot none (task 8459 ms: download 5855 ms overlapping gunzip 1296 ms, parse 5758 ms, sort 0 ms, write 0 ms, index 623 ms: 11 candidates, 91526 repo-hours, 1250 releases; waiting 470 ms; commit 0 ms)
2026-11-08T07:33:12Z [load_day 2024-08-21] 2024-08-21 hour 9: 229525 events in 0 files, snapshot none (task 8279 ms: download 5423 ms overlapping gunzip 1277 ms, parse 5223 ms, sort 0 ms, write 0 ms, index 899 ms: 5 candidates, 96575 repo-hours, 1338 releases; waiting 532 ms; commit 0 ms)
2026-11-08T07:33:19Z [load_day 2024-08-21] 2024-08-21 hour 10: 223176 events in 0 files, snapshot none (task 7922 ms: download 5284 ms overlapping gunzip 1210 ms, parse 5179 ms, sort 0 ms, write 0 ms, index 724 ms: 9 candidates, 89760 repo-hours, 1259 releases; waiting 502 ms; commit 0 ms)
2026-11-08T07:33:21Z [load_day 2024-08-21] 2024-08-21 hour 11: 218678 events in 0 files, snapshot none (task 8403 ms: download 5570 ms overlapping gunzip 1234 ms, parse 4987 ms, sort 0 ms, write 0 ms, index 899 ms: 6 candidates, 86234 repo-hours, 1270 releases; waiting 805 ms; commit 0 ms)
2026-11-08T07:33:29Z [load_day 2024-08-21] 2024-08-21 hour 12: 274128 events in 0 files, snapshot none (task 8751 ms: download 5932 ms overlapping gunzip 1322 ms, parse 5847 ms, sort 0 ms, write 0 ms, index 826 ms: 10 candidates, 130860 repo-hours, 1245 releases; waiting 503 ms; commit 0 ms)
2026-11-08T07:33:30Z [load_day 2024-08-21] 2024-08-21 hour 13: 240305 events in 0 files, snapshot none (task 8028 ms: download 5316 ms overlapping gunzip 1245 ms, parse 5088 ms, sort 0 ms, write 0 ms, index 826 ms: 7 candidates, 111733 repo-hours, 1161 releases; waiting 538 ms; commit 0 ms)
2026-11-08T07:33:38Z [load_day 2024-08-21] 2024-08-21 hour 14: 228797 events in 0 files, snapshot none (task 8676 ms: download 7039 ms overlapping gunzip 1220 ms, parse 4947 ms, sort 0 ms, write 0 ms, index 694 ms: 6 candidates, 98287 repo-hours, 1204 releases; waiting 1276 ms; commit 0 ms)
2026-11-08T07:33:38Z [load_day 2024-08-21] 2024-08-21 hour 15: 236000 events in 0 files, snapshot none (task 8148 ms: download 5465 ms overlapping gunzip 1132 ms, parse 4746 ms, sort 0 ms, write 0 ms, index 750 ms: 3 candidates, 103799 repo-hours, 1401 releases; waiting 1178 ms; commit 0 ms)
2026-11-08T07:33:48Z [load_day 2024-08-21] 2024-08-21 hour 16: 222739 events in 0 files, snapshot none (task 9292 ms: download 6732 ms overlapping gunzip 1451 ms, parse 6329 ms, sort 0 ms, write 0 ms, index 646 ms: 9 candidates, 94122 repo-hours, 1078 releases; waiting 534 ms; commit 0 ms)
2026-11-08T07:33:48Z [load_day 2024-08-21] 2024-08-21 hour 17: 214554 events in 0 files, snapshot none (task 8535 ms: download 5922 ms overlapping gunzip 1420 ms, parse 5918 ms, sort 0 ms, write 0 ms, index 685 ms: 6 candidates, 86327 repo-hours, 1112 releases; waiting 250 ms; commit 0 ms)
2026-11-08T07:33:57Z [load_day 2024-08-21] 2024-08-21 hour 18: 224121 events in 0 files, snapshot none (task 9500 ms: download 6528 ms overlapping gunzip 1384 ms, parse 6167 ms, sort 0 ms, write 0 ms, index 1031 ms: 12 candidates, 99901 repo-hours, 1300 releases; waiting 573 ms; commit 0 ms)
2026-11-08T07:33:57Z [load_day 2024-08-21] 2024-08-21 hour 19: 203215 events in 0 files, snapshot none (task 7909 ms: download 5673 ms overlapping gunzip 1239 ms, parse 5307 ms, sort 0 ms, write 0 ms, index 602 ms: 9 candidates, 80060 repo-hours, 1061 releases; waiting 505 ms; commit 0 ms)
2026-11-08T07:34:06Z [load_day 2024-08-21] 2024-08-21 hour 20: 199359 events in 0 files, snapshot none (task 7832 ms: download 4288 ms overlapping gunzip 1219 ms, parse 5104 ms, sort 0 ms, write 0 ms, index 703 ms: 6 candidates, 79552 repo-hours, 1017 releases; waiting 530 ms; commit 0 ms)
2026-11-08T07:34:06Z [load_day 2024-08-21] 2024-08-21 hour 21: 188638 events in 0 files, snapshot none (task 8527 ms: download 6777 ms overlapping gunzip 1262 ms, parse 4923 ms, sort 0 ms, write 0 ms, index 593 ms: 10 candidates, 74803 repo-hours, 1264 releases; waiting 1232 ms; commit 0 ms)
2026-11-08T07:34:12Z [load_day 2024-08-21] 2024-08-21 hour 22: 168153 events in 0 files, snapshot none (task 5692 ms: download 3318 ms overlapping gunzip 839 ms, parse 3573 ms, sort 0 ms, write 0 ms, index 490 ms: 11 candidates, 61055 repo-hours, 1062 releases; waiting 541 ms; commit 0 ms)
2026-11-08T07:34:12Z [load_day 2024-08-21] 2024-08-21 hour 23: 163160 events in 0 files, snapshot none (task 5164 ms: download 2732 ms overlapping gunzip 831 ms, parse 3337 ms, sort 0 ms, write 0 ms, index 437 ms: 8 candidates, 62651 repo-hours, 793 releases; waiting 226 ms; commit 0 ms)
2026-11-08T07:34:21Z [load_day 2024-08-21] 2024-08-21: repo_hour merged from 24 files to 1 (2104453 rows, 9229 ms)
2026-11-08T07:34:24Z [load_day 2024-08-21] 2024-08-21: index committed in 11626 ms (24 + 1 + 24 files)
2026-11-08T07:34:24Z [load_day 2024-08-21] 2024-08-21: 4948811 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:34:24Z [load_day 2024-08-21] attempt 1 succeeded