orcaLog in

Runs · run 3275

load_day 2024-12-04, attempt 1 succeeded

Host
73ccef5e07c2:216737
Started
2026-11-08T09:12:11Z
Ended
2026-11-08T09:14:20Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
924 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
203.2 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3275/load_day/2024-12-04/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:12:11Z [load_day 2024-12-04] attempt 1 started
2026-11-08T09:12:12Z [load_day 2024-12-04] 2024-12-04: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:12:21Z [load_day 2024-12-04] 2024-12-04 hour 0: 201549 events in 0 files, snapshot none (task 8741 ms: download 5453 ms overlapping gunzip 1362 ms, parse 5688 ms, sort 0 ms, write 0 ms, index 864 ms: 13 candidates, 92244 repo-hours, 1319 releases; waiting 481 ms; commit 0 ms)
2026-11-08T09:12:22Z [load_day 2024-12-04] 2024-12-04 hour 1: 225289 events in 0 files, snapshot none (task 9417 ms: download 6171 ms overlapping gunzip 1433 ms, parse 6549 ms, sort 0 ms, write 0 ms, index 948 ms: 11 candidates, 119590 repo-hours, 924 releases; waiting 186 ms; commit 0 ms)
2026-11-08T09:12:30Z [load_day 2024-12-04] 2024-12-04 hour 2: 191205 events in 0 files, snapshot none (task 8661 ms: download 5648 ms overlapping gunzip 1365 ms, parse 5761 ms, sort 0 ms, write 0 ms, index 673 ms: 10 candidates, 83463 repo-hours, 1056 releases; waiting 533 ms; commit 0 ms)
2026-11-08T09:12:31Z [load_day 2024-12-04] 2024-12-04 hour 3: 207236 events in 0 files, snapshot none (task 8186 ms: download 4957 ms overlapping gunzip 1318 ms, parse 5576 ms, sort 0 ms, write 0 ms, index 647 ms: 7 candidates, 86398 repo-hours, 4006 releases; waiting 267 ms; commit 0 ms)
2026-11-08T09:12:38Z [load_day 2024-12-04] 2024-12-04 hour 4: 184203 events in 0 files, snapshot none (task 7253 ms: download 3770 ms overlapping gunzip 1103 ms, parse 4560 ms, sort 0 ms, write 0 ms, index 681 ms: 6 candidates, 70543 repo-hours, 692 releases; waiting 595 ms; commit 0 ms)
2026-11-08T09:12:38Z [load_day 2024-12-04] 2024-12-04 hour 5: 192179 events in 0 files, snapshot none (task 7001 ms: download 3552 ms overlapping gunzip 991 ms, parse 4104 ms, sort 0 ms, write 0 ms, index 919 ms: 3 candidates, 76749 repo-hours, 775 releases; waiting 613 ms; commit 0 ms)
2026-11-08T09:12:47Z [load_day 2024-12-04] 2024-12-04 hour 6: 217500 events in 0 files, snapshot none (task 7933 ms: download 4664 ms overlapping gunzip 1199 ms, parse 4813 ms, sort 0 ms, write 0 ms, index 1132 ms: 8 candidates, 98330 repo-hours, 985 releases; waiting 494 ms; commit 0 ms)
2026-11-08T09:12:47Z [load_day 2024-12-04] 2024-12-04 hour 7: 217625 events in 0 files, snapshot none (task 8479 ms: download 5271 ms overlapping gunzip 1367 ms, parse 5372 ms, sort 0 ms, write 0 ms, index 881 ms: 5 candidates, 89501 repo-hours, 886 releases; waiting 496 ms; commit 0 ms)
2026-11-08T09:12:56Z [load_day 2024-12-04] 2024-12-04 hour 8: 233480 events in 0 files, snapshot none (task 8404 ms: download 5865 ms overlapping gunzip 1352 ms, parse 5546 ms, sort 0 ms, write 0 ms, index 713 ms: 8 candidates, 100550 repo-hours, 1125 releases; waiting 496 ms; commit 0 ms)
2026-11-08T09:12:56Z [load_day 2024-12-04] 2024-12-04 hour 9: 246530 events in 0 files, snapshot none (task 8356 ms: download 5758 ms overlapping gunzip 1320 ms, parse 5499 ms, sort 0 ms, write 0 ms, index 745 ms: 5 candidates, 107104 repo-hours, 1348 releases; waiting 477 ms; commit 0 ms)
2026-11-08T09:13:04Z [load_day 2024-12-04] 2024-12-04 hour 10: 237067 events in 0 files, snapshot none (task 7999 ms: download 5322 ms overlapping gunzip 1283 ms, parse 5307 ms, sort 0 ms, write 0 ms, index 716 ms: 3 candidates, 100015 repo-hours, 1118 releases; waiting 332 ms; commit 0 ms)
2026-11-08T09:13:04Z [load_day 2024-12-04] 2024-12-04 hour 11: 237365 events in 0 files, snapshot none (task 8016 ms: download 5440 ms overlapping gunzip 1269 ms, parse 5260 ms, sort 0 ms, write 0 ms, index 734 ms: 14 candidates, 95361 repo-hours, 1190 releases; waiting 471 ms; commit 0 ms)
2026-11-08T09:13:15Z [load_day 2024-12-04] 2024-12-04 hour 12: 273357 events in 0 files, snapshot none (task 10087 ms: download 6416 ms overlapping gunzip 1442 ms, parse 6507 ms, sort 0 ms, write 0 ms, index 1121 ms: 5 candidates, 137754 repo-hours, 1410 releases; waiting 662 ms; commit 0 ms)
2026-11-08T09:13:15Z [load_day 2024-12-04] 2024-12-04 hour 13: 263373 events in 0 files, snapshot none (task 9493 ms: download 6154 ms overlapping gunzip 1429 ms, parse 6197 ms, sort 0 ms, write 0 ms, index 1022 ms: 15 candidates, 122462 repo-hours, 1147 releases; waiting 494 ms; commit 0 ms)
2026-11-08T09:13:27Z [load_day 2024-12-04] 2024-12-04 hour 14: 254014 events in 0 files, snapshot none (task 11609 ms: download 8296 ms overlapping gunzip 1789 ms, parse 7967 ms, sort 0 ms, write 0 ms, index 1210 ms: 9 candidates, 108763 repo-hours, 1296 releases; waiting 335 ms; commit 0 ms)
2026-11-08T09:13:28Z [load_day 2024-12-04] 2024-12-04 hour 15: 262583 events in 0 files, snapshot none (task 12353 ms: download 8587 ms overlapping gunzip 1865 ms, parse 8319 ms, sort 0 ms, write 0 ms, index 1572 ms: 9 candidates, 115552 repo-hours, 1433 releases; waiting 309 ms; commit 0 ms)
2026-11-08T09:13:39Z [load_day 2024-12-04] 2024-12-04 hour 16: 251824 events in 0 files, snapshot none (task 11594 ms: download 8028 ms overlapping gunzip 1860 ms, parse 7969 ms, sort 0 ms, write 0 ms, index 1062 ms: 10 candidates, 108621 repo-hours, 1379 releases; waiting 484 ms; commit 0 ms)
2026-11-08T09:13:40Z [load_day 2024-12-04] 2024-12-04 hour 17: 243897 events in 0 files, snapshot none (task 11258 ms: download 7539 ms overlapping gunzip 1828 ms, parse 7686 ms, sort 0 ms, write 0 ms, index 849 ms: 7 candidates, 99419 repo-hours, 1124 releases; waiting 501 ms; commit 0 ms)
2026-11-08T09:13:49Z [load_day 2024-12-04] 2024-12-04 hour 18: 218969 events in 0 files, snapshot none (task 9425 ms: download 6035 ms overlapping gunzip 1462 ms, parse 6230 ms, sort 0 ms, write 0 ms, index 925 ms: 5 candidates, 103545 repo-hours, 1111 releases; waiting 503 ms; commit 0 ms)
2026-11-08T09:13:50Z [load_day 2024-12-04] 2024-12-04 hour 19: 222615 events in 0 files, snapshot none (task 9624 ms: download 6732 ms overlapping gunzip 1563 ms, parse 6573 ms, sort 0 ms, write 0 ms, index 719 ms: 16 candidates, 88213 repo-hours, 1172 releases; waiting 496 ms; commit 0 ms)
2026-11-08T09:13:59Z [load_day 2024-12-04] 2024-12-04 hour 20: 219843 events in 0 files, snapshot none (task 9315 ms: download 6440 ms overlapping gunzip 1536 ms, parse 6186 ms, sort 0 ms, write 0 ms, index 830 ms: 8 candidates, 88390 repo-hours, 1118 releases; waiting 532 ms; commit 0 ms)
2026-11-08T09:13:59Z [load_day 2024-12-04] 2024-12-04 hour 21: 220992 events in 0 files, snapshot none (task 8671 ms: download 5305 ms overlapping gunzip 1353 ms, parse 5551 ms, sort 0 ms, write 0 ms, index 1192 ms: 7 candidates, 87407 repo-hours, 1214 releases; waiting 192 ms; commit 0 ms)
2026-11-08T09:14:07Z [load_day 2024-12-04] 2024-12-04 hour 22: 196276 events in 0 files, snapshot none (task 7574 ms: download 4592 ms overlapping gunzip 1180 ms, parse 4887 ms, sort 0 ms, write 0 ms, index 711 ms: 5 candidates, 76408 repo-hours, 1350 releases; waiting 493 ms; commit 0 ms)
2026-11-08T09:14:07Z [load_day 2024-12-04] 2024-12-04 hour 23: 191337 events in 0 files, snapshot none (task 7628 ms: download 4484 ms overlapping gunzip 1121 ms, parse 4743 ms, sort 0 ms, write 0 ms, index 964 ms: 9 candidates, 74920 repo-hours, 927 releases; waiting 478 ms; commit 0 ms)
2026-11-08T09:14:17Z [load_day 2024-12-04] 2024-12-04: repo_hour merged from 24 files to 1 (2331302 rows, 10173 ms)
2026-11-08T09:14:20Z [load_day 2024-12-04] 2024-12-04: index committed in 12731 ms (24 + 1 + 24 files)
2026-11-08T09:14:20Z [load_day 2024-12-04] 2024-12-04: 5410308 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:14:20Z [load_day 2024-12-04] attempt 1 succeeded