orcaLog in

Runs · run 2391

load_day 2024-04-30, attempt 1 succeeded

Host
73ccef5e07c2:116276
Started
2026-11-08T05:51:44Z
Ended
2026-11-08T05:53:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
718 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
203.5 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2391/load_day/2024-04-30/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:51:44Z [load_day 2024-04-30] attempt 1 started
2026-11-08T05:51:45Z [load_day 2024-04-30] 2024-04-30: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:51:55Z [load_day 2024-04-30] 2024-04-30 hour 0: 206327 events in 0 files, snapshot none (task 9401 ms: download 6024 ms overlapping gunzip 1478 ms, parse 6241 ms, sort 0 ms, write 0 ms, index 847 ms: 17 candidates, 98431 repo-hours, 1050 releases; waiting 527 ms; commit 0 ms)
2026-11-08T05:51:55Z [load_day 2024-04-30] 2024-04-30 hour 1: 209891 events in 0 files, snapshot none (task 8668 ms: download 4901 ms overlapping gunzip 1392 ms, parse 5768 ms, sort 0 ms, write 0 ms, index 1025 ms: 19 candidates, 104537 repo-hours, 776 releases; waiting 179 ms; commit 0 ms)
2026-11-08T05:52:03Z [load_day 2024-04-30] 2024-04-30 hour 2: 175256 events in 0 files, snapshot none (task 7819 ms: download 5660 ms overlapping gunzip 1088 ms, parse 4555 ms, sort 0 ms, write 0 ms, index 669 ms: 9 candidates, 68092 repo-hours, 759 releases; waiting 1227 ms; commit 0 ms)
2026-11-08T05:52:03Z [load_day 2024-04-30] 2024-04-30 hour 3: 187894 events in 0 files, snapshot none (task 7549 ms: download 4549 ms overlapping gunzip 1102 ms, parse 4633 ms, sort 0 ms, write 0 ms, index 918 ms: 5 candidates, 70717 repo-hours, 2118 releases; waiting 468 ms; commit 0 ms)
2026-11-08T05:52:11Z [load_day 2024-04-30] 2024-04-30 hour 4: 180309 events in 0 files, snapshot none (task 7069 ms: download 4460 ms overlapping gunzip 1152 ms, parse 4511 ms, sort 0 ms, write 0 ms, index 474 ms: 13 candidates, 63276 repo-hours, 713 releases; waiting 523 ms; commit 0 ms)
2026-11-08T05:52:11Z [load_day 2024-04-30] 2024-04-30 hour 5: 200124 events in 0 files, snapshot none (task 7544 ms: download 4961 ms overlapping gunzip 1246 ms, parse 4957 ms, sort 0 ms, write 0 ms, index 538 ms: 5 candidates, 69370 repo-hours, 783 releases; waiting 487 ms; commit 0 ms)
2026-11-08T05:52:21Z [load_day 2024-04-30] 2024-04-30 hour 6: 215935 events in 0 files, snapshot none (task 9743 ms: download 6056 ms overlapping gunzip 1505 ms, parse 6607 ms, sort 0 ms, write 0 ms, index 843 ms: 8 candidates, 89374 repo-hours, 995 releases; waiting 505 ms; commit 0 ms)
2026-11-08T05:52:22Z [load_day 2024-04-30] 2024-04-30 hour 7: 232619 events in 0 files, snapshot none (task 10802 ms: download 7705 ms overlapping gunzip 1575 ms, parse 7500 ms, sort 0 ms, write 0 ms, index 715 ms: 11 candidates, 87516 repo-hours, 1030 releases; waiting 511 ms; commit 0 ms)
2026-11-08T05:52:33Z [load_day 2024-04-30] 2024-04-30 hour 8: 249994 events in 0 files, snapshot none (task 11763 ms: download 7483 ms overlapping gunzip 1757 ms, parse 8108 ms, sort 0 ms, write 0 ms, index 1047 ms: 15 candidates, 95516 repo-hours, 1199 releases; waiting 194 ms; commit 0 ms)
2026-11-08T05:52:34Z [load_day 2024-04-30] 2024-04-30 hour 9: 250350 events in 0 files, snapshot none (task 11359 ms: download 7941 ms overlapping gunzip 1765 ms, parse 8122 ms, sort 0 ms, write 0 ms, index 801 ms: 10 candidates, 96344 repo-hours, 1531 releases; waiting 391 ms; commit 0 ms)
2026-11-08T05:52:43Z [load_day 2024-04-30] 2024-04-30 hour 10: 242189 events in 0 files, snapshot none (task 9432 ms: download 6083 ms overlapping gunzip 1447 ms, parse 6264 ms, sort 0 ms, write 0 ms, index 868 ms: 3 candidates, 90326 repo-hours, 1223 releases; waiting 574 ms; commit 0 ms)
2026-11-08T05:52:45Z [load_day 2024-04-30] 2024-04-30 hour 11: 241491 events in 0 files, snapshot none (task 10102 ms: download 6962 ms overlapping gunzip 1450 ms, parse 6864 ms, sort 0 ms, write 0 ms, index 1029 ms: 17 candidates, 86332 repo-hours, 1181 releases; waiting 453 ms; commit 0 ms)
2026-11-08T05:52:54Z [load_day 2024-04-30] 2024-04-30 hour 12: 290098 events in 0 files, snapshot none (task 10563 ms: download 6264 ms overlapping gunzip 1487 ms, parse 6981 ms, sort 0 ms, write 0 ms, index 1277 ms: 11 candidates, 123074 repo-hours, 1381 releases; waiting 479 ms; commit 0 ms)
2026-11-08T05:52:55Z [load_day 2024-04-30] 2024-04-30 hour 13: 274827 events in 0 files, snapshot none (task 10241 ms: download 7594 ms overlapping gunzip 1554 ms, parse 7164 ms, sort 0 ms, write 0 ms, index 798 ms: 11 candidates, 110560 repo-hours, 1228 releases; waiting 465 ms; commit 0 ms)
2026-11-08T05:53:03Z [load_day 2024-04-30] 2024-04-30 hour 14: 262295 events in 0 files, snapshot none (task 8861 ms: download 6179 ms overlapping gunzip 1359 ms, parse 5952 ms, sort 0 ms, write 0 ms, index 731 ms: 11 candidates, 103007 repo-hours, 1415 releases; waiting 520 ms; commit 0 ms)
2026-11-08T05:53:04Z [load_day 2024-04-30] 2024-04-30 hour 15: 253464 events in 0 files, snapshot none (task 8296 ms: download 5698 ms overlapping gunzip 1284 ms, parse 5495 ms, sort 0 ms, write 0 ms, index 719 ms: 15 candidates, 101737 repo-hours, 1495 releases; waiting 505 ms; commit 0 ms)
2026-11-08T05:53:11Z [load_day 2024-04-30] 2024-04-30 hour 16: 230480 events in 0 files, snapshot none (task 7764 ms: download 5209 ms overlapping gunzip 1188 ms, parse 5026 ms, sort 0 ms, write 0 ms, index 724 ms: 8 candidates, 92409 repo-hours, 1299 releases; waiting 549 ms; commit 0 ms)
2026-11-08T05:53:12Z [load_day 2024-04-30] 2024-04-30 hour 17: 202114 events in 0 files, snapshot none (task 7376 ms: download 5425 ms overlapping gunzip 1076 ms, parse 4475 ms, sort 0 ms, write 0 ms, index 637 ms: 7 candidates, 78550 repo-hours, 960 releases; waiting 861 ms; commit 0 ms)
2026-11-08T05:53:22Z [load_day 2024-04-30] 2024-04-30 hour 18: 241281 events in 0 files, snapshot none (task 10219 ms: download 7182 ms overlapping gunzip 1608 ms, parse 6913 ms, sort 0 ms, write 0 ms, index 786 ms: 12 candidates, 96653 repo-hours, 1201 releases; waiting 501 ms; commit 0 ms)
2026-11-08T05:53:22Z [load_day 2024-04-30] 2024-04-30 hour 19: 222357 events in 0 files, snapshot none (task 9533 ms: download 7000 ms overlapping gunzip 1522 ms, parse 6781 ms, sort 0 ms, write 0 ms, index 598 ms: 6 candidates, 77934 repo-hours, 1008 releases; waiting 334 ms; commit 0 ms)
2026-11-08T05:53:31Z [load_day 2024-04-30] 2024-04-30 hour 20: 213957 events in 0 files, snapshot none (task 8875 ms: download 6398 ms overlapping gunzip 1455 ms, parse 6206 ms, sort 0 ms, write 0 ms, index 583 ms: 10 candidates, 78008 repo-hours, 1036 releases; waiting 348 ms; commit 0 ms)
2026-11-08T05:53:31Z [load_day 2024-04-30] 2024-04-30 hour 21: 196411 events in 0 files, snapshot none (task 8484 ms: download 6002 ms overlapping gunzip 1335 ms, parse 6008 ms, sort 0 ms, write 0 ms, index 548 ms: 5 candidates, 71652 repo-hours, 1119 releases; waiting 311 ms; commit 0 ms)
2026-11-08T05:53:39Z [load_day 2024-04-30] 2024-04-30 hour 22: 179215 events in 0 files, snapshot none (task 7327 ms: download 4874 ms overlapping gunzip 1088 ms, parse 4878 ms, sort 0 ms, write 0 ms, index 525 ms: 8 candidates, 62033 repo-hours, 1068 releases; waiting 540 ms; commit 0 ms)
2026-11-08T05:53:39Z [load_day 2024-04-30] 2024-04-30 hour 23: 170686 events in 0 files, snapshot none (task 7410 ms: download 4287 ms overlapping gunzip 1056 ms, parse 4528 ms, sort 0 ms, write 0 ms, index 1062 ms: 5 candidates, 57193 repo-hours, 827 releases; waiting 471 ms; commit 0 ms)
2026-11-08T05:53:49Z [load_day 2024-04-30] 2024-04-30: repo_hour merged from 24 files to 1 (2072641 rows, 10366 ms)
2026-11-08T05:53:52Z [load_day 2024-04-30] 2024-04-30: index committed in 12666 ms (24 + 1 + 24 files)
2026-11-08T05:53:52Z [load_day 2024-04-30] 2024-04-30: 5329564 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:53:52Z [load_day 2024-04-30] attempt 1 succeeded