orcaLog in

Runs · run 2995

load_day 2024-09-23, attempt 1 succeeded

Host
73ccef5e07c2:181717
Started
2026-11-08T08:02:55Z
Ended
2026-11-08T08:05:05Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
797 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
207.4 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2995/load_day/2024-09-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:02:55Z [load_day 2024-09-23] attempt 1 started
2026-11-08T08:02:56Z [load_day 2024-09-23] 2024-09-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:03:03Z [load_day 2024-09-23] 2024-09-23 hour 0: 169452 events in 0 files, snapshot none (task 7073 ms: download 4554 ms overlapping gunzip 1072 ms, parse 4624 ms, sort 0 ms, write 0 ms, index 555 ms: 10 candidates, 80625 repo-hours, 1046 releases; waiting 540 ms; commit 0 ms)
2026-11-08T08:03:05Z [load_day 2024-09-23] 2024-09-23 hour 1: 194642 events in 0 files, snapshot none (task 8221 ms: download 5668 ms overlapping gunzip 1415 ms, parse 5090 ms, sort 0 ms, write 0 ms, index 757 ms: 13 candidates, 103182 repo-hours, 881 releases; waiting 651 ms; commit 0 ms)
2026-11-08T08:03:11Z [load_day 2024-09-23] 2024-09-23 hour 2: 171862 events in 0 files, snapshot none (task 7089 ms: download 4217 ms overlapping gunzip 1042 ms, parse 4132 ms, sort 0 ms, write 0 ms, index 984 ms: 8 candidates, 77335 repo-hours, 884 releases; waiting 611 ms; commit 0 ms)
2026-11-08T08:03:13Z [load_day 2024-09-23] 2024-09-23 hour 3: 189193 events in 0 files, snapshot none (task 7439 ms: download 4012 ms overlapping gunzip 1100 ms, parse 4152 ms, sort 0 ms, write 0 ms, index 821 ms: 10 candidates, 76048 repo-hours, 4036 releases; waiting 569 ms; commit 0 ms)
2026-11-08T08:03:19Z [load_day 2024-09-23] 2024-09-23 hour 4: 171453 events in 0 files, snapshot none (task 7527 ms: download 4130 ms overlapping gunzip 1199 ms, parse 4700 ms, sort 0 ms, write 0 ms, index 1007 ms: 9 candidates, 63937 repo-hours, 719 releases; waiting 309 ms; commit 0 ms)
2026-11-08T08:03:20Z [load_day 2024-09-23] 2024-09-23 hour 5: 179639 events in 0 files, snapshot none (task 7201 ms: download 3858 ms overlapping gunzip 1235 ms, parse 4776 ms, sort 0 ms, write 0 ms, index 711 ms: 8 candidates, 68730 repo-hours, 1062 releases; waiting 207 ms; commit 0 ms)
2026-11-08T08:03:30Z [load_day 2024-09-23] 2024-09-23 hour 6: 221963 events in 0 files, snapshot none (task 9810 ms: download 6520 ms overlapping gunzip 1725 ms, parse 6865 ms, sort 0 ms, write 0 ms, index 702 ms: 6 candidates, 96809 repo-hours, 1084 releases; waiting 250 ms; commit 0 ms)
2026-11-08T08:03:31Z [load_day 2024-09-23] 2024-09-23 hour 7: 225412 events in 0 files, snapshot none (task 10111 ms: download 7429 ms overlapping gunzip 1760 ms, parse 6891 ms, sort 0 ms, write 0 ms, index 645 ms: 15 candidates, 88727 repo-hours, 992 releases; waiting 506 ms; commit 0 ms)
2026-11-08T08:03:41Z [load_day 2024-09-23] 2024-09-23 hour 8: 235421 events in 0 files, snapshot none (task 10962 ms: download 6956 ms overlapping gunzip 1848 ms, parse 7331 ms, sort 0 ms, write 0 ms, index 1010 ms: 4 candidates, 96171 repo-hours, 1229 releases; waiting 261 ms; commit 0 ms)
2026-11-08T08:03:43Z [load_day 2024-09-23] 2024-09-23 hour 9: 243611 events in 0 files, snapshot none (task 11178 ms: download 8528 ms overlapping gunzip 1911 ms, parse 7607 ms, sort 0 ms, write 0 ms, index 754 ms: 6 candidates, 102016 repo-hours, 1412 releases; waiting 515 ms; commit 0 ms)
2026-11-08T08:03:50Z [load_day 2024-09-23] 2024-09-23 hour 10: 233011 events in 0 files, snapshot none (task 8905 ms: download 6512 ms overlapping gunzip 1475 ms, parse 6008 ms, sort 0 ms, write 0 ms, index 668 ms: 7 candidates, 93383 repo-hours, 1294 releases; waiting 506 ms; commit 0 ms)
2026-11-08T08:03:52Z [load_day 2024-09-23] 2024-09-23 hour 11: 233569 events in 0 files, snapshot none (task 9131 ms: download 6496 ms overlapping gunzip 1522 ms, parse 5975 ms, sort 0 ms, write 0 ms, index 751 ms: 8 candidates, 91390 repo-hours, 1268 releases; waiting 549 ms; commit 0 ms)
2026-11-08T08:03:59Z [load_day 2024-09-23] 2024-09-23 hour 12: 279545 events in 0 files, snapshot none (task 8324 ms: download 5434 ms overlapping gunzip 1319 ms, parse 5444 ms, sort 0 ms, write 0 ms, index 1002 ms: 11 candidates, 137935 repo-hours, 1521 releases; waiting 238 ms; commit 0 ms)
2026-11-08T08:04:03Z [load_day 2024-09-23] 2024-09-23 hour 13: 263915 events in 0 files, snapshot none (task 9890 ms: download 6067 ms overlapping gunzip 1449 ms, parse 5775 ms, sort 0 ms, write 0 ms, index 1967 ms: 19 candidates, 122001 repo-hours, 1459 releases; waiting 474 ms; commit 0 ms)
2026-11-08T08:04:11Z [load_day 2024-09-23] 2024-09-23 hour 14: 255562 events in 0 files, snapshot none (task 10930 ms: download 7358 ms overlapping gunzip 1722 ms, parse 7102 ms, sort 0 ms, write 0 ms, index 1260 ms: 10 candidates, 107306 repo-hours, 1455 releases; waiting 511 ms; commit 0 ms)
2026-11-08T08:04:14Z [load_day 2024-09-23] 2024-09-23 hour 15: 262839 events in 0 files, snapshot none (task 10956 ms: download 7504 ms overlapping gunzip 1753 ms, parse 7340 ms, sort 0 ms, write 0 ms, index 962 ms: 8 candidates, 113791 repo-hours, 1529 releases; waiting 489 ms; commit 0 ms)
2026-11-08T08:04:23Z [load_day 2024-09-23] 2024-09-23 hour 16: 248399 events in 0 files, snapshot none (task 11970 ms: download 9270 ms overlapping gunzip 2125 ms, parse 8372 ms, sort 0 ms, write 0 ms, index 723 ms: 13 candidates, 102517 repo-hours, 1569 releases; waiting 516 ms; commit 0 ms)
2026-11-08T08:04:26Z [load_day 2024-09-23] 2024-09-23 hour 17: 235401 events in 0 files, snapshot none (task 10918 ms: download 7433 ms overlapping gunzip 1694 ms, parse 7044 ms, sort 0 ms, write 0 ms, index 1382 ms: 12 candidates, 97731 repo-hours, 1209 releases; waiting 460 ms; commit 0 ms)
2026-11-08T08:04:34Z [load_day 2024-09-23] 2024-09-23 hour 18: 247946 events in 0 files, snapshot none (task 10161 ms: download 6890 ms overlapping gunzip 1642 ms, parse 6574 ms, sort 0 ms, write 0 ms, index 1108 ms: 6 candidates, 110677 repo-hours, 1467 releases; waiting 534 ms; commit 0 ms)
2026-11-08T08:04:36Z [load_day 2024-09-23] 2024-09-23 hour 19: 225351 events in 0 files, snapshot none (task 10201 ms: download 7279 ms overlapping gunzip 1688 ms, parse 6861 ms, sort 0 ms, write 0 ms, index 802 ms: 11 candidates, 87075 repo-hours, 1162 releases; waiting 490 ms; commit 0 ms)
2026-11-08T08:04:44Z [load_day 2024-09-23] 2024-09-23 hour 20: 218531 events in 0 files, snapshot none (task 9365 ms: download 5590 ms overlapping gunzip 1562 ms, parse 6036 ms, sort 0 ms, write 0 ms, index 945 ms: 7 candidates, 85049 repo-hours, 1124 releases; waiting 514 ms; commit 0 ms)
2026-11-08T08:04:45Z [load_day 2024-09-23] 2024-09-23 hour 21: 206553 events in 0 files, snapshot none (task 7672 ms: download 5286 ms overlapping gunzip 1321 ms, parse 5139 ms, sort 0 ms, write 0 ms, index 538 ms: 8 candidates, 81526 repo-hours, 1275 releases; waiting 392 ms; commit 0 ms)
2026-11-08T08:04:51Z [load_day 2024-09-23] 2024-09-23 hour 22: 190070 events in 0 files, snapshot none (task 6597 ms: download 3966 ms overlapping gunzip 1113 ms, parse 3975 ms, sort 0 ms, write 0 ms, index 670 ms: 12 candidates, 71639 repo-hours, 1034 releases; waiting 563 ms; commit 0 ms)
2026-11-08T08:04:52Z [load_day 2024-09-23] 2024-09-23 hour 23: 188763 events in 0 files, snapshot none (task 7069 ms: download 4650 ms overlapping gunzip 1130 ms, parse 4056 ms, sort 0 ms, write 0 ms, index 781 ms: 13 candidates, 68566 repo-hours, 842 releases; waiting 715 ms; commit 0 ms)
2026-11-08T08:05:02Z [load_day 2024-09-23] 2024-09-23: repo_hour merged from 24 files to 1 (2224166 rows, 9972 ms)
2026-11-08T08:05:05Z [load_day 2024-09-23] 2024-09-23: index committed in 12384 ms (24 + 1 + 24 files)
2026-11-08T08:05:05Z [load_day 2024-09-23] 2024-09-23: 5292103 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:05:05Z [load_day 2024-09-23] attempt 1 succeeded