orcaLog in

Runs · run 2185

load_day 2024-03-11, attempt 1 succeeded

Host
73ccef5e07c2:96583
Started
2026-11-08T05:03:14Z
Ended
2026-11-08T05:05:20Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
720 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
202.4 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2185/load_day/2024-03-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:03:14Z [load_day 2024-03-11] attempt 1 started
2026-11-08T05:03:15Z [load_day 2024-03-11] 2024-03-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:03:22Z [load_day 2024-03-11] 2024-03-11 hour 0: 232127 events in 0 files, snapshot none (task 6751 ms: download 4146 ms overlapping gunzip 937 ms, parse 4225 ms, sort 0 ms, write 0 ms, index 682 ms: 8 candidates, 86691 repo-hours, 1139 releases; waiting 631 ms; commit 0 ms)
2026-11-08T05:03:24Z [load_day 2024-03-11] 2024-03-11 hour 1: 247669 events in 0 files, snapshot none (task 8123 ms: download 5087 ms overlapping gunzip 1256 ms, parse 5067 ms, sort 0 ms, write 0 ms, index 1080 ms: 5 candidates, 94767 repo-hours, 803 releases; waiting 460 ms; commit 0 ms)
2026-11-08T05:03:29Z [load_day 2024-03-11] 2024-03-11 hour 2: 219450 events in 0 files, snapshot none (task 6401 ms: download 3513 ms overlapping gunzip 1061 ms, parse 4036 ms, sort 0 ms, write 0 ms, index 472 ms: 6 candidates, 63172 repo-hours, 782 releases; waiting 514 ms; commit 0 ms)
2026-11-08T05:03:31Z [load_day 2024-03-11] 2024-03-11 hour 3: 218901 events in 0 files, snapshot none (task 6227 ms: download 3866 ms overlapping gunzip 950 ms, parse 3924 ms, sort 0 ms, write 0 ms, index 528 ms: 6 candidates, 63059 repo-hours, 883 releases; waiting 536 ms; commit 0 ms)
2026-11-08T05:03:37Z [load_day 2024-03-11] 2024-03-11 hour 4: 214344 events in 0 files, snapshot none (task 6703 ms: download 4193 ms overlapping gunzip 1016 ms, parse 4267 ms, sort 0 ms, write 0 ms, index 446 ms: 10 candidates, 59827 repo-hours, 689 releases; waiting 569 ms; commit 0 ms)
2026-11-08T05:03:38Z [load_day 2024-03-11] 2024-03-11 hour 5: 222400 events in 0 files, snapshot none (task 7142 ms: download 4776 ms overlapping gunzip 1102 ms, parse 4671 ms, sort 0 ms, write 0 ms, index 542 ms: 5 candidates, 64061 repo-hours, 680 releases; waiting 534 ms; commit 0 ms)
2026-11-08T05:03:45Z [load_day 2024-03-11] 2024-03-11 hour 6: 246265 events in 0 files, snapshot none (task 7747 ms: download 5175 ms overlapping gunzip 1300 ms, parse 5097 ms, sort 0 ms, write 0 ms, index 617 ms: 2 candidates, 79321 repo-hours, 769 releases; waiting 509 ms; commit 0 ms)
2026-11-08T05:03:47Z [load_day 2024-03-11] 2024-03-11 hour 7: 250987 events in 0 files, snapshot none (task 8107 ms: download 4975 ms overlapping gunzip 1260 ms, parse 5036 ms, sort 0 ms, write 0 ms, index 984 ms: 5 candidates, 78653 repo-hours, 829 releases; waiting 515 ms; commit 0 ms)
2026-11-08T05:03:56Z [load_day 2024-03-11] 2024-03-11 hour 8: 269420 events in 0 files, snapshot none (task 11130 ms: download 6731 ms overlapping gunzip 1884 ms, parse 7727 ms, sort 0 ms, write 0 ms, index 749 ms: 16 candidates, 88125 repo-hours, 965 releases; waiting 442 ms; commit 0 ms)
2026-11-08T05:03:58Z [load_day 2024-03-11] 2024-03-11 hour 9: 277202 events in 0 files, snapshot none (task 11206 ms: download 8444 ms overlapping gunzip 1854 ms, parse 7726 ms, sort 0 ms, write 0 ms, index 798 ms: 7 candidates, 92562 repo-hours, 1253 releases; waiting 524 ms; commit 0 ms)
2026-11-08T05:04:07Z [load_day 2024-03-11] 2024-03-11 hour 10: 270332 events in 0 files, snapshot none (task 10170 ms: download 7215 ms overlapping gunzip 1669 ms, parse 6993 ms, sort 0 ms, write 0 ms, index 691 ms: 10 candidates, 90593 repo-hours, 1243 releases; waiting 514 ms; commit 0 ms)
2026-11-08T05:04:10Z [load_day 2024-03-11] 2024-03-11 hour 11: 279658 events in 0 files, snapshot none (task 10765 ms: download 7520 ms overlapping gunzip 1655 ms, parse 7230 ms, sort 0 ms, write 0 ms, index 1082 ms: 5 candidates, 90077 repo-hours, 1234 releases; waiting 492 ms; commit 0 ms)
2026-11-08T05:04:17Z [load_day 2024-03-11] 2024-03-11 hour 12: 311679 events in 0 files, snapshot none (task 10122 ms: download 6459 ms overlapping gunzip 1524 ms, parse 6596 ms, sort 0 ms, write 0 ms, index 1186 ms: 10 candidates, 120002 repo-hours, 1229 releases; waiting 523 ms; commit 0 ms)
2026-11-08T05:04:20Z [load_day 2024-03-11] 2024-03-11 hour 13: 302513 events in 0 files, snapshot none (task 9455 ms: download 6880 ms overlapping gunzip 1481 ms, parse 6442 ms, sort 0 ms, write 0 ms, index 817 ms: 11 candidates, 114869 repo-hours, 1079 releases; waiting 483 ms; commit 0 ms)
2026-11-08T05:04:28Z [load_day 2024-03-11] 2024-03-11 hour 14: 300548 events in 0 files, snapshot none (task 10450 ms: download 7873 ms overlapping gunzip 1736 ms, parse 7099 ms, sort 0 ms, write 0 ms, index 747 ms: 5 candidates, 106519 repo-hours, 1288 releases; waiting 526 ms; commit 0 ms)
2026-11-08T05:04:30Z [load_day 2024-03-11] 2024-03-11 hour 15: 301557 events in 0 files, snapshot none (task 9989 ms: download 7550 ms overlapping gunzip 1627 ms, parse 6916 ms, sort 0 ms, write 0 ms, index 712 ms: 11 candidates, 104548 repo-hours, 1334 releases; waiting 481 ms; commit 0 ms)
2026-11-08T05:04:39Z [load_day 2024-03-11] 2024-03-11 hour 16: 297571 events in 0 files, snapshot none (task 8581 ms: download 6048 ms overlapping gunzip 1405 ms, parse 5632 ms, sort 0 ms, write 0 ms, index 738 ms: 11 candidates, 103297 repo-hours, 1183 releases; waiting 501 ms; commit 0 ms)
2026-11-08T05:04:40Z [load_day 2024-03-11] 2024-03-11 hour 17: 277175 events in 0 files, snapshot none (task 9588 ms: download 6788 ms overlapping gunzip 1421 ms, parse 5777 ms, sort 0 ms, write 0 ms, index 861 ms: 13 candidates, 93983 repo-hours, 1052 releases; waiting 1222 ms; commit 0 ms)
2026-11-08T05:04:50Z [load_day 2024-03-11] 2024-03-11 hour 18: 253332 events in 0 files, snapshot none (task 10417 ms: download 6875 ms overlapping gunzip 1715 ms, parse 6699 ms, sort 0 ms, write 0 ms, index 1121 ms: 11 candidates, 98889 repo-hours, 1297 releases; waiting 535 ms; commit 0 ms)
2026-11-08T05:04:51Z [load_day 2024-03-11] 2024-03-11 hour 19: 238706 events in 0 files, snapshot none (task 9762 ms: download 6078 ms overlapping gunzip 1554 ms, parse 6365 ms, sort 0 ms, write 0 ms, index 1003 ms: 15 candidates, 85843 repo-hours, 1171 releases; waiting 502 ms; commit 0 ms)
2026-11-08T05:05:00Z [load_day 2024-03-11] 2024-03-11 hour 20: 235568 events in 0 files, snapshot none (task 9230 ms: download 6617 ms overlapping gunzip 1508 ms, parse 6309 ms, sort 0 ms, write 0 ms, index 609 ms: 11 candidates, 85932 repo-hours, 1720 releases; waiting 525 ms; commit 0 ms)
2026-11-08T05:05:00Z [load_day 2024-03-11] 2024-03-11 hour 21: 219625 events in 0 files, snapshot none (task 9077 ms: download 6726 ms overlapping gunzip 1439 ms, parse 5866 ms, sort 0 ms, write 0 ms, index 600 ms: 10 candidates, 77391 repo-hours, 1241 releases; waiting 958 ms; commit 0 ms)
2026-11-08T05:05:09Z [load_day 2024-03-11] 2024-03-11 hour 22: 208001 events in 0 files, snapshot none (task 8458 ms: download 5817 ms overlapping gunzip 1488 ms, parse 5483 ms, sort 0 ms, write 0 ms, index 553 ms: 7 candidates, 70420 repo-hours, 987 releases; waiting 371 ms; commit 0 ms)
2026-11-08T05:05:09Z [load_day 2024-03-11] 2024-03-11 hour 23: 195304 events in 0 files, snapshot none (task 7525 ms: download 5098 ms overlapping gunzip 1285 ms, parse 4899 ms, sort 0 ms, write 0 ms, index 577 ms: 8 candidates, 67019 repo-hours, 782 releases; waiting 498 ms; commit 0 ms)
2026-11-08T05:05:18Z [load_day 2024-03-11] 2024-03-11: repo_hour merged from 24 files to 1 (2079620 rows, 9203 ms)
2026-11-08T05:05:20Z [load_day 2024-03-11] 2024-03-11: index committed in 11762 ms (24 + 1 + 24 files)
2026-11-08T05:05:20Z [load_day 2024-03-11] 2024-03-11: 6090334 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:05:20Z [load_day 2024-03-11] attempt 1 succeeded