orcaLog in

Runs · run 2432

load_day 2024-05-09, attempt 1 succeeded

Host
73ccef5e07c2:120164
Started
2026-11-08T06:00:48Z
Ended
2026-11-08T06:02:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
706 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
174.8 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2432/load_day/2024-05-09/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:00:48Z [load_day 2024-05-09] attempt 1 started
2026-11-08T06:00:49Z [load_day 2024-05-09] 2024-05-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:00:57Z [load_day 2024-05-09] 2024-05-09 hour 0: 188786 events in 0 files, snapshot none (task 7633 ms: download 4489 ms overlapping gunzip 1168 ms, parse 4855 ms, sort 0 ms, write 0 ms, index 738 ms: 9 candidates, 95688 repo-hours, 1167 releases; waiting 555 ms; commit 0 ms)
2026-11-08T06:00:57Z [load_day 2024-05-09] 2024-05-09 hour 1: 192343 events in 0 files, snapshot none (task 7439 ms: download 3891 ms overlapping gunzip 1052 ms, parse 4477 ms, sort 0 ms, write 0 ms, index 1058 ms: 5 candidates, 102219 repo-hours, 836 releases; waiting 503 ms; commit 0 ms)
2026-11-08T06:01:05Z [load_day 2024-05-09] 2024-05-09 hour 2: 167968 events in 0 files, snapshot none (task 7422 ms: download 4728 ms overlapping gunzip 932 ms, parse 4009 ms, sort 0 ms, write 0 ms, index 590 ms: 5 candidates, 67423 repo-hours, 845 releases; waiting 1637 ms; commit 0 ms)
2026-11-08T06:01:05Z [load_day 2024-05-09] 2024-05-09 hour 3: 171277 events in 0 files, snapshot none (task 6157 ms: download 3283 ms overlapping gunzip 852 ms, parse 3753 ms, sort 0 ms, write 0 ms, index 687 ms: 8 candidates, 72410 repo-hours, 2943 releases; waiting 523 ms; commit 0 ms)
2026-11-08T06:01:11Z [load_day 2024-05-09] 2024-05-09 hour 4: 156424 events in 0 files, snapshot none (task 5149 ms: download 2771 ms overlapping gunzip 761 ms, parse 3074 ms, sort 0 ms, write 0 ms, index 543 ms: 15 candidates, 61151 repo-hours, 724 releases; waiting 502 ms; commit 0 ms)
2026-11-08T06:01:13Z [load_day 2024-05-09] 2024-05-09 hour 5: 172002 events in 0 files, snapshot none (task 7332 ms: download 4358 ms overlapping gunzip 990 ms, parse 4170 ms, sort 0 ms, write 0 ms, index 949 ms: 10 candidates, 67364 repo-hours, 1094 releases; waiting 877 ms; commit 0 ms)
2026-11-08T06:01:17Z [load_day 2024-05-09] 2024-05-09 hour 6: 198541 events in 0 files, snapshot none (task 6023 ms: download 3489 ms overlapping gunzip 883 ms, parse 3547 ms, sort 0 ms, write 0 ms, index 774 ms: 4 candidates, 88175 repo-hours, 969 releases; waiting 528 ms; commit 0 ms)
2026-11-08T06:01:20Z [load_day 2024-05-09] 2024-05-09 hour 7: 194850 events in 0 files, snapshot none (task 6870 ms: download 4050 ms overlapping gunzip 975 ms, parse 4161 ms, sort 0 ms, write 0 ms, index 796 ms: 8 candidates, 80410 repo-hours, 856 releases; waiting 539 ms; commit 0 ms)
2026-11-08T06:01:26Z [load_day 2024-05-09] 2024-05-09 hour 8: 226859 events in 0 files, snapshot none (task 7839 ms: download 5448 ms overlapping gunzip 1343 ms, parse 5132 ms, sort 0 ms, write 0 ms, index 609 ms: 5 candidates, 85142 repo-hours, 1035 releases; waiting 509 ms; commit 0 ms)
2026-11-08T06:01:28Z [load_day 2024-05-09] 2024-05-09 hour 9: 219389 events in 0 files, snapshot none (task 7500 ms: download 4816 ms overlapping gunzip 1210 ms, parse 4495 ms, sort 0 ms, write 0 ms, index 862 ms: 8 candidates, 92493 repo-hours, 1172 releases; waiting 519 ms; commit 0 ms)
2026-11-08T06:01:34Z [load_day 2024-05-09] 2024-05-09 hour 10: 212252 events in 0 files, snapshot none (task 7314 ms: download 5004 ms overlapping gunzip 1240 ms, parse 4649 ms, sort 0 ms, write 0 ms, index 651 ms: 15 candidates, 86209 repo-hours, 1042 releases; waiting 532 ms; commit 0 ms)
2026-11-08T06:01:36Z [load_day 2024-05-09] 2024-05-09 hour 11: 209278 events in 0 files, snapshot none (task 7302 ms: download 4908 ms overlapping gunzip 1237 ms, parse 4500 ms, sort 0 ms, write 0 ms, index 708 ms: 12 candidates, 82762 repo-hours, 879 releases; waiting 590 ms; commit 0 ms)
2026-11-08T06:01:44Z [load_day 2024-05-09] 2024-05-09 hour 12: 272434 events in 0 files, snapshot none (task 9172 ms: download 4826 ms overlapping gunzip 1361 ms, parse 5925 ms, sort 0 ms, write 0 ms, index 1149 ms: 9 candidates, 122835 repo-hours, 1212 releases; waiting 534 ms; commit 0 ms)
2026-11-08T06:01:46Z [load_day 2024-05-09] 2024-05-09 hour 13: 236826 events in 0 files, snapshot none (task 8920 ms: download 6291 ms overlapping gunzip 1403 ms, parse 6258 ms, sort 0 ms, write 0 ms, index 758 ms: 10 candidates, 110787 repo-hours, 1175 releases; waiting 287 ms; commit 0 ms)
2026-11-08T06:01:54Z [load_day 2024-05-09] 2024-05-09 hour 14: 233074 events in 0 files, snapshot none (task 9412 ms: download 6662 ms overlapping gunzip 1451 ms, parse 6438 ms, sort 0 ms, write 0 ms, index 689 ms: 15 candidates, 98541 repo-hours, 1239 releases; waiting 512 ms; commit 0 ms)
2026-11-08T06:01:55Z [load_day 2024-05-09] 2024-05-09 hour 15: 252342 events in 0 files, snapshot none (task 9280 ms: download 6377 ms overlapping gunzip 1437 ms, parse 6371 ms, sort 0 ms, write 0 ms, index 964 ms: 17 candidates, 105434 repo-hours, 1282 releases; waiting 172 ms; commit 0 ms)
2026-11-08T06:02:03Z [load_day 2024-05-09] 2024-05-09 hour 16: 229420 events in 0 files, snapshot none (task 9140 ms: download 6289 ms overlapping gunzip 1398 ms, parse 5957 ms, sort 0 ms, write 0 ms, index 1016 ms: 24 candidates, 94879 repo-hours, 1225 releases; waiting 496 ms; commit 0 ms)
2026-11-08T06:02:04Z [load_day 2024-05-09] 2024-05-09 hour 17: 219637 events in 0 files, snapshot none (task 7832 ms: download 5161 ms overlapping gunzip 1235 ms, parse 5115 ms, sort 0 ms, write 0 ms, index 737 ms: 16 candidates, 88297 repo-hours, 1198 releases; waiting 473 ms; commit 0 ms)
2026-11-08T06:02:12Z [load_day 2024-05-09] 2024-05-09 hour 18: 223056 events in 0 files, snapshot none (task 8460 ms: download 5535 ms overlapping gunzip 1229 ms, parse 5435 ms, sort 0 ms, write 0 ms, index 1048 ms: 9 candidates, 98919 repo-hours, 1255 releases; waiting 495 ms; commit 0 ms)
2026-11-08T06:02:12Z [load_day 2024-05-09] 2024-05-09 hour 19: 208643 events in 0 files, snapshot none (task 7411 ms: download 4700 ms overlapping gunzip 1155 ms, parse 4898 ms, sort 0 ms, write 0 ms, index 916 ms: 7 candidates, 78269 repo-hours, 1209 releases; waiting 190 ms; commit 0 ms)
2026-11-08T06:02:20Z [load_day 2024-05-09] 2024-05-09 hour 20: 198661 events in 0 files, snapshot none (task 7426 ms: download 5016 ms overlapping gunzip 1106 ms, parse 4932 ms, sort 0 ms, write 0 ms, index 634 ms: 8 candidates, 76589 repo-hours, 1016 releases; waiting 485 ms; commit 0 ms)
2026-11-08T06:02:20Z [load_day 2024-05-09] 2024-05-09 hour 21: 182067 events in 0 files, snapshot none (task 6568 ms: download 4166 ms overlapping gunzip 1087 ms, parse 4513 ms, sort 0 ms, write 0 ms, index 526 ms: 9 candidates, 73923 repo-hours, 1365 releases; waiting 178 ms; commit 0 ms)
2026-11-08T06:02:27Z [load_day 2024-05-09] 2024-05-09 hour 22: 168253 events in 0 files, snapshot none (task 6773 ms: download 4218 ms overlapping gunzip 1074 ms, parse 4449 ms, sort 0 ms, write 0 ms, index 423 ms: 3 candidates, 62023 repo-hours, 917 releases; waiting 483 ms; commit 0 ms)
2026-11-08T06:02:27Z [load_day 2024-05-09] 2024-05-09 hour 23: 155638 events in 0 files, snapshot none (task 6220 ms: download 3609 ms overlapping gunzip 1005 ms, parse 4159 ms, sort 0 ms, write 0 ms, index 503 ms: 6 candidates, 58883 repo-hours, 770 releases; waiting 184 ms; commit 0 ms)
2026-11-08T06:02:36Z [load_day 2024-05-09] 2024-05-09: repo_hour merged from 24 files to 1 (2050825 rows, 8993 ms)
2026-11-08T06:02:39Z [load_day 2024-05-09] 2024-05-09: index committed in 11512 ms (24 + 1 + 24 files)
2026-11-08T06:02:39Z [load_day 2024-05-09] 2024-05-09: 4890020 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:02:39Z [load_day 2024-05-09] attempt 1 succeeded