orcaLog in

Runs · run 2449

load_day 2024-05-13, attempt 1 succeeded

Host
73ccef5e07c2:121725
Started
2026-11-08T06:03:58Z
Ended
2026-11-08T06:06:02Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
701 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
203.0 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2449/load_day/2024-05-13/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:03:58Z [load_day 2024-05-13] attempt 1 started
2026-11-08T06:03:59Z [load_day 2024-05-13] 2024-05-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:04:06Z [load_day 2024-05-13] 2024-05-13 hour 0: 177165 events in 0 files, snapshot none (task 6438 ms: download 3230 ms overlapping gunzip 941 ms, parse 3897 ms, sort 0 ms, write 0 ms, index 943 ms: 5 candidates, 87483 repo-hours, 1028 releases; waiting 366 ms; commit 0 ms)
2026-11-08T06:04:06Z [load_day 2024-05-13] 2024-05-13 hour 1: 193847 events in 0 files, snapshot none (task 7112 ms: download 4106 ms overlapping gunzip 1048 ms, parse 4279 ms, sort 0 ms, write 0 ms, index 1024 ms: 4 candidates, 100240 repo-hours, 804 releases; waiting 509 ms; commit 0 ms)
2026-11-08T06:04:13Z [load_day 2024-05-13] 2024-05-13 hour 2: 166133 events in 0 files, snapshot none (task 6696 ms: download 3599 ms overlapping gunzip 1129 ms, parse 4144 ms, sort 0 ms, write 0 ms, index 661 ms: 10 candidates, 64295 repo-hours, 788 releases; waiting 499 ms; commit 0 ms)
2026-11-08T06:04:13Z [load_day 2024-05-13] 2024-05-13 hour 3: 182315 events in 0 files, snapshot none (task 6393 ms: download 3496 ms overlapping gunzip 1093 ms, parse 4253 ms, sort 0 ms, write 0 ms, index 627 ms: 8 candidates, 71722 repo-hours, 3081 releases; waiting 188 ms; commit 0 ms)
2026-11-08T06:04:21Z [load_day 2024-05-13] 2024-05-13 hour 4: 170069 events in 0 files, snapshot none (task 7704 ms: download 3425 ms overlapping gunzip 1273 ms, parse 5139 ms, sort 0 ms, write 0 ms, index 690 ms: 6 candidates, 59490 repo-hours, 614 releases; waiting 378 ms; commit 0 ms)
2026-11-08T06:04:21Z [load_day 2024-05-13] 2024-05-13 hour 5: 180989 events in 0 files, snapshot none (task 7588 ms: download 3990 ms overlapping gunzip 1196 ms, parse 4751 ms, sort 0 ms, write 0 ms, index 944 ms: 5 candidates, 66692 repo-hours, 767 releases; waiting 485 ms; commit 0 ms)
2026-11-08T06:04:30Z [load_day 2024-05-13] 2024-05-13 hour 6: 211397 events in 0 files, snapshot none (task 7535 ms: download 5038 ms overlapping gunzip 1288 ms, parse 5061 ms, sort 0 ms, write 0 ms, index 695 ms: 7 candidates, 91329 repo-hours, 907 releases; waiting 204 ms; commit 0 ms)
2026-11-08T06:04:31Z [load_day 2024-05-13] 2024-05-13 hour 7: 227045 events in 0 files, snapshot none (task 8810 ms: download 6311 ms overlapping gunzip 1399 ms, parse 5898 ms, sort 0 ms, write 0 ms, index 725 ms: 10 candidates, 86514 repo-hours, 1011 releases; waiting 534 ms; commit 0 ms)
2026-11-08T06:04:38Z [load_day 2024-05-13] 2024-05-13 hour 8: 236342 events in 0 files, snapshot none (task 8305 ms: download 5835 ms overlapping gunzip 1376 ms, parse 5441 ms, sort 0 ms, write 0 ms, index 706 ms: 13 candidates, 95418 repo-hours, 1182 releases; waiting 497 ms; commit 0 ms)
2026-11-08T06:04:39Z [load_day 2024-05-13] 2024-05-13 hour 9: 246531 events in 0 files, snapshot none (task 7888 ms: download 5398 ms overlapping gunzip 1260 ms, parse 5180 ms, sort 0 ms, write 0 ms, index 645 ms: 18 candidates, 95593 repo-hours, 1336 releases; waiting 510 ms; commit 0 ms)
2026-11-08T06:04:48Z [load_day 2024-05-13] 2024-05-13 hour 10: 241430 events in 0 files, snapshot none (task 9301 ms: download 6457 ms overlapping gunzip 1310 ms, parse 5093 ms, sort 0 ms, write 0 ms, index 976 ms: 7 candidates, 90080 repo-hours, 1211 releases; waiting 1433 ms; commit 0 ms)
2026-11-08T06:04:48Z [load_day 2024-05-13] 2024-05-13 hour 11: 228978 events in 0 files, snapshot none (task 7728 ms: download 4878 ms overlapping gunzip 1189 ms, parse 4784 ms, sort 0 ms, write 0 ms, index 944 ms: 8 candidates, 89494 repo-hours, 1155 releases; waiting 508 ms; commit 0 ms)
2026-11-08T06:05:00Z [load_day 2024-05-13] 2024-05-13 hour 12: 282898 events in 0 files, snapshot none (task 11015 ms: download 7153 ms overlapping gunzip 1729 ms, parse 7460 ms, sort 0 ms, write 0 ms, index 1151 ms: 9 candidates, 131145 repo-hours, 1363 releases; waiting 460 ms; commit 0 ms)
2026-11-08T06:05:00Z [load_day 2024-05-13] 2024-05-13 hour 13: 265184 events in 0 files, snapshot none (task 11331 ms: download 7559 ms overlapping gunzip 1956 ms, parse 7615 ms, sort 0 ms, write 0 ms, index 932 ms: 16 candidates, 120383 repo-hours, 1301 releases; waiting 536 ms; commit 0 ms)
2026-11-08T06:05:10Z [load_day 2024-05-13] 2024-05-13 hour 14: 258099 events in 0 files, snapshot none (task 10184 ms: download 7339 ms overlapping gunzip 1792 ms, parse 7029 ms, sort 0 ms, write 0 ms, index 805 ms: 23 candidates, 106596 repo-hours, 1274 releases; waiting 227 ms; commit 0 ms)
2026-11-08T06:05:11Z [load_day 2024-05-13] 2024-05-13 hour 15: 257846 events in 0 files, snapshot none (task 10339 ms: download 7695 ms overlapping gunzip 1777 ms, parse 7164 ms, sort 0 ms, write 0 ms, index 887 ms: 10 candidates, 110167 repo-hours, 1554 releases; waiting 232 ms; commit 0 ms)
2026-11-08T06:05:22Z [load_day 2024-05-13] 2024-05-13 hour 16: 241778 events in 0 files, snapshot none (task 10775 ms: download 7411 ms overlapping gunzip 1714 ms, parse 6830 ms, sort 0 ms, write 0 ms, index 1435 ms: 16 candidates, 99326 repo-hours, 1188 releases; waiting 524 ms; commit 0 ms)
2026-11-08T06:05:22Z [load_day 2024-05-13] 2024-05-13 hour 17: 233490 events in 0 files, snapshot none (task 9793 ms: download 7193 ms overlapping gunzip 1610 ms, parse 6595 ms, sort 0 ms, write 0 ms, index 814 ms: 18 candidates, 92866 repo-hours, 1202 releases; waiting 466 ms; commit 0 ms)
2026-11-08T06:05:32Z [load_day 2024-05-13] 2024-05-13 hour 18: 248658 events in 0 files, snapshot none (task 10160 ms: download 7010 ms overlapping gunzip 1588 ms, parse 6613 ms, sort 0 ms, write 0 ms, index 1170 ms: 16 candidates, 102599 repo-hours, 1319 releases; waiting 484 ms; commit 0 ms)
2026-11-08T06:05:32Z [load_day 2024-05-13] 2024-05-13 hour 19: 225933 events in 0 files, snapshot none (task 9674 ms: download 6462 ms overlapping gunzip 1615 ms, parse 6327 ms, sort 0 ms, write 0 ms, index 948 ms: 17 candidates, 84343 repo-hours, 1129 releases; waiting 506 ms; commit 0 ms)
2026-11-08T06:05:41Z [load_day 2024-05-13] 2024-05-13 hour 20: 230222 events in 0 files, snapshot none (task 8330 ms: download 5390 ms overlapping gunzip 1397 ms, parse 5535 ms, sort 0 ms, write 0 ms, index 970 ms: 12 candidates, 85724 repo-hours, 1071 releases; waiting 201 ms; commit 0 ms)
2026-11-08T06:05:41Z [load_day 2024-05-13] 2024-05-13 hour 21: 204127 events in 0 files, snapshot none (task 8696 ms: download 5624 ms overlapping gunzip 1472 ms, parse 5667 ms, sort 0 ms, write 0 ms, index 810 ms: 11 candidates, 78606 repo-hours, 1273 releases; waiting 511 ms; commit 0 ms)
2026-11-08T06:05:49Z [load_day 2024-05-13] 2024-05-13 hour 22: 181239 events in 0 files, snapshot none (task 7315 ms: download 4941 ms overlapping gunzip 1170 ms, parse 4782 ms, sort 0 ms, write 0 ms, index 533 ms: 14 candidates, 66238 repo-hours, 924 releases; waiting 525 ms; commit 0 ms)
2026-11-08T06:05:50Z [load_day 2024-05-13] 2024-05-13 hour 23: 181616 events in 0 files, snapshot none (task 8004 ms: download 5219 ms overlapping gunzip 1395 ms, parse 5011 ms, sort 0 ms, write 0 ms, index 688 ms: 9 candidates, 68411 repo-hours, 713 releases; waiting 490 ms; commit 0 ms)
2026-11-08T06:05:59Z [load_day 2024-05-13] 2024-05-13: repo_hour merged from 24 files to 1 (2144754 rows, 9532 ms)
2026-11-08T06:06:02Z [load_day 2024-05-13] 2024-05-13: index committed in 12317 ms (24 + 1 + 24 files)
2026-11-08T06:06:02Z [load_day 2024-05-13] 2024-05-13: 5273331 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:06:02Z [load_day 2024-05-13] attempt 1 succeeded