orcaLog in

Runs · run 2482

load_day 2024-05-21, attempt 1 succeeded

Host
73ccef5e07c2:125187
Started
2026-11-08T06:11:12Z
Ended
2026-11-08T06:13:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
747 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
195.8 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2482/load_day/2024-05-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:11:12Z [load_day 2024-05-21] attempt 1 started
2026-11-08T06:11:13Z [load_day 2024-05-21] 2024-05-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:11:23Z [load_day 2024-05-21] 2024-05-21 hour 0: 206290 events in 0 files, snapshot none (task 8769 ms: download 5012 ms overlapping gunzip 1364 ms, parse 5705 ms, sort 0 ms, write 0 ms, index 979 ms: 18 candidates, 100706 repo-hours, 1054 releases; waiting 474 ms; commit 0 ms)
2026-11-08T06:11:23Z [load_day 2024-05-21] 2024-05-21 hour 1: 216262 events in 0 files, snapshot none (task 8789 ms: download 4780 ms overlapping gunzip 1227 ms, parse 5818 ms, sort 0 ms, write 0 ms, index 937 ms: 8 candidates, 106753 repo-hours, 943 releases; waiting 486 ms; commit 0 ms)
2026-11-08T06:11:29Z [load_day 2024-05-21] 2024-05-21 hour 2: 180107 events in 0 files, snapshot none (task 6374 ms: download 3552 ms overlapping gunzip 1000 ms, parse 4354 ms, sort 0 ms, write 0 ms, index 559 ms: 14 candidates, 69800 repo-hours, 872 releases; waiting 186 ms; commit 0 ms)
2026-11-08T06:11:30Z [load_day 2024-05-21] 2024-05-21 hour 3: 187982 events in 0 files, snapshot none (task 6847 ms: download 4215 ms overlapping gunzip 1139 ms, parse 4363 ms, sort 0 ms, write 0 ms, index 523 ms: 8 candidates, 73618 repo-hours, 2875 releases; waiting 504 ms; commit 0 ms)
2026-11-08T06:11:38Z [load_day 2024-05-21] 2024-05-21 hour 4: 183401 events in 0 files, snapshot none (task 7805 ms: download 4914 ms overlapping gunzip 1244 ms, parse 5290 ms, sort 0 ms, write 0 ms, index 576 ms: 17 candidates, 63539 repo-hours, 883 releases; waiting 475 ms; commit 0 ms)
2026-11-08T06:11:39Z [load_day 2024-05-21] 2024-05-21 hour 5: 217300 events in 0 files, snapshot none (task 8743 ms: download 6465 ms overlapping gunzip 1498 ms, parse 5899 ms, sort 0 ms, write 0 ms, index 577 ms: 16 candidates, 75050 repo-hours, 851 releases; waiting 482 ms; commit 0 ms)
2026-11-08T06:11:47Z [load_day 2024-05-21] 2024-05-21 hour 6: 229941 events in 0 files, snapshot none (task 9127 ms: download 5749 ms overlapping gunzip 1432 ms, parse 5680 ms, sort 0 ms, write 0 ms, index 881 ms: 33 candidates, 96183 repo-hours, 932 releases; waiting 621 ms; commit 0 ms)
2026-11-08T06:11:49Z [load_day 2024-05-21] 2024-05-21 hour 7: 233806 events in 0 files, snapshot none (task 10034 ms: download 7511 ms overlapping gunzip 1710 ms, parse 6701 ms, sort 0 ms, write 0 ms, index 759 ms: 43 candidates, 93939 repo-hours, 1050 releases; waiting 588 ms; commit 0 ms)
2026-11-08T06:11:58Z [load_day 2024-05-21] 2024-05-21 hour 8: 248766 events in 0 files, snapshot none (task 10253 ms: download 7143 ms overlapping gunzip 1759 ms, parse 6808 ms, sort 0 ms, write 0 ms, index 832 ms: 27 candidates, 99531 repo-hours, 1172 releases; waiting 494 ms; commit 0 ms)
2026-11-08T06:12:00Z [load_day 2024-05-21] 2024-05-21 hour 9: 251895 events in 0 files, snapshot none (task 9867 ms: download 7340 ms overlapping gunzip 1607 ms, parse 6773 ms, sort 0 ms, write 0 ms, index 741 ms: 27 candidates, 101298 repo-hours, 1341 releases; waiting 479 ms; commit 0 ms)
2026-11-08T06:12:06Z [load_day 2024-05-21] 2024-05-21 hour 10: 242388 events in 0 files, snapshot none (task 8284 ms: download 5506 ms overlapping gunzip 1297 ms, parse 5178 ms, sort 0 ms, write 0 ms, index 677 ms: 22 candidates, 90379 repo-hours, 1032 releases; waiting 762 ms; commit 0 ms)
2026-11-08T06:12:08Z [load_day 2024-05-21] 2024-05-21 hour 11: 234537 events in 0 files, snapshot none (task 7880 ms: download 5423 ms overlapping gunzip 1275 ms, parse 5140 ms, sort 0 ms, write 0 ms, index 657 ms: 17 candidates, 93186 repo-hours, 1156 releases; waiting 522 ms; commit 0 ms)
2026-11-08T06:12:15Z [load_day 2024-05-21] 2024-05-21 hour 12: 275005 events in 0 files, snapshot none (task 8593 ms: download 4863 ms overlapping gunzip 1220 ms, parse 5257 ms, sort 0 ms, write 0 ms, index 1471 ms: 17 candidates, 130961 repo-hours, 1210 releases; waiting 387 ms; commit 0 ms)
2026-11-08T06:12:17Z [load_day 2024-05-21] 2024-05-21 hour 13: 271181 events in 0 files, snapshot none (task 8814 ms: download 5945 ms overlapping gunzip 1342 ms, parse 5841 ms, sort 0 ms, write 0 ms, index 891 ms: 11 candidates, 123256 repo-hours, 1088 releases; waiting 515 ms; commit 0 ms)
2026-11-08T06:12:26Z [load_day 2024-05-21] 2024-05-21 hour 14: 257232 events in 0 files, snapshot none (task 10426 ms: download 7451 ms overlapping gunzip 1696 ms, parse 6933 ms, sort 0 ms, write 0 ms, index 774 ms: 15 candidates, 109563 repo-hours, 1182 releases; waiting 612 ms; commit 0 ms)
2026-11-08T06:12:28Z [load_day 2024-05-21] 2024-05-21 hour 15: 259981 events in 0 files, snapshot none (task 9963 ms: download 7318 ms overlapping gunzip 1606 ms, parse 6840 ms, sort 0 ms, write 0 ms, index 836 ms: 12 candidates, 114221 repo-hours, 1330 releases; waiting 464 ms; commit 0 ms)
2026-11-08T06:12:37Z [load_day 2024-05-21] 2024-05-21 hour 16: 252406 events in 0 files, snapshot none (task 9989 ms: download 7359 ms overlapping gunzip 1571 ms, parse 6884 ms, sort 0 ms, write 0 ms, index 742 ms: 18 candidates, 100539 repo-hours, 1360 releases; waiting 532 ms; commit 0 ms)
2026-11-08T06:12:38Z [load_day 2024-05-21] 2024-05-21 hour 17: 235615 events in 0 files, snapshot none (task 9242 ms: download 6444 ms overlapping gunzip 1446 ms, parse 6164 ms, sort 0 ms, write 0 ms, index 779 ms: 7 candidates, 91920 repo-hours, 1366 releases; waiting 528 ms; commit 0 ms)
2026-11-08T06:12:47Z [load_day 2024-05-21] 2024-05-21 hour 18: 237667 events in 0 files, snapshot none (task 9357 ms: download 6116 ms overlapping gunzip 1426 ms, parse 6123 ms, sort 0 ms, write 0 ms, index 1151 ms: 10 candidates, 103766 repo-hours, 1252 releases; waiting 340 ms; commit 0 ms)
2026-11-08T06:12:47Z [load_day 2024-05-21] 2024-05-21 hour 19: 216587 events in 0 files, snapshot none (task 8082 ms: download 5500 ms overlapping gunzip 1341 ms, parse 5248 ms, sort 0 ms, write 0 ms, index 774 ms: 13 candidates, 84290 repo-hours, 1106 releases; waiting 447 ms; commit 0 ms)
2026-11-08T06:12:54Z [load_day 2024-05-21] 2024-05-21 hour 20: 217017 events in 0 files, snapshot none (task 7498 ms: download 5122 ms overlapping gunzip 1180 ms, parse 4928 ms, sort 0 ms, write 0 ms, index 599 ms: 20 candidates, 82401 repo-hours, 1095 releases; waiting 507 ms; commit 0 ms)
2026-11-08T06:12:54Z [load_day 2024-05-21] 2024-05-21 hour 21: 249611 events in 0 files, snapshot none (task 7127 ms: download 4820 ms overlapping gunzip 1080 ms, parse 4633 ms, sort 0 ms, write 0 ms, index 559 ms: 17 candidates, 69340 repo-hours, 919 releases; waiting 614 ms; commit 0 ms)
2026-11-08T06:13:02Z [load_day 2024-05-21] 2024-05-21 hour 22: 173772 events in 0 files, snapshot none (task 6730 ms: download 4403 ms overlapping gunzip 1045 ms, parse 4400 ms, sort 0 ms, write 0 ms, index 464 ms: 21 candidates, 64946 repo-hours, 970 releases; waiting 532 ms; commit 0 ms)
2026-11-08T06:13:02Z [load_day 2024-05-21] 2024-05-21 hour 23: 167514 events in 0 files, snapshot none (task 6536 ms: download 3703 ms overlapping gunzip 1081 ms, parse 4413 ms, sort 0 ms, write 0 ms, index 472 ms: 19 candidates, 61344 repo-hours, 826 releases; waiting 302 ms; commit 0 ms)
2026-11-08T06:13:11Z [load_day 2024-05-21] 2024-05-21: repo_hour merged from 24 files to 1 (2200529 rows, 9536 ms)
2026-11-08T06:13:13Z [load_day 2024-05-21] 2024-05-21: index committed in 11616 ms (24 + 1 + 24 files)
2026-11-08T06:13:13Z [load_day 2024-05-21] 2024-05-21: 5446263 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:13:13Z [load_day 2024-05-21] attempt 1 succeeded