orcaLog in

Runs · run 2036

load_day 2024-02-01, attempt 1 succeeded

Host
73ccef5e07c2:80545
Started
2026-11-08T04:26:17Z
Ended
2026-11-08T04:28:26Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
717 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
200.7 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2036/load_day/2024-02-01/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:26:17Z [load_day 2024-02-01] attempt 1 started
2026-11-08T04:26:18Z [load_day 2024-02-01] 2024-02-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:26:27Z [load_day 2024-02-01] 2024-02-01 hour 0: 226339 events in 0 files, snapshot none (task 9030 ms: download 5535 ms overlapping gunzip 1438 ms, parse 5908 ms, sort 0 ms, write 0 ms, index 919 ms: 11 candidates, 93577 repo-hours, 1351 releases; waiting 473 ms; commit 0 ms)
2026-11-08T04:26:28Z [load_day 2024-02-01] 2024-02-01 hour 1: 227627 events in 0 files, snapshot none (task 9464 ms: download 5592 ms overlapping gunzip 1464 ms, parse 6336 ms, sort 0 ms, write 0 ms, index 882 ms: 9 candidates, 99769 repo-hours, 1296 releases; waiting 506 ms; commit 0 ms)
2026-11-08T04:26:36Z [load_day 2024-02-01] 2024-02-01 hour 2: 197981 events in 0 files, snapshot none (task 8375 ms: download 5191 ms overlapping gunzip 1311 ms, parse 5538 ms, sort 0 ms, write 0 ms, index 784 ms: 5 candidates, 66348 repo-hours, 806 releases; waiting 470 ms; commit 0 ms)
2026-11-08T04:26:37Z [load_day 2024-02-01] 2024-02-01 hour 3: 196266 events in 0 files, snapshot none (task 9294 ms: download 5557 ms overlapping gunzip 1524 ms, parse 6249 ms, sort 0 ms, write 0 ms, index 760 ms: 8 candidates, 63652 repo-hours, 886 releases; waiting 535 ms; commit 0 ms)
2026-11-08T04:26:43Z [load_day 2024-02-01] 2024-02-01 hour 4: 191139 events in 0 files, snapshot none (task 6771 ms: download 4224 ms overlapping gunzip 1085 ms, parse 4423 ms, sort 0 ms, write 0 ms, index 427 ms: 3 candidates, 60174 repo-hours, 726 releases; waiting 480 ms; commit 0 ms)
2026-11-08T04:26:46Z [load_day 2024-02-01] 2024-02-01 hour 5: 202313 events in 0 files, snapshot none (task 8143 ms: download 4485 ms overlapping gunzip 1326 ms, parse 4975 ms, sort 0 ms, write 0 ms, index 951 ms: 8 candidates, 65060 repo-hours, 754 releases; waiting 547 ms; commit 0 ms)
2026-11-08T04:26:51Z [load_day 2024-02-01] 2024-02-01 hour 6: 222285 events in 0 files, snapshot none (task 7733 ms: download 5058 ms overlapping gunzip 1256 ms, parse 5382 ms, sort 0 ms, write 0 ms, index 591 ms: 5 candidates, 77916 repo-hours, 977 releases; waiting 208 ms; commit 0 ms)
2026-11-08T04:26:54Z [load_day 2024-02-01] 2024-02-01 hour 7: 222926 events in 0 files, snapshot none (task 7835 ms: download 5299 ms overlapping gunzip 1247 ms, parse 5158 ms, sort 0 ms, write 0 ms, index 617 ms: 5 candidates, 76776 repo-hours, 783 releases; waiting 484 ms; commit 0 ms)
2026-11-08T04:26:59Z [load_day 2024-02-01] 2024-02-01 hour 8: 232018 events in 0 files, snapshot none (task 6849 ms: download 4424 ms overlapping gunzip 1088 ms, parse 4358 ms, sort 0 ms, write 0 ms, index 622 ms: 9 candidates, 82243 repo-hours, 1085 releases; waiting 519 ms; commit 0 ms)
2026-11-08T04:27:03Z [load_day 2024-02-01] 2024-02-01 hour 9: 250425 events in 0 files, snapshot none (task 8393 ms: download 5471 ms overlapping gunzip 1356 ms, parse 5539 ms, sort 0 ms, write 0 ms, index 825 ms: 5 candidates, 90162 repo-hours, 1458 releases; waiting 366 ms; commit 0 ms)
2026-11-08T04:27:08Z [load_day 2024-02-01] 2024-02-01 hour 10: 252020 events in 0 files, snapshot none (task 8678 ms: download 5369 ms overlapping gunzip 1313 ms, parse 5242 ms, sort 0 ms, write 0 ms, index 1368 ms: 5 candidates, 89858 repo-hours, 1194 releases; waiting 498 ms; commit 0 ms)
2026-11-08T04:27:13Z [load_day 2024-02-01] 2024-02-01 hour 11: 251106 events in 0 files, snapshot none (task 9561 ms: download 6565 ms overlapping gunzip 1606 ms, parse 6449 ms, sort 0 ms, write 0 ms, index 739 ms: 6 candidates, 85248 repo-hours, 994 releases; waiting 535 ms; commit 0 ms)
2026-11-08T04:27:17Z [load_day 2024-02-01] 2024-02-01 hour 12: 297356 events in 0 files, snapshot none (task 8738 ms: download 5934 ms overlapping gunzip 1383 ms, parse 5798 ms, sort 0 ms, write 0 ms, index 829 ms: 11 candidates, 114213 repo-hours, 1134 releases; waiting 445 ms; commit 0 ms)
2026-11-08T04:27:24Z [load_day 2024-02-01] 2024-02-01 hour 13: 276070 events in 0 files, snapshot none (task 9694 ms: download 5218 ms overlapping gunzip 1495 ms, parse 6210 ms, sort 0 ms, write 0 ms, index 1192 ms: 15 candidates, 108022 repo-hours, 1170 releases; waiting 524 ms; commit 0 ms)
2026-11-08T04:27:32Z [load_day 2024-02-01] 2024-02-01 hour 14: 278229 events in 0 files, snapshot none (task 12320 ms: download 8035 ms overlapping gunzip 2082 ms, parse 8387 ms, sort 0 ms, write 0 ms, index 1021 ms: 14 candidates, 99491 repo-hours, 1184 releases; waiting 544 ms; commit 0 ms)
2026-11-08T04:27:35Z [load_day 2024-02-01] 2024-02-01 hour 15: 272849 events in 0 files, snapshot none (task 9891 ms: download 6938 ms overlapping gunzip 1691 ms, parse 6603 ms, sort 0 ms, write 0 ms, index 820 ms: 8 candidates, 101537 repo-hours, 1302 releases; waiting 500 ms; commit 0 ms)
2026-11-08T04:27:44Z [load_day 2024-02-01] 2024-02-01 hour 16: 269708 events in 0 files, snapshot none (task 11635 ms: download 8772 ms overlapping gunzip 2013 ms, parse 8021 ms, sort 0 ms, write 0 ms, index 837 ms: 12 candidates, 100172 repo-hours, 1324 releases; waiting 495 ms; commit 0 ms)
2026-11-08T04:27:45Z [load_day 2024-02-01] 2024-02-01 hour 17: 263851 events in 0 files, snapshot none (task 10077 ms: download 7387 ms overlapping gunzip 1738 ms, parse 6864 ms, sort 0 ms, write 0 ms, index 755 ms: 9 candidates, 92475 repo-hours, 1089 releases; waiting 448 ms; commit 0 ms)
2026-11-08T04:27:55Z [load_day 2024-02-01] 2024-02-01 hour 18: 267505 events in 0 files, snapshot none (task 11192 ms: download 7872 ms overlapping gunzip 1788 ms, parse 7570 ms, sort 0 ms, write 0 ms, index 1090 ms: 9 candidates, 97151 repo-hours, 1250 releases; waiting 528 ms; commit 0 ms)
2026-11-08T04:27:55Z [load_day 2024-02-01] 2024-02-01 hour 19: 249167 events in 0 files, snapshot none (task 9105 ms: download 6425 ms overlapping gunzip 1641 ms, parse 6235 ms, sort 0 ms, write 0 ms, index 767 ms: 7 candidates, 82743 repo-hours, 1075 releases; waiting 197 ms; commit 0 ms)
2026-11-08T04:28:05Z [load_day 2024-02-01] 2024-02-01 hour 20: 252432 events in 0 files, snapshot none (task 9298 ms: download 6249 ms overlapping gunzip 1419 ms, parse 6120 ms, sort 0 ms, write 0 ms, index 991 ms: 13 candidates, 79216 repo-hours, 1110 releases; waiting 506 ms; commit 0 ms)
2026-11-08T04:28:05Z [load_day 2024-02-01] 2024-02-01 hour 21: 229502 events in 0 files, snapshot none (task 8771 ms: download 6217 ms overlapping gunzip 1424 ms, parse 5879 ms, sort 0 ms, write 0 ms, index 692 ms: 5 candidates, 75029 repo-hours, 1234 releases; waiting 507 ms; commit 0 ms)
2026-11-08T04:28:14Z [load_day 2024-02-01] 2024-02-01 hour 22: 211883 events in 0 files, snapshot none (task 8466 ms: download 5725 ms overlapping gunzip 1344 ms, parse 5686 ms, sort 0 ms, write 0 ms, index 683 ms: 4 candidates, 66653 repo-hours, 1059 releases; waiting 501 ms; commit 0 ms)
2026-11-08T04:28:14Z [load_day 2024-02-01] 2024-02-01 hour 23: 200255 events in 0 files, snapshot none (task 8197 ms: download 5188 ms overlapping gunzip 1340 ms, parse 5564 ms, sort 0 ms, write 0 ms, index 557 ms: 7 candidates, 62537 repo-hours, 991 releases; waiting 187 ms; commit 0 ms)
2026-11-08T04:28:23Z [load_day 2024-02-01] 2024-02-01: repo_hour merged from 24 files to 1 (2030022 rows, 8854 ms)
2026-11-08T04:28:26Z [load_day 2024-02-01] 2024-02-01: index committed in 12152 ms (24 + 1 + 24 files)
2026-11-08T04:28:26Z [load_day 2024-02-01] 2024-02-01: 5741252 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:28:26Z [load_day 2024-02-01] attempt 1 succeeded