orcaLog in

Runs · run 2899

load_day 2024-08-28, attempt 1 succeeded

Host
73ccef5e07c2:170498
Started
2026-11-08T07:39:01Z
Ended
2026-11-08T07:41:01Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
770 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
183.3 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2899/load_day/2024-08-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:39:01Z [load_day 2024-08-28] attempt 1 started
2026-11-08T07:39:03Z [load_day 2024-08-28] 2024-08-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:39:10Z [load_day 2024-08-28] 2024-08-28 hour 0: 189015 events in 0 files, snapshot none (task 6589 ms: download 3303 ms overlapping gunzip 948 ms, parse 3961 ms, sort 0 ms, write 0 ms, index 914 ms: 11 candidates, 94314 repo-hours, 1088 releases; waiting 495 ms; commit 0 ms)
2026-11-08T07:39:10Z [load_day 2024-08-28] 2024-08-28 hour 1: 205131 events in 0 files, snapshot none (task 7169 ms: download 3599 ms overlapping gunzip 1063 ms, parse 4382 ms, sort 0 ms, write 0 ms, index 980 ms: 5 candidates, 112472 repo-hours, 834 releases; waiting 516 ms; commit 0 ms)
2026-11-08T07:39:16Z [load_day 2024-08-28] 2024-08-28 hour 2: 174547 events in 0 files, snapshot none (task 5362 ms: download 2943 ms overlapping gunzip 795 ms, parse 3198 ms, sort 0 ms, write 0 ms, index 528 ms: 5 candidates, 73980 repo-hours, 803 releases; waiting 511 ms; commit 0 ms)
2026-11-08T07:39:17Z [load_day 2024-08-28] 2024-08-28 hour 3: 190655 events in 0 files, snapshot none (task 5917 ms: download 3793 ms overlapping gunzip 813 ms, parse 3268 ms, sort 0 ms, write 0 ms, index 618 ms: 5 candidates, 76711 repo-hours, 4901 releases; waiting 954 ms; commit 0 ms)
2026-11-08T07:39:22Z [load_day 2024-08-28] 2024-08-28 hour 4: 167522 events in 0 files, snapshot none (task 5566 ms: download 2969 ms overlapping gunzip 774 ms, parse 3247 ms, sort 0 ms, write 0 ms, index 507 ms: 4 candidates, 63786 repo-hours, 686 releases; waiting 529 ms; commit 0 ms)
2026-11-08T07:39:23Z [load_day 2024-08-28] 2024-08-28 hour 5: 181998 events in 0 files, snapshot none (task 5804 ms: download 3593 ms overlapping gunzip 855 ms, parse 3423 ms, sort 0 ms, write 0 ms, index 521 ms: 3 candidates, 69844 repo-hours, 848 releases; waiting 670 ms; commit 0 ms)
2026-11-08T07:39:29Z [load_day 2024-08-28] 2024-08-28 hour 6: 216575 events in 0 files, snapshot none (task 7176 ms: download 4038 ms overlapping gunzip 1100 ms, parse 4414 ms, sort 0 ms, write 0 ms, index 844 ms: 4 candidates, 97119 repo-hours, 1002 releases; waiting 519 ms; commit 0 ms)
2026-11-08T07:39:31Z [load_day 2024-08-28] 2024-08-28 hour 7: 222011 events in 0 files, snapshot none (task 7497 ms: download 4767 ms overlapping gunzip 1211 ms, parse 4847 ms, sort 0 ms, write 0 ms, index 685 ms: 2 candidates, 89386 repo-hours, 1209 releases; waiting 506 ms; commit 0 ms)
2026-11-08T07:39:39Z [load_day 2024-08-28] 2024-08-28 hour 8: 230180 events in 0 files, snapshot none (task 9059 ms: download 5952 ms overlapping gunzip 1501 ms, parse 6071 ms, sort 0 ms, write 0 ms, index 705 ms: 6 candidates, 93624 repo-hours, 1259 releases; waiting 512 ms; commit 0 ms)
2026-11-08T07:39:40Z [load_day 2024-08-28] 2024-08-28 hour 9: 241323 events in 0 files, snapshot none (task 9178 ms: download 6585 ms overlapping gunzip 1523 ms, parse 6118 ms, sort 0 ms, write 0 ms, index 759 ms: 4 candidates, 101167 repo-hours, 1367 releases; waiting 493 ms; commit 0 ms)
2026-11-08T07:39:49Z [load_day 2024-08-28] 2024-08-28 hour 10: 224281 events in 0 files, snapshot none (task 9126 ms: download 5956 ms overlapping gunzip 1423 ms, parse 5963 ms, sort 0 ms, write 0 ms, index 1123 ms: 5 candidates, 89995 repo-hours, 1256 releases; waiting 261 ms; commit 0 ms)
2026-11-08T07:39:50Z [load_day 2024-08-28] 2024-08-28 hour 11: 223702 events in 0 files, snapshot none (task 8884 ms: download 5914 ms overlapping gunzip 1406 ms, parse 5975 ms, sort 0 ms, write 0 ms, index 693 ms: 2 candidates, 87806 repo-hours, 1184 releases; waiting 494 ms; commit 0 ms)
2026-11-08T07:40:00Z [load_day 2024-08-28] 2024-08-28 hour 12: 274015 events in 0 files, snapshot none (task 10934 ms: download 6907 ms overlapping gunzip 1528 ms, parse 6835 ms, sort 0 ms, write 0 ms, index 1739 ms: 6 candidates, 135488 repo-hours, 1424 releases; waiting 518 ms; commit 0 ms)
2026-11-08T07:40:00Z [load_day 2024-08-28] 2024-08-28 hour 13: 254890 events in 0 files, snapshot none (task 10246 ms: download 6734 ms overlapping gunzip 1624 ms, parse 6938 ms, sort 0 ms, write 0 ms, index 840 ms: 4 candidates, 116515 repo-hours, 1220 releases; waiting 524 ms; commit 0 ms)
2026-11-08T07:40:14Z [load_day 2024-08-28] 2024-08-28 hour 14: 245425 events in 0 files, snapshot none (task 10411 ms: download 7881 ms overlapping gunzip 1793 ms, parse 7069 ms, sort 0 ms, write 0 ms, index 760 ms: 8 candidates, 103016 repo-hours, 1406 releases; waiting 517 ms; commit 0 ms)
2026-11-08T07:40:14Z [load_day 2024-08-28] 2024-08-28 hour 15: 247100 events in 0 files, snapshot none (task 10082 ms: download 7314 ms overlapping gunzip 1673 ms, parse 6900 ms, sort 0 ms, write 0 ms, index 742 ms: 7 candidates, 107296 repo-hours, 1404 releases; waiting 502 ms; commit 0 ms)
2026-11-08T07:40:23Z [load_day 2024-08-28] 2024-08-28 hour 16: 228901 events in 0 files, snapshot none (task 9047 ms: download 6355 ms overlapping gunzip 1409 ms, parse 6143 ms, sort 0 ms, write 0 ms, index 684 ms: 13 candidates, 94599 repo-hours, 1162 releases; waiting 531 ms; commit 0 ms)
2026-11-08T07:40:23Z [load_day 2024-08-28] 2024-08-28 hour 17: 217985 events in 0 files, snapshot none (task 8654 ms: download 6111 ms overlapping gunzip 1405 ms, parse 5815 ms, sort 0 ms, write 0 ms, index 612 ms: 6 candidates, 87374 repo-hours, 1011 releases; waiting 522 ms; commit 0 ms)
2026-11-08T07:40:33Z [load_day 2024-08-28] 2024-08-28 hour 18: 227337 events in 0 files, snapshot none (task 9225 ms: download 6415 ms overlapping gunzip 1501 ms, parse 6200 ms, sort 0 ms, write 0 ms, index 732 ms: 6 candidates, 100604 repo-hours, 1183 releases; waiting 485 ms; commit 0 ms)
2026-11-08T07:40:33Z [load_day 2024-08-28] 2024-08-28 hour 19: 202693 events in 0 files, snapshot none (task 8568 ms: download 5907 ms overlapping gunzip 1368 ms, parse 5727 ms, sort 0 ms, write 0 ms, index 644 ms: 6 candidates, 78271 repo-hours, 1119 releases; waiting 541 ms; commit 0 ms)
2026-11-08T07:40:42Z [load_day 2024-08-28] 2024-08-28 hour 20: 200299 events in 0 files, snapshot none (task 8473 ms: download 5996 ms overlapping gunzip 1342 ms, parse 5701 ms, sort 0 ms, write 0 ms, index 611 ms: 7 candidates, 77379 repo-hours, 1051 releases; waiting 549 ms; commit 0 ms)
2026-11-08T07:40:42Z [load_day 2024-08-28] 2024-08-28 hour 21: 188539 events in 0 files, snapshot none (task 7610 ms: download 4791 ms overlapping gunzip 1229 ms, parse 5026 ms, sort 0 ms, write 0 ms, index 570 ms: 9 candidates, 74147 repo-hours, 1222 releases; waiting 508 ms; commit 0 ms)
2026-11-08T07:40:49Z [load_day 2024-08-28] 2024-08-28 hour 22: 169934 events in 0 files, snapshot none (task 7019 ms: download 4335 ms overlapping gunzip 1154 ms, parse 4508 ms, sort 0 ms, write 0 ms, index 465 ms: 9 candidates, 63254 repo-hours, 1034 releases; waiting 550 ms; commit 0 ms)
2026-11-08T07:40:49Z [load_day 2024-08-28] 2024-08-28 hour 23: 158842 events in 0 files, snapshot none (task 6477 ms: download 3858 ms overlapping gunzip 989 ms, parse 4202 ms, sort 0 ms, write 0 ms, index 428 ms: 6 candidates, 59155 repo-hours, 783 releases; waiting 518 ms; commit 0 ms)
2026-11-08T07:40:59Z [load_day 2024-08-28] 2024-08-28: repo_hour merged from 24 files to 1 (2147302 rows, 9239 ms)
2026-11-08T07:41:01Z [load_day 2024-08-28] 2024-08-28: index committed in 11630 ms (24 + 1 + 24 files)
2026-11-08T07:41:01Z [load_day 2024-08-28] 2024-08-28: 5082900 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:41:01Z [load_day 2024-08-28] attempt 1 succeeded