orcaLog in

Runs · run 3295

load_day 2024-12-08, attempt 1 succeeded

Host
73ccef5e07c2:219394
Started
2026-11-08T09:16:26Z
Ended
2026-11-08T09:18:04Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
667 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
135.3 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3295/load_day/2024-12-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:16:26Z [load_day 2024-12-08] attempt 1 started
2026-11-08T09:16:27Z [load_day 2024-12-08] 2024-12-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:16:33Z [load_day 2024-12-08] 2024-12-08 hour 0: 149437 events in 0 files, snapshot none (task 4956 ms: download 2517 ms overlapping gunzip 665 ms, parse 2872 ms, sort 0 ms, write 0 ms, index 581 ms: 4 candidates, 68623 repo-hours, 1045 releases; waiting 498 ms; commit 0 ms)
2026-11-08T09:16:33Z [load_day 2024-12-08] 2024-12-08 hour 1: 174054 events in 0 files, snapshot none (task 5512 ms: download 2126 ms overlapping gunzip 709 ms, parse 3205 ms, sort 0 ms, write 0 ms, index 1009 ms: 5 candidates, 95084 repo-hours, 817 releases; waiting 296 ms; commit 0 ms)
2026-11-08T09:16:37Z [load_day 2024-12-08] 2024-12-08 hour 2: 137475 events in 0 files, snapshot none (task 3947 ms: download 2192 ms overlapping gunzip 520 ms, parse 2202 ms, sort 0 ms, write 0 ms, index 400 ms: 1 candidates, 60105 repo-hours, 725 releases; waiting 525 ms; commit 0 ms)
2026-11-08T09:16:38Z [load_day 2024-12-08] 2024-12-08 hour 3: 157167 events in 0 files, snapshot none (task 4176 ms: download 2769 ms overlapping gunzip 530 ms, parse 2306 ms, sort 0 ms, write 0 ms, index 490 ms: 3 candidates, 63597 repo-hours, 3939 releases; waiting 521 ms; commit 0 ms)
2026-11-08T09:16:42Z [load_day 2024-12-08] 2024-12-08 hour 4: 144540 events in 0 files, snapshot none (task 4050 ms: download 2374 ms overlapping gunzip 561 ms, parse 2288 ms, sort 0 ms, write 0 ms, index 407 ms: 1 candidates, 51835 repo-hours, 525 releases; waiting 514 ms; commit 0 ms)
2026-11-08T09:16:43Z [load_day 2024-12-08] 2024-12-08 hour 5: 149733 events in 0 files, snapshot none (task 4174 ms: download 2138 ms overlapping gunzip 534 ms, parse 2416 ms, sort 0 ms, write 0 ms, index 403 ms: 1 candidates, 55286 repo-hours, 526 releases; waiting 513 ms; commit 0 ms)
2026-11-08T09:16:47Z [load_day 2024-12-08] 2024-12-08 hour 6: 170350 events in 0 files, snapshot none (task 4397 ms: download 2540 ms overlapping gunzip 549 ms, parse 2468 ms, sort 0 ms, write 0 ms, index 499 ms: 9 candidates, 71291 repo-hours, 717 releases; waiting 551 ms; commit 0 ms)
2026-11-08T09:16:47Z [load_day 2024-12-08] 2024-12-08 hour 7: 153493 events in 0 files, snapshot none (task 3587 ms: download 1901 ms overlapping gunzip 517 ms, parse 2152 ms, sort 0 ms, write 0 ms, index 421 ms: 3 candidates, 55801 repo-hours, 560 releases; waiting 217 ms; commit 0 ms)
2026-11-08T09:16:54Z [load_day 2024-12-08] 2024-12-08 hour 8: 160629 events in 0 files, snapshot none (task 6168 ms: download 2933 ms overlapping gunzip 855 ms, parse 3832 ms, sort 0 ms, write 0 ms, index 690 ms: 2 candidates, 61342 repo-hours, 643 releases; waiting 503 ms; commit 0 ms)
2026-11-08T09:16:54Z [load_day 2024-12-08] 2024-12-08 hour 9: 170176 events in 0 files, snapshot none (task 6491 ms: download 3158 ms overlapping gunzip 951 ms, parse 4194 ms, sort 0 ms, write 0 ms, index 550 ms: 4 candidates, 68117 repo-hours, 787 releases; waiting 512 ms; commit 0 ms)
2026-11-08T09:16:59Z [load_day 2024-12-08] 2024-12-08 hour 10: 168870 events in 0 files, snapshot none (task 5311 ms: download 3421 ms overlapping gunzip 672 ms, parse 2955 ms, sort 0 ms, write 0 ms, index 682 ms: 8 candidates, 65362 repo-hours, 663 releases; waiting 726 ms; commit 0 ms)
2026-11-08T09:17:00Z [load_day 2024-12-08] 2024-12-08 hour 11: 172384 events in 0 files, snapshot none (task 5426 ms: download 2505 ms overlapping gunzip 767 ms, parse 3208 ms, sort 0 ms, write 0 ms, index 642 ms: 6 candidates, 64321 repo-hours, 692 releases; waiting 503 ms; commit 0 ms)
2026-11-08T09:17:06Z [load_day 2024-12-08] 2024-12-08 hour 12: 233420 events in 0 files, snapshot none (task 6255 ms: download 3211 ms overlapping gunzip 789 ms, parse 3769 ms, sort 0 ms, write 0 ms, index 934 ms: 7 candidates, 114687 repo-hours, 942 releases; waiting 528 ms; commit 0 ms)
2026-11-08T09:17:06Z [load_day 2024-12-08] 2024-12-08 hour 13: 210988 events in 0 files, snapshot none (task 5693 ms: download 3384 ms overlapping gunzip 791 ms, parse 3597 ms, sort 0 ms, write 0 ms, index 683 ms: 4 candidates, 95914 repo-hours, 755 releases; waiting 234 ms; commit 0 ms)
2026-11-08T09:17:13Z [load_day 2024-12-08] 2024-12-08 hour 14: 197156 events in 0 files, snapshot none (task 6013 ms: download 3260 ms overlapping gunzip 859 ms, parse 3752 ms, sort 0 ms, write 0 ms, index 620 ms: 5 candidates, 77470 repo-hours, 782 releases; waiting 470 ms; commit 0 ms)
2026-11-08T09:17:13Z [load_day 2024-12-08] 2024-12-08 hour 15: 209518 events in 0 files, snapshot none (task 6642 ms: download 3928 ms overlapping gunzip 931 ms, parse 4183 ms, sort 0 ms, write 0 ms, index 673 ms: 5 candidates, 87796 repo-hours, 955 releases; waiting 497 ms; commit 0 ms)
2026-11-08T09:17:21Z [load_day 2024-12-08] 2024-12-08 hour 16: 204346 events in 0 files, snapshot none (task 7721 ms: download 4371 ms overlapping gunzip 1181 ms, parse 5110 ms, sort 0 ms, write 0 ms, index 605 ms: 7 candidates, 80674 repo-hours, 897 releases; waiting 510 ms; commit 0 ms)
2026-11-08T09:17:21Z [load_day 2024-12-08] 2024-12-08 hour 17: 196652 events in 0 files, snapshot none (task 6991 ms: download 4147 ms overlapping gunzip 1013 ms, parse 4581 ms, sort 0 ms, write 0 ms, index 576 ms: 10 candidates, 74018 repo-hours, 852 releases; waiting 461 ms; commit 0 ms)
2026-11-08T09:17:38Z [load_day 2024-12-08] 2024-12-08 hour 18: 258423 events in 0 files, snapshot none (task 15985 ms: download 13723 ms overlapping gunzip 3509 ms, parse 11174 ms, sort 0 ms, write 0 ms, index 801 ms: 6 candidates, 94733 repo-hours, 776 releases; waiting 207 ms; commit 0 ms)
2026-11-08T09:17:38Z [load_day 2024-12-08] 2024-12-08 hour 19: 193670 events in 0 files, snapshot none (task 9844 ms: download 4901 ms overlapping gunzip 1572 ms, parse 6227 ms, sort 0 ms, write 0 ms, index 1188 ms: 10 candidates, 69389 repo-hours, 825 releases; waiting 487 ms; commit 0 ms)
2026-11-08T09:17:45Z [load_day 2024-12-08] 2024-12-08 hour 20: 187424 events in 0 files, snapshot none (task 6981 ms: download 3891 ms overlapping gunzip 996 ms, parse 4441 ms, sort 0 ms, write 0 ms, index 663 ms: 6 candidates, 70791 repo-hours, 902 releases; waiting 558 ms; commit 0 ms)
2026-11-08T09:17:46Z [load_day 2024-12-08] 2024-12-08 hour 21: 187765 events in 0 files, snapshot none (task 7459 ms: download 4954 ms overlapping gunzip 1253 ms, parse 4885 ms, sort 0 ms, write 0 ms, index 531 ms: 5 candidates, 71321 repo-hours, 1038 releases; waiting 487 ms; commit 0 ms)
2026-11-08T09:17:53Z [load_day 2024-12-08] 2024-12-08 hour 22: 171504 events in 0 files, snapshot none (task 7054 ms: download 4977 ms overlapping gunzip 1097 ms, parse 4343 ms, sort 0 ms, write 0 ms, index 666 ms: 4 candidates, 61809 repo-hours, 1245 releases; waiting 523 ms; commit 0 ms)
2026-11-08T09:17:53Z [load_day 2024-12-08] 2024-12-08 hour 23: 168854 events in 0 files, snapshot none (task 6936 ms: download 3816 ms overlapping gunzip 1054 ms, parse 4518 ms, sort 0 ms, write 0 ms, index 495 ms: 1 candidates, 59418 repo-hours, 801 releases; waiting 546 ms; commit 0 ms)
2026-11-08T09:18:01Z [load_day 2024-12-08] 2024-12-08: repo_hour merged from 24 files to 1 (1738784 rows, 7723 ms)
2026-11-08T09:18:04Z [load_day 2024-12-08] 2024-12-08: index committed in 10601 ms (24 + 1 + 24 files)
2026-11-08T09:18:04Z [load_day 2024-12-08] 2024-12-08: 4328028 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:18:04Z [load_day 2024-12-08] attempt 1 succeeded