orcaLog in

Runs · run 2072

load_day 2024-02-11, attempt 1 succeeded

Host
73ccef5e07c2:85492
Started
2026-11-08T04:36:09Z
Ended
2026-11-08T04:37:34Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
586 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
114.4 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2072/load_day/2024-02-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:36:09Z [load_day 2024-02-11] attempt 1 started
2026-11-08T04:36:10Z [load_day 2024-02-11] 2024-02-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:36:15Z [load_day 2024-02-11] 2024-02-11 hour 0: 198433 events in 0 files, snapshot none (task 4619 ms: download 1940 ms overlapping gunzip 599 ms, parse 2751 ms, sort 0 ms, write 0 ms, index 537 ms: 5 candidates, 72839 repo-hours, 1089 releases; waiting 492 ms; commit 0 ms)
2026-11-08T04:36:15Z [load_day 2024-02-11] 2024-02-11 hour 1: 195036 events in 0 files, snapshot none (task 4311 ms: download 3081 ms overlapping gunzip 495 ms, parse 2417 ms, sort 0 ms, write 0 ms, index 500 ms: 4 candidates, 76139 repo-hours, 877 releases; waiting 635 ms; commit 0 ms)
2026-11-08T04:36:19Z [load_day 2024-02-11] 2024-02-11 hour 2: 159896 events in 0 files, snapshot none (task 3456 ms: download 1810 ms overlapping gunzip 427 ms, parse 1947 ms, sort 0 ms, write 0 ms, index 325 ms: 3 candidates, 38945 repo-hours, 639 releases; waiting 497 ms; commit 0 ms)
2026-11-08T04:36:19Z [load_day 2024-02-11] 2024-02-11 hour 3: 159262 events in 0 files, snapshot none (task 3547 ms: download 1862 ms overlapping gunzip 432 ms, parse 2084 ms, sort 0 ms, write 0 ms, index 295 ms: 8 candidates, 39030 repo-hours, 592 releases; waiting 489 ms; commit 0 ms)
2026-11-08T04:36:24Z [load_day 2024-02-11] 2024-02-11 hour 4: 161596 events in 0 files, snapshot none (task 4859 ms: download 1814 ms overlapping gunzip 650 ms, parse 3055 ms, sort 0 ms, write 0 ms, index 397 ms: 2 candidates, 39651 repo-hours, 472 releases; waiting 501 ms; commit 0 ms)
2026-11-08T04:36:24Z [load_day 2024-02-11] 2024-02-11 hour 5: 166259 events in 0 files, snapshot none (task 4398 ms: download 2277 ms overlapping gunzip 594 ms, parse 2733 ms, sort 0 ms, write 0 ms, index 342 ms: 8 candidates, 42636 repo-hours, 461 releases; waiting 482 ms; commit 0 ms)
2026-11-08T04:36:29Z [load_day 2024-02-11] 2024-02-11 hour 6: 167369 events in 0 files, snapshot none (task 4006 ms: download 2293 ms overlapping gunzip 474 ms, parse 2221 ms, sort 0 ms, write 0 ms, index 375 ms: 5 candidates, 50121 repo-hours, 617 releases; waiting 494 ms; commit 0 ms)
2026-11-08T04:36:29Z [load_day 2024-02-11] 2024-02-11 hour 7: 172610 events in 0 files, snapshot none (task 3855 ms: download 2076 ms overlapping gunzip 493 ms, parse 2272 ms, sort 0 ms, write 0 ms, index 319 ms: 7 candidates, 45583 repo-hours, 471 releases; waiting 497 ms; commit 0 ms)
2026-11-08T04:36:34Z [load_day 2024-02-11] 2024-02-11 hour 8: 174988 events in 0 files, snapshot none (task 4644 ms: download 2195 ms overlapping gunzip 648 ms, parse 2893 ms, sort 0 ms, write 0 ms, index 341 ms: 6 candidates, 47268 repo-hours, 516 releases; waiting 521 ms; commit 0 ms)
2026-11-08T04:36:34Z [load_day 2024-02-11] 2024-02-11 hour 9: 182626 events in 0 files, snapshot none (task 4476 ms: download 2049 ms overlapping gunzip 605 ms, parse 2767 ms, sort 0 ms, write 0 ms, index 368 ms: 4 candidates, 51073 repo-hours, 638 releases; waiting 447 ms; commit 0 ms)
2026-11-08T04:36:40Z [load_day 2024-02-11] 2024-02-11 hour 10: 192881 events in 0 files, snapshot none (task 5967 ms: download 3009 ms overlapping gunzip 861 ms, parse 3889 ms, sort 0 ms, write 0 ms, index 455 ms: 5 candidates, 54637 repo-hours, 614 releases; waiting 542 ms; commit 0 ms)
2026-11-08T04:36:40Z [load_day 2024-02-11] 2024-02-11 hour 11: 192763 events in 0 files, snapshot none (task 6083 ms: download 2818 ms overlapping gunzip 831 ms, parse 4042 ms, sort 0 ms, write 0 ms, index 489 ms: 6 candidates, 53814 repo-hours, 711 releases; waiting 473 ms; commit 0 ms)
2026-11-08T04:36:47Z [load_day 2024-02-11] 2024-02-11 hour 12: 275807 events in 0 files, snapshot none (task 6901 ms: download 3355 ms overlapping gunzip 890 ms, parse 4447 ms, sort 0 ms, write 0 ms, index 819 ms: 8 candidates, 88946 repo-hours, 822 releases; waiting 502 ms; commit 0 ms)
2026-11-08T04:36:47Z [load_day 2024-02-11] 2024-02-11 hour 13: 226111 events in 0 files, snapshot none (task 6513 ms: download 3087 ms overlapping gunzip 927 ms, parse 4369 ms, sort 0 ms, write 0 ms, index 659 ms: 14 candidates, 78704 repo-hours, 718 releases; waiting 256 ms; commit 0 ms)
2026-11-08T04:36:55Z [load_day 2024-02-11] 2024-02-11 hour 14: 217858 events in 0 files, snapshot none (task 6992 ms: download 3055 ms overlapping gunzip 1013 ms, parse 4455 ms, sort 0 ms, write 0 ms, index 750 ms: 10 candidates, 66013 repo-hours, 713 releases; waiting 512 ms; commit 0 ms)
2026-11-08T04:36:55Z [load_day 2024-02-11] 2024-02-11 hour 15: 224408 events in 0 files, snapshot none (task 7721 ms: download 4274 ms overlapping gunzip 1133 ms, parse 4798 ms, sort 0 ms, write 0 ms, index 738 ms: 22 candidates, 69835 repo-hours, 1073 releases; waiting 597 ms; commit 0 ms)
2026-11-08T04:37:03Z [load_day 2024-02-11] 2024-02-11 hour 16: 227126 events in 0 files, snapshot none (task 7496 ms: download 4166 ms overlapping gunzip 1013 ms, parse 4757 ms, sort 0 ms, write 0 ms, index 865 ms: 9 candidates, 69792 repo-hours, 798 releases; waiting 571 ms; commit 0 ms)
2026-11-08T04:37:03Z [load_day 2024-02-11] 2024-02-11 hour 17: 227635 events in 0 files, snapshot none (task 6670 ms: download 3459 ms overlapping gunzip 1026 ms, parse 4585 ms, sort 0 ms, write 0 ms, index 676 ms: 5 candidates, 67658 repo-hours, 726 releases; waiting 186 ms; commit 0 ms)
2026-11-08T04:37:11Z [load_day 2024-02-11] 2024-02-11 hour 18: 233931 events in 0 files, snapshot none (task 7736 ms: download 4710 ms overlapping gunzip 1198 ms, parse 5221 ms, sort 0 ms, write 0 ms, index 513 ms: 11 candidates, 74642 repo-hours, 820 releases; waiting 450 ms; commit 0 ms)
2026-11-08T04:37:11Z [load_day 2024-02-11] 2024-02-11 hour 19: 218416 events in 0 files, snapshot none (task 7231 ms: download 3794 ms overlapping gunzip 1116 ms, parse 4840 ms, sort 0 ms, write 0 ms, index 507 ms: 11 candidates, 61815 repo-hours, 755 releases; waiting 497 ms; commit 0 ms)
2026-11-08T04:37:19Z [load_day 2024-02-11] 2024-02-11 hour 20: 214346 events in 0 files, snapshot none (task 7150 ms: download 4128 ms overlapping gunzip 1011 ms, parse 4772 ms, sort 0 ms, write 0 ms, index 580 ms: 11 candidates, 60973 repo-hours, 769 releases; waiting 511 ms; commit 0 ms)
2026-11-08T04:37:19Z [load_day 2024-02-11] 2024-02-11 hour 21: 201710 events in 0 files, snapshot none (task 6635 ms: download 3800 ms overlapping gunzip 1024 ms, parse 4366 ms, sort 0 ms, write 0 ms, index 497 ms: 10 candidates, 54557 repo-hours, 831 releases; waiting 494 ms; commit 0 ms)
2026-11-08T04:37:25Z [load_day 2024-02-11] 2024-02-11 hour 22: 194765 events in 0 files, snapshot none (task 5968 ms: download 3085 ms overlapping gunzip 830 ms, parse 3511 ms, sort 0 ms, write 0 ms, index 519 ms: 4 candidates, 50554 repo-hours, 828 releases; waiting 493 ms; commit 0 ms)
2026-11-08T04:37:25Z [load_day 2024-02-11] 2024-02-11 hour 23: 185912 events in 0 files, snapshot none (task 5546 ms: download 2655 ms overlapping gunzip 685 ms, parse 3275 ms, sort 0 ms, write 0 ms, index 826 ms: 5 candidates, 46794 repo-hours, 677 releases; waiting 499 ms; commit 0 ms)
2026-11-08T04:37:32Z [load_day 2024-02-11] 2024-02-11: repo_hour merged from 24 files to 1 (1402019 rows, 6819 ms)
2026-11-08T04:37:34Z [load_day 2024-02-11] 2024-02-11: index committed in 9228 ms (24 + 1 + 24 files)
2026-11-08T04:37:34Z [load_day 2024-02-11] 2024-02-11: 4771744 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:37:34Z [load_day 2024-02-11] attempt 1 succeeded