orcaLog in

Runs · run 2496

load_day 2024-05-24, attempt 1 succeeded

Host
73ccef5e07c2:126451
Started
2026-11-08T06:14:09Z
Ended
2026-11-08T06:15:46Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
668 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
150.9 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2496/load_day/2024-05-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:14:09Z [load_day 2024-05-24] attempt 1 started
2026-11-08T06:14:10Z [load_day 2024-05-24] 2024-05-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:14:18Z [load_day 2024-05-24] 2024-05-24 hour 0: 179592 events in 0 files, snapshot none (task 6929 ms: download 2948 ms overlapping gunzip 989 ms, parse 4315 ms, sort 0 ms, write 0 ms, index 802 ms: 15 candidates, 93850 repo-hours, 1138 releases; waiting 511 ms; commit 0 ms)
2026-11-08T06:14:19Z [load_day 2024-05-24] 2024-05-24 hour 1: 187631 events in 0 files, snapshot none (task 7779 ms: download 4697 ms overlapping gunzip 1149 ms, parse 4582 ms, sort 0 ms, write 0 ms, index 833 ms: 11 candidates, 102800 repo-hours, 852 releases; waiting 694 ms; commit 0 ms)
2026-11-08T06:14:24Z [load_day 2024-05-24] 2024-05-24 hour 2: 159267 events in 0 files, snapshot none (task 5586 ms: download 3189 ms overlapping gunzip 845 ms, parse 3386 ms, sort 0 ms, write 0 ms, index 531 ms: 8 candidates, 64837 repo-hours, 850 releases; waiting 519 ms; commit 0 ms)
2026-11-08T06:14:25Z [load_day 2024-05-24] 2024-05-24 hour 3: 174238 events in 0 files, snapshot none (task 6319 ms: download 3421 ms overlapping gunzip 989 ms, parse 4028 ms, sort 0 ms, write 0 ms, index 573 ms: 9 candidates, 70853 repo-hours, 2762 releases; waiting 504 ms; commit 0 ms)
2026-11-08T06:14:30Z [load_day 2024-05-24] 2024-05-24 hour 4: 151712 events in 0 files, snapshot none (task 5837 ms: download 2541 ms overlapping gunzip 906 ms, parse 3676 ms, sort 0 ms, write 0 ms, index 497 ms: 9 candidates, 58629 repo-hours, 711 releases; waiting 496 ms; commit 0 ms)
2026-11-08T06:14:32Z [load_day 2024-05-24] 2024-05-24 hour 5: 167617 events in 0 files, snapshot none (task 6114 ms: download 3568 ms overlapping gunzip 911 ms, parse 3843 ms, sort 0 ms, write 0 ms, index 506 ms: 7 candidates, 66826 repo-hours, 908 releases; waiting 496 ms; commit 0 ms)
2026-11-08T06:14:38Z [load_day 2024-05-24] 2024-05-24 hour 6: 202013 events in 0 files, snapshot none (task 7771 ms: download 4689 ms overlapping gunzip 1215 ms, parse 5081 ms, sort 0 ms, write 0 ms, index 696 ms: 10 candidates, 88814 repo-hours, 1093 releases; waiting 496 ms; commit 0 ms)
2026-11-08T06:14:40Z [load_day 2024-05-24] 2024-05-24 hour 7: 211760 events in 0 files, snapshot none (task 8040 ms: download 5536 ms overlapping gunzip 1315 ms, parse 5262 ms, sort 0 ms, write 0 ms, index 685 ms: 21 candidates, 83322 repo-hours, 1067 releases; waiting 509 ms; commit 0 ms)
2026-11-08T06:14:47Z [load_day 2024-05-24] 2024-05-24 hour 8: 232209 events in 0 files, snapshot none (task 8236 ms: download 5203 ms overlapping gunzip 1202 ms, parse 5479 ms, sort 0 ms, write 0 ms, index 789 ms: 15 candidates, 90163 repo-hours, 1212 releases; waiting 505 ms; commit 0 ms)
2026-11-08T06:14:50Z [load_day 2024-05-24] 2024-05-24 hour 9: 224691 events in 0 files, snapshot none (task 9115 ms: download 6454 ms overlapping gunzip 1385 ms, parse 6176 ms, sort 0 ms, write 0 ms, index 683 ms: 18 candidates, 97380 repo-hours, 1306 releases; waiting 505 ms; commit 0 ms)
2026-11-08T06:14:55Z [load_day 2024-05-24] 2024-05-24 hour 10: 211236 events in 0 files, snapshot none (task 7674 ms: download 4316 ms overlapping gunzip 1222 ms, parse 5026 ms, sort 0 ms, write 0 ms, index 646 ms: 11 candidates, 88929 repo-hours, 1208 releases; waiting 512 ms; commit 0 ms)
2026-11-08T06:14:58Z [load_day 2024-05-24] 2024-05-24 hour 11: 211292 events in 0 files, snapshot none (task 7114 ms: download 4611 ms overlapping gunzip 1081 ms, parse 4602 ms, sort 0 ms, write 0 ms, index 595 ms: 5 candidates, 82849 repo-hours, 1336 releases; waiting 490 ms; commit 0 ms)
2026-11-08T06:15:03Z [load_day 2024-05-24] 2024-05-24 hour 12: 264297 events in 0 files, snapshot none (task 6912 ms: download 4303 ms overlapping gunzip 983 ms, parse 4314 ms, sort 0 ms, write 0 ms, index 858 ms: 18 candidates, 120336 repo-hours, 1292 releases; waiting 516 ms; commit 0 ms)
2026-11-08T06:15:06Z [load_day 2024-05-24] 2024-05-24 hour 13: 248584 events in 0 files, snapshot none (task 7770 ms: download 5181 ms overlapping gunzip 1216 ms, parse 5015 ms, sort 0 ms, write 0 ms, index 819 ms: 11 candidates, 112192 repo-hours, 1486 releases; waiting 504 ms; commit 0 ms)
2026-11-08T06:15:11Z [load_day 2024-05-24] 2024-05-24 hour 14: 235544 events in 0 files, snapshot none (task 7944 ms: download 4953 ms overlapping gunzip 1164 ms, parse 4787 ms, sort 0 ms, write 0 ms, index 1217 ms: 20 candidates, 97883 repo-hours, 1372 releases; waiting 514 ms; commit 0 ms)
2026-11-08T06:15:15Z [load_day 2024-05-24] 2024-05-24 hour 15: 235194 events in 0 files, snapshot none (task 8706 ms: download 5412 ms overlapping gunzip 1344 ms, parse 5713 ms, sort 0 ms, write 0 ms, index 1050 ms: 8 candidates, 100567 repo-hours, 1455 releases; waiting 336 ms; commit 0 ms)
2026-11-08T06:15:19Z [load_day 2024-05-24] 2024-05-24 hour 16: 201319 events in 0 files, snapshot none (task 7019 ms: download 3753 ms overlapping gunzip 1069 ms, parse 4550 ms, sort 0 ms, write 0 ms, index 639 ms: 7 candidates, 81326 repo-hours, 1001 releases; waiting 484 ms; commit 0 ms)
2026-11-08T06:15:19Z [load_day 2024-05-24] 2024-05-24 hour 17: 137992 events in 0 files, snapshot none (task 3705 ms: download 1531 ms overlapping gunzip 465 ms, parse 2288 ms, sort 0 ms, write 0 ms, index 280 ms: 6 candidates, 36382 repo-hours, 217 releases; waiting 463 ms; commit 0 ms)
2026-11-08T06:15:21Z [load_day 2024-05-24] 2024-05-24 hour 18: 120371 events in 0 files, snapshot none (task 2011 ms: download 853 ms overlapping gunzip 189 ms, parse 1025 ms, sort 0 ms, write 0 ms, index 230 ms: 1 candidates, 22450 repo-hours, 102 releases; waiting 240 ms; commit 0 ms)
2026-11-08T06:15:23Z [load_day 2024-05-24] 2024-05-24 hour 19: 138775 events in 0 files, snapshot none (task 3712 ms: download 2131 ms overlapping gunzip 419 ms, parse 2034 ms, sort 0 ms, write 0 ms, index 408 ms: 1 candidates, 40609 repo-hours, 276 releases; waiting 463 ms; commit 0 ms)
2026-11-08T06:15:29Z [load_day 2024-05-24] 2024-05-24 hour 20: 190405 events in 0 files, snapshot none (task 7023 ms: download 3756 ms overlapping gunzip 1093 ms, parse 4432 ms, sort 0 ms, write 0 ms, index 685 ms: 16 candidates, 81983 repo-hours, 1016 releases; waiting 523 ms; commit 0 ms)
2026-11-08T06:15:30Z [load_day 2024-05-24] 2024-05-24 hour 21: 178210 events in 0 files, snapshot none (task 6361 ms: download 3868 ms overlapping gunzip 987 ms, parse 3999 ms, sort 0 ms, write 0 ms, index 576 ms: 11 candidates, 68864 repo-hours, 953 releases; waiting 515 ms; commit 0 ms)
2026-11-08T06:15:35Z [load_day 2024-05-24] 2024-05-24 hour 22: 164569 events in 0 files, snapshot none (task 5505 ms: download 2911 ms overlapping gunzip 844 ms, parse 3424 ms, sort 0 ms, write 0 ms, index 403 ms: 9 candidates, 55401 repo-hours, 915 releases; waiting 542 ms; commit 0 ms)
2026-11-08T06:15:36Z [load_day 2024-05-24] 2024-05-24 hour 23: 157366 events in 0 files, snapshot none (task 5055 ms: download 2852 ms overlapping gunzip 728 ms, parse 3185 ms, sort 0 ms, write 0 ms, index 359 ms: 7 candidates, 49712 repo-hours, 703 releases; waiting 476 ms; commit 0 ms)
2026-11-08T06:15:44Z [load_day 2024-05-24] 2024-05-24: repo_hour merged from 24 files to 1 (1856957 rows, 8020 ms)
2026-11-08T06:15:46Z [load_day 2024-05-24] 2024-05-24: index committed in 10395 ms (24 + 1 + 24 files)
2026-11-08T06:15:46Z [load_day 2024-05-24] 2024-05-24: 4585884 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:15:46Z [load_day 2024-05-24] attempt 1 succeeded