orcaLog in

Runs · run 2708

load_day 2024-07-12, attempt 1 succeeded

Host
73ccef5e07c2:148919
Started
2026-11-08T06:57:26Z
Ended
2026-11-08T06:59:14Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
690 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
166.2 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2708/load_day/2024-07-12/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:57:26Z [load_day 2024-07-12] attempt 1 started
2026-11-08T06:57:27Z [load_day 2024-07-12] 2024-07-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:57:35Z [load_day 2024-07-12] 2024-07-12 hour 0: 175957 events in 0 files, snapshot none (task 7115 ms: download 3822 ms overlapping gunzip 988 ms, parse 4445 ms, sort 0 ms, write 0 ms, index 706 ms: 7 candidates, 93514 repo-hours, 1097 releases; waiting 577 ms; commit 0 ms)
2026-11-08T06:57:35Z [load_day 2024-07-12] 2024-07-12 hour 1: 186365 events in 0 files, snapshot none (task 6942 ms: download 3927 ms overlapping gunzip 948 ms, parse 4213 ms, sort 0 ms, write 0 ms, index 926 ms: 4 candidates, 106937 repo-hours, 960 releases; waiting 597 ms; commit 0 ms)
2026-11-08T06:57:41Z [load_day 2024-07-12] 2024-07-12 hour 2: 151335 events in 0 files, snapshot none (task 5899 ms: download 3247 ms overlapping gunzip 903 ms, parse 3610 ms, sort 0 ms, write 0 ms, index 651 ms: 7 candidates, 66205 repo-hours, 898 releases; waiting 478 ms; commit 0 ms)
2026-11-08T06:57:42Z [load_day 2024-07-12] 2024-07-12 hour 3: 173212 events in 0 files, snapshot none (task 6374 ms: download 3358 ms overlapping gunzip 873 ms, parse 3852 ms, sort 0 ms, write 0 ms, index 909 ms: 6 candidates, 74766 repo-hours, 5504 releases; waiting 515 ms; commit 0 ms)
2026-11-08T06:57:47Z [load_day 2024-07-12] 2024-07-12 hour 4: 146926 events in 0 files, snapshot none (task 5563 ms: download 3197 ms overlapping gunzip 853 ms, parse 3418 ms, sort 0 ms, write 0 ms, index 465 ms: 7 candidates, 60043 repo-hours, 802 releases; waiting 506 ms; commit 0 ms)
2026-11-08T06:57:48Z [load_day 2024-07-12] 2024-07-12 hour 5: 165946 events in 0 files, snapshot none (task 6168 ms: download 3746 ms overlapping gunzip 919 ms, parse 3859 ms, sort 0 ms, write 0 ms, index 547 ms: 3 candidates, 70307 repo-hours, 850 releases; waiting 498 ms; commit 0 ms)
2026-11-08T06:57:56Z [load_day 2024-07-12] 2024-07-12 hour 6: 206069 events in 0 files, snapshot none (task 8012 ms: download 5125 ms overlapping gunzip 1189 ms, parse 5367 ms, sort 0 ms, write 0 ms, index 672 ms: 10 candidates, 97958 repo-hours, 1120 releases; waiting 485 ms; commit 0 ms)
2026-11-08T06:57:57Z [load_day 2024-07-12] 2024-07-12 hour 7: 204554 events in 0 files, snapshot none (task 7890 ms: download 5321 ms overlapping gunzip 1232 ms, parse 5151 ms, sort 0 ms, write 0 ms, index 631 ms: 5 candidates, 84057 repo-hours, 967 releases; waiting 566 ms; commit 0 ms)
2026-11-08T06:58:07Z [load_day 2024-07-12] 2024-07-12 hour 8: 213599 events in 0 files, snapshot none (task 10463 ms: download 7234 ms overlapping gunzip 1411 ms, parse 5658 ms, sort 0 ms, write 0 ms, index 768 ms: 8 candidates, 90376 repo-hours, 1315 releases; waiting 1776 ms; commit 0 ms)
2026-11-08T06:58:07Z [load_day 2024-07-12] 2024-07-12 hour 9: 219801 events in 0 files, snapshot none (task 9156 ms: download 6091 ms overlapping gunzip 1370 ms, parse 5892 ms, sort 0 ms, write 0 ms, index 1026 ms: 14 candidates, 96697 repo-hours, 1340 releases; waiting 528 ms; commit 0 ms)
2026-11-08T06:58:14Z [load_day 2024-07-12] 2024-07-12 hour 10: 203659 events in 0 files, snapshot none (task 7080 ms: download 4662 ms overlapping gunzip 1104 ms, parse 4613 ms, sort 0 ms, write 0 ms, index 599 ms: 8 candidates, 85165 repo-hours, 1152 releases; waiting 505 ms; commit 0 ms)
2026-11-08T06:58:14Z [load_day 2024-07-12] 2024-07-12 hour 11: 197975 events in 0 files, snapshot none (task 6454 ms: download 4028 ms overlapping gunzip 963 ms, parse 4100 ms, sort 0 ms, write 0 ms, index 602 ms: 5 candidates, 79817 repo-hours, 995 releases; waiting 514 ms; commit 0 ms)
2026-11-08T06:58:22Z [load_day 2024-07-12] 2024-07-12 hour 12: 265133 events in 0 files, snapshot none (task 7662 ms: download 4658 ms overlapping gunzip 1040 ms, parse 4477 ms, sort 0 ms, write 0 ms, index 922 ms: 6 candidates, 133708 repo-hours, 1271 releases; waiting 778 ms; commit 0 ms)
2026-11-08T06:58:23Z [load_day 2024-07-12] 2024-07-12 hour 13: 235533 events in 0 files, snapshot none (task 7617 ms: download 4973 ms overlapping gunzip 1129 ms, parse 4859 ms, sort 0 ms, write 0 ms, index 833 ms: 9 candidates, 112166 repo-hours, 1341 releases; waiting 524 ms; commit 0 ms)
2026-11-08T06:58:32Z [load_day 2024-07-12] 2024-07-12 hour 14: 220091 events in 0 files, snapshot none (task 9379 ms: download 6845 ms overlapping gunzip 1459 ms, parse 6428 ms, sort 0 ms, write 0 ms, index 728 ms: 6 candidates, 93282 repo-hours, 1465 releases; waiting 497 ms; commit 0 ms)
2026-11-08T06:58:32Z [load_day 2024-07-12] 2024-07-12 hour 15: 224624 events in 0 files, snapshot none (task 8892 ms: download 6045 ms overlapping gunzip 1421 ms, parse 5860 ms, sort 0 ms, write 0 ms, index 721 ms: 10 candidates, 100310 repo-hours, 1330 releases; waiting 512 ms; commit 0 ms)
2026-11-08T06:58:41Z [load_day 2024-07-12] 2024-07-12 hour 16: 212912 events in 0 files, snapshot none (task 8149 ms: download 5473 ms overlapping gunzip 1349 ms, parse 5444 ms, sort 0 ms, write 0 ms, index 633 ms: 11 candidates, 90864 repo-hours, 1235 releases; waiting 482 ms; commit 0 ms)
2026-11-08T06:58:41Z [load_day 2024-07-12] 2024-07-12 hour 17: 196540 events in 0 files, snapshot none (task 7474 ms: download 4470 ms overlapping gunzip 1180 ms, parse 5232 ms, sort 0 ms, write 0 ms, index 601 ms: 12 candidates, 78768 repo-hours, 1063 releases; waiting 199 ms; commit 0 ms)
2026-11-08T06:58:49Z [load_day 2024-07-12] 2024-07-12 hour 18: 206103 events in 0 files, snapshot none (task 7780 ms: download 5029 ms overlapping gunzip 1161 ms, parse 5012 ms, sort 0 ms, write 0 ms, index 844 ms: 7 candidates, 92891 repo-hours, 1177 releases; waiting 492 ms; commit 0 ms)
2026-11-08T06:58:49Z [load_day 2024-07-12] 2024-07-12 hour 19: 184746 events in 0 files, snapshot none (task 7293 ms: download 4553 ms overlapping gunzip 1111 ms, parse 4804 ms, sort 0 ms, write 0 ms, index 641 ms: 9 candidates, 77940 repo-hours, 1025 releases; waiting 201 ms; commit 0 ms)
2026-11-08T06:58:56Z [load_day 2024-07-12] 2024-07-12 hour 20: 171694 events in 0 files, snapshot none (task 6246 ms: download 3602 ms overlapping gunzip 956 ms, parse 3862 ms, sort 0 ms, write 0 ms, index 596 ms: 7 candidates, 67385 repo-hours, 937 releases; waiting 527 ms; commit 0 ms)
2026-11-08T06:58:56Z [load_day 2024-07-12] 2024-07-12 hour 21: 165950 events in 0 files, snapshot none (task 6385 ms: download 3268 ms overlapping gunzip 960 ms, parse 3859 ms, sort 0 ms, write 0 ms, index 742 ms: 3 candidates, 68880 repo-hours, 979 releases; waiting 512 ms; commit 0 ms)
2026-11-08T06:59:02Z [load_day 2024-07-12] 2024-07-12 hour 22: 142854 events in 0 files, snapshot none (task 5784 ms: download 3294 ms overlapping gunzip 876 ms, parse 3614 ms, sort 0 ms, write 0 ms, index 528 ms: 7 candidates, 54879 repo-hours, 1025 releases; waiting 511 ms; commit 0 ms)
2026-11-08T06:59:02Z [load_day 2024-07-12] 2024-07-12 hour 23: 130220 events in 0 files, snapshot none (task 5567 ms: download 2670 ms overlapping gunzip 766 ms, parse 3593 ms, sort 0 ms, write 0 ms, index 436 ms: 7 candidates, 48171 repo-hours, 744 releases; waiting 522 ms; commit 0 ms)
2026-11-08T06:59:11Z [load_day 2024-07-12] 2024-07-12: repo_hour merged from 24 files to 1 (2025086 rows, 8513 ms)
2026-11-08T06:59:13Z [load_day 2024-07-12] 2024-07-12: index committed in 11113 ms (24 + 1 + 24 files)
2026-11-08T06:59:13Z [load_day 2024-07-12] 2024-07-12: 4601798 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:59:13Z [load_day 2024-07-12] attempt 1 succeeded