orcaLog in

Runs · run 2619

load_day 2024-06-21, attempt 1 succeeded

Host
73ccef5e07c2:139269
Started
2026-11-08T06:38:14Z
Ended
2026-11-08T06:40:09Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
696 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
174.6 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2619/load_day/2024-06-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:38:14Z [load_day 2024-06-21] attempt 1 started
2026-11-08T06:38:16Z [load_day 2024-06-21] 2024-06-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:38:24Z [load_day 2024-06-21] 2024-06-21 hour 0: 187348 events in 0 files, snapshot none (task 7682 ms: download 3804 ms overlapping gunzip 1198 ms, parse 4899 ms, sort 0 ms, write 0 ms, index 772 ms: 12 candidates, 94965 repo-hours, 1605 releases; waiting 489 ms; commit 0 ms)
2026-11-08T06:38:24Z [load_day 2024-06-21] 2024-06-21 hour 1: 193423 events in 0 files, snapshot none (task 7218 ms: download 3807 ms overlapping gunzip 1013 ms, parse 4517 ms, sort 0 ms, write 0 ms, index 914 ms: 11 candidates, 104449 repo-hours, 1330 releases; waiting 470 ms; commit 0 ms)
2026-11-08T06:38:31Z [load_day 2024-06-21] 2024-06-21 hour 2: 162316 events in 0 files, snapshot none (task 6916 ms: download 4252 ms overlapping gunzip 1080 ms, parse 4386 ms, sort 0 ms, write 0 ms, index 583 ms: 2 candidates, 66030 repo-hours, 1492 releases; waiting 461 ms; commit 0 ms)
2026-11-08T06:38:32Z [load_day 2024-06-21] 2024-06-21 hour 3: 178935 events in 0 files, snapshot none (task 7278 ms: download 4296 ms overlapping gunzip 1031 ms, parse 4740 ms, sort 0 ms, write 0 ms, index 727 ms: 2 candidates, 75416 repo-hours, 6166 releases; waiting 500 ms; commit 0 ms)
2026-11-08T06:38:39Z [load_day 2024-06-21] 2024-06-21 hour 4: 156547 events in 0 files, snapshot none (task 7068 ms: download 4194 ms overlapping gunzip 1166 ms, parse 4601 ms, sort 0 ms, write 0 ms, index 557 ms: 5 candidates, 59712 repo-hours, 1413 releases; waiting 482 ms; commit 0 ms)
2026-11-08T06:38:39Z [load_day 2024-06-21] 2024-06-21 hour 5: 173789 events in 0 files, snapshot none (task 7325 ms: download 4374 ms overlapping gunzip 1142 ms, parse 4856 ms, sort 0 ms, write 0 ms, index 557 ms: 6 candidates, 67784 repo-hours, 1527 releases; waiting 437 ms; commit 0 ms)
2026-11-08T06:38:48Z [load_day 2024-06-21] 2024-06-21 hour 6: 208478 events in 0 files, snapshot none (task 8349 ms: download 4212 ms overlapping gunzip 1277 ms, parse 5197 ms, sort 0 ms, write 0 ms, index 1056 ms: 5 candidates, 93439 repo-hours, 1403 releases; waiting 532 ms; commit 0 ms)
2026-11-08T06:38:48Z [load_day 2024-06-21] 2024-06-21 hour 7: 209082 events in 0 files, snapshot none (task 8585 ms: download 5292 ms overlapping gunzip 1366 ms, parse 5634 ms, sort 0 ms, write 0 ms, index 815 ms: 6 candidates, 84427 repo-hours, 1137 releases; waiting 521 ms; commit 0 ms)
2026-11-08T06:38:58Z [load_day 2024-06-21] 2024-06-21 hour 8: 221279 events in 0 files, snapshot none (task 9366 ms: download 6175 ms overlapping gunzip 1466 ms, parse 6276 ms, sort 0 ms, write 0 ms, index 770 ms: 5 candidates, 91430 repo-hours, 1655 releases; waiting 497 ms; commit 0 ms)
2026-11-08T06:38:58Z [load_day 2024-06-21] 2024-06-21 hour 9: 224804 events in 0 files, snapshot none (task 8512 ms: download 5507 ms overlapping gunzip 1330 ms, parse 5601 ms, sort 0 ms, write 0 ms, index 781 ms: 5 candidates, 97112 repo-hours, 1942 releases; waiting 497 ms; commit 0 ms)
2026-11-08T06:39:08Z [load_day 2024-06-21] 2024-06-21 hour 10: 207278 events in 0 files, snapshot none (task 10151 ms: download 7561 ms overlapping gunzip 1409 ms, parse 5658 ms, sort 0 ms, write 0 ms, index 639 ms: 5 candidates, 85160 repo-hours, 1660 releases; waiting 2168 ms; commit 0 ms)
2026-11-08T06:39:08Z [load_day 2024-06-21] 2024-06-21 hour 11: 203519 events in 0 files, snapshot none (task 7960 ms: download 4045 ms overlapping gunzip 1208 ms, parse 5120 ms, sort 0 ms, write 0 ms, index 833 ms: 9 candidates, 80772 repo-hours, 1640 releases; waiting 528 ms; commit 0 ms)
2026-11-08T06:39:19Z [load_day 2024-06-21] 2024-06-21 hour 12: 265906 events in 0 files, snapshot none (task 9871 ms: download 6755 ms overlapping gunzip 1466 ms, parse 6706 ms, sort 0 ms, write 0 ms, index 864 ms: 4 candidates, 125775 repo-hours, 1792 releases; waiting 521 ms; commit 0 ms)
2026-11-08T06:39:19Z [load_day 2024-06-21] 2024-06-21 hour 13: 240532 events in 0 files, snapshot none (task 9804 ms: download 7073 ms overlapping gunzip 1621 ms, parse 6613 ms, sort 0 ms, write 0 ms, index 800 ms: 9 candidates, 109125 repo-hours, 1990 releases; waiting 481 ms; commit 0 ms)
2026-11-08T06:39:27Z [load_day 2024-06-21] 2024-06-21 hour 14: 234526 events in 0 files, snapshot none (task 8032 ms: download 5537 ms overlapping gunzip 1296 ms, parse 5268 ms, sort 0 ms, write 0 ms, index 693 ms: 11 candidates, 95434 repo-hours, 1928 releases; waiting 509 ms; commit 0 ms)
2026-11-08T06:39:27Z [load_day 2024-06-21] 2024-06-21 hour 15: 234089 events in 0 files, snapshot none (task 7678 ms: download 5052 ms overlapping gunzip 1204 ms, parse 4889 ms, sort 0 ms, write 0 ms, index 766 ms: 9 candidates, 100844 repo-hours, 2014 releases; waiting 520 ms; commit 0 ms)
2026-11-08T06:39:35Z [load_day 2024-06-21] 2024-06-21 hour 16: 213747 events in 0 files, snapshot none (task 7612 ms: download 4628 ms overlapping gunzip 1241 ms, parse 4873 ms, sort 0 ms, write 0 ms, index 651 ms: 15 candidates, 87626 repo-hours, 1820 releases; waiting 508 ms; commit 0 ms)
2026-11-08T06:39:35Z [load_day 2024-06-21] 2024-06-21 hour 17: 200506 events in 0 files, snapshot none (task 7621 ms: download 3945 ms overlapping gunzip 1155 ms, parse 4915 ms, sort 0 ms, write 0 ms, index 770 ms: 8 candidates, 81103 repo-hours, 1707 releases; waiting 495 ms; commit 0 ms)
2026-11-08T06:39:44Z [load_day 2024-06-21] 2024-06-21 hour 18: 208422 events in 0 files, snapshot none (task 8714 ms: download 5495 ms overlapping gunzip 1217 ms, parse 5376 ms, sort 0 ms, write 0 ms, index 890 ms: 14 candidates, 94072 repo-hours, 1698 releases; waiting 519 ms; commit 0 ms)
2026-11-08T06:39:44Z [load_day 2024-06-21] 2024-06-21 hour 19: 183461 events in 0 files, snapshot none (task 7393 ms: download 4452 ms overlapping gunzip 1193 ms, parse 4837 ms, sort 0 ms, write 0 ms, index 548 ms: 8 candidates, 72980 repo-hours, 1656 releases; waiting 543 ms; commit 0 ms)
2026-11-08T06:39:52Z [load_day 2024-06-21] 2024-06-21 hour 20: 179999 events in 0 files, snapshot none (task 6897 ms: download 3988 ms overlapping gunzip 1064 ms, parse 4479 ms, sort 0 ms, write 0 ms, index 589 ms: 10 candidates, 75204 repo-hours, 1558 releases; waiting 471 ms; commit 0 ms)
2026-11-08T06:39:52Z [load_day 2024-06-21] 2024-06-21 hour 21: 174849 events in 0 files, snapshot none (task 7494 ms: download 4237 ms overlapping gunzip 1222 ms, parse 4968 ms, sort 0 ms, write 0 ms, index 492 ms: 3 candidates, 68260 repo-hours, 1481 releases; waiting 489 ms; commit 0 ms)
2026-11-08T06:39:58Z [load_day 2024-06-21] 2024-06-21 hour 22: 147514 events in 0 files, snapshot none (task 5285 ms: download 2521 ms overlapping gunzip 782 ms, parse 3271 ms, sort 0 ms, write 0 ms, index 478 ms: 6 candidates, 53781 repo-hours, 1334 releases; waiting 498 ms; commit 0 ms)
2026-11-08T06:39:58Z [load_day 2024-06-21] 2024-06-21 hour 23: 141236 events in 0 files, snapshot none (task 4973 ms: download 2783 ms overlapping gunzip 714 ms, parse 3031 ms, sort 0 ms, write 0 ms, index 373 ms: 7 candidates, 51159 repo-hours, 1227 releases; waiting 544 ms; commit 0 ms)
2026-11-08T06:40:06Z [load_day 2024-06-21] 2024-06-21: repo_hour merged from 24 files to 1 (2016059 rows, 8730 ms)
2026-11-08T06:40:09Z [load_day 2024-06-21] 2024-06-21: index committed in 11556 ms (24 + 1 + 24 files)
2026-11-08T06:40:09Z [load_day 2024-06-21] 2024-06-21: 4751585 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:40:09Z [load_day 2024-06-21] attempt 1 succeeded