orcaLog in

Runs · run 2690

load_day 2024-07-08, attempt 1 succeeded

Host
73ccef5e07c2:146657
Started
2026-11-08T06:53:15Z
Ended
2026-11-08T06:55:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
885 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
199.3 s, up to 3.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2690/load_day/2024-07-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:53:15Z [load_day 2024-07-08] attempt 1 started
2026-11-08T06:53:16Z [load_day 2024-07-08] 2024-07-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:53:23Z [load_day 2024-07-08] 2024-07-08 hour 0: 164713 events in 0 files, snapshot none (task 6329 ms: download 3743 ms overlapping gunzip 939 ms, parse 3888 ms, sort 0 ms, write 0 ms, index 667 ms: 6 candidates, 84009 repo-hours, 1073 releases; waiting 511 ms; commit 0 ms)
2026-11-08T06:53:23Z [load_day 2024-07-08] 2024-07-08 hour 1: 185808 events in 0 files, snapshot none (task 6893 ms: download 4356 ms overlapping gunzip 1109 ms, parse 4452 ms, sort 0 ms, write 0 ms, index 728 ms: 7 candidates, 102324 repo-hours, 781 releases; waiting 268 ms; commit 0 ms)
2026-11-08T06:53:30Z [load_day 2024-07-08] 2024-07-08 hour 2: 158658 events in 0 files, snapshot none (task 6464 ms: download 3610 ms overlapping gunzip 1099 ms, parse 4083 ms, sort 0 ms, write 0 ms, index 459 ms: 2 candidates, 65187 repo-hours, 818 releases; waiting 506 ms; commit 0 ms)
2026-11-08T06:53:30Z [load_day 2024-07-08] 2024-07-08 hour 3: 183002 events in 0 files, snapshot none (task 6627 ms: download 4111 ms overlapping gunzip 1006 ms, parse 4164 ms, sort 0 ms, write 0 ms, index 620 ms: 6 candidates, 77054 repo-hours, 5365 releases; waiting 549 ms; commit 0 ms)
2026-11-08T06:53:37Z [load_day 2024-07-08] 2024-07-08 hour 4: 169003 events in 0 files, snapshot none (task 7121 ms: download 4511 ms overlapping gunzip 1167 ms, parse 4652 ms, sort 0 ms, write 0 ms, index 480 ms: 6 candidates, 70982 repo-hours, 643 releases; waiting 532 ms; commit 0 ms)
2026-11-08T06:53:38Z [load_day 2024-07-08] 2024-07-08 hour 5: 173700 events in 0 files, snapshot none (task 7452 ms: download 5217 ms overlapping gunzip 1222 ms, parse 4917 ms, sort 0 ms, write 0 ms, index 504 ms: 3 candidates, 68288 repo-hours, 895 releases; waiting 545 ms; commit 0 ms)
2026-11-08T06:53:47Z [load_day 2024-07-08] 2024-07-08 hour 6: 210774 events in 0 files, snapshot none (task 9503 ms: download 6334 ms overlapping gunzip 1465 ms, parse 6170 ms, sort 0 ms, write 0 ms, index 1089 ms: 5 candidates, 95817 repo-hours, 1029 releases; waiting 474 ms; commit 0 ms)
2026-11-08T06:53:49Z [load_day 2024-07-08] 2024-07-08 hour 7: 217048 events in 0 files, snapshot none (task 10189 ms: download 6760 ms overlapping gunzip 1740 ms, parse 6891 ms, sort 0 ms, write 0 ms, index 747 ms: 11 candidates, 89364 repo-hours, 991 releases; waiting 486 ms; commit 0 ms)
2026-11-08T06:54:00Z [load_day 2024-07-08] 2024-07-08 hour 8: 230992 events in 0 files, snapshot none (task 12261 ms: download 9775 ms overlapping gunzip 1749 ms, parse 7148 ms, sort 0 ms, write 0 ms, index 690 ms: 4 candidates, 97690 repo-hours, 1300 releases; waiting 2411 ms; commit 0 ms)
2026-11-08T06:54:00Z [load_day 2024-07-08] 2024-07-08 hour 9: 232898 events in 0 files, snapshot none (task 10286 ms: download 7554 ms overlapping gunzip 1778 ms, parse 7025 ms, sort 0 ms, write 0 ms, index 692 ms: 4 candidates, 100403 repo-hours, 1301 releases; waiting 536 ms; commit 0 ms)
2026-11-08T06:54:10Z [load_day 2024-07-08] 2024-07-08 hour 10: 221887 events in 0 files, snapshot none (task 9260 ms: download 6562 ms overlapping gunzip 1583 ms, parse 6252 ms, sort 0 ms, write 0 ms, index 698 ms: 11 candidates, 94795 repo-hours, 1175 releases; waiting 422 ms; commit 0 ms)
2026-11-08T06:54:11Z [load_day 2024-07-08] 2024-07-08 hour 11: 220991 events in 0 files, snapshot none (task 9858 ms: download 7188 ms overlapping gunzip 1594 ms, parse 6484 ms, sort 0 ms, write 0 ms, index 702 ms: 8 candidates, 92954 repo-hours, 1133 releases; waiting 806 ms; commit 0 ms)
2026-11-08T06:54:20Z [load_day 2024-07-08] 2024-07-08 hour 12: 268341 events in 0 files, snapshot none (task 9663 ms: download 6928 ms overlapping gunzip 1501 ms, parse 6484 ms, sort 0 ms, write 0 ms, index 938 ms: 15 candidates, 131104 repo-hours, 1202 releases; waiting 504 ms; commit 0 ms)
2026-11-08T06:54:20Z [load_day 2024-07-08] 2024-07-08 hour 13: 251745 events in 0 files, snapshot none (task 9415 ms: download 6847 ms overlapping gunzip 1581 ms, parse 6422 ms, sort 0 ms, write 0 ms, index 800 ms: 11 candidates, 117292 repo-hours, 1326 releases; waiting 324 ms; commit 0 ms)
2026-11-08T06:54:29Z [load_day 2024-07-08] 2024-07-08 hour 14: 241658 events in 0 files, snapshot none (task 8741 ms: download 6263 ms overlapping gunzip 1438 ms, parse 5784 ms, sort 0 ms, write 0 ms, index 758 ms: 10 candidates, 103568 repo-hours, 1325 releases; waiting 508 ms; commit 0 ms)
2026-11-08T06:54:29Z [load_day 2024-07-08] 2024-07-08 hour 15: 248472 events in 0 files, snapshot none (task 8683 ms: download 6134 ms overlapping gunzip 1404 ms, parse 5707 ms, sort 0 ms, write 0 ms, index 799 ms: 8 candidates, 108801 repo-hours, 1364 releases; waiting 495 ms; commit 0 ms)
2026-11-08T06:54:41Z [load_day 2024-07-08] 2024-07-08 hour 16: 231079 events in 0 files, snapshot none (task 10761 ms: download 7559 ms overlapping gunzip 1822 ms, parse 7396 ms, sort 0 ms, write 0 ms, index 777 ms: 13 candidates, 97327 repo-hours, 1160 releases; waiting 536 ms; commit 0 ms)
2026-11-08T06:54:41Z [load_day 2024-07-08] 2024-07-08 hour 17: 222809 events in 0 files, snapshot none (task 9831 ms: download 6447 ms overlapping gunzip 1497 ms, parse 6366 ms, sort 0 ms, write 0 ms, index 1169 ms: 9 candidates, 89248 repo-hours, 1300 releases; waiting 521 ms; commit 0 ms)
2026-11-08T06:54:51Z [load_day 2024-07-08] 2024-07-08 hour 18: 225446 events in 0 files, snapshot none (task 9481 ms: download 6818 ms overlapping gunzip 1523 ms, parse 6424 ms, sort 0 ms, write 0 ms, index 683 ms: 9 candidates, 100996 repo-hours, 1180 releases; waiting 533 ms; commit 0 ms)
2026-11-08T06:54:51Z [load_day 2024-07-08] 2024-07-08 hour 19: 207276 events in 0 files, snapshot none (task 8765 ms: download 6147 ms overlapping gunzip 1481 ms, parse 5905 ms, sort 0 ms, write 0 ms, index 565 ms: 10 candidates, 80973 repo-hours, 1091 releases; waiting 523 ms; commit 0 ms)
2026-11-08T06:55:01Z [load_day 2024-07-08] 2024-07-08 hour 20: 200245 events in 0 files, snapshot none (task 9587 ms: download 6934 ms overlapping gunzip 1536 ms, parse 6413 ms, sort 0 ms, write 0 ms, index 872 ms: 12 candidates, 79535 repo-hours, 1023 releases; waiting 538 ms; commit 0 ms)
2026-11-08T06:55:01Z [load_day 2024-07-08] 2024-07-08 hour 21: 194955 events in 0 files, snapshot none (task 9126 ms: download 6402 ms overlapping gunzip 1556 ms, parse 5907 ms, sort 0 ms, write 0 ms, index 884 ms: 15 candidates, 77027 repo-hours, 1060 releases; waiting 497 ms; commit 0 ms)
2026-11-08T06:55:09Z [load_day 2024-07-08] 2024-07-08 hour 22: 170976 events in 0 files, snapshot none (task 7794 ms: download 5315 ms overlapping gunzip 1239 ms, parse 5166 ms, sort 0 ms, write 0 ms, index 475 ms: 5 candidates, 62075 repo-hours, 1101 releases; waiting 570 ms; commit 0 ms)
2026-11-08T06:55:09Z [load_day 2024-07-08] 2024-07-08 hour 23: 158611 events in 0 files, snapshot none (task 7454 ms: download 5026 ms overlapping gunzip 1191 ms, parse 4944 ms, sort 0 ms, write 0 ms, index 524 ms: 8 candidates, 57548 repo-hours, 809 releases; waiting 513 ms; commit 0 ms)
2026-11-08T06:55:18Z [load_day 2024-07-08] 2024-07-08: repo_hour merged from 24 files to 1 (2144361 rows, 9113 ms)
2026-11-08T06:55:21Z [load_day 2024-07-08] 2024-07-08: index committed in 11547 ms (24 + 1 + 24 files)
2026-11-08T06:55:21Z [load_day 2024-07-08] 2024-07-08: 4991087 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:55:21Z [load_day 2024-07-08] attempt 1 succeeded