orcaLog in

Runs · run 438

load_day 2026-06-25, attempt 1 succeeded

Host
4e84322b8c45:90565
Started
2026-11-07T05:34:38Z
Ended
2026-11-07T05:35:51Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/438/load_day/2026-06-25/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:34:38Z [load_day 2026-06-25] attempt 1 started
2026-11-07T05:34:46Z [load_day 2026-06-25] 2026-06-25 hour 0: 162690 events in 4 files, snapshot 4653663197053419448 (task 4217 ms: download 1677 ms overlapping gunzip 233 ms, parse 825 ms, sort 119 ms, write 1691 ms, index 426 ms: 2 candidates, 67377 repo-hours, 0 releases; waiting 532 ms; commit 938 ms)
2026-11-07T05:34:47Z [load_day 2026-06-25] 2026-06-25 hour 1: 161737 events in 4 files, snapshot 6400369960447543138 (task 4063 ms: download 1299 ms overlapping gunzip 225 ms, parse 828 ms, sort 121 ms, write 1812 ms, index 456 ms: 7 candidates, 70357 repo-hours, 0 releases; waiting 318 ms; commit 855 ms)
2026-11-07T05:34:51Z [load_day 2026-06-25] 2026-06-25 hour 2: 160480 events in 4 files, snapshot 8216076667343849936 (task 3922 ms: download 1438 ms overlapping gunzip 219 ms, parse 799 ms, sort 104 ms, write 1480 ms, index 516 ms: 7 candidates, 82940 repo-hours, 0 releases; waiting 513 ms; commit 940 ms)
2026-11-07T05:34:55Z [load_day 2026-06-25] 2026-06-25 hour 3: 163879 events in 4 files, snapshot 976431289709978871 (task 4027 ms: download 1338 ms overlapping gunzip 229 ms, parse 858 ms, sort 112 ms, write 1551 ms, index 489 ms: 3 candidates, 79502 repo-hours, 0 releases; waiting 476 ms; commit 3855 ms)
2026-11-07T05:34:56Z [load_day 2026-06-25] 2026-06-25 hour 4: 156918 events in 4 files, snapshot 3239479812573180592 (task 3892 ms: download 1723 ms overlapping gunzip 214 ms, parse 792 ms, sort 110 ms, write 1443 ms, index 495 ms: 4 candidates, 74773 repo-hours, 0 releases; waiting 534 ms; commit 941 ms)
2026-11-07T05:35:00Z [load_day 2026-06-25] 2026-06-25 hour 5: 159161 events in 4 files, snapshot 4477966319276340208 (task 4198 ms: download 772 ms overlapping gunzip 220 ms, parse 797 ms, sort 123 ms, write 1939 ms, index 504 ms: 6 candidates, 73763 repo-hours, 0 releases; waiting 13 ms; commit 1033 ms)
2026-11-07T05:35:01Z [load_day 2026-06-25] 2026-06-25 hour 6: 158651 events in 4 files, snapshot 3771922483677656843 (task 4089 ms: download 1087 ms overlapping gunzip 200 ms, parse 742 ms, sort 96 ms, write 1861 ms, index 503 ms: 7 candidates, 77661 repo-hours, 0 releases; waiting 389 ms; commit 1040 ms)
2026-11-07T05:35:05Z [load_day 2026-06-25] 2026-06-25 hour 7: 160142 events in 4 files, snapshot 8841728314640018146 (task 4027 ms: download 1318 ms overlapping gunzip 197 ms, parse 740 ms, sort 110 ms, write 1617 ms, index 517 ms: 2 candidates, 72550 repo-hours, 0 releases; waiting 532 ms; commit 1010 ms)
2026-11-07T05:35:06Z [load_day 2026-06-25] 2026-06-25 hour 8: 163853 events in 4 files, snapshot 6841270020269182634 (task 4194 ms: download 1605 ms overlapping gunzip 203 ms, parse 784 ms, sort 112 ms, write 1779 ms, index 512 ms: 3 candidates, 78396 repo-hours, 0 releases; waiting 518 ms; commit 1102 ms)
2026-11-07T05:35:09Z [load_day 2026-06-25] 2026-06-25 hour 9: 159822 events in 4 files, snapshot 3141963714802739795 (task 3962 ms: download 1336 ms overlapping gunzip 202 ms, parse 744 ms, sort 103 ms, write 1564 ms, index 547 ms: 6 candidates, 80775 repo-hours, 0 releases; waiting 522 ms; commit 991 ms)
2026-11-07T05:35:10Z [load_day 2026-06-25] 2026-06-25 hour 10: 160051 events in 4 files, snapshot 5136321245990587833 (task 4059 ms: download 1452 ms overlapping gunzip 206 ms, parse 749 ms, sort 104 ms, write 1642 ms, index 532 ms: 3 candidates, 81834 repo-hours, 0 releases; waiting 522 ms; commit 940 ms)
2026-11-07T05:35:15Z [load_day 2026-06-25] 2026-06-25 hour 11: 161892 events in 4 files, snapshot 8883193920087560008 (task 4079 ms: download 1511 ms overlapping gunzip 207 ms, parse 768 ms, sort 110 ms, write 1545 ms, index 576 ms: 5 candidates, 81614 repo-hours, 0 releases; waiting 524 ms; commit 1500 ms)
2026-11-07T05:35:16Z [load_day 2026-06-25] 2026-06-25 hour 12: 160649 events in 4 files, snapshot 8992515023651969362 (task 4007 ms: download 1371 ms overlapping gunzip 199 ms, parse 775 ms, sort 107 ms, write 1511 ms, index 574 ms: 10 candidates, 82367 repo-hours, 0 releases; waiting 536 ms; commit 988 ms)
2026-11-07T05:35:19Z [load_day 2026-06-25] 2026-06-25 hour 13: 159290 events in 4 files, snapshot 7976569741809760011 (task 3942 ms: download 1628 ms overlapping gunzip 195 ms, parse 756 ms, sort 104 ms, write 1363 ms, index 546 ms: 14 candidates, 84672 repo-hours, 0 releases; waiting 547 ms; commit 1124 ms)
2026-11-07T05:35:20Z [load_day 2026-06-25] 2026-06-25 hour 14: 160574 events in 4 files, snapshot 4620207191642325499 (task 3907 ms: download 1184 ms overlapping gunzip 201 ms, parse 752 ms, sort 101 ms, write 1453 ms, index 645 ms: 17 candidates, 90670 repo-hours, 4 releases; waiting 528 ms; commit 1015 ms)
2026-11-07T05:35:23Z [load_day 2026-06-25] 2026-06-25 hour 15: 158119 events in 4 files, snapshot 7493767009358387862 (task 3235 ms: download 353 ms overlapping gunzip 189 ms, parse 716 ms, sort 100 ms, write 1410 ms, index 612 ms: 4 candidates, 80597 repo-hours, 7 releases; waiting 15 ms; commit 999 ms)
2026-11-07T05:35:25Z [load_day 2026-06-25] 2026-06-25 hour 16: 162183 events in 4 files, snapshot 1125628421330748897 (task 3687 ms: download 1264 ms overlapping gunzip 202 ms, parse 779 ms, sort 108 ms, write 1440 ms, index 590 ms: 7 candidates, 81650 repo-hours, 18 releases; waiting 247 ms; commit 985 ms)
2026-11-07T05:35:28Z [load_day 2026-06-25] 2026-06-25 hour 17: 148598 events in 3 files, snapshot 2673995723771488568 (task 4336 ms: download 1465 ms overlapping gunzip 221 ms, parse 821 ms, sort 141 ms, write 1778 ms, index 550 ms: 8 candidates, 78190 repo-hours, 139 releases; waiting 516 ms; commit 990 ms)
2026-11-07T05:35:29Z [load_day 2026-06-25] 2026-06-25 hour 18: 159211 events in 4 files, snapshot 8395255900630628429 (task 3942 ms: download 1583 ms overlapping gunzip 204 ms, parse 761 ms, sort 105 ms, write 1507 ms, index 501 ms: 5 candidates, 75038 repo-hours, 14 releases; waiting 528 ms; commit 959 ms)
2026-11-07T05:35:32Z [load_day 2026-06-25] 2026-06-25 hour 19: 162895 events in 4 files, snapshot 5347359768376149636 (task 3950 ms: download 1204 ms overlapping gunzip 198 ms, parse 739 ms, sort 100 ms, write 1579 ms, index 490 ms: 4 candidates, 73399 repo-hours, 17 releases; waiting 536 ms; commit 1034 ms)
2026-11-07T05:35:34Z [load_day 2026-06-25] 2026-06-25 hour 20: 158579 events in 4 files, snapshot 8114533954299718702 (task 3876 ms: download 1369 ms overlapping gunzip 198 ms, parse 738 ms, sort 124 ms, write 1498 ms, index 503 ms: 9 candidates, 70573 repo-hours, 27 releases; waiting 536 ms; commit 1133 ms)
2026-11-07T05:35:37Z [load_day 2026-06-25] 2026-06-25 hour 21: 163190 events in 4 files, snapshot 5303189842686520924 (task 3932 ms: download 1285 ms overlapping gunzip 214 ms, parse 804 ms, sort 119 ms, write 1515 ms, index 475 ms: 5 candidates, 70996 repo-hours, 45 releases; waiting 530 ms; commit 921 ms)
2026-11-07T05:35:38Z [load_day 2026-06-25] 2026-06-25 hour 22: 154967 events in 4 files, snapshot 6136416225271979317 (task 3756 ms: download 1363 ms overlapping gunzip 222 ms, parse 816 ms, sort 110 ms, write 1418 ms, index 457 ms: 4 candidates, 66255 repo-hours, 85 releases; waiting 527 ms; commit 864 ms)
2026-11-07T05:35:42Z [load_day 2026-06-25] 2026-06-25 hour 23: 153827 events in 4 files, snapshot 3717021980241370063 (task 3900 ms: download 1628 ms overlapping gunzip 232 ms, parse 838 ms, sort 99 ms, write 1401 ms, index 468 ms: 3 candidates, 67604 repo-hours, 153 releases; waiting 500 ms; commit 1207 ms)
2026-11-07T05:35:49Z [load_day 2026-06-25] 2026-06-25: repo_hour merged from 24 files to 1 (1843553 rows, 7539 ms)
2026-11-07T05:35:51Z [load_day 2026-06-25] 2026-06-25: index committed in 9470 ms (24 + 1 + 10 files)
2026-11-07T05:35:51Z [load_day 2026-06-25] 2026-06-25: 3831358 events in 24 hours
2026-11-07T05:35:51Z [load_day 2026-06-25] attempt 1 succeeded