orcaLog in

Runs · run 500

load_day 2026-06-04, attempt 1 succeeded

Host
4e84322b8c45:108601
Started
2026-11-07T06:03:12Z
Ended
2026-11-07T06:04:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/500/load_day/2026-06-04/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:03:12Z [load_day 2026-06-04] attempt 1 started
2026-11-07T06:03:16Z [load_day 2026-06-04] 2026-06-04 hour 0: 963 events in 1 files, snapshot 4754392723201809274 (task 953 ms: download 509 ms overlapping gunzip 12 ms, parse 44 ms, sort 1 ms, write 121 ms, index 22 ms: 0 candidates, 456 repo-hours, 0 releases; waiting 463 ms; commit 1040 ms)
2026-11-07T06:03:18Z [load_day 2026-06-04] 2026-06-04 hour 1: 77277 events in 2 files, snapshot 6146489532220920191 (task 2628 ms: download 991 ms overlapping gunzip 130 ms, parse 462 ms, sort 53 ms, write 798 ms, index 314 ms: 8 candidates, 43123 repo-hours, 52 releases; waiting 517 ms; commit 1093 ms)
2026-11-07T06:03:21Z [load_day 2026-06-04] 2026-06-04 hour 2: 154554 events in 4 files, snapshot 3676162075594603432 (task 4086 ms: download 1240 ms overlapping gunzip 243 ms, parse 851 ms, sort 108 ms, write 1690 ms, index 536 ms: 4 candidates, 83344 repo-hours, 127 releases; waiting 362 ms; commit 1154 ms)
2026-11-07T06:03:23Z [load_day 2026-06-04] 2026-06-04 hour 3: 157040 events in 4 files, snapshot 8791173773236358311 (task 4173 ms: download 1469 ms overlapping gunzip 237 ms, parse 847 ms, sort 121 ms, write 1662 ms, index 523 ms: 6 candidates, 83178 repo-hours, 213 releases; waiting 539 ms; commit 1130 ms)
2026-11-07T06:03:26Z [load_day 2026-06-04] 2026-06-04 hour 4: 155677 events in 4 files, snapshot 3580012436809019679 (task 3731 ms: download 1119 ms overlapping gunzip 202 ms, parse 754 ms, sort 100 ms, write 1437 ms, index 531 ms: 6 candidates, 80854 repo-hours, 84 releases; waiting 442 ms; commit 1362 ms)
2026-11-07T06:03:28Z [load_day 2026-06-04] 2026-06-04 hour 5: 155602 events in 4 files, snapshot 2763527209838164694 (task 4309 ms: download 1554 ms overlapping gunzip 249 ms, parse 881 ms, sort 134 ms, write 1676 ms, index 535 ms: 6 candidates, 74275 repo-hours, 169 releases; waiting 578 ms; commit 947 ms)
2026-11-07T06:03:30Z [load_day 2026-06-04] 2026-06-04 hour 6: 156616 events in 4 files, snapshot 6903191312658883485 (task 3742 ms: download 1439 ms overlapping gunzip 209 ms, parse 753 ms, sort 105 ms, write 1402 ms, index 490 ms: 11 candidates, 74635 repo-hours, 102 releases; waiting 554 ms; commit 1252 ms)
2026-11-07T06:03:32Z [load_day 2026-06-04] 2026-06-04 hour 7: 155864 events in 4 files, snapshot 4507369193288067671 (task 3820 ms: download 1339 ms overlapping gunzip 205 ms, parse 742 ms, sort 96 ms, write 1392 ms, index 567 ms: 6 candidates, 73863 repo-hours, 59 releases; waiting 545 ms; commit 974 ms)
2026-11-07T06:03:33Z [load_day 2026-06-04] 2026-06-04 hour 8: 112464 events in 3 files, snapshot 7053931606773536925 (task 2900 ms: download 1042 ms overlapping gunzip 150 ms, parse 536 ms, sort 71 ms, write 990 ms, index 366 ms: 4 candidates, 58417 repo-hours, 54 releases; waiting 537 ms; commit 974 ms)
2026-11-07T06:03:36Z [load_day 2026-06-04] 2026-06-04 hour 9: 104926 events in 3 files, snapshot 5815044327499137806 (task 2875 ms: download 971 ms overlapping gunzip 139 ms, parse 509 ms, sort 65 ms, write 951 ms, index 386 ms: 5 candidates, 59100 repo-hours, 29 releases; waiting 524 ms; commit 1184 ms)
2026-11-07T06:03:38Z [load_day 2026-06-04] 2026-06-04 hour 10: 157140 events in 4 files, snapshot 5644455684068347683 (task 3821 ms: download 1198 ms overlapping gunzip 200 ms, parse 727 ms, sort 102 ms, write 1423 ms, index 569 ms: 8 candidates, 80697 repo-hours, 30 releases; waiting 528 ms; commit 1104 ms)
2026-11-07T06:03:40Z [load_day 2026-06-04] 2026-06-04 hour 11: 158774 events in 4 files, snapshot 8925601452157931823 (task 3816 ms: download 1256 ms overlapping gunzip 207 ms, parse 756 ms, sort 104 ms, write 1480 ms, index 571 ms: 4 candidates, 80859 repo-hours, 68 releases; waiting 402 ms; commit 948 ms)
2026-11-07T06:03:43Z [load_day 2026-06-04] 2026-06-04 hour 12: 153788 events in 4 files, snapshot 1331657822650390818 (task 3842 ms: download 1393 ms overlapping gunzip 194 ms, parse 717 ms, sort 97 ms, write 1397 ms, index 594 ms: 11 candidates, 79126 repo-hours, 26 releases; waiting 524 ms; commit 1035 ms)
2026-11-07T06:03:44Z [load_day 2026-06-04] 2026-06-04 hour 13: 148465 events in 3 files, snapshot 2107176857663820100 (task 3671 ms: download 896 ms overlapping gunzip 202 ms, parse 732 ms, sort 102 ms, write 1371 ms, index 531 ms: 10 candidates, 77760 repo-hours, 45 releases; waiting 212 ms; commit 921 ms)
2026-11-07T06:03:47Z [load_day 2026-06-04] 2026-06-04 hour 14: 149646 events in 3 files, snapshot 6498193520120698206 (task 3917 ms: download 1168 ms overlapping gunzip 191 ms, parse 714 ms, sort 103 ms, write 1418 ms, index 664 ms: 11 candidates, 85689 repo-hours, 35 releases; waiting 521 ms; commit 1293 ms)
2026-11-07T06:03:48Z [load_day 2026-06-04] 2026-06-04 hour 15: 121392 events in 3 files, snapshot 8559993185262529046 (task 3358 ms: download 1086 ms overlapping gunzip 156 ms, parse 562 ms, sort 79 ms, write 1221 ms, index 504 ms: 6 candidates, 70736 repo-hours, 37 releases; waiting 534 ms; commit 904 ms)
2026-11-07T06:03:49Z [load_day 2026-06-04] 2026-06-04 hour 16: 587 events in 1 files, snapshot 2262447704134657963 (task 910 ms: download 461 ms overlapping gunzip 9 ms, parse 23 ms, sort 0 ms, write 103 ms, index 14 ms: 0 candidates, 448 repo-hours, 0 releases; waiting 439 ms; commit 997 ms)
2026-11-07T06:03:51Z [load_day 2026-06-04] 2026-06-04 hour 17: 37107 events in 1 files, snapshot 1144893653813923424 (task 1658 ms: download 763 ms overlapping gunzip 66 ms, parse 230 ms, sort 25 ms, write 371 ms, index 162 ms: 1 candidates, 24809 repo-hours, 41 releases; waiting 514 ms; commit 1390 ms)
2026-11-07T06:03:54Z [load_day 2026-06-04] 2026-06-04 hour 18: 120121 events in 3 files, snapshot 5636791286716528859 (task 3312 ms: download 1116 ms overlapping gunzip 166 ms, parse 603 ms, sort 86 ms, write 1243 ms, index 421 ms: 11 candidates, 64006 repo-hours, 50 releases; waiting 568 ms; commit 1026 ms)
2026-11-07T06:03:55Z [load_day 2026-06-04] 2026-06-04 hour 19: 154019 events in 4 files, snapshot 4696804068523617537 (task 3996 ms: download 1343 ms overlapping gunzip 216 ms, parse 813 ms, sort 111 ms, write 1419 ms, index 567 ms: 8 candidates, 77552 repo-hours, 89 releases; waiting 523 ms; commit 929 ms)
2026-11-07T06:03:58Z [load_day 2026-06-04] 2026-06-04 hour 20: 155243 events in 4 files, snapshot 8322262229878210854 (task 3785 ms: download 805 ms overlapping gunzip 212 ms, parse 774 ms, sort 117 ms, write 1573 ms, index 588 ms: 5 candidates, 77774 repo-hours, 74 releases; waiting 209 ms; commit 1080 ms)
2026-11-07T06:04:00Z [load_day 2026-06-04] 2026-06-04 hour 21: 157704 events in 4 files, snapshot 6795648930526903052 (task 4109 ms: download 1402 ms overlapping gunzip 238 ms, parse 840 ms, sort 117 ms, write 1594 ms, index 504 ms: 9 candidates, 73340 repo-hours, 119 releases; waiting 532 ms; commit 1012 ms)
2026-11-07T06:04:03Z [load_day 2026-06-04] 2026-06-04 hour 22: 151152 events in 4 files, snapshot 6498560513450450619 (task 4521 ms: download 1557 ms overlapping gunzip 273 ms, parse 980 ms, sort 118 ms, write 1857 ms, index 447 ms: 4 candidates, 68550 repo-hours, 268 releases; waiting 520 ms; commit 1000 ms)
2026-11-07T06:04:05Z [load_day 2026-06-04] 2026-06-04 hour 23: 115436 events in 3 files, snapshot 7226448150108070042 (task 3873 ms: download 1448 ms overlapping gunzip 218 ms, parse 763 ms, sort 95 ms, write 1627 ms, index 350 ms: 8 candidates, 54969 repo-hours, 333 releases; waiting 527 ms; commit 1092 ms)
2026-11-07T06:04:11Z [load_day 2026-06-04] 2026-06-04: repo_hour merged from 24 files to 1 (1547560 rows, 6594 ms)
2026-11-07T06:04:13Z [load_day 2026-06-04] 2026-06-04: index committed in 8645 ms (22 + 1 + 22 files)
2026-11-07T06:04:13Z [load_day 2026-06-04] 2026-06-04: 3011557 events in 24 hours
2026-11-07T06:04:13Z [load_day 2026-06-04] attempt 1 succeeded