orcaLog in

Runs · run 410

load_day 2026-07-04, attempt 1 succeeded

Host
4e84322b8c45:82681
Started
2026-11-07T05:19:18Z
Ended
2026-11-07T05:20:29Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/410/load_day/2026-07-04/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:19:18Z [load_day 2026-07-04] attempt 1 started
2026-11-07T05:19:26Z [load_day 2026-07-04] 2026-07-04 hour 0: 160388 events in 4 files, snapshot 1835044449481617656 (task 5019 ms: download 1580 ms overlapping gunzip 308 ms, parse 1094 ms, sort 167 ms, write 2162 ms, index 453 ms: 4 candidates, 62005 repo-hours, 415 releases; waiting 513 ms; commit 964 ms)
2026-11-07T05:19:27Z [load_day 2026-07-04] 2026-07-04 hour 1: 164598 events in 4 files, snapshot 6294745007960747601 (task 4543 ms: download 1730 ms overlapping gunzip 264 ms, parse 943 ms, sort 112 ms, write 2013 ms, index 460 ms: 11 candidates, 72002 repo-hours, 199 releases; waiting 511 ms; commit 797 ms)
2026-11-07T05:19:31Z [load_day 2026-07-04] 2026-07-04 hour 2: 164507 events in 4 files, snapshot 6539176253422148860 (task 4400 ms: download 1443 ms overlapping gunzip 242 ms, parse 852 ms, sort 107 ms, write 1867 ms, index 509 ms: 5 candidates, 79875 repo-hours, 202 releases; waiting 525 ms; commit 785 ms)
2026-11-07T05:19:32Z [load_day 2026-07-04] 2026-07-04 hour 3: 160034 events in 4 files, snapshot 7491615693308334743 (task 4180 ms: download 1398 ms overlapping gunzip 227 ms, parse 813 ms, sort 109 ms, write 1717 ms, index 466 ms: 6 candidates, 70003 repo-hours, 92 releases; waiting 526 ms; commit 847 ms)
2026-11-07T05:19:36Z [load_day 2026-07-04] 2026-07-04 hour 4: 166677 events in 4 files, snapshot 5483759331795313128 (task 4254 ms: download 1735 ms overlapping gunzip 247 ms, parse 879 ms, sort 121 ms, write 1750 ms, index 407 ms: 5 candidates, 64864 repo-hours, 136 releases; waiting 527 ms; commit 919 ms)
2026-11-07T05:19:37Z [load_day 2026-07-04] 2026-07-04 hour 5: 167105 events in 4 files, snapshot 6564282896191078757 (task 4268 ms: download 1365 ms overlapping gunzip 231 ms, parse 837 ms, sort 109 ms, write 1888 ms, index 444 ms: 6 candidates, 64234 repo-hours, 145 releases; waiting 525 ms; commit 859 ms)
2026-11-07T05:19:41Z [load_day 2026-07-04] 2026-07-04 hour 6: 166651 events in 4 files, snapshot 4385669857812899558 (task 4005 ms: download 1446 ms overlapping gunzip 230 ms, parse 833 ms, sort 114 ms, write 1561 ms, index 445 ms: 8 candidates, 65945 repo-hours, 59 releases; waiting 523 ms; commit 1064 ms)
2026-11-07T05:19:42Z [load_day 2026-07-04] 2026-07-04 hour 7: 165122 events in 4 files, snapshot 3200583797455340383 (task 3652 ms: download 1008 ms overlapping gunzip 220 ms, parse 755 ms, sort 99 ms, write 1614 ms, index 466 ms: 6 candidates, 63704 repo-hours, 69 releases; waiting 201 ms; commit 966 ms)
2026-11-07T05:19:45Z [load_day 2026-07-04] 2026-07-04 hour 8: 165410 events in 4 files, snapshot 8086556539936094553 (task 3581 ms: download 835 ms overlapping gunzip 206 ms, parse 755 ms, sort 104 ms, write 1542 ms, index 492 ms: 4 candidates, 66820 repo-hours, 54 releases; waiting 203 ms; commit 1207 ms)
2026-11-07T05:19:46Z [load_day 2026-07-04] 2026-07-04 hour 9: 167935 events in 4 files, snapshot 4633343042115126499 (task 4068 ms: download 1468 ms overlapping gunzip 204 ms, parse 765 ms, sort 103 ms, write 1573 ms, index 459 ms: 6 candidates, 68137 repo-hours, 38 releases; waiting 540 ms; commit 994 ms)
2026-11-07T05:19:49Z [load_day 2026-07-04] 2026-07-04 hour 10: 171011 events in 4 files, snapshot 3585349288594743567 (task 3840 ms: download 1204 ms overlapping gunzip 218 ms, parse 819 ms, sort 122 ms, write 1505 ms, index 473 ms: 15 candidates, 72615 repo-hours, 44 releases; waiting 403 ms; commit 939 ms)
2026-11-07T05:19:51Z [load_day 2026-07-04] 2026-07-04 hour 11: 165127 events in 4 files, snapshot 61576686631095140 (task 3837 ms: download 1404 ms overlapping gunzip 205 ms, parse 757 ms, sort 102 ms, write 1513 ms, index 495 ms: 84 candidates, 76930 repo-hours, 41 releases; waiting 487 ms; commit 912 ms)
2026-11-07T05:19:54Z [load_day 2026-07-04] 2026-07-04 hour 12: 168057 events in 4 files, snapshot 4963400484095386694 (task 4068 ms: download 1357 ms overlapping gunzip 217 ms, parse 830 ms, sort 111 ms, write 1570 ms, index 523 ms: 4 candidates, 76208 repo-hours, 24 releases; waiting 516 ms; commit 896 ms)
2026-11-07T05:19:55Z [load_day 2026-07-04] 2026-07-04 hour 13: 170338 events in 4 files, snapshot 168308547546637871 (task 4010 ms: download 1466 ms overlapping gunzip 218 ms, parse 813 ms, sort 111 ms, write 1543 ms, index 535 ms: 6 candidates, 86228 repo-hours, 24 releases; waiting 513 ms; commit 760 ms)
2026-11-07T05:19:59Z [load_day 2026-07-04] 2026-07-04 hour 14: 165656 events in 4 files, snapshot 7783452416621104360 (task 3923 ms: download 1378 ms overlapping gunzip 199 ms, parse 753 ms, sort 100 ms, write 1546 ms, index 473 ms: 13 candidates, 71898 repo-hours, 43 releases; waiting 513 ms; commit 1420 ms)
2026-11-07T05:20:00Z [load_day 2026-07-04] 2026-07-04 hour 15: 165380 events in 4 files, snapshot 3274172883439142537 (task 3877 ms: download 1429 ms overlapping gunzip 202 ms, parse 749 ms, sort 102 ms, write 1541 ms, index 429 ms: 5 candidates, 64327 repo-hours, 18 releases; waiting 540 ms; commit 780 ms)
2026-11-07T05:20:04Z [load_day 2026-07-04] 2026-07-04 hour 16: 170572 events in 4 files, snapshot 2740234891954447628 (task 4081 ms: download 1405 ms overlapping gunzip 203 ms, parse 770 ms, sort 112 ms, write 1699 ms, index 430 ms: 7 candidates, 62421 repo-hours, 8 releases; waiting 517 ms; commit 1131 ms)
2026-11-07T05:20:05Z [load_day 2026-07-04] 2026-07-04 hour 17: 163858 events in 4 files, snapshot 6219315564174314028 (task 4194 ms: download 1511 ms overlapping gunzip 203 ms, parse 761 ms, sort 108 ms, write 1732 ms, index 471 ms: 8 candidates, 68123 repo-hours, 22 releases; waiting 527 ms; commit 1081 ms)
2026-11-07T05:20:09Z [load_day 2026-07-04] 2026-07-04 hour 18: 169549 events in 4 files, snapshot 1686520142369118880 (task 4005 ms: download 1274 ms overlapping gunzip 213 ms, parse 827 ms, sort 120 ms, write 1517 ms, index 474 ms: 8 candidates, 69896 repo-hours, 28 releases; waiting 536 ms; commit 876 ms)
2026-11-07T05:20:10Z [load_day 2026-07-04] 2026-07-04 hour 19: 164450 events in 4 files, snapshot 3100529484354110232 (task 4125 ms: download 1594 ms overlapping gunzip 217 ms, parse 821 ms, sort 109 ms, write 1629 ms, index 468 ms: 9 candidates, 68256 repo-hours, 51 releases; waiting 528 ms; commit 939 ms)
2026-11-07T05:20:14Z [load_day 2026-07-04] 2026-07-04 hour 20: 175139 events in 4 files, snapshot 7205123098712336127 (task 4322 ms: download 1477 ms overlapping gunzip 227 ms, parse 846 ms, sort 112 ms, write 1776 ms, index 488 ms: 10 candidates, 70993 repo-hours, 92 releases; waiting 545 ms; commit 1034 ms)
2026-11-07T05:20:15Z [load_day 2026-07-04] 2026-07-04 hour 21: 162838 events in 4 files, snapshot 1311289947386202849 (task 4122 ms: download 1888 ms overlapping gunzip 231 ms, parse 876 ms, sort 112 ms, write 1577 ms, index 480 ms: 6 candidates, 66418 repo-hours, 135 releases; waiting 528 ms; commit 941 ms)
2026-11-07T05:20:19Z [load_day 2026-07-04] 2026-07-04 hour 22: 164941 events in 4 files, snapshot 3856827383685669448 (task 4566 ms: download 1856 ms overlapping gunzip 287 ms, parse 995 ms, sort 122 ms, write 1897 ms, index 437 ms: 5 candidates, 66799 repo-hours, 401 releases; waiting 513 ms; commit 1082 ms)
2026-11-07T05:20:20Z [load_day 2026-07-04] 2026-07-04 hour 23: 159239 events in 4 files, snapshot 3883732190616967462 (task 4781 ms: download 1597 ms overlapping gunzip 329 ms, parse 1160 ms, sort 118 ms, write 1967 ms, index 399 ms: 5 candidates, 64309 repo-hours, 593 releases; waiting 532 ms; commit 892 ms)
2026-11-07T05:20:27Z [load_day 2026-07-04] 2026-07-04: repo_hour merged from 24 files to 1 (1663010 rows, 6685 ms)
2026-11-07T05:20:29Z [load_day 2026-07-04] 2026-07-04: index committed in 8957 ms (24 + 1 + 24 files)
2026-11-07T05:20:29Z [load_day 2026-07-04] 2026-07-04: 3984582 events in 24 hours
2026-11-07T05:20:29Z [load_day 2026-07-04] attempt 1 succeeded