orcaLog in

Runs · run 1378

load_day 2023-08-10, attempt 1 succeeded

Host
3c2b29713ce8:212240
Started
2026-11-07T23:45:28Z
Ended
2026-11-07T23:49:23Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1378/load_day/2023-08-10/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:45:28Z [load_day 2023-08-10] attempt 1 started
2026-11-07T23:45:29Z [load_day 2023-08-10] 2023-08-10: 2 hours in flight, about 1200 MB
2026-11-07T23:45:49Z [load_day 2023-08-10] 2023-08-10 hour 0: 153562 events in 4 files, snapshot 5866555893002024756 (task 15422 ms: download 7188 ms overlapping gunzip 970 ms, parse 4342 ms, sort 205 ms, write 8567 ms, index 546 ms: 4 candidates, 77494 repo-hours, 963 releases; waiting 491 ms; commit 2875 ms)
2026-11-07T23:45:52Z [load_day 2023-08-10] 2023-08-10 hour 1: 159518 events in 4 files, snapshot 1953766593723033438 (task 15462 ms: download 6513 ms overlapping gunzip 881 ms, parse 3925 ms, sort 113 ms, write 9064 ms, index 697 ms: 3 candidates, 88390 repo-hours, 803 releases; waiting 500 ms; commit 2415 ms)
2026-11-07T23:46:04Z [load_day 2023-08-10] 2023-08-10 hour 2: 139563 events in 3 files, snapshot 3354587274652410951 (task 13594 ms: download 5718 ms overlapping gunzip 898 ms, parse 3589 ms, sort 137 ms, write 7611 ms, index 530 ms: 4 candidates, 61543 repo-hours, 716 releases; waiting 507 ms; commit 2776 ms)
2026-11-07T23:46:06Z [load_day 2023-08-10] 2023-08-10 hour 3: 132465 events in 3 files, snapshot 7897076500644532890 (task 12463 ms: download 5634 ms overlapping gunzip 709 ms, parse 3109 ms, sort 154 ms, write 7205 ms, index 434 ms: 3 candidates, 55442 repo-hours, 844 releases; waiting 545 ms; commit 2524 ms)
2026-11-07T23:46:23Z [load_day 2023-08-10] 2023-08-10 hour 4: 129992 events in 3 files, snapshot 2666978051211250428 (task 12005 ms: download 5271 ms overlapping gunzip 660 ms, parse 2767 ms, sort 97 ms, write 7276 ms, index 379 ms: 3 candidates, 53073 repo-hours, 646 releases; waiting 494 ms; commit 9237 ms)
2026-11-07T23:46:26Z [load_day 2023-08-10] 2023-08-10 hour 5: 140154 events in 3 files, snapshot 6716474299803004391 (task 14123 ms: download 5705 ms overlapping gunzip 896 ms, parse 3686 ms, sort 104 ms, write 8013 ms, index 565 ms: 13 candidates, 59507 repo-hours, 823 releases; waiting 536 ms; commit 2379 ms)
2026-11-07T23:46:35Z [load_day 2023-08-10] 2023-08-10 hour 6: 181963 events in 4 files, snapshot 769569480461778997 (task 17513 ms: download 9229 ms overlapping gunzip 1041 ms, parse 4685 ms, sort 129 ms, write 9953 ms, index 948 ms: 6 candidates, 88573 repo-hours, 947 releases; waiting 477 ms; commit 2572 ms)
2026-11-07T23:46:45Z [load_day 2023-08-10] 2023-08-10 hour 7: 175000 events in 4 files, snapshot 432042165175137348 (task 18296 ms: download 10443 ms overlapping gunzip 1026 ms, parse 4584 ms, sort 149 ms, write 11126 ms, index 667 ms: 4 candidates, 74505 repo-hours, 959 releases; waiting 491 ms; commit 2758 ms)
2026-11-07T23:46:57Z [load_day 2023-08-10] 2023-08-10 hour 8: 186448 events in 4 files, snapshot 8031008758585630163 (task 20263 ms: download 11459 ms overlapping gunzip 1138 ms, parse 5294 ms, sort 151 ms, write 12217 ms, index 606 ms: 8 candidates, 81369 repo-hours, 1071 releases; waiting 537 ms; commit 2693 ms)
2026-11-07T23:47:07Z [load_day 2023-08-10] 2023-08-10 hour 9: 184366 events in 4 files, snapshot 3991035359395793042 (task 20034 ms: download 10657 ms overlapping gunzip 1163 ms, parse 4926 ms, sort 124 ms, write 12458 ms, index 578 ms: 5 candidates, 80060 repo-hours, 1153 releases; waiting 481 ms; commit 2889 ms)
2026-11-07T23:47:16Z [load_day 2023-08-10] 2023-08-10 hour 10: 178471 events in 4 files, snapshot 1154497025127298928 (task 18613 ms: download 10625 ms overlapping gunzip 1110 ms, parse 4856 ms, sort 138 ms, write 10847 ms, index 840 ms: 3 candidates, 75919 repo-hours, 1086 releases; waiting 513 ms; commit 2328 ms)
2026-11-07T23:47:26Z [load_day 2023-08-10] 2023-08-10 hour 11: 180935 events in 4 files, snapshot 1523955898373953902 (task 18888 ms: download 10301 ms overlapping gunzip 997 ms, parse 4277 ms, sort 187 ms, write 11925 ms, index 669 ms: 2 candidates, 74812 repo-hours, 990 releases; waiting 488 ms; commit 2165 ms)
2026-11-07T23:47:39Z [load_day 2023-08-10] 2023-08-10 hour 12: 222453 events in 5 files, snapshot 4974466700045683421 (task 20619 ms: download 10445 ms overlapping gunzip 1107 ms, parse 5021 ms, sort 130 ms, write 12895 ms, index 687 ms: 6 candidates, 107332 repo-hours, 1035 releases; waiting 504 ms; commit 3138 ms)
2026-11-07T23:47:48Z [load_day 2023-08-10] 2023-08-10 hour 13: 203317 events in 5 files, snapshot 1185120202981936728 (task 21210 ms: download 10479 ms overlapping gunzip 1142 ms, parse 5271 ms, sort 190 ms, write 12948 ms, index 769 ms: 7 candidates, 100395 repo-hours, 1020 releases; waiting 532 ms; commit 2228 ms)
2026-11-07T23:48:01Z [load_day 2023-08-10] 2023-08-10 hour 14: 197611 events in 4 files, snapshot 240046355149623908 (task 22024 ms: download 12032 ms overlapping gunzip 1283 ms, parse 5971 ms, sort 138 ms, write 13188 ms, index 613 ms: 3 candidates, 87351 repo-hours, 1088 releases; waiting 511 ms; commit 2410 ms)
2026-11-07T23:48:08Z [load_day 2023-08-10] 2023-08-10 hour 15: 172416 events in 4 files, snapshot 460757159277322369 (task 19182 ms: download 11668 ms overlapping gunzip 1028 ms, parse 4439 ms, sort 108 ms, write 12253 ms, index 575 ms: 6 candidates, 79459 repo-hours, 925 releases; waiting 513 ms; commit 2108 ms)
2026-11-07T23:48:18Z [load_day 2023-08-10] 2023-08-10 hour 16: 171015 events in 4 files, snapshot 6265397073866154030 (task 16129 ms: download 9858 ms overlapping gunzip 996 ms, parse 4228 ms, sort 117 ms, write 9405 ms, index 545 ms: 1 candidates, 77594 repo-hours, 1012 releases; waiting 494 ms; commit 2187 ms)
2026-11-07T23:48:23Z [load_day 2023-08-10] 2023-08-10 hour 17: 175321 events in 4 files, snapshot 5248207430682069566 (task 14297 ms: download 8318 ms overlapping gunzip 867 ms, parse 3781 ms, sort 110 ms, write 8208 ms, index 524 ms: 4 candidates, 74482 repo-hours, 978 releases; waiting 500 ms; commit 2067 ms)
2026-11-07T23:48:36Z [load_day 2023-08-10] 2023-08-10 hour 18: 169250 events in 4 files, snapshot 5740866051707516476 (task 15523 ms: download 8642 ms overlapping gunzip 892 ms, parse 3849 ms, sort 97 ms, write 9350 ms, index 514 ms: 3 candidates, 76307 repo-hours, 1044 releases; waiting 506 ms; commit 2838 ms)
2026-11-07T23:48:42Z [load_day 2023-08-10] 2023-08-10 hour 19: 162705 events in 4 files, snapshot 7732635672628324406 (task 17114 ms: download 7666 ms overlapping gunzip 975 ms, parse 4303 ms, sort 152 ms, write 10086 ms, index 556 ms: 4 candidates, 68498 repo-hours, 881 releases; waiting 715 ms; commit 2863 ms)
2026-11-07T23:48:52Z [load_day 2023-08-10] 2023-08-10 hour 20: 163350 events in 4 files, snapshot 7606071793167327924 (task 16401 ms: download 9595 ms overlapping gunzip 1024 ms, parse 4389 ms, sort 98 ms, write 9580 ms, index 521 ms: 7 candidates, 68045 repo-hours, 993 releases; waiting 507 ms; commit 2200 ms)
2026-11-07T23:49:00Z [load_day 2023-08-10] 2023-08-10 hour 21: 149354 events in 3 files, snapshot 8185591730130986827 (task 16321 ms: download 7158 ms overlapping gunzip 960 ms, parse 4192 ms, sort 183 ms, write 9613 ms, index 576 ms: 10 candidates, 59068 repo-hours, 1008 releases; waiting 480 ms; commit 3235 ms)
2026-11-07T23:49:10Z [load_day 2023-08-10] 2023-08-10 hour 22: 137349 events in 3 files, snapshot 2178628037354821420 (task 13309 ms: download 5553 ms overlapping gunzip 816 ms, parse 3531 ms, sort 115 ms, write 7706 ms, index 377 ms: 4 candidates, 53868 repo-hours, 921 releases; waiting 503 ms; commit 5438 ms)
2026-11-07T23:49:13Z [load_day 2023-08-10] 2023-08-10 hour 23: 128301 events in 3 files, snapshot 735829208803419935 (task 12400 ms: download 5256 ms overlapping gunzip 603 ms, parse 2612 ms, sort 87 ms, write 7829 ms, index 464 ms: 3 candidates, 52006 repo-hours, 742 releases; waiting 493 ms; commit 2715 ms)
2026-11-07T23:49:21Z [load_day 2023-08-10] 2023-08-10: repo_hour merged from 24 files to 1 (1775092 rows, 7893 ms)
2026-11-07T23:49:23Z [load_day 2023-08-10] 2023-08-10: index committed in 9574 ms (24 + 1 + 24 files)
2026-11-07T23:49:23Z [load_day 2023-08-10] 2023-08-10: 3994879 events in 24 hours
2026-11-07T23:49:23Z [load_day 2023-08-10] attempt 1 succeeded