orcaLog in

Runs · run 1496

load_day 2023-09-13, attempt 1 succeeded

Host
3c2b29713ce8:325239
Started
2026-11-08T00:47:09Z
Ended
2026-11-08T00:51:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1496/load_day/2023-09-13/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T00:47:09Z [load_day 2023-09-13] attempt 1 started
2026-11-08T00:47:11Z [load_day 2023-09-13] 2023-09-13: 2 hours in flight, about 1200 MB
2026-11-08T00:47:31Z [load_day 2023-09-13] 2023-09-13 hour 0: 175246 events in 4 files, snapshot 6005084209048589338 (task 16354 ms: download 6761 ms overlapping gunzip 990 ms, parse 4603 ms, sort 126 ms, write 9198 ms, index 603 ms: 13 candidates, 91393 repo-hours, 833 releases; waiting 490 ms; commit 2230 ms)
2026-11-08T00:47:34Z [load_day 2023-09-13] 2023-09-13 hour 1: 163905 events in 4 files, snapshot 7006655329609960579 (task 15640 ms: download 6447 ms overlapping gunzip 932 ms, parse 4266 ms, sort 148 ms, write 8774 ms, index 740 ms: 11 candidates, 90613 repo-hours, 693 releases; waiting 482 ms; commit 2949 ms)
2026-11-08T00:47:46Z [load_day 2023-09-13] 2023-09-13 hour 2: 142565 events in 3 files, snapshot 5177896893787984388 (task 13688 ms: download 5764 ms overlapping gunzip 788 ms, parse 3497 ms, sort 98 ms, write 7844 ms, index 647 ms: 7 candidates, 61353 repo-hours, 722 releases; waiting 548 ms; commit 2371 ms)
2026-11-08T00:47:50Z [load_day 2023-09-13] 2023-09-13 hour 3: 138193 events in 3 files, snapshot 5043307450704800083 (task 12778 ms: download 5754 ms overlapping gunzip 790 ms, parse 3538 ms, sort 122 ms, write 7181 ms, index 430 ms: 6 candidates, 58645 repo-hours, 813 releases; waiting 494 ms; commit 3164 ms)
2026-11-08T00:48:00Z [load_day 2023-09-13] 2023-09-13 hour 4: 134874 events in 3 files, snapshot 7599607743682212613 (task 12553 ms: download 5276 ms overlapping gunzip 695 ms, parse 3056 ms, sort 103 ms, write 7458 ms, index 441 ms: 6 candidates, 55664 repo-hours, 658 releases; waiting 200 ms; commit 2739 ms)
2026-11-08T00:48:07Z [load_day 2023-09-13] 2023-09-13 hour 5: 147350 events in 3 files, snapshot 366577614368966239 (task 14824 ms: download 6013 ms overlapping gunzip 910 ms, parse 4117 ms, sort 137 ms, write 8396 ms, index 454 ms: 5 candidates, 61984 repo-hours, 742 releases; waiting 472 ms; commit 4490 ms)
2026-11-08T00:48:19Z [load_day 2023-09-13] 2023-09-13 hour 6: 176116 events in 4 files, snapshot 3178672732896977327 (task 17843 ms: download 10385 ms overlapping gunzip 1031 ms, parse 5063 ms, sort 118 ms, write 10249 ms, index 672 ms: 12 candidates, 80256 repo-hours, 951 releases; waiting 479 ms; commit 2300 ms)
2026-11-08T00:48:25Z [load_day 2023-09-13] 2023-09-13 hour 7: 172242 events in 4 files, snapshot 8824880323397844829 (task 18980 ms: download 11199 ms overlapping gunzip 1235 ms, parse 5976 ms, sort 162 ms, write 10058 ms, index 750 ms: 11 candidates, 76857 repo-hours, 872 releases; waiting 483 ms; commit 2325 ms)
2026-11-08T00:48:44Z [load_day 2023-09-13] 2023-09-13 hour 8: 192069 events in 4 files, snapshot 2450390183397285860 (task 21418 ms: download 12085 ms overlapping gunzip 1133 ms, parse 5060 ms, sort 144 ms, write 13748 ms, index 564 ms: 10 candidates, 84627 repo-hours, 1119 releases; waiting 508 ms; commit 4287 ms)
2026-11-08T00:48:48Z [load_day 2023-09-13] 2023-09-13 hour 9: 196318 events in 4 files, snapshot 3528559803222021702 (task 21760 ms: download 12227 ms overlapping gunzip 1199 ms, parse 5407 ms, sort 188 ms, write 13393 ms, index 711 ms: 11 candidates, 88485 repo-hours, 1311 releases; waiting 549 ms; commit 2984 ms)
2026-11-08T00:49:03Z [load_day 2023-09-13] 2023-09-13 hour 10: 193423 events in 4 files, snapshot 2199579240433308123 (task 19496 ms: download 11595 ms overlapping gunzip 1214 ms, parse 5296 ms, sort 158 ms, write 11432 ms, index 545 ms: 10 candidates, 83415 repo-hours, 1075 releases; waiting 506 ms; commit 2590 ms)
2026-11-08T00:49:07Z [load_day 2023-09-13] 2023-09-13 hour 11: 195049 events in 4 files, snapshot 3013765334358699715 (task 18111 ms: download 10663 ms overlapping gunzip 1147 ms, parse 5195 ms, sort 198 ms, write 10191 ms, index 621 ms: 8 candidates, 83207 repo-hours, 1044 releases; waiting 487 ms; commit 2029 ms)
2026-11-08T00:49:24Z [load_day 2023-09-13] 2023-09-13 hour 12: 240550 events in 5 files, snapshot 9080239401663070124 (task 20118 ms: download 11343 ms overlapping gunzip 1047 ms, parse 4908 ms, sort 151 ms, write 12253 ms, index 949 ms: 9 candidates, 115524 repo-hours, 1110 releases; waiting 542 ms; commit 2517 ms)
2026-11-08T00:49:29Z [load_day 2023-09-13] 2023-09-13 hour 13: 221010 events in 5 files, snapshot 3800213502548296437 (task 21509 ms: download 13152 ms overlapping gunzip 1134 ms, parse 4986 ms, sort 145 ms, write 13526 ms, index 893 ms: 9 candidates, 109624 repo-hours, 1093 releases; waiting 524 ms; commit 2239 ms)
2026-11-08T00:49:49Z [load_day 2023-09-13] 2023-09-13 hour 14: 210786 events in 5 files, snapshot 2944643782942744348 (task 22959 ms: download 12560 ms overlapping gunzip 1353 ms, parse 6126 ms, sort 192 ms, write 13715 ms, index 784 ms: 11 candidates, 95147 repo-hours, 1507 releases; waiting 547 ms; commit 2858 ms)
2026-11-08T00:49:54Z [load_day 2023-09-13] 2023-09-13 hour 15: 199077 events in 4 files, snapshot 6611110767482147690 (task 21130 ms: download 11345 ms overlapping gunzip 1147 ms, parse 4985 ms, sort 125 ms, write 12989 ms, index 1152 ms: 9 candidates, 91155 repo-hours, 1368 releases; waiting 486 ms; commit 4647 ms)
2026-11-08T00:50:11Z [load_day 2023-09-13] 2023-09-13 hour 16: 190576 events in 4 files, snapshot 1779524281833709748 (task 21070 ms: download 11662 ms overlapping gunzip 1133 ms, parse 5137 ms, sort 281 ms, write 12876 ms, index 836 ms: 10 candidates, 84627 repo-hours, 1069 releases; waiting 510 ms; commit 2635 ms)
2026-11-08T00:50:13Z [load_day 2023-09-13] 2023-09-13 hour 17: 190683 events in 4 files, snapshot 4733182719307933852 (task 19327 ms: download 10919 ms overlapping gunzip 1109 ms, parse 4791 ms, sort 123 ms, write 11749 ms, index 799 ms: 7 candidates, 81611 repo-hours, 900 releases; waiting 487 ms; commit 2986 ms)
2026-11-08T00:50:32Z [load_day 2023-09-13] 2023-09-13 hour 18: 190697 events in 4 files, snapshot 1512763610350546886 (task 20724 ms: download 10961 ms overlapping gunzip 1197 ms, parse 5604 ms, sort 166 ms, write 11964 ms, index 1003 ms: 11 candidates, 85586 repo-hours, 1103 releases; waiting 491 ms; commit 2292 ms)
2026-11-08T00:50:35Z [load_day 2023-09-13] 2023-09-13 hour 19: 177560 events in 4 files, snapshot 7592406126556418726 (task 19736 ms: download 11484 ms overlapping gunzip 1177 ms, parse 5261 ms, sort 134 ms, write 11893 ms, index 503 ms: 12 candidates, 74408 repo-hours, 1029 releases; waiting 495 ms; commit 2568 ms)
2026-11-08T00:50:52Z [load_day 2023-09-13] 2023-09-13 hour 20: 174024 events in 4 files, snapshot 1801260883469149396 (task 17904 ms: download 10392 ms overlapping gunzip 1012 ms, parse 4541 ms, sort 157 ms, write 10498 ms, index 745 ms: 11 candidates, 72978 repo-hours, 944 releases; waiting 589 ms; commit 3040 ms)
2026-11-08T00:50:55Z [load_day 2023-09-13] 2023-09-13 hour 21: 156337 events in 4 files, snapshot 1311046236603904420 (task 16907 ms: download 7398 ms overlapping gunzip 989 ms, parse 4104 ms, sort 119 ms, write 9918 ms, index 611 ms: 18 candidates, 63079 repo-hours, 896 releases; waiting 847 ms; commit 2646 ms)
2026-11-08T00:51:07Z [load_day 2023-09-13] 2023-09-13 hour 22: 140594 events in 3 files, snapshot 6518910567479686906 (task 14139 ms: download 6279 ms overlapping gunzip 819 ms, parse 3313 ms, sort 117 ms, write 8442 ms, index 546 ms: 10 candidates, 56651 repo-hours, 846 releases; waiting 549 ms; commit 2354 ms)
2026-11-08T00:51:11Z [load_day 2023-09-13] 2023-09-13 hour 23: 133514 events in 3 files, snapshot 2385014469502671132 (task 13126 ms: download 6034 ms overlapping gunzip 774 ms, parse 3478 ms, sort 91 ms, write 7483 ms, index 433 ms: 8 candidates, 53329 repo-hours, 688 releases; waiting 532 ms; commit 4049 ms)
2026-11-08T00:51:19Z [load_day 2023-09-13] 2023-09-13: repo_hour merged from 24 files to 1 (1900218 rows, 8431 ms)
2026-11-08T00:51:21Z [load_day 2023-09-13] 2023-09-13: index committed in 10653 ms (24 + 1 + 24 files)
2026-11-08T00:51:21Z [load_day 2023-09-13] 2023-09-13: 4252758 events in 24 hours
2026-11-08T00:51:21Z [load_day 2023-09-13] attempt 1 succeeded