orcaLog in

Runs · run 1604

load_day 2023-10-09, attempt 1 succeeded

Host
3c2b29713ce8:416638
Started
2026-11-08T01:35:50Z
Ended
2026-11-08T01:40:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1604/load_day/2023-10-09/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T01:35:50Z [load_day 2023-10-09] attempt 1 started
2026-11-08T01:35:52Z [load_day 2023-10-09] 2023-10-09: 2 hours in flight, about 1200 MB
2026-11-08T01:36:11Z [load_day 2023-10-09] 2023-10-09 hour 0: 145183 events in 3 files, snapshot 5944535161625339921 (task 14768 ms: download 6033 ms overlapping gunzip 948 ms, parse 3917 ms, sort 117 ms, write 8277 ms, index 680 ms: 6 candidates, 75553 repo-hours, 815 releases; waiting 546 ms; commit 2725 ms)
2026-11-08T01:36:14Z [load_day 2023-10-09] 2023-10-09 hour 1: 162389 events in 4 files, snapshot 6228351280941304416 (task 16362 ms: download 9718 ms overlapping gunzip 1110 ms, parse 4570 ms, sort 121 ms, write 8936 ms, index 863 ms: 6 candidates, 84258 repo-hours, 725 releases; waiting 480 ms; commit 2825 ms)
2026-11-08T01:36:26Z [load_day 2023-10-09] 2023-10-09 hour 2: 135461 events in 3 files, snapshot 3909268593624039061 (task 14458 ms: download 6522 ms overlapping gunzip 898 ms, parse 3758 ms, sort 117 ms, write 8394 ms, index 524 ms: 8 candidates, 55014 repo-hours, 686 releases; waiting 529 ms; commit 2101 ms)
2026-11-08T01:36:29Z [load_day 2023-10-09] 2023-10-09 hour 3: 137086 events in 3 files, snapshot 4197272395358527603 (task 12722 ms: download 5966 ms overlapping gunzip 847 ms, parse 3723 ms, sort 110 ms, write 6807 ms, index 378 ms: 6 candidates, 56022 repo-hours, 916 releases; waiting 546 ms; commit 3111 ms)
2026-11-08T01:36:42Z [load_day 2023-10-09] 2023-10-09 hour 4: 133668 events in 3 files, snapshot 6179214240995358850 (task 14590 ms: download 6812 ms overlapping gunzip 924 ms, parse 3851 ms, sort 116 ms, write 8493 ms, index 414 ms: 5 candidates, 51889 repo-hours, 667 releases; waiting 504 ms; commit 2310 ms)
2026-11-08T01:36:47Z [load_day 2023-10-09] 2023-10-09 hour 5: 143607 events in 3 files, snapshot 1030539339131215882 (task 15266 ms: download 7528 ms overlapping gunzip 1041 ms, parse 4780 ms, sort 199 ms, write 7905 ms, index 513 ms: 13 candidates, 58411 repo-hours, 580 releases; waiting 505 ms; commit 5001 ms)
2026-11-08T01:37:02Z [load_day 2023-10-09] 2023-10-09 hour 6: 175899 events in 4 files, snapshot 2558192348242989511 (task 18729 ms: download 10862 ms overlapping gunzip 1128 ms, parse 4663 ms, sort 194 ms, write 11084 ms, index 831 ms: 9 candidates, 77064 repo-hours, 904 releases; waiting 524 ms; commit 2980 ms)
2026-11-08T01:37:07Z [load_day 2023-10-09] 2023-10-09 hour 7: 182985 events in 4 files, snapshot 8972436406383951541 (task 21587 ms: download 12661 ms overlapping gunzip 1204 ms, parse 5561 ms, sort 159 ms, write 13261 ms, index 671 ms: 12 candidates, 78266 repo-hours, 862 releases; waiting 491 ms; commit 2188 ms)
2026-11-08T01:37:26Z [load_day 2023-10-09] 2023-10-09 hour 8: 195890 events in 4 files, snapshot 4611794764857868241 (task 22907 ms: download 13338 ms overlapping gunzip 1480 ms, parse 6491 ms, sort 202 ms, write 13441 ms, index 538 ms: 12 candidates, 84260 repo-hours, 1036 releases; waiting 532 ms; commit 2401 ms)
2026-11-08T01:37:33Z [load_day 2023-10-09] 2023-10-09 hour 9: 204308 events in 5 files, snapshot 3349469152338571153 (task 23412 ms: download 13279 ms overlapping gunzip 1362 ms, parse 5907 ms, sort 183 ms, write 14324 ms, index 809 ms: 10 candidates, 86687 repo-hours, 1143 releases; waiting 526 ms; commit 3380 ms)
2026-11-08T01:37:50Z [load_day 2023-10-09] 2023-10-09 hour 10: 199295 events in 4 files, snapshot 3593324517207675392 (task 22179 ms: download 12632 ms overlapping gunzip 1229 ms, parse 5495 ms, sort 154 ms, write 13547 ms, index 555 ms: 10 candidates, 84248 repo-hours, 1094 releases; waiting 844 ms; commit 3478 ms)
2026-11-08T01:37:55Z [load_day 2023-10-09] 2023-10-09 hour 11: 197106 events in 4 files, snapshot 2881512337391542617 (task 21248 ms: download 12938 ms overlapping gunzip 1489 ms, parse 6255 ms, sort 177 ms, write 11866 ms, index 568 ms: 9 candidates, 82924 repo-hours, 1172 releases; waiting 546 ms; commit 2648 ms)
2026-11-08T01:38:10Z [load_day 2023-10-09] 2023-10-09 hour 12: 235251 events in 5 files, snapshot 7807686573526887397 (task 19844 ms: download 12364 ms overlapping gunzip 1119 ms, parse 4830 ms, sort 136 ms, write 11802 ms, index 1219 ms: 10 candidates, 113400 repo-hours, 1192 releases; waiting 524 ms; commit 2990 ms)
2026-11-08T01:38:17Z [load_day 2023-10-09] 2023-10-09 hour 13: 223455 events in 5 files, snapshot 5263921564579044579 (task 21823 ms: download 12617 ms overlapping gunzip 1322 ms, parse 5682 ms, sort 159 ms, write 12881 ms, index 892 ms: 12 candidates, 107338 repo-hours, 1159 releases; waiting 508 ms; commit 2367 ms)
2026-11-08T01:38:36Z [load_day 2023-10-09] 2023-10-09 hour 14: 209676 events in 5 files, snapshot 1161808815267884784 (task 24677 ms: download 17352 ms overlapping gunzip 1452 ms, parse 6190 ms, sort 142 ms, write 15334 ms, index 704 ms: 8 candidates, 95572 repo-hours, 1118 releases; waiting 528 ms; commit 2742 ms)
2026-11-08T01:38:41Z [load_day 2023-10-09] 2023-10-09 hour 15: 210283 events in 5 files, snapshot 3536907217373414480 (task 22835 ms: download 15936 ms overlapping gunzip 1323 ms, parse 5914 ms, sort 176 ms, write 13765 ms, index 834 ms: 7 candidates, 93022 repo-hours, 1229 releases; waiting 511 ms; commit 2587 ms)
2026-11-08T01:38:59Z [load_day 2023-10-09] 2023-10-09 hour 16: 196851 events in 4 files, snapshot 1493018784726692603 (task 22451 ms: download 13401 ms overlapping gunzip 1514 ms, parse 6566 ms, sort 184 ms, write 12667 ms, index 670 ms: 11 candidates, 89432 repo-hours, 1022 releases; waiting 532 ms; commit 2425 ms)
2026-11-08T01:39:05Z [load_day 2023-10-09] 2023-10-09 hour 17: 192256 events in 4 files, snapshot 1005198947095459430 (task 22206 ms: download 12528 ms overlapping gunzip 1477 ms, parse 5940 ms, sort 181 ms, write 13174 ms, index 606 ms: 11 candidates, 83231 repo-hours, 941 releases; waiting 527 ms; commit 2896 ms)
2026-11-08T01:39:22Z [load_day 2023-10-09] 2023-10-09 hour 18: 197881 events in 4 files, snapshot 6329971498505261956 (task 21965 ms: download 11943 ms overlapping gunzip 1364 ms, parse 5881 ms, sort 176 ms, write 13032 ms, index 666 ms: 10 candidates, 88321 repo-hours, 993 releases; waiting 524 ms; commit 2209 ms)
2026-11-08T01:39:26Z [load_day 2023-10-09] 2023-10-09 hour 19: 187436 events in 4 files, snapshot 4332479356591906332 (task 20567 ms: download 11806 ms overlapping gunzip 1176 ms, parse 5153 ms, sort 133 ms, write 12559 ms, index 714 ms: 8 candidates, 77415 repo-hours, 945 releases; waiting 475 ms; commit 2544 ms)
2026-11-08T01:39:44Z [load_day 2023-10-09] 2023-10-09 hour 20: 182525 events in 4 files, snapshot 2294778399014948693 (task 20329 ms: download 11626 ms overlapping gunzip 1285 ms, parse 5581 ms, sort 125 ms, write 11826 ms, index 535 ms: 23 candidates, 74280 repo-hours, 1248 releases; waiting 621 ms; commit 2386 ms)
2026-11-08T01:39:50Z [load_day 2023-10-09] 2023-10-09 hour 21: 168422 events in 4 files, snapshot 8129316840911411688 (task 19054 ms: download 11697 ms overlapping gunzip 1072 ms, parse 4575 ms, sort 125 ms, write 11899 ms, index 576 ms: 9 candidates, 65648 repo-hours, 1048 releases; waiting 489 ms; commit 5520 ms)
2026-11-08T01:40:03Z [load_day 2023-10-09] 2023-10-09 hour 22: 147695 events in 3 files, snapshot 9006783224781049908 (task 16294 ms: download 7439 ms overlapping gunzip 951 ms, parse 4290 ms, sort 96 ms, write 9693 ms, index 425 ms: 8 candidates, 58479 repo-hours, 849 releases; waiting 523 ms; commit 4087 ms)
2026-11-08T01:40:05Z [load_day 2023-10-09] 2023-10-09 hour 23: 135753 events in 3 files, snapshot 271809132236684898 (task 13922 ms: download 6332 ms overlapping gunzip 873 ms, parse 3993 ms, sort 91 ms, write 7825 ms, index 347 ms: 5 candidates, 53741 repo-hours, 679 releases; waiting 532 ms; commit 2080 ms)
2026-11-08T01:40:14Z [load_day 2023-10-09] 2023-10-09: repo_hour merged from 24 files to 1 (1874475 rows, 8392 ms)
2026-11-08T01:40:16Z [load_day 2023-10-09] 2023-10-09: index committed in 10392 ms (24 + 1 + 24 files)
2026-11-08T01:40:16Z [load_day 2023-10-09] 2023-10-09: 4300361 events in 24 hours
2026-11-08T01:40:16Z [load_day 2023-10-09] attempt 1 succeeded