Commit Graph

19 Commits

Author SHA1 Message Date
Diego Ripley c3f0fb641b Made improvements 2026-03-14 07:34:18 -04:00
Diego Ripley 9c35374b04 Change multipart upload size to 5 MiB, I was getting out of memory errors for the workers 2026-03-13 09:53:55 -04:00
Diego Ripley 422cff5273 Update Python CLI to call Cloudflare HTTP ingestor. TODO: For singlepart upload, return back part size and number of parts. More descriptive error logged 2026-03-13 07:18:36 -04:00
Diego Ripley d4484b665f Updates to Cloudflare HTTP ingestor. I tried to calculate different file hashes and failed miserably 2026-03-13 07:16:47 -04:00
Diego Ripley d3b5d69571 Python CLI to call Cloudflare HTTP ingestor. To start running tomorrow morning! https://tenor.com/view/bbnft-yuge-theriouthly-seriously-mike-tyson-gif-5575001300972074272 2026-03-10 14:31:09 -04:00
Diego Ripley 258571bfd4 Turn on Cloudflare observability 2026-03-10 14:17:40 -04:00
Diego Ripley c9d051bc59 Got it working. Will start running it tomorrow early in the morning, going to chill 2026-03-08 15:46:25 -04:00
Diego Ripley b2dfd76165 Add vibe code Cloudflare data ingestor to Source Cooperative 2026-03-08 13:12:47 -04:00
Diego Ripley a48cc9a9ef Change trackers to list taken from https://github.com/ngosang/trackerslist 2026-03-03 17:27:41 -05:00
Diego Ripley faeb967cb1 Progress on #24. Create torrent once upload to Source Cooperative is done and PMTiles file is done generating, that is eating up all of the storage bandwidth so cannot hash properly 2026-02-25 15:28:23 -05:00
Diego Ripley 7afbf6ba43 Got magnet links to work 2026-02-21 13:02:02 -05:00
Diego Ripley 6944839f54 Generate torrent with libtorrent's Python bindings. This is work for #12. 2026-02-17 18:17:55 -05:00
Diego Ripley 4b15c9e722 Create torrents for remaining orthoimagery 2026-02-08 18:06:40 -05:00
Diego Ripley bfc0eda524 Made torrent no longer private 2026-02-07 11:36:27 -05:00
Diego Ripley 88183e1443 Add Source Coop as an HTTP webseed 2026-02-07 11:36:27 -05:00
Diego Ripley 61a714a564 Add data-01.labs.dataforcanada.org, better for demonstrations as it will now download from two dedicated sources 2026-02-04 15:02:19 -05:00
Diego Ripley 759ae9b788 Update HTTP webseed to netcup infrastructure through Cloudflare CDN. Update BitTorrent tracker so that it is behind HTTPS vs. UDP. Goes through Cloudflare as well 2026-02-04 12:59:25 -05:00
Diego Ripley 521217bfc0 Fix #1. 2026-02-03 17:20:25 -05:00
Diego Ripley 02c2869e6c Initial commit 2026-02-03 16:55:38 -05:00