dataforcanada/d4c-service-main-site
1
0
Fork 0
mirror of https://github.com/dataforcanada/d4c-service-main-site.git synced 2026-08-04 07:10:51 +02:00
Code Issues Packages Projects Releases Wiki Activity

Add more context on multistore as it is used by Source Cooperative in production

Browse Source
This commit is contained in:
Diego Ripley
2026-06-18 10:48:07 -04:00
parent e9ebf99296
commit 9a644fa7ed
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
content/blog/2026/deployed-s3-and-browser-ui.md
+1 -1
View File
@@ -17,7 +17,7 @@ A core part of the mission here at Data for Canada is modernizing how we access,
These two tools are designed to serve both programmatic workflows and everyday discovery.
## 1. The Programmatic S3 Interface
[developmentseed/multistore](https://github.com/developmentseed/multistore/) has been successfully deployed to [https://s3.dataforcanada.org/](https://s3.dataforcanada.org/).
[developmentseed/multistore](https://github.com/developmentseed/multistore/) has been successfully deployed to [https://s3.dataforcanada.org/](https://s3.dataforcanada.org/). This is the exact same technology utilized by the [Source Cooperative read-only data proxy](https://github.com/source-cooperative/data.source.coop). To give you an idea of its proven scalability, this proxy recently served over 1 billion requests and transferred just under 3PB of data in April 2026 alone. (You can read more about these metrics in Jed Sundwall's [recent LinkedIn announcement](https://www.linkedin.com/posts/jedsundwall_source-cooperative-appears-to-have-turned-share-7465709591096360961-uO5P/)).
For data pipelines and cloud-native workflows, standard access protocols are everything. Multistore provides a robust S3-compatible interface, allowing developers, researchers, and data engineers to interact with our hosted datasets using familiar S3 tools and libraries. Whether you are automating data pipelines, querying cloud-optimized formats directly over the network, or syncing large datasets, this endpoint ensures that data retrieval is fast, scalable, and standardized.