dataforcanada/d4c-service-main-site
1
0
Fork 0
mirror of https://github.com/dataforcanada/d4c-service-main-site.git synced 2026-08-04 07:10:51 +02:00
Code Issues Packages Projects Releases Wiki Activity

Add more context on multistore as it is used by Source Cooperative in production

Browse Source
This commit is contained in:
Diego Ripley
2026-06-18 10:48:07 -04:00
parent e9ebf99296
commit 9a644fa7ed
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
content/blog/2026/deployed-s3-and-browser-ui.md
+1 -1
View File
@@ -17,7 +17,7 @@ A core part of the mission here at Data for Canada is modernizing how we access,
These two tools are designed to serve both programmatic workflows and everyday discovery. These two tools are designed to serve both programmatic workflows and everyday discovery.
## 1. The Programmatic S3 Interface ## 1. The Programmatic S3 Interface
[developmentseed/multistore](https://github.com/developmentseed/multistore/) has been successfully deployed to [https://s3.dataforcanada.org/](https://s3.dataforcanada.org/). [developmentseed/multistore](https://github.com/developmentseed/multistore/) has been successfully deployed to [https://s3.dataforcanada.org/](https://s3.dataforcanada.org/). This is the exact same technology utilized by the [Source Cooperative read-only data proxy](https://github.com/source-cooperative/data.source.coop). To give you an idea of its proven scalability, this proxy recently served over 1 billion requests and transferred just under 3PB of data in April 2026 alone. (You can read more about these metrics in Jed Sundwall's [recent LinkedIn announcement](https://www.linkedin.com/posts/jedsundwall_source-cooperative-appears-to-have-turned-share-7465709591096360961-uO5P/)).
For data pipelines and cloud-native workflows, standard access protocols are everything. Multistore provides a robust S3-compatible interface, allowing developers, researchers, and data engineers to interact with our hosted datasets using familiar S3 tools and libraries. Whether you are automating data pipelines, querying cloud-optimized formats directly over the network, or syncing large datasets, this endpoint ensures that data retrieval is fast, scalable, and standardized. For data pipelines and cloud-native workflows, standard access protocols are everything. Multistore provides a robust S3-compatible interface, allowing developers, researchers, and data engineers to interact with our hosted datasets using familiar S3 tools and libraries. Whether you are automating data pipelines, querying cloud-optimized formats directly over the network, or syncing large datasets, this endpoint ensures that data retrieval is fast, scalable, and standardized.