Revise dissemiantion strategy. Source Cooperative has opened up a lot of doors for the project vision

content/docs/dissemination/_index.md

@@ -6,14 +6,6 @@ weight: 3
 
 Our dissemination strategy prioritizes interoperability, long-term preservation, and decentralized resilience.
 
-Once data products reach a production-ready state, the workflow is as follows:
-
-* **Cloud-Native First:** Priority is given to highly performant, system-to-system file formats (e.g., Parquet) to enable highly performant applications.
-* **Persistent Identification & Cataloging:** Every dataset version will be assigned a DOI for citation and immutability.
-  * The endpoint `https://data-01.dataforcanada.org/processed/` will strictly serve the **latest** version of a dataset.
-  * Global metadata will be aggregated into a single, queryable [STAC GeoParquet](https://stac-utils.github.io/stac-geoparquet/latest/spec/stac-geoparquet-spec/) file. This catalog will track all versions and DOIs, providing direct download links to [Zenodo](https://zenodo.org/communities/dataforcanada/) which serves as the long-term data repository.
-* **Decentralized Distribution:** We will pilot BitTorrent to maximize infrastructure resilience. By leveraging [HTTP Web Seeding (BEP 19)](https://www.bittorrent.org/beps/bep_0019.html), torrents will be seeded simultaneously by Zenodo, the Data for Canada infrastructure, and community peers, ensuring high availability without a single point of failure. Current laboratory work is available on the [dataforcanada/decentralized-distribution-labs](https://github.com/dataforcanada/decentralized-distribution-labs) repo.
-
 ## High-Level Overview
 
 ```mermaid
@@ -26,6 +18,8 @@ flowchart TD
     Metadata[Metadata]
     Distribution[Decentralized Distribution]
     Zenodo[Zenodo]
+    SourceCoop[Source Cooperative]
+    InternetArchive[Internet Archive]
     Torrent[BitTorrent]
     Users[Researchers & Developers]
     Systems[Systems]
@@ -41,6 +35,10 @@ flowchart TD
     Metadata a5@--> Distribution
     a5@{animate: true, animation: fast}
 
+    Distribution a14@--> SourceCoop
+    a14@{animate: true, animation: fast}
+    Distribution a15@--> InternetArchive
+    a15@{animate: true, animation: slow}
     Distribution a6@--> Zenodo
     a6@{animate: true, animation: slow}
     Distribution a7@--> Torrent
@@ -48,20 +46,43 @@ flowchart TD
 
     Zenodo a9@--> Users
     a9@{animate: true, animation: slow}
+    SourceCoop a18@--> Users
+    a18@{animate: true, animation: fast}
+
     Torrent a10@--> Users
     a10@{animate: true, animation: fast}
+    InternetArchive a20@--> Users
+    a20@{animate: true, animation: slow}
     Torrent a11@--> Systems
     a11@{animate: true, animation: fast}
     Zenodo a12@--> Systems
     a12@{animate: true, animation: slow}
+    SourceCoop a16@--> Systems
+    a16@{animate: true, animation: fast}
+    SourceCoop a17@--> Torrent
+    a17@{animate: true, animation: fast}
     Zenodo a13@--> Torrent
     a13@{animate: true, animation: slow}
+    InternetArchive a19@--> Torrent
+    a19@{animate: true, animation: slow}
 
-    click Portal "https://data-01.dataforcanada.org/processed/" _blank
     click Metadata "https://stac-utils.github.io/stac-geoparquet/latest/spec/stac-geoparquet-spec/" _blank
     click Zenodo "https://zenodo.org/communities/dataforcanada/" _blank
 ```
 
+## Dissemination Process
+Once data products reach a production-ready state, the workflow is as follows:
+
+- **Cloud-Native First:** Priority is given to highly performant, system-to-system file formats (e.g., Parquet) to enable highly performant applications.
+- **Persistent Identification & Cataloging:** Every dataset version will be assigned a DOI for citation and immutability.
+  - The endpoint `https://data-01.dataforcanada.org/processed/` will strictly serve the **latest** version of a dataset.
+  - Global metadata will be aggregated into a single, queryable [STAC GeoParquet](https://stac-utils.github.io/stac-geoparquet/latest/spec/stac-geoparquet-spec/) file. This catalog will track all versions and DOIs, directing users to our multi-tier storage network:
+    - **[Source Cooperative](https://source.coop/dataforcanada)** serves as our **primary mirror** for all datasets, including large-scale products like orthoimagery (see [Funding and Governance](https://docs.source.coop/#funding-and-governance)).
+    - **[Zenodo](https://zenodo.org/communities/dataforcanada/)** serves as our repository for **long-term preservation** and provides a mirror for users in Europe.
+    - **[The Internet Archive](https://archive.org)** is utilized **strategically** for specific datasets to minimize load on their limited infrastructure.
+- **Decentralized Distribution:** We will pilot BitTorrent to maximize infrastructure resilience. By leveraging [HTTP Web Seeding (BEP 19)](https://www.bittorrent.org/beps/bep_0019.html), torrents will be seeded simultaneously by Source Cooperative, Zenodo, the Data for Canada infrastructure, and community peers, ensuring high availability without a single point of failure. Current laboratory work is available on the [dataforcanada/decentralized-distribution-labs](https://github.com/dataforcanada/decentralized-distribution-labs) repo.
+
+
 ## Work in the Lab: Smartnodes
 
 To further democratize access and ensure the persistence of Canada’s open data, we are experimenting with the features defined in previous **smartnode** work done by [Academic Torrents](https://academictorrents.com/docs/mirroring.html#smartnodes).
@@ -72,4 +93,4 @@ A smartnode functions as a "set-it-and-forget-it" volunteer server, an automated
 * **Volunteer-Powered Resilience:** This model allows partner institutions (universities, research labs) and public volunteers to donate bandwidth and storage. By running a smartnode, contributors actively protect vital Canadian datasets from being lost or gated behind paywalls.
 * **Dynamic Storage Management:** The node software monitors network health, automatically prioritizing rare data to maintain high availability across the entire Data for Canada ecosystem.
 
-We are currently adapting the `smart-node-transmission` protocols to work seamlessly with our STAC GeoParquet catalog, enabling a fully decentralized data mesh for Canadian geospatial information.
+We are currently refining the concepts from  [smart-node-transmission](https://github.com/academictorrents/smartnode-transmission)  to work seamlessly with our STAC GeoParquet catalog, enabling a fully decentralized data mesh for Canadian geospatial information.