dataforcanada/d4c-infra-distribution
1
0
Fork 0
mirror of https://github.com/dataforcanada/d4c-infra-distribution.git synced 2026-06-13 14:10:53 +02:00
Code Issues Packages Projects Releases Wiki Activity

Revise README for clarity and updated links

Browse Source 
Updated links and descriptions for decentralized distribution and infrastructure.
This commit is contained in:
Diego Ripley
2026-02-20 14:12:09 -05:00
committed by GitHub
parent 6944839f54
commit a9af733765
1 changed files with 12 additions and 7 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+12 -7
View File
@@ -1,5 +1,7 @@
## Data Dissemination Strategy High-Level Overview ## Data Dissemination Strategy High-Level Overview
We prioritize interoperability, long-term preservation, and decentralized resilience.
## High-Level Overview ## High-Level Overview
```mermaid ```mermaid
@@ -7,13 +9,14 @@ flowchart TD
classDef linkNode stroke:#0000EE,color:#0000EE,stroke-width:2px; classDef linkNode stroke:#0000EE,color:#0000EE,stroke-width:2px;
subgraph mirrors [Mirrors & Preservation] subgraph mirrors [Mirrors & Preservation]
SourceCoop[Source Cooperative] SourceCoop[Source Cooperative]
Tigris[Tigris]
Community[Community]
Zenodo[Zenodo] Zenodo[Zenodo]
InternetArchive[Internet Archive] InternetArchive[Internet Archive]
Community[Community]
end end
Sources[Open Data Sources] Sources[Open Data Sources]
Processes[Data for Canada Packages Collection] Processes[Data Packages]
Artifacts[Systems-Ready Data] Artifacts[Systems-Ready Data]
subgraph CoreInfra [Infrastructure] subgraph CoreInfra [Infrastructure]
@@ -66,17 +69,19 @@ flowchart TD
style Processes fill:#B71C1C,stroke:#7F0000,color:#FFFFFF style Processes fill:#B71C1C,stroke:#7F0000,color:#FFFFFF
class Processes Processes class Processes Processes
style SourceCoop fill:#B71C1C,stroke:#7F0000,color:#FFFFFF style SourceCoop fill:#B71C1C,stroke:#7F0000,color:#FFFFFF
style Tigris fill:#B71C1C,stroke:#7F0000,color:#FFFFFF
style Zenodo fill:#FFB74D,stroke:#EF6C00,color:#000000 style Zenodo fill:#FFB74D,stroke:#EF6C00,color:#000000
style Community fill:#D32F2F,stroke:#8E0000,color:#FFFFFF style Community fill:#B71C1C,stroke:#7F0000,color:#FFFFFF
style P2P fill:#B71C1C,stroke:#7F0000,color:#FFFFFF style P2P fill:#B71C1C,stroke:#7F0000,color:#FFFFFF
style InternetArchive fill:#66BB6A,stroke:#2E7D32,color:#000000 style InternetArchive fill:#66BB6A,stroke:#2E7D32,color:#000000
style Users fill:#FFB74D,stroke:#EF6C00,color:#000000 style Users fill:#B71C1C,stroke:#7F0000,color:#FFFFFF
style Systems fill:#B71C1C,stroke:#7F0000,color:#FFFFFF style Systems fill:#B71C1C,stroke:#7F0000,color:#FFFFFF
%% Click Actions %% Click Actions
click P2P "https://tixati.com/specs/bittorrent" _blank
click Tigris "https://www.tigrisdata.com/docs/overview/" _blank
click Sources "https://www.dataforcanada.org/#high-level-overview" _blank click Sources "https://www.dataforcanada.org/#high-level-overview" _blank
click Processes "https://www.dataforcanada.org/docs/processes/" _blank click Processes "https://www.dataforcanada.org/docs/d4c-pkgs/" _blank
click Artifacts "https://www.dataforcanada.org/docs/getting_started/" _blank
click Metadata "https://stac-utils.github.io/stac-geoparquet/latest/spec/stac-geoparquet-spec/" _blank click Metadata "https://stac-utils.github.io/stac-geoparquet/latest/spec/stac-geoparquet-spec/" _blank
click Zenodo "https://zenodo.org/communities/dataforcanada/" _blank click Zenodo "https://zenodo.org/communities/dataforcanada/" _blank
click SourceCoop "https://source.coop/dataforcanada/" _blank click SourceCoop "https://source.coop/dataforcanada/" _blank
@@ -100,7 +105,7 @@ Once data products reach a production-ready state, they enter a dissemination fl
### Decentralized Distribution ### Decentralized Distribution
We are piloting a <abbr title="Peer-to-Peer">P2P</abbr> technology, to maximize infrastructure resilience. By leveraging the [P2P HTTP consumption feature](https://www.bittorrent.org/beps/bep_0019.html), users will be able to download simultaneously from Source Cooperative, Zenodo, Data for Canada infrastructure, and community peers. This ensures high availability without a single point of failure. Current laboratory work is available in the [Decentralized Distribution Labs](https://github.com/dataforcanada/decentralized-distribution-labs). We are piloting a <abbr title="Peer-to-Peer">P2P</abbr> technology, to maximize infrastructure resilience. By leveraging the [P2P HTTP consumption feature](https://www.bittorrent.org/beps/bep_0019.html), users will be able to download simultaneously from Source Cooperative, Zenodo, Data for Canada infrastructure, and community peers. This ensures high availability without a single point of failure. Current laboratory work is available in the [d4c-infra-distribution](https://github.com/dataforcanada/d4c-infra-distribution).
## 🏗️ Open Processing Architecture ## 🏗️ Open Processing Architecture