diff --git a/README.md b/README.md index 5c5f40c..b9423f3 100644 --- a/README.md +++ b/README.md @@ -1,5 +1,7 @@ ## Data Dissemination Strategy High-Level Overview +We prioritize interoperability, long-term preservation, and decentralized resilience. + ## High-Level Overview ```mermaid @@ -7,13 +9,14 @@ flowchart TD classDef linkNode stroke:#0000EE,color:#0000EE,stroke-width:2px; subgraph mirrors [Mirrors & Preservation] SourceCoop[Source Cooperative] + Tigris[Tigris] + Community[Community] Zenodo[Zenodo] InternetArchive[Internet Archive] - Community[Community] end Sources[Open Data Sources] - Processes[Data for Canada Packages Collection] + Processes[Data Packages] Artifacts[Systems-Ready Data] subgraph CoreInfra [Infrastructure] @@ -66,17 +69,19 @@ flowchart TD style Processes fill:#B71C1C,stroke:#7F0000,color:#FFFFFF class Processes Processes style SourceCoop fill:#B71C1C,stroke:#7F0000,color:#FFFFFF + style Tigris fill:#B71C1C,stroke:#7F0000,color:#FFFFFF style Zenodo fill:#FFB74D,stroke:#EF6C00,color:#000000 - style Community fill:#D32F2F,stroke:#8E0000,color:#FFFFFF + style Community fill:#B71C1C,stroke:#7F0000,color:#FFFFFF style P2P fill:#B71C1C,stroke:#7F0000,color:#FFFFFF style InternetArchive fill:#66BB6A,stroke:#2E7D32,color:#000000 - style Users fill:#FFB74D,stroke:#EF6C00,color:#000000 + style Users fill:#B71C1C,stroke:#7F0000,color:#FFFFFF style Systems fill:#B71C1C,stroke:#7F0000,color:#FFFFFF %% Click Actions + click P2P "https://tixati.com/specs/bittorrent" _blank + click Tigris "https://www.tigrisdata.com/docs/overview/" _blank click Sources "https://www.dataforcanada.org/#high-level-overview" _blank - click Processes "https://www.dataforcanada.org/docs/processes/" _blank - click Artifacts "https://www.dataforcanada.org/docs/getting_started/" _blank + click Processes "https://www.dataforcanada.org/docs/d4c-pkgs/" _blank click Metadata "https://stac-utils.github.io/stac-geoparquet/latest/spec/stac-geoparquet-spec/" _blank click Zenodo "https://zenodo.org/communities/dataforcanada/" _blank click SourceCoop "https://source.coop/dataforcanada/" _blank @@ -100,7 +105,7 @@ Once data products reach a production-ready state, they enter a dissemination fl ### Decentralized Distribution -We are piloting a P2P technology, to maximize infrastructure resilience. By leveraging the [P2P HTTP consumption feature](https://www.bittorrent.org/beps/bep_0019.html), users will be able to download simultaneously from Source Cooperative, Zenodo, Data for Canada infrastructure, and community peers. This ensures high availability without a single point of failure. Current laboratory work is available in the [Decentralized Distribution Labs](https://github.com/dataforcanada/decentralized-distribution-labs). +We are piloting a P2P technology, to maximize infrastructure resilience. By leveraging the [P2P HTTP consumption feature](https://www.bittorrent.org/beps/bep_0019.html), users will be able to download simultaneously from Source Cooperative, Zenodo, Data for Canada infrastructure, and community peers. This ensures high availability without a single point of failure. Current laboratory work is available in the [d4c-infra-distribution](https://github.com/dataforcanada/d4c-infra-distribution). ## 🏗️ Open Processing Architecture