mirror of
https://github.com/dataforcanada/d4c-service-main-site.git
synced 2026-06-13 14:00:51 +02:00
Update documentation
This commit is contained in:
@@ -10,6 +10,6 @@ Once data products reach a production-ready state, the workflow is as follows:
|
||||
|
||||
* **Cloud-Native First:** Priority is given to highly performant, system-to-system file formats (e.g., [Geo]Parquet) to enable efficient bulk analysis. Support for specific desktop GIS clients (e.g., Esri products, QGIS) will follow.
|
||||
* **Persistent Identification & Cataloging:** * Every dataset version will be assigned a DOI for citation and immutability.
|
||||
* The endpoint `https://data-01.dataforcanada.org/processed/` will strictly serve the **latest** version of a dataset.
|
||||
* Global metadata will be aggregated into a single, queryable [STAC GeoParquet](https://stac-utils.github.io/stac-geoparquet/latest/spec/stac-geoparquet-spec/) file. This catalog will track all versions and DOIs, providing direct download links to [Zenodo](https://zenodo.org) which serves as the long-term data repository.
|
||||
* The endpoint `https://data-01.dataforcanada.org/processed/` will strictly serve the **latest** version of a dataset.
|
||||
* Global metadata will be aggregated into a single, queryable [STAC GeoParquet](https://stac-utils.github.io/stac-geoparquet/latest/spec/stac-geoparquet-spec/) file. This catalog will track all versions and DOIs, providing direct download links to [Zenodo](https://zenodo.org) which serves as the long-term data repository.
|
||||
* **Decentralized Distribution:** We will pilot BitTorrent to maximize infrastructure resilience. By leveraging HTTP Web Seeding (BEP 19), torrents will be seeded simultaneously by Zenodo, the Data for Canada infrastructure, and community peers, ensuring high availability without a single point of failure.
|
||||
@@ -1,7 +1,9 @@
|
||||
---
|
||||
title: "Getting Started"
|
||||
toc: true
|
||||
weight: 1
|
||||
weight: 2
|
||||
---
|
||||
|
||||
Look through our [GitHub Organization](https://github.com/orgs/dataforcanada/repositories) to see ongoing work being done in this project.
|
||||
|
||||
There are some samples on specific software usage that reads datasets produced by Data for Canada.
|
||||
@@ -1,7 +1,7 @@
|
||||
---
|
||||
title: "Processes"
|
||||
toc: true
|
||||
weight: 2
|
||||
weight: 1
|
||||
---
|
||||
|
||||
For the moment, this project is composed of two processes, both of which are still in development.
|
||||
|
||||
Reference in New Issue
Block a user