dataforcanada/d4c-service-main-site
1
0
Fork 0
mirror of https://github.com/dataforcanada/d4c-service-main-site.git synced 2026-06-13 14:00:51 +02:00
Code Issues Packages Projects Releases Wiki Activity
Files
54095f96bdcf9e6e0fd657b1964ee002be8153fb
d4c-service-main-site/high-level-overview-homepage.mermaid
T
Diego Ripley 4faccf64d7 Add URL to the FlatCityBuf GitHub repo
2026-03-09 13:05:41 -04:00

229 lines
9.7 KiB
Plaintext
Raw Blame History

flowchart TD
classDef linkNode stroke:#333333,color:#333333,stroke-width:1.5px
classDef legendRed fill:#B71C1C,stroke:#7F0000,color:#FFFFFF
classDef legendYellow fill:#FBC02D,stroke:#F9A825,color:#000000
classDef legendGreen fill:#66BB6A,stroke:#2E7D32,color:#000000
subgraph ds [Data Sources]
Statistical@{ shape: lean-l}
Foundation@{ shape: lean-l}
%% I have some big ideas for this data package, but it will take some exploratory work
EnvClimate@{ shape: lean-l, label: "Environment, Climate, & Health"}
Orthoimagery@{ shape: lean-l}
FieldImagery@{ shape: lean-l, label: "Field Imagery"}
Elevation@{ shape: lean-l}
WebCorpus@{ shape: lean-l, label: "Web Corpus"}
end
DataPkgs@{ shape: rect, label: "Data Packages"}
subgraph df [Dissemination Formats]
%% TODO: 3D Tiles. Need to take a closer look at this file format, I am not experienced with it
GLB@{ shape: rect, label: "glTF GLB"}
FlatCityBuf@{ shape: rect}
subgraph sot [Long-Term Storage]
Parquet@{ shape: lean-l}
Zarr@{ shape: lean-l}
GeoTIFF@{ shape: lean-l}
JPEGXL@{ shape: lean-l, label: "JPEG XL"}
AV1@{ shape: lean-l, label: "AV1"}
%% Commented out since I'm pretty sure this is not ideal file format. Ideal file format is Parquet and other file formats outlined depending on need. For example, let's say we archive media posts from various platforms (ex. X, BlueSky, etc.), there's no need to archive the webpage if we can just parse the content and have significant savings.
%% If we do archive webpages, I want there to be a deduplicating component similar to BTRFS, The Internet Archive is way too wasteful with the way they archive webpages.
%%WARC@{ shape: lean-l, label: "Unstructured Web Data"}
FAIRCat@{ shape: lean-l, label: "FAIR Data Catalogue"}
end
FlatGeoBuf@{ shape: lean-l}
subgraph vt [Vector Tiles]
VectorTiles@{ shape: lean-l, label: "Mapbox Vector Tiles"}
NextGenVT@{ shape: lean-l, label: "Next-Gen Vector Tiles"}
end
subgraph visuals [" "]
AVIF@{ shape: lean-l}
WebP@{ shape: lean-l}
JPG@{ shape: lean-l}
PNG@{ shape: lean-l}
end
subgraph pkg [Portable Databases]
PMTiles@{ shape: lean-l}
SQLite@{ shape: lean-l}
end
subgraph ent [Enterprise]
FileGDB@{shape: lean-l, label: "File Geodatabase"}
end
end
subgraph di [Distribution]
ObjStorage@{ shape: bow-rect, label: "Storage"}
Metadata@{ shape: rect, label: "FAIR Data Catalogue"}
HTTP@{ shape: rect, label: "Systems-Ready Data"}
DecenDist@{ shape: rect, label: "Decentralized Distribution"}
end
subgraph ei [Experimental Infrastructure]
Services@{ shape: rect, label: "Services"}
end
subgraph consumption [Consumption]
DataSci@{ shape: rect, label: "Data People & Developers"}
Systems@{ shape: rect, label: "Systems"}
end
Statistical e1@<--> DataPkgs
e1@{animate: true, animation: slow}
Foundation e2@<--> DataPkgs
e2@{animate: true, animation: slow}
EnvClimate e4@<--> DataPkgs
e4@{animate: true, animation: fast}
Orthoimagery e3@<--> DataPkgs
e3@{animate: true, animation: slow}
FieldImagery e7@<--> DataPkgs
e7@{animate: true, animation: fast}
Elevation e5@<--> DataPkgs
e5@{animate: true, animation: slow}
WebCorpus e6@<--> DataPkgs
e6@{animate: true, animation: fast}
DataPkgs e8@--> df
e8@{animate: true, animation: fast}
sot e9@<--> FlatGeoBuf
e9@{animate: true, animation: fast}
FlatGeoBuf e10@--> vt
e10@{animate: true, animation: fast}
sot e11@<--> visuals
e11@{animate: true, animation: slow}
vt e12@<--> pkg
e12@{animate: true, animation: fast}
visuals e13@<--> pkg
e13@{animate: true, animation: slow}
sot e14@<--> ent
e14@{animate: true, animation: slow}
visuals e15@--> ent
e15@{animate: true, animation: slow}
df e16@<--> di
e16@{animate: true, animation: slow}
ObjStorage e17@<--> Metadata
e17@{animate: true, animation: slow}
Metadata e18@<--> HTTP
e18@{animate: true, animation: slow}
HTTP e19@<--> ei
e19@{animate: true, animation: slow}
HTTP e20@<--> DecenDist
e20@{animate: true, animation: slow}
HTTP e21@<--> DataSci
e21@{animate: true, animation: slow}
DecenDist e22@--> Systems
e22@{animate: true, animation: fast}
DecenDist e23@--> DataSci
e23@{animate: true, animation: fast}
Systems e24@<--> DataSci
e24@{animate: true, animation: fast}
ei e25@<--> DataSci
e25@{animate: true, animation: slow}
consumption ~~~ legend
subgraph legend [Priority Legend]
direction LR
L1[High]:::legendRed ~~~ L2[Medium]:::legendYellow ~~~ L3[Low]:::legendGreen
end
style EnvClimate fill:#B71C1C,stroke:#7F0000,color:#FFFFFF
style Orthoimagery fill:#FBC02D,stroke:#F9A825,color:#000000
style FieldImagery fill:#FBC02D,stroke:#F9A825,color:#000000
style WebCorpus fill:#66BB6A,stroke:#2E7D32,color:#000000
style Elevation fill:#66BB6A,stroke:#2E7D32,color:#000000
style VectorTiles fill:#66BB6A,stroke:#2E7D32,color:#000000
style NextGenVT fill:#B71C1C,stroke:#7F0000,color:#FFFFFF
%% This is in the ideal file format. As of 2026-03-05, it is mostly supported across major browsers
style AVIF fill:#B71C1C,stroke:#7F0000,color:#FFFFFF
style WebP fill:#FFCC80,stroke:#FB8C00,color:#000000
style JPG fill:#66BB6A,stroke:#2E7D32,color:#000000
style PNG fill:#66BB6A,stroke:#2E7D32,color:#000000
style FileGDB fill:#fff,stroke:#2E7D32,color:#000000
style Services fill:#FBC02D,stroke:#F9A825,color:#000000
style ObjStorage fill:#FBC02D,stroke:#F9A825,color:#000000
style GLB fill:#B71C1C,stroke:#7F0000,color:#FFFFFF
style FlatCityBuf fill:#B71C1C,stroke:#7F0000,color:#FFFFFF
style DataPkgs fill:#B71C1C,stroke:#7F0000,color:#FFFFFF
style FAIRCat fill:#B71C1C,stroke:#7F0000,color:#FFFFFF
%% I'm not as concerned about distribution of data. I have made some progress on smart nodes so that's going to be a YUGE release
style DecenDist fill:#FBC02D,stroke:#F9A825,color:#000000
style HTTP fill:#B71C1C,stroke:#7F0000,color:#FFFFFF
style Systems fill:#B71C1C,stroke:#7F0000,color:#FFFFFF
style Metadata fill:#B71C1C,stroke:#7F0000,color:#FFFFFF
style Statistical fill:#B71C1C,stroke:#7F0000,color:#FFFFFF
style Foundation fill:#B71C1C,stroke:#7F0000,color:#FFFFFF
style sot fill:#EF9A9A,stroke:#C62828,color:#000000
style Parquet fill:#FFCDD2,stroke:#E57373,color:#000000
style Zarr fill:#FFCDD2,stroke:#E57373,color:#000000
style GeoTIFF fill:#FFCC80,stroke:#FB8C00,color:#000000
style JPEGXL fill:#FFCDD2,stroke:#E57373,color:#000000
%%style WARC fill:#FFCDD2,stroke:#E57373,color:#000000
style AV1 fill:#FFCDD2,stroke:#E57373,color:#000000
style pkg fill:#FFB74D,stroke:#EF6C00,color:#000000
style SQLite fill:#EF6C00,stroke:#E65100,color:#000000
style PMTiles fill:#FFCC80,stroke:#FB8C00,color:#000000
style vt fill:#FBC02D,stroke:#F9A825,color:#000000
style FlatGeoBuf fill:#FBC02D,stroke:#F9A825,color:#000000
style visuals fill:#FBC02D,stroke:#F9A825,color:#000000
style ent fill:#66BB6A,stroke:#2E7D32,color:#000000
style DataSci fill:#B71C1C,stroke:#7F0000,color:#FFFFFF
style legend fill:none,stroke:#999,stroke-width:1px
class FieldImagery linkNode
class Parquet,FlatGeoBuf,SQLite,FileGDB,VectorTiles,NextGenVT,GeoTIFF,Zarr,WebP,PMTiles,JPEGXL,AV1,WARC linkNode
click DataPkgs "https://github.com/dataforcanada/d4c-pkgs" _blank
click Foundation "https://github.com/dataforcanada/d4c-datapkg-foundation" _blank
click Statistical "https://github.com/dataforcanada/d4c-datapkg-statistical" _blank
click Orthoimagery "https://github.com/dataforcanada/d4c-datapkg-orthoimagery" _blank
click FieldImagery "https://github.com/dataforcanada/d4c-datapkg-field-imagery" _blank
click EnvClimate "https://github.com/dataforcanada/d4c-datapkg-environment-climate-health" _blank
click Elevation "https://github.com/dataforcanada/d4c-datapkg-elevation" _blank
click FlatCityBuf "https://github.com/cityjson/flatcitybuf" _blank
click WebCorpus "https://github.com/dataforcanada/d4c-datapkg-web-corpus" _blank
click Parquet "https://github.com/apache/parquet-format/" _blank
click FlatGeoBuf "https://flatgeobuf.org/" _blank
click SQLite "https://www.geopackage.org/" _blank
click FileGDB "https://gdal.org/en/stable/drivers/vector/openfilegdb.html" _blank
click VectorTiles "https://github.com/mapbox/vector-tile-spec/" _blank
click NextGenVT "https://github.com/maplibre/maplibre-tile-spec/" _blank
click GLB "https://registry.khronos.org/glTF/specs/2.0/glTF-2.0.html#glb-file-format-specification"
click GeoTIFF "https://cogeo.org/" _blank
click Zarr "https://github.com/zarr-developers/geozarr-spec/" _blank
click WebP "https://developers.google.com/speed/webp/" _blank
click PMTiles "https://github.com/protomaps/PMTiles/blob/main/spec/v3/spec.md" _blank
click JPEGXL "https://jpeg.org/jpegxl/" _blank
click AV1 "https://aomedia.org/specifications/av1/" _blank
%%click WARC "https://github.com/iipc/warc-specifications/" _blank
click FAIRCat "https://stac-utils.github.io/stac-geoparquet/latest/spec/stac-geoparquet-spec/" _blank
click HTTP "https://www.dataforcanada.org/docs/" _blank
click DecenDist "https://www.dataforcanada.org/docs/d4c-infra-distribution/" _blank
click Metadata "https://stac-utils.github.io/stac-geoparquet/latest/spec/stac-geoparquet-spec/" _blank
Reference in New Issue View Git Blame Copy Permalink