mirror of
https://github.com/dataforcanada/d4c-community.git
synced 2026-11-22 04:21:34 +01:00
240 lines
5.6 KiB
Markdown
240 lines
5.6 KiB
Markdown
---
|
|
theme: seriph
|
|
layout: cover
|
|
title: Data for Canada - Orthoimagery
|
|
author: Diego Ripley
|
|
class: text-center
|
|
drawings:
|
|
persist: false
|
|
transition: slide-left
|
|
comark: true
|
|
hideInToc: true
|
|
favicon: 'https://www.dataforcanada.org/favicon.svg'
|
|
routerMode: hash
|
|
---
|
|
|
|
<v-switch>
|
|
<template #0>
|
|
|
|
# Data for Canada Orthoimagery
|
|
Finding, freeing, describing and keeping 145 TB of open orthoimagery
|
|
|
|
<img src="/dataforcanada-logo.svg" class="w-50 h-auto mx-auto" />
|
|
|
|
October 14, 2026
|
|
|
|
</template>
|
|
<template #1>
|
|
|
|
<SlidevVideo autoplay controls class="max-h-100 mx-auto">
|
|
<!-- Anything that can go in an HTML video element. -->
|
|
<source src="/intro.mp4" type="video/mp4" />
|
|
</SlidevVideo>
|
|
|
|
</template>
|
|
</v-switch>
|
|
|
|
---
|
|
layout: full
|
|
transition: slide-up
|
|
---
|
|
|
|
# Data Portals
|
|
|
|
<a href="https://directory.opendatasociety.ca/directory">
|
|
<img src="/opendatasociety-opendatadirectory.webp" class="w-180 h-auto mx-auto" />
|
|
</a>
|
|
|
|
---
|
|
layout: full
|
|
transition: slide-up
|
|
---
|
|
|
|
# Datasets
|
|
|
|
<a href="https://docs.google.com/spreadsheets/d/1rAZyVt7AByn0sEhIbX9N0wh5TEUXbvOL6g1btq6mVZg/edit?usp=sharing">
|
|
<img src="/d4c-datapkg-orthoimagery-datasets.webp" class="w-300 h-auto mx-auto" />
|
|
</a>
|
|
|
|
<!--
|
|
- I have seen Dropbox, Google Drive, Sync URLs used
|
|
-->
|
|
|
|
---
|
|
layout: full
|
|
transition: slide-up
|
|
---
|
|
|
|
# Servers
|
|
WMS, WMTS, ESRI.
|
|
|
|
<a href="https://docs.google.com/spreadsheets/d/1rAZyVt7AByn0sEhIbX9N0wh5TEUXbvOL6g1btq6mVZg/edit?usp=sharing">
|
|
<img src="/d4c-datapkg-orthoimagery-servers.webp" class="w-200" />
|
|
</a>
|
|
|
|
|
|
---
|
|
layout: center
|
|
---
|
|
|
|
| Province | Data sources | Datasets | Storage |
|
|
|------------------|--------------|----------|----------|
|
|
| Quebec | 1 | 1 | 117.0 TB |
|
|
| New Brunswick | 1 | 12 | 13.1 TB |
|
|
| Ontario | 8 | 63 | 6.0 TB |
|
|
| Alberta | 7 | 75 | 3.9 TB |
|
|
| British Columbia | 10 | 58 | 3.6 TB |
|
|
| Manitoba | 1 | 9 | 891.2 GB |
|
|
| Yukon | 1 | 1 | 703.5 GB |
|
|
| Total | 29 | 219 | 145.4 TB |
|
|
|
|
---
|
|
layout: center
|
|
---
|
|
|
|
# Processing Pipeline
|
|
|
|
```mermaid {scale: 0.5}
|
|
flowchart TD
|
|
Source["Source Imagery"]
|
|
COG["Cloud Optimized GeoTIFF"]
|
|
Tiles["PMTiles"]
|
|
STAC["STAC Metadata"]
|
|
STACGeoparquet["STAC GeoParquet"]
|
|
Mirrors
|
|
|
|
Source --> COG
|
|
COG --> Tiles
|
|
COG --> STAC
|
|
Tiles --> STAC
|
|
STAC --> STACGeoparquet
|
|
STACGeoparquet --> Mirrors
|
|
|
|
click COG "https://cogeo.org/" _blank
|
|
click Tiles "https://github.com/protomaps/PMTiles/blob/main/spec/v3/spec.md" _blank
|
|
click STAC "https://stacspec.org/" _blank
|
|
click STACGeoparquet "https://radiantearth.github.io/stac-geoparquet-spec/latest/" _blank
|
|
```
|
|
|
|
<!--
|
|
- COG is the long-term storage format; PMTiles is for viewing in a browser without a tile server.
|
|
- Largest package so far: Eastern Ontario 2024 at 16 cm, made from a ~5 TB source dataset.
|
|
-->
|
|
|
|
---
|
|
layout: center
|
|
---
|
|
|
|
# PMTiles
|
|
|
|
[Demo](https://source.coop/dataforcanada/d4c-datapkg-orthoimagery/processed/ca-on_province_of_ontario-2024A000235_drape_eastern_ontario_orthoimagery_d4c-datapkg-orthoimagery_2024_16cm_v0.1.0-beta.2.pmtiles)
|
|
|
|
---
|
|
layout: center
|
|
transition: slide-up
|
|
---
|
|
|
|
# COG
|
|
|
|
[Demo](https://data.source.coop/dataforcanada/d4c-community/presentations/presentation-02/cog_example/index.html)
|
|
|
|
<!--
|
|
- There's a bug where the image may dissapear when you zoom in. That's nothing wrong with the data.
|
|
-->
|
|
|
|
---
|
|
layout: full
|
|
transition: slide-up
|
|
---
|
|
|
|
# 3 Band RGB
|
|
|
|
```bash
|
|
gdal_translate vancouver_2022.sid vancouver_2022.tif \
|
|
-of COG \
|
|
-co COMPRESS=WEBP \
|
|
-co QUALITY=100 \
|
|
-co BLOCKSIZE=512 \
|
|
-co OVERVIEW_RESAMPLING=CUBIC \
|
|
-co NUM_THREADS=ALL_CPUS \
|
|
-co STATISTICS=YES \
|
|
-co BIGTIFF=IF_SAFER
|
|
```
|
|
<!--
|
|
- Knowing these two commands will already put you ahead of 99% of all orthoimagery data providers in Canada
|
|
- This command gives you the best compression, which is similar to MrSID
|
|
-->
|
|
|
|
---
|
|
layout: full
|
|
---
|
|
|
|
# 4 Bands or More
|
|
|
|
```bash
|
|
gdal_translate kitchener_2021.sid kitchener_2021.tif \
|
|
-of COG \
|
|
-co COMPRESS=ZSTD -co LEVEL=22 -co PREDICTOR=YES \
|
|
-co BLOCKSIZE=512 \
|
|
-co OVERVIEW_RESAMPLING=CUBIC \
|
|
-co NUM_THREADS=ALL_CPUS \
|
|
-co STATISTICS=YES \
|
|
-co BIGTIFF=IF_SAFER
|
|
|
|
```
|
|
|
|
---
|
|
layout: full
|
|
transition: slide-up
|
|
---
|
|
|
|
# STAC Metadata
|
|
|
|
<a href="https://data.source.coop/dataforcanada/d4c-datapkg-orthoimagery/archive/ca-qc_government_and_municipalities_of_quebec-2026A000224_d4c-datapkg-orthoimagery_orthorectified_imagery_from_quebec/items.parquet">
|
|
<img src="/stac-metadata.webp" class="w-110 h-auto mx-auto" />
|
|
</a>
|
|
|
|
---
|
|
layout: full
|
|
transition: slide-up
|
|
---
|
|
|
|
# DuckDB Query
|
|
Records that intersect Montreal, QC
|
|
|
|
```sql
|
|
COPY (
|
|
SELECT * FROM read_parquet('https://data.source.coop/dataforcanada/d4c-datapkg-orthoimagery/archive/ca-qc_government_and_municipalities_of_quebec-2026A000224_d4c-datapkg-orthoimagery_orthorectified_imagery_from_quebec/items.parquet')
|
|
WHERE bbox.xmin <= -73.4766 AND bbox.xmax >= -73.9742
|
|
AND bbox.ymin <= 45.7048 AND bbox.ymax >= 45.4100
|
|
) TO 'montreal_items.parquet' (FORMAT parquet);
|
|
|
|
```
|
|
|
|
---
|
|
layout: center
|
|
transition: slide-up
|
|
---
|
|
|
|
<img src="/stac-montreal.webp" class="w-180 h-auto mx-auto" />
|
|
|
|
---
|
|
layout: center
|
|
---
|
|
|
|
<img src="/stac-montreal-table.webp" class="w-300 h-auto mx-auto" />
|
|
|
|
|
|
---
|
|
layout: center
|
|
class: text-center
|
|
---
|
|
|
|
# Get Involved
|
|
|
|
- [d4c-datapkg-orthoimagery on GitHub](https://github.com/dataforcanada/d4c-datapkg-orthoimagery)
|
|
- Download from [Source Cooperative](https://source.coop/dataforcanada/d4c-datapkg-orthoimagery)
|
|
- diegoripley@dataforcanada.org
|
|
|
|
<img src="/dataforcanada-logo.svg" class="w-40 h-auto mx-auto mt-8" />
|