mirror of
https://github.com/dataforcanada/d4c-community.git
synced 2026-06-13 14:10:52 +02:00
5.9 KiB
5.9 KiB
theme, layout, title, author, class, drawings, transition, comark, hideInToc, favicon, routerMode
| theme | layout | title | author | class | drawings | transition | comark | hideInToc | favicon | routerMode | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| seriph | cover | Data for Canada / the Universe Background and Strategy | Diego Ripley | text-center |
|
slide-up | true | true | https://www.dataforcanada.org/favicon.svg | hash |
Data for Canada / the Universe
Background and Strategy
Presented By: Diego Ripley
Date: April 10, 2026
layout: cover hideInToc: true
"Space is big. You just won't believe how vastly, hugely, mind-bogglingly big it is. I mean, you may think it's a long way down the road to the chemist's, but that's just peanuts to space."
Douglas Adams, Hitchicker's Guide to the Galaxy, #1
<style> .slidev-layout.cover { background-image: url('/dont-panic-background-01.webp') !important; background-size: cover !important; background-position: center !important; } p { text-shadow: 1px 1px 4px rgba(0,0,0,0.9); } </style>hideInToc: true level: 4
flowchart TD
Client(["🌐 S3 Client / User"])
Gateway["<b>s3.dataforcanada.org</b>\nS3-Compatible Gateway"]
Client -->|"S3 API Request"| Gateway
Gateway -->|"sourcecooperative bucket"| AWS
Gateway -->|"backblaze-ca-east-006 bucket"| BB
Gateway -->|"cloudflare-apac bucket"| CFAPAC
Gateway -->|"cloudflare-enam bucket"| CFENAM
Gateway -->|"tigris bucket"| TIGRIS
subgraph AWS ["☁️ Amazon Web Services"]
AWSNode["📍 Oregon, United States"]
end
subgraph BB ["🔵 Backblaze B2"]
BBNode["📍 Toronto, ON, Canada"]
end
subgraph CFAPAC ["🟠 Cloudflare R2"]
CFAPACNode["📍 Asia Pacific Region"]
end
subgraph CFENAM ["🟠 Cloudflare R2"]
CFENAMNode["📍 Eastern North America"]
end
subgraph TIGRIS ["⚡ Tigris Data"]
TIGRISNode["11 Regions Worldwide 🌍\nAuto-routes to nearest location\nfor lowest latency"]
end
style Gateway fill:#1a5f7a,color:#fff,stroke:#0d3d52
style Client fill:#2d6a4f,color:#fff,stroke:#1b4332
style AWSNode fill:#ff9900,color:#000,stroke:#cc7a00
style BBNode fill:#e03c31,color:#fff,stroke:#b02d24
style CFAPACNode fill:#f6821f,color:#fff,stroke:#c4681a
style CFENAMNode fill:#f6821f,color:#fff,stroke:#c4681a
style TIGRISNode fill:#6c3483,color:#fff,stroke:#512e6b
<?xml version="1.0" encoding="UTF-8"?>
<ListAllMyBucketsResult>
<Owner>
<ID>multistore-proxy</ID>
<DisplayName>multistore-proxy</DisplayName>
</Owner>
<Buckets>
<Bucket>
<Name>backblaze-ca-east-006</Name>
</Bucket>
<Bucket>
<Name>cloudflare-apac</Name>
</Bucket>
<Bucket>
<Name>cloudflare-enam</Name>
</Bucket>
<Bucket>
<Name>sourcecooperative</Name>
</Bucket>
<Bucket>
<Name>tigris</Name>
</Bucket>
</Buckets>
</ListAllMyBucketsResult>
rclone --progress size d4c:backblaze-ca-east-006/
Total objects: 92.705k (92705)
Total size: 3.702 TiB (4070336275406 Byte)
Transferred: 0 B / 0 B, -, 0 B/s, ETA -
Checks: 0 / 0, -, Listed 92705
Elapsed time: 29.7s
rclone --progress size d4c:cloudflare-apac/
Total objects: 13.183k (13183)
Total size: 99.782 GiB (107140636461 Byte)
Transferred: 0 B / 0 B, -, 0 B/s, ETA -
Checks: 0 / 0, -, Listed 13183
Elapsed time: 13.9s
rclone --progress size d4c:cloudflare-enam/
Total objects: 932
Total size: 98.404 GiB (105660400478 Byte)
Transferred: 0 B / 0 B, -, 0 B/s, ETA -
Checks: 0 / 0, -, Listed 932
Elapsed time: 0.3s
rclone --progress size d4c:tigris/
Total objects: 14.371k (14371)
Total size: 11.583 GiB (12437413070 Byte)
Transferred: 0 B / 0 B, -, 0 B/s, ETA -
Checks: 0 / 0, -, Listed 14371
Elapsed time: 8.4s
But this one is 11.583 GiB * 11 locations.
aws s3 ls s3://us-west-2.opendata.source.coop/dataforcanada/ --summarize --recursive --human-readable
Total Objects: 165979
Total Size: 14.8 TiB
layout: iframe-unscaled hideInToc: true level: 4 url: https://objex.labs.dataforcanada.org/
IPFS & AT Protocol
BitTorrent
- Cheap infrastructure
- High bandwidth
- Academic Torrents
Example
University student is writing a presentation on X topic. They can share their specification that links to the appropriate data sources.