dataforcanada/d4c-datapkg-statistical
1
0
Fork 0
mirror of https://github.com/dataforcanada/d4c-datapkg-statistical.git synced 2026-06-14 14:40:55 +02:00
Code Issues Packages Projects Releases Wiki Activity

Scraping the table names from from https://www150.statcan.gc.ca/n1/en/type/data

Browse Source 
Will compare against the productIds available at  https://www150.statcan.gc.ca/t1/wds/rest/getAllCubesListLite
This commit is contained in:
Diego Ripley
2025-06-27 09:11:42 -04:00
parent b88a2272b4
commit 6ad2e2c4d6
18 changed files with 75040 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
experiments/scrape_statcan_tables/run.sh
+2
View File
@@ -0,0 +1,2 @@
# You'll need to stop the crawler after the last page, as it will just restart at page 1
scrapy crawl statcan_tables -o tables.json