 Diego Ripley
|
4ed5fb4bbb
|
Add DuckDB example for duplicate column name
|
2025-06-25 15:38:12 +00:00 |
|
|
Diego Ripley
|
b71a7b326e
|
DuckDB issue with duplicate column names (ex. 'Value' and 'VALUE' are treated the same)
|
2025-06-25 15:30:36 +00:00 |
|
|
Diego Ripley
|
e929850d4a
|
Finish comment on issue with Value and VALUE columns being treated the same by DuckDB
|
2025-06-21 18:03:29 +00:00 |
|
|
Diego Ripley
|
8875722d10
|
Made changes to processing of data tables
|
2025-06-21 18:01:16 +00:00 |
|
|
Diego Ripley
|
7c8211cb5f
|
Found some issues with the output parquet files
|
2025-06-21 05:26:50 +00:00 |
|
|
Diego Ripley
|
887291d2f7
|
Read all DGUIDs from subset parquet output (100,000 records each)
|
2025-06-21 00:54:26 -04:00 |
|
|
Diego Ripley
|
72ca6c87e1
|
Made changes
|
2025-06-20 17:32:01 -04:00 |
|
|
Diego Ripley
|
5a95616b3c
|
Calculate CSV file size by viewing inside of zip file
|
2025-06-20 16:01:20 -04:00 |
|
|
Diego Ripley
|
e836363cd1
|
Had to optimize the code. Leaving it outside of function for now in case I need to continue working on it
|
2025-06-20 16:00:51 -04:00 |
|
|
Diego Ripley
|
f6d88c5fd0
|
Continue work on processing data tables
|
2025-06-19 15:58:30 -04:00 |
|
|
Diego Ripley
|
ab8f40c708
|
Keeping track of processed files in case processing crashes and I have to restart again
|
2025-06-19 11:46:31 -04:00 |
|
|
Diego Ripley
|
faa63451ab
|
Experiment with Jupyter notebook on downloading and processing statcan cubes
|
2025-06-18 21:26:51 +00:00 |
|
|
Diego Ripley
|
c0899080f4
|
Remove scratch files after processing. Was running out of space
|
2025-06-18 09:26:18 -04:00 |
|
|
Diego Ripley
|
ea603f2914
|
Convert statcan CSV into parquet
|
2025-06-17 20:46:24 +00:00 |
|
|
Diego Ripley
|
b3c5f8767f
|
Move export of 2021 geographic boundaries
|
2025-06-06 22:51:49 +00:00 |
|
|
Diego Ripley
|
ce999a3a4d
|
Remove unused code
|
2025-06-04 17:02:21 +00:00 |
|
|
Diego Ripley
|
3565b7c5a4
|
Update DuckDB lonboard example
|
2025-06-04 17:01:04 +00:00 |
|
|
Diego Ripley
|
fad884efc8
|
Create 2021 cartographic boundary files
|
2025-06-04 16:36:45 +00:00 |
|
|
Diego Ripley
|
4eae3622d2
|
Update DuckDB lonboard example
|
2025-05-30 22:30:35 +00:00 |
|
|
Diego Ripley
|
34d2c50046
|
Update DuckDB longboard example
|
2025-05-30 17:29:58 +00:00 |
|
|
Diego Ripley
|
bd7e8ee9f4
|
Should have used count_total_4 in calculation instead of count_total_1
|
2025-05-30 16:15:27 +00:00 |
|
|
Diego Ripley
|
6aedfe7c46
|
Update DuckDB example so it calculates the area of a polygon properly
|
2025-05-30 15:26:22 +00:00 |
|
|
Diego Ripley
|
b7f8506708
|
Add DuckDB and lonboard example. Still need lots of work to get it right
|
2025-05-27 15:22:10 +00:00 |
|
|
Diego Ripley
|
d4a25af7b1
|
Format DuckDB SQL code
|
2025-05-25 20:05:15 +00:00 |
|
|
Diego Ripley
|
b260d259c8
|
Add DuckDB example for selecting a Census of Population variable at the Dissemination Area level, calculating a field, and exporting the dataset into multiple formats
|
2025-05-25 19:35:30 +00:00 |
|
|
Diego Ripley
|
f93e4d0cec
|
Initial commit
|
2025-05-24 13:37:31 -04:00 |
|