7 Commits

Author	SHA1	Message	Date
Diego Ripley	5a95616b3c	Calculate CSV file size by viewing inside of zip file	2025-06-20 16:01:20 -04:00
Diego Ripley	e836363cd1	Had to optimize the code. Leaving it outside of function for now in case I need to continue working on it	2025-06-20 16:00:51 -04:00
Diego Ripley	f6d88c5fd0	Continue work on processing data tables	2025-06-19 15:58:30 -04:00
Diego Ripley	ab8f40c708	Keeping track of processed files in case processing crashes and I have to restart again	2025-06-19 11:46:31 -04:00
Diego Ripley	faa63451ab	Experiment with Jupyter notebook on downloading and processing statcan cubes	2025-06-18 21:26:51 +00:00
Diego Ripley	c0899080f4	Remove scratch files after processing. Was running out of space	2025-06-18 09:26:18 -04:00
Diego Ripley	ea603f2914	Convert statcan CSV into parquet	2025-06-17 20:46:24 +00:00