I am embarking on a project to build a system specifically designed to handle the entirety of the IPUMS databases. This includes IPUMS-USA (ACS and decennial Census data), IPUMS CPS, IPUMS International, and any other datasets that are part of the IPUMS collection.
My goal is to download all available years of data for each IPUMS dataset, including all available variables. I understand that this will result in a massive amount of data, and I am trying to estimate the storage requirements to accommodate this.
Could you please provide an estimate of the total file size for all years of uncompressed IPUMS data, with all variables included, across all the different IPUMS datasets? Additionally, do you have any recommendations for additional storage that might be required for data processing and analysis?
I appreciate your assistance and look forward to your guidance.