Okay got it, thanks! The reason I ask is that I wanted to suggest using the IPUMS API to try to debug your issue, and luckily, IPUMS CPS is one of the projects that has API support! If you don’t mind doing a little setup, using the API will be helpful in double-checking that all your extract files are being downloaded fully and correctly, and in allowing me to reproduce your extract.
To use the API, you first need to grab and store your API key by following the instructions on the ipumsr website here. Make sure you’ve called library(ipumsr)
before calling set_ipums_api_key()
.
If that goes smoothly, you’ll next want to get the extract number of one of the extracts that is failing to load. Then you can try running this code – filling in your extract number in place of <num>
– to resubmit the extract, wait for it to process, then download and load the data into R:
library(ipumsr)
my_data <- get_extract_info("cps:<num>") |>
submit_extract() |>
wait_for_extract() |>
download_extract() |>
read_ipums_micro()
If that doesn’t work, please post the error you get back here. You can also use the API to share your extract definition with me so that I can try to reproduce your issue. To create a JSON file that you can upload to this thread on the forum, run (changing the file path as you see fit):
library(ipumsr)
get_extract_info("cps:<num>") |>
save_extract_as_json(file = "my_extract.json")
If you upload the resulting JSON file here, I can use the API to submit a matching extract and see if I run into the same issues.
One caveat is that if your extract uses the “Adjust monetary values” feature available for CPS, the API won’t be able to reproduce that extract exactly.
Let me know if you run into any issues trying to follow these steps – I might have made a mistake or not explained something clearly.
Alternatively, if you’d rather not use the API, you could just share your extract number(s) with me and our IT staff can pull up the extract definitions for me.