Census vs CPS population

Can I drop people from the IPUMS population data to make it comparable to the CPS population? I have dropped out prisoners, is there any other difference between the two?

The same question applies for getting comparable estimates of total households between the two surveys. Thanks.

You should exclude institutional group quarters and military group quarters in IPUMS-USA (GQTYPE=1, 2, 3, 4, or 6) to achieve a comparable sampling frame with IPUMS-CPS.

Hope this helps.