Tried this with a second iTunes library on my main computer. I deleted everything off my iCloud library and waited for it to update.
But when I went back to my original library and turned iCloud library on again, most of the old stuff appeared again! I did verify my iCloud library was empty before. There seem to have been some cached files left, I guess?