Moving/Zipping/Deleting xcodeproj files takes too long

Hi everyone, I experienced something that I think caused by GitHub and iCloud but I do not know how to solve it. In my Desktop (which is also in iCloud Drive), I have cloned a repo from GitHub to a directory called Cs163_Dictionary (I'll call it A). However, every time I try to add/remove a file or folder in A in Finder, it always seems to take forever with the line "estimating adding/removing time" (roughly translated because I use Vietnamese language). And then when I click the X button, it says "Is stopping" and never really stops.

I also find that with every folder containing xcode file in my Desktop, it also takes too long to zip/remove/add or move it to my Downloads directory, which isn't in iCloud Drive. And this morning, when I created an xcode proj in A, it took very long and never finished. Since then, I could not open any xcode proj anymore. Every time I try opening a project, it just hangs there with a spinning wheel forever.

I tried to disable iCloud Drive and reinstall xcode but it did not help. I tried creating a new project in a directory outside iCloud Drive (Downloads) and I can opened it.

I do not understand why this happened and how to solve this. Thank you so much for reading this. If you have any suggestions, please let me know. This problem really causes many troubles while working on my tasks.