Are you asking about a "new" Time Capsule?
If yes, that device needs AirPort Utility 6.3.1 or higher on a Mac......or......AirPort Utility for iOS on an iPhone or iPad to set up and administer the Time Capsule.
Once the Time Capsule has been set up to provide a wireless network, a PC should be able to connect to the wireless network.
Unfortunately, if you do have a 'new" Time Capsule, you should not use AirPort Utility for Windows to set up and administer the Time Capsule, since that is not officially supported. Plus, Apple has not updated the PC version of AirPort Utility since Windows 7.