Apple kind of skirts around the topic in its support articles. While one of Apple's support articles talks about "managing" a Family Sharing group on an Android, it isn't clear that this extends beyond Apple Music.
Use Family Sharing with Apple Music on Android - Apple Support
"How to start and manage your own family group
When you get an Apple Music family subscription, you can start and manage a family group to share your subscription."
It is theoretically possible to get access to AppleTV on Windows and Android with Family Sharing. The standard thought on the forum is that sharing would have to be set up on an Apple device but once a person has access to a subscription then Apple says that you can play Apple TV on Windows and Android by using a web browser.
How to watch Apple TV+, MLS Season Pass, and more - --> How to watch Apple TV+, MLS Season Pass, and more - Apple Support
Family Sharing on Apple TV --> Use Family Sharing on Apple TV - Apple Support
"You can’t initiate or configure Family Sharing directly on Apple TV. It must be done on a Mac, an iOS device, or an iPadOS device. To learn more about setting up Family Sharing, see the Apple Support article Set up Family Sharing."