If I hotspot my android phone to get an internet connection on my firestick, while my phone is connected to Windscribe, is my firestick also safely connected to the VPN?

Sorry if this is a dumb question

No, you need to install Windscribe on the Fire Stick.

Android doesn’t allow hotspot traffic to go through the VPN connection.

you can share vpn with something like pdanet for adnroid

Is this also true for iPhone?

Yes, both iOS and Android behave in that manner.