These are two different devices?
You have a yellow light on both of them?
However, yes, you can reset either one of them.
A yellow light could mean there is just an update for each one of them.
But if yours isn't working there is another problem.
See this Apple doc about the blinking yellow light: