how do I change the password for my router settings

That would depend on the make / model of your router. The manual/user’s guide should explain that.

You sign into your routers administrator account, and follow that specific router model's user guide for changing the password.

many routers has a webserver one configure them on

apples routers had an util called airport util to handle it

sure other manufacturers have their special ways too

If you have an Apple AirPort Extreme, then Applications-> Utilities-> Airport Utility