I don't have a software update option

System Preferences> Software Update did not appear on the mac until macOS Mojave (10.14)

was released.

As you are posting in the High Sierra community I am assuming you are running High Sierra

updates are handled through the App Store Updates page.

If you are referring to moving to a newer OS then that is called an upgrade.

For OS's Mojave or Catalina open your Safari browser and click on the link below,

How to get old versions of macOS – Apple Support

Go to Check Compatibility to see if your mac qualifies for the OS upgrade you want.

Then go to the Download OS section and click on the OS you want to install.

If you want to install Big Sur, open Safari and click on the link below.

How to upgrade to macOS Big Sur - Apple Support

Before upgrading make a full back up of your Mac.

Check that third party apps you use have updates available for the new OS.

https://roaringapps.com

Check that your printers/ scanners etc have updated drivers and software available for the new OS.

Connect your mac to your router via cable rather than rely on WiFi.

Do not use your mac while it is downloading

and do not use any other devices that share the same internet connection.

If the App Store says ‘Open’ then it is detecting a previous download of the install app

go to the Applications folder locate Install macOS ******.app.

Move it to the Trash, empty the Trash.

Restart, click on the link again, the App Store should say ‘Get' or 'Download'.

If you are considering upgrading to Catalina or Big Sur be warned they do not support 32bit apps.

Your Mac is probably running 32bit apps and these will need to be updated to 64bit apps,

some updates may be free, some may be paid. Use this app to discover which apps you have

are 32bit, https://www.stclairsoft.com/Go64/ then contact the developers of the software to see

if they are providing 64bit updates or alternatives.