You'll probably need to format the new hdd and install the OS.
It sounds like you have the install discs that the computer shipped with, so the next step will be to boot the Mac with the first of those discs, probably marked as such.
The boot process, I believe is to insert Disc 1 into the drive slot or tray and press and hold the "C" key while you power up the Mac. The computer should boot up to the installer. If you follow the on screen prompts, you may be prompted to format the drive and after that to install the OS.
If you google "Restore iMac G4" you'll find several guides on YouTube that you may find helpful.
I think you may have done yourself a disservice when buying that iMac. If your hopes are to use it day to day and you aren't especially tech savvy, then you're going to find this to be quite a challenge. The Mac is vintage vintage and the OS that it can run is beyond outdated. There really is no good path for an inexperienced user with the machine, and barely so with a user who knows their stuff. The world and the web have moved well beyond the capabilities of a machine released twenty years ago or more.
I hope this is only a hobby computer for you.