If not used for a couple of years it is quite possible the PRAM battery is dead. PRAM stores basic startup information (including monitor information) and a bad battery can actually prevent a computer from starting.
Decide what you want to do. If you just want to recover data there are options for that. If you want to get it up and running again you can start with replacing the PRAM battery.
Texas Mac Man's PRAM, battery, PMU tutorial - https://sites.google.com/site/macpram/mac-pram-nvram-cuda-pmu-battery-tutorial
Apple's PRAM reset directions - http://docs.info.apple.com/article.html?artnum=2238
If you have a digital multimeter you can check the condition of your present battery. It should read at least 3.2V if it is the 3.6V half-AA battery type. A new battery provides 3.67 Volts DC. A bad battery provides under 3.2 Volts DC. Ideally this should be measured while the battery is under load; added recommendation from Hans777:
>I have recently found out that an exhausted battery will still indicate >3.6 V with a high internal resistance VM.
>
>Checking incircuit: powercord disconnected press PMU reset button for >about 5 sec before measuring.
>
>Checking outside: load the battery with a 1500 Ohm resistor when measuring.
Alternatively, test the battery while it is still in the computer.
If the battery is more than 5 years old, especially if you totally disconnect the computer from the power regularly, or have left it unplugged for several months at one time, it is likely the battery is dead.
If you just want to recover data you can try using the G4 in target disk mode:
How to use FireWire target disk mode - http://support.apple.com/kb/HT1661 - includes description of hardware and software requirements.
Target Disk Mode - Mac OS X 10.6 Help: Transferring files between two computers using FireWire - http://docs.info.apple.com/article.html?path=Mac/10.6/en/8443.html
[What to do if your Mac doesn't enter FireWire Target Disk Mode|http://docs.info.apple.com/article.html?artnum=75414], also read about [Open Firmware Password Protection|http://www.apple.com/support/downloads/openfirmwarepassword.html] which can disable Target Disk Mode.
If that doesn't work and you really don't care about the computer you can take out the drive and put it in an enclosure and use it as an external drive, or get something like this which lets you temporarily connect a drive:
"Newer Technology Universal 5.25/3.5/2.5" Hard Drive & Optical Drive to USB2 Adapter w/Power. Everything you need to Plug and Play any SATA/ATA/IDE/ATAPI Drive via USB 2.0/1.1 port. Fast, Simple, Plug & Play. GREAT for transferring data, etc. (NWTU2NV2SPATA)" - http://eshop.macsales.com/item/Newer%20Technology/U2NV2SPATA/