Welcome to Apple Support Communities
Are you using a Bluetooth keyboard? If so, are you using the Apple Wireless Keyboard? If not, get a wired keyboard. Some Bluetooth keyboards don't work during start.
Another way of starting into OS X is by holding the X key while your Mac is starting. If it doesn't work, probably you removed OS X