If you don't have keyboard clicks, you probably do have system sounds muted, but you are saying that the speaker icon does not have a line through it. You do see a speaker icon in the task bar that Diavonex referred to correct? If you see a circle with an arrow at the end of the circle, that is the screen orientation lock and not the mute icon.
I post this quite often to explain how system sounds and the rotation lock can work for you.
If you lose sounds for keyboard clicks, games or other apps, email notifications and other notifications, system sounds may have been muted.
System sounds can be muted and controlled two different ways. The screen lock rotation can be controlled in the same manner as well.
Settings>General>Use Side Switch to: Mute System sounds. If this option is selected, the switch on the side of the iPad above the volume rocker will mute system sounds.
If you choose Lock Screen Rotation, then the switch locks the screen. If the screen is locked, you will see a lock icon in the upper right corner next to the battery indicator gauge.
If you have the side switch set to lock screen rotation then the system sound control is in the task bar. Double tap the home button and in the task bar at the bottom, swipe all the way to the right. The speaker icon is all the way to the left. Tap on it and system sounds will return.
If you have the side switch set to mute system sounds, then the screen lock rotation can be accessed via the task bar in the same manner as described above.
This support article from Apple explains how the side switch works.
http://support.apple.com/kb/HT4085