If your images are 500 x 375 (if you are using 4:3 aspect ratio), that is your pixel density. The quality slider when you are saving the jpegs is for the amount of compression, which decreases the file size the lower the number, but also adds noise - like halos around text and such.
Your image size is perfect as far as the resolution. If you are using Photoshop, I love to use the "Save for web..." in the file menu. It opens up a window where you can tweak further. At the top there are tabs where I like to look at the 2-Up view to see the original vs the edited (I am using CS1, so it might be a bit different in your version).
On the left you can select the file type and amount of compression, etc. For jpegs, you can choose the compression amount from the drop down menu below the file type. I always play with it to find a balance between the smallest file size possible while retaining image fidelity. You can see the file size at the bottom of each image's window.
I also like to try .png format just to compare file sizes to the jpegs. If you want to know more about the .png format got to Wikipedia and read all about it.
Once I have found my balance, I hit the Save button and save the file to and "Edited for web" folder I created so I don't lose my originals. I've found that this feature of Photoshop is the one I am using the most lately since I manage 2 websites. I'll even use it to lower the file sizes for keynote presentations or emails - any program where file size is an issue.
Hope this helps. Good luck!