I have tried to plug it into my mac and doing a manual sync, but still it didn't work.
First, can you see the contacts in itunes on your mac? Verify that they are there first.
Read this for help if you haven't already:
Retrieving data ...