This type of mixup between the @ and " keys on the keyboard is usually caused when using a UK keyboard with something that involves Windows - for example using Microsoft Remote Desktop client, running a virtualised copy of Windows, using Timbuktu Pro to remotely control a Windows computer, etc. In these cases it is caused by ignorant American software developers who assume everyone has a US keyboard layout. (Americans are notorious for being geographically challenged, they still apparently think if you leave the US you will fall off the edge of the world, this might also explain why they don't know where many foreign cities are. 😉 A clue for our friends in the colonies, Terry Pratchett's Disc World book series are works of fiction not fact.)
While nearly all Mac <--> Windows software has the above flaw there are two exceptions, VNC another remote control program was written at AT&T Labs in Cambridge, England. If it has been written in Cambridge, Massachusetts I am sure it would have had the same flaw 😠. The other one that seems not to have this flaw is using Windows via Boot Camp. Apple's Boot Camp drivers seem clever enough to know when you are using a UK keyboard or more accurately non-American keyboard on a Mac. Kudos to Apple for this, brickbats to Microsoft for initially having this bug in the original versions of Remote Desktop Client for Mac 1.x, fixing it in 2.x, and reintroducing the same bug in 7.x/8.x.
(Perhaps Americans are punishing us dirty stinking foreigners for conducting un-american activities in trying to use non-US keyboards. 😉 However surely this counts as cruel and unusual punishment.)
Check the symbol on your keyboard above the number 3, it should show the £ (UK Pound) symbol. If it instead shows the # (Hash as in duh! hashtag or as the Americans incorrectly pronounce it Pound symbol) then you have a US keyboard and need to set your keyboard layout accordingly.