I think I fixed graphics issue.
(My case was green and purple tiny square dot, freeze, slowness and cannot find correct resolution for second display)
My imac is mid 2010 27" core i7 iMac with ATI Radeon HD 5750 with 1 GB of GDDR5 SDRAM model.
Here is what I did.
Since my graphics card is AMD 5xxx series I renamed /System/Library/Extensions/AMD5000Controller.kext to some other name.
(like AMD5000Controller.kext.org)
for 2011 imac driver will be AMD6000Controller.kext
Then I copied same driver from Maverick backup.
reboot imac. wait for system to boot up.
However, I have got system error. and my imac went into infinite loop of boot up system.
so that basically my mac is no longer boot up (sound pretty bad isn't it? but don't worry)
after watching retrying boot process (I don't know if its necessary) then press the power button to shutdown.
now trying to boot mac with safe mode.(regular safe mode boot procedure)
In order to do so I connected usb keyboard. (wireless keyboard didn't work)
press the power button, immediately after you hear the startup sound, press and hold the shift key.
Release the shift key when you see Apple logo.
Then after system come up log on to your account, navigate you to /System/Library/Extensions folder.
remove bad AMD5000Controller.kext then put backed up driver to AMD5000Controller.kext
(This case I backed up original one as AMD5000Controller.kext.org)
Then reboot one more time, system boot up correctly and problem is gone.
now no more noisy pattern, no slowness, second display works as it should be.
I've been testing my mac over 6hrs now with video playback, photo edit, video encoding.(many many CPU/GPU intense task)
but all working fine now.
I convinced Yosemite's graphics driver itself is good. The problem is some broken or incompatible preference/config/setting file for graphics card is left on the system drive somewhere during migration.
This procedure may remove or reset such files.
I hope this will help you.
PS
if you do not have Maverick copy of AMD?000Controller.kext, try just copy bogus driver as AMD?000Controller.kext or may be
simply rename original driver to something else (with different extension other than kext) and restart may work.
(of course you need to fail boot up once and go into safe mode to fix it)