Sorry, I have posteed my solution for this problem in the wrong thread earlier. Here is what has solved the problem with the jerky mouse behaviour:
1) The problem is software, not hardware. I can reproduce that the jerky mouse behaviour is gone when the system is 10.5.5 - and it is there when I install 10.5.6.
2) The problem does show up on the brand new iMac9,1, Boot-ROM-Version: IM91.008D.B00; SMC Version: 1.37f3, too!
I have solved the problem on my MacBook 15" unibody AND on my iMac9,1 by installing system 10.5.5 (came along with the MacBook) and applying the patch "MacBookMacBookProSU1.2.dmg". I zapped the PRAM and connected the 30" Dell. Problems gone.
If you are googling for the installer "MacBookMacBookProSU1.2.dmg" you have to follow some threads of the forums which Apple probably does not want me to mention here. The installer is still out there and it is worth to search for - thats all what I can tell you about.
I still cannot believe that the solution to this problem make me bound to system 10.5.5 which does not allow installation of latest security patches.
Apple - this is a shame!
Edit: The file still can be found, hosted by Apple:
http://tinyurl.com/btk6lb
Added link.