Follow Lennart's advice, but add one small step which will eliminate a pan, if there is one. (It sounds like there is one, which shows a border.)
After turning on the Ken Burns checkbox, click on the Start end of the Start/End thingy, pause for a moment, then
drag the zoom slider a bit to the right, then drag it all the way to the left. Repeat for the End side of the Start/End thingy.
Now Ken Burns has been returned to its default settings with no pan and no zoom. Now the image won't get cropped.