I don’t think it much matters.
Try it.
Create a big page or three, fill it with Lorem ipsum text and a few images approximating your design thoughts, try it, and see.
Run some tests across the EPUB readers that you have access to, and preferably testing some of those that expect your readers to use, and see how well it works.
Try again with the other sizes.
These test pages both to check your page layout, and to check the rendering. From what I’ve met of it, EPUB rendering isn’t always as consistent across EPUB readers as any of us might want. (See links below for some tools.)
PDF will have the same issues with sizing as does fixed EPUB, with pan-and-zoom required to read the contents on small screens.
HTML goes the other way with this, with the HTML readers (browsers, and the browser users’ preferences) in control of more of the rendering and display, akin to EPUB flowing.
As mentioned above, I don’t expect an appreciable difference between viewing 8.5” x 11” or viewing 10.67” x 14.22”, particularly when viewing on a smaller display. It’s all going to need to be panned and zoomed. Or very young and very sharp eyes. But only you can tell if your fixed or flowing layouts are what you want, across your target devices.
Related pre-flight tools:
https://ebookflightdeck.com/
http://validator.idpf.org/
https://github.com/w3c/epubcheck
ps: That particular “odd” page size you’re looking at happens to be the size of a 1024 x 768 image at 72 dots per inch (dpi): 1024 / 72 dpi by 768 / 72 dpi is 14.22” x 10.67” in size. 72 dpi is an old printing and CRT and lower-resolution LCD display rendering. That page size would render nicely on an old CRT or a really low-res LCD without needing any scaling. For comparison, current typical printing runs at ~300 dpi, and variously higher, while the iMac 24” M1 has a resolution of 4480 by 2520 resolution with 218 pixels (dots) per inch. iPad Pro 12.9” is 2732 by 2048 resolution at 264 pixels (dots) per inch. This also all feeds into the image resolutions you’re embedding too, as a 72 dpi image might not look the way you want on a 264 ppi/dpi display.