Without the specific PDFs to merge in order, its anyone's guess what is going on with Preview. There are PDFs whose content Preview simply cannot handle properly and that may be the simple answer. Without a true PDF editor ($), you can't merge PDFs on Monterey 12.3.1 and later because Apple removed the Python 2.7.18 distribution and that broke the Python code in Automator's Combine PDF action. But you can still combine PDFs…
Copy and paste the following AppleScript into Script Editor, click the compile (hammer) button, and then run it. It will prompt you for multple PDFs that you choose using the ⌘+key to add them in order. They will be combined into merged.pdf on your Desktop. If this works to merge those same PDFs, then you won't need to waste more time with Preview.
(*
merge_pdf.applescript
Prompt user for PDF filenames to merge using the ⌘-key for multiple selection.
PDF will be merged in the order of their selection and written to an arbitrary
PDF filename on the Desktop (in this example, merged.pdf)
Reference: https://discussions.apple.com/thread/253764288
Tested: macOS 11.6.8, 12.5.1
Updated from 2021-06-24 version
VikingOSX, 2022-05-31, Apple Support Communities, No warranty/support implied.
*)
use AppleScript version "2.4" -- Yosemite (10.10) or later
use framework "Foundation"
use framework "PDFKit"
use scripting additions
property NSString : a reference to current application's NSString
property NSArray : a reference to current application's NSArray
property NSURL : a reference to current application's NSURL
property PDFDocument : a reference to current application's PDFDocument
property merged_pdf_name : "~/Desktop/merged.pdf"
set PDFUrl to NSArray's array()'s mutableCopy()
set PDFRest to NSArray's array()
# change to absolute path
set mergedPDF to (NSString's stringWithString:merged_pdf_name)'s stringByStandardizingPath()
set msg to "Select multiple PDF using the ⌘-key in the order of your merge preference."
set pdfList to (choose file with prompt msg of type {"com.adobe.pdf"} default location (path to desktop) with multiple selections allowed)
# guard
if (count of pdfList) is 1 then return
# Change HFS paths to NSURL paths in list
repeat with afile in pdfList
(PDFUrl's addObject:(NSURL's fileURLWithPath:(POSIX path of afile)))
end repeat
# Objective-C arrays are zero based, so get first PDF selection as base for merge
set outpdf to PDFDocument's alloc()'s initWithURL:(PDFUrl's objectAtIndex:0)
set PDFRest to PDFUrl's subarrayWithRange:(current application's NSMakeRange(1, (PDFUrl's |count|()) - 1))
repeat with pdfdoc in PDFRest
set thisPDF to (PDFDocument's alloc()'s initWithURL:pdfdoc)
repeat with n from 0 to (thisPDF's pageCount())
(outpdf's insertPage:(thisPDF's pageAtIndex:n) atIndex:(outpdf's pageCount()))
end repeat
end repeat
outpdf's writeToFile:mergedPDF
return