You can try opening the PDF with Preview. File -> Export then click the Quartz Filter drop down list and
select 'Reduce File Size' and save the new PDF. Image quality is likely to be reduced but if you are happy with the results, then you now have a workaround.
***You possibly have these options available when initially saving the scan to a PDF.
The people sending you smaller PDF's are unlikely to be scanning content to create a PDF. They generate those PDF's based on source digital documents. When you scan to PDF each page is a full page image which takes up considerably more space.
PDFs are written in PostScript, which is plain text code that instructs printers how to precisely render the document. Adobe invented PostScript and a PDF is really just a compressed PostScript file with a bunch of additional features including security options. Mac's use a technology called DisplayPDF to render the screen. This is why macOS can create PDF's so easily without 3rd party software.
Since PostScript is mostly text (w/potential images) it will compress much more than a PDF comprised of page after page entirely filled with a large image from the scanner.
You may see better compression with 3rd party tools such as Adobe Acrobat, etc. Depending on the source of the scans, you might make use of OCR (Optical Character Recognition) software. If you are scanning mostly text, OCR allows you to extract just the text which you can page layout and format then save as a PDF. You could alternatively create eBooks as well.