Thought so. Didn't want to say so before, but since you posted one domain name you pretty much gave it away anyway 😉
I just ran a few tests. Connection to your server is very fast so it's not a DNS or Router issue.
My gut feeling is that your server is running slowly because it's either under heavy load or not properly configured.
Let's start with the configuration.
mydomain = mail.qsigroup.com
This should be:
mydomain = qsigroup.com
(don't worry in case you need it, mail for mail.qsigroup.com will still be accepted)
mynetworks =
127.0.0.1/32,204.0.28.0/24,209.39.67.0/24,67.162.226.0
/24,216.85.195.0/24,64.157.108.0/24,65.44.84.0/24
Although not related to your issue, do you really need all these IP ranges?
smtpd
clientrestrictions = permit
saslauthenticated
permit_mynetworks reject
rblclient relays.ordb.org
reject
rblclient list.dsbl.org reject
rblclient
dnsbl.njabl.org reject
rblclient cbl.abuseat.org
reject
rblclient opm.blitzed.org permit
Now here we have huge potential for slowdowns. I strongly recommend you stop using so many RBLs. Although you may catch a few extra mails the load on the server is higher than its benefits. I would change this to:
smtpd
clientrestrictions = permit
saslauthenticated, permit_mynetworks, reject
rblclient zen.spamhaus.org, permit
If you insist on using more than 1 RBL, make sure you eliminate relays.ordb.org as it doesn't exist anymore.
smtpd
recipientrestrictions =
reject
invalidhostname, reject
non_fqdnsender,
reject
non_fqdn_recipient,permit_saslauthenticated,pe
rmit
mynetworks,reject_unauth_destination,reject_rblc
lient zen.spamhaus.org, reject
rblclient
relays.ordb.org,permit
Change to:
smtpd
recipientrestrictions = reject
invalidhostname, reject
non_fqdnsender, reject
non_fqdnrecipient, permit
saslauthenticated, permit_mynetworks, reject
unauthdestination, reject
unlistedrecipient, reject
rblclient zen.spamhaus.org, permit
(Same reason as above. ordb.org is history)
Save and issue "sudo postfix reload". Let me know when done and we'll take it from there.
Alex