Same for me. Since iOS 14 (iPhone / iPad mini)
i can see this in the VPN log:
2020:09:18-14:46:27 gtw-asgaard pluto[5970]: "L_for admin"[34] 78.80.99.86:57983 #66: received Delete SA(0x0fe64c16) payload: deleting IPSEC State #67
2020:09:18-14:46:27 gtw-asgaard pluto[5970]: "L_for admin"[34] 78.80.99.86:57983 #66: deleting connection "L_for admin"[16] instance with peer 78.80.99.86 {isakmp=#0/ipsec=#0}
2020:09:18-14:46:27 gtw-asgaard pluto[5970]: ERROR: asynchronous network error report on eth0 for message to 78.80.99.86 port 57983, complainant 78.80.99.86: Connection refused [errno 111, origin ICMP type 3 code 3 (not authenticated)]
2020:09:18-14:46:27 gtw-asgaard pluto[5970]: "L_for admin"[34] 78.80.99.86:57983 #66: received Delete SA payload: deleting ISAKMP State #66
2020:09:18-14:46:27 gtw-asgaard pluto[5970]: "L_for admin"[34] 78.80.99.86:57983: deleting connection "L_for admin"[34] instance with peer 78.80.99.86 {isakmp=#0/ipsec=#0}
2020:09:18-14:46:27 gtw-asgaard pluto[5970]: ERROR: asynchronous network error report on eth0 for message to 78.80.99.86 port 57983, complainant 78.80.99.86: Connection refused [errno 111, origin ICMP type 3 code 3 (not authenticated)]