Iphone SE charging issue

My old charger cable had shortage and problems charging phone so I bought another charger different brand. I still have issue. When I insert charger i have to move it around side to side to charge in a certain position. If I just insert it it will not charge regularly and if I insert charger and push it in while holding it the phone will charge as well but also the charger can be loose if I move phone around. I tried to see if anything is in charger port but there wasn’t really anything in it.