Hi,
You should obviously stop using the power adapter immediately. Whether Apple will replace it or not only Apple can say, so I would bring the power adapter and Mac to an Apple Store “genius” bar to find out; the visit is free: https://support.apple.com/contact