Does the 42 mm Apple Watch band fit the 40 mm Apple Watch Series 4 comfortably?

I have the Apple Watch Series 4 40 mm, as well as several 42 mm bands from the older Apple Watch Series 1 42 mm. I have heard that the 42 mm bands are supposed to fit the 40 mm watch, so I went to give it a try. Upon doing so, I noticed that the band sticks out from the corners of the watch. I don’t know if this is supposed to happen and just has to do with the difference in watch shapes, or if it means that the 42 mm watch band will not fit the 40 mm watch. Is it safe to have the band sticking out like this? I don’t mind how it looks as much as making sure I can use my older bands.