48khz vs 44khz

how come when im in logic running a 48k session, and import audio that is 44.1, sometimes it coverts to 48 and some times in imports and the audio is sped up? annoying. why doesnt it convert the audio file to the session sample rate every time? am i missing something?
thx