Audio doesn't load when using negative offset

Hi, whenever I make the audio have a negative offset it doesn't make noise at all while trying to align them whenever I restart it. So I can change it and it will make noise, but if I change it and rewind all the way before any notes, then it doesn't make sound until I change it again, so it's very difficult to line up the audio with the midi