Should I leave my machine in the pause mode ?

It is okay for a minute or two, but not advisable for longer periods of time, as the same piece of tape stays loaded against the head. This can cause problems with the tape and possible head damage due to clogging.