Is there a way to only show it once to a visitor on exit?

There is a timer setting under “Popup trigger”. You can increase the “Interval Seconds” to avoid showing the popup to many timers.