No, your location will not be tracked when the app is not being used for SafeEntry check-ins. SingPass Mobile will only retrieve the list of registered locations when you have given consent to provide your location information and when you are actively checking in to places that require SafeEntry.
