Issue "Only Accesible for Builders" After Tool Re-Publish

I am experiencing an issue every time I re-publish my tool after making changes. Users who were actively using the tool in their browsers encounter an error message stating that the tool is “only available for builders” when they refresh the page.

See image below:

what I am doing wrong?

@Sebastian Is your app live? That’s what I used to see when in dev mode.