SKevo thanks! I am able to reproduce the issue by using two separate accounts (one Admin, one normal account).
If you first post with one, then sign out and sign in with the other to post, the problem occurs.
So must be a cache issue I guess.
But is this maybe something that Flarum could fix?
Clearing cache every time I perform an account change is not so convenient.