I believe everything that is set in the admin panel doesn't have its own permissions. Only admins can do it. Which sadly prevents giving access to tags settings to anybody else.
This might be something that will create problems in the future. What if you allow other groups to edit tags ? You can't give them access to the admin panel, as you need to be a super-admin to load it. Where do you place the tags settings then ?
If you start adding more granular permissions and move stuff to the front-end side (forum) so non-admins can edit them, we will end up with nearly nothing in the actual admin panel (?)
Or should the admin panel be refactored so it doesn't actually require admin access for everything ? But then we need to change the way some things are done, for example all setting values are always injected in the admin panel, this wouldn't be secure if non-admins also see it. Extensions would have to whitelist or inject settings themselves like in the front-end.
Just thinking out loud here. Not sure if there's a discussion about this on GitHub already ?