meihuak it depends on the sso service you'll use. It might need a custom extension, though most will be fairly simple to create. You could combine it with https://flarum.org/extension/v17development/flarum-third-party-login-only to force log in with that sso provider only (and unify your users in one system).
Remember that such an implementation will create separate users in each community still, though their information will be shared in the sso system.
I don't think truly re-using one database table users for multiple instances work as migrations might not work between them.