I know this user directory is good and all that but I found a amazing Bug in this in flarum.org example community
See here I searched users and got an option to search all users I clicked it and Now i can see full directory and i have no permission, I am guest but see it worked.
Then after this I thought they may have did user directory public so then i directly accessed /users and see what, I confirmed 10000000%
This is a amazing bug in this extension please fix this, and If someone can open Github.com issue please open as I don't have github account.