hanilkathuria right now it's a bit confusing and I'm hoping to ship some changes in a coming release.
Right now "user tokens" can be used either as a way to start a cookie session, or directly as an authentication header. There is no way to revoke a specific token. (And there's also a known security issue where tokens don't expire flarum/core2075)
Logging out is a feature that destroys a cookie session, but it also deletes all the "user token" belonging to the user. It's currently the only way to delete "user tokens" natively.
If you want to invalidate a specific "user token" only, you'll need to wait until Flarum implements that feature (this is part of the PR I shared above) or create an extension to add it.
A remember session is actually just an additional cookie containing a "user token", and Flarum will start a new cookie session with that token if no user is currently authenticated in the current cookie session.
A limitation of Flarum right now is that deleting a "user token" won't automatically invalidate the cookie sessions that were started with it. This will change with the PR.
If you want to use Flarum's native logout endpoint from an embedded browser, you'll need to use the native logout button from within the embedded browser, or find a way to read the CSRF token from the page's header in order to use it as part of the logout payload.
I hope this clarifies things.