I've just installed a fresh copy of beta-4. After making sure that the forum worked, I installed the extension by running this at the root of the forum:
composer require s9e/flarum-ext-mediaembed
Then I went to the admin panel and enabled the extension. Once the extension enabled, I posted a new thread with a YouTube video and it worked as expected.