I wouldn't recommend using Varnish; there might be some issues with pages being cached as an authenticated user and other seeing those pages.
You can use opcache, it can speed up your forum quite well. Perhaps you might run into some oddities, but those are easily fixed and are not a security issue. Eg a need to restart php fpm or the webserver after js/css recompilation.
