I moved the files to mydomain.com directory instead of public.
Edited as per the guide and get this still when going to mydomain.com:
This page isn’t working MYDOMAIN.com is currently unable to handle this request.
HTTP ERROR 500
I don't know what I am doing wrong.