Googlebot 404

Kakifrucht

I just got a warning from googlebot regarding a lot of 404's that came up since I set up the forum.
The forum is not located on a dedicated subdomain, but on a subdirectory domain.com/forum.
I did already notice, that right now Flarum has some issues regarding this, for instance the links when clicking on mentions and replies are not relative to the subdirectory (issues already reported) and directly loading a subtag via URL also causes a 404.
Google however seemed to index the forum wrong, completely skipping the /forum/ in front of the uri.
Is this something that is already a known issue or what I can fix?

jordanjay29

Did you check your .htaccess file against the URL Rewriting rules in the Installation Guide?

Kakifrucht

Yes, I have setup Nginx properly, or at least I believe so.
I had to add /forum to all the paths.

BlackSheep

Kakifrucht or at least I believe so

Is this problem still active ?

Kakifrucht

BlackSheep Yes, out of some reason Google Search console shows me 404 on all forum links, because it doesn't seem to append the /forum at the front.

jordanjay29

Kakifrucht you might need to look into making a robots.txt file.

Kakifrucht

jordanjay29 Well, I have a robots.txt in my document root.

jordanjay29

Could you link your robots.txt here?

Kakifrucht

I'm pretty sure I found the issue already.
Flarum still has some bugs regarding relative path linking, meaning that mentions for instance will not append the /forum/ to the links. This is reported already on Github, can't find the ticket right now though.
Google actually does index the forum properly, however due to these wrong links with mentions, answers etc. it also causes lots of 404 to be thrown.

This issue will hopefully be fixed with beta5.

cristic

Is this enough for Flarum's robots.txt or does it need some "custom permissions" in it ?

User-Agent: *
Disallow: