Google not indexing pages

AleM

Google excluding pages with status "page with redirect". I have added this in .htaccess so probably this might be the issue:

RewriteCond %{HTTP_HOST} !^$
RewriteCond %{HTTP_HOST} !^www\. [NC]
RewriteCond %{HTTPS}s ^on(s)|
RewriteRule ^ http%1://www.%{HTTP_HOST}%{REQUEST_URI} [R=301,L]

I am also using FoF Sitemap extension, all the URLs there are written without www.

Any solution to get all the pages indexed, and also have them all go to no www url?

AleM

Any chance to get some help with this? It's a nginx server.

010101

AleM What are you trying to do with that htaccess code? Redirect to www or non-www? Or neither? If www to non or vice versa is the goal, search the web for “htaccess www to non www” because I don’t think what you have there is right.

AleM

010101 Yes, that's what I'm trying to do, and it's actually working, the problem is that google doesn't like those redirects, and exclude all those pages.

streaps

010101 I don’t think what you have there is right.

what is wrong there?

edit: web search returns the exact same recipe:

streaps

I don't think the redirects are the problem, but that the FoF Sitemap extension is using the wrong URL without the www. I guess the canonical address is also without the www. What url do you have in config.php? Does it solve the problem if you add the www. there?

JohnP

I might be missing something here, and it doesn't have much to do with G indexing pages or not, but the OP stated that the server is Nginx, and I didn't think Nginx read .htaccess files ?

010101

JohnP Good catch. @AleM are you using nginx? Then you can’t use a htaccess file. That’d be Apache.

And I know even less about nginx so all I can do personally to help you is suggest you start Google searching.

A theory I have would be that you currently have a www version of your website plus a non-www version. You have attempted to fix that with redirects in an Apache htaccess file. But, that may not help you depending on your set up.

Sounds like you mostly know this or else you wouldn’t be trying to redirect in the first place, so as you know, your SEO will not be good if you don’t permanently redirect to either the www or non-www.

A final tip you may take or not take if you ever use Cloudflare: At some point my web host said if you are using Cloudflare, it’s best to stick with the www version. I don’t know why. I’m not that technical. And it could be just my web host due to their set up. But, since then because I always utilize Cloudflare, I permanently redirect to the www version. Plus, for a little bit of nostalgia, I like the www version since that’s how everyone once had their web addresses shown. 😄

Maybe this will help you. I didn’t full read the posts and I don’t know anything about nginx. But serverfault.com looks like a good place to figure this out.

Hide www: https://serverfault.com/questions/258378/remove-www-and-redirect-to-https-with-nginx

Keep www:
https://serverfault.com/questions/624848/redirect-non-www-to-www-over-ssl-with-nginx

Braden

As per my learning not every link you submit will be indexed straight away, the page gotta have a good content and people reading. The excluded pages they usually get indexed after sometime. You are not alone.

Justoverclock

i have the same issue, some link like https://flarum.it/d/38-emojione-menu-emoji-per-flarum are not indexed by google, i do not use flarum seo.

google search console says:

Generally these pages are not indexed and we believe this is not a mistake. These pages are duplicates of indexed pages, or their indexing is blocked by certain mechanisms on your site or still these pages have not been indexed for a reason that we believe is not an error.

and the cause can be the noidex tag (but i do not know if is present, i think not)