Currently using Concrete 9.5.1 and PHP 8.1.34. The site was re-built as new from an original V8 site whose pages of HTML had been copied and saved.
To see how the site is doing I launched Google Search Console. That flagged many broken links which have now all been fixed. However it has also decided that there are Page Index errors, in particular “Server error (5xx); These pages aren’t indexed or served on Google”.
The 180 pages listed are not pages that I have created or edited. For example:
GSC is flagging that it has discovered these pages but either cannot access them to index (5xx because your server correctly doesn’t allow access to them) or doesn’t think they should be indexed. You said you haven’t intentionally created any of them so this is working correctly i.e. they don’t include content that you want Google to read.
You’re absolutely correct they are Concrete system files (don’t delete them!) but you also don’t need Google to see them so there’s no real issue here.
Thank you both for your comments and suggestions. I will seek out the robots.txt file as I seem to recall that it was moved/deleted for some reason at one point in the past. If I have managed to delete it rather than just suspend it temporarily, can one easily re-generate it? I do have a second site of similar vintage (different topic) so could copy the file from there if it is generic rather than site specific.
Thank you all for your thoughts. I have got into File Manager and robots.txt is present and presumably correct. I have looked up ‘Pretty URLs’ since that was a new term for me and can conform that I have not attempted to set up any such, although I like the idea.
The only other thought I had was that I do have a folder public_html_old which Google might be searching. I will prefix the ‘public’ bit in that folder with something else like Q and see if that makes any difference.
