When we first set up our site (theusedcarplace.com), I installed a script that would email me whenever a user attempted to access a missing page. Initially, this helped me to find broken links and stuff in the Flynax script, and fix them accordingly.
But over time, I started to get emails that looked like the following...
On Sat Jul 26 2014 3:36:28 pm CDT, 37.58.100.90 tried to load :
http://www.www.theusedcarplace.com//...c/deville.html
User Agent = Mozilla/5.0 (compatible; AhrefsBot/5.0; +http://ahrefs.com/robot/)
...Which appears to me to indicate that a bot tried to access a missing page. I tend to get 10-15 of these messages a day. It's been going on for a long time now, and I've never been able to figure out how to fix it, but if anyone has any ideas, I'd love to get it working correctly.
Is it something in the code of the site that's improperly configured? Is the Sitemap plugin not listing URLs correctly? Any other guesses?
Reply With Quote
all urls with correct path.