Problem: Using Prerender.io to index/store pages of one site, I keep getting path requests that only exist on my old site
Example: on Prerender I'll see that Googlebot requested
I have an old website
old-website.com and a new one (
Both websites are on separate servers with different IP addresses, (though
old-website used to live on the server that
new-site now lives on.
new-site does not have these old path URL's anywhere in any of the site-maps, additionally these pages return 404's.
I'm not sure where to tell google to stop requesting these pages. For a quick solution I've added these to my robots.txt but that feels like a short term hack. The new site is a single page application, and old site is wordpress.