Site Crawl report show strange duplicate pages
-
Beginning in early in Feb, we got a big bump in duplicate pages. The URLs of the pages are very odd:
Example URL:
http://[email protected]/dir/page.php
is duplicate with http://website.com/dir/page.phpI checked though the site, nginx conf files, and referral pages, and could not find what is prefixing the pages with 'http://firstname.lastname@'.
Any ideas? The person whose name is 'Firstname Lastname' is stumped as well.
Thanks.
-
I will send details to [email protected]
Thank you.
-
Hi there!
Send us a ticket to [email protected] and we'll take a look as well
Thanks!
Kevin
Help Team -
Could you share an actual url? Can you see in the crawl which pages are linking to these strange url's? You could try to replicate the crawl locally (with Screaming Frog) to see if the problem is replicated
Did you check your url rewriting? Maybe you're trying to clean your url structure & the parameter is translated the wrong way?
Dirk
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz Crawler Causing Server Timeouts... Crawling thousands of non-existant pages with query parameters
Moz crawler is crawling all pages like this: http://www.xxxx.com/?product_count=100&product_order=desc&product_orderby=date http://www.xxxx.com/?product_count=100&product_order=desc&paged=1 http://www.xxx.com/?product_count=100&product_order=desc&product_view=grid Last month it crawled 80,000 pages on a site with less than 100 pages. Is there a way to select only certain pages to be crawled? Right now it is still crawling this site, since Monday morning and it's Tuesday mid-day. Every Monday it is causing time-outs from high band width on our server. Just getting ready to delete this client from the account unless there is a solution someone can give us. Thanks.
Moz Bar | | adirondack0 -
Page Authority drop to Zero with new Moz crawl
My Site having page authority about 15 to 17 and i added many new pages in end of November. Everything is fine in December Moz Crawl update (Page Authority - Domain Authority) but in recent update my DA id drop 3 points and all my pages authority vanished drop to 1. Can anyone help me out to understand whats going on there!!!
Moz Bar | | signsny0 -
On page grader tool - ip address
Does anyone know Moz's IP address for the above tool so I can give it access to a staging area of our site?
Moz Bar | | Jennie050 -
Different Errors Running 2 Crawls on Effectively the Same Setup
Our developers are moving away from utilising robots.txt files due to security risks, so e have been in the process of removing them from sites. However we, and our clients still want to run Moz crawl reports as they can highlight useful information. The two sites in question sit on the same server with the same settings (in fact running on the same Magento install). We do not have a robots.txt files present (they 404), and as per Chiaryn's response here https://mza.seotoolninja.com/community/q/without-robots-txt-no-crawling this should work fine? However for www.iconiclights.co.uk we got: 902 : Network errors prevented crawler from contacting server for page. While for www.valuelights.co.uk we got: 612 : Page banned by error response for robots.txt. These crawls were both run recently, and there was no robots.txt present. Not to mention, they are on the same setup/server etc as mentioned. Now, we have just tested this, by uploading a blank robots.txt file to see if it changed anything - but we get exactly the same errors. I have had a look, but can't find anything that really matches this on here - help would really be appreciated! Thanks!
Moz Bar | | I-COM0 -
URL not returning a page successfully
I am trying to use the on page grader however it is not working with my website. The url is: http://www.britishhardwoods.co.uk/ Can anyone help?
Moz Bar | | British_Hardwoods0 -
Moz Rank Tracker - showing deleted subdomains results for entered keywords
We have recently deleted subdomains because they were causing duplicate page errors but now the Moz rank tracker is showing the subdomain key word results even instead of the exact url we entered. So for example wine cellar is showing up for a deleted subdomain (winecellar.vigilantinc.com) instead of the entered exact url of (vigilantinc.com/winecellars/) Please advise. Thanks!
Moz Bar | | KristyFord0 -
Keyword Difficulty Showing ONLY Bing Search Volume (Exact Match)
Hi I am using the "Keyword Difficulty" tool and selecting "Google US". But the report that gets generated shows "Bing Search Volume (Exact Match). Is there any way to get "Google Search Volume (Exact Match)" being shown in the report? Regards
Moz Bar | | rholt0 -
Mozscape Update-Why every site is down?
Every site,every competitors site have been down.What type of data Moz used this time to update the index. If the variables are changed can I have the priority variables?
Moz Bar | | csfarnsworth1