Is there a way to get a list of urls on the website?
-
For example, www.laskeimages.com
Outside of Google Search Console, is there another way?
-
You can run a "site:yourwebsite.com" search on google and see what is returned. Based on the results you can run further "site:" searches along with more parameters to see more URLs in the index.
A general "site:yourwebsite.com" idea about how many pages are in the index, but it's not 100% accurate.
-
slickplan.com allows you to pull the entire sitemap of your site and pull links, descriptions etc
-
If all of the pages you are interested in are linked internally from somewhere in your site which can be reached through navigation or page links, you can run a simulated crawl with a tool like ScreamingFrog, whcih will discover all the "discoverable" pages.
The site you referenced is built with a platform called "Good Gallery", whcih generates a sitemap. This is at www.laskeimages.com/sitemap.xml. I'm not sure what criteria it might use to include/exclude pages, but that would likely be a good list. You will need to view the page source of that page to see the data in a structured way to extract it.
Another method is to use Google Analytics. Assuming that each page of your site has been viewed at least once in its history, you could extract the list from Google Analytics. Especially from an unfiltered view which includes visits by bots.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
We're merging 2 separate websites into 1 but need to ideally rank service pages for both locations
I have a dilemma, we're merging 2 websites, one an Australian branch and one a UK one. We've decided to have a UK page and a AUS page so agency.site/uk/ agency.site/aus/ but what is the best tactic for the service pages? ideally, we'd like a web-design service page to rank in Australia and the UK but not sure if this is actually possible, or whether to duplicate the pages and localise them i.e. /web-design-leeds/ and /web-design-melbourne/ What's everyone's thoughts on this? localised landing pages with some duplicate content or one master page with both locations mentioned? Thanks!
Local SEO | | Unbranded_Lee1 -
What's the best way to create keyword tracking lists for local SEO?
I have a question for the local SEO crowd: when it comes to creating keyword tracking lists, what are your best practices in reference to tracking from a set location? Do you typically create national keyword lists that include the location operator in each term or are you better creating a list of locally-tracked keywords around a business' location and dropping the location operator from the keyword? Or some combination of the two? To clarify, if I had an example business of a realtor in Chatham, MA, would I want to track -"realtor in chatham ma" (national)
Local SEO | | formandfunctionagency
-"realtor in chatham ma" (with the location set to Chatham, MA)
-"realtor" (with the location set to Chatham, MA) Or some combination of all of the above? Right now, I track waaaay too many keyword variants on my local campaigns! Hoping there's a better way from some more-seasoned Moz users. Thanks in advance!2 -
Will I get Penelized for having a .co.uk site AND a .com site?
Hi Mozers, I have a very important pitch coming up which needs to tackle a questions about international SEO. My client currently has a .com website, but we are debating internally about creating a .co.uk website too so that we can localise content for the UK versus American English on our .com site. Currently, our clients proposition is global, so we made the decision to create a .com website but using American English spelling as a large chunk of English speakers in the world use American English over British English. However, we want to grow the business within the UK, and therefore want to use British English language. Hence creating a .co.uk website. Now, my question is this.... the new .co.uk website will be identical content as the .com website, except for a few spelling changes and the way we phrase certain sentences. How would we be able to run both a .co.uk site and .com site without being penelized from Google for plagarism? Would it involve href lang tags? Server hosting location? Any ideas from you guys out there?
Local SEO | | Virginia-Girtz0 -
Website pages for different cities
HI, Is it ok to have pages on my website that are specifically targeted for one town? Does Google frown on this? is there any thing I should know about doing this, like, does it hurt my seo efforts in anyway? I would be making each page as resourceful as possible to the reader., by Including unique content etc Thanks in advance:)
Local SEO | | MissThumann0 -
How can you add custom Structured Data to a website hosted on Squarespace?
I have a client with a simple one page landing website hosted on Squarespace. Is there any method to easily apply structured data to this format?
Local SEO | | RosemaryB0 -
SEO: Directory Listing Help with Two business locations in different states
Hello! I am in the process of building my second location, and will be moving to Nashville TN. My first location is located in ohio, and I am changing my primary location to nashville, but still want to keep my clients in Ohio... At least for the first year. As for directory building, what is the best option? 1.) Should I create two separate directory listings for each location and then direct www.domain.com to Nashville directory, and then www.domain.com/ohio-wedding-photographer/ to the Ohio listing in the directory? Or do you create one directory and mention I have offices in both Ohio and nashville? Is it bad to have two listings for each location if they have different addresses and phone numbers? Thank you!
Local SEO | | jean78780 -
How to get links for boring niches/industries?
I've asked this question before, but it's 12/18 months on, the SEO landscape has changed, and new people are aboard. So basically, how do others look/achieve links for industries that generally have static sites with little to report. My books are awash with forklift truck, accountants, concrete companies. Very little happens in their businesses - someone orders concrete... my client delivers concrete. Someone orders a forklift.... my client sends a forklift..... Yes, we can do a bit of social, but where else would people go for link building. If my client was a wedding photographer, a mountain climber or cancer specialist, I'd be rolling in ideas, as it is, I find myself a little stumped sometimes.
Local SEO | | Gordon_Hall0 -
If you have a product on your site that's only available in the US, is there a way to avoid it leading to a 404 error if a user in Canada accesses it?
A client has some products on their site that are only available in Canada. When a user in the US accesses the product listing, it results in a 404 error page. Are there any work-arounds for something like this? Thanks in advance!
Local SEO | | DA20130