SEO Bot
-
Can the SeoMoz Bot Crawl more than 3,000 pages at once?
-
Depending on the plan you have, the spider crawlers 10k - 20k pages per campaign
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Menu impact on SEO
we have a single page web application for an ecommerce website. I think it is built in angular. One UX features we are exploring is the use of a "Products" Item on the menu with the categories showing on a menu rather than directly present on the header. The aim being to keep the header nice and clean. The result of this is that the categories which would typically sit in the header will now not be immediately visible until the menu is opened. Let's say I want to rank well for "building materials". Traditionally the view would be that this word would need to be in the header and marked up with the appropriate h tag. Will moving "building materials" into a product menu be detrimental for SEO? My initial thought is that as long as it is coded correctly there shouldn't be any impact on SEO. Can anyone give me their expert SEO view?
Technical SEO | | built_bot0 -
Google Bot Noindex
If a site has the tag, can it still be flagged for duplicate content?
Technical SEO | | MayflyInternet0 -
Does Dublin Core Metadata have any effect in SEO.
Hi, I wanted to know if anyone here can give me an answer about Dublin Core metadata standard, is still this metadat effective for SEO, or maybe I need to go with just microformats like Schema or microformats.org.
Technical SEO | | FisnikSylka0 -
Is it possible to change a sitelink title by off page SEO?
Hi all, I checked a website of my company: sitelinks in SERP are with the correct url, but one of the sitelinks’ title is completely irrelevant. Is it possible that it was changed from "outside"? Or maybe it's a bug? Thank you, Imre
Technical SEO | | DDL0 -
Country domain: Seo for other languages
Hi, I have an italian domain (.it) for an italian hotel, it is an old authoritative domain (1997) and it is well optimized for the keywords that include the city the hotel is in, now the page is decently positioned in Google Italy. There are many problems to have the same rank for German version (in google.de, google.at). The German version is in the /de folder. The hotel has another .com domain, much less authoritative (2007), in a German server, but it was and is only a simple redirect 301 (by code) to the German version in the .it domain. (obviously the rank for this domain is almost nonexistent). Do you have any suggestion? Thank you.
Technical SEO | | depi0 -
Changing DNS -- SEO implications?
Hey Moz, We're migrating an old site on an old server over to a new server/DNS. The plan is to keep the same URL structure and reuse our existing URL's. As long as we make minimal changes to each page's content, we should be able to update our DNS entry and get all the pages recreated and assigned to their correct URLs without any reduction in SEO rankings. Is this correct? This site gets a lot of organic traffic and ranks highly on some challenging keywords, so it's key that we retain our rankings as much as possible. I've read that it's wise to lower the DNS time-to-live to one hour, about a day before the move, to help Google crawl the DNS a little quicker. Are there any other recommendations you guys can offer or past experiences?
Technical SEO | | stephen_reply0 -
SEO Impact of IPv4 and iPv6?
Thought I'd see what the asking side of Q&A feels like 😉 We've been hearing for forever that the internet is running out of IP addresses, but I finally encountered the reality of it. I just realized that one of my sites is on a shared IP (hosted by Hosting.com, formerly HostMySite.com). My other sites with them included a unique IP, so I was surprised to discover this. They claim it's due to limitations on their IP allocations. Hosting.com doesn't have the option to buy a unique IP, but some other hosts do. I noticed, though, that many of them are using IPv6 for the new accounts. Has anyone had practical experience with having an IPv6 address and is there any impact on SEO?
Technical SEO | | Dr-Pete0 -
External Sitewide Links and SEO
I have one big question about the potential SEO value -- and possibly also dangers? -- of "followed" external sitewide links. Examples of these would be: a link to your site from another site's footer a blogroll link a link to your site from another site's global navigation Aside from the link's position in the HTML file (the higher the better, presumably), are these links essentially the same from an SEO point of view or different (and how)? There used to be an influential view out there that the link juice value of a sitewide link was the same as that of a single link (presumably from the linking site's home page), even though a sitewide link may in fact result a huge number individual links. Is this true or false? What is the math here? Should one worry about having "too many" sitewide links, in the sense that this may raise red flags by way of the algo? I talked to someone a few months ago (before the recent algo updates) who believed that he had got a minus 10 penalty or whatever it was for getting too many sitewide links We offer website design and development as well as SEO, and we put a keyworded link to ourselves in the footer. I think this is a fairly common practice. Is this a good or bad idea SEO-wise? One opinion is that for external sitewide footer links, you should best have a dofollow link on the home page, but nofollow it on all other pages. What is your opinion about that? Is there anything else that is distinct, interesting or important about sitewide links' SEO value and pitfalls? Thank you!
Technical SEO | | Philip-SEO1