What is the best tool to view your page as Googlebot?
-
Our site was done with asp.net and a lot of scripting. I want to see what Google can see and what it can't. What is the best tool that duplicates Googlebot? I have found several but they seem old or inaccurate.
-
I just used it today. The simple crawl is free. Advanced is paid.
-
I think it's free again? I use it today...
-
Used to be free, now it's 9,99$ per year
certainly not unreasonable, but some sort of demo would be nice so one knows what to expect. Do you have another recommendation? -
Hi Niners52,
Personally, I like to use webconfs search engine spider tools (http://www.webconfs.com/search-engine-spider-simulator.php) but there are loads out there that you can use and it is your own preference really.
Also, I use ScreamingFrog to do similar tasks.
Matt.
-
I'm a fan of http://www.seo-browser.com/ - use their simple search and it's totally free.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEO Problem With My Pages ?
Hi everyone, I created a self-hosted custom PHP website the page is ( custom cosmetic boxes ), but it doesn't show up on Google. I tried to follow tutorials on the HubSpot, but even my site sucks. Please help me where I am wrong. Maybe the little thing is left unattended, which makes it void.
Web Design | | fbowable
Please help me.0 -
Best Practices for Leveraging Long Tail Content & Gated Content
Our B2B site has a lot of of long form content (e.g., transcriptions from presentations and webinars). We'd like to leverage the long tail SEO traffic driven to these pages and convert those visitors to leads. Essentially, we'd like Google to index all this lengthy, keyword-rich content AND we'd like to put up a read gate that requires users to register before viewing the full article. This is a B2B site, and the goal is to generate leads. Some considerations and questions: How much of the content to share before requiring registration? Ask too soon and it's a terrible user experience, give too much away and our business objectives are not met. Design-wise, what are good ways to do this? I notice Moz uses a "teaser" to block Mozinar content, and I've seen modals and blur bars on other sites. Any gotchas that Google doesn't like that we should be aware of? Trying to avoid anything that might seem like cloaking. Is it better to split the content across several pages (split a 10K word doc across 10 URLs and include a read gate on each) or keep to one page? Thank you!
Web Design | | Allie_Williams0 -
Certain PHP Pages Not Showing In SERPs
Hi all, You've all been so helpful so far, I'm hoping you can help me with our trickiest SEO question yet. Last year we migrated 7 sites into one, going from flat html to Joomla. This went fine and although we saw a slight drop in traffic, it wasn't too bad. Now however traffic has started to drop and we've been able to hone it down into a certain area of our website. Each of the 7 sites had their own page with some php code that was fed products. These products were updated everyday and were are second most popular page on the sites aprt from the home page. These pages were found in Google no problem and were an essential resource for our site. What we have found is these pages cannot be found at all, unless you type the full business name and product. If you just type the product and the location our customer is based in, we're no where, using the Moz tools it says we're not in the top 50 results. This is a bit of a shock since we used to be at least on the first page, usually quite high up. I'm a little stumped as SEO wise these pages are technically better. They offer the same functionality but in a much more SEO friendly way. I've asked our developer to check: Nothing is being blocked in robots.txt
Web Design | | HB17
The pages are being indexed
There's no strange code errors Essentially the pages can't be found even if we type the full title, for example 'customer's products in their town' to be found we have to type 'customer's products in their town and their full business name'. The top third of the page is just html text, the bottom like I mentioned is PHP and is fed data from a database which is refreshed each morning. I know our developer did some rel conical work but has assured me that's all working fine. While I know it's a new website, we've owned the domain for a while so our domain authority isn't brand new and 0, we also have pages with worse page authority that show up on page 1 no problem, so I'm leaning towards something else might not be right. Can anyone help me figure out why these pages are being indexed but not even found? Thanks!0 -
Hi, I have a doubt. If we want to hide unwanted text in a web page its possible with "" tag. And my question "does a search engine crawl those text? help me.
I want to hide a lot of text behind my site page. I know its possible with that tag. But in what way a search engine looks at those text? Hidden or they are crawled and indexed.
Web Design | | FhyzicsBCPL0 -
Keywords in the page url for best SEO
Hello all, I am working in the keywors structure of a web and I have the following doubt: If I want to target these keywords: great food madrid and my website is: http://www.madridlive.com I do not know if I should keep either: OPTION 1: page url: www.madridlive.com/great-food-madrid or OPTION 2: page url www.madridlive.com/great-food I do not know if the search engines "understands" madrid in "madridlive", therefore I can avoid the "madrid" keyword, dicarding option 1 and going for option 2. Additionally I avoid duplication of the madrid keyword that can be seen as redundancy and also have a shorter page url. Thank you very much and sorry for such a question but I am new in this SEO field...just the excellent SEOMOZ's SEO Guide for beginners! Best regards, Antonio
Web Design | | aalcocer20030 -
Duplicate Page Content mysite.com and mysite.com/index.html MOZ Dashboard
According to MOZ Dashboard my site shows Duplicate Page Content mysite.com and mysite.com/index.html .What i can do for that .redirect mysite.com/index.html to mysite.com .then how can i do that using .htaccess file .
Web Design | | innofidelity0 -
Spammy page titles and the consequences
Hiya Mozzers! A pal who works in SEO has suggested I add the following type <title>tag structure to my pages:<br /><br />Bars in New York - Bars New York [no brand name]</p> <p>Pizzas in New York - Pizzas New York [no brand name]</p> <p>Firstly, I think this looks spammy, secondly, can't understand the logic of both combinations, thirdly, my understanding is brand name lessens importance of keyphrases, but it's still important from a branding point of view.</p> <p>Fourthly, is this sustainable? I mean, Google could identify this as spammy in the future, with penalty, no? Any feedback on these points would be very useful.</p> <p>Also, he said that I should play around with title tags on an ongoing basis, but I haven't changed any single title tag more than once/6 months for fear of being flagged for manipulative SEO practice by Google. Guidance here would be great as well.</p> <p>Thanking you in advance, Luke</p></title>
Web Design | | McTaggart0 -
Number of links per page?
I'm confused by the number of links that we should put on a page. Our site has a high domain authority but SEOmoz tool and others, plus Google WMT suggests much much less than other sites have - look at Dailymail.co.uk or the Huff post site for example. our site is www.worldtravelguide.net and I'm thinking specifically about the /destinations and each continent like /europe Our site has thousands of pages, trying to create an effective internal linking structure with the limitation of 150 or so links is nearly impossible and ends up with too many navigational pages. We were hit hard by Panda (even though all our content is original, professionally written frequently updated) in favour of bigger brands and considering Google suggests that sites should be designed for users and not SEO these two ideals conflict. Does anyone have any data on what the link limit is? Any other tips or observations would be gratefully received. Thanks, John
Web Design | | JohnFinlayson0