Robots.txt is not an appropriate or effective way of blocking sensitive or confidential material. It only instructs well-behaved crawlers that the pages are not for them, but it does not prevent your server from delivering those pages to a browser that requests them. One reason is that search engines could still reference the URLs you block (showing just the URL, no title or snippet) if there happen to be links to those URLs somewhere on the Internet (like referrer logs). Also, non-compliant or rogue search engines that don't acknowledge the Robots Exclusion Standard could disobey the instructions of your robots.txt. Finally, a curious user could examine the directories or subdirectories in your robots.txt file and guess the URL of the content that you don't want seen.
Organic search results are free and display below Google Ads and sometimes local results. Google uses a sophisticated algorithm to determine which sites rank highest for organic search results based on keyword usage, relevance, site design, and other factors. Generally, Google provides the highest quality, most relevant results based on the keyword(s) used by the searcher.
The tip that resonates with me the most is to publish studies, which you back up by linking to the study you collaborated on. That is spot on. It feels like having genuinely useful in depth content is THE strategy that will not be “Google updated” at any point. (Because if you were building a search engine, that’s the content you’d want to serve your users when they search for a topic.)
If you are using Responsive Web Design, use meta name="viewport" tag to tell the browser how to adjust the content. If you use Dynamic Serving, use the Vary HTTP header to signal your changes depending on the user-agent. If you are using separate URLs, signal the relationship between two URLs by tag with rel="canonical" and rel="alternate" elements.
I did want to ask you about the section on “Don’t Focus on Long Tail Keywords”. This is topical for me as I actually have a tab opened from a recent post on the MOZ blog from Rand Fishkin that details reasons why you should focus on long tail keywords. I know you have said that “they have their place”, but as I say as a newbie to all of this, ever so slightly differing opinions from two authoritative people in the industry (that’s you and Rand of course 🙂 frazzles my brain somewhat and I’m not sure whether to turn left or right!
If I have 2 pages that are on the same topic and basically the same info re-written with the same image, but both are very popular pages, what is your advice? Over the last 9 years the 2 pages have gotten more than a million pageviews combined, almost equally between them. Should I permanently redirect one to the other, or try to improve them each and distinguish them slightly more so that they cover a different angle of the same topic?
Tablet - We consider tablets as devices in their own class, so when we speak of mobile devices, we generally do not include tablets in the definition. Tablets tend to have larger screens, which means that, unless you offer tablet-optimized content, you can assume that users expect to see your site as it would look on a desktop browser rather than on a smartphone browser.
Google’s aim is to provide the most relevant result for any given query. Their entire business model relies on them being able to do this, consistently, across hundreds of billions of searches. For that reason, they’ve invested heavily into understanding the intent of queries, i.e., the reason a person typed a specific thing into Google in the first place.
Quora is a website where users generate the content entirely. They post questions via threads and other users answer them. It’s basically a yahoo answers type social network that works like an internet forum. Both threads and answers can receive “upvotes” which signify the answer was worthy and popular. The answers with the most upvotes are put at the thread’s top.
You may not want certain pages of your site crawled because they might not be useful to users if found in a search engine's search results. If you do want to prevent search engines from crawling your pages, Google Search Console has a friendly robots.txt generator to help you create this file. Note that if your site uses subdomains and you wish to have certain pages not crawled on a particular subdomain, you'll have to create a separate robots.txt file for that subdomain. For more information on robots.txt, we suggest this Webmaster Help Center guide on using robots.txt files13.
This is another master piece. You’re not only a top SEO but your writing skills are also amazing. Good to see that I am doing most of the things already that you mentioned under On-Page SEO tips. The only thing I am currently struggling with is to get my content published on top sites. Can you come up with a detailed article about how to approach top sites in your niche and get your content approved? Thanks
For centuries, the myth of the starving artist has dominated our culture, seeping into the minds of creative people and stifling their pursuits. But the truth is that the world’s most successful artists did not starve. In fact, they capitalized on the power of their creative strength. In Real Artists Don’t Starve, Jeff Goins debunks the myth of the starving artist by unveiling the ideas that created it and replacing them with fourteen rules for artists to thrive.
Smartphone - In this document, "mobile" or “mobile devices" refers to smartphones, such as devices running Android, iPhone, or Windows Phone. Mobile browsers are similar to desktop browsers in that they can render a broad set of the HTML5 specification, although their screen size is smaller and in almost all cases their default orientation is vertical.
Keep in mind, this will often mean shifting the focus of your business from more general to more specific products or services. For instance, instead of exclusively offering general home renovation services, you could consider specializing in "one day bathroom renos" or "custom kitchen makeovers." These more specific keyword phrases will likely be much easier to rank for, which will mean you can start ranking that much faster.