robots

  • Enable GoogleBot to fetch your JavaScript and CSS files

    Google announced recently that they’ve updated their webmaster guidelines to specifically note that blocking your CSS or JavaScript files may have a negative impact on your indexing and search rankings in Google. They are claiming, that for better understanding your site, they need to access these files too (and, probably next time they will want to take a peek in your laundry bag too...)

  • How to Add Meta Tag Robots in Joomla 2.5 withouth extra tools

    By default Joomla 2.5 does not add the robots meta tag in the header and you have no handy tool by default to do it in one place, unless you don't use some add-on which let you do this easily.

    But what if you prefer to do it yourself, bare-handed, without seeing even some code? You might be surprised, but in fact in Joomla 2.5 it's very easy to set up meta tag robots for your home page and content articles.

  • Sitemap in robots.txt

    Are you a SEO-conscioncious webmaster? Of course, you are!

    And you already have a nice, standards-compliant XML sitemap! Congrats! (Maybe you used a Joomla component to generate it on the fly - Brilliant!) You even had submitted it to the Google! Great! And you think you can enjoy from now that well-deserved pina colada, right? Hold on, you have some important tasks to do!

  • When searchengine robots are hammering your site...

    SEO is good. SEO is great. Making search-engine spiders visiting your site is even better! Or not??? Recently one of my client has complained, that he was almost banned from one host, because the search-engine bots where "hammering" - read overloading - the server. Ouch...