<?xml version="1.0" encoding="iso-8859-1"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	>
<channel>
	<title>Comments on: GoogleBot ate my bandwidth!</title>
	<atom:link href="http://www.jimwestergren.com/googlebot-ate-my-bandwidth/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.jimwestergren.com/googlebot-ate-my-bandwidth/</link>
	<description>SEO Expert and Philosophical Sci-Fi Author</description>
	<pubDate>Wed, 20 Aug 2008 20:42:06 +0000</pubDate>
	<generator>http://wordpress.org/?v=2.5.1</generator>
		<item>
		<title>By: Alex</title>
		<link>http://www.jimwestergren.com/googlebot-ate-my-bandwidth/#comment-32890</link>
		<dc:creator>Alex</dc:creator>
		<pubDate>Tue, 04 Sep 2007 22:14:30 +0000</pubDate>
		<guid isPermaLink="false">http://www.jimwestergren.com/googlebot-ate-my-bandwidth/#comment-32890</guid>
		<description>Hey

Just found exactly the same on one of my client's sites. They were complaining that despite being a small site, they'd apparently used all of their bandwidth within 4 days.

They had one of these PHP calendars on their site, where you click the day and it tells you what's on. Googlebot had tried to index EVERY SINGLE POSSIBLE DAY. And, in the first four days of September, had used up all this site's bandwidth, clocking up an impressive 19,000 hits and 800MB of bandwidth.

You can use robots.txt to tell all decent robots to push off. I've just done that. Let's see if it works!</description>
		<content:encoded><![CDATA[<p>Hey</p>
<p>Just found exactly the same on one of my client&#8217;s sites. They were complaining that despite being a small site, they&#8217;d apparently used all of their bandwidth within 4 days.</p>
<p>They had one of these PHP calendars on their site, where you click the day and it tells you what&#8217;s on. Googlebot had tried to index EVERY SINGLE POSSIBLE DAY. And, in the first four days of September, had used up all this site&#8217;s bandwidth, clocking up an impressive 19,000 hits and 800MB of bandwidth.</p>
<p>You can use robots.txt to tell all decent robots to push off. I&#8217;ve just done that. Let&#8217;s see if it works!</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: ilushkin</title>
		<link>http://www.jimwestergren.com/googlebot-ate-my-bandwidth/#comment-54</link>
		<dc:creator>ilushkin</dc:creator>
		<pubDate>Fri, 23 Dec 2005 06:51:45 +0000</pubDate>
		<guid isPermaLink="false">http://www.jimwestergren.com/googlebot-ate-my-bandwidth/#comment-54</guid>
		<description>this is scary...</description>
		<content:encoded><![CDATA[<p>this is scary&#8230;</p>
]]></content:encoded>
	</item>
</channel>
</rss>
