Comments on: Retrieving Google’s Cache for a Whole Website

By: Ashley

Ashley — Wed, 08 Sep 2010 23:18:09 +0000

hey, nice blog…really like it and added to bookmarks. keep up with good work

By: Martin

Martin — Mon, 30 Aug 2010 08:12:16 +0000

by adding num=100, so changing line 15 to:
url = “http://www.google.com/search?num=100&q=”+search_term
you can at least fetch 100 pages instead of 10.
that was enough for me so i didn’t try to fix the page-fetching anymore.
hope it helps.
thanks to the author for this great script, saved my life as i had a server-crash and no backups!

By: Farid Peterson

Farid Peterson — Fri, 06 Aug 2010 05:25:28 +0000

Actualization: Nope only the first ten again!!
What happened?? I need to retrieve a whole website

By: Farid Peterson

Farid Peterson — Wed, 04 Aug 2010 15:06:00 +0000

This really works at 4 August 2010. I used James Revillini code, with mar wilson regex_cache changes, also with Windows Python 2.7.

However i have the following issue:I want a retrieve a subsite with a key such as
http://www.mysite.com/forum/codechange?showforum=23

what are the changes required in the code for make this?

Thanks everybody specially to guy

By: Mark Wilson

Mark Wilson — Mon, 26 Jul 2010 15:19:18 +0000

The google cache is now served up over a proper URl and not an IP. You need to change the regex_cache from

\d*\.\d*\.\d*\.\d*

\w*\.\w*\.\w*

By: Ryan

Ryan — Tue, 25 May 2010 16:07:01 +0000

Same issue as Jeremiah. Nothing is saved, but I get the same type of echo message.

By: Jeremiah

Jeremiah — Mon, 24 May 2010 15:55:31 +0000

script just echos
PAGE 1: http://www.google.com/search?q=site:thesite.com
and no file is saved

By: Tom

Tom — Thu, 25 Mar 2010 19:12:03 +0000

Thank you very much “Guy”. I downloaded Windows x86 MSI Installer (2.7a4) as it seems to be the latest 2.x version and it works.

Cheers

By: Guy

Guy — Wed, 24 Mar 2010 04:53:52 +0000

Python 3 isn’t back-compatible with Python 2, so there were incompatible syntax changes. One of those changes concerns the print command. As a result, you will have to use Python 2, or adjust the script yourself to Python 3.

By: Tom

Tom — Tue, 23 Mar 2010 20:34:17 +0000

Hi,

I’am running Phyton for windows x64
http://www.python.org/download/releases/3.1.2/

And when running your latest script I got the following error:
[img]
http://i44.tinypic.com/okzwqd.jpg
[/img]

Please tell me what is wrong. I dont no much about phyton except from running the script!

Thanks in advance