9 Comments on Scrape A Webpage – Save To CSV

Ray on Sat, 12th Dec 2009 2:30 pm


GREAT tutorial!

The software creator ought to post a link to this tutorial on their website.

None of the tutorials they have on their site covers this vital subject.

Thanks. I appreciate your work.

Ray

[Reply]

Xdreamer on Sun, 13th Dec 2009 3:44 am


Hey Aaron,

just donated some bucks, not much but hey its a beginning Great tutorial, exactly what I was looking for for a loooooooooooong time now Covers pretty everything I always wanted to learn with ubot. Also thanks for sharing your technique with the subs, looks quite logical to me.

Hopefully there is more coming like this. Thanks again.

[Reply]



Aaron Reply:
December 13th, 2009 at 7:10 am

Thanks for the donation!

Keeps me motivated to make more videos.

[Reply]

Kirsteen on Sun, 13th Dec 2009 4:40 pm


Fantastic Tutorial, I like how simply you explained everything, I’ve already been using subs but you make it look neater and I like your suggestion of ‘Initializer’ and working from the bottom up. I’m away to start my first scraper bot. Thanks a lot!

[Reply]



Aaron Reply:
December 13th, 2009 at 5:39 pm

Thanks for the wonderful feedback!

Good luck on your scraper bot. If you need any help, just let me know.

[Reply]



Manuel Merz Reply:
December 14th, 2009 at 5:50 am

Hey Kirsteen, nice to see you here

[Reply]

Scott on Mon, 14th Dec 2009 9:19 pm


Hi Aaron,

Thank you very much for this tutorial. I haven’t actually seen it yet but I can’t wait. Just been burning the midnight oil trying to finish a big project. I’ll donate too when I come back to visit, hopefully tomorrow!

Thanks again, very cool indeed!

[Reply]

Jeff on Wed, 16th Dec 2009 8:54 am


Hey Aaron, great tutorial. I want to do the same type of scraping to a CSV, but instead of a single URL, I want to scrape from an auto incrementing URL…ex:

http://www.domain.com/index.php?id=1
http://www.domain.com/index.php?id=2
http://www.domain.com/index.php?id=3

The page elements will all be the same that I’m scraping

How would you do this? Or can you post an updated bot from your scraper and I can look at it?

Thanks!

[Reply]



Steve Reply:
January 11th, 2010 at 5:51 pm

Me too … I am interested in the incrementatl navigation aspect of web crawling and web scraping (page1.htm, page2.htm, page3.htm … page99.htm) … I suppose I could create a .txt file with 1 to 99 URLs and manually increment the pages but I’d prefer an automated solution that knows to STOP at page 66 if there are no more results … looks promising as I used to write this stuff in either Java or C for a large data compiler …

[Reply]

Tell me what you're thinking...
and oh, if you want a pic to show with your comment, go get a gravatar!