Comments on: Create your First Web Scraper to Extract Data from a Web Page

By: pr

pr — Thu, 27 Sep 2012 06:55:39 +0000

The last post was last week, in fact. And yes, it’s still very much operational and supported. This page, however, as it says in red at the top, is about a very old tutorial. You should use the ones built in the Hub instead. Feel free to send us bug reports or suggestion with our contact form.

By: Ernest

Ernest — Wed, 26 Sep 2012 19:24:13 +0000

The last entry and archive is a year old. Is this software still operational and is anybody supporting it?

By: Big Bang Theory Quotes

Big Bang Theory Quotes — Sat, 18 Aug 2012 23:10:20 +0000

This tutorial got my scrapping a website for a project data I needed. Thank you so much for the details. Worked perfect!

By: Les

Les — Fri, 02 Sep 2011 18:00:14 +0000

Thanks JCC. Will do!

By: jcc

jcc — Fri, 02 Sep 2011 17:51:26 +0000

You’ll be able to do all sorts of tweakings after reading the help 🙂
Go to links, select all your URLs, right click on one of them and choose “Browse through selected URLs…” or “Apply scraper to selected URLs…” These are the simplest ways.

But, please, do read the help and do not use this blog for support tickets: We have a perfectly good support system on the site… As it says in red in the comment form you used to type this 😉

Cheers,

By: Les

Les — Fri, 02 Sep 2011 17:32:30 +0000

Thanks JC.

I have opened the .txt file with the Hub. Now about the scraper,
how do you tweak the scraper to scrape the pages?

Thanks again in advance.

By: jcc

jcc — Fri, 02 Sep 2011 05:45:04 +0000

If you have the pro version, you can use the ‘queries’ view and create a directory of URLs to be used manually or called in a macro. There are several ways to add URLs to a directory of queries, the drag and drop is the easiest.
If you are using the light version, the best way is simply to put your URLs in a .txt file and open the file with the Hub.
Cheers,
JC

By: Les

Les — Thu, 01 Sep 2011 22:58:29 +0000

Hi,

Great tool…

A quick question– how do you make a list of url’s to be scaped?

Thank you in advance.

By: pr

pr — Tue, 28 Jun 2011 08:21:22 +0000

@George: you can use the "clean data" checkbox in the scraped bottom panel. Please use the contact page for any question/suggestion/bugreport.

By: George Vandelet

George Vandelet — Thu, 16 Jun 2011 16:28:25 +0000

The automatic scraper does a great job of only placing the text that would be seen on the web page instead of the html code. However, when I build my own scraper, I have to build it where there are numerous html fields in a single capture. hence, the scraper returns both the html code and the text that would appear on the website. I do not want the html code in my catch. Is there a button when you make your own scraper that will not catch the html code but will select the text that appears on the website? Thanks, George The example is 4 29 184779 HARRIS ESTATE B 013 26-JAN-83 9999 010-10N-13W 1440 BENSON where I use as the "Marker Before" and as the "Marker After" I just want the text not all the html code like "" or "