Have an account? / Register

Forgot your password?

Forgot your username?

Results 1 to 4 of 4

Thread: screen scraping

  1. #1
    Registered User
    Join Date
    Apr 2009
    Posts
    256
    Thanks
    25
    Thanked 18 Times in 15 Posts

    screen scraping



    Hi All

    I've just started to play around with datafeeds, and love the ability to display the products exactly how I want them. My only issue with this is that you have to download the feed once a day, and hope then that the merchant has actually updated it.

    The only other option appears to be to scrape the required info from the merchant site, but if like me you want to run a price comparison site, this means scraping each merchant site, and creating a new scrape instruction for each product and each merchant.

    If I'm correct in the paragraph above, can someone please shed some light on a efficient and managable method to perform the scraping and manipulation of the data?

    Also I intend to use a CMS like Joomla and the virtuemart plugin to handle the products, does anyone know of something that may already offer what I want?

    cheers
    Andy

  2. #2
    Registered User
    Join Date
    Jul 2009
    Posts
    1
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: screen scraping

    MetaSeeker is a FREE HTML wrapper factory. A new HTML wrapper for a target site is created in minutes without coding a single line.

    XPath, XSLT and XML are made use of to express Web data extraction rules and to store extraction results.

    It is very suitable for extracting web data in bulk. With the help of proprietary technology named as FreeFormat, the tool is very resistant to changes of target web pages. As a consequence, it is suitable for monitoring and extracting a site for a long duration. Not only can the data in form of tables be extracted, tree-like data can also be extracted.

    For more information please visit GooSeeker, a community on web data extraction | GooSeeker

  3. #3
    Chocaholic Mogga's Avatar
    Join Date
    Aug 2003
    Location
    Oldham
    Posts
    8,482
    Thanks
    541
    Thanked 231 Times in 179 Posts

    Re: screen scraping

    Make sure you have merchant permission to scrape

  4. #4
    Registered User
    Join Date
    Apr 2009
    Posts
    256
    Thanks
    25
    Thanked 18 Times in 15 Posts

    Re: screen scraping

    Thanks, will check out the scripts above, I've not heard of those ones and I've searched all over the place!

    Generally, are merchants quite happy to allow you to scrape their sites? I don't want to go to the hassle of sending out twenty odd emails, and waiting for responses, only to find 5 are happy.

    If anyone else has experience of screen scraping that they're willing to share, it would be much apreciated.

    cheers

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Legalities of scraping a site
    By max99 in forum Affiliate Marketing Lounge
    Replies: 25
    Last Post: 21-04-09, 05:41 PM
  2. Amazon bot scraping my site?
    By ep90 in forum Affiliate Marketing Lounge
    Replies: 3
    Last Post: 08-04-09, 02:14 PM
  3. Merchant Scraping
    By victor_m in forum Affiliate Marketing Lounge
    Replies: 7
    Last Post: 28-10-07, 08:40 PM
  4. Screen Scraping DGM
    By Pandini in forum Programming
    Replies: 8
    Last Post: 06-04-05, 01:26 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
To Top

SEO by vBSEO 3.6.1