Affiliate Marketing
Forum Search

Reply
 
LinkBack Thread Tools Display Modes

  #1 (permalink)  
Old 24-07-07
Registered User
 
Join Date: Dec 2006
Location: Up North
Posts: 26
Thanks: 0
Thanked 0 Times in 0 Posts
victor_m is an unknown quantity at this point
  Merchant Scraping

This is purely for above board reasons and to save me inputting each and every product individually as the merchant doesn't have a datafeed. Any help would be great. Does anyone know of any good screen scraping programs or links to good tutorials on how to build your own?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2 (permalink)  
Old 24-07-07
scifind's Avatar
thin[box]king
 
Join Date: Aug 2003
Location: Cambridge
Posts: 1,831
Thanks: 6
Thanked 4 Times in 4 Posts
scifind is an unknown quantity at this point
  Re: Merchant Scraping

Before you do this - have you had a chat with the Merchant?
They may be accommodating.
It would be better for the merchant to have a datafeed and a more stable system for yourself, as minor site changes can kill data scrapers.
__________________
Earn an average of £45 per sale. | New Star Trek Trailer | Looking for Mobile Phone Link Swaps
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3 (permalink)  
Old 24-07-07
Registered User
 
Join Date: Dec 2006
Location: Up North
Posts: 26
Thanks: 0
Thanked 0 Times in 0 Posts
victor_m is an unknown quantity at this point
  Re: Merchant Scraping

Just as a quick update I have found this tutorial for their tool (not affiliated) here which seems quite decent. Will have a play around with it but it seems to be along the lines of what I need, plus their demo is based on scraping the same type of store that I will be looking to scrape.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #4 (permalink)  
Old 24-07-07
tbp tbp is offline
Registered User
 
Join Date: Dec 2006
Posts: 1,999
Thanks: 0
Thanked 18 Times in 18 Posts
tbp is an unknown quantity at this point
  Re: Merchant Scraping

There was a thread about this topic a couple of weeks ago.

Some merchants are really against scraping their sites, as they believe it would put too much load on their servers.

Its also quite difficult, as getting the computer to work out where on the page the price is for example can be quite difficult. If the price is between two specific tags its easy, but if the price is just tacked onto the end of the product description for example, its much harder.

As a result, you end up having to write code for each and every site that you want to scrape, telling the computer where the data is that you want to capture.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #5 (permalink)  
Old 24-07-07
Legend!
 
Join Date: Aug 2003
Location: AF London Dungeon
Posts: 2,443
Thanks: 0
Thanked 5 Times in 5 Posts
pistol101 seems to know their stuff
  Re: Merchant Scraping

As TBP has said some merchants are really against it. In certain sectors the merchants are actually charged for searches. Many merchants will simply block your spiders.
__________________
Peter Dickenson Peter@affiliatefuture.co.uk

Barbados...We hired a theme park....join the affiliatefuture cult
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #6 (permalink)  
Old 27-07-07
Registered User
 
Join Date: Aug 2006
Posts: 72
Thanks: 0
Thanked 0 Times in 0 Posts
QualityNonsense is an unknown quantity at this point
  Re: Merchant Scraping

Anthracite (Metafy LLC >> MacOS X Software for Web Mining Automation) is excellent, costs $99 or so and there's a free trial. It's Mac only, though.

You create a custom scraper for each site with a drag 'n' drop interface.
__________________
Domain Lookup Firefox Extension
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #7 (permalink)  
Old 27-10-07
John Jupp's Avatar
The New 'Arfur Daley
 
Join Date: Mar 2004
Location: Kent UK
Posts: 2,308
Thanks: 29
Thanked 37 Times in 28 Posts
John Jupp is an unknown quantity at this point
  Re: Merchant Scraping

Hmmm. $99 eh! We've just developed a software tool that does all that and more. Guess I'll have to look into retailing it. It creates lovely datafeeds.
__________________
Read Our Blog, London/New York/San Francisco Affiliate Program Management - Contact Us
My Contact Details: Terrasip: 21100004227 @ terrasip.net Skype: john_jupp
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #8 (permalink)  
Old 28-10-07
Registered User
 
Join Date: May 2006
Posts: 41
Thanks: 0
Thanked 0 Times in 0 Posts
wackimonki is an unknown quantity at this point
  Re: Merchant Scraping

Yes, I would always ask permissions before scraping data. I've produced a website before using data scraped from a government website. After getting some decent traffic, we also got a cease and desist phone call.

I would say datafeeds all the way. I'm using PPC, and they have all the information I need.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply

Bookmarks


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is On
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Thread Thread Starter Forum Replies Last Post
Bristol a4u get2Gether - Who's Who - Attendee List Matthew Wood Affiliate Marketing Events 25 24-02-06 11:50 AM
New try, Networks vs In House allaffiliatepro The Affiliate Marketing Lounge 28 18-01-05 02:29 PM
Conflicting Affiliate Cookies darrenw The Affiliate Marketing Lounge 26 25-10-04 10:31 PM
eDirectory Affiliates Newsletter Pistol101 Affiliate Future 0 22-07-03 08:48 PM


Affiliate Marketing RSS Feeds - Contact Us - Affiliate Marketing - Archive - Privacy Statement - Top

Content Relevant URLs by vBSEO 3.2.0 RC7