Results 1 to 3 of 3

 

Thread: PHP CURL question

  1. #1
    Registered User

    Status
    Offline
    Join Date
    Sep 2003
    Posts
    315
    Thanks
    28
    Thanked 19 Times in 16 Posts


    I'm using CURL a lot on my websites but it has one major problem. Some pages use javascript and other elements which CURL does not pick up. Instead, it scrapes the page before the data I need has been shown. ie. it sees a different page to what surfers see.

    Is there a way to get CURL to scrape the page after everything has been fully rendered?

    Here's an example:

    http://www.dabs.com/products/toshiba...eady-5HV0.html

    This page when scraped does not show the prices.

    Thanks

  2. #2
    Registered User

    Status
    Offline
    Join Date
    Mar 2007
    Posts
    68
    Thanks
    0
    Thanked 4 Times in 4 Posts
    why not use the data feed to get the prices instead of scraping the website i do believe DABS is on the TD programme

  3. #3
    Registered User

    Status
    Offline
    Join Date
    Sep 2003
    Posts
    315
    Thanks
    28
    Thanked 19 Times in 16 Posts
    Thanks, hadn't thought of that. Where can I read more about datafeeds?



Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. cURL instead of fopen_url HELP!
    By bhutastuta in forum Programming
    Replies: 9
    Last Post: 19-08-08, 04:10 PM
  2. wget / curl
    By morleymouse in forum Programming
    Replies: 4
    Last Post: 13-03-05, 12:30 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
To Top

Content Relevant URLs by vBSEO 3.5.0 RC2