Have an account? / Register

Forgot your password?

Forgot your username?

Results 1 to 4 of 4

Thread: Merging data feeds from different sources

  1. #1
    Registered User
    Join Date
    Jan 2011
    Posts
    4
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Merging data feeds from different sources



    Hi,

    I am newbie to affliate marketing. I am planning to start a deals website. I have applied for most of the affliates listed above in the other group. I have few fundamental questions about dealing with the feeds
    1) I could see that some of the affiliate networks provide us with the dynamic data feeds with the help of API (eg: CJ.com) .. As when we get the feeds from different networks, they would have different XML formats . How can we merge them and display it in the site.

    2) There are some networks which provide static data feed in csv or xml format, Do we need to have process to read them and store them in the Database.

    Is it like for both the options we need to store the data in the data base and then read from it. Cant we directly hit the API and parse and display in the Website.

    Sorry for being naive, Any help is much appreciated,

    Thanks
    Hari

  2. #2
    Registered User D-Mac's Avatar
    Join Date
    Mar 2004
    Location
    Surrey
    Posts
    1,353
    Thanks
    29
    Thanked 52 Times in 46 Posts

    Re: Merging data feeds from different sources

    My personal preference is to store the data in a database, then read from that. You can run directly from the APIs, but it means your content is:
    a) dependant on the API responding properly
    b) makes it more of a faff to clean the data before you display it
    David Macfarlane
    Cost effective web development. Codewise

  3. #3
    Registered User
    Join Date
    Jan 2011
    Posts
    4
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: Merging data feeds from different sources

    Quote Originally Posted by D-Mac View Post
    My personal preference is to store the data in a database, then read from that. You can run directly from the APIs, but it means your content is:
    a) dependant on the API responding properly
    b) makes it more of a faff to clean the data before you display it

    Thank you for the information. I see your point using API's.
    If we store in the database we can store relevant fields and update them periodically (may be every night) with a script.

    How frequently do we need to update the data? I used to have a product comparison site pulling data from google API .. there was a restriction of saving the data into the local DB . Does any of the affiliate networks have this restriction.

    Thank you once agian for the help.
    Hari

  4. #4
    Registered User D-Mac's Avatar
    Join Date
    Mar 2004
    Location
    Surrey
    Posts
    1,353
    Thanks
    29
    Thanked 52 Times in 46 Posts

    Re: Merging data feeds from different sources

    No affiliate networks that I know of have this restriction. Updating once a day is usually sufficient, although some merchant feeds are updated less frequently than this.
    David Macfarlane
    Cost effective web development. Codewise

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
To Top

SEO by vBSEO 3.6.1