IDEA for Price Comparison: Option to get Live Prices directly scraping product pages from many stores

Closed
3
0

Getting prices from APIs like Zanox, Rakuten Linkshare, etc, often returns old prices because it depends on data uploaded by merchants. Flash sales are not tracked in real time. Also, there are networks not known by Content Egg. My suggestion: allow live price scraping as an option (along with the current method). CSS selectors or Xpath are used to locate the price HTML element. Put URL for direct scraping the price, and another URL field to be clicked (if like to use affiliate links like Zanox, etc). Adding this feature as option, we can decide if want use Content Egg prices or real time scraped prices.

There are several WordPress plugins for web scraping/web crawling that can be studied and implemented. The most complete I know is Wiseloop Web Grabber which has option for setting cache time, removing unwanted tags from content, etc. Web Grabber can be used for any content type and not use iframes. Scraped data are parsed as real HTML.

Hope I made myself clear!
Please, feel free to contact me.
Thanks! Eric

  • You must to post comments
0
0

This is already made in Affiliate Egg plugin https://wpsoul.com/affiliate-egg-deal/

  • You must to post comments
0
0

Hi! It seems Affiliate Egg only works with specific stores which have been mapped by developers, right?

What I’m suggesting is a “universal” solution for live price scraping, so I could use with brazilian stores.

WordPress Price Comparison Pro Plugin is a perfect example, but it’s too expensive for me.

Please, take a look.

  • You must to post comments
0
0

Your link is very bad example, it just adds additional fields for manual adding of prices. It’s not real price grabber and not price updater.

You need to use Content Egg. There are many supported affiliate aggregators in Content Egg, like Zanox, CJ, Shareasale, Linkshare and others.

This is example how to use it with Woocommerce https://www.youtube.com/watch?v=5-9B69fLa24
This is how to use with Posts https://www.youtube.com/watch?v=TZOZ9Hvhp3E

  • You must to post comments
0
0

Hey! No, Please, look carefully, also the video. This plugin adds URLs fields for user inform from where the plugin will fetch the price from different stores and keep tracking them. Additionally, the user may inform the HTML element (CSS selector) which the website uses for prices, but this is done once and only if the plugin can’t find itself.

The Egg family is great, but limitation is that they only work for specific websites mapped by factory. I would like Affiliate/Content Egg could grab live prices from local websites, like here in Brazil. WordPress Price Comparison Pro can fetch live prices from local websites, please take a look again. This would be a nice feature for future Rehub/EGGs update.

Thanks!

  • wpsouladmin
    Ok. I will write this to developers
  • You must to post comments
0
0

This would be a really great idea and much wanted by us as users of the ReHub theme.

  • You must to post comments
Showing 5 results