How do i acquire the list of all possible products ?

By Abhishek Sharma on May 30, 2013 5 Comments / 2058 views

How do i acquire the list of all possible products ever manufactured across all categories? Ofcourse the previous statement is an ideal case, but how close can i get to it? Are there any paid services that provide the required info? Or any free service or anything else?

Lets take an example of junglee.com. They have a good listing of many (1.8 crore as stated in their website) products along with its specs. How can i acquire that data? Scraping junglee would be an option but would that be ethical? Moreover it would take a good amount of time given the bandwidth and hardware resources i have.

Any help would be appreciated. Thanks in advance.

Comments

Abhishek Sharma

5 Comments

Aparna May 31, 2013, 5:05 am

If you are just starting up, I would suggest you look for broad categories(like books, apparel, laptops) 3-4 below that and then the products under that. Even this is a tiresome process.

I would suggest you go lean as of now then pivot as and when you should. (please check out this https://www.youtube.com/watch?v=fEvKo90qBns for more information).
Abhishek Sharma May 31, 2013, 10:07 am

Thanks Aparna, but my application will work better with more data. The bigger and more variant the dataset, the better the app. So
Indy Singh May 31, 2013, 10:31 pm

You can use the Amazon Product Service API: https://affiliate-program.amazon.com/gp/advertising/api/detail/main.html

or try

icecat.in (For Indian Products)

Are you trying to put together something like Junglee – a CSE?
Abhishek Sharma June 17, 2013, 10:58 am

thanks for your input Indy. No i am not working on a comparison shopping engine. Its more of a product discovery engine. 🙂 anyway thanks
Abhishek Sharma June 17, 2013, 11:00 am

and wow icecat.in is infact very useful for me. Thanks and god bless you. I was struggling for about 2 months to find such data. Thanks a lot Indu