Customer Reviews RSS feeds

Hi,


I'm a backend developer and I try to create a script (in nodejs) that download reviews from countries where there is a purchase. To help me I have created this node module called iReviews (https://www.npmjs.com/package/ireviews). It works great but It doesn't download all the reviews.

I think that there is restrictions on the number of request per IP but I'm not sure. For example I have 2 applications with 117 and 39 countries, AppAnnie says that for the application with 117 there is 208 reviews and with my script I can get only 116 or sometimes 189. Also sometimes I can get reviews for an application in a country in the browser but not with my script.


So I came here to find some help and find why I can't get all the reviews from Apple customer reviews rss feeds.

My question is, how can I get all the reviews (all pages) for applications in some countries each days with a script ?


Thanks.

MacBook Pro, OS X Yosemite (10.10.2)

Posted on Mar 19, 2015 2:16 AM

Reply
5 replies

Mar 19, 2015 4:31 AM in response to FluxB0x

So AppAnnie says there are 208 reviews total? What is the maximum number of reviews that you get per country? Each feed request may be limited by a maximum number of entries. It may also be limited by age of entry. The expectation is that a feed is just the most recent. If a given feed only returns 10 entries at a time, and you check a feed once an hour, and there are 11 new entries per hour, then you will miss 1 entry per hour. An established system like AppAnnie probably saves each entry in its own database. You should do that too. Also, don't forget to do HEAD checks with an "If-Modified-Since" header. That is very important with a feed and should keep you from hitting any IP or frequency restrictions.

Mar 20, 2015 8:45 AM in response to FluxB0x

I guess I stand corrected. I've never seen that before.


It looks like iTunes is limited to a maximum of 10 pages. In practice, it doesn't matter because in addition to "next", there is also a "last". You would keep following the "next" links until your current URL is the same as the "last" URL. Maybe that is 10 today or 20 tomorrow.


The feed URL you posted has 51 entries, not 50. There is no counter in the XML content and you can't assume any specific count. You just have to process each /feed/entry node.

This thread has been closed by the system or the community team. You may vote for any posts you find helpful, or search the Community for additional answers.

Customer Reviews RSS feeds

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple Account.