Guardian Anywhere: reviewing the reviews
Our Guardian Anywhere product has been in the Android Marketplace for nearly a couple of years now, and every so often I run through the feedback. It tends to be positive: the 1,116 ratings we've had from the 64,300 downloads to date have averaged at 4.5 stars out of 5; but we've also had a few hundred reviews of the product written, and I wanted to see what might be lurking in these.
The Android Marketplace doesn't let you programmatically download reviews, but there's an excellent unofficial project which you can use to grab them. An hour or so playing with that gave me a nice dump of reviews which I could throw into a Google spreadsheet.
Once there, I started to look through them to find patterns. Where a review mentioned something specific which we could address or add as a feature, I recorded it, leaving me with this list:
- Fatal error
- Speed of downloading content
- Reliability of downloading content
- Tablet version
- Missing stories or sections of content
- Improved sharing facilities
- Use of storage, or desire to install to SD card
- User interface issues (often fonts)
- Battery life worries
- Old content
- Videos, podcasts or multimedia
- Changing intervals between downloads
I matched this list against all reviews, and against those from the last 6 months (we've made quite a few amendments and improvements to the product over the last couple of years, so really old feedback may already have been addressed). The top 5 items from the last 6 months are:
- Download speed (23% of coded comments)
- Use of storage (23%)
- Fatal error (15%)
- Download reliability (15%)
- Improve sharing (8%)
...and from the lifetime of the product:
- Download reliability (31%)
- Download speed (25%)
- User interface (12%)
- Use of storage (10%)
- Fatal error (9%)
What have I concluded from this?
- In terms of what users most readily ask for, speed and reliability are more important than additional features;
- We successfully addressed many of the UI concerns in early version of the product (only one review in the last 6 months mentioned the interface);
- Android app downloaders are particularly concerned with how their on-device storage is used;
- Multimedia, crosswords or other advanced features were surprisingly rare requests;
I've also been going through the analytics we have installed in the product; not in detail yet, but I can see that in the last month we had 828k page-views of articles, and just shy of 55k views of a photo in the last month. On average users are spending 6 minutes on each article, which feels high.
The Guardian Anywhere has a couple of alternative means of navigating stories: "Picks", which is an automagically generated set of personalised articles, based on your reading habits; and the "Tag Cloud", a list of all tags from current articles, sized according to their popularity. Picks is generally more popular, with 23k visits last month compared to 7k for the Tag Cloud. My gut feeling is that we should drop the tag clouds and do a little more with Picks - perhaps highlighting when it's activated and encouraging users to go there.
And from the Android market stats, I can see that our users are slightly more likely to have recent versions of Android (87.6% have Android 2.0 or above compared to 80.6% of average users of news apps) and are, as you'd expect, UK-biased (72.7% in the UK compared to 4.9% of most news app users).