One of the areas that customers often discuss in relation to an Intelligent Advisor project is the need to understand and track usage patterns. What kind of flow are users taking through the Interview, how many are dropping out of the expected Interview flow, and so on. They often talk about comparisons of different versions of the same Interview. And then they turn and look at us, the Intelligent Advisor people, and ask how much that will cost. They want Interview Statistics!
On this occasion we can give them good news – pretty much everything they might need is already in the product. For example:
Hub vs Project Statistics
Built-in to the Hub we have Interview Statistics either at the Hub level (so, comparing and analysing across all projects that have been deployed) or at the single project level (for example, comparing two versions of an Interview or looking at the details for a single Interview version). So where are all these Interview Statistics? In the Hub.
Let’s take look at some of the excellent features. To get there, just click the Metrics Zone once you are viewing a deployed project.
So now we can view the different charting options, such as looking at the screens visited and how many sessions dropped out:
In the above diagram, you can see that 20% of people (red) did not get past screen 1. Only 80 percent made it to screen 2. Of course if you have several versions of your deployed project you will maybe want to overlay multiple versions and look at that instead. In the following example I have clicked the Add button above and added a couple of versions, one of which included an extra screen (version 2). My interview statistics are pretty poor since this project was only used a few times, but notice that the default is for 30 days of analysis.
In the next example, I’ve selected to view the averge time spent in the screens as my users work through my very simple interview. It’s one of the preset report types that I encourage everyone to know about:
Of course, it is not always possible to find exactly what you want in the preset data analysis types. So you can select Custom and build a customised Interview Statistics analysis based on your desired timeframe, versions and style of chart:
And you probably will want to get this data into Power BI or Excel or both, so you can always download the information in CSV format:
All in all this is a very good start. Of course we can go further and use tools like Selenium and so on, but sometimes out of the box is more than enough! You can learn more about these cool features here.