Location: Community Settings >> Dashboards >> Reporting
This article will walk you through the different areas of the Engagement Dashboard.
- Community Summary
- Monthly Visitor Stats
- Top Members
- Activity Trends
- Stage Activity Snapshots
- Outcome & Engagement Alerts
Shows a snapshot of the cumulative activity your efforts have generated!
The community summary will help you monitor activities on a global level and set goals for increasing certain activities per capita.
In the above example, I might be content with one comment per member on average, but I might set a goal for one idea per member on average and tailor my outreach and engagement efforts accordingly.
Monthly Visitor Stats:
The monthly visitor stats provide a snapshot of activity within your community this month. You can track the overall number of visitors this month, and you can track the percentage (%) of those visitors who took key actions: submitted, commented, voted.
You can use the filters at the top to display data by:
- Campaign (only display data for users who visited a specific campaign)
- Group (only display data for users from a specific group)
- Custom Profile response (only display data for users who gave a particular response to a custom profile question).
The following are the calculations made within this report, with the numbers provided corresponding with the purple numbers to the top right of each data type.
1. Unique visitors: Visitors within in the context of this report refers only to members that logged-in to your community this month (to learn more about tracking overall web visits, ask about our Google Analytics Integration).
2. % change in unique visitors: The percentage change in the number of unique visitors is calculated in the following way:
(unique visitors SO FAR during current month - unique visitors IN TOTAL previous month) / unique visitors in previous month) * 100.
3. Submission Rate, Comment Rate & Vote Rate: The % of visitors who completed the key actions of submitting, commenting, and voting are calculated as follows (example is calculating for % submitted):
(number of visitors who submitted at least 1 idea this month / total unique visitors this month) * 100
These can be considered as “conversion rates”, as they represent that rate at which you have converted a ‘visitor’ to a ‘submitter’, ‘voter’, or ‘commenter’. The blue tick-mark on each display indicates the average “conversion rate” across all IdeaScale communities in your region (region is defined by the server hosting your community).
4. Change in rate of key actions: The change in % of members taking key actions is calculated in the following way (example is given for % submitted):
% unique visitors who submitted this month - % unique visitors who submitted last month
This feature helps you set monthly goals for increasing engagement in specific areas. By monitoring these metrics, you can tailor your engagement strategy for fulfilling your overall engagement goals.
In the example above, we have 42 unique visitors, which is almost 30% shy of our total unique visitors last month. Ten days remain in the month of August. We could set a goal for matching or surpassing the number of unique visitors from last year. See our Innovation Assistant on the right side of the Engage Dashboard for tips, tricks, and tactics to improve engagement.
Top members provides a quick way to spot the top contributors to your community as a whole as well as each individual campaign. This is how you can track the individuals with the highest participation in 4 categories:
- Most Votes
- Most Comments
- Most Ideas
- Most Stage Actions
All the data here is based on simple counts of activity within your community. This tool can be used to identify people to recognize as top contributors to the community. You can also link to your overall leaderboard using the View Leaderboard button at the bottom of the display.
The Activity Trends graph lets you quickly monitor the activity of both members and moderators across the entire community, or from campaign to campaign.
One of the powers of this graph is the multitude of ways that the filters can be used to display specific segments of data. We recommend experimenting with the filters.
We have provided a summary of some key calculations below.
- User activities such as commenting, voting and idea submission are totalled through simple addition and provided in either a weekly or monthly breakdown. Filtering by group or custom profile response will display activity by specific segments of your crowd. Filtering by campaign will show actions taken within that campaign. Filtering by custom field responses will filter for activity taken on ideas where that response has been selected.
- The Net Activity Score is calculated by summing the key activities that occur within your community. Idea submissions, comments, votes and stage actions are combined in a simple way to reflect the total activity in each of your campaigns (and over time). Votes are consistently more numerous than other activity types across IdeaScale communities. This is accounted for by weighting votes less than other activities. Also, ‘Down votes’ are weighted less than ‘up votes’. This leads to the following calculation:
Ideas + comments + (0.3 * (up votes - (0.8 * down votes))) + stage actions
- Stage Actions vs Idea Stage Changes: These two activity types sound similar, but are actually very different. It is, therefore, worth clarifying the different definitions. Stage actions totals all the actions users have taken to contribute to non-ideate stages (such as reviews submitted, teams joined etc). Idea Stage Changes totals all the times that ideas have changed stage. When recording the stage change data we are recording all activity without differentiating between “forward” and “backward” movement; moving 10 ideas back to your first stage will register as 10 stage changes, just as moving those same 10 ideas back to your second stage will register another 10.
Stage Actions = Reviews Submitted + Reviews Modified + Refinement Answers Submitted + Refinement Answers Modified + Estimates Submitted + Estimates Modified + Fund Submissions + Fund Submissions Modified + Assessment Submitted + Assessments Modified Idea Stage Changes = Number of times ideas within the system have changed stage (irrespective of the “direction of change”)
- When filtering activity data by Campaign we only display data relevant to that campaign.
- When filtering by Custom Field Response we only display data pertaining to ideas that have that custom field response selected.
- Within the Activity Trends data, five activity types are considered User Activities: Net Activity Score, Ideas, Comments, Votes and Stage Actions. When filtering these activities by Group or Custom Profile response the filter will be applied by only including activities taken by members of that group and/or members who had selected that Custom Profile Response. So, for example, when filtering for Activity = “votes” and filtering for Group = “Sales” we would be looking at the following data:
number of votes cast by members of the group sales on all ideas
- Within the Activity Trends data, three activity types are considered Moderator Activities: Idea Stage Changes, Moderator Activity Count, and Moderator Activity / Idea Submission (which is a ratio of moderator activity per idea submission). When filtering these activities by Group or Custom Profile Response the filter will be applied by only including activities taken on ideas where the submitter was a member of that group and/or had selected the appropriate Custom Profile Response. So, for example, when filtering for Activity = “Moderator Activity Count / Idea Submission” while filtering for Group = “Sales” we would be looking at the following data:
number of actions taken by moderators on ideas submitted by members of the group “sales” / number of ideas submitted by members of the group “sales”
Below is an example, where I have filtered for Activity = “Net Activity Score” and Campaign = “Moderation and Administration”, which is one of the public campaigns on the IdeaScale Feedback Community. I then zoomed in to see the activity since last September. I can see we had a dip in activity in December, which is not surprising given the holidays. Activity peaked in the first three months of the year. It dipped again in April. Is this due to the distractions of Spring Break and Easter holiday? Activity is creeping up again.
Stage Activity Snapshots:
The Stage Activity Snapshots gives a quick overview of how much activity related to each stage type has been taking place within your community. The main numbers provides your community’s lifetime total activity within each category, the line below each of the headline numbers lets you know how much activity has occurred over the last 90 days and the color indicates the direction of change (green for higher than average activity and red for lower than average activity).
Community Members = Total Community Members (excluding banned or purged members)
Idea Team Members = (Idea Team members who join a team + idea team members who are assigned to a team) - team members who are unassigned from or leave a team
Fund Allocations = Number of times users have pledged funds to an idea. This is based on the “MEMBER_PLEDGE_FUND” event and counts each pledge (including if a single user pledges to the same idea multiple times)
Reviews Completed = # of times an individual user has completed ALL review questions on a particular idea + # of times an individual user has completed ALL assessment questions on a particular idea
Estimation Completed = # of times individual users have completed all estimates for a particular idea.
Refinements Submitted = # of times all refinement questions are completed for an idea
Pairwise Comparisons = # of times users have completed ALL comparisons in a pairwise batch or survey.
Outcome & Engagement Alerts:
These Alerts can be seen on the right hand side of the Engagement Dashboard and are bucketed into two categories: Outcomes & Engagement. Within these two buckets there are seven types of Alerts you might see (details below). For each Alert you can see what the Alert is indicating, details, date when Alert was triggered, and helpful links that are specific to that Alert.
- Drop in Submission: will trigger when a campaign has seen a 20% drop in submission over the last week
- Less than 50% of ideas received a comment: triggers when less than 50% of ideas submitted to your community are receiving a comment
- Slow Start in campaign: triggers when a campaign is 15 days old and has less that 10 ideas
- No ideas implemented this month: triggers when no ideas get moved to implemented in the current month
- One week left: triggers from the end date on a campaign
- Aging ideas (45 days): triggers when the average time spent of ideas in a certain stage is over 45 days
- Aging ideas (3 months): triggers when the average time spent of ideas in a certain stage is over 3 months