Access Groups: Pulse
Overview
The Pulse tab within a project shows detailed data from Pulse surveys. You can view how the scores have changed over time, see the data for the latest survey, and see the scores for every survey that has been sent. You can also view detailed response and participation information for each survey, resend surveys, and copy shareable survey links.
Pulse Tab
The Pulse tab shows the following information:
- Average Over Time—The average Client Pulse and Team Pulse scores for all time. You can check or uncheck these to show or hide them from the graph on the right.
- Pulse Scores Graph—The Pulse scores over time. Hover over a point to see the survey date and score.
-
Client Score detail and Team Score detail—Data
from the latest survey is shown.
- Score and trend
-
Participation rate and trend
Note: A low participation rate may disproportionately affect the score. - Happiness score
- Confidence score
- Collaboration score
- Pulse Scores Table—The table at the bottom lists all the surveys that have been sent and their scores. Click the Link icon to view more information for that specific survey.
Scores appear with the following colors, allowing you to see where you’re doing well and identify problem areas at a glance:
- Scores between 0 and 3.9 appear in red.
- Scores between 4.0 and 6.9 appear in yellow.
- Scores between 7.0 and 10 appear in green.
Survey Responses Page
On the Pulse Survey Responses page, you can see detailed response and participation information for the survey, resend surveys, and copy shareable survey links.
The following information is available on the left side of the page:
- The overall score for the survey and how the score has changed since the previous survey.
- The survey’s participation rate and how the participation rate has changed since the previous survey.
- Options to resend the survey to all non-respondents and export the data in the table as a CSV file.
- Each respondent’s name and profile picture.
- How many questions the respondent answered.
- The date the respondent answered the survey.
- The respondent’s score.
- Options to copy a personalized survey link for the respondent and to resend the survey via email.
If you don’t have permission to see respondent names, the table will show only how many recipients responded to the survey, the date of the last survey submission, and a button to resend the survey to all non-respondents.
The following information is available on the right side of the page:
- The question category: happiness, confidence, or collaboration.
- To the upper right of the question text is a count of how many responses were submitted for the question. Select the Expand icon beside [#] Responses to see the individual responses.
- To the left of the question text is the average score, calculated from the individual responses. This helps you understand how each question contributes to the overall score.
- The horizontal colored bar below the question text breaks down the distribution of responses. High scores are in green, medium scores are in yellow, and low scores are in red.
-
If you have
permission
to see respondent names, you’ll be able to see the respondent names for
each
response.
If you don’t have permission to see respondent names, you’ll see the scores without names. If multiple respondents had the same score, they will be grouped together. -
If the question has text responses, they will appear below the score
breakdown.
If you have
permission
to see respondent names, you’ll be able to see the respondent names for
each
text response.
If you don’t have permission to see respondent names, the text responses will not display the respondent names.Note: The score that appears beside a respondent’s text response is the same score as the one in the score breakdown.
TIP
You can also ask the Project Agent to summarize and analyze Pulse survey results.
How to Resend Pulse Surveys
- Select the Pulse tab in a project.
-
In the Pulse Scores Tables at the bottom, locate the
survey
you would like to resend, then select the Link
icon.
The Survey Responses page opens. -
To resend the survey to an individual recipient, in the recipients table,
select the Send
icon that is inline with the recipient
you would like to resend the survey to.
Note: This option is only available if you have permission to see respondent names. -
To resend the survey to all non-respondents, select the
Send
icon above the recipients table, then select
Resend in the confirmation modal that appears.
How Pulse Scores are Calculated
The Pulse score is the average of all the responses, while each category score is the average of the responses for that specific category. Because respondents can skip questions, the Pulse score may not always be equal to the average of the category scores. Skipped questions are not included in the score calculations, which affects the denominators used in the calculations.
This can be illustrated with two examples.
Example 1: Respondents skipped questions
In this example, two users respond to a survey as follows:
User 1 |
User 2 |
|
|---|---|---|
| Question 1 - Confidence |
5 (on 5-point scale) |
4 (on 5-point scale) |
| Question 2 - Happiness |
5 (on 5-point scale) |
SKIPPED |
| Question 3 - Collaboration |
5 (on 5-point scale) |
2 (on 10-point scale) |
Before calculating the scores, answers on a 5-point scale are converted to a 10-point scale in the following way:
| Selected answer | 1 |
2 |
3 |
4 |
5 |
| Converted value used in calculation | 0 |
2.5 |
5 |
7.5 |
10 |
Therefore the values used in calculations are as follows:
User 1 |
User 2 |
|
|---|---|---|
| Question 1 - Confidence | 10 |
7.5 |
| Question 2 - Happiness | 10 |
SKIPPED |
| Question 3 - Collaboration | 10 |
2 |
The Pulse score is the average of all answers, excluding skipped answers:
(10 + 10 + 10 + 7.5 + 2) / 5 = 7.9
The Confidence score is the average of responses to the Confidence question:
(10 + 7.5) / 2 = 8.75
The Happiness score is the average of responses to the Happiness question:
(10) / 1 = 10
The Collaboration score is the average of responses to the Collaboration question:
(10 + 2) / 2 = 6
(For illustrative purposes only) The average of the category scores is:
(8.75 + 10 + 6) / 3 = 8.25
This is not the same as the Pulse score (7.9), because one respondent skipped a question.
Example 2: Respondents did not skip questions
In this example, two users respond to a survey as follows:
User 1 |
User 2 |
|
|---|---|---|
| Question 1 - Confidence |
5 (on 5-point scale) |
4 (on 5-point scale) |
| Question 2 - Happiness |
5 (on 5-point scale) |
4 (on 5-point scale) |
| Question 3 - Collaboration |
5 (on 5-point scale) |
2 (on 10-point scale) |
Before calculating the scores, answers on a 5-point scale are converted to a 10-point scale in the following way:
| Selected answer | 1 |
2 |
3 |
4 |
5 |
| Converted value used in calculation | 0 |
2.5 |
5 |
7.5 |
10 |
Therefore the values used in calculations are as follows:
User 1 |
User 2 |
|
|---|---|---|
| Question 1 - Confidence | 10 |
7.5 |
| Question 2 - Happiness | 10 |
7.5 |
| Question 3 - Collaboration | 10 |
2 |
The Pulse score is the average of all answers, excluding skipped answers:
(10 + 10 + 10 + 7.5 + 7.5 + 2) / 6 = 7.8
The Confidence score is the average of responses to the Confidence question:
(10 + 7.5) / 2 = 8.75
The Happiness score is the average of responses to the Happiness question:
(10 + 7.5) / 2 = 8.75
The Collaboration score is the average of responses to the Collaboration question:
(10 + 2) / 2 = 6
(For illustrative purposes only) The average of the category scores is:
(8.75 + 8.75 + 6) / 3 = 7.8
This turns out to be the same as the Pulse score, since no one skipped any questions.
How Pulse Participation Rates are Calculated
The Pulse participation rate indicates how many people have responded to at least one question in a survey. The participation rate is not how many questions have been answered in total.
Example
A Pulse survey consisting of 3 questions is sent to 5 people. The 5 people respond as follows:
- Alice responds to 3/3 questions
- Bob responds to 1/3 questions
- Caroline responds to 3/3 questions
- Dana has not taken the survey
- Evan responds to 2/3 questions
The participation rate is 80% because 4 out of 5 people responded to at least one question in the survey. Bob and Evan did not fully complete the survey, but they are still counted as having participated.
Additional Considerations
- If a user clicks the survey link in the email (as opposed to an answer button) then skips all of the survey questions, that is not considered a response. This person’s activity would not be included in the participation rate.
- If different surveys were sent out on the same day, the table in the Pulse tab will display the surveys separately, but the survey detail page will combine the survey data. The Pulse scores and participation rates shown in the table will differ from those shown in the survey detail page.
Interpreting Category Scores
Each survey question belongs to one of three categories: happiness, confidence, and collaboration. When both internal and external Pulse surveys are enabled, you’ll be able to identify any disconnect between how the internal team and clients feel about the project.
For the internal team:
- Happiness scores for the internal team indicate whether team members feel recognized, supported, and personally fulfilled; and how high their job satisfaction is.
- Confidence scores for the internal team indicate how team members feel about the project strategy, alignment with the client’s goals, and ability of the team to overcome challenges.
- Collaboration scores for the internal team indicate how team members feel about the ease and frequency of communication, cooperation amongst the team, and the overall working relationship.
For clients:
- Happiness scores for clients indicate whether clients are happy with the project’s progress, the delivered work, and the value of the services received.
- Confidence scores for clients indicate how clients feel about the team’s ability to meet objectives, manage risks, and deliver high quality work.
- Collaboration scores for clients indicate how clients feel about the interactions with the project team, alignment of expectations, or the communication strategy.
For more information about what each category measures, see the Kantata Pulse Question Categories article.
Comments
1 comment
This article has been updated to include information about how Pulse participation rates are calculated.
Please sign in to leave a comment.