How to analyze sentiment of Qualtrics CSAT Survey Comments with generative AI

Sentiment Analysis

Qualtrics

As a business, it’s important to know what your customers think about your products and services. Qualtrics Customer Satisfaction (CSAT) surveys measure customer satisfaction and provide valuable insights into how they perceive your brand. However, analyzing open-ended feedback comments can be time-consuming and challenging. In this post, we’ll show you how to use generative AI to automatically perform sentiment analysis on Qualtrics CSAT survey comments.

What is Sentiment Analysis?

Sentiment analysis is a natural language processing (NLP) technique that uses machine learning algorithms to automatically identify and extract emotions or opinions expressed in a given piece of text.

The algorithms are trained on a labeled dataset of text samples, where each sample is labeled with its corresponding sentiment (positive, negative, or neutral). The model learns to recognize patterns and features in the text that are associated with different emotions and uses these patterns to predict the sentiment of new, unseen text.

Sentiment analysis has many applications, such as customer feedback analysis, social media monitoring, and market research. It's a powerful tool for organizations that want to understand how people feel about their products or services or to track public opinion on different issues. It can help automate tasks and extract valuable insights from large amounts of text data.

Example Use Cases

Some use cases for performing sentiment analysis on Qualtrics CSAT survey comments include:

Identifying common pain points and areas for improvement
Tracking changes in customer satisfaction over time
Identifying trends and patterns in customer feedback
Improving customer experience and retention
Informing product development and marketing strategies

Teams that might find these use cases helpful include customer support, product, marketing, operations, and management.

Accessing Your Data and Confirming Your Sentiment Scale

You first need to identify the data that you want to work with. Here, we are looking at Qualtrics CSAT survey comments. You can export this data in CSV or Excel format and upload it into your preferred data analysis software.

Next, you need to confirm the sentiment scale you will use for assessing customer sentiment. Typically - sentiment is measured on a scale of -1 (most negative) to 1 (most positive). You also may assign sentiment ratings.

Here is an example of a sentiment rating scale:

Very Positive
Positive
Neutral
Negative
Very Negative

Once you have your data and sentiment scale, you can use generative AI to automatically assess the sentiment of your Qualtrics CSAT survey comments. This will help you identify areas for improvement and make data-driven decisions to improve customer satisfaction.

For more information on how to use generative AI for sentiment analysis in Qualtrics, check out this tutorial: https://www.qualtrics.com/support/survey-platform/survey-module/survey-flow/advanced-elements/automated-insights/

Using AirOps to perform Keyword Identification

With AirOps, you can easily extract relevant keywords and phrases from your text-based data using the Keyword Identifier data app. Here's how:

Select "Keyword Identifier" from the Data Apps page. The input required for Keyword Identifier is the "text_field" which is the input text data.
Decide where you want the analysis to be performed and stored. The Keyword Identifier data app can be easily used in the AirOps Data App page and via API, but in this example, the analysis will be performed in Snowflake through an external function called AIROPS_KEYWORD_IDENTIFIER.

Here is an example SQL query:
```
SELECT
AIROPS_KEYWORD_IDENTIFIER(text_field) as result
FROM
your_table
```
Execute the keyword extraction analysis by running the SQL query. The output will contain an array of keywords and phrases extracted from the input text data.

Example Input:

"Hello, I am having trouble with my account. I cannot seem to log in and I have tried resetting my password multiple times."

Example Output:
```
"keywords": ["trouble", "account", "log in", "resetting", "password", "multiple times"],"summary": "A customer is having trouble logging into their account and has tried resetting their password multiple times."
```

Using AirOps to perform Sentiment Analysis

With AirOps, you can easily perform sentiment analysis on any text data such as reviews, support tickets, or sales calls using Sentiment Analyzer. Here’s how:

Select "Sentiment Analyzer" from the Data Apps page. The only input for Sentiment Analyzer is some text to analyze.
Decide where you want the analysis to be performed and stored. The Sentiment Analyzer data app can be easily used in the AirOps Data App page and via API, but in this example, the analysis will be performed in Snowflake through an external function called AIROPS_SENTIMENT_ANALYZER.

Here is an example SQL query:
```
SELECT
AIROPS_SENTIMENT_ANALYZER(text_field) as result
FROM
your_table
```
Execute the sentiment analysis by running the SQL query. The output will contain a sentiment score and sentiment summary, as well as a list of positive and negative keywords extracted from the input text data.
Input:
"I'm sorry to say that I had a terrible experience with your product. The customer service was unresponsive and the product didn't work as advertised."
Output:
```
"positive_keywords": [],"negative_keywords": ["terrible experience", "customer service", "unresponsive", "product", "didn't work", "advertised"],"score": -0.8,"sentiment": "Very Negative"
```

Using AirOps to perform Text Classification

With AirOps, you can easily perform classification using generative AI. Here’s how:

Select "Text Classifier'' from the Data Apps page. Below are the possible inputs for Text Classifier.text_field: The input text data.categories (optional): Categories can be specified as a comma-separated list. Leave empty for automatic determination.multi_category: Set to “true” if the text can belong to multiple categories, or “false” if it can only belong to one category.
Decide where you want the analysis to be performed and stored. The Text Classifier data app can be easily used in the AirOps Data App page and via API, but in this example, the analysis will be performed in Snowflake through an external function called AIROPS_CLASSIFIER.

Here is an example SQL query:
```
SELECT
AIROPS_CLASSIFIER(text_field, categories, multi_category) as result
FROM
your_table
```
Execute the classification analysis by running the SQL query. The output will contain a list of keywords extracted from the input text data that are relevant to the identified categories and a list of categories that the input text data belongs to based on the provided categories or automatic determination.

If you have feedback, please let us know!