Qualitative Reporting 🎦

Qualitative market research reports present descriptive, interpretation-based data, often using open-ended methods to explore motivations and behaviors. These reports are available for Quick Questions, discussion boards that have at least one comment, and surveys with at least one open-ended response. 

Users can view, sort, filter, and search responses, managing relevance through qualification. Tags and categories organize data, and AI can generate and assign tags for analysis. The AI Summary Tab summarizes comments and identifies patterns. Reports can be securely shared or exported as Excel files for stakeholders.

To access your Qualitative Report...

1. Click the Reports icon on the left navigation bar. The type of activity and type of report are in columns on that table.
2. Click on the report name that you want to view to see your report.

Responses Tab

This section contains the unprocessed responses generated by your activity. The tab name also contains the number of responses available.

Responses include the following information:

• Username
• Date/timestamp
• Member comment
• Any replies to the member's response.
• Any likes of the member's response.
• Any attachments to the member's response.
• Tags—Use descriptive labels or keywords for open-ended answers. This helps researchers (and the Summary generator) sort and find common themes, opinions, or ideas in the data, making it easier to analyze and understand the information.

Above the responses, you can Sort, Filter, or Search responses to view only the responses you wish to see. Qualify or disqualify responses based on relevance or suitability.

Expand Responses

Replies to other members' comments are hidden by default. If you wish to expand the listing to see all comments, click the Expand Responses icon above the original comment and to the right of the username.

You can also click on the response. The Response Overview window appears, displaying all information about the response.

View Attachments

Review the images or files attached in the responses. Click the response to display any associated files. Preview the image by clicking on it. Download the image by clicking the icon below it.

Review Comment Chains

Review replies to comments (if there are any). Click the response to display a response overview window. There is a link to expand replies at the bottom of the window. NOTE replies cannot be seen if images are being previewed at the same time.

Search Responses

Use Search to find responses based on a particular phrase or word.

Filter Responses

Change your display to only show Qualified or Unqualified responses with the Filter. 

Sort Responses

Use Sort By to re-organize your response list and prioritize any of the following:

• Response Date
• Username
• Reply Count
• Likes

Disqualify/Qualify Responses

To make sure that only relevant and appropriate responses are considered...

1. Check the boxes to the left of any responses that are not useful or do not align with the criteria.
2. At the top of the list of responses, click the Disqualify button.

Click the "Select All" checkbox at the top of the responses list to select all responses

Re-qualify your unqualified responses:

1. Use the Filter function to see all unqualified responses.
2. Check the boxes next to the responses you wish to re-qualify.
3. Click the Qualify button.

Tags and Tag Categories

Organize and categorize responses with tags to identify trends, analyze themes, and align findings with research objectives. These structured elements are essential for making large datasets manageable and aligning qualitative data with research objectives. Check out this article for more information on using AI to generate tags and tag categories.

Tags are labels assigned to individual pieces of qualitative data (such as survey responses or discussion comments) that describe key themes, topics, or sentiments.

Categories group related tags into broader themes, enabling researchers to see patterns and relationships within the data. You can think of your tag categories as buckets to classify your tags. For example, in a discussion board on fishing, you may have tag categories for equipment or environment types. The tags within equipment may be: rods, reels, line, lures, etc. The tags within environment types may be: freshwater, saltwater, brackish, pelagic, estuary, etc.

In the list of responses, P2 tags are teal-colored, and the column header contains a person icon. Created tag categories are blue.

Create a hierarchical structure of tags and tag categories to organize your responses. Initially, there are no tags or categories available. You can manually create and assign your tags or allow our AI algorithm to generate and assign tags based on your responses.

To create tags and tag categories, click the + Add New Tag Category button in the top right to begin.

Add Tags Manually

1. Click Create and Apply Tags Manually.
2. In the Title field, add your new Tag Category.
3. In the Define Tags field, one field is automatically provided to add your new tag.
4. Click +Add Tag to provide a space to add another, new tag.
5. Click Save to retain your changes.

You can also add tags through the responses list if the Tag Category already exists.

1. Click in the cell corresponding to the correct Tag Category column and the Response row.
2. Click Add Tags.
3. Select the tag to add to that response.
4. Click Apply.

Create Manual Tags and Apply with AI

1. Click Create and Apply Custom Tags with AI.
2. In the Title field, add your new Tag Category.
3. In the Tag Objective, describe your project objectives to help the AI classify your pre-defined categories. See this article on how to develop research objectives. See this article to identify some sample objectives.
4. In the Define Tags field, one field is automatically provided to add your new tag.
5. Click +Add Tag to provide a space to add another, new tag.
6. Click Apply Tags to continue. After a short time, a notification will alert you the process is finished.

Automated Tags with AI

1. Click Automatic Tagging with AI.
2. In the Title field, add your new Tag Category.
3. In the Tag Objective, describe your project objective to help AI accurately apply your tags. See this article on how to develop research objectives. See this article to identify some sample objectives.
4. Click Generate Tags to continue. After a short time, a notification will alert you the process is finished.
5. If you remain on the page or navigate to the report, you will see the Review Tags page. With AI technology, incorporating human interaction is desirable. This page enables you to review and verify any generated tags and discard any anomalies you might encounter. At the right end of each tag is a delete icon. Click that icon to remove any defined tags you want.
6. When your tags are as you like them, click the Apply Tags button. While tagging is in progress, feel free to leave this page; you will receive a notification when it's complete.
7. Repeat this process from step 3 with any new objectives you wish to apply.

Delete Tags from the Response List

Tags may be deleted on individual responses through the responses list.

1. Click in the cell corresponding to the correct Tag Category column and the Response row.
2. Click the X on the tag you wish to delete.
3. Click Apply.

Tag Category Details

For Hybrid and Auto Tagged reports, in the AI tag category  menu there is an option to View Tag Category Details. This will open a new modal containing all the information about the tag category.

Edit Tag Categories

Edit Category names by clicking the menu icon in the column header and selecting Edit as Manual. Editing any AI-generated tag category will disable AI tagging and switch it to manual tagging. You will need to manage all future tag updates for this category.

Delete Tag Categories

The link to Delete Category is in the same menu as Edit Category. To continue, confirm your action by clicking Delete.

AI Summary Tab

Leverage Fuel Cycle's AI capabilities with this advanced tool to analyze and summarize comments, providing a comprehensive understanding of the discussion. This AI summary can also identify patterns and trends within comments, providing deeper insights into the overall conversation.

Our algorithm automatically analyzes and organizes the content into a coherent summary. The summary is divided into the following sections:

• Background + Objectives—Before summarizing the information, the AI needs to identify the discussion objectives and identify comment tags associated with those objectives. The AI analyzes responses, creates objectives based on standard research principles, and tags all of the responses, using its tags to create better insight and certain levels of quantification within the summary itself. We display it, so the user gets better insight into how the summary was generated.

  The next iteration of Qual Reporting will allow end users to work with those, customize them, or create their own categories and tags that the AI will use.

• Summary—A concise summarization of the overall language and tone of the project results.
• Key Themes—Important, quantified takeaways from the project.
• Recommendations—Recommended actions to take based on the project feedback.

Summary Timestamp

The clock icon contains the timestamp for the last time the AI summary was generated.

Refresh Summary

Click the Refresh button to regenerate your AI summary results. The current summary will be replaced with a new version.

While AI generates the summary, you will see a message to refresh the screen for the results. Depending on the number of report responses, this may take a couple of minutes. You will also receive a notification when the summary generation is completed.

Edit Summary

Click the Edit button to manually change the contents of your Summary.

Click the Save button to retain your changes. You are allowed to keep only the most recent set of edits. You may not undo changes once you Save your edits.

Revert Summary to Most Recent Iteration

While editing your summary, you may revert your changes to the original AI summary by clicking the Revert to Original button. This undoes any edits and returns the summary to the original state or most recent refresh.

Share Report

Give your stakeholders a secure view of your data during fielding, or share quick hits from a community health survey. The page will reflect the report you created and configured in the chart view. Any text edits, sorting, or visibility options set will persist in this new shared view.

Click the Share button in the top right corner of the report.

The Distribution Link tab contains a password-protected, read-only link to your report and a password to share. It's a best practice to share each URL in its self-contained message with your stakeholders.

Email and SMS messages are not secure forms of communication, and sharing these links and passwords in that fashion is at your own risk.

Export Report

The Export tab of the report sharing window contains a button to download an Excel version of the report.