Improved bot response quality

One major challenge that comes with building an AI agent is that its response quality is dependent on the quality of the data that it’s given. As a result, ensuring high quality responses from Aptible AI has been a journey, but we’ve made some big steps forward over the past few weeks.

Here’s what’s new:

Bot response quality updates

When your on-call engineers rely on accurate information to investigate and resolve incidents as quickly as possible. To ensure that Aptible AI provides the most relevant and helpful information that it can from your data sources. Here’s how we’ve improved Aptible AI’s responses:

• Self-rating: we’re now using AI to quantify how useful the most recent tool call results are to resolving the question that was asked. This self-rating system helps Aptible AI to choose tools and identify stopping criteria when searing for the correct answer.

  

• Links to sources: previously, when the bot would return a Grafana or Datadog dashboard, it would only embed the dashboard in its response. Now the response also includes the link to the source for easy access to further investigation if needed.

  

• Quicker responses: we’ve made adjustments to the bots data fetching that allow it to return a response faster by only grabbing relevant data.

Other improvements:

• UI update: We’ve improved the readability of long, complex conversations in the Threads tab of the Web UI so that it’s easier to understand the human messages vs. the bot’s messages
  
  

  

  
  
  

• New logging assistant: Improved usefulness of logging interactions by creating a standalone logging assistant that’s better at finding the specific section of logs that you need based on the incident