The Setup Process
- Develop your context - what data will this chatbot sit on top of? You want your companion app to only reference the context you provide it with, to avoid hallucination. So the chat experience will only be as good as the underlying context.
- Connect your data source - the app then connects to any number of data sources, wherever that data lives. Pay attention to whether you want the app to continue syncing with that data source over time, or if it should be a one-time import.
- Set up access - how is the chat bot best used? A private link you’ll just use yourself? Something you’re going to set up for a client to use? Or a bot that should be connected to your team’s chat app?
Optimization
The devil is in the details when it comes to making these bots work well. Some common hiccups:
- The context includes visuals or tables that the bot can’t pull meaningful information from
- No context is provided that addresses the user’s specific question
- Users have different expectations for the boundaries of what the bot will and won’t talk about
- GPT-3.5 may not perform well enough, in which case try switching to GPT-4
Tools
ChatThing