Imagine a scenario where a data analyst needs to generate SQL queries to extract specific information from a complex data warehouse, but without deep knowledge of SQL. Our goal was to create an AI assistant that translates natural language to SQL, and we wanted to find the optimal large language model (LLM) for this task. We needed a solution that balances performance and cost while handling the limitations of context windows. A context window refers to the amount of text […]
This blog post examines the operational expenses of the AI-powered chatbot solution introduced in our previous blog posts, Custom AI chatbot using RAG and Deployment of AI-Powered Chatbot. This solution operates on the AWS cloud while integrating OpenAI’s language model. We will discuss the financial aspects of infrastructure costs and analyze how to estimate expenses for AI resources, such as Language Model as a service. Cost Structure of a Custom AI Chatbot Solution Operating expenses for our AI chatbot solution […]
This blog post focuses on the architecture and deployment of the AI-powered Chatbot solution that we described in our earlier blog post Custom AI Chatbot Development Using RAG. This solution is built for the AWS cloud but uses OpenAI as an LLM. We’ll dive deep into the CI/CD process and AWS deployment architecture of the backend application. AWS Deployment Architecture Our solution represents a rather typical configuration of a web project deployed to AWS. Click or tap on the picture […]
You have probably seen and heard about AI-powered chatbots that can converse with the user about website content, or some piece of knowledge related to a company. The world is full of buzz on all things AI, with chatbots driving the headlines. In this article, we’ll share our experience building a full-blown solution from scratch that empowers such chatbots. The goal is to build a framework that can be plugged in with any knowledge sources and be easily integrated into […]
Chatbots as they come are not something new under the sky. They have populated the web since long ago leaving behind an impressive trail of user annoyance and frustration. Wild repetitions, endless question-answer loops, and downright stupidity were the common laments to splash in jokes among the cubicle drones. The only improvements seemed to be expected from the further growth of output speed and size of Q&A database. The recent breakthroughs in Artificial Intelligence (AI) brought the benefits of this […]
OpenAI’s ChatGPT captured imagination of the world with unlimited possibilities it can bring to our daily life. Our mobile team had many ideas for the projects, and one of them revolved around creating a smart keyboard powered by AI. Introducing Keyssistant Keyssistant is a mobile keyboard extension that seamlessly integrates AI-powered capabilities into all messaging apps on your smartphone. The solution connects to ChatGPT via the OpenAI API. The extension offers a selection of AI-generated responses in various conversational styles, […]