As we all know generative AI, like Chat-GPT, is disrupting many industries at the current moment. But, as we have all seen by now it has some flukes. The models are prone to ‘hallucinations’, give inaccurate answers, have limited specialized knowledge, and struggle to create coherent long-form content. This takes away from the value that can be created by the model in businesses.
To remedy this Companies can fine-tune the model by providing a large dataset with questions and answers to teach the model how it should behave. Also creating a reference window by vectorizing text and storing it in a database can provide the model with company-specific specialized data based on the questions asked, which can then be interpreted by the model further reducing the number of hallucinations and inaccurate answers the model might generate.
This improves the performance of the model significantly in shorter chat-based interactions, but the model still struggles with coherent large replies to complex topics. So, as you might be able to imagine, Chat-GPT cannot make your video games or write large multipage reports. But, with the advent of LLM AI agents this might change.
Agents are actors who perceive their environment and make decisions based on this environment. A chatbot is a kind of agent that perceives the input question and provides the answer. This is nothing new, but creating a system of AI chatbots that interact with each other, each having a different role, and iteratively working to perfect a project is. ChatDev, a development platform for Multi-agent framework, was able to create a game by designing an AI LLM workforce of developers, a CTO, a COO, and a CEO where each was given certain responsibilities.
By iteratively generating code, getting it audited by other models, and reimplementing new code the model was able to solve a complex topic like game development. The game might have been fairly simple but imagine this technology developing over the next two years like generative AI has developed over the last year. In the future entire companies of sections of companies might be run by ai.
In my opinion, this technology has great potential and might change the way we work in the future, so i advise you strongly to conduct your own research into this topic.