Have you ever thought about how Artificial Intelligence (AI) can impact language and more importantly, writing? We know that AI can do many things alike humans, and sometimes technologies even transcends human skills. With its self-learning mechanism, AI is deployable in many settings and many industries. And with this new software in the field of language and text generating, new possibilities rise up.
Last summer the software program Generative Pre-Skilled Transformer Three (GPT-Three) was published. This language model is an AI application developed to generate human-like text. And it is one of the biggest best trained language models at this moment, with 175 billion parameters to be used. It knows the statistical relationships between these parameters, by using training data.
So how does this AI model work? The model can be used by building an API for it. You can use it by giving it a bit of text, and the model will come back to you with a prediction on what follows on that text. It will use its own output to predict even more text, and this way it can write a whole story.
This model and the technology of text-generating software may sound like a big improvement, however there are still some things to take into account. The model is very slow, because of the enormous amount which cannot fit on a GPU. Another thing is that it is economic infeasible to train this model even further. It would cost over $4.6 million, because a system with an enormous GPU has to be used.
But if we leave all these downsides for what they are, and just think about this technology on its own, what possibilities does it create and in what context? If a computer program can write just like humans or maybe in the future even better, what does this mean for our business activities? Will we just have to put some words and a subject into a program, and a whole essay or great story will just come out? If we can automate writing text, this will have an enormous impact on businesses.
What do you think of these innovations and how do you think it will affect you or your business?
References:
https://aidevelopmenthub.com/artificial-intelligence-a-new-ai-language-model-generates-poetry-and-prose-science-technology/
https://www.economist.com/science-and-technology/2020/08/06/a-new-ai-language-model-generates-poetry-and-prose
https://lambdalabs.com/blog/demystifying-gpt-3/
https://lambdalabs.com/blog/gpt-3/
https://edition.cnn.com/2019/02/18/tech/dangerous-ai-text-generator/index.html
Hii Hillene,
Thanks for this interesting story! Personally, I never heard of this technology before. I think if this technology eventually really works it would have an enormous impact on especially writers. However, in my opinion, stories can never be that great when a computer program generates this. Also, maybe people deny reading stories coming from a program. Just like robots can’t show empathy, I’m not sure if programs are able to write with emotions.
So thinking in that direction I don’t think we have to worry that much when looking in a business perspective.
How do you think about that? Do you think businesses like newspapers and book publishers are in danger?
I’m curious to know your opinion.
Amanda