Universities and the rise of AI - Part 2: A peek into large language models

The Secret Life of Language

Generative AI tools are making waves in universities, but what exactly powers these systems? In this second of a series of episodes that examines the impact of generative AI on university education and research, we pull back the curtain on the technology that's rapidly changing how we live, work, and interact with the world. The Secret Life of Language hosts John Hajek and Yu Hao are joined by experts in the field to explore the mechanics of genAI, going beyond the captivating interfaces of tools like ChatGPT to reveal the complexity within. Dr Lea Frermann and Dr Ting Dang, from the University of Melbourne's School of Computing and Information Systems, share their insights into how these AI systems work, from underlying technologies like neural networks and transformers to the data used to train them. Our guests unpack key concepts like machine learning, neural networks, and the significance of "attention" in AI models, and discuss the critical role of human feedback in refining natural language outputs and mitigating biases. Guests for this episode:

• Dr Lea Frermann
• Dr Ting Dang

School of Computing and Information Systems, The University of Melbourne

The Secret Life of Language is a podcast from the University of Melbourne’s School of Languages and Linguistics. This episode was produced by Eric van Bemmel and Kelvin Param of Profactual and Gavin Nebauer. Recorded and mixed by Gavin Nebauer at The Horwood Recording Studio, the University of Melbourne.

The Secret Life of Language is licensed under Creative Commons.