LLMs Are Great at Code Generation, But What About Code Adaptation?

Justin "Goju" Gottschlich (Merly, Stanford)

Abstract

In recent years, we’ve seen a flurry of AI systems for code generation. These systems have shown tremendous progress for early software prototyping as well as building minimal viable products (MVPs) for startups. However, they struggle in augmenting existing software systems, including the ones they have been used to create. Yet, this is one of the central problems in building production-quality software.

We are interested in exploring how to advance these AI systems so they can not only create software that is “correct” but also software that is reliable, secure, and performant. These production-quality characteristics tend to be notably more nuanced and contextually specific than satisfying logical program correctness.

Bio

Justin (“Goju”) Gottschlich is the founder of Goju Tech Talk (GTT, https://youtube.com/@gojutechtalk), a social media platform designed to bring together fellow technologists who are deeply inspired by technological advances yet are disenchanted by overzealous and hype-based media. Justin was also the founder, CEO, and chief scientist of Merly, Inc. a company aimed at designing intelligent automated software development.

Justin received his PhD in computer engineering from the University of Colorado-Boulder in 2011. He spent a decade at Intel Labs, where he eventually founded and directed the Machine Programming Research lab. Along with his industry experience, Justin has consistently remained active in academia. From 2011 - 2016, while concurrently at Intel Labs, he served as an adjunct professor at University of Colorado Boulder. In 2017, he moved to University of Pennsylvania as an adjunct professor until 2022. Since 2022, he has been at Stanford University, where he teaches machine programming as an adjunct lecturer.