DiscoverEngineering Enablement by Abi NodaMeasuring and rolling out AI coding assistants | Eirini Kalliamvakou (GitHub)
Measuring and rolling out AI coding assistants | Eirini Kalliamvakou (GitHub)

Measuring and rolling out AI coding assistants | Eirini Kalliamvakou (GitHub)

Update: 2024-01-31
Share

Description

This week's guest is Eirini Kalliamvakou, a staff researcher at GitHub focused on AI and developer experience. Eirini sits at the forefront of research into GitHub Copilot. Abi and Eirini discuss recent research on how AI coding assistance impacts developer productivity. They talk about how leaders should build business cases for AI tools. They also preview what's to come with AI tools and implications for how developer productivity is measured.


Discussion points:

  • (1:49 ) Overview of GitHub’s research on AI
  • (2:59 ) The research study on Copilot
  • (4:48 ) Defining and measuring productivity for this study
  • (7:44 ) Exact measures and factors studied
  • (8:16 ) Key findings from the study
  • (9:45 ) How the study was conducted 
  • (11:17 ) Most surprising findings for the researchers
  • (14:01 ) The motivation for conducting a follow-up study
  • (15:34 ) How the follow-up study was conducted
  • (18:42 ) Findings from the follow-up study
  • (21:13 ) Is AI just hype? 
  • (26:34 ) How to begin advocating for AI tools
  • (34:44 ) How to translate data into dollars
  • (37:06 ) How to roll out AI tools to an organization
  • (38:47 ) The impact of AI on developer experience
  • (43:24 ) Implications of AI on how we measure productivity


Mentions and links:

Comments 
In Channel
loading
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Measuring and rolling out AI coding assistants | Eirini Kalliamvakou (GitHub)

Measuring and rolling out AI coding assistants | Eirini Kalliamvakou (GitHub)

DX