DiscoverTest & Code218: Balancing test coverage with test costs - Nicole Tietz-Sokolskaya
218: Balancing test coverage with test costs -  Nicole Tietz-Sokolskaya

218: Balancing test coverage with test costs - Nicole Tietz-Sokolskaya

Update: 2024-04-18
Share

Description

Nicole is a software engineer and writer, and recently wrote about the trade-offs we make when deciding which tests to write and how much testing is enough.

We talk about:

  • Balancing schedule vs testing
  • How much testing is the right about of testing
  • Should code coverage be measured and tracked
  • Good refactoring can reduce code coverage
  • Is it worth testing error conditions?
  • Are rare error codes ok to just monitor?
  • API drift and autospec
  • Mitigating risk
  • Deciding what to test and what not to test
  • Focus testing on key money-making features 
  • If there's a bug in this part of the code, how much business impact is there?
  • Performance testing needs to approximately match real world workloads
  • Cost of a service breaking vs the cost of creating, maintaining, and running tests
  • Keeping test suites quick to minimize getting distracted


Links:



 Learn pytest

Comments 
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

218: Balancing test coverage with test costs -  Nicole Tietz-Sokolskaya

218: Balancing test coverage with test costs - Nicole Tietz-Sokolskaya

Brian Okken