DiscoverCode ImpactFBDetect - Catching Tiny Performance Regressions at Hyperscale through In-Production Monitoring
FBDetect - Catching Tiny Performance Regressions at Hyperscale through In-Production Monitoring

FBDetect - Catching Tiny Performance Regressions at Hyperscale through In-Production Monitoring

Update: 2024-12-23
Share

Description

Meta's FBDetect system, detailed in this research paper, is a robust, in-production performance regression detection system. It identifies minuscule performance regressions (as small as 0.005%) across millions of servers and hundreds of services by monitoring hundreds of thousands of time series metrics. Key to FBDetect's success are advanced techniques for subroutine-level performance analysis, filtering false positives, deduplicating correlated regressions, and root cause analysis. The paper validates FBDetect's effectiveness through simulations and real-world production data, showcasing its superiority over existing methods and highlighting the significance of its seven years of successful operation.

Comments 
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

FBDetect - Catching Tiny Performance Regressions at Hyperscale through In-Production Monitoring

FBDetect - Catching Tiny Performance Regressions at Hyperscale through In-Production Monitoring

Sanket Makhija