Operating System-Level Load Distribution for Network Telemetry Data Collection

Abstract

As networks grow larger, network telemetry data collection becomes both more of a necessity as well as a challenge scaling with the extent of the network. In order to distribute network telemetry traffic among network telemetry collection endpoints, multiple layers of load balancing are used. Targeting the last layer—from the network interface to the collecting processes—we designed and implemented a system tailored to addressing practical challenges of running such a collection system while surpassing the existing system in both usability and performance.