[icnrg] NetClone: Fast, Scalable, and Dynamic Request Cloning for Microsecond-Scale RPCs

[Dirk Kutscher <[e-mail]>]

Also presented at SIGCOMM this week.

This is a really nice paper that is spot-on Computing in the Network. It demonstrates how to actually make use of programmable switches for real-world application frameworks (RPC).

For ICN, we had developed RICE earlier that made some first steps into this direction but was more focused on leveraging already existing ICN features (with Reflexive Forwarding as an extension mechanism). We didn't explore forwarding strategies such as NetClone at that time.


Best regards,
Dirk


-----

Spawning duplicate requests, called cloning, is a powerful technique to reduce tail latency by masking service-time variability. However, traditional client-based cloning is static and harmful to performance under high load, while a recent coordinator-based approach is slow and not scalable. Both approaches are insufficient to serve modern microsecond-scale Remote Procedure Calls (RPCs). To this end, we present NetClone, a request cloning system that performs cloning decisions dynamically within nanoseconds at scale. Rather than the client or the coordinator, NetClone performs request cloning in the network switch by leveraging the capability of programmable switch ASICs. Specifically, NetClone replicates requests based on server states and blocks redundant responses using request fingerprints in the switch data plane. To realize the idea while satisfying the strict hardware constraints, we address several technical challenges when designing a custom switch data plane. NetClone can be integrated with emerging in-network request schedulers like RackSched. We implement a Net-Clone prototype with an Intel Tofino switch and a cluster of commodity servers. Our experimental results show that NetClone can improve the tail latency of microsecond-scale RPCs for synthetic and real-world application workloads and is robust to various system conditions.

-----

https://dl.acm.org/doi/10.1145/3603269.3604820