posted on 2024-03-27, 15:25authored byXiaoquan Zhang, Lin Cui, WaiMing Lau, Fung Po TsoFung Po Tso, Yuhui Deng, Weijia Jia
<p>In-network computing (INC) is a new paradigm that allows applications to be executed within the network, rather than on dedicated servers. Conventionally, INC applications have been exclusively deployed on the data plane (e.g., programmable ASICs), offering impressive performance capabilities. However, the data plane’s efficiency is hindered by limited resources, which can prevent a comprehensive deployment of applications. On the other hand, offloading compute tasks to the control plane, which is underpinned by general-purpose servers with ample resources, provides greater flexibility. However, this approach comes with the tradeoff of significantly reduced efficiency, especially when the system operates under heavy load. To simultaneously exploit the efficiency of data plane and the flexibility of control plane, we propose <em>Carlo</em>, a cross-plane collaborative optimization framework to support the network-wide deployment of multiple INC applications across both the control and data plane. <em>Carlo</em> first analyzes resource requirements of various INC applications across different planes. It then establishes mathematical models for resource allocation in cross-plane and automatically generates solutions using proposed algorithms. We have implemented the prototype of <em>Carlo</em> on Intel Tofino ASIC switches and DPDK. Experimental results demonstrate that <em>Carlo</em> can compute solutions in a short time while avoiding performance degradation caused by the deployment scheme.</p>
Funding
National Natural Science Foundation of China (NSFC) under Grant 62172189 and 62272050
Guangdong Key Lab of AI and Multi-modal Data Processing, United International College (UIC) under Grant 2020KSYS007
Guangdong Basic and Applied Basic Research Foundation under Grant No. 2021B1515120048
Innovate UK grants 47198 and 10040850
Outstanding Innovative Talents Cultivation Funded Programs for Doctoral Students of Jinan University
Interdisciplinary Intelligence SuperComputer Center of Beijing Normal University (Zhuhai)