An In-Network Computing Service Placement Mechanism for NUMA-based Software Router

With the development of network computing integration technology, deploying the computing services as Virtual Machines (VMs) on software router is emerging for achieving flexible in-network computing recently. But for current widely used x86 software router, to maximize the throughput of computing service VMs placed on it, how to optimize the placement scheme based on its non-uniform memory access (NUMA) architecture is still a challenge. Facing this problem, we propose a NUMA-oriented in-network computing service placement mechanism (NUMA-ISP). In our mechanism, the computing service VMs to be deployed are selected by their popularity. Through monitoring the memory bandwidth usage inside NUMA node and interconnect bandwidth usage between two NUMA nodes, NUMA-ISP tries to allocate CPU-memory resources to the selected VM from the nodes with enough remaining resources and low bandwidth contention, while closing to the VM of virtual routing function as possible. Experimental results show that, comparing with traditional FF and WF placement mechanisms, NUMA-ISP can increase about 10% total throughput of deployed computing service VMs.