Providing High Availability for Distributed Stream Processing Application with Replica Placement

With the popularity of cloud computing, high volume data needs to be processed in real-time. Therefore, many distributed stream processing systems have risen to deal with this requirement. One kind of distributed stream processing applications contains several PEs which are connected together to implement the application logic. As data is in the form of streams and it needs to be processed in real-time, high availability is important for the application. At the same time, the application requires a high performance, including a low resource cost. According to these features of the application, we propose a new replica placement method to guarantee the application's availability while controlling the resource cost under some constraint and trying to get the maximal resource usage. The result of our experiment shows that our placement method can acquire high availability and low resource cost comparing with other placement strategies.