SCIENCE CHINA Information Sciences, Volume 63 , Issue 7 : 172101(2020) https://doi.org/10.1007/s11432-019-9948-6

Online traffic-aware linked VM placement in cloud data centers

More info
  • ReceivedFeb 27, 2019
  • AcceptedJun 16, 2019
  • PublishedMay 18, 2020


In cloud computing, virtual machine (VM) placement plays a crucial role in data center (DC) management, as different ways of VM placement may require different system resources.As Cisco research reveals that virtualization of DC increases traffic within the DC and causes network bandwidth to become scarce resource, recent researches have been focusing on traffic-aware VM placement. However, previous traffic-aware VM placement schemes treat the VM placement as a static process in that they do not take into account the impact of the current placement decision on the subsequent placement. In this paper, we thus propose a novel online traffic-aware VM placement scheme. Our scheme views VM placement as a context-sensitive dynamic process in that the decision of every step of the placement is made aiming at helping the subsequent steps of placement to reduce the required network bandwidth in the long run. In our scheme, we consider not only inter-VM traffic but also the bandwidth constraint of a physical machine (PM) when making a VM placement decision. To realize our objective, we put those VMs with close end time in the same or close proximity PMs so that when the VMs are terminated, one can make enough room for the future arrivals so as to not only minimize the number of active PMs but also reduce networking costs. We conduct extensive simulations to verify the superiority of our scheme in terms of networking costs and energy consumption.Simulation results show that our scheme outperforms improved-best-fit-decreasing (IBFD) scheme, a revised best-fit version thattakes inter-VM traffic into account, by 30%–40% on network cost under various scenarios. Our scheme also promises 10%–25% power savingscompared with IBFD.


[1] Chen R, Chen H B. Asymmetric virtual machine replication for low latency and high available service. Sci China Inf Sci, 2018, 61: 092110 CrossRef Google Scholar

[2] Machida F, Kim D S, Park J S, et al. Toward optimal virtual machine placement and rejuvenation scheduling in a virtualized data center. In: Proceedings of IEEE International Conference on Software Reliability Engineering Workshops, 2008. 1--3. Google Scholar

[3] Kochut A. On impact of dynamic virtual machine reallocation on data center efficiency. In: Proceedings of IEEE International Symposium on Modeling, Analysis and Simulation of Computers and Telecommunication Systems, 2008. 1--8. Google Scholar

[4] Gao Y, Guan H, Qi Z. A multi-objective ant colony system algorithm for virtual machine placement in cloud computing. J Comput Syst Sci, 2013, 79: 1230-1242 CrossRef Google Scholar

[5] Hao F, Kodialam M, Lakshman T V. Online Allocation of Virtual Machines in a Distributed Cloud. IEEE/ACM Trans Networking, 2017, 25: 238-249 CrossRef Google Scholar

[6] Deng W, Liu F, Jin H. Reliability-aware server consolidation for balancing energy-lifetime tradeoff in virtualized cloud datacenters. Int J Commun Syst, 2014, 27: 623-642 CrossRef Google Scholar

[7] Huang D, He B, Miao C. A Survey of Resource Management in Multi-Tier Web Applications. IEEE Commun Surv Tutorials, 2014, 16: 1574-1590 CrossRef Google Scholar

[8] Dean J, Ghemawat S. MapReduce. Commun ACM, 2008, 51: 107 CrossRef Google Scholar

[9] Xu F, Liu F, Jin H. Heterogeneity and Interference-Aware Virtual Machine Provisioning for Predictable Performance in the Cloud. IEEE Trans Comput, 2016, 65: 2470-2483 CrossRef Google Scholar

[10] Xia M, Shirazipour M, Zhang Y. Network Function Placement for NFV Chaining in Packet/Optical Datacenters. J Lightwave Technol, 2015, 33: 1565-1570 CrossRef ADS Google Scholar

[11] Cohen R, Lewin-Eytan L, Naor J S, et al. Near optimal placement of virtual network functions. In: Proceedings of IEEE Conference on Computer Communications, 2015. 1346--1354. Google Scholar

[12] Meng X, Pappas V, Zhang L. Improving the scalability of data center networks with traffic-aware virtual machine placement. In: Proceedings of INFOCOM, 2010. 1--9. Google Scholar

[13] Guo Y, Stolyar A L, Walid A. Shadow-Routing Based Dynamic Algorithms for Virtual Machine Placement in a Network Cloud. IEEE Trans Cloud Comput, 2018, 6: 209-220 CrossRef Google Scholar

[14] Cisco: By 2014, cloud traffic will surpass traditional data center traffic. Cisco Whitepaper, 2011. http://www.cablinginstall.com/articles/2011/12/cisco-cloud-will-surpass-traditional-data-center.html. Google Scholar

[15] Bulk of data center traffic internal: Cisco. Cisco Whitepaper, 2011. https://insights.dice.com/2012/10/23/bulk-of-data-center-traffic-internal-cisco/. Google Scholar

[16] Guo C X, Wu H T, Tan K. Dcell. SIGCOMM Comput Commun Rev, 2008, 38: 75 CrossRef Google Scholar

[17] Fang W, Liang X, Li S. VMPlanner: Optimizing virtual machine placement and traffic flow routing to reduce network power costs in cloud data centers. Comput Networks, 2013, 57: 179-196 CrossRef Google Scholar

[18] Wang M, Meng X Q, Zhang L. Consolidating virtual machines with dynamic bandwidth demand in data centers. In: Proceedings of INFOCOM, 2011. 71--75. Google Scholar

[19] Xu J L, Kwiat J T K, Zhang W. Enhancing Survivability in Virtualized Data Centers: A Service-Aware Approach. IEEE J Sel Areas Commun, 2013, 31: 2610-2619 CrossRef Google Scholar

[20] Cisco ucs director administration guide, release 6.0, chapter: Managing lifecycles. Cisco Whitepaper, 2011. https://www.cisco.com/c/en/us/td/docs/unified_computing/ucs/ucs-director/administration-guide/6-0/b_Cisco_UCSD_Admin_Guide_Rel60/b_Cisco_UCSD_Admin_Guide_Rel60_chapter_010000.html. Google Scholar

[21] Get the list of events generated on any vm. https://portal.nutanix.com//page/docs/details?targetId=API_Ref-Acr_v4_6:vms_api_getVMEvents_auto_r.html. Google Scholar

[22] Klempous R, Nikodem J. Innovative Technologies in Management and Science. Berlin: Springer, 2014. 10: 158--159. Google Scholar

[23] Quang-Hung N, Thoai N. Eminret: heuristic for energy-aware vm placement with fixed intervals and non-preemption. In: Proceedings of IEEE International Conference on Advanced Computing and Applications, 2015. 98--105. Google Scholar

[24] Alharbi F, Tain Y C, Tang M, et al. Profile-based static virtual machine placement for energy-efficient data center.In: Proceedings of IEEE 18th International Conference on High Performance Computing and Communications; IEEE14th International Conference on Smart City; IEEE 2nd International Conference on Data Science and Systems. 2016,1045-1052. Google Scholar

[25] Usmani Z, Singh S. A Survey of Virtual Machine Placement Techniques in a Cloud Data Center. Procedia Comput Sci, 2016, 78: 491-498 CrossRef Google Scholar

[26] Wang X, Xie H, Wang R, et al. Design and implementation of adaptive resource co-allocation approaches for cloud service environments. In: Proceedings of the 3rd International Conference on Advanced Computer Theory and Engineering. New York: IEEE, 2010. 2: 484--488. Google Scholar

[27] Le K, Bianchini R, Zhang J, et al. Reducing electricity cost through virtual machine placement in high performance computing clouds. In: Proceedings of International Conference for High Performance Computing, Networking, Storage and Analysis. New York: ACM, 2011. 22. Google Scholar

[28] Zhang X, Zhao Y, Guo S, et al. Performance-Aware Energy-efficient Virtual Machine Placement in Cloud Data Center. In: Proceedings of IEEE International Conference on Communications. New York: IEEE, 2017. 1--7. Google Scholar

[29] Mann Z A. Multicore-Aware Virtual Machine Placement in Cloud Data Centers. IEEE Trans Comput, 2016, 65: 3357-3369 CrossRef Google Scholar

[30] Bin E, Biran O, Boni O, et al. Guaranteeing high availability goals for virtual machine placement. In: Proceedings of 31st International Conference on Distributed Computing Systems. New York: IEEE, 2011. 700--709. Google Scholar

[31] Yanagisawa H, Osogami T, Raymond R. Dependable virtual machine allocation. In: Proceedings of IEEE INFOCOM. New York: IEEE, 2013. 629--637. Google Scholar

[32] Zhou A, Wang S, Cheng B. Cloud Service Reliability Enhancement via Virtual Machine Placement Optimization. IEEE Trans Serv Comput, 2017, 10: 902-913 CrossRef Google Scholar

[33] Yang S, Wieder P, Yahyapour R. Reliable Virtual Machine Placement and Routing in Clouds. IEEE Trans Parallel Distrib Syst, 2017, 28: 2965-2978 CrossRef Google Scholar

[34] Wang S, Zhou A, Hsu C H. Provision of Data-Intensive Services Through Energy- and QoS-Aware Virtual Machine Placement in National Cloud Data Centers. IEEE Trans Emerg Top Comput, 2016, 4: 290-300 CrossRef Google Scholar

[35] Xu F, Liu F, Liu L. iAware: Making Live Migration of Virtual Machines Interference-Aware in the Cloud. IEEE Trans Comput, 2014, 63: 3012-3025 CrossRef Google Scholar

[36] Li X, Wu J, Tang S, et al. Let's stay together: Towards traffic aware virtual machine placement in data centers. In: Proceedings of IEEE Conference on Computer Communications. New York: IEEE, 2014. 1842--1850. Google Scholar

[37] Li X, Qian C. Traffic and failure aware vm placement for multi-tenant cloud computing. In: Proceedings of IEEE 23rd International Symposium on Quality of Service. New York: IEEE, 2015. 41--50. Google Scholar

[38] Benson T, Anand A, Akella A, et al. Understanding data center traffic characteristics. In: Proceedings of the 1st ACM Workshop on Research on Enterprise Networking. New York: ACM, 2009. 65--72. Google Scholar

[39] Kandula S, Sengupta S, Greenberg A, et al. The nature of data center traffic: measurements & analysis. In: Proceedings of the 9th ACM SIGCOMM Conference on Internet Measurement. New York: ACM, 2009. 202--208. Google Scholar

[40] Andreev K, Racke H. Balanced Graph Partitioning. Theor Comput Syst, 2006, 39: 929-939 CrossRef Google Scholar

[41] Garey M R, Johnson D S, Stockmeyer L. Some simplified NP-complete problems. In: Proceedings of the 6th Annual ACM Symposium on Theory of Computing. New York: ACM, 1974. 47--63. Google Scholar

[42] Ballani H, Costa P, Karagiannis T. Towards predictable datacenter networks. SIGCOMM Comput Commun Rev, 2011, 41: 242 CrossRef Google Scholar

[43] Guo Y, Stolyar A L, Walid A. Shadow-Routing Based Dynamic Algorithms for Virtual Machine Placement in a Network Cloud. IEEE Trans Cloud Comput, 2018, 6: 209-220 CrossRef Google Scholar

[44] Breitgand D, Epstein A. Improving consolidation of virtual machines with risk-aware bandwidth oversubscription in compute clouds. In: Proceedings of IEEE INFOCOM. New York: IEEE, 2012. 2861--2865. Google Scholar

  • Figure 1

    (Color online) The placement of linked VMs in data center.

  • Table 1   Notations
    $v$ A VM
    $e(v_i,v_j)$ $e(v_i,v_j)=1$ if there is a direct communication link between$v_i$ and $v_j$, otherwise $e(v_i,v_j)=0$
    tr$(v_i,v_j)$ Direct communication traffic between $v_i$ and $v_j$,otherwise tr$(v_i,v_j)=0$
    $e(v_i,*)$ All direct communication links of $v_i$
    ${\rm~tr}(v_i,*)$ All direct communication traffic of $v_i$
    VS A VS represents a set of VMs. e.g., VS$_a$ represents the VMs to be placed in or residing in PM $P_a$
    $v_i^{t_e}$ $v_i$'s end time
    ${\rm~VS}_a^{\rm~out}$ The whole out traffic of ${\rm~VS}_a$
    $B_c$ The bandwidth constraint of a PM
    NC The network cost
    ${\rm~Hop}(v_i,v_j)$ Number of physical links along the shortest path between PM $P_{v_i}$ and PM $P_{v_j}$ after $v_i$ and $v_j$ are placed
    $|P(fs)|$ Number of free slots in PM $P$
    aPMs The set of active PM in DC

Copyright 2020  CHINA SCIENCE PUBLISHING & MEDIA LTD.  中国科技出版传媒股份有限公司  版权所有

京ICP备14028887号-23       京公网安备11010102003388号