research-article
Authors: Luyao Luo, Gongming Zhao, Hongli Xu, Zhuolong Yu, Liguang Xie
IEEE/ACM Transactions on Networking, Volume 32, Issue 2
Pages 1391 - 1406
Published: 05 October 2023 Publication History
Metrics
Total Citations1Total Downloads17Last 12 Months17
Last 6 weeks0
New Citation Alert added!
This alert has been successfully added and will be sent to:
You will be notified whenever a record that you have chosen has been cited.
To manage your alert preferences, click on the button below.
Manage my Alerts
New Citation Alert!
Please log in to your account
Get Access
Abstract
Cloud infrastructure has gradually displayed a tendency of geographical distribution in order to provide anywhere, anytime connectivity to tenants all over the world. The tenant task placement in geo-distributed clouds comes with three critical and coupled factors: regional diversity in electricity prices, access delay for tenants, and traffic demand among tasks. However, existing works disregard either the regional difference in electricity prices or the tenant requirements in geo-distributed clouds, resulting in increased operating costs or low user QoS. To bridge the gap, we design a cost optimization framework for tenant task placement in geo-distributed clouds, called TanGo. However, it is non-trivial to achieve an optimization framework while meeting all the tenant requirements. To this end, we first formulate the electricity cost minimization for task placement problem as a constrained mixed-integer non-linear programming problem. We then propose a near-optimal algorithm with a tight approximation ratio <inline-formula> <tex-math notation="LaTeX">$(1-1/e)$ </tex-math></inline-formula> using an effective submodular-based method. Results of in-depth simulations based on real-world datasets show the effectiveness of our algorithm as well as the overall 10%-30% reduction in electricity expenses compared to commonly-adopted alternatives.
References
[1]
L. Luo, G. Zhao, H. Xu, Z. Yu, and L. Xie, “TanGo: A cost optimization framework for tenant task placement in geo-distributed clouds,” in Proc. IEEE Conf. Comput. Commun. (INFOCOM), May 2023, pp. 1–10.
[2]
Netflix Streaming Service. Unlimited Films, TV Programmes and More. Accessed: Jul. 20, 2022. [Online]. Available: https://www.netflix.com/
[3]
Disney+ Streaming Service. The Home of Disney, Pixar, Marvel, Star Wars, National Geographic, and Star. Accessed: Jul. 20, 2022. [Online]. Available: https://www.disneyplus.com/
[4]
General Data Protection Regulation (GDPR). Harmonize Data Privacy Laws Across Europe. Accessed: Jul. 20, 2022. [Online]. Available: https://gdpr-info.eu/
[5]
Amazon Web Services. Build, Deploy, and Manage Websites, Apps or Processes On AWS Secure, Reliable Network. Accessed: Jul. 20, 2022. [Online]. Available: https://aws.amazon.com/
[6]
Microsoft Azure. Invent With Purpose, Realize Cost Savings, and Make Your Organization More Efficient With Microsoft Azure’s Open and Flexible Cloud Computing Platform. Accessed: Jul. 20, 2022. [Online]. Available: https://azure.microsoft.com/en-us/
[7]
Google Cloud. Build, Deploy, and Scale Applications, Websites, and Services on the Same Infrastructure as Google. Accessed: Jul. 20, 2022. [Online]. Available: https://cloud.google.com/
[8]
Data Center White Paper From CAICT. Accessed: Jul. 20, 2022. [Online]. Available: https://pdf.dfcfw.com/pdf/H3_AP202204241561314215_1.pdf?1650898389000.pdf
[9]
J. Gao, H. Wang, and H. Shen, “Smartly handling renewable energy instability in supporting a cloud datacenter,” in Proc. IEEE Int. Parallel Distrib. Process. Symp. (IPDPS), May 2020, pp. 769–778.
[10]
W. Li, X. Zhou, K. Li, H. Qi, and D. Guo, “TrafficShaper: Shaping interdatacenter traffic to reduce the transmission cost,” IEEE/ACM Trans. Netw., vol. 26, no. 3, pp. 1193–1206, Jun. 2018.
[11]
T. Zhu, M. A. Kozuch, and M. Harchol-Balter, “WorkloadCompactor: Reducing datacenter cost while providing tail latency SLO guarantees,” in Proc. Symp. Cloud Comput., Sep. 2017, pp. 598–610.
[12]
W. Deng, F. Liu, H. Jin, C. Wu, and X. Liu, “MultiGreen: Costminimizing multi-source datacenter power supply with online control,” in Proc. 4th Int. Conf. Future Energy Syst., May 2013, pp. 149–160.
[13]
R. Eyckerman, S. Mercelis, J. Marquez-Barja, and P. Hellinckx, “Requirements for distributed task placement in the fog,” Internet Things, vol. 12, Dec. 2020, Art. no.
[14]
M. H. Hajiesmaili, L. T. Mak, Z. Wang, C. Wu, M. Chen, and A. Khonsari, “Cost-effective low-delay cloud video conferencing,” in Proc. IEEE 35th Int. Conf. Distrib. Comput. Syst., Jun. 2015, pp. 103–112.
[15]
P. Liet al., “Traffic-aware geo-distributed big data analytics with predictable job completion time,” IEEE Trans. Parallel Distrib. Syst., vol. 28, no. 6, pp. 1785–1796, Jun. 2017.
[16]
R. Singh, S. Agarwal, M. Calder, and P. Bahl, “Cost-effective cloud edge traffic engineering with cascara,” in Proc. NSDI, 2021, pp. 201–216.
[17]
W. Li, K. Li, D. Guo, G. Min, H. Qi, and J. Zhang, “Cost-minimizing bandwidth guarantee for inter-datacenter traffic,” IEEE Trans. Cloud Comput., vol. 7, no. 2, pp. 483–494, Apr. 2019.
[18]
L. Rao, X. Liu, L. Xie, and W. Liu, “Minimizing electricity cost: Optimization of distributed Internet Data Centers in a multi-electricitymarket environment,” in Proc. IEEE (INFOCOM), Mar. 2010, pp. 1–9.
[19]
L. Gu, D. Zeng, A. Barnawi, S. Guo, and I. Stojmenovic, “Optimal task placement with QoS constraints in geo-distributed data centers using DVFS,” IEEE Trans. Comput., vol. 64, no. 7, pp. 2049–2059, Jul. 2015.
[20]
H. Xu and B. Li, “Cost efficient datacenter selection for cloud services,” in Proc. 1st IEEE Int. Conf. Commun. China (ICCC), Aug. 2012, pp. 51–56.
[21]
Federal Energy Regulatory Commission. U.S. Electric Power Markets. Accessed: Jul. 20, 2022. [Online]. Available: https://www.ferc.gov/market-oversight/mkt-electric/overview.asp
[22]
M. Alizadeh, A. Kabbani, T. Edsall, B. Prabhakar, A. Vahdat, and M. Yasuda, “Less is more: Trading a little bandwidth for ultra-low latency in the data center,” in Proc. 9th USENIX Symp. Networked Syst. Design Implement. (NSDI), 2012, pp. 253–266.
[23]
K.-T. Chen, Y.-C. Chang, P.-H. Tseng, C.-Y. Huang, and C.-L. Lei, “Measuring the latency of cloud gaming systems,” in Proc. 19th ACM Int. Conf. Multimedia, Nov. 2011, pp. 1269–1272.
[24]
Y. Feng, B. Li, and B. Li, “Airlift: Video conferencing as a cloud service using inter-datacenter networks,” in Proc. 20th IEEE Int. Conf. Netw. Protocols (ICNP), Oct. 2012, pp. 1–11.
[25]
D. Dahiphaleet al., “An advanced MapReduce: Cloud MapReduce, enhancements and applications,” IEEE Trans. Netw. Service Manage., vol. 11, no. 1, pp. 101–115, Mar. 2014.
[26]
D. Pop, “Machine learning and cloud computing: Survey of distributed and SaaS solutions,” 2016, arXiv:1603.08767.
[27]
Alibaba Cluster Data. Cluster Data Collected From Production Clusters in Alibaba for Cluster Management Research. Accessed: Jul. 20, 2022. [Online]. Available: https://github.com/alibaba/clusterdata/
[28]
Google Cluster Data. Borg Cluster Traces From Google. Accessed: Jul. 20, 2022. [Online]. Available: https://github.com/google/clusterdata/
[29]
I. Pelle, J. Czentye, J. Dóka, and B. Sonkoly, “Towards latency sensitive cloud native applications: A performance study on AWS,” in Proc. IEEE 12th Int. Conf. Cloud Comput. (CLOUD), Jul. 2019, pp. 272–280.
[30]
S. Lenhart and D. Fox, “Participatory democracy in dynamic contexts: A review of regional transmission organization governance in the United States,” Energy Res. Social Sci., vol. 83, Jan. 2022, Art. no.
[31]
V. Jalaparti, I. Bliznets, S. Kandula, B. Lucier, and I. Menache, “Dynamic pricing and traffic engineering for timely inter-datacenter transfers,” in Proc. ACM SIGCOMM Conf., Aug. 2016, pp. 73–86.
[32]
N. Laoutaris, M. Sirivianos, X. Yang, and P. Rodriguez, “Inter-datacenter bulk transfers with NetStitcher,” in Proc. ACM SIGCOMM Conf., 2011, pp. 74–85.
[33]
S. Kandula, S. Sengupta, A. Greenberg, P. Patel, and R. Chaiken, “The nature of data center traffic: Measurements & analysis,” in Proc. 9th ACM SIGCOMM Conf. Internet Meas., 2009, pp. 202–208.
[34]
C. Guoet al., “Pingmesh: A large-scale system for data center network latency measurement and analysis,” in Proc. ACM Conf. Special Interest Group Data Commun., Aug. 2015, pp. 139–152.
[35]
A. Soltanian, D. Naboulsi, R. Glitho, and H. Elbiaze, “Resource allocation mechanism for media handling services in cloud multimedia conferencing,” IEEE J. Sel. Areas Commun., vol. 37, no. 5, pp. 1167–1181, May 2019.
[36]
C. Chekuri and S. Khanna, “A polynomial time approximation scheme for the multiple knapsack problem,” SIAM J. Comput., vol. 35, no. 3, pp. 713–728, 2005.
[37]
B. Bixby, “The Gurobi optimizer,” Transp. Res. B, vol. 41, no. 2, pp. 159–178, 2007.
[38]
A. Agarwal, Z. Liu, and S. Seshan, “HeteroSketch: Coordinating network-wide monitoring in heterogeneous and dynamic networks,” in Proc. 19th USENIX Symp. Networked Syst. Design Implement. (NSDI), 2022, pp. 719–741.
[39]
A. Krause and D. Golovin, “Submodular function maximization,” Tractability, vol. 3, no. 19, pp. 71–104, 2012.
[40]
R. Tarjan, “Depth-first search and linear graph algorithms,” SIAM J. Comput., vol. 1, no. 2, pp. 146–160, Jun. 1972.
[41]
G. L. Nemhauser and L. A. Wolsey, “Best algorithms for approximating the maximum of a submodular set function,” Math. Oper. Res., vol. 3, no. 3, pp. 177–188, Aug. 1978.
[42]
L. Luo, G. Zhao, H. Xu, L. Xie, and Y. Xiong, “VITA: Virtual network topology-aware southbound message delivery in clouds,” in Proc. IEEE Conf. Comput. Commun. (INFOCOM), May 2022, pp. 630–639.
[43]
V. K. Adhikariet al., “Unreeling Netflix: Understanding and improving multi-CDN movie delivery,” in Proc. IEEE INFOCOM, Mar. 2012, pp. 1620–1628.
[44]
H. Chen, X. Zhu, D. Qiu, L. Liu, and Z. Du, “Scheduling for workflows with security-sensitive intermediate data by selective tasks duplication in clouds,” IEEE Trans. Parallel Distrib. Syst., vol. 28, no. 9, pp. 2674–2688, Sep. 2017.
[45]
H. Xu, J. Fan, J. Wu, C. Qiao, and L. Huang, “Joint deployment and routing in hybrid SDNs,” in Proc. IEEE/ACM 25th Int. Symp. Quality Service (IWQoS), Jun. 2017, pp. 1–10.
[46]
V. Eramo and F. G. Lavacca, “Optimizing the cloud resources, bandwidth and deployment costs in multi-providers network function virtualization environment,” IEEE Access, vol. 7, pp. 46898–46916, 2019.
[47]
L. Qu, C. Assi, K. Shaban, and M. J. Khabbaz, “A reliability-aware network service chain provisioning with delay guarantees in NFVenabled enterprise datacenter networks,” IEEE Trans. Netw. Service Manage., vol. 14, no. 3, pp. 554–568, Sep. 2017.
[48]
W. Lin, H. Wang, Y. Zhang, D. Qi, J. Z. Wang, and V. Chang, “A cloud server energy consumption measurement system for heterogeneous cloud environments,” Inf. Sci., vol. 468, pp. 47–62, Nov. 2018.
[49]
S. Agarwal, J. Dunagan, N. Jain, S. Saroiu, A. Wolman, and H. Bhogan, “Volley: Automated data placement for geo-distributed cloud services,” in Proc. NSDI, 2010, pp. 1–16.
[50]
Z. Wenet al., “GA-Par: Dependable microservice orchestration framework for geo-distributed clouds,” IEEE Trans. Parallel Distrib. Syst., vol. 31, no. 1, pp. 129–143, Jan. 2020.
[51]
H. Wang, H. Shen, Z. Li, and S. Tian, “GeoCol: A geo-distributed cloud storage system with low cost and latency using reinforcement learning,” in Proc. IEEE 41st Int. Conf. Distrib. Comput. Syst. (ICDCS), Jul. 2021, pp. 149–159.
[52]
K. Oh, N. Qin, A. Chandra, and J. Weissman, “Wiera: Policy-driven multi-tiered geo-distributed cloud storage system,” IEEE Trans. Parallel Distrib. Syst., vol. 31, no. 2, pp. 294–305, Feb. 2020.
[53]
A. Yassine, A. A. N. Shirehjini, and S. Shirmohammadi, “Bandwidth on-demand for multimedia big data transfer across geo-distributed cloud data centers,” IEEE Trans. Cloud Comput., vol. 8, no. 4, pp. 1189–1198, Oct. 2020.
[54]
C. Feng, H. Xu, and B. Li, “An alternating direction method approach to cloud traffic management,” IEEE Trans. Parallel Distrib. Syst., vol. 28, no. 8, pp. 2145–2158, Aug. 2017.
[55]
G. Zhao, H. Xu, Y. Zhao, C. Qiao, and L. Huang, “Offloading tasks with dependency and service caching in mobile edge computing,” IEEE Trans. Parallel Distrib. Syst., vol. 32, no. 11, pp. 2777–2792, Nov. 2021.
[56]
A. Munir, T. He, R. Raghavendra, F. Le, and A. X. Liu, “Network scheduling and compute resource aware task placement in datacenters,” IEEE/ACM Trans. Netw., vol. 28, no. 6, pp. 2435–2448, Dec. 2020.
[57]
B. Liang, X. Dong, Y. Wang, and X. Zhang, “Memory-aware resource management algorithm for low-energy cloud data centers,” Future Gener. Comput. Syst., vol. 113, pp. 329–342, Dec. 2020.
[58]
N. Kumar, V. H. Gaidhane, and R. K. Mittal, “Cloud-based electricity consumption analysis using neural network,” Int. J. Comput. Appl. Technol., vol. 62, no. 1, pp. 45–56, 2020.
Cited By
View all
- Jha DLi YWen ZMorgan GJayaraman PKoutny MRana ORanjan R(2024)GeoDeploy: Geo-Distributed Application Deployment Using BenchmarkingIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2024.347053235:12(2361-2374)Online publication date: 1-Dec-2024
Recommendations
- Cost optimization for Online Social Networks on geo-distributed clouds
ICNP '12: Proceedings of the 2012 20th IEEE International Conference on Network Protocols (ICNP)
Geo-distributed IaaS (Infrastructure-as-a-Service) clouds provide an intriguing platform to deploy Online Social Network (OSN) services. To leverage the potential of clouds, a major task of OSN providers is optimizing the monetary cost spent on cloud ...
Read More
- Cost-Effective Resource Configurations for Multi-Tenant Database Systems in Public Clouds
Cloud computing is a promising paradigm for deploying applications due to its large resource offerings on a pay-as-you-go basis. This paper examines the problem of determining the most cost-effective provisioning of a multi-tenant database system as a ...
Read More
- A Comprehensive Study of Co-residence Threat in Multi-tenant Public PaaS Clouds
Information and Communications Security
Abstract
Public Platform-as-a-Service (PaaS) clouds are always multi-tenant. Applications from different tenants may reside on the same physical machine, which introduces the risk of sharing physical resources with a potentially malicious application. This ...
Read More
Comments
Information & Contributors
Information
Published In
IEEE/ACM Transactions on Networking Volume 32, Issue 2
April 2024
927 pages
Issue’s Table of Contents
1063-6692 © 2023 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See https://www.ieee.org/publications/rights/index.html for more information.
Publisher
IEEE Press
Publication History
Published: 05 October 2023
Published inTONVolume 32, Issue 2
Qualifiers
- Research-article
Contributors
Other Metrics
View Article Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations
1
Total Citations
17
Total Downloads
- Downloads (Last 12 months)17
- Downloads (Last 6 weeks)0
Reflects downloads up to 15 Mar 2025
Other Metrics
View Author Metrics
Citations
Cited By
View all
- Jha DLi YWen ZMorgan GJayaraman PKoutny MRana ORanjan R(2024)GeoDeploy: Geo-Distributed Application Deployment Using BenchmarkingIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2024.347053235:12(2361-2374)Online publication date: 1-Dec-2024
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in
Full Access
Get this Article
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFigures
Tables
Media
