Skip to main content
SpringerLink
Log in

A survey on optimal utilization of preemptible VM instances in cloud computing

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

In this article, an extensive survey on optimal utilization of preemptible instances in cloud is presented. Different techniques used in state-of-the-art research for efficient utilization of spot instances have been classified and categorized in the paper. To the best of our knowledge, this is the first attempt of its kind. With the continuing growths in cloud computing, researchers and business personnels are exploiting the services provided by the cloud computing to reduce their operational cost. Users can share resources in the cloud with the help of virtualization. Virtualization provides abstraction of cloud to the users by hiding the complexity of inherent software and hardware present in the cloud. It increases the likelihood of running multiple operating systems (OSs) on a single physical machine with sharing of hardware resources. Each OS can be considered as a virtual machine (VM) installed on a physical machine. Based on subscription model, VMs can be classified into three types: reserved VMs, on-demand VMs and spot VMs. Spot instances are also known as preemptible VM instances. Spot instances are used as reduced cost resources at the risk of reliability. To utilize spot instances, users have to bid for them. Users will able to get the spot instances only if the biding price is greater than the spot instance price. As soon as the bid price becomes less than the spot price, the cloud provider will revoke the VMs (SIs). This survey aims to find the ways, one can efficiently utilize spot instances for executing the tasks with optimized cost and time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. The term “spot instance” and “preemptible VM instances” are used interchangeably in this article.

References

  1. (2017) Cloud computing. https://azure.microsoft.com/en-in/overview/what-is-cloud-computing/. Accessed 25 Dec 2017

  2. (2018) Amazon EC2 instance types. https://aws.amazon.com/ec2/instance-types/. Accessed 25 Mar 2018

  3. Abundo M, Valerio VD, Cardellini V, Presti FL (2015) QoS-aware bidding strategies for VM spot instances: a reinforcement learning approach applied to periodic long running jobs. In: IFIP/IEEE International Symposium on Integrated Network Management, IM 2015, Ottawa, ON, Canada, 11–15 May, 2015, pp 53–61. https://doi.org/10.1109/INM.2015.7140276

  4. Agmon Ben-Yehuda O, Ben-Yehuda M, Schuster A, Tsafrir D (2013) Deconstructing amazon EC2 spot instance pricing. ACM Trans Econ Comput 1(3):16. https://doi.org/10.1145/2509413.2509416

    Article  Google Scholar 

  5. Ben-Yehuda OA, Ben-Yehuda M, Schuster A, Tsafrir D (2011) Deconstructing amazon EC2 spot instance pricing. In: 2011 IEEE Third International Conference on Cloud Computing Technology and Science, pp 304–311. https://doi.org/10.1109/CloudCom.2011.48

  6. Blum A, Sandholm T, Zinkevich M (2006) Online algorithms for market clearing. J ACM 53(5):845–879. https://doi.org/10.1145/1183907.1183913

    Article  MathSciNet  MATH  Google Scholar 

  7. Burgess M, Wiedenbeck B (2010) Strategic bidding on amazon EC2. https://scholar.google.co.in/scholar?hl=en&as_sdt=0,5&cluster=3572391033188216107

  8. Buyya R, Vecchiola C, Selvi ST (2013) Mastering cloud computing: foundations and applications programming. Newnes. https://doi.org/10.1016/C2012-0-06719-1

  9. Calheiros RN, Ranjan R, Beloglazov A, Rose CAFD, Buyya R (2011) Cloudsim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw Pract Exper 41(1):23–50. https://doi.org/10.1002/spe.995

    Article  Google Scholar 

  10. Chichin S, Vo QB, Kowalczyk R (2017) Towards efficient and truthful market mechanisms for double-sided cloud markets. IEEE Trans Serv Comput 10(1):37–51

    Article  Google Scholar 

  11. Chohan N, Castillo C, Spreitzer M, Steinder M, Tantawi AN, Krintz C (2010) See spot run: using spot instances for mapreduce workflows. In: 2nd USENIX Workshop on Hot Topics in Cloud Computing, HotCloud’10, Boston, MA, USA, June 22, 2010. https://www.usenix.org/conference/hotcloud-10/see-spot-run-using-spot-instances-mapreduce-workflows

  12. Dawoud W, Takouna I, Meinel C (2012) Increasing spot instances reliability using dynamic scalability. In: 2012 IEEE Fifth International Conference on Cloud Computing, Honolulu, HI, USA, June 24–29, 2012, pp 959–961. https://doi.org/10.1109/CLOUD.2012.58

  13. DeCandia G, Hastorun D, Jampani M, Kakulapati G, Lakshman A, Pilchin A, subramanian SS, Vosshall P, Vogels W (2007) Dynamo: amazon’s highly available key-value store. In: Proceedings of the 21st ACM Symposium on Operating Systems Principles 2007, SOSP 2007, Stevenson, Washington, USA, October 14–17, 2007, pp 205–220. https://doi.org/10.1145/1294261.1294281

  14. Di S, Robert Y, Vivien F, Kondo D, Wang C, Cappello F (2013) Optimization of cloud task processing with checkpoint-restart mechanism. In: International Conference for High Performance Computing, Networking, Storage and Analysis, SC’13, Denver, CO, USA—November 17–21, 2013, pp 64:1–64:12. https://doi.org/10.1145/2503210.2503217

  15. Domanal SG, Reddy GRM (2018) An efficient cost optimized scheduling for spot instances in heterogeneous cloud environment. Future Gener Comput Syst 84:11–21

    Article  Google Scholar 

  16. Friedman EJ, Parkes DC (2003) Pricing wifi at starbucks: issues in online mechanism design. In: Proceedings of the 4th ACM Conference on Electronic Commerce, ACM, New York, NY, USA, EC ’03, pp 240–241. https://doi.org/10.1145/779928.779978

  17. Gong Y, He B, Zhou AC (2015) Monetary cost optimizations for MPI-based HPC applications on amazon clouds: checkpoints and replicated execution. In: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2015, Austin, TX, USA, November 15–20, 2015, pp 32:1–32:12. https://doi.org/10.1145/2807591.2807612

  18. Guo W, Chen K, Wu Y, Zheng W (2015) Bidding for highly available services with low price in spot instance market. In: Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing, ACM, New York, NY, USA, HPDC ’15, pp 191–202. https://doi.org/10.1145/2749246.2749259

  19. He X, Shenoy P, Sitaraman R, Irwin D (2015) Cutting the cost of hosting online services using cloud spot markets. In: Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing, ACM, New York, NY, USA, HPDC ’15, pp 207–218. https://doi.org/10.1145/2749246.2749275

  20. Huang B, Jarrett NWD, Babu S, Mukherjee S, Yang J (2015) Cumulon: matrix-based data analytics in the cloud with spot instances. PVLDB 9(3):156–167. http://www.vldb.org/pvldb/vol9/p156-huang.pdf

  21. Jangjaimon I, Tzeng N (2013) Adaptive incremental checkpointing via delta compression for networked multicore systems. In: 27th IEEE International Symposium on Parallel and Distributed Processing, IPDPS 2013, Cambridge, MA, USA, May 20–24, 2013, pp 7–18. https://doi.org/10.1109/IPDPS.2013.33

  22. Jangjaimon I, Tzeng N (2015) Effective cost reduction for elastic clouds under spot instance pricing through adaptive checkpointing. IEEE Trans Comput 64(2):396–409. https://doi.org/10.1109/TC.2013.225

    Article  MathSciNet  MATH  Google Scholar 

  23. Javadi B, Thulasiram RK, Buyya R (2011) Statistical modeling of spot instance prices in public cloud environments. In: IEEE 4th International Conference on Utility and Cloud Computing, UCC 2011, Melbourne, Australia, December 5–8, 2011, pp 219–228. https://doi.org/10.1109/UCC.2011.37

  24. Javadi B, Thulasiram RK, Buyya R (2013) Characterizing spot price dynamics in public cloud environments. Future Gener Comput Syst 29(4):988–999. https://doi.org/10.1016/j.future.2012.06.012

    Article  Google Scholar 

  25. Jia Q, Shen Z, Song W, van Renesse R, Weatherspoon H (2016) Smart spot instances for the supercloud. In: Proceedings of the 3rd Workshop on CrossCloud Infrastructures and Platforms, ACM, New York, NY, USA, CrossCloud ’16, pp 5:1–5:6. https://doi.org/10.1145/2904111.2904114

  26. Jung D, Lim J, Yu H, Suh T (2014) Estimated interval-based checkpointing (EIC) on spot instances in cloud computing. J Appl Math 2014:217,547:1–217,547:12. https://doi.org/10.1155/2014/217547

    Article  Google Scholar 

  27. Kaminski B, Szufel P (2015) On optimization of simulation execution on amazon EC2 spot market. Simul Model Pract Theory 58:172–187. https://doi.org/10.1016/j.simpat.2015.05.008

    Article  Google Scholar 

  28. Kaminski B, Szufel P (2015) On optimization of simulation execution on amazon EC2 spot market. Simul Modell Pract Theory 58(Part 2):172–187. doi: 10.1016/j.simpat.2015.05.008

    Article  Google Scholar 

  29. Karunakaran S, Krishnaswamy V, Sundarraj RP (2014) Decisions models and opportunities in cloud computing economics: a review of research on pricing and markets. Springer, Cham, pp 85–99. https://doi.org/10.1007/978-3-319-07950-9_7

    Book  Google Scholar 

  30. Khatua S, Mukherjee N (2013a) Application-centric resource provisioning for amazon EC2 spot instances. Springer, Berlin, pp 267–278. https://doi.org/10.1007/978-3-642-40047-6_29

    Book  Google Scholar 

  31. Khatua S, Mukherjee N (2013b) A novel checkpointing scheme for amazon EC2 spot instances. In: 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2013, Delft, Netherlands, May 13–16, 2013, pp 180–181. https://doi.org/10.1109/CCGrid.2013.71

  32. Marathe A, Harris R, Lowenthal DK, de Supinski BR, Rountree B, Schulz M (2014) Exploiting redundancy for cost-effective, time-constrained execution of HPC applications on amazon EC2. In: The 23rd International Symposium on High-Performance Parallel and Distributed Computing, HPDC’14, Vancouver, BC, Canada—June 23–27, 2014, pp 279–290. https://doi.org/10.1145/2600212.2600226

  33. Mattess M, Vecchiola C, Buyya R (2010) Managing peak loads by leasing cloud infrastructure services from a spot market. In: 2010 IEEE 12th International Conference on High Performance Computing and Communications (HPCC), pp 180–188. https://doi.org/10.1109/HPCC.2010.77

  34. Mazzucco M, Dumas M (2011) Achieving performance and availability guarantees with spot instances. In: 2011 IEEE International Conference on High Performance Computing and Communications, pp 296–303. https://doi.org/10.1109/HPCC.2011.46

  35. Mell P, Grance T (2011) The NIST definition of cloud computing. Tech. Rep. 800-145, National Institute of Standards and Technology (NIST), Gaithersburg, MD. http://csrc.nist.gov/publications/nistpubs/800-145/SP800-145.pdf

  36. Menache I, Shamir O, Jain N (2014) On-demand, spot, or both: dynamic resource allocation for executing batch jobs in the cloud. In: 11th International Conference on Autonomic Computing (ICAC 14), USENIX Association, Philadelphia, PA, pp 177–187. https://www.usenix.org/conference/icac14/technical-sessions/presentation/menache

  37. Ng C, Parkes DC, Seltzer M (2003) Virtual worlds: Fast and strategyproof auctions for dynamic resource allocation. In: Proceedings of the 4th ACM Conference on Electronic Commerce, ACM, New York, NY, USA, EC ’03, pp 238–239. https://doi.org/10.1145/779928.779977

  38. Poola D, Ramamohanarao K, Buyya R (2014) Fault-tolerant workflow scheduling using spot instances on clouds. In: Proceedings of the International Conference on Computational Science, ICCS 2014, Cairns, Queensland, Australia, 10–12 June, 2014, pp 523–533. https://doi.org/10.1016/j.procs.2014.05.047

    Article  Google Scholar 

  39. Poola D, Ramamohanarao K, Buyya R (2016) Enhancing reliability of workflow execution using task replication and spot instances. TAAS 10(4):30:1–30:21. https://doi.org/10.1145/2815624

    Article  Google Scholar 

  40. Porter R (2004) Mechanism design for online real-time scheduling. In: Proceedings of the 5th ACM Conference on Electronic Commerce, ACM, New York, NY, USA, EC ’04, pp 61–70. https://doi.org/10.1145/988772.988783

  41. Qu C, Calheiros RN, Buyya R (2016) A reliable and cost-efficient auto-scaling system for web applications using heterogeneous spot instances. J Netw Comput Appl 65:167–180. https://doi.org/10.1016/j.jnca.2016.03.001

    Article  Google Scholar 

  42. Salehan A, Deldari H, Abrishami S (2017) An online valuation-based sealed winner-bid auction game for resource allocation and pricing in clouds. J Supercomput 73(11):4868–4905

    Article  Google Scholar 

  43. Sharma P, Lee S, Guo T, Irwin D, Shenoy P (2015) Spotcheck: designing a derivative IaaS cloud on the spot market. In: Proceedings of the Tenth European Conference on Computer Systems, ACM, New York, NY, USA, EuroSys ’15, pp 16:1–16:15. https://doi.org/10.1145/2741948.2741953

  44. Sharma P, Irwin D, Shenoy P (2016) How not to bid the cloud. In: Proceedings of the 8th USENIX Conference on Hot Topics in Cloud Computing, USENIX Association, Berkeley, CA, USA, HotCloud’16, pp 1–6. http://dl.acm.org/citation.cfm?id=3027041.3027042

  45. Shroff G (2010) Enterprise cloud computing: technology, architecture, applications. Cambridge University Press, Cambridge

    Book  Google Scholar 

  46. Singh VK, Dutta K (2015) Dynamic price prediction for amazon spot instances. In: 48th Hawaii International Conference on System Sciences, HICSS 2015, Kauai, Hawaii, USA, January 5–8, 2015, pp 1513–1520. https://doi.org/10.1109/HICSS.2015.184

  47. Sinha PK (1996) Distributed operating systems: concepts and design, 1st edn. Wiley-IEEE Press, Hoboken

    Book  Google Scholar 

  48. Sinha PK (2012) Distributed operating systems: concepts and design. PHI Learning Pvt, Ltd, New Delhi

    Google Scholar 

  49. Song Y, Zafer M, Lee KW (2012) Optimal bidding in spot instance market. In: 2012 Proceedings IEEE INFOCOM, pp 190–198. https://doi.org/10.1109/INFCOM.2012.6195567

  50. Subramanya S, Guo T, Sharma P, Irwin D, Shenoy P (2015) Spoton: a batch computing service for the spot market. In: Proceedings of the Sixth ACM Symposium on Cloud Computing, ACM, New York, NY, USA, SoCC ’15, pp 329–341. https://doi.org/10.1145/2806777.2806851

  51. Taifi M (2011) ACM SRC poster: Spotmpi: auction-based high performance cloud computing. In: Conference on High Performance Computing Networking, Storage and Analysis—Companion Volume, SC 2011, Seattle, WA, USA, November 12–18, 2011, pp 115–116. https://doi.org/10.1145/2148600.2148660

  52. Taifi M, Shi JY, Khreishah A (2011) Spotmpi: A framework for auction-based HPC computing using amazon spot instances. In: Algorithms and Architectures for Parallel Processing—11th International Conference, ICA3PP, Melbourne, Australia, October 24–26, 2011, proceedings, part II, pp 109–120. https://doi.org/10.1007/978-3-642-24669-2_11

    Chapter  Google Scholar 

  53. Tang S, Yuan J, Li Xy (2012a) Amazing: An optimal bidding strategy for amazon EC2 cloud spot instance. https://scholar.google.co.in/scholar?hl=en&as_sdt=0%2C5&q=AMAZING%3A+An+Optimal+Bidding+Strategy+for+Amazon+EC2+cloud+spot+instances&btnG=

  54. Tang S, Yuan J, Li XY (2012b) Towards optimal bidding strategy for amazon EC2 cloud spot instance. In: 2012 IEEE Fifth International Conference on Cloud Computing, pp 91–98. https://doi.org/10.1109/CLOUD.2012.134

  55. Tang S, Yuan J, Wang C, Li X (2014) A framework for amazon EC2 bidding strategy under SLA constraints. IEEE Trans Parallel Distrib Syst 25(1):2–11. https://doi.org/10.1109/TPDS.2013.15

    Article  Google Scholar 

  56. Toosi AN, Khodadadi F, Buyya R (2016) SipaaS: spot instance pricing as a service framework and its implementation in openstack. Concurr Comput Pract Exp 28(13):3672–3690. https://doi.org/10.1002/cpe.3749

    Article  Google Scholar 

  57. Veena K, Anand C, Gupta CP (2016) Temporal and spatial trend analysis of cloud spot instance pricing in amazon EC2. In: 2016 IEEE 14th International Conference on Dependable, Autonomic and Secure Computing, 14th International Conference on Pervasive Intelligence and Computing, 2nd International Conference on Big Data Intelligence and Computing and Cyber Science and Technology Congress, DASC/PiCom/DataCom/CyberSciTech 2016, Auckland, New Zealand, August 8–12, 2016, pp 909–912. https://doi.org/10.1109/DASC-PICom-DataCom-CyberSciTec.2016.157

  58. Voorsluys W, Buyya R (2012) Reliable provisioning of spot instances for compute-intensive applications. In: IEEE 26th International Conference on Advanced Information Networking and Applications, AINA, 2012, Fukuoka, Japan, March 26–29, 2012, pp 542–549. https://doi.org/10.1109/AINA.2012.106

  59. Wallace RM, Turchenko V, Sheikhalishahi M, Turchenko I, Shults V, Vazquez-Poletti JL, Grandinetti L (2013) Applications of neural-based spot market prediction for cloud computing. In: 2013 IEEE 7th International Conference on Intelligent Data Acquisition and Advanced Computing Systems (IDAACS), vol 02, pp 710–716. https://doi.org/10.1109/IDAACS.2013.6663017

  60. Wang P, Qi Y, Hui D, Rao L, Liu X (2013) Present or future: optimal pricing for spot instances. In: 2013 IEEE 33rd International Conference on Distributed Computing Systems, pp 410–419. https://doi.org/10.1109/ICDCS.2013.68

  61. Xu H, Li B (2013) A study of pricing for cloud resources. SIGMETRICS Perform Eval Rev 40(4):3–12. https://doi.org/10.1145/2479942.2479944

    Article  MathSciNet  Google Scholar 

  62. Xu Z, Stewart C, Deng N, Wang X (2016) Blending on-demand and spot instances to lower costs for in-memory storage. In: 35th Annual IEEE International Conference on Computer Communications, INFOCOM 2016, San Francisco, CA, USA, April 10–14, 2016, pp 1–9. https://doi.org/10.1109/INFOCOM.2016.7524348

  63. Yi S, Kondo D, Andrzejak A (2010) Reducing costs of spot instances via checkpointing in the amazon elastic compute cloud. In: IEEEE International Conference on Cloud Computing, CLOUD 2010, Miami, FL, USA, 5–10 July, 2010, pp 236–243. https://doi.org/10.1109/CLOUD.2010.35

  64. Yi S, Andrzejak A, Kondo D (2012) Monetary cost-aware checkpointing and migration on amazon cloud spot instances. IEEE Trans Serv Comput 5(4):512–524. https://doi.org/10.1109/TSC.2011.44

    Article  Google Scholar 

  65. Zafer M, Song Y, Lee KW (2012) Optimal bids for spot VMS in a cloud for deadline constrained jobs. In: Proceedings of the 2012 IEEE Fifth International Conference on Cloud Computing, IEEE Computer Society, Washington, DC, USA, CLOUD ’12, pp 75–82. https://doi.org/10.1109/CLOUD.2012.9

  66. Zaman S, Grosu D (2011) Efficient bidding for virtual machine instances in clouds. In: 2011 IEEE 4th International Conference on Cloud Computing, pp 41–48. https://doi.org/10.1109/CLOUD.2011.49

  67. Zhao H, Pan M, Liu X, Li X, Fang Y (2012) Optimal resource rental planning for elastic applications in cloud market. In: Proceedings of the 2012 IEEE 26th International Parallel and Distributed Processing Symposium, IEEE Computer Society, Washington, DC, USA, IPDPS ’12, pp 808–819. https://doi.org/10.1109/IPDPS.2012.77

  68. Zheng L, Joe-Wong C, Tan CW, Chiang M, Wang X (2015) How to bid the cloud. In: Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication, ACM, New York, NY, USA, SIGCOMM ’15, pp 71–84. https://doi.org/10.1145/2785956.2787473

Download references

Author information

Authors and Affiliations

  1. Computer Science and Engineering Department, Motilal Nehru National Institute of Technology Allahabad, Allahabad, 211004, India

    Ashish Kumar Mishra, Brajesh Kumar Umrao & Dharmendra K. Yadav

Authors
  1. Ashish Kumar Mishra
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Brajesh Kumar Umrao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dharmendra K. Yadav
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ashish Kumar Mishra.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mishra, A.K., Umrao, B.K. & Yadav, D.K. A survey on optimal utilization of preemptible VM instances in cloud computing. J Supercomput 74, 5980–6032 (2018). https://doi.org/10.1007/s11227-018-2509-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-018-2509-0

Keywords

Search

Navigation