Google Cloud has expanded functionality of its virtual machines, making them more suitable for GPU-heavy workloads like deep learning and image recognition.
Each custom Google Cloud VM can now support up to four Nvidia Tesla K80 accelerators that essentially combine two GK210 GPUs on a single board.
The service is currently available in public beta from data center regions in the US, Europe and Asia.
Google Cloud seems to be late to the GPU party: IBM SoftLayer has been offering a similar service since July 2015. AWS launched VMs that support up to eight Tesla K80 units in October 2016, while Microsoft Azure introduced the same hardware in December. Chinese cloud giant Alibaba also supports GPUs, but it uses chips from AMD, not Nvidia.
Fashionably late
GPGPU - general-purpose computing on graphics processing units - is a relatively recent trend, but the one where Nvidia has been making solid advances. HPC clusters equipped with powerful GPUs can now carry out certain highly parallel calculations much faster than Intel’s most powerful Xeons on their own.
Each Tesla K80 Accelerator features 4992 cores and 24 GB of GDDR5 memory, with 480 GB/s of aggregate memory bandwidth.
With the new service, up to four Tesla K80 (or eight GPUs) can be attached directly to any custom Google Compute Engine virtual machine to offer bare-metal levels of performance. The GPUs can also be used with the Google Cloud Machine Learning platform that supports popular frameworks such as TensorFlow, Theano, Torch, MXNet and Caffe.
These combinations can be used for video and image transcoding, seismic analysis, molecular modeling, computational finance, fluid dynamics, analytics and visualization.
Google says the service enables customers to quickly spin up a large cluster of GPU machines for rapid deep learning and machine learning training, thereby shortening app development cycles. When the GPU resources are no longer needed they can be retired, so customers only pay for what they use.
In the US, each K80 GPU attached to a VM is priced at $0.700 per hour per GPU. The hardware is more expensive in Asia and Europe, where it is priced at $0.770 per hour per GPU.