<p>Today, most organizations either want to move away from their infrastructure from on-premises to the cloud or use a hybrid model. According to Gartner, by 2022 the public cloud computing market value will grow up to $331.2 billion. It's no surprise that, in the future, every company will use one of the cloud services for their applications at some point. However, if you are looking for the best cloud service provider for your application, here are some aspects that you must consider. This blog will give you an overview of storage services being offered by top cloud service providers-- Google Cloud Platform (GCP) and AWS.</p> <table style="font-size: 15px; border-collapse: separate;" cellspacing="10" width="50%"> <th style="background-color: #cad5d7; padding: 10px; width: 25%; text-align: left;">Storage Services by GCP</th> <th style="background-color: #cad5d7; padding: 10px; width: 25%; text-align: left;">Storage Services by AWS</th> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">GCP Cloud Storage Regional and Multi-Regional</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Amazon S3</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">GCP Cloud Storage Nearline</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Amazon EBS</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">GCP Cloud Storage Cold line</td><td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Amazon EFS</td> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">GCP Persistent Disk</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Amazon Glacier</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">GCP Filestore</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Amazon FSx for Lustre</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;"></td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Amazon FSx for Windows File Server</td> </tr> </table> <p>Rather than understanding every service offering by Google Cloud and AWS separately, let’s go through the situations where these services are best suited. Here are some general scenarios:</p> <ol> <li>Cloud storage to save a large amount of data.</li> <li>Cloud storage to attach to virtual machines.</li> <li>Cloud storage to use as a standard file system.</li> <li>Cloud storage for backups.</li> <li>Cloud storage for archives.</li> </ol> <h3 style="text-align: left;">1. Cloud storage to save a large amount of data</h3> <p>Do you want to save a large amount of highly available data, scalable, and low latency (in fetching the data) for your application? You have Google Cloud storage (Regional and Multi-regional) and Amazon Simple Storage Service (S3) services for such situations.</p> <p>Both these Google Cloud and AWS storage services store data in the form of buckets and objects. These services treat the files stored in the system as atomic units. It means that you cannot overwrite a particular section of the file; you can only perform ‘create’ or ‘delete’ operations. Both these services support object versioning and lifecycle management. Another advantage of these services is that you can notify the other service when a file is uploaded or deleted.</p> <p><img style="padding: 0px 20px;" width="600px" height="auto" alt="Architecture of a Bucket" src="https://images.prismic.io/gspann/4e7f61a6-1175-4872-81f9-26203028c7e9_Architecture+of+a+Bucket.jpg?auto=compress,format" /></p> <p>In terms of cost, both these services charge you for the amount of data stored every month by network egress for API requests made to the cloud storage based on the data storage region. These services give you the flexibility to store large amounts of data without worrying about the underlying infrastructure.</p> <p>Here are the summarized features of Google Cloud Platform (Regional and Multi-regional) vs. Amazon Simple Storage Service (S3) services.</p> <table style="font-size: 15px; border-collapse: separate;" cellspacing="10" width="80%"> <th style="background-color: #cad5d7; padding: 10px; width: 20%; text-align: left;">Features</th> <th style="background-color: #cad5d7; padding: 10px; width: 30%; text-align: left;">GCP Regional and Multi-regional</th> <th style="background-color: #cad5d7; padding: 10px; width: 30%; text-align: left;">Amazon Simple Storage Service (S3) Services</th> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Unit of Deployment</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Bucket</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Bucket</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Deployment Identifier</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Globally Unique Key</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Globally Unique Key</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">File System Emulation</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Limited</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Limited</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Object Metadata</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Yes</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Yes</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Object Versioning</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Yes</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Yes</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Object Lifecycle Management</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: center; border-bottom: none; text-align: left;">Yes</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align:center; border-bottom: none; text-align: left;">Yes</td> </tr> </table> <h3 style="text-align: left;">2. Cloud storage to attach to the virtual machines</h3> <p>Virtual machines (VM) are one of the key resources in cloud computing. VM uses internal memory to store the application data. You can use a storage service that is attached to a VM over a network or directly. In such cases, cloud service providers may offer you block storage. Google Cloud calls it a ‘Persistent Disk,’ and ‘AWS’ calls it an ‘Amazon Elastic Block Storage (EBS).</p> <p>You can use Persistent Disk to mount to a Compute Engine (GCP VMs) and Amazon EBS to mount to Amazon EC2 (AWS VMs). These block-storage services can scale up to 64 TB (for Persistent disk) and 16 TIB (for Amazon EBS). You can attach block storage to a VM in two different ways in both services: locally or over the network.</p> <p>If your application needs high IOPS (Input/Output Operations Per Second), it is better to use locally-attached block storage. When your application can compromise on IOPS, then you can choose network-attached block storage. Another advantage of block storage is that you can attach multiple disks to a single VM. The maximum number of disks attached to a single Compute Engine is 128 and to Amazon EC2 is 40. In both the services, Google Cloud and AWS, you can create a backup of disk volume by creating a snapshot to provision a new VM with the same data later.</p> <p>Here are the summarized features of Google Cloud Platform Persistent Disk vs. Amazon EBS.</p> <table style="font-size: 15px; border-collapse: separate;" cellspacing="10" width="80%"> <th style="background-color: #cad5d7; padding: 10px; width: 20%; text-align: left;">Features</th> <th style="background-color: #cad5d7; padding: 10px; width: 30%; text-align: left;">GCP Persistent Disk</th> <th style="background-color: #cad5d7; padding: 10px; width: 30%; text-align: left;;">Amazon EBS</th> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Volume Types</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Zonal standard disks (HDD), regional disks, zonal SSD disks, regional SSD disks</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">EBS General Purpose SSD, Cold HDD, EBS Provisioned IOPS SSD, Throughput Optimized HDD.</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Attached Volumes Per Instance</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: center; border-bottom: none; text-align: left;">Maximum 128</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: center; border-bottom: none; text-align: left;">Maximum 40</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Volume Attachment</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Read-only volumes can be attached with multiple instances, while read-write volumes can be attached to only one instance at a time.</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">It can be attached to only one instance.</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Max Volume Size</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">64 TB</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">16 TIB</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Snapshotting</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Yes</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Yes</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Snapshot Locality</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Global</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Regional</td> </tr> </table> <p>Prices of both EBS and Persistent Disks are based on per-GB-per-month usage. In addition to this, EBS prices can vary depending on the region.</p> <h3 style="text-align: left;">3. Cloud storage service to use as a standard file system</h3> <p>If you want to use a traditional standard file system instead of a block and object storage, Google Cloud offers Cloud Filestore, and AWS offers Amazon Elastic File System (EFS) and Amazon FSx.</p> <p>With these services, you can mount the filesystem to the VMs through a network-attached storage (NAS). These services offer high throughput, low latency, and high IOPS. GCP offers two types of Cloud Filestores: standard and premium. Besides EFS, Amazon offers Amazon FSx Luster and Amazon FSx for Windows file servers. FSx Luster is used for performing heavy compute-intensive loads, such as machine-learning, heavy computing, etc., and FSx for Windows File server offers more advanced features to fit your windows application.</p> <p>Here are the summarized features of Google Cloud Filestore vs. Amazon Elastic File System (EFS).</p> <table style="font-size: 15px; border-collapse: separate;" cellspacing="10" width="80%"> <th style="background-color: #cad5d7; padding: 10px; width: 20%; text-align: left;">Features</th> <th style="background-color: #cad5d7; padding: 10px; width: 30%; text-align: left;">GCP Cloud Filestore</th> <th style="background-color: #cad5d7; padding: 10px; width: 30%; text-align: left;">Amazon Elastic File System (EFS)</th> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Tiers/Modes</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Standard and premium modes</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">General Purpose and Max I/O. Each mode supports either Bursting Throughput or Provisioned Throughput mode.</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Deployment Locality</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Based on Zone</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Based on Region</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Encryption</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Enabled at rest and in transit by default.</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">At rest and in transit. Needs to be enabled.</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Max File Size</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">16TB</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">47.9TB</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Protocol</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">NFSv3</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">NFSv4</td> </tr> </table> <p>For these services, Google Cloud and AWS charge on a per-GB-per-month basis, and the price may change depending on the region.</p> <h3 style="text-align: left;">4. Cloud storage service for backups</h3> <p>To store your application data that is not being used cost-effectively, Google Cloud offers Cloud Storage Nearline storage service, and AWS offers Amazon S3 Standard-IA and One Zone-IA.</p> <p>These services are enhanced versions of cloud storage in Google Cloud and Amazon S3 in AWS that can reduce the storage cost. These storage services make backups wherein you can access data once a month. Google Cloud Storage Nearline can deploy data at a multi-regional and regional level, but AWS uses S3 Standard-IA for regional deployments and S3 One Zone-IA for zonal deployments.</p> <p>Here are the summarized features of Google Cloud Storage Nearline storage service vs. Amazon S3 Standard-IA and One Zone-IA.</p> <table style="font-size: 15px; border-collapse: separate;" cellspacing="10" width="80%"> <th style="background-color: #cad5d7; padding: 10px; width: 20%; text-align: left;">Features</th> <th style="background-color: #cad5d7; padding: 10px; width: 30%; text-align: left;">GCP Cloud Storage Nearline Storage Service</th> <th style="background-color: #cad5d7; padding: 10px; width: 30%; text-align: left;">Amazon S3 Standard-IA and One Zone-IA</th> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: center; border-bottom: none; text-align: left;">First-byte Latency</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: center; border-bottom: none; text-align: left;">Milliseconds (identical to Cloud Storage Standard)</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Standard-IA: Milliseconds (identical to Amazon S3 standard)<br>One Zone-IA: Milliseconds (identical to Amazon S3 standard)</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: center; border-bottom: none; text-align: left;">SLA</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: center; border-bottom: none; text-align: left;">Yes</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Standard-IA: Yes <br>One Zone-IA: Yes</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: center; border-bottom: none; text-align: left;">Minimum Storage Period</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: center; border-bottom: none; text-align: left;">30 days</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Standard-IA: 30 days <br>One Zone-IA: 30 days</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: center; border-bottom: none; text-align: left;">Deployment Locality</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: center; border-bottom: none; text-align: left;">Multi-Regional or Regional</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Standard-IA: Regional <br>One Zone-IA: Zonal</td> </tr> </table> <p>Pricing follows the same pattern as the previous two types of storage services. However, a significant setback for AWS services is that you would need to store at least 128 KB of data. If your storage is lower than 128 KB, AWS will still charge you for 128 KB. In AWS, if you delete your data before the minimum storage time, i.e., 30 days, you will be charged for 30 days, whereas GCP doesn’t charge you for the remaining days.</p> <h3 style="text-align: left;">5. Cloud storage service for archives</h3> <p>When you want to store the files that are accessed once in three months, you can opt for Google Cloud Storage Coldline and AWS Amazon Glacier.</p> <p>These services are used to store log data of an application for future purposes. Data stored in these services are retrieved as quickly as possible. GCP and AWS will charge you to retrieve data per GB.</p> <p>Here are the summarized features of Google Cloud Storage Coldline vs. Amazon Glacier.</p> <table style="font-size: 15px; border-collapse: separate;" cellspacing="10" width="80%"> <th style="background-color: #cad5d7; padding: 10px; width: 20%; text-align: left;">Features</th> <th style="background-color: #cad5d7; padding: 10px; width: 30%; text-align: left;">GCP Cloud Storage Coldline</th> <th style="background-color: #cad5d7; padding: 10px; width: 30%; text-align: left;">Amazon Glacier</th> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">First-byte Latency</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Milliseconds (identical to Cloud Storage Standard)</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Minutes to hours</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Deployment Locality</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Multi-Regional or Regional</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Regional</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Minimum Storage Period</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">90 days</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">90 days</td> </tr> <tr> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">SLA</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">Yes</td> <td style="background-color: #f1f5f6; padding: 10px; vertical-align: top; border-bottom: none; text-align: left;">No</td> </tr> </table> <p>Both Google Cloud and AWS will charge you based on the amount of data stored per month. For instance, in AWS, when you store data for five days, it will still charge you for 90 days (which is the minimum storage period), but Google Cloud Platform will charge you for five days only.</p> <p>Every cloud service provider offers different storage services that fit your cloud application requirements. Hence, you must choose the best storage service to help your application run smoothly and provide valuable services to the users. Your cloud service choice can significantly reduce your spending since not all the data needs to be accessed frequently; hence it does not require high-speed data processing.</p>