AWS introduces Amazon S3 Files to simplify cloud data management

Amazon Web Services Inc. introduced a feature called Amazon S3 Files that will make it easier for customers to manage the data they store in its cloud.

The ability was introduced on Tuesday.

Most applications store their data in a file system or storage. A file system organizes records into folders. Object storage, on the other hand, places user records in a single location called a bucket. Attach metadata, or descriptive information, to each record that facilitates data operations such as searching.

Technology also has another important difference. The file system makes it possible to organize records in a folder, while the only way to update a record in the storage is to delete it and insert a new one. Advance technology also completes certain data management tasks quickly.

In general, companies that need both file and object storage should use a separate data center for each. AWS’ new feature for S3 files removes that requirement. It embeds the file system in the Amazon S3 object storage service, which means that users can now store files and objects in the same place.

Besides removing the need to maintain a separate file and object location, the feature also offers other benefits. Synchronizing a record from an object location to a file system or vice versa usually requires copying it. S3 files skip that step. Additionally, it enables applications that were designed to process files to interact with objects stored in S3.

S3 files make S3 objects accessible to workloads through file sharing. When an application sends commands to the file system interface, S3 Files translates them into commands that the S3 subsystem can understand. In some cases, it skips the translation stage and sends requests directly to S3.

When an application requests to read records, S3 Files moves them from S3 to a high-speed storage infrastructure that can process the request quickly. According to AWS, this feature can provide throughput of up to several terabytes per second. Requests to write data are processed in the same way. S3 files move each request to high-speed storage and sync them back to S3.

“For files not stored in high-performance storage such as those that require large sequential reads, S3 Files automatically uses those files directly from Amazon S3 to increase performance,” wrote AWS engineer Sebastien Stormacq in a letter. blog post. “In byte-range reads, only requested bytes are transferred, reducing data movement and cost.”

S3 files work with Amazon EC2 instances, containers and serverless AWS Lambda functions. It is usually found in 34 cloud regions.

Image: Tony Webster/Flickr