Amazon S3 Object Lambda now generally available Amazon Web Services (AWS), makes it easier to customize data that is retrieved from Amazon S3 for use by other applications. The new S3 object lambda feature is now available. Users can run code against their data while it’s being transferred from Amazon S3 into another application. This feature is especially useful for organizations who share their S3 data to multiple applications that have their own formatting requirements. Instead of creating a proxy layer to transform data as it leaves S3, or making multiple copies the same data for each application, S3 Object Lambda allows users to transform their S3 data using AWS Lambda function. S3 Object Lambda allows you to add your code to process data retrieved form S3 before returning to an application,” Danilo Poccia, AWS evangelist, stated in a blog post last Wednesday announcing its availability. This feature will make it easier to, among other things, remove customer data before it is used for analytics, convert a XML dataset to JSON, and add information from another service to an existing dataset. Poccia stated that S3 Object Lambda uses AWS Lambda functions to “automatically process, transform and store your data as it is being retrieved by S3”. “The Lambda function can be invoked inline with a standard GET request to S3 so you don’t need to modify your application code. As described by Poccia, using S3 Object Lambda involves five steps.

To transform data for your case, create a Lambda Function.

From the S3 Management Console, create an S3 Object Lambda access point.

Select the Lambda function you created above.

To allow S3 Object Lambda access the original object, provide a supporting S3 Access Point

To retrieve data from S3, update your application configuration.

S3 Object Lambda can currently be accessed in most AWS regions. It can be accessed via AWS Command Line Interface (Management Console), SDKs or the SDKs. More information is available here.

By DaisyOctober 28, 2022