Serverless Archives

AWS Lambda – use the invocation context to better handle slow HTTP responses

API Gateway, AWS, Lambda, Programming, Serverless

With API Gateway and Lambda, you’re forced to use relatively short timeouts on the server-side: API Gateway have a 30s max timeout on all integration points Serverless framework uses a default of 6s for AWS Lambda functions However, as you have limited influence over a Lambda function’s cold start time and have no control over the amount of …

AWS Lambda – use the invocation context to better handle slow HTTP responses Read More »

Applying principles of chaos engineering to AWS Lambda with latency injection

API Gateway, AWS, Lambda, Programming, Serverless

This is part 2 of a multipart series that explores ideas on how we could apply the principles of chaos engineering to serverless architectures built around Lambda functions. part 1: how can we apply principles of chaos engineering to Lambda? part 2: latency injection for APIs <- you’re here part 3: fault injection for Lambda …

Applying principles of chaos engineering to AWS Lambda with latency injection Read More »

How can we apply the principles of chaos engineering to AWS Lambda?

AWS, Chaos Engineering, Lambda, Programming, Serverless

This is the first of a multipart series that explores ideas on how we could apply the principles of chaos engineering to serverless architectures built around Lambda functions. part 1: how can we apply principles of chaos engineering to Lambda? <- you’re here part 2: latency injection for APIs part 3: fault injection for Lambda …

How can we apply the principles of chaos engineering to AWS Lambda? Read More »

Mind the 75GB limit on AWS Lambda deployment packages

AWS, Lambda, Programming, Serverless

Gotta clean up those old Lambda deployment packages! With AWS Lambda and the Serverless framework, deploying your code has become so simple and frictionless. As you move more and more of your architecture to run on Lambda, you might find that, in addition to getting things done faster you are also deploying your code more frequently. That’s awesome! But, …

Mind the 75GB limit on AWS Lambda deployment packages Read More »

You should use SSM Parameter Store over Lambda env variables

AWS, Lambda, Programming, Serverless

AWS Lambda announced native support for environment variables at the end of 2016. But even before that, the Serverless framework had supported environment variables and I was using them happily as me and my team at the time migrated our monolithic Node.js backend to serverless. However, as our architecture expanded we found several drawbacks with managing configurations with environment variables. …

You should use SSM Parameter Store over Lambda env variables Read More »

Using Protocol Buffers with API Gateway and AWS Lambda

API Gateway, AWS, Lambda, Performance, Programming, protobuf, Serverless

AWS announced binary support for API Gateway in late 2016, which opened up the door for you to use more efficient binary formats such as Google’s Protocol Buffers and Apache Thrift. Why? Compared to JSON – which is the bread and butter for APIs built with API Gateway and Lambda – these binary formats can produce significantly smaller payloads. At scale, …

Using Protocol Buffers with API Gateway and AWS Lambda Read More »

Capture and forward correlation IDs through different Lambda event sources

API Gateway, AWS, Kinesis, Lambda, Serverless

Serverless architectures are microservices by default, you need correlation IDs to help debug issues that spans across multiple functions, and possibly different event source types – asynchronous, synchronous and streams. This is the last of a 3-part mini series on managing your AWS Lambda logs. If you haven’t read part 1 yet, please give it a read now. …

Capture and forward correlation IDs through different Lambda event sources Read More »

Tips and tricks for logging and monitoring AWS Lambda functions

AWS, CloudWatch, Lambda, Serverless

The common practice of using agents/daemons to buffer and batch send logs and metrics are no longer applicable in the world of serverless. Here are some tips to help you get the most out of your logging and monitoring infrastructure for your functions. This is part 2 of a 3-part mini series on managing your …

Tips and tricks for logging and monitoring AWS Lambda functions Read More »

Centralised logging for AWS Lambda

AWS, CloudWatch, Lambda, Serverless

[update 23/07/2018]: The approach outlined in this post works well when you start out, but you can run into concurrency related issues at scale. To see a better approach when running at scale, please see the revised version of this post here. CloudWatch Logs is hardly the ideal fit for all your logging needs, …

Centralised logging for AWS Lambda Read More »

Write recursive AWS Lambda functions the right way

AWS, Lambda, Programming, Serverless

You may not realise that you can write AWS Lambda functions in a recursive manner to perform long-running tasks. Here’s two tips to help you do it right. AWS Lambda limits the maximum execution time of a single invocation to 5 minutes. Whilst this limit might be raised in the future, it’s likely that you’ll still …

Write recursive AWS Lambda functions the right way Read More »