Monthly roundup – re:Invent Edition

Each Lambda function can now burst to 1000 concurrent executions every 10 seconds, independently. It means it will take a single function just a minute to reach a peak concurrency of 6,000 concurrent executions. Every function can burst independently. So assuming your account level concurrency limit allows, multiple functions can burst to the 6,000 concurrent executions within that same minute. This shatters the previous account-wide burst concurrency limit of 3000, followed by an increment of 500 per minute.

This means Lambda is now suitable for use cases that experience very bursty traffic! But if the high level of throughput is sustained (rather than in a burst) then you should still consider moving the workload to containers for better cost efficiency.

Step Functions

Step Functions supports public HTTP endpoints

You can now call 3rd party APIs directly from your state machine.

Step Functions adds TestState API

You can use this new endpoint to test individual states without deploying the whole state machine. This is especially useful for those hard-to-reach branches of state machines. I’m excited about this feature and will update my Testing Serverless Architectures course shortly.

Step Functions adds optimized integration with Bedrock

Step Functions Workflow Studio now integrates with Application Composer

CloudWatch

CloudWatch logs adds anomaly detection

CloudWatch adds AI assistant

You can now use English to query CloudWatch logs and metrics. In my testing, it often doesn’t get the query right the first time. For example, in the example below, the generated query returns the function with the most invocations, not cold starts.

I wouldn’t trust this AI assistant’s output at face value, but it can still give you a good starting point and save you some typing.

CloudWatch adds an infrequent access log class

If you don’t need any of these features, then the new infrequent access log class can save you 50% on log ingestion costs. It’s a shame you can’t use subscription filters. This can impact many vendors who use subscription filters today to process and forward your logs.

CloudWatch Application Signals

Ok, not a serverless news per se, as this is only applicable to EC2, ECS and EKS and only works for Java applications. But it’s a good first step from AWS to provide automated instrumentation for customer applications.

SQS

SQS FIFO can now process up to 70,000 messages per second

SQS FIFO DLQs adds redrive support

That is, you can now redrive messages from an SQS FIFO DLQ to the source SQS FIFO queue for reprocessing.

AI

Amazon Q

AWS’s new chat assistant. Available in AWS documentation, AWS console as well as your IDE (via the AWS Toolkit plugin).

It can provide contextual answers – if you talk to it in the AWS console, it will have access to your AWS resources, and if you talk to it in VS Code then it can help you with your code.

From my testing thus far, its answers are hit-and-miss. Subjectively, it feels less accurate compared to ChatGPT and it hallucinates more.

But it’s free.

Bedrock gets guardrails

Bedrock Knowledge Base is generally available

Bedrock Agents is generally available

Bedrock supports new foundational models

Bedrock supports batch inference

SageMaker gets HyperPod

And promises to reduce training time by 40%!

Vector search for Amazon MemoryDB for Redis

Vector search for Amazon DocumentDB

OpenSearch

Vector engine for OpenSearch Serverless is GA

But remember, OpenSearch Serverless has a minimum charge of $700/month!

No-code integration from DynamoDB to OpenSearch

This is a nice update. You don’t have to write custom code to sync DynamoDB changes to OpenSearch anymore.

OpenSearch adds a new OR1 instance family

It promises to give you a 30% better price-to-performance ratio.

Other

Aurora Limitless Database

“enables you to scale your Amazon Aurora clusters to millions of write transactions per second and manage petabytes of data”

Wow!

Elasticache “serverless”

Not as bad as OpenSearch “serverless”, but this one comes with a minimum cost of $90/month even if you have no data.

If you really need a serverless cache, go check out Momento instead.

CloudFormation can sync your template files in Git

This is not for everyone, but there are lots of small admin/ops/security stacks that can benefit from this.

S3 adds Express One Zone storage class

Data is still replicated across multiple disks and retains the 11 nines durability. But you can suffer data loss if the data centre is destroyed. I’m surprised the calculation of durability doesn’t include some probability for such (highly unlikely) scenarios.

It promises single-digit ms latency. The cost per million requests is 50% cheaper, but the storage cost is 7x the cost of the standard class.

This is not for everyone, unless you need low latency (single digit ms) access to relatively small amounts of data.

EventBridge adds partner integration with Adobe and Stripe

Application Composer is now integrated into VS Code

If you work with AWS SAM or CloudFormation templates, then you can use Application Composer to visualize and design your template directly in VS Code (via the AWS Toolkit plugin).

Blog posts

I published seven blog posts.

Podcast

We aired five episodes on the Real-World Serverless podcast:

YouTube

I published eleven videos.

If you like the topics I cover then please subscribe to my channel and never miss a thing.

Webinar

I had a chat with Waldemar Hummer, CTO of LocalStack, on some key takeaways from running and debugging serverless applications locally. I have been sceptical of LocalStack for a long time, but it’s looking slick these days. It even simulates IAM checks and can identify permission-related problems.

The webinar was on the 9th of November, and the recording should be available soon.

Looking ahead to December

Ok, November was crazy! I’m taking some time off in December to catch up on re:Invent sessions and update my courses. If you’re taking part in the January cohort of Production-Ready Serverless, then expect plenty of brand-new lectures and all the exercises will be available in CDK as well as the Serverless Framework.

On December 11th, I will be cohosting a free webinar with Khawaja Shams (CEO of Momento) and Aviad Mor (CTO of Lumigo). Hope to see you there!

Until then, ciao :-)

Whenever you’re ready, here are 4 ways I can help you:

Production-Ready Serverless: Join 20+ AWS Heroes & Community Builders and 1000+ other students in levelling up your serverless game. This is your one-stop shop for quickly levelling up your serverless skills.
Do you want to know how to test serverless architectures with a fast dev & test loop? Check out my latest course, Testing Serverless Architectures and learn the smart way to test serverless.
I help clients launch product ideas, improve their development processes and upskill their teams. If you’d like to work together, then let’s get in touch.
Join my community on Discord, ask questions, and join the discussion on all things AWS and Serverless.