DynamoDB Archives | Page 2 of 3 | theburningmonk.com

What is the best event source for doing pub-sub with AWS Lambda?

AWS, Design Patterns, DynamoDB, Kinesis, Lambda, Programming, Serverless, SNS / April 2, 2018 September 16, 2023

AWS offers a wealth of options for implementing messaging patterns such as pub-sub with Lambda, let’s compare and contrast some of these options. The pub-sub pattern Publish-Subscribe (often shortened to pub-sub) is a messaging pattern where publishers and subscribers are decoupled through an intermediary broker (ZeroMQ, RabbitMQ, SNS, etc.). SNS + Lambda In the AWS ecosystem, the obvious …

What is the best event source for doing pub-sub with AWS Lambda? Read More »

How to implementation pagination with DynamoDB

AWS, Design Patterns, DynamoDB, Programming / February 19, 2018 September 15, 2023

“Guys, we’re doing pagination wrong…” These are the words that I had to mutter quite a few times in my career, at the dissatisfaction of how pagination had been implemented on several projects. Still, that dissatisfaction is nothing compared to how I feel when I occasionally had to ask “why is this API not paginated..?” So, …

How to implementation pagination with DynamoDB Read More »

The problems with DynamoDB Auto Scaling and how it might be improved

AWS, DynamoDB, Programming / August 7, 2017 October 6, 2019

TL;DR – AWS announced the long awaited auto scaling capability for DynamoDB, but we found it takes too long to scale up and doesn’t scale up aggressively enough as it’s held back by using consumed capacity as scaling metric rather than actual request count. Here at Space Ape Games we developed an in-house tech to auto scale DynamoDB …

The problems with DynamoDB Auto Scaling and how it might be improved Read More »

aws x-ray and lambda : the good, the bad and the ugly

API Gateway, AWS, DynamoDB, Lambda, Programming, S3, Serverless, X-Ray / June 26, 2017 September 5, 2020

AWS announced general availability of AWS Lambda support for AWS X-Ray back in May. It’s taken me a while to try it out, and whilst I see plenty of values I think its current limitations significantly restricts its usefulness in a complex system. I found Lambda-specific documentations to be fragmented and I had to rely …

aws x-ray and lambda : the good, the bad and the ugly Read More »

Beware of dilution of DynamoDB throughput due to excessive scaling

4 Comments / AWS, DynamoDB / May 22, 2017 January 26, 2020

update Jan 26, 2020: since this article was already written, the problem of throughput dilution has been resolved by DynamoDB’s adaptive capacity feature which is applied in real-time. TL;DR – The no. of partitions in a DynamoDB table goes up in response to increased load or storage size, but it never come back down, ever. DynamoDB …

Beware of dilution of DynamoDB throughput due to excessive scaling Read More »

AWS Lambda – build yourself a URL shortener in 2 hours

3 Comments / API Gateway, AWS, DynamoDB, Lambda, Programming, Serverless / April 4, 2017 October 6, 2019

An interesting requirement came up at work this week where we discussed potentially having to run our own URL Shortener because the Universal Links mechanism (in iOS 9 and above) requires a JSON manifest at https://domain.com/apple-app-site-association Since the OS doesn’t follow redirects this manifest has to be hosted on the URL shortener’s root domain. Owing to a limitation on AppsFlyer it’s …

AWS Lambda – build yourself a URL shortener in 2 hours Read More »

Yubl’s road to Serverless architecture – overview

6 Comments / API Gateway, AWS, DynamoDB, Kinesis, Lambda, Node.js, Programming, S3, Serverless / December 7, 2016 March 11, 2018

part 1: overview <- you’re here part 2: testing and CI/CD part 3: ops part 4: building a scalable notification system part 5: building a better recommendation system Since Yubl’s closure quite a few people have asked about the serverless architecture we ended up with and some of the things we have learnt along the …

Yubl’s road to Serverless architecture – overview Read More »

Slides and recording of my Lambda talk at LeetSpeak 2016

Leave a Comment / API Gateway, AWS, DynamoDB, Kinesis, Lambda, Node.js, Programming, Serverless / November 7, 2016 November 4, 2016

[slideshare id=67212536&doc=buildreactivesystemsonlambda-161015103832]

Recording and Slides for F# DSLs talk at F# |> Bristol

1 Comment / AWS, CloudWatch, Domain Specific Language, DynamoDB, DynamoDb.SQL, F#, Programming, SimpleWorkflow.Extensions, SWF / March 3, 2016 March 3, 2016

Here’s the recorded live stream of the F# DSLs session I did at the F# |> Bristol user group last night. (apologies for the first few mins where I forgot to share my screen to the Hangout…) and here’s the slides to go with the talk: Tame cloud complexity with F#-powered DSLs from Yan Cui

Slides for F# DSL talk at LambdaDays

Leave a Comment / AWS, CloudWatch, DynamoDB, Programming, SWF / February 18, 2016 February 15, 2016

Hi, thanks to everyone who turned up to my talk at LambdaDays this afternoon, here are the slides. Tame cloud complexity with F#-powered DSLs from Yan Cui You can find the source code for the projects I discussed below: DynamoDB.SQL : source code & nuget package SimpleWorkflow.Extensions : source code & nuget package CloudWatch.Selector : …

Slides for F# DSL talk at LambdaDays Read More »