Kinesis

how to do fan-out and fan-in with AWS Lambda

In the last post, we look at how you can imple­ment pub-sub with AWS Lamb­da. We com­pared sev­er­al event sources you can use, SNS, Kine­sis streams and DynamoDB streams, and the trade­offs avail­able to you. Let’s look at anoth­er mes­sag­ing pat­tern today, push-pull, which is often referred to as fan-out­/­fan-in. It’s real­ly two sep­a­rate pat­terns …

how to do fan-out and fan-in with AWS Lamb­daRead More »

What is the best event source for doing pub-sub with AWS Lambda?

AWS offers a wealth of options for imple­ment­ing mes­sag­ing pat­terns such as pub-sub with Lamb­da, let’s com­pare and con­trast some of these options. The pub-sub pat­tern Pub­lish-Sub­scribe (often short­ened to pub-sub) is a mes­sag­ing pat­tern where pub­lish­ers and sub­scribers are decou­pled through an inter­me­di­ary bro­ker (ZeroMQ, Rab­bit­MQ, SNS, etc.). SNS + Lamb­da In the AWS ecosys­tem, the obvi­ous …

What is the best event source for doing pub-sub with AWS Lamb­da?Read More »

Capture and forward correlation IDs through different Lambda event sources

Server­less archi­tec­tures are microser­vices by default, you need cor­re­la­tion IDs to help debug issues that spans across mul­ti­ple func­tions, and pos­si­bly dif­fer­ent event source types — asyn­chro­nous, syn­chro­nous and streams. This is the last of a 3-part mini series on man­ag­ing your AWS Lamb­da logs. If you haven’t read part 1 yet, please give it a read now. …

Cap­ture and for­ward cor­re­la­tion IDs through dif­fer­ent Lamb­da event sourcesRead More »

Auto-scaling Kinesis streams with AWS Lambda

Fol­low­ing on from the last post where we dis­cussed 3 use­ful tips for work­ing effec­tive­ly with Lamb­da and Kine­sis, let’s look at how you can use Lamb­da to help you auto scale Kine­sis streams. Auto-scal­ing for DynamoDB and Kine­sis are two of the most fre­quent­ly request­ed fea­tures for AWS, as I write this post I’m sure the folks …

Auto-scal­ing Kine­sis streams with AWS Lamb­daRead More »

AWS Lambda —3 pro tips for working with Kinesis streams

At Yubl, we arrived at a non-triv­ial server­less archi­tec­ture where Lamb­da and Kine­sis became a promi­nent fea­ture of this archi­tec­ture. Whilst our expe­ri­ence using Lamb­da with Kine­sis was great in gen­er­al, there was a cou­ple of lessons that we had to learn along the way. Here are 3 use­ful tips to help you avoid some …

AWS Lamb­da —3 pro tips for work­ing with Kine­sis streamsRead More »

Yubl’s road to Serverless architecture — Testing and CI/CD

part 1: overview part 2: test­ing and CI/CD <- you’re here part 3: ops part 4: build­ing a scal­able noti­fi­ca­tion sys­tem part 5: build­ing a bet­ter rec­om­men­da­tion sys­tem Hav­ing spo­ken to quite a few peo­ple about using AWS Lamb­da in pro­duc­tion, test­ing and CI/CD are always high up the list of ques­tions, so I’d like to use …

Yubl’s road to Server­less archi­tec­ture — Test­ing and CI/CDRead More »

Yubl’s road to Serverless architecture — overview

part 1: overview <- you’re here part 2: test­ing and CI/CD part 3: ops part 4: build­ing a scal­able noti­fi­ca­tion sys­tem part 5: build­ing a bet­ter rec­om­men­da­tion sys­tem Since Yubl’s clo­sure quite a few peo­ple have asked about the server­less archi­tec­ture we end­ed up with and some of the things we have learnt along the …

Yubl’s road to Server­less archi­tec­ture — overviewRead More »

New releases — DynamoDB.SQL and Darkseid

Hi, just a quick update on two of my libraries aimed at mak­ing AWS eas­i­er to work with from .Net.   DynamoDB.SQL DynamoDB.SQL is a SQL-like exter­nal DSL for query­ing & scan­ning data in Ama­zon DynamoDB. Ver­sion 3.0.0 has been released, which moves away from the mono­lith­ic .Net AWSSDK (v2.x.x), and onto the DynamoDB spe­cif­ic pack­age. You can …

New releas­es — DynamoDB.SQL and Dark­seidRead More »

By continuing to use the site, you agree to the use of cookies. more information

The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept" below then you are consenting to this.

Close