how to do fan-out and fan-in with AWS Lambda

In the last post, we look at how you can imple­ment pub-sub with AWS Lamb­da. We com­pared sev­er­al event sources you can use, SNS, Kine­sis streams and DynamoDB streams, and the trade­offs avail­able to you. Let’s look at anoth­er mes­sag­ing pat­tern today, push-pull, which is often referred to as fan-out­/­fan-in. It’s real­ly two sep­a­rate pat­terns …

how to do fan-out and fan-in with AWS Lamb­daRead More »

What is the best event source for doing pub-sub with AWS Lambda?

AWS offers a wealth of options for imple­ment­ing mes­sag­ing pat­terns such as pub-sub with Lamb­da, let’s com­pare and con­trast some of these options. The pub-sub pat­tern Pub­lish-Sub­scribe (often short­ened to pub-sub) is a mes­sag­ing pat­tern where pub­lish­ers and sub­scribers are decou­pled through an inter­me­di­ary bro­ker (ZeroMQ, Rab­bit­MQ, SNS, etc.). SNS + Lamb­da In the AWS ecosys­tem, the obvi­ous …

What is the best event source for doing pub-sub with AWS Lamb­da?Read More »

Guys, we’re doing pagination wrong…

These are the words that I had to mut­ter quite a few times in my career, at the dis­sat­is­fac­tion of how pag­i­na­tion had been imple­ment­ed on sev­er­al projects. Still, that dis­sat­is­fac­tion is noth­ing com­pared to how I feel when I occa­sion­al­ly had to ask “why is this API not pag­i­nat­ed..?” So, tak­ing a break from my …

Guys, we’re doing pag­i­na­tion wrong…Read More »

The problems with DynamoDB Auto Scaling and how it might be improved

TL;DR — AWS announced the long await­ed auto scal­ing capa­bil­i­ty for DynamoDB, but we found it takes too long to scale up and doesn’t scale up aggres­sive­ly enough as it’s held back by using con­sumed capac­i­ty as scal­ing met­ric rather than actu­al request count. Here at Space Ape Games we devel­oped an in-house tech to auto scale DynamoDB …

The prob­lems with DynamoDB Auto Scal­ing and how it might be improvedRead More »

aws x-ray and lambda : the good, the bad and the ugly

AWS announced gen­er­al avail­abil­i­ty of AWS Lamb­da sup­port for AWS X-Ray back in May. It’s tak­en me a while to try it out, and whilst I see plen­ty of val­ues I think its cur­rent lim­i­ta­tions sig­nif­i­cant­ly restricts its use­ful­ness in a com­plex sys­tem. I found Lam­b­­da-spe­­cif­ic doc­u­men­ta­tions to be frag­ment­ed and I had to rely …

aws x-ray and lamb­da : the good, the bad and the uglyRead More »

Beware of dilution of DynamoDB throughput due to excessive scaling

TL;DR — The no. of par­ti­tions in a DynamoDB table goes up in response to increased load or stor­age size, but it nev­er come back down, ever. DynamoDB is pret­ty great, but as I have seen this par­tic­u­lar prob­lem at 3 dif­fer­ent com­pa­nies — Gamesys, JUST EAT, and now Space Ape Games — I think it’s …

Beware of dilu­tion of DynamoDB through­put due to exces­sive scal­ingRead More »

AWS Lambda — build yourself a URL shortener in 2 hours

An inter­est­ing require­ment came up at work this week where we dis­cussed poten­tial­ly hav­ing to run our own URL Short­en­er because the Uni­ver­sal Links mech­a­nism (in iOS 9 and above) requires a JSON man­i­fest at https://domain.com/apple-app-site-association Since the OS doesn’t fol­low redi­rects this man­i­fest has to be host­ed on the URL shortener’s root domain. Owing to a lim­i­ta­tion on Apps­Fly­er it’s …

AWS Lamb­da — build your­self a URL short­en­er in 2 hoursRead More »

Yubl’s road to Serverless architecture — overview

part 1: overview <- you’re here part 2: test­ing and CI/CD part 3: ops part 4: build­ing a scal­able noti­fi­ca­tion sys­tem part 5: build­ing a bet­ter rec­om­men­da­tion sys­tem Since Yubl’s clo­sure quite a few peo­ple have asked about the server­less archi­tec­ture we end­ed up with and some of the things we have learnt along the …

Yubl’s road to Server­less archi­tec­ture — overviewRead More »

Recording and Slides for F# DSLs talk at F# |> Bristol

Here’s the record­ed live stream of the F# DSLs ses­sion I did at the F# |> Bris­tol user group last night. (apolo­gies for the first few mins where I for­got to share my screen to the Hang­out…) and here’s the slides to go with the talk: Tame cloud com­plex­i­ty with F#-powered DSLs from Yan Cui

By continuing to use the site, you agree to the use of cookies. more information

The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept" below then you are consenting to this.