Applying the Saga pattern with AWS Lambda and Step Functions

The Saga pat­tern is a pat­tern for man­ag­ing fail­ures, where each action has a com­pen­sat­ing action for roll­back. In Hec­tor Garcia-Molina’s 1987 paper, it is described as an approach to han­dling sys­tem fail­ures in a long-run­n­ing trans­ac­tions. It has become increas­ing­ly rel­e­vant in the world of microser­vices as appli­ca­tion log­ic often needs to trans­act across …

Apply­ing the Saga pat­tern with AWS Lamb­da and Step Func­tionsRead More »

Yubl’s road to Serverless — building better recommendations with Lambda, BigQuery and GrapheneDB

part 1: overview part 2: test­ing and CI/CD part 3: ops part 4: build­ing a scal­able noti­fi­ca­tion sys­tem part 5: build­ing a bet­ter rec­om­men­da­tion sys­tem <- you’re here When I joined Yubl in April 2016, it had launched just 2 months ear­li­er, after a long and chaot­ic devel­op­ment cycle that last­ed more than 2 years …

Yubl’s road to Server­less — build­ing bet­ter rec­om­men­da­tions with Lamb­da, Big­Query and GrapheneDBRead More »

aws x-ray and lambda : the good, the bad and the ugly

AWS announced gen­er­al avail­abil­i­ty of AWS Lamb­da sup­port for AWS X-Ray back in May. It’s tak­en me a while to try it out, and whilst I see plen­ty of val­ues I think its cur­rent lim­i­ta­tions sig­nif­i­cant­ly restricts its use­ful­ness in a com­plex sys­tem. I found Lam­b­­da-spe­­cif­ic doc­u­men­ta­tions to be frag­ment­ed and I had to rely …

aws x-ray and lamb­da : the good, the bad and the uglyRead More »

Finding coldstarts : how long does AWS Lambda keep your idle functions around?

In the last post I com­pared the cold­start time for Lamb­da func­tions with dif­fer­ent lan­guage, mem­o­ry and code size. One of the things I learnt was that idle func­tions are no longer ter­mi­nat­ed after 5 min­utes of inac­tiv­i­ty. /2017/06/aws-lam­b­­da-com­­pare-cold­s­tart-time-with-dif­fer­­ent-lan­guages-mem­o­ry-and-code-sizes/ It is a fan­tas­tic news and some­thing that Ama­zon has qui­et­ly changed behind the scene. How­ev­er, …

Find­ing cold­starts : how long does AWS Lamb­da keep your idle func­tions around?Read More »

aws lambda — compare coldstart time with different languages, memory and code sizes

A while back we looked at the per­for­mance dif­fer­ence between the lan­guage run­times AWS Lamb­da sup­ports native­ly. /2017/03/aws-lam­b­­da-com­­par­ing-plat­­form-per­­for­­mances/ We inten­tion­al­ly omit­ted cold­start time from that exper­i­ment as we were inter­est­ed in per­for­mance dif­fer­ences when a func­tion is “warm”. How­ev­er, cold­start is still an impor­tant per­for­mance con­sid­er­a­tion, so let’s take a clos­er look with some exper­i­ments …

aws lamb­da — com­pare cold­start time with dif­fer­ent lan­guages, mem­o­ry and code sizesRead More »

Serverless 1.X — enable API Gateway caching on request parameters

Hav­ing pre­vi­ous­ly blogged about the untrod­den path to enable caching on API Gate­way request para­me­ters in the Server­less frame­work 0.5.X, it’s a lit­tle dis­ap­point­ing that it’s still not offi­cial­ly fixed in the 1.X ver­sions… The Prob­lem The prob­lem is two-fold: there’s cur­rent­ly no way to spec­i­fy caching should be enabled for path & query string …

Server­less 1.X — enable API Gate­way caching on request para­me­tersRead More »

Yubl’s road to Serverless architecture – building a scalable push notification system

part 1: overview part 2: test­ing and CI/CD part 3: ops part 4: build­ing a scal­able noti­fi­ca­tion sys­tem <- you’re here part 5: build­ing a bet­ter rec­om­men­da­tion sys­tem Just before Yubl’s untime­ly demise we did an inter­est­ing piece of work to redesign the sys­tem for send­ing tar­get­ed push noti­fi­ca­tions to our users to improve reten­tion. The …

Yubl’s road to Server­less archi­tec­ture – build­ing a scal­able push noti­fi­ca­tion sys­temRead More »

Auto-scaling Kinesis streams with AWS Lambda

Fol­low­ing on from the last post where we dis­cussed 3 use­ful tips for work­ing effec­tive­ly with Lamb­da and Kine­sis, let’s look at how you can use Lamb­da to help you auto scale Kine­sis streams. Auto-scal­ing for DynamoDB and Kine­sis are two of the most fre­quent­ly request­ed fea­tures for AWS, as I write this post I’m sure the folks …

Auto-scal­ing Kine­sis streams with AWS Lamb­daRead More »

AWS Lambda —3 pro tips for working with Kinesis streams

At Yubl, we arrived at a non-triv­ial server­less archi­tec­ture where Lamb­da and Kine­sis became a promi­nent fea­ture of this archi­tec­ture. Whilst our expe­ri­ence using Lamb­da with Kine­sis was great in gen­er­al, there was a cou­ple of lessons that we had to learn along the way. Here are 3 use­ful tips to help you avoid some …

AWS Lamb­da —3 pro tips for work­ing with Kine­sis streamsRead More »

By continuing to use the site, you agree to the use of cookies. more information

The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept" below then you are consenting to this.