Kinesis

Centralised logging for AWS Lambda, REVISED (2018)

First of all, I would like to thank all of you for fol­low­ing and read­ing my con­tent. My post on cen­tralised log­ging for AWS Lamb­da has been viewed more than 20K times by now, so it is clear­ly a chal­lenge that many of you have run into. In the post, I out­lined an approach of …

Cen­tralised log­ging for AWS Lamb­da, REVISED (2018)Read More »

What is the best event source for doing pub-sub with AWS Lambda?

AWS offers a wealth of options for imple­ment­ing mes­sag­ing pat­terns such as pub-sub with Lamb­da, let’s com­pare and con­trast some of these options. The pub-sub pat­tern Pub­lish-Sub­scribe (often short­ened to pub-sub) is a mes­sag­ing pat­tern where pub­lish­ers and sub­scribers are decou­pled through an inter­me­di­ary bro­ker (ZeroMQ, Rab­bit­MQ, SNS, etc.). SNS + Lamb­da In the AWS ecosys­tem, the obvi­ous …

What is the best event source for doing pub-sub with AWS Lamb­da?Read More »

Capture and forward correlation IDs through different Lambda event sources

Server­less archi­tec­tures are microser­vices by default, you need cor­re­la­tion IDs to help debug issues that spans across mul­ti­ple func­tions, and pos­si­bly dif­fer­ent event source types — asyn­chro­nous, syn­chro­nous and streams. This is the last of a 3-part mini series on man­ag­ing your AWS Lamb­da logs. If you haven’t read part 1 yet, please give it a read now. …

Cap­ture and for­ward cor­re­la­tion IDs through dif­fer­ent Lamb­da event sourcesRead More »

Auto-scaling Kinesis streams with AWS Lambda

Fol­low­ing on from the last post where we dis­cussed 3 use­ful tips for work­ing effec­tive­ly with Lamb­da and Kine­sis, let’s look at how you can use Lamb­da to help you auto scale Kine­sis streams. Auto-scal­ing for DynamoDB and Kine­sis are two of the most fre­quent­ly request­ed fea­tures for AWS, as I write this post I’m sure the folks …

Auto-scal­ing Kine­sis streams with AWS Lamb­daRead More »

AWS Lambda —3 pro tips for working with Kinesis streams

At Yubl, we arrived at a non-triv­ial server­less archi­tec­ture where Lamb­da and Kine­sis became a promi­nent fea­ture of this archi­tec­ture. Whilst our expe­ri­ence using Lamb­da with Kine­sis was great in gen­er­al, there was a cou­ple of lessons that we had to learn along the way. Here are 3 use­ful tips to help you avoid some …

AWS Lamb­da —3 pro tips for work­ing with Kine­sis streamsRead More »

New releases — DynamoDB.SQL and Darkseid

Hi, just a quick update on two of my libraries aimed at mak­ing AWS eas­i­er to work with from .Net.   DynamoDB.SQL DynamoDB.SQL is a SQL-like exter­nal DSL for query­ing & scan­ning data in Ama­zon DynamoDB. Ver­sion 3.0.0 has been released, which moves away from the mono­lith­ic .Net AWSSDK (v2.x.x), and onto the DynamoDB spe­cif­ic pack­age. You can …

New releas­es — DynamoDB.SQL and Dark­seidRead More »

Introducing log4net.Kinesis, a log4net appender for Amazon Kinesis

Just under three weeks ago, Ama­zon announced the pub­lic avail­abil­i­ty of their new Kine­sis ser­vice, a ser­vice which is designed to allow real-time pro­cess­ing of stream­ing big data. As an exper­i­ment I have put togeth­er a sim­ple, actor-based cus­tomer appen­der for log4net which allows you to pub­lish your log mes­sages into a con­fig­ured Kine­sis stream. …

Intro­duc­ing log4net.Kinesis, a log4net appen­der for Ama­zon Kine­sisRead More »

By continuing to use the site, you agree to the use of cookies. more information

The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept" below then you are consenting to this.

Close