Binary and JSON serializer benchmarks updated

You can become a serverless blackbelt. Enrol to my 4-week online workshop Production-Ready Serverless and gain hands-on experience building something from scratch using serverless technologies. At the end of the workshop, you should have a broader view of the challenges you will face as your serverless architecture matures and expands. You should also have a firm grasp on when serverless is a good fit for your system as well as common pitfalls you need to avoid. Sign up now and get 15% discount with the code yanprs15!

First of all I’d like to offer my sincere apologies to those who have asked me to update my benchmark numbers following the release of Json.NET 5.0.6, it took me a long time to clear some of my backlogs and only just got around to it, sorry for the waiting!

The good news is that, based on my tests against a simple POCO object (that’s representative of the payload that I work with often) Json.NET has delivered on its promised and offered big improvements on deserialization performance and is now neck-to-neck with ServiceStack.Text in terms of deserialization speed.

 

DISCLAIMER : as always, you should be benchmark against your payload and use case, the benchmark numbers I have produced here is unlikely to be representative of your use cases and neither is anybody else’s benchmark numbers.

You can use the simple test harness I created and see this example code for my JSON serializer tests to benchmark against your particular payload.

 

JSON

Here is the result against the latest versions of JSON serializers at the time of writing:

image

image

Versions of serializers tested:

 

As mentioned previously, the latest version of Json.Net has made big improvements on its deserialization speed and is now on par with ServiceStack.Text.

 

Binary

image12[1]

image16

Versions of serializers tested:

 

As you can see, there is little to choose between the usual suspects of protobuf-net, MessagePack and MessageShark, who are well clear of the rest of the pack. I have also included two additional binary serializers:

  • FlourineFX, an open source library for working with Flash/Flex remoting, and comes with a serializer for AMF encoded data
  • Filbert, a BERT (Binary ERlang Term) serializer and BERT-RPC client I wrote in F#. As you can see, purely from a performance point of view it needs much optimization on its deserialization speed (specifically it needs a buffer pool rather than allocating new array each time) which I have been hoping to find time to do for a while. In general, is interoperability with Erlang something .Net developers are interested in exploring? Would love to hear your thoughts on the matter, and if you know of alternative approaches (other than via something like BERT) you think worth investing.

 

Links

My Benchmarks

Simple Speed Tester

Code for the JSON benchmarks

Code for the binary benchmarks

Liked this article? Support me on Patreon and get direct help from me via a private Slack channel or 1-2-1 mentoring.
Subscribe to my newsletter


Hi, I’m Yan. I’m an AWS Serverless Hero and I help companies go faster for less by adopting serverless technologies successfully.

Are you struggling with serverless or need guidance on best practices? Do you want someone to review your architecture and help you avoid costly mistakes down the line? Whatever the case, I’m here to help.

Hire me.


Skill up your serverless game with this hands-on workshop.

My 4-week Production-Ready Serverless online workshop is back!

This course takes you through building a production-ready serverless web application from testing, deployment, security, all the way through to observability. The motivation for this course is to give you hands-on experience building something with serverless technologies while giving you a broader view of the challenges you will face as the architecture matures and expands.

We will start at the basics and give you a firm introduction to Lambda and all the relevant concepts and service features (including the latest announcements in 2020). And then gradually ramping up and cover a wide array of topics such as API security, testing strategies, CI/CD, secret management, and operational best practices for monitoring and troubleshooting.

If you enrol now you can also get 15% OFF with the promo code “yanprs15”.

Enrol now and SAVE 15%.


Check out my new podcast Real-World Serverless where I talk with engineers who are building amazing things with serverless technologies and discuss the real-world use cases and challenges they face. If you’re interested in what people are actually doing with serverless and what it’s really like to be working with serverless day-to-day, then this is the podcast for you.


Check out my video course, Complete Guide to AWS Step Functions. In this course, we’ll cover everything you need to know to use AWS Step Functions service effectively. There is something for everyone from beginners to more advanced users looking for design patterns and best practices. Enrol now and start learning!


Check out my video course, Complete Guide to AWS Step Functions. In this course, we’ll cover everything you need to know to use AWS Step Functions service effectively. There is something for everyone from beginners to more advanced users looking for design patterns and best practices. Enrol now and start learning!