Performance benchmarks updated

I recently reorganized the SimpleSpeedTester project’s structure so that it’s easier to add tests to both the Json and binary serializer benchmarks, and to run the tests is as easy as running the RunBenchmarks.fsx F# script and then choosing which benchmark you’d like to run and then kick back and wait for the results to come back.

 

DISCLAIMER : as always, you should be bench­mark against your pay­load and use case, the bench­mark num­bers I have pro­duced here is unlikely to be rep­re­sen­ta­tive of your use cases and nei­ther is any­body else’s bench­mark numbers.

You can use the sim­ple test har­ness I cre­ated and see this exam­ple code for my JSON seri­al­izer tests to bench­mark against your par­tic­u­lar payload.

 

Binary Serializers

Versions tested:

• Filbert v0.2.0
• FluorineFx v1.2.4
• MsgPack v0.1.0.2011042300
• Json.Net v5.0.8
• protobuf-net v2.0.0.668
• MessageShark

 

JSON Serializers

System.Json has been added to the list of serializers thanks to Mauricio’s pull-request.

P.S. protobuf-net is NOT a JSON serializer, but it’s in the mix here simply as a benchmark since it’s one of the more widely used and fastest serializers around, and useful to compare the BSON serializers in the list.

 

Versions tested:

• ServiceStack.Text v4.0.8

• Json.Net v5.0.8
• fastJson v2.0.27.1
• MongoDB Driver v1.8.3
• SimpleJson
• System.Json (beta) 4.0.20126.16343
• JsonFx v2.0.1209.2802
• JayRock v0.9.16530

 

Since I started doing these benchmarks more than two years ago, I have been impressed by the way Json.Net upped its game since those early benchmarks! Long may the healthy competition lasts between these JSON serializer heavyweights so that rest of us can simply reap the benefits of the great work guys like Demis Bellot and James Newton-King are doing in providing essential tooling in this space!