Check out my new course Learn you some Lambda best practice for great good! and learn the best practices for performance, cost, security, resilience, observability and scalability.
If you enjoy reading these exercises then please buy Crista’s book to support her work.
Style 26 – Spreadsheet
- The problem is modeled like a spreadsheet, with columns of data and formulas.
- Some data depends on other data according to formulas. When data changes, the dependent data also changes automatically.
Since we’re modelling the problem like a spreadsheet, let’s first define a few type alias to help us establish our domain language.
- a column is referenced by a string – e.g. column “A”, “B”, “C”, and so on
- a column can have explicit values, or a formula
- a formula references one or more other columns and uses their data to calculate the display value for the column
We can model a Column with a union type, where a column is:
a) given explicit values; or
b) given a formula, and its display value is calculated from that formula.
A Spreadsheet is a collection of columns, whose value can be retrieved or updated using a ColumnRef, e.g.
let spreadsheet = Spreadsheet()
spreadsheet.[“A”] <- Choice1Of2 [| “hello”; “world” |]
let columnA = spreadsheet.[“A”] // [| “hello”; “world” |]
Note that our custom indexer accepts a Choice<DisplayValue, Formula> in its setter instead of a Column. I made this decision because Column.Formula needs both the Formula and its calculated DisplayValue, and here it shouldn’t be the caller’s responsibility to exercise the formula and calculate its DisplayValue.
After a column’s value is updated, we’ll recalculate the DisplayValue of all the columns in the Spreadsheet. This is a naive approach, but sufficient for the task at hand.
During this step, we’ll need to recursively evaluate the DisplayValue of the columns, sometimes a column might be evaluated multiple times if it’s referenced by several formulae. Again, there’s room for optimization here by caching previously calculated values.
Next, we’ll start inputting data into our Spreadsheet.
To make it easier to work with the Choice<DisplayValue, Formula> type, let’s add two helper functions.
We’ll leave column A and B blank for now.
Column C will use the data from Column A (all words) and Column B (stop words) to calculate all the non-stop words.
Column D will contain all the distinct words from Column C (non-stop words).
Column E references both Column C (non-stop words) and Column D (distinct non-stop words), and counts the frequency for each of these words.
An important detail to note here is that, positionally, each count in Column E is aligned with the corresponding word in Column D.
Column F is where we’ll store the output of the program.
Because Column D (unique non-stop words) and Column E (counts) are positionally aligned, so we can use Array.zip to combine the two columns to calculate a sorted array of word frequencies.
Now that all the columns are set up, we can go back and input the text from Pride and Prejudice and the list of stop words into Column A and B respectively.
Doing so will trigger the DisplayValue of all the other columns to be recalculated.
Finally, we’ll take the top 25 rows from Column F and print them to complete our program.
I hope you’ve enjoyed today’s style, apologies for the lack of updates the last two weeks, I have been busy working out some stuff on a personal front. I’ll resume the two posts per week routine, which means we should finish this series in just over a month!
You can find the source code for this exercise here.
I specialise in rapidly transitioning teams to serverless and building production-ready services on AWS.
Are you struggling with serverless or need guidance on best practices? Do you want someone to review your architecture and help you avoid costly mistakes down the line? Whatever the case, I’m here to help.
Check out my new podcast Real-World Serverless where I talk with engineers who are building amazing things with serverless technologies and discuss the real-world use cases and challenges they face. If you’re interested in what people are actually doing with serverless and what it’s really like to be working with serverless day-to-day, then this is the podcast for you.
Check out my new course, Learn you some Lambda best practice for great good! In this course, you will learn best practices for working with AWS Lambda in terms of performance, cost, security, scalability, resilience and observability. We will also cover latest features from re:Invent 2019 such as Provisioned Concurrency and Lambda Destinations. Enrol now and start learning!
Check out my video course, Complete Guide to AWS Step Functions. In this course, we’ll cover everything you need to know to use AWS Step Functions service effectively. There is something for everyone from beginners to more advanced users looking for design patterns and best practices. Enrol now and start learning!
Are you working with Serverless and looking for expert training to level-up your skills? Or are you looking for a solid foundation to start from? Look no further, register for my Production-Ready Serverless workshop to learn how to build production-grade Serverless applications!
Here is a complete list of all my posts on serverless and AWS Lambda. In the meantime, here are a few of my most popular blog posts.
- Lambda optimization tip – enable HTTP keep-alive
- You are wrong about serverless and vendor lock-in
- You are thinking about serverless costs all wrong
- Just how expensive is the full AWS SDK?
- Many faced threats to Serverless security
- We can do better than percentile latencies
- Yubl’s road to Serverless
- AWS Lambda – should you have few monolithic functions or many single-purposed functions?
- AWS Lambda – compare coldstart time with different languages, memory and code sizes
- Guys, we’re doing pagination wrong
- Top 10 Serverless framework best practices