How to Build, Train and Deploy Your Own Recommender System â Part 2
We build a recommender system from the ground up with matrix factorization for implicit feedback systems. We then deploy the model to production in AWS.
It was the towards the end of November 2019 on a kayak outing when I decided to finally attempt to take this AWS certification after months of indecision. The year 2019 was rapidly coming to a close, things were kind of winding down at work, and I thought this was the best time to focus and have a good go at it.
At that time, I was receptive to some kind of self improvement activity after mulling over and reflecting over my recent article - How can I lead when I am not in charge? - an introspection - specifically the section Lead yourself
. Being intentional in shaping the environment I belong to. I have decided that I want to belong to an environment of experts so I am exerting effort to be an expert myself.
be intentional day to day, instead of sleepwalking through the day, be mindful that I have the responsibility of shaping my environment, the same one that is ultimately responsible for shaping me
The year was coming to an end, I thought wouldnât it be cool if I could pull this off and collect an AWS certification, one of the top and in-demand industry certifications available in the market today.
If I could only take one certification exam, which would it be?
Honestly, it didnât take long to decide on which Associate exam I was going to take. I knew of the AWS associate level exams however did not really know about the differences between a Solution Architect - Associate, a Developer - Associate, and a SysOps Administrator - Associate exam.
Being a developer, naturally I decided to take the Developer exam. Long after I took the test did I know their differences, and the AWS preferred order of taking them, which is the following:
And basing on public opinion, the difficulty level is in that order too, where SysOps Administrator is the hardest. Because I had already decided to take just one exam, I settled and set my mind on the Developer exam.
My goal was to get certified before the 2019 holidays, so I promptly scheduled my exam on the 18th of December, just a couple of days before my break for Christmas.
How difficult could it be? At this stage I was already using AWS every day for close to a year, so I was fairly confident with my knowledge. However, having scanned the AWS Developer - Associate exam guide, I quickly realized that I was not ready to take the exam as I had some gaps in knowledge.
My goal was to get certified, I knew most of the material, but I needed some help if I was to save time and be efficient in my study, as I had told myself that I can only afford 2 weeks of focus for it.
Initially I had used Pluralsight, but I did not find it good enough, so I did some research and this is how I was able to get wind of A Cloud Guru. So for the next 2 weeks, I devoured the ACG study course, where they have over 16 hours of video instruction, Hands on labs, comprehensive quizzes and exam simulator.
After 2 weeks of an average of 2 hours per day study/review (and passing 2 of 3 goes with the exam simulator - 78%, then 71%, then 83%), I decided I was ready to get certified.
I had scheduled my exam in a test centre in nearby Parramatta at 9am, so I took the morning off work. Before you can start the test, the exam proctor performs the required ID checks (found out that 2 forms of ID are required - so I should have read the exam info beforehand), and no phone, no water, nothing in pockets are allowed, leave everything in a locker before going in the exam area. There is a A4 sized eraseable board for use as a scratch paper, but has to be strictly returned after the exam.
I had used all the allocated 140 minutes - for answering all the 65 questions, with 30 minutes to spare, which I used to review about 50% of the questions where I was not sure of the answers, when I had some sort of doubts.
I did find it moderately hard. Specially there are questions that there are more than 1 correct answers, but only one is the most correct answer. I did have a feeling that there was a chance that I might have just passed, or on the flip side, just flunked it.
I allowed all of 140 minutes to expire, and after spending 5 minutes to give some AWS feedback on the testing experience, I was shown the result.
I PASSED!!!
Not really high marks, however, at 827/1000, I was happy with my effort - of achieving the AWS Certified Developer - Associate, before the end of 2019. All in all, I was happy with that result.
I am not really a big fan of certifications. This is actually my first attempt of getting one. At this point, I donât think I will be getting another one in the near future. Contrary to my initial thoughts that getting a certification will prove that one is an expert, I think that is furthest from the truth.
It proves nothing else than just being familiar with the technology. It is similar when one learns to play the guitar. You can learn all the chords in the world. But that does not make you a good musician. For that you will need experience.
What do you think?
These picks are things that have had a positive impact to me in recent weeks:
We build a recommender system from the ground up with matrix factorization for implicit feedback systems. We then deploy the model to production in AWS.
We build a recommender system from the ground up with matrix factorization for implicit feedback systems. We put it all together with Metaflow and used Comet...
Building and maintaining a recommender system that is tuned to your businessâ products or services can take great effort. The good news is that AWS can do th...
Provided in 6 weekly installments, we will cover current and relevant topics relating to ethics in data
Get your ML application to production quicker with Amazon Rekognition and AWS Amplify
(Re)Learning how to create conceptual models when building software
A scalable (and cost-effective) strategy to transition your Machine Learning project from prototype to production
An Approach to Effective and Scalable MLOps when youâre not a Giant like Google
Day 2 summary - AI/ML edition
Day 1 summary - AI/ML edition
What is Module Federation and why itâs perfect for building your Micro-frontend project
What you always wanted to know about Monorepos but were too afraid to ask
Using Github Actions as a practical (and Free*) MLOps Workflow tool for your Data Pipeline. This completes the Data Science Bootcamp Series
Final week of the General Assembly Data Science bootcamp, and the Capstone Project has been completed!
Fifth and Sixth week, and we are now working with Machine Learning algorithms and a Capstone Project update
Fourth week into the GA Data Science bootcamp, and we find out why we have to do data visualizations at all
On the third week of the GA Data Science bootcamp, we explore ideas for the Capstone Project
We explore Exploratory Data Analysis in Pandas and start thinking about the course Capstone Project
Follow along as I go through General Assemblyâs 10-week Data Science Bootcamp
Updating Context will re-render context consumers, only in this example, it doesnât
Static Site Generation, Server Side Render or Client Side Render, whatâs the difference?
How to ace your Core Web Vitals without breaking the bank, hint, its FREE! With Netlify, Github and GatsbyJS.
Follow along as I implement DynamoDB Single-Table Design - find out the tools and methods I use to make the process easier, and finally the light-bulb moment...
Use DynamoDB as it was intended, now!
A GraphQL web client in ReactJS and Apollo
From source to cloud using Serverless and Github Actions
How GraphQL promotes thoughtful software development practices
Why you might not need external state management libraries anymore
My thoughts on the AWS Certified Developer - Associate Exam, is it worth the effort?
Running Lighthouse on this blog to identify opportunities for improvement
Use the power of influence to move people even without a title
Real world case studies on effects of improving website performance
Speeding up your site is easy if you know what to focus on. Follow along as I explore the performance optimization maze, and find 3 awesome tips inside (plus...
Tools for identifying performance gaps and formulating your performance budget
Why web performance matters and what that means to your bottom line
How to easily clear your Redis cache remotely from a Windows machine with Powershell
Trials with Docker and Umbraco for building a portable development environment, plus find 4 handy tips inside!
How to create a low cost, highly available CDN solution for your image handling needs in no time at all.
What is the BFF pattern and why you need it.