How to Build, Train and Deploy Your Own Recommender System â Part 2
We build a recommender system from the ground up with matrix factorization for implicit feedback systems. We then deploy the model to production in AWS.
Jose đ„đȘ Reyes
Overview
Why an image handler
If you are within the AWS infrastructure there is this ready-made solution created by AWS Labs that your website or mobile application can use to improve user experience and prevent high bounce rates.
Typically when serving image files, website usually have several versions of each image (different resolutions to cater for different image sizes), but this process lends itself to being slow and error prone. This process is also hard to manage, and when there are thousands of files, it can be a nightmare when the time comes when things need to be updated.
Because there is a need for a highly available, fast, and low-cost product, AWS Labs have developed a solution based on AWS, and open source imaging service called Thumbor.
AWS Serverless Image Handler solution
The following make up the AWS Serverless Image Handler solution:
-
AWS S3 Bucket - you store your original images in your own S3 bucket. You donât have to expose them to the public if you donât want to.
-
AWS Lambda - your Thumbor service lives in a Lambda, this will do the image processing for you. In addition to downscaling (or even upscaling) your images, Thumbor makes available all these filters for you to use!
-
AWS API Gateway - to expose the Lambda to the world, you need the API Gateway.
-
AWS Cloudfront - your image handler now gets low-latency and high availability through AWS Cloudfront CDN.
How to Install
Just head to the official AWS links at Serverless Image Handler, there you will find instructions:
- use a Cloudfront template to get it up and ready to use in 25 minutes. It took me 30 minutes, so itâs spot on.
- customizations if you need them
- the Thumbor-based Lambda serviceâs source code is also available
- a UI component is optionally available to help you get familiar with itâs usage
- AWS also prepared a PDF Deployment Guide as a simple step-by-step guide that you can follow
Summary
An Image Handler is a common requirement for optimizing your websites and mobile applications. There are commercial solutions available, or you can opt to do it yourself from scratch. However there is no need to do that if a ready-made and production-ready solution is available right now.
The AWS Serverless Image Handler is a serverless solution that is optimized for dynamic image manipulation on the AWS Cloud infrastructure.
Resources
2023
How to Build, Train and Deploy Your Own Recommender System â Part 1
We build a recommender system from the ground up with matrix factorization for implicit feedback systems. We put it all together with Metaflow and used Comet...
Build Recommender Systems the Easy Way in AWS
Building and maintaining a recommender system that is tuned to your businessâ products or services can take great effort. The good news is that AWS can do th...
Ethics in Data, Weekly Reflections
Provided in 6 weekly installments, we will cover current and relevant topics relating to ethics in data
Accelerate ML Application Development in AWS
Get your ML application to production quicker with Amazon Rekognition and AWS Amplify
Remember the last time you created an Entity Relationship diagram? I canât.
(Re)Learning how to create conceptual models when building software
2022
Going to Production with Github Actions, Metaflow and AWS SageMaker
A scalable (and cost-effective) strategy to transition your Machine Learning project from prototype to production
Small to Reasonable Scale MLOps
An Approach to Effective and Scalable MLOps when youâre not a Giant like Google
AWS Summit 2022 Australia and New Zealand
Day 2 summary - AI/ML edition
AWS Summit 2022 Australia and New Zealand
Day 1 summary - AI/ML edition
Micro-frontends building blocks: Webpack Module Federation
What is Module Federation and why itâs perfect for building your Micro-frontend project
Micro-frontends building blocks: Monorepos
What you always wanted to know about Monorepos but were too afraid to ask
Data Science Bootcamp - MLOps on the cheap!
Using Github Actions as a practical (and Free*) MLOps Workflow tool for your Data Pipeline. This completes the Data Science Bootcamp Series
2021
Data Science Bootcamp - Week 10
Final week of the General Assembly Data Science bootcamp, and the Capstone Project has been completed!
Data Science Bootcamp - Week 5 & 6
Fifth and Sixth week, and we are now working with Machine Learning algorithms and a Capstone Project update
Data Science Bootcamp - Week 4
Fourth week into the GA Data Science bootcamp, and we find out why we have to do data visualizations at all
Data Science Bootcamp - Week 3
On the third week of the GA Data Science bootcamp, we explore ideas for the Capstone Project
Data Science Bootcamp - Week 2
We explore Exploratory Data Analysis in Pandas and start thinking about the course Capstone Project
Data Science Bootcamp - Week 1
Follow along as I go through General Assemblyâs 10-week Data Science Bootcamp
Updating React Context does not update my component
Updating Context will re-render context consumers, only in this example, it doesnât
Pre-render strategies in NextJS
Static Site Generation, Server Side Render or Client Side Render, whatâs the difference?
Penny Pinching using the Jamstack Architecture
How to ace your Core Web Vitals without breaking the bank, hint, its FREE! With Netlify, Github and GatsbyJS.
2020
DynamoDB and Single-Table Design
Follow along as I implement DynamoDB Single-Table Design - find out the tools and methods I use to make the process easier, and finally the light-bulb moment...
Debunking 5 common misconceptions about DynamoDB
Use DynamoDB as it was intended, now!
Simple GraphQL consumer with Apollo Client
A GraphQL web client in ReactJS and Apollo
6 Steps to your first GraphQL server
From source to cloud using Serverless and Github Actions
Top 7 reasons why GraphQL is better than REST
How GraphQL promotes thoughtful software development practices
Managing React application state shouldnât be rocket science
Why you might not need external state management libraries anymore
2019
AWS Certifications - are they worth it?
My thoughts on the AWS Certified Developer - Associate Exam, is it worth the effort?
Website Performance Series - Part 5
Running Lighthouse on this blog to identify opportunities for improvement
How can I lead when I am not in charge? - an introspection
Use the power of influence to move people even without a title
Website Performance Series - Part 4
Real world case studies on effects of improving website performance
Website Performance Series - Part 3
Speeding up your site is easy if you know what to focus on. Follow along as I explore the performance optimization maze, and find 3 awesome tips inside (plus...
Website Performance Series - Part 2
Tools for identifying performance gaps and formulating your performance budget
Website Performance Series - Part 1
Why web performance matters and what that means to your bottom line
Easy way to automate Redis cache flush remotely in Powershell
How to easily clear your Redis cache remotely from a Windows machine with Powershell
Docker and Umbraco - meant to be?
Trials with Docker and Umbraco for building a portable development environment, plus find 4 handy tips inside!
Production-ready image handler in 25 minutes
How to create a low cost, highly available CDN solution for your image handling needs in no time at all.
Seeing the BFF Pattern used in the wild
What is the BFF pattern and why you need it.