Hey @ravimashru lets connect over a call.
Cool! I love the idea of trying to make this something reusable.
Roger that! I can set up a call.
Any date and time preferences? One option would be Wednesday 8:00 am IST (Tuesday 7:30 pm PT).
Ya that should work. Let’s connect. Thanks.
Just scheduled a call. See you all then!
Wednesday, 1 September · 8:00 – 9:00am IST
Video call link: https://meet.google.com/xtv-cgir-kbs
@kurianbenoy-aot and I had the first call today to kick this off
Here are some things we discussed:
- The MovieLens 25M Dataset is the most recent version of the dataset (released in Dec. 2019)
- A list of SaaS, Paas and IaaS providers that have free tiers that we can use to host the project: GitHub - ripienaar/free-for-dev: A list of SaaS, PaaS and IaaS offerings that have free tiers of i
- The tech stack we’ll use is: FastAPI + VueJS
- Working model: mostly working asynchronously with 1 - 2 check-in calls a week to keep us on track
- Train a model on the MovieLens 25M Dataset.
- Learning & upskilling (FastAPI & VueJS)
- Try out Deta as a possible free hosting option for the backend
Tentative date/time: Saturday, 4 September. 7pm IST (if it works for everyone)
Tentative agenda: create a skeleton for the different parts of the project, create repo on GitHub.
This is incredible!
May I suggest looking at NVIDIA Merlin ecosystem for some ideas? The team has been winning RecSys comps consistently and usually open source ideas on here. You might find something interesting to experiment.
The blog on medium also tends to have great suggestions
Thanks! We’ll check these out.
Hey guys. This is a great project. I am currently watching this space actively for ideas
I have also been working on a similar recommendation system but for books
But was stuck at the putting it in production part. I’m currently hosting at Streamlit but for some reason my app keeps on crashing because I’m using too much resources after some time.
Planning on joining in the other call
Hi @ravimashru and team, not sure if I am late to the party but this seems like a very cool project. I’d love to be involved.
Hey @edwinq… Welcome to the community!
You’re not late at all. We’ve just had one call so far and then I guess we got busy with other things. We’d love to have you on board.
I was planning to resume working on this over the weekend, but I haven’t scheduled a call yet.
I’m not sure what timezone you’re in. Does Saturday 2:00 p.m. GMT work for you?
Sure, I’m in EST so I should be free for about an hour or so then. Still meeting here :
Video call link: https://meet.google.com/xtv-cgir-kbs ?
I think that’s the old one. I’ve set up a new meeting here.
It would also love to join the meeting. I am still excited to work on this project. @ravimashru, I am not able to find the meeting link you shared
Oh, that’s strange. That was a link to a calendar invite. If that’s not working then here’s a link to the call directly: https://meet.google.com/heu-heqi-grq
After fighting the errors for over 12 hours, I decided to submit a bug.
Apologies, I was not able to attend the last call, are there any action items that we can get started on?
No worries @edwinq! Here’s a summary of what we did:
We created the fast-recsys org on GitHub to store everything we work on. I can add you to the org as well if you give me your GitHub username.
We created skeleton repositories for the UI (using VueJS) and the backend API server (using FastAPI).
We also started looking into NVIDIA Merlin since it has really cool tools for feature engineering (NVTabular), training (HugeCTR) and even an inference server (Triton). However, we pretty much hit a roadblack with installing the required dependencies when trying out the examples and @bhutanisanyam1 created the GitHub issue he mentions above.
We’re currently experimenting with two approaches:
Creating an API server to serve the model trained using fastai.
Use the NVIDIA Merlin ecosystem to train and deploy the recommendation system.
Here’s a few things we can start doing:
Create a web UI that a user can use to rate movies they have already watched (some inspiration: Book Recommender: Collaborative Filtering, Shiny | Kaggle) and view recommendations.
Convert the contents of this blog post into Python files and create REST API endpoints that we can use from the UI.
The maintainers of NVTabular have responded to the issue that Sanyam created. We can try to set up an environment with the required dependencies like they recommend and try to run the example notebooks (they already have notebooks that use the MovieLens25 dataset that we also plan to use )
Apart from this, I don’t think we have any other planned/concrete action items. We’re just planning to learn and figuring things out as we go!
We’ve planned to meet again at the same time this Saturday as well (Calendar invite). We’d love to see you there if you can make it.