Setting up Dockerized Slurm Cluster on Raspberry Pis
Creating a SLURM cluster on raspberry pi with dockerized worker nodes
Recent Posts
Serving Fastchat - Personal Journey
Serving fastchat for people to experiment with various LLMs. This guide also incluides setting up Vllm to serve multiple models on a single GPU.
Basics of Transformers and Huggingface - Training
A take on trying to help understand LLMs and Transformers - Now training them!
Basics of Transformers and Huggingface - Datasets
A take on trying to help understand LLMs and Transformers - Now the dataset!
Basics of Transformers and Huggingface - Inference
A take on trying to help understand LLMs and Transformers - In a code first approach!