Serving Fastchat - Personal Journey
Serving fastchat for people to experiment with various LLMs. This guide also incluides setting up Vllm to serve multiple models on a single GPU.
Recent Posts
Basics of Transformers and Huggingface - Datasets
A take on trying to help understand LLMs and Transformers - Now the dataset!
Basics of Transformers and Huggingface - Inference
A take on trying to help understand LLMs and Transformers - In a code first approach!
Arch Linux is the Best for Deep Learning (for intermediate users)
Arch linux makes it better to manage deep learning system, and understand the system better.
Elegance of Keras Core and JAX combo
Combining Keras and JAX as a backend, makes JAX to be meant for Humans