Serving Fastchat - Personal Journey
Serving fastchat for people to experiment with various LLMs. This guide also incluides setting up Vllm to serve multiple models on a single GPU.
Posts by Tag
- deep learning 14
- cluster 6
- pytorch 4
- NLP 4
- transformers 4
- tensorflow 3
- hpc 3
- glusterfs 2
- update 1
- image 1
- XAI 1
- book 1
- machine learning 1
- sklearn 1
- horovod 1
- onnx 1
- speedster 1
- optimization 1
- inference 1
- pandas 1
- projects 1
- slurm 1
- docker 1
- raspberry-pi 1
- nfs 1
- kubernetes 1
- pvc 1
deep learning
Basics of Transformers and Huggingface - Training
A take on trying to help understand LLMs and Transformers - Now training them!
Basics of Transformers and Huggingface - Datasets
A take on trying to help understand LLMs and Transformers - Now the dataset!
Basics of Transformers and Huggingface - Inference
A take on trying to help understand LLMs and Transformers - In a code first approach!
Arch Linux is the Best for Deep Learning (for intermediate users)
Arch linux makes it better to manage deep learning system, and understand the system better.
Elegance of Keras Core and JAX combo
Combining Keras and JAX as a backend, makes JAX to be meant for Humans
Maximizing HPC Potential: The Accelerators [Part 2]
Get those numbers crunching! Hardware accelerators are specialized computing devices designed to perform specific tasks more efficiently than general-purpose...
Maximizing HPC Potential: Unveiling the Best CPU, Motherboard, and Memory [Part 1]
Prepare to harness the immense power of high-performance computing (HPC) nodes. In Part 1 of my comprehensive series, I delve into the art of choosing the ul...
Stuff I learnt doing an end to end project
Deep Learning Lessons: Insights from an End-to-End Project. Gain valuable tips from my personal experiences in deep learning. Discover the power of thorough ...
Distributed Training With Tensorflow
Leveraging Multi Worker Mirrored Strategy in TensorFlow to train models across multiple workers using data parallelism.
Optimizing Deep Learning Models for Inference with Speedster
Nebuly-AI’s Speedster is a tool that can optimize deep learning models for inference on CPUs and GPUs.
Setting up Horovod on cluster
Setting and running Horovod on a PBS managed cluster
Mixed Precision Training
Less memory more speeeeedddd. Training Models with mixed precision for lower memory footprint, and faster training.
Neural Style Transfer
Introduction
cluster
Working with GlusterFS and NFS (NFS-Ganesha)
Setting up and working with NFS Ganesha on GlusterFS. This guide will be using raspberry pi’s as the nodes, but it should be applicable to any system.
Setting up Dockerized Slurm Cluster on Raspberry Pis
Creating a SLURM cluster on raspberry pi with dockerized worker nodes
Maximizing HPC Potential: The Accelerators [Part 2]
Get those numbers crunching! Hardware accelerators are specialized computing devices designed to perform specific tasks more efficiently than general-purpose...
Maximizing HPC Potential: Unveiling the Best CPU, Motherboard, and Memory [Part 1]
Prepare to harness the immense power of high-performance computing (HPC) nodes. In Part 1 of my comprehensive series, I delve into the art of choosing the ul...
Distributed Training With Tensorflow
Leveraging Multi Worker Mirrored Strategy in TensorFlow to train models across multiple workers using data parallelism.
Setting up Horovod on cluster
Setting and running Horovod on a PBS managed cluster
pytorch
Optimizing Deep Learning Models for Inference with Speedster
Nebuly-AI’s Speedster is a tool that can optimize deep learning models for inference on CPUs and GPUs.
Setting up Horovod on cluster
Setting and running Horovod on a PBS managed cluster
Mixed Precision Training
Less memory more speeeeedddd. Training Models with mixed precision for lower memory footprint, and faster training.
Neural Style Transfer
Introduction
NLP
Serving Fastchat - Personal Journey
Serving fastchat for people to experiment with various LLMs. This guide also incluides setting up Vllm to serve multiple models on a single GPU.
Basics of Transformers and Huggingface - Training
A take on trying to help understand LLMs and Transformers - Now training them!
Basics of Transformers and Huggingface - Datasets
A take on trying to help understand LLMs and Transformers - Now the dataset!
Basics of Transformers and Huggingface - Inference
A take on trying to help understand LLMs and Transformers - In a code first approach!
transformers
Serving Fastchat - Personal Journey
Serving fastchat for people to experiment with various LLMs. This guide also incluides setting up Vllm to serve multiple models on a single GPU.
Basics of Transformers and Huggingface - Training
A take on trying to help understand LLMs and Transformers - Now training them!
Basics of Transformers and Huggingface - Datasets
A take on trying to help understand LLMs and Transformers - Now the dataset!
Basics of Transformers and Huggingface - Inference
A take on trying to help understand LLMs and Transformers - In a code first approach!
tensorflow
Distributed Training With Tensorflow
Leveraging Multi Worker Mirrored Strategy in TensorFlow to train models across multiple workers using data parallelism.
Optimizing Deep Learning Models for Inference with Speedster
Nebuly-AI’s Speedster is a tool that can optimize deep learning models for inference on CPUs and GPUs.
Setting up Horovod on cluster
Setting and running Horovod on a PBS managed cluster
hpc
Setting up Dockerized Slurm Cluster on Raspberry Pis
Creating a SLURM cluster on raspberry pi with dockerized worker nodes
Maximizing HPC Potential: The Accelerators [Part 2]
Get those numbers crunching! Hardware accelerators are specialized computing devices designed to perform specific tasks more efficiently than general-purpose...
Maximizing HPC Potential: Unveiling the Best CPU, Motherboard, and Memory [Part 1]
Prepare to harness the immense power of high-performance computing (HPC) nodes. In Part 1 of my comprehensive series, I delve into the art of choosing the ul...
glusterfs
Working with GlusterFS and NFS (NFS-Ganesha)
Setting up and working with NFS Ganesha on GlusterFS. This guide will be using raspberry pi’s as the nodes, but it should be applicable to any system.
Setting up Dockerized Slurm Cluster on Raspberry Pis
Creating a SLURM cluster on raspberry pi with dockerized worker nodes
update
Back to Top ↑image
Neural Style Transfer
Introduction
XAI
Introduction to XAI (Explainable AI)
Chapter 01 of Applied Machine Learning Explainability Techniques book by Aditya Bhattacharya
book
Introduction to XAI (Explainable AI)
Chapter 01 of Applied Machine Learning Explainability Techniques book by Aditya Bhattacharya
machine learning
LazyPredict
I am just too lazy to compare multiple Machine Learning algorithms.
sklearn
LazyPredict
I am just too lazy to compare multiple Machine Learning algorithms.
horovod
Setting up Horovod on cluster
Setting and running Horovod on a PBS managed cluster
onnx
Optimizing Deep Learning Models for Inference with Speedster
Nebuly-AI’s Speedster is a tool that can optimize deep learning models for inference on CPUs and GPUs.
speedster
Optimizing Deep Learning Models for Inference with Speedster
Nebuly-AI’s Speedster is a tool that can optimize deep learning models for inference on CPUs and GPUs.
optimization
Optimizing Deep Learning Models for Inference with Speedster
Nebuly-AI’s Speedster is a tool that can optimize deep learning models for inference on CPUs and GPUs.
inference
Optimizing Deep Learning Models for Inference with Speedster
Nebuly-AI’s Speedster is a tool that can optimize deep learning models for inference on CPUs and GPUs.
pandas
Unleashing the Power of AI in Data Analysis with Sketch
Explore and Analyze Your Data with Sketch: In this blog post, we will explore Sketch - an AI-powered DataFrame assistant for Python that uses data sketching ...
projects
Stuff I learnt doing an end to end project
Deep Learning Lessons: Insights from an End-to-End Project. Gain valuable tips from my personal experiences in deep learning. Discover the power of thorough ...
slurm
Setting up Dockerized Slurm Cluster on Raspberry Pis
Creating a SLURM cluster on raspberry pi with dockerized worker nodes
docker
Setting up Dockerized Slurm Cluster on Raspberry Pis
Creating a SLURM cluster on raspberry pi with dockerized worker nodes
raspberry-pi
Setting up Dockerized Slurm Cluster on Raspberry Pis
Creating a SLURM cluster on raspberry pi with dockerized worker nodes
nfs
Working with GlusterFS and NFS (NFS-Ganesha)
Setting up and working with NFS Ganesha on GlusterFS. This guide will be using raspberry pi’s as the nodes, but it should be applicable to any system.
kubernetes
Working with GlusterFS and NFS (NFS-Ganesha)
Setting up and working with NFS Ganesha on GlusterFS. This guide will be using raspberry pi’s as the nodes, but it should be applicable to any system.
pvc
Working with GlusterFS and NFS (NFS-Ganesha)
Setting up and working with NFS Ganesha on GlusterFS. This guide will be using raspberry pi’s as the nodes, but it should be applicable to any system.