Serving Fastchat - Personal Journey
Serving fastchat for people to experiment with various LLMs. This guide also incluides setting up Vllm to serve multiple models on a single GPU.
Posts by Tag
- deep learning 13
- pytorch 4
- cluster 4
- tensorflow 3
- NLP 3
- transformers 3
- hpc 2
- update 1
- image 1
- XAI 1
- book 1
- machine learning 1
- sklearn 1
- horovod 1
- onnx 1
- speedster 1
- optimization 1
- inference 1
- pandas 1
- projects 1
deep learning
Basics of Transformers and Huggingface - Datasets
A take on trying to help understand LLMs and Transformers - Now the dataset!
Basics of Transformers and Huggingface - Inference
A take on trying to help understand LLMs and Transformers - In a code first approach!
Arch Linux is the Best for Deep Learning (for intermediate users)
Arch linux makes it better to manage deep learning system, and understand the system better.
Elegance of Keras Core and JAX combo
Combining Keras and JAX as a backend, makes JAX to be meant for Humans
Maximizing HPC Potential: The Accelerators [Part 2]
Get those numbers crunching! Hardware accelerators are specialized computing devices designed to perform specific tasks more efficiently than general-purpose...
Maximizing HPC Potential: Unveiling the Best CPU, Motherboard, and Memory [Part 1]
Prepare to harness the immense power of high-performance computing (HPC) nodes. In Part 1 of my comprehensive series, I delve into the art of choosing the ul...
Stuff I learnt doing an end to end project
Deep Learning Lessons: Insights from an End-to-End Project. Gain valuable tips from my personal experiences in deep learning. Discover the power of thorough ...
Distributed Training With Tensorflow
Leveraging Multi Worker Mirrored Strategy in TensorFlow to train models across multiple workers using data parallelism.
Optimizing Deep Learning Models for Inference with Speedster
Nebuly-AI’s Speedster is a tool that can optimize deep learning models for inference on CPUs and GPUs.
Setting up Horovod on cluster
Setting and running Horovod on a PBS managed cluster
Mixed Precision Training
Less memory more speeeeedddd. Training Models with mixed precision for lower memory footprint, and faster training.
Neural Style Transfer
Introduction
pytorch
Optimizing Deep Learning Models for Inference with Speedster
Nebuly-AI’s Speedster is a tool that can optimize deep learning models for inference on CPUs and GPUs.
Setting up Horovod on cluster
Setting and running Horovod on a PBS managed cluster
Mixed Precision Training
Less memory more speeeeedddd. Training Models with mixed precision for lower memory footprint, and faster training.
Neural Style Transfer
Introduction
cluster
Maximizing HPC Potential: The Accelerators [Part 2]
Get those numbers crunching! Hardware accelerators are specialized computing devices designed to perform specific tasks more efficiently than general-purpose...
Maximizing HPC Potential: Unveiling the Best CPU, Motherboard, and Memory [Part 1]
Prepare to harness the immense power of high-performance computing (HPC) nodes. In Part 1 of my comprehensive series, I delve into the art of choosing the ul...
Distributed Training With Tensorflow
Leveraging Multi Worker Mirrored Strategy in TensorFlow to train models across multiple workers using data parallelism.
Setting up Horovod on cluster
Setting and running Horovod on a PBS managed cluster
tensorflow
Distributed Training With Tensorflow
Leveraging Multi Worker Mirrored Strategy in TensorFlow to train models across multiple workers using data parallelism.
Optimizing Deep Learning Models for Inference with Speedster
Nebuly-AI’s Speedster is a tool that can optimize deep learning models for inference on CPUs and GPUs.
Setting up Horovod on cluster
Setting and running Horovod on a PBS managed cluster
NLP
Serving Fastchat - Personal Journey
Serving fastchat for people to experiment with various LLMs. This guide also incluides setting up Vllm to serve multiple models on a single GPU.
Basics of Transformers and Huggingface - Datasets
A take on trying to help understand LLMs and Transformers - Now the dataset!
Basics of Transformers and Huggingface - Inference
A take on trying to help understand LLMs and Transformers - In a code first approach!
transformers
Serving Fastchat - Personal Journey
Serving fastchat for people to experiment with various LLMs. This guide also incluides setting up Vllm to serve multiple models on a single GPU.
Basics of Transformers and Huggingface - Datasets
A take on trying to help understand LLMs and Transformers - Now the dataset!
Basics of Transformers and Huggingface - Inference
A take on trying to help understand LLMs and Transformers - In a code first approach!
hpc
Maximizing HPC Potential: The Accelerators [Part 2]
Get those numbers crunching! Hardware accelerators are specialized computing devices designed to perform specific tasks more efficiently than general-purpose...
Maximizing HPC Potential: Unveiling the Best CPU, Motherboard, and Memory [Part 1]
Prepare to harness the immense power of high-performance computing (HPC) nodes. In Part 1 of my comprehensive series, I delve into the art of choosing the ul...
update
Back to Top ↑image
Neural Style Transfer
Introduction
XAI
Introduction to XAI (Explainable AI)
Chapter 01 of Applied Machine Learning Explainability Techniques book by Aditya Bhattacharya
book
Introduction to XAI (Explainable AI)
Chapter 01 of Applied Machine Learning Explainability Techniques book by Aditya Bhattacharya
machine learning
LazyPredict
I am just too lazy to compare multiple Machine Learning algorithms.
sklearn
LazyPredict
I am just too lazy to compare multiple Machine Learning algorithms.
horovod
Setting up Horovod on cluster
Setting and running Horovod on a PBS managed cluster
onnx
Optimizing Deep Learning Models for Inference with Speedster
Nebuly-AI’s Speedster is a tool that can optimize deep learning models for inference on CPUs and GPUs.
speedster
Optimizing Deep Learning Models for Inference with Speedster
Nebuly-AI’s Speedster is a tool that can optimize deep learning models for inference on CPUs and GPUs.
optimization
Optimizing Deep Learning Models for Inference with Speedster
Nebuly-AI’s Speedster is a tool that can optimize deep learning models for inference on CPUs and GPUs.
inference
Optimizing Deep Learning Models for Inference with Speedster
Nebuly-AI’s Speedster is a tool that can optimize deep learning models for inference on CPUs and GPUs.
pandas
Unleashing the Power of AI in Data Analysis with Sketch
Explore and Analyze Your Data with Sketch: In this blog post, we will explore Sketch - an AI-powered DataFrame assistant for Python that uses data sketching ...
projects
Stuff I learnt doing an end to end project
Deep Learning Lessons: Insights from an End-to-End Project. Gain valuable tips from my personal experiences in deep learning. Discover the power of thorough ...