Thoughts, Problems and Experiments while my PC's VRAM gets full and I run for my next slot in the laundry.

My Naïve experiments with vLLM and evaluating SLMs

Because why not - Experiment 1: Improving Inference Speed