Arafat Sani
AI Infra, In Public
— IT support specialist climbing into AI infrastructure. I run models on affordable GPUs, learn Kubernetes, Terraform and CUDA in the open, and log every step.
Serving LLMs at 4x:
vLLM, KV-Cache
& Autoscaling
Inference engineering field log — how continuous batching + PagedAttention took a 7B model from 18 → 74 tok/s on one A10G, and how I autoscale it on Kubernetes without burning budget.
Published
Documented
Learning Logs
& Field Notes
Filter by engineering track. Add your own tags, delete ones you don't use — the filter bar is yours. Tags persist locally.
LOG.ALL
TRK.INFRA
NVIDIA + NEBIUS
LIVE.REC
Infrastructure
Builds
Small, real and reproducible. Every build is something I ran, broke, measured or wrote up — notes included, hype excluded.
IN PUBLIC.
BUILDS →
Serving, scheduling,
cloud & delivery.
Small builds, real runs.
Benchmarks
& Lab Runs
Every number below came off a GPU I actually rented or ran. Same format every time: model, hardware, precision, method — so anyone can reproduce or challenge it.
OR SILENCE.
Experience
& Roles
Roles, teams, and what shipped. Full dossier with skills, certs and education lives in About — this is the short path.
Tools I
Actually Use
No affiliate links, no sponsored picks. Every tool here runs something of mine — with a one-line verdict on why it earned its place.
This list grows as the builds do — check back.
What I Run
This On
Daily drivers, homelab hardware and the AI stack behind my builds. If it's listed, it earned its place by running something real.
Learning
Signal Index
Logged in public
Road Into
AI Infrastructure
What I'm
Into Right Now
Updated monthly. The short version also lives in the hero — this is the full one.
Arafat Sani
AI Infrastructure / Inference Engineer
Tier 1 Triage→TO
Reliable Ops
IT Support Specialist with B.S. Computer Science, M.S. Data Science and 4+ years across help desk, desktop, service desk and NOC-style operations.
Support Coverage Focus
Windows 10/11, macOS/iOS, Microsoft 365 and Google Workspace, Active Directory/MFA access, LAN/Wi-Fi/VPN and TCP/IP/DNS/DHCP, ServiceNow ticketing and knowledge-base documentation.
- ◉ Service Desk & Ticketing Unit
- ◈ Systems / Network Unit
Arafat Sani
AI infrastructure & inference engineer with an M.S. in Data Science and 4+ years of ops roots across help desk and NOC-style environments.
Let's
Work Together
◈ Hiring for cloud support, junior DevOps/MLOps or GPU-adjacent roles — or just want to talk homelabs and inference? I reply within 48 hours.
◇ DISCUSSION