Algomi Blogs

System design, AI engineering, databases, networking, concurrency and more, written for engineers building real trading and fintech systems — part of the Algomi Suite.

All System Design AI Solutions Architecture & AI Engineering Interview Questions (61)

Browse by topic (29)

AI Engineering (7)Java (7)Distributed Systems (6)Reliability (6)Security (6)AI Agents (5)Caching (5)Concurrency (4)Databases (4)Low-Level Design (4)Messaging (4)Networking (4)Streaming (4)APIs (3)Architecture (3)Consistency (3)Design Patterns (3)Harness Engineering (3)Observability (3)RAG (3)Transactions (3)Agent Memory (2)Capacity Planning (2)Enterprise Architecture (2)Fintech (2)Kafka (2)Machine Coding (2)Storage (2)Tool Use (2)

Part 17 of 28

Capacity Estimation and Load Testing: Back-of-the-Envelope Done Properly

The numbers every engineer should know, a repeatable method for QPS, storage, bandwidth, and server counts, worked examples, and how to check the estimate with load tests and percentile latency.

Created 2026-09-29 · Updated 2026-10-15 · System Design

Part 24 of 28

LLM Serving Infrastructure and Capacity Planning: SLOs, Parallelism, and Autoscaling

Turning the mechanics of LLM inference into a capacity plan: TTFT and tokens-per-second targets, how many GPUs a model needs, tensor and pipeline parallelism, prefix caching, speculative decoding, serving engines, streaming, and autoscaling.

Created 2026-09-29 · Updated 2026-10-15 · AI Solutions Architecture & AI Engineering