Explore AI Model Architectures

In this lab, you'll explore the practical aspects of AI models from an infrastructure perspective.

You'll learn to:

• Understand different model formats (GGUF, SafeTensors) and when to use each
• Pull and inspect model metadata to understand resource requirements
• Compare inference speeds across different model sizes
• Make informed decisions about model selection for your infrastructure

Prerequisites:

• Basic Linux command line skills
• Understanding of system resources (memory, CPU)

Key Concepts:

• Model quantization levels (FP16, INT8, INT4)
• VRAM and RAM requirements
• Inference latency vs model capability tradeoffs