Course
Python
·
Testing, Evaluation, and Observability
· part 70 of 79
Course outline
Expand all
79
parts
01
Environment, Tooling, and Version Control
7
01
Lesson 1: Toolchain
02
Lesson 2: Configuration and Secrets
03
Lesson 3: Editor and Quality Tooling
04
Lesson 4: Debugging Fundamentals
05
Lesson 5: Version Control
06
Lesson 6: Containers
07
Summary
02
Problem Decomposition, Data Structures, and Typed Records
6
08
Lesson 1: Logic Bootcamp
09
Lesson 2: Data Structures by Access Pattern
10
Lesson 3: Readable Logic
11
Lesson 4: Records
12
Lesson 5: Type Hints as Design
13
Summary
03
Functions, Composition, and Prompts as Code
5
14
Lesson 1: Function Design
15
Lesson 2: Functions as Values
16
Lesson 3: Decorators
17
Lesson 4: Prompts as Code
18
Summary
04
Data Pipelines and Streaming Processing
6
19
Lesson 1: Files and Formats
20
Lesson 2: Lazy Processing
21
Lesson 3: Durability
22
Lesson 4: Multimodal Inputs
23
Lesson 5: Tabular Tools
24
Summary
05
Error Handling and Reliability Engineering
7
25
Lesson 1: Failure Taxonomy
26
Lesson 2: Exception Mechanics
27
Lesson 3: Retry Logic
28
Lesson 4: Timeouts
29
Lesson 5: Degradation
30
Lesson 6: Correctness Under Retry
31
Summary
06
Structured Outputs, Tool Calling, and Agent Security
6
32
Lesson 1: Validated Outputs
33
Lesson 2: Parsing Hostile Output
34
Lesson 3: Tool Execution
35
Lesson 4: MCP
36
Lesson 5: Security
37
Summary
07
Object-Oriented Design, Provider Abstraction, and Persistence
8
38
Lesson 1: Classes
39
Lesson 2: Contracts
40
Lesson 3: Provider Abstraction
41
Lesson 4: Relational Persistence
42
Lesson 5: The Repository Pattern
43
Lesson 6: Ephemeral State
44
Lesson 7: Migrations
45
Summary
08
Asynchronous Python, Concurrency, and Streaming
7
46
Lesson 1: Async Fundamentals
47
Lesson 2: Concurrency Control
48
Lesson 3: Consuming a Stream
49
Lesson 4: Streaming Structured Data
50
Lesson 5: Re-streaming Through Your Own API
51
Lesson 6: Operating Streams
52
Summary
09
Retrieval and Context Engineering
7
53
Lesson 1: Chunking
54
Lesson 2: Embeddings
55
Lesson 3: Search
56
Lesson 4: Vector Stores
57
Lesson 5: Context Assembly
58
Lesson 6: Diagnosis
59
Summary
10
Token Economics and Cost Engineering
5
60
Lesson 1: Counting
61
Lesson 2: Context Window Budgeting
62
Lesson 3: Cost Accounting
63
Lesson 4: Cost Control
64
Summary
11
Testing, Evaluation, and Observability
6
65
Lesson 1: Testing
66
Lesson 2: Evaluation
67
Lesson 3: Logging and Tracing
68
Lesson 4: Performance
69
Lesson 5: CI Layering
70
Summary
12
Application Architecture and Production Readiness
9
71
Lesson 1: Architecture
72
Lesson 2: Configuration and Secrets
73
Lesson 3: FastAPI in Production
74
Lesson 4: Background Work
75
Lesson 5: Type and Quality Gates
76
Lesson 6: Security Review
77
Lesson 7: Deployment
78
Lesson 8: Documentation and Packaging
79
Summary
Part
70
· Testing, Evaluation, and Observability
Summary
9 Sept 2026
← Part
69
Lesson 5: CI Layering
Part
71
→
Lesson 1: Architecture