Statistical Basis of AI/ML¶
Volume I Epilogue: The Bridge to Volume II¶
Chapter 21 -- From Prototype to Platform: agent-creator and Cyberdoc_Onc¶
Chapter 20 built a cognitive agent over 30 curated oncology statements using only the libraries installed in the Volume I environment. The agent worked. It retrieved evidence, propagated uncertainty through a belief graph, applied an entropy-based refusal threshold, and reflected on its own draft before answering.
What it lacked was everything that makes a clinical tool real: a corpus of actual medical knowledge, a safety system, a production API, persistent memory across sessions, and the infrastructure to serve thousands of users.
This chapter is the bridge. It does not introduce new mathematics. It shows how every mathematical idea in Chapters 1 through 20 reappears -- at production scale -- in agent-creator and its first specialization, Cyberdoc_Onc.
Volume II is the engineering narrative of that production system.
Volume III asks whether the energy cost of running it at civilizational scale can be addressed by quantum computing.
Why This Chapter?¶
Volume I is complete. Twenty chapters, twenty executable notebooks, a
continuous arc from import numpy to a working cognitive reasoning agent.
That arc had one deliberate constraint: it stayed in the notebook. Every
component -- the retrieval engine, the belief graph, the reflection gate,
the entropy calibration -- was designed to be transparent and inspectable
from first principles, not to be deployed.
Chapter 21 names the gap between the notebook and production, and introduces the project that closes it.
| Chapter 21 goal | Why it matters |
|---|---|
| Map Vol I concepts to production counterparts | Reader of Vol II never asks "where did this come from?" |
| Describe agent-creator and Cyberdoc_Onc precisely | Vol II assumes this knowledge; Ch21 builds it |
| State the energy question honestly | Connects the engineering of Vol II to the physics of Vol III |
Table of Contents¶
| Section | Topic |
|---|---|
| Sec.21.0 | How to read this chapter |
| Sec.21.1 | From notebook to production: the concept map |
| Sec.21.2 | agent-creator: the factory architecture |
| Sec.21.3 | Cyberdoc_Onc: the five-layer production system |
| Sec.21.4 | The corpus gap: from 30 statements to 1.4 million documents |
| Sec.21.5 | Volume II chapter map (provisional) |
| Sec.21.6 | The energy question: hook to Volume III |
| Sec.21.7 | The Grand Vision: three volumes, one argument |
Sec.21.0 How to Read This Chapter¶
This is a map chapter. It requires no new packages, no new mathematics,
and no code execution to understand. The single Python cell draws an
architecture diagram; running it requires matplotlib, which is already
installed in the Volume I environment.
Three goals drive the text:
Goal 1 -- Translation. Every concept introduced in Chapters 1-20 has a production counterpart in Cyberdoc_Onc. Section 21.1 makes that translation table explicit. A reader who reaches this chapter after following the full Volume I arc should recognise every item in the right column of that table.
Goal 2 -- Orientation. Readers who pick up Volume II without having read Volume I need a starting map of what they are walking into. Sections 21.2 and 21.3 provide that map in enough detail that no architectural decision in Volume II requires a separate explanation of its origin.
Goal 3 -- Motivation. The engineering effort of Volume II and the theoretical inquiry of Volume III are both responses to the same question: what does it cost to serve clinical AI at civilizational scale, and how do we make it sustainable? Section 21.6 states that question precisely before Volume III takes it up.
Sec.21.1 From Notebook to Production: The Concept Map¶
Every architectural component of the Chapter 20 agent has a production counterpart in Cyberdoc_Onc. The table below is the translation dictionary that Volume II assumes. The left column is what Volume I built. The right column is what Cyberdoc_Onc runs in production today.
| Vol I concept | Chapter | Production counterpart in Cyberdoc_Onc |
|---|---|---|
| TF-IDF / cosine retrieval | Ch10 | Azure AI Search: dense + sparse hybrid, 1.4 million documents |
| Confidence scoring (regression) | Ch06 | confidence_score field in UnifiedMedicalResponse |
| Shannon entropy refusal | Ch13 | BeliefGraph.entropy_threshold = 0.7 |
| GCN belief graph consistency | Ch19 | BeliefGraph: GCN propagation over live clinical claim nodes |
| BeliefNode status classifier | Ch07 | Node status: SUPPORTED, CONTRADICTED, UNCERTAIN |
| ReAct loop | Ch20 | coordinator.py: plan -> dispatch -> retrieve -> reflect |
| Reflection gate | Ch20 | reflection_gate.py: LLM self-critique before answer release |
| BERT encoder backbone | Ch17 | text-embedding-3-large (1536 dims) via Azure OpenAI |
| Patch attention (vision) | Ch18 | Semantic ranker: attention over retrieved document chunks |
| Calibration curves | Ch06 | Retrieval score calibration and confidence reporting |
| Information entropy (anomaly) | Ch13 | HIPAA audit log entropy for access-pattern anomaly detection |
| Intent classification | Ch07 | Intent router: oncology vs. general query (utility LLM tier) |
| Gradient descent | Ch14-15 | Future: fine-tuning the coordinator on physician-scientist traces |
The right-hand column is not a replacement of the left-hand column. It is the same idea, reimplemented at a scale and reliability level that a clinical tool requires. The Vol I implementation proved the mechanism. The Vol II implementation proves the engineering.
Sec.21.2 agent-creator: The Factory¶
agent-creator is a software factory for building and maintaining specialized AI agents -- one per clinical specialty. Its design separates two concerns that are easy to conflate:
Infrastructure (API layer, safety system, multi-agent coordination, memory management, CI/CD, deployment): this changes slowly and is shared across all specializations.
Domain knowledge (corpus, clinical ontology, specialty-specific prompt templates, retrieval index): this changes per specialization and per institution.
The factory pattern means that a second specialization -- Cyberdoc_Cardio, Cyberdoc_Neuro, Cyberdoc_Rad -- reuses the coordinator, safety system, and API layer without modification. Only the domain layer changes.
Repository structure¶
agent-creator/ <- shared factory infrastructure
main.py <- FastAPI entry point (port 8610)
Cyberdoc_Onc/ <- oncology specialization
coordinator.py <- multi-agent orchestration loop
agents/ <- specialist sub-agents
nccn_agent.py
pubmed_agent.py
drugdb_agent.py
clinical_trials_agent.py
knowledge/ <- Azure AI Search index configuration
models/ <- Pydantic response models
unified_medical_entities.py
utils/
belief_graph.py <- BeliefGraph (Ch19 GCN + Ch13 entropy)
safety_system.py <- pre-flight and post-answer checks
reflection_gate.py <- LLM self-critique (Ch20 reflection)
The agent-creator repository is the living implementation of the
architecture that Volume II describes. Every chapter in Volume II maps to
one or more files in this repository. The code is the textbook.
The factory in action¶
A query enters main.py. The coordinator in Cyberdoc_Onc/coordinator.py
receives it, plans a retrieval sub-goal sequence, dispatches to specialist
agents, assembles results into a belief graph, runs the reflection gate,
checks the entropy threshold, applies safety review, and returns a
UnifiedMedicalResponse.
That pipeline -- plan, retrieve, believe, reflect, verify -- is the ReAct loop of Chapter 20, extended with production-grade safety, multi-agent dispatch, and the Azure infrastructure that makes it available 24 hours a day at cyberdoc.avestabio.org.
Sec.21.3 Cyberdoc_Onc: The Five-Layer Architecture¶
Cyberdoc_Onc has five layers. A query enters at Layer 1 and propagates upward through safety, coordination, retrieval, and reasoning. The response travels back down the same path before reaching the caller.
External traffic (HTTPS via cyberdoc.avestabio.org)
|
v
+-------------------------------------------------------+
| Layer 1: API |
| FastAPI (port 8610, internal) |
| Azure Front Door (WAF + TLS + CDN) |
| Azure Key Vault (all secrets -- nothing in .env) |
| Docker container on relay VM (8611:8610) |
+-------------------------------------------------------+
|
v
+-------------------------------------------------------+
| Layer 2: Safety |
| Pre-flight: scope check, HIPAA audit log |
| Emergency escalation (acute crisis queries) |
| Post-answer: safety guideline consistency check |
+-------------------------------------------------------+
|
v
+-------------------------------------------------------+
| Layer 3: Multi-Agent Coordination |
| Coordinator: plan sub-goals -> dispatch -> collect |
| Specialist agents: NCCN, PubMed, DrugDB, |
| ClinicalTrials, SafetyDB |
+-------------------------------------------------------+
|
v
+-------------------------------------------------------+
| Layer 4: Retrieval (RAG) |
| Azure AI Search index: 1,459,137 documents |
| Dense: text-embedding-3-large (1536 dims) |
| Sparse: BM25 Ranker: Azure semantic re-ranking |
+-------------------------------------------------------+
|
v
+-------------------------------------------------------+
| Layer 5: Reasoning |
| Primary LLM: gpt-5.4-pro (all clinical reasoning) |
| Utility LLM: gpt-4.1 (intent routing, formatting) |
| BeliefGraph: GCN consistency + entropy threshold |
| ReflectionGate: LLM self-critique before release |
+-------------------------------------------------------+
Layer by layer: the Vol I connections¶
Layer 1 -- API runs FastAPI with a /consult endpoint. Azure Front
Door provides WAF protection, TLS termination, and CDN caching. Azure Key
Vault stores all credentials; the .env file contains no secrets.
Layer 2 -- Safety applies two passes: a pre-flight check before the query reaches the reasoning layer (is this clinical? within oncology scope? an emergency requiring immediate escalation?) and a post-answer check before the response is returned (does the answer contradict known safety guidelines?). Every query and response is logged to the HIPAA audit trail.
Layer 3 -- Coordination is the ReAct loop of Chapter 20, extended. The coordinator plans a sequence of retrieval sub-goals, dispatches each to a specialist agent (NCCN guidelines, PubMed literature, drug database, clinical trials registry), collects structured results, and assembles them into a belief graph for the reasoning layer.
Layer 4 -- Retrieval replaces the Chapter 20 TF-IDF retriever with
Azure AI Search. The index holds 1,459,137 documents embedded with
text-embedding-3-large (1536 dimensions). Hybrid retrieval (dense +
BM25 sparse) followed by a semantic re-ranker gives substantially higher
precision than TF-IDF alone at this corpus scale.
Layer 5 -- Reasoning is where Chapter 20's architecture is preserved
most faithfully. The BeliefGraph uses the same GCN-based propagation
(Chapter 19) and the same Shannon entropy refusal threshold (Chapter 13).
The ReflectionGate is a direct implementation of the reflection pattern
from Chapter 20. The primary LLM (gpt-5.4-pro) handles all clinical
reasoning. A lighter utility model (gpt-4.1) handles intent routing and
format normalization -- tasks that require no multi-hop clinical inference.
# ============================================================
# Chapter 21 -- Architecture Diagram (optional)
# Requires: matplotlib (already in the Volume I environment)
# ============================================================
import matplotlib.pyplot as plt
from matplotlib.patches import FancyBboxPatch
# Each tuple: (y_bottom, background_color, header_text, detail_text)
# Layers ordered bottom-to-top (Layer 1 API at y=0, Layer 5 Reasoning at top)
LAYERS = [
(0.0, '#4a235a', 'Layer 1 -- API',
'FastAPI port 8610 | Azure Front Door | Azure Key Vault | Docker (relay VM 8611:8610)'),
(1.5, '#7e5109', 'Layer 2 -- Safety',
'Pre-flight scope check | HIPAA audit log | Emergency escalation | Post-answer review'),
(3.0, '#154360', 'Layer 3 -- Multi-Agent Coordination',
'Coordinator (Ch20 ReAct) | NCCN | PubMed | DrugDB | ClinicalTrials'),
(4.5, '#1f618d', 'Layer 4 -- Retrieval (RAG)',
'Azure AI Search | 1,459,137 docs | 1536-dim embeddings (Ch17) | Semantic ranker'),
(6.0, '#1a5276', 'Layer 5 -- Reasoning',
'gpt-5.4-pro (cognitive) | gpt-4.1 (utility) | BeliefGraph (Ch19+Ch13) | ReflectionGate (Ch20)'),
]
fig, ax = plt.subplots(figsize=(13, 8))
ax.set_xlim(-0.2, 10.6)
ax.set_ylim(-0.5, 8.2)
ax.axis('off')
ax.text(5.0, 7.8, 'Cyberdoc_Onc Production Architecture',
ha='center', va='center', fontsize=13, fontweight='bold', color='#1c2833')
ax.text(5.0, 7.45,
'Query enters at Layer 1 and propagates upward through safety, coordination, retrieval, and reasoning.',
ha='center', va='center', fontsize=8, color='#555555', style='italic')
for (y, color, header, detail) in LAYERS:
rect = FancyBboxPatch(
(0.3, y), 9.2, 1.2,
boxstyle='round,pad=0.06',
facecolor=color, edgecolor='#ecf0f1', linewidth=1.5,
)
ax.add_patch(rect)
ax.text(4.9, y + 0.85, header,
ha='center', va='center', color='white',
fontsize=9.5, fontweight='bold', fontfamily='monospace')
ax.text(4.9, y + 0.38, detail,
ha='center', va='center', color='#d6eaf8',
fontsize=7.5, fontfamily='monospace')
# Upward arrows between adjacent layers (showing query flow)
for i in range(len(LAYERS) - 1):
y_top_of_lower = LAYERS[i][0] + 1.2
y_bot_of_upper = LAYERS[i + 1][0]
ax.annotate('', xy=(4.9, y_bot_of_upper), xytext=(4.9, y_top_of_lower),
arrowprops=dict(arrowstyle='->', color='#aab7b8', lw=1.5))
# Vol I chapter references on the right margin
VOL1 = [
'Ch06 regression, Ch07 classification',
'Ch06 calibration, Ch13 information theory',
'Ch20 planning + dispatch loop',
'Ch10 TF-IDF, Ch17 BERT, Ch18 attention',
'Ch13 entropy, Ch19 GCN, Ch20 ReAct + reflection',
]
ax.text(9.7, 7.2, 'Vol I foundation:', ha='left', va='center',
fontsize=7.5, color='#7f8c8d', fontweight='bold')
for i, (y, _, _, _) in enumerate(LAYERS):
ax.text(9.7, y + 0.6, VOL1[i], ha='left', va='center',
fontsize=6.5, color='#7f8c8d', style='italic')
plt.tight_layout()
plt.show()
print('[OK] Architecture diagram rendered.')
Sec.21.4 The Corpus Gap: From 30 Statements to 1.4 Million Documents¶
Chapter 20 ran on a knowledge store of 30 curated oncology statements. The TF-IDF retriever worked because the corpus was small enough that exhaustive comparison over all documents was fast. At 30 documents, the retrieval step took microseconds.
Cyberdoc_Onc indexes 1,459,137 documents.
The gap is not cosmetic. It determines the retrieval architecture, the infrastructure costs, and the evaluation protocol.
| Corpus size | Retrieval strategy | Index type | Typical latency |
|---|---|---|---|
| < 5 K chunks | TF-IDF, in-memory (Ch20) | Python dict | < 1 ms |
| 5 K - 100 K | Dense embeddings, flat index | FAISS / Chroma | 5-20 ms |
| > 100 K chunks | Dense + sparse hybrid, inverted index | Azure AI Search | 20-80 ms |
Cyberdoc_Onc sits in the third row. The Azure AI Search Standard tier index supports up to one million documents per index (with multiple indices for larger corpora) and sub-100 ms retrieval under normal load.
What the corpus contains¶
The 1.4 million documents come from four sources:
- Clinical guidelines -- NCCN, ESMO, ASCO, WHO protocols (structured PDF, chunked at the recommendation level)
- Peer-reviewed literature -- PubMed abstracts and full texts via PubMed Central Open Access (PMC-OA)
- Drug database -- FDA labels, prescribing information, pharmacokinetic data, Black Box Warning text
- Clinical trial registry -- ClinicalTrials.gov structured records, including primary completion data and outcome summaries
Each document is chunked at the claim level (150-250 words per chunk),
embedded with text-embedding-3-large, and stored with metadata fields:
source_type, specialty, date_indexed, doc_id.
The retrieval interface is unchanged from Chapter 20¶
The coordinator in Chapter 20 called a retrieval function with a string
query and received a list of RetrievalResult objects. The coordinator
in Cyberdoc_Onc calls the same interface. The function behind that
interface changed -- from TF-IDF to Azure AI Search -- but the
coordinator's code did not change.
This is the tool registry pattern: define a stable interface, swap the implementation. It is the reason the Chapter 20 architecture is production-ready in structure even when the retrieval layer is a notebook simulation. The pattern propagates through Volume II: every major component in Cyberdoc_Onc is behind a defined interface that can be upgraded without rewriting its callers.
Sec.21.5 Volume II Chapter Map (Provisional)¶
Volume II describes the engineering of agent-creator and Cyberdoc_Onc. Each part of the book maps to one engineering concern. The chapter map below is provisional; the ordering and chapter boundaries will evolve as the manuscript develops. The scope and the sequence of concerns are fixed.
Part 1 -- The Corpus and Knowledge Infrastructure¶
| Chapter | Topic |
|---|---|
| Vol II Ch01 | From PDFs to claim nodes: ingestion, chunking, de-identification |
| Vol II Ch02 | The knowledge graph: claim nodes, citation edges, temporal ordering |
| Vol II Ch03 | Azure AI Search: dense embeddings, BM25, and the semantic ranker |
| Vol II Ch04 | Privacy audit: HIPAA scope, PII detection, de-identification pipeline |
Part 2 -- The Multi-Agent Architecture¶
| Chapter | Topic |
|---|---|
| Vol II Ch05 | The coordinator: planning, dispatch, and working memory |
| Vol II Ch06 | Specialist agents: NCCN, PubMed, DrugDB, ClinicalTrials |
| Vol II Ch07 | The safety system: pre-flight checks and emergency escalation |
| Vol II Ch08 | BeliefGraph at scale: GCN over 10 K+ claim nodes |
| Vol II Ch09 | The ReflectionGate: LLM self-critique and entropy-controlled refusal |
Part 3 -- Memory Systems¶
| Chapter | Topic |
|---|---|
| Vol II Ch10 | Semantic memory: Azure AI Search as long-term store |
| Vol II Ch11 | Episodic memory: case-encounter embeddings with temporal indexing |
| Vol II Ch12 | Procedural memory: clinical workflow graphs |
| Vol II Ch13 | Working memory: attention-weighted context window management |
Part 4 -- Evaluation and Calibration¶
| Chapter | Topic |
|---|---|
| Vol II Ch14 | Calibration curves: stated confidence vs. empirical accuracy |
| Vol II Ch15 | Retrieval quality: precision, recall, NDCG at the chunk level |
| Vol II Ch16 | Clinician-in-the-loop evaluation protocol |
Part 5 -- Deployment and Operations¶
| Chapter | Topic |
|---|---|
| Vol II Ch17 | Docker, Azure Front Door, and the relay VM |
| Vol II Ch18 | The virtual cancer center: extending agent-creator to multiple specialties |
| Vol II Ch19 | CI/CD, security scanning, and the GitHub Actions pipeline |
Part 6 -- The Energy Question¶
| Chapter | Topic |
|---|---|
| Vol II Ch20 | The cost of one consultation: tokens, compute, and carbon |
| Vol II Ch21 | At EHR scale: what happens when a billion patients have an agent? |
Part 6 is the final movement of Volume II. It closes the engineering narrative and opens the question that Volume III addresses.
Sec.21.6 The Energy Question: Hook to Volume III¶
The cost of one Cyberdoc_Onc consultation¶
A single Cyberdoc_Onc consultation at current production configuration involves:
Retrieval: one embedding call per sub-query (typically 3-5 specialist agent dispatches), each converting a query string into a 1536-dimensional vector and running hybrid retrieval over 1.4 million documents.
Primary LLM calls:
gpt-5.4-proprocesses approximately 3,000-8,000 input tokens and generates 500-2,000 output tokens per full consultation.Reflection: one additional
gpt-5.4-procall of comparable scale.Safety checks: two
gpt-4.1calls (pre-flight and post-answer), each 200-500 tokens.
The total compute per consultation is modest. The question becomes interesting at scale.
At EHR scale¶
| Scope | Annual encounters |
|---|---|
| United States outpatient visits | approximately 1.0 billion per year |
| US oncology consultations | approximately 7 million per year |
| Global outpatient contacts | approximately 8-10 billion per year |
If 10% of US outpatient encounters used a cognitive agent consultation:
- 100 million consultations per year
- Approximately 8,000 tokens per consultation average: 800 billion tokens processed per year
- At 2025 GPU efficiency for LLM inference: roughly 10^13 to 10^14 floating-point operations per consultation
- At 100 million consultations: 10^21 to 10^22 FLOPs per year
This is not a prohibitive number at 2025 efficiency for the US oncology use case alone. It becomes significant at full global deployment across all specialties.
The IEA (2024) projects AI inference will account for 10-15% of global data center power consumption by 2030. Healthcare AI is one of the largest anticipated demand categories.
The classical computing response¶
Efficiency improvements on the classical path are real and measurable:
- Smaller, distilled models for triage and routing (the utility-vs-cognitive two-tier architecture in Cyberdoc_Onc is an example of this already applied)
- Semantic caching: repeated similar queries share cached embeddings and retrieval results
- Speculative decoding and hardware-level quantization reduce per-token compute
- Next-generation GPUs and NPUs improve FLOPs per watt each hardware generation
These improvements extend the efficiency runway but do not change the asymptotic trajectory: more users, more specialties, more languages, more compute, more energy.
The quantum computing premise¶
Quantum computing offers three theoretical advantages relevant to large-scale clinical AI inference:
Grover's algorithm provides O(sqrt(N)) search over an unstructured database, compared to O(N) classically. For retrieval over 1.4 million documents, this represents a quadratic speedup in the theoretical limit. For retrieval over a global health knowledge graph of billions of claim nodes, the speedup compounds.
Quantum parallelism allows a quantum processor to evaluate multiple inference paths simultaneously in superposition, collapsing to the highest-probability answer. This could in principle replace the serial beam search of autoregressive language models.
Low-loss interconnects exploit quantum effects to eliminate the classical resistance losses between computational units. For the dense matrix operations that dominate attention and embedding computation, this could reduce interconnect energy substantially at scale.
The quantum engineering caveat¶
The premise is theoretical. Current quantum hardware in 2025:
- Has gate error rates of 0.1-1% per operation; classical error correction overhead consumes most of the theoretical speedup at current fidelities
- Requires cryogenic infrastructure at 15 millikelvin; refrigeration plants for current quantum processors consume kilowatts continuously
- Operates on 100-1000 physical qubits, far below the fault-tolerant logical qubit count needed for LLM-scale inference
Volume III examines whether the engineering trajectory of quantum hardware is on a course that could close this gap within a clinically relevant timeframe -- and what honest assessment of the physics says about the conditions under which the premise survives contact with engineering reality.
Sec.21.7 The Grand Vision: Three Volumes, One Argument¶
The argument¶
A physician-scientist has spent a career generating knowledge -- publications, clinical protocols, case series, funded grants. That knowledge is fragmented across PDFs, databases, and memory. It cannot be queried consistently. It cannot reason across its own contradictions. It cannot articulate its confidence calibration. It is not available at 3 AM when a trainee needs it.
Volume I proved that the mathematical foundations for building a system that can do these things are teachable from first principles in Python. No black boxes. Every mechanism inspectable. Every equation derived, not imported.
Volume II shows one such system built and deployed: agent-creator and Cyberdoc_Onc. The engineering is genuinely difficult -- the safety requirements are non-negotiable, the evaluation protocol is hard, the infrastructure costs are real. But the system works, runs in production, and is auditable end to end.
Volume III asks what it costs when that system -- or systems like it -- are deployed at the scale of global healthcare. And it examines the most seriously proposed alternative computational substrate.
The three-volume arc¶
Vol I: The Mathematics (Chapters 1-21)
From probability theory to transformers to cognitive agents.
Everything derived from first principles -- nothing hidden.
|
v
Vol II: The Engineering (Chapters 1-21)
agent-creator and Cyberdoc_Onc.
From raw corpus to production clinical reasoning.
The virtual cancer center: one factory, many specialties.
|
v
Vol III: The Physics and the Future
Energy cost of clinical AI at civilizational scale.
Quantum computing: theoretical promise vs. engineering reality.
The sustainability question that determines the trajectory.
What this means for different readers¶
For the clinician or biomedical researcher: Volume I requires no prior programming background beyond what Chapter 1 teaches. Volume II can be read as an architectural narrative with code as supporting evidence. Volume III is accessible to anyone who has followed the probability and information theory threads of Volume I.
For the engineer or data scientist: Volume I is a graduate-level refresher that derives everything from first principles and never hides a mechanism behind a library call. Volume II is a production engineering case study with all decisions made explicit and all trade-offs documented. Volume III is an engineering assessment of emerging hardware against a concrete, quantified workload.
For the physician-scientist who wants to build their own agent: Volume II Chapter 18 describes how to extend agent-creator to a new specialty. The factory pattern means the infrastructure already exists; the domain knowledge -- the corpus, the ontology, the specialty-specific prompt templates -- is the only new investment required.
Volume I ends here.
The mathematics is complete. The agent is built.
Volume II begins with a real corpus, a real knowledge graph, and a real clinical reasoning task -- and the engineering decisions that turn a notebook experiment into a system that a physician can trust.
Summary¶
Chapter 21 closes Volume I by naming the gap between the prototype cognitive agent built in Chapter 20 and a deployable clinical reasoning system. It introduces agent-creator -- the production engineering framework -- and Cyberdoc_Onc -- the first specialty instantiation for medical oncology.
The chapter contains no new mathematics. It is a concept map: every mechanism derived in Chapters 1--20 reappears at production scale, and the chapter names exactly where and how.
| Vol I Component | Production Counterpart | agent-creator Module |
|---|---|---|
| TF-IDF cosine retrieval (Ch10, Ch20) | Dense embedding search | Azure AI Search |
| Entropy refusal threshold (Ch13, Ch20) | Calibrated refusal gate | BeliefGraph entropy check |
| GCN belief graph (Ch19, Ch20) | Full knowledge graph (10 K+ nodes) | GCN consistency module |
| BERT encoder backbone (Ch17) | Production LLM API | unified_config.py model tier |
| Reflection gate (Ch20) | LLM-based self-critique | ReflectionGate |
| ReAct loop (Ch20) | Stateful multi-turn coordinator | Cyberdoc coordinator |
Volume II spans six parts: Corpus ingestion, Multi-agent coordination, Memory systems, Evaluation, Deployment, and Energy. Volume III asks whether the energy cost of clinical AI at civilizational scale can be addressed by quantum computing.
Section 21.8 — Summary & Quick Reference
Key Concepts¶
| Vol I Concept | Production Counterpart | Volume II Part |
|---|---|---|
| TF-IDF / cosine retrieval | Azure AI Search with dense embeddings | Part 1 -- Corpus |
| Entropy refusal (Ch13) | Calibration curves; Bayesian confidence propagation | Part 4 -- Metacognition |
| GCN belief graph (Ch19) | Full production knowledge graph (10 K+ nodes) | Part 4 -- Metacognition |
| Reflection gate (Ch20) | LLM-based self-critique replaces rule-based reflector | Part 3 -- Reasoning Engine |
| Domain adaptation (Ch17) | Production LLM with cognitive / utility task tiers | Part 3 -- Reasoning Engine |
| Multi-agent coordination | Stateful multi-turn coordinator with planning horizon | Part 2 -- Multi-Agent |
Architecture Map¶
| agent-creator Layer | Function | Vol I Foundation |
|---|---|---|
| Corpus pipeline | Ingest, chunk, embed, index clinical publications | Ch10 vector spaces, Ch17 BERT |
| Knowledge graph | Claim nodes, citation edges, temporal edges | Ch19 GCN |
| Reasoning engine | ReAct loop, working memory, planning horizon | Ch20 cognitive agent |
| Evaluation protocol | Clinician-in-the-loop; calibration curves | Ch06 regression, Ch13 entropy |
| Safety system | HIPAA compliance, hallucination detection, audit log | Ch07 classification, Ch20 refusal |
What's Next?¶
$$\boxed{\text{Vol I: Mathematics (Ch 1--21)}} \;\to\; \boxed{\text{Vol II: Engineering}} \;\to\; \boxed{\text{Vol III: Physics and the Future}}$$
Volume II opens with the corpus audit: how many documents, in what formats, at what scale? The answer determines the retrieval architecture. Every component of Vol II -- the ingestion pipeline, the reasoning engine, the evaluation protocol -- applies concepts derived in Vol I at production scale. No new mathematics is introduced. The engineering is genuinely difficult.
References¶
Amodei D and Hernandez D (2018). AI and Compute. OpenAI Blog. blog.openai.com/ai-and-compute.
Chen T, Liang C, Ma X, et al. (2023). Power hungry processing: Watts driving the cost of AI deployment? arXiv:2311.16814.
Grover LK (1996). A fast quantum mechanical algorithm for database search. Proceedings of the 28th ACM Symposium on Theory of Computing, 212-219.
IEA (2024). Electricity 2024: Analysis and forecast to 2026. International Energy Agency. Paris.
Jaynes ET (2003). Probability Theory: The Logic of Science. Cambridge University Press. [Vol I, Ch06, Ch13]
Kipf TN and Welling M (2017). Semi-supervised classification with graph convolutional networks. ICLR 2017. [Vol I, Ch19]
Lewis P, Perez E, Piktus A, et al. (2020). Retrieval-augmented generation for knowledge-intensive NLP tasks (RAG). NeurIPS 33. [Vol I, Ch20]
National Academies of Sciences, Engineering, and Medicine (2019). Quantum Computing: Progress and Prospects. National Academies Press.
Patterson D, Gonzalez J, Le Q, et al. (2022). The carbon footprint of machine learning training will plateau, then shrink. IEEE Computer, 55(7), 18-28.
Preskill J (2018). Quantum computing in the NISQ era and beyond. Quantum, 2, 79.
Shannon CE (1948). A mathematical theory of communication. Bell System Technical Journal, 27, 379-423. [Vol I, Ch13]
Yao S, Zhao J, Yu D, et al. (2022). ReAct: Synergizing reasoning and acting in language models. arXiv:2210.03629. [Vol I, Ch20]
Zhou S, et al. (2023). Is your LLM secretly a world model and should you treat it like one? arXiv:2305.14909.