Product Goal
The chatbot should help learners navigate the knowledge base and should also demonstrate production AI engineering skill.
Design Principles
- Answer from indexed site content.
- Cite the source notes.
- Refuse unsupported answers.
- Show related topics.
- Log retrieval quality signals.
Architecture
Question -> Rewrite -> Hybrid retrieval -> Rerank -> Prompt -> Answer -> Citation check
Evaluation
Use a golden dataset of questions with expected source documents. Track:
- Retrieval recall
- Citation correctness
- Answer groundedness
- Refusal quality
- Cost per conversation
- Latency
Future Paid Layer
Accounts can later support saved chats, private notes, guided learning paths, and paid advisory/service workflows.