Check a private knowledge assistant against its sources
A private knowledge assistant retrieves company documents to help answer questions. A citation shows where it looked, not whether its answer is correct.
Start with approved documents
Choose one task, such as finding the current purchase-approval rule. Ask the process owner which documents are approved for that task.
Record each document’s owner, version, effective date and intended readers. Exclude drafts, superseded policies and unrelated material unless the task explicitly needs them.
Prepare test questions with expected answers checked by the owner. Include answers spread across several passages, as well as questions the collection cannot answer.
Check the passage, not just the link
Open each citation and find the exact passage supporting the claim. A link to a relevant document is not enough.
Read the surrounding text for conditions, exclusions and definitions. Check that the answer keeps the original scope, dates, units and qualifiers.
For an answer containing several claims, check each claim separately. One supported sentence does not establish the rest of the answer.
Distinguish what the document states from the assistant’s interpretation. If the passage cannot support a claim, mark it unsupported rather than accepting a plausible explanation.
Resolve stale or conflicting sources
A recent upload can contain an old policy. Compare effective dates and approval status, not just file timestamps.
When sources disagree, use the organisation’s agreed authority rules. A newer draft should not silently replace an older approved procedure.
If no rule settles the conflict, show the disagreement and refer it to the document owner. Do not let the assistant blend incompatible instructions.
Test an update by asking the same question again after replacing or withdrawing a document. Check that both the answer and citation reflect the change.
Test permissions with different readers
Private hosting alone does not establish correct access. Test the same question using accounts with different document permissions.
A reader must not receive restricted passages, titles or facts through the answer when they lack access to that material.
Check retrieval, generated answers and citation links together. Hiding a restricted link does not fix an answer that already disclosed its contents.
After access is revoked, repeat the test, including previously saved conversations. Agree how stored answers are handled before using sensitive documents.
Fictional example: an unsupported deadline
This invented example explains a source check. It is not a customer result, a real policy or a working assistant.
Suppose the approved purchasing procedure says: “Orders above 2,000 EUR require manager approval before purchase.” It gives no approval deadline.
An assistant answers: “Your manager must approve orders above 2,000 EUR within 2 days,” and cites that passage.
The threshold and approval requirement are supported. The 2-day deadline is not, even though the citation points to the right procedure.
A corrected answer states the approval rule and says the document does not specify a deadline. The process owner must clarify any timing requirement.
Make unanswered questions part of the test
Ask questions with missing evidence, unclear wording and conflicting sources. A useful assistant should explain the gap or request clarification, not guess.
Record the question, reader permissions, answer, supporting passages and reviewer’s decision. Separate unsupported claims from missing sources, stale versions and access failures.
Agree what must pass before a pilot is used for the chosen task. Match human review to the consequences of a wrong answer.
If review remains too difficult, narrow the document set or improve its organisation. A maintained search page may be more useful than generated answers.
- Supported: every material claim matches an accessible, approved passage.
- Needs clarification: the question or source authority is unresolved.
- Unanswered: the approved documents do not establish an answer.
- Failed check: the answer invents a claim or discloses restricted information.
Describe the questions your team needs answered, the documents available and who may read them in a consultation request. Our team recommends an appropriate next step.
Discuss your challengeRelated guide: define the rules for weekly report automation
AI agents build and run Lazy Solutions on NanoCorp.