How to Check the Sources Behind an AI Answer About Aviation Rules
Check an aviation AI answer by opening the cited source, confirming the edition, separating rule from guidance and writing a reviewable source note.
About this article: This information illustrates the potential benefits of Aviation.Bot’s upcoming regulatory library and desktop/web document-review features. It is not compliance guidance, legal advice or a basis for a regulatory, certification or operational decision. Examples demonstrate the workflow; verify applicable official sources and use qualified professional judgement for actual work.
An AI answer can contain a link and still leave its central claim unsupported. The link may open the right book but the wrong clause. The passage may support a general idea but omit a condition. Or the assistant may combine guidance and an organisation's procedure into a sentence that sounds like a legal requirement.
Checking sources means testing the connection between the answer and the text. A citation is the beginning of that check, not its outcome. The method below helps turn a convenient answer into a reviewable note without asking an AI tool to decide compliance.
Workflow at a glance
Original workflow illustration. Candidate findings remain subject to qualified human review; the diagram does not establish an approval or compliance decision.
Break the answer into claims
Start with the statements that would change a decision. Highlight words such as “must,” “all,” “always” and “required.” Ask whether each statement describes a rule, guidance, an interpretation or a suggested working practice.
Suppose an answer says a reporting procedure needs a particular recipient, time limit and training action. That is at least three claims. One citation at the end does not necessarily support all three. Check them separately and leave any unresolved claim visible.
Open the actual passage
Follow the citation and locate the clause, table, note or paragraph used. Read the nearby definitions, conditions and exceptions that affect its meaning. A search-result snippet or AI-generated summary is not a substitute for opening the cited passage.
If the answer points only to a book's home page, ask for a precise reference, then verify it yourself. If no passage supports the claim, record it as unsupported. Do not repair the answer by finding a vaguely similar sentence elsewhere and assuming that was the intended source.
Identify authority and edition
Record the issuing authority, source's title, document identity, edition and retrieval date. Check whether you are reading adopted regulatory material, a proposal, guidance, a decision, an FAQ or another explanatory source. Preserve the authority's actual category label, such as EASA AMC/GM or a named FAA publication, rather than forcing every document into an EASA vocabulary. These source types should not disappear inside an undifferentiated list of links.
EASA's Easy Access Rules combine regulatory material and related EASA decisions in consolidated publications. They are useful navigation tools with online section access. The publication structure helps a reader reach source material; it does not establish applicability to a particular organisation. EASA's description of Easy Access Rules
Check the underlying publication and any later changes relevant to the decision. “Latest” in an AI answer is not a verified edition identifier. If the assistant cannot establish the version, narrow the output to the text actually inspected.
Worked example: replace a confident sentence with a source note
This example is synthetic. It describes a verification method, not a real regulatory conclusion.
Before: “The new rule means we must rewrite our reporting procedure and retrain everyone immediately.”
The sentence mixes a source change, an organisational action, a training population and a timing claim. None is safe to accept solely because an answer links to a regulatory library.
After, as a working note:
Question: could the identified source change affect procedure REP-04?
Source inspected: named amendment, exact paragraph and edition recorded
Internal material: fictional REP-04 revision 3, sections 2 and 5
Observation: the source and procedure use different interface descriptions
Unverified: applicability, approved reporting route, training consequences
Next check: responsible reviewer compares exact passages and current scope
Status: candidate impact; no rewrite, deadline or training action approved
In a real note, replace the description of the source with its actual title, identifier, link and passage. The deliberately fictional reference above avoids suggesting an invented paragraph is a real requirement. The useful change is that the note now exposes what was inspected and what remains a question.
Test whether the evidence answers your question
A correct passage can still answer a different question. Ask whether the source concerns your approval, activity, aircraft, organisation or scenario. For international work, also ask whether it concerns the state of design, registry, operation or the competent authority actually overseeing the task. A statement about one authority's approval should not become a claim of automatic acceptance elsewhere. Identify which facts are needed to establish relevance and who can confirm them. Where the answer relies on information you did not provide, flag the assumption.
Keep conflicting passages rather than selecting whichever supports the initial answer. Differences may arise from editions, source types or distinct circumstances. The responsible reviewer should resolve the conflict with a documented basis; the assistant should not hide it behind a smooth summary.
Use a repeatable prompt and a human check
A useful prompt is: “Separate direct source statements from your interpretation. For each claim, provide the exact passage, source type and edition inspected. List missing applicability facts. Do not invent references or conclude compliance.”
Then open the references. Prompt wording cannot guarantee correct retrieval or reasoning. For a consequential decision, preserve the checked note and the responsible person's conclusion through your normal review process.
Aviation.Bot’s upcoming regulatory library and desktop/web features are designed to support source verification like this. The starting libraries cover EASA, FAA, UK CAA, CAAC and Dutch IL&T across multiple document categories. The workflow lets a reviewer check each generated claim against an identified regulatory passage and the organisation’s documents, keeping unsupported statements visible. Desktop users work with selected local folders and files; browser users upload selected documents to their workspace. Available sources and editions remain visible parts of the review rather than an assumed complete collection.
The practical difference from a typical ChatGPT upload session is the aviation-specific source collection and repeatable document-review workflow: selected regulatory material sits alongside the organisation’s manuals, procedures and evidence, with references the reviewer can reopen. ChatGPT also supports file analysis; Aviation.Bot’s differentiation is how the source set and review task are organised, rather than a claim that general assistants cannot read documents.
Complex tables and forms deserve the same inspection as prose. The workflow is being developed to retain table relationships, headings, footnotes and form context, and to let the reviewer check the original page when extraction is uncertain. Reliable review depends on seeing that structure—not merely receiving a confident summary. Better accuracy, complete table fidelity and time savings require task-specific validation; they are not established by having a curated database.
For related reading, see EASA AMC and CS reference work and regulatory change-impact review. Start with one answer that matters, verify its strongest claim, and save the result as a source note.
Sign up on Aviation.Bot to stay up to date about upcoming releases.
Prepared with AI assistance and editorial checks against linked official sources. Illustrative examples do not represent authority or independent expert approval.