Preparation, query and validation
How IUCOM Reporter turns facts into a supported answer – and how it checks every answer against the sources themselves
Version 1.3 · 9 October 2026 · Process dossier
Summary
This dossier describes the path of a request in practical use, in three parts. Preparation: personal data are replaced by placeholders before sending and shown for confirmation; the AI turns the protected text into the search – area of law, sub-questions, provisions and separate queries per source. Query: every source is asked with its queries, the AI checks the entries for relevance, targeted additional sources are added from the facts, and the request to the AI consists of rule set, entries and facts – with the rule to cite only from the entries. Validation: after the answer the program checks every citation against the entries, looks up unsupported decisions in the official databases and verifies cited literature in the library catalogue; the result is a verification report at the end of the answer and in the archive.
Guiding principle: what is measured is not whether the AI finds the one right solution, but whether it asserts something false – checked against the official sources themselves. How answers of different origin are compared scientifically is described in the study dossier.
1The path of a request at a glance
| No. | Station | What happens |
|---|---|---|
| 1 | Input | Select text and press the shortcut (Ctrl+Alt+Shift+L) – in Word, the browser, PDF programs; or research directly in the program. |
| 2 | Placeholders | Names, addresses, numbers are replaced locally by placeholders. |
| 3 | Check before sending | The version that goes out is shown for confirmation. |
| 4 | AI preparation | Area of law, sub-questions, provisions, queries per source. |
| 5 | Own documents | Matching excerpts from the firm standard and the documents of the area of law. |
| 6 | Search | Every enabled source with its queries. |
| 7 | Relevance check | The AI removes unsuitable entries. |
| 8 | Additional sources | Statutory texts from federal law and – where relevant – from Germany. |
| 9 | Request to the AI | Rule set, entries, facts, checklist of sub-questions; optionally a style profile. |
| 10 | Validation | Citations against the entries and the official databases, literature against catalogue, ISBN and DOI; verification report. |
| 11 | Re-insertion and filing | Re-insert real data, answer document, archive. |
Everything that leaves the computer is listed in Table 1a – always with your own key or directly to the official body or the catalogue and DOI service, without a detour via deepnet. The mapping of the placeholders never leaves the computer.
| Recipient | What | When |
|---|---|---|
| Chosen AI provider | the checked placeholder version of the facts, the entries with excerpts from the local sources, the rule set and the additional rules of the area of law | with every request |
| Chosen AI provider | Style adoption (options → input/output, off by default): when a style profile is created, pseudonymised excerpts from the works in the profile folder once (at most 40,000 characters, without file names) together with locally measured figures – after the confirmation of rights and the check before sending; works classified “permission required” are not sent; afterwards only the style profile with each request, never the works and never the profile's name | when a style profile is created; the profile with every request if switched on |
| Chosen AI provider | for the source-support check (on by default) the footnoted statements and the wording of their entries, on the placeholder version; with “also official sources” (off by default) also the officially fetched wording of decisions and provisions outside the research | after the answer |
| Chosen AI provider | the own documents of the chosen area of law, the knowledge base and an attached gold standard (or the matching excerpts) – pseudonymised by default with the same placeholders as the facts (tick “also own documents” next to “Pseudonymise client data”); as these texts do not appear in the check before sending, uncertain person finds are replaced there too; author names are replaced too, what must never be replaced goes on the “never anonymise” list. With the option off they go out verbatim. Documents that the licence check classifies as “permission required” when they are added do not go out – unless a licence or permission of the rights holder was confirmed at import (2.4) | if documents are stored |
| Legal sources (RIS, Findok, Parliament, EUR-Lex/Cellar, literature services, NeuRIS) | search terms the AI forms from the placeholder version; provisions and case numbers to look up | with every request |
| Official look-up (RIS, Findok, NeuRIS, Cellar) | case numbers and provisions cited in the AI's answer; with “also official sources” in addition the retrieval of the wording of officially confirmed decisions (RIS) and provisions (federal law) for the source-support check | after the answer |
| German National Library (catalogue, SRU) | for the literature check only literature details from the AI's answer – author or editor, title, year, ISBN; at most 8 works per answer, no client data | after the answer (literature check, on by default) |
| doi.org | only the DOI from the AI's answer (registered yes/no) | after the answer, if a DOI is cited |
| Crossref | for the literature check – in addition to the search terms of the research – title and author of cited articles from the answer | after the answer, if an article is cited |
| Web search via the AI provider | search queries formulated by the AI; executed by the provider (Claude only), restricted to official domains, at most 5 | only if switched on – off by default |
| Source check | retrieval of the index of local sources and of new versions – without any case data | periodically |
2Part I – Preparation: protecting data before sending
2.1Placeholders in four layers
Before anything leaves the computer, the program replaces personal and identifying data with placeholders such as [PERSON_1], [FIRMA_2] or [IBAN_1]. The replacement is reversible: the mapping stays local and is never sent.
| Layer | Method | Detects |
|---|---|---|
| 1 Rules | fixed patterns with check digits and context words | addresses (also postcode + town), e-mail, phone, IBAN (only with ISO 13616 check digit or keyword), cards (Luhn), social insurance, tax and ID numbers, company register number, VAT ID, plates, IP, birth dates; companies by legal form (GmbH, AG, LLC, S.A. …), law firms (“X & Partner attorneys”) |
| 2 Name recognition | local language model (XLM-RoBERTa NER, ONNX, int8) in the semantik.exe service – offline | persons, organisations, places in running text |
| 3 Dictionary | fallback without model: capitalised words unknown to the German and English dictionary | suspected cases – marked yellow |
| 4 Lists | own lists “always replace” and “never replace” | client names, technical terms that are not names |
Not replaced are citations of provisions (§ 1295 Abs 1 ABGB), amounts, years after “since”, “until” or month names, and job titles – otherwise the facts would lose their legal content.
2.2Check before sending
If anything was replaced or suspected – or “always show the check” is switched on –, the program shows the version that goes out: in a separate Word instance (if LibreOffice is set or Word is missing, in the program window) with the placeholders in red, beside it a table with tick, item in the text, placeholder sent, type and how it was detected. Uncertain items are yellow at the top (“unchanged – please check”). Further names can be added in one line. Nothing is sent before “Send”; “Cancel” ends the request without anything going out. Cautious users switch on “always show the check” in the options: then every version appears before sending, even if nothing was recognised, and missed names can still be replaced.
2.3AI preparation: the facts become the search
The chosen AI reads the checked placeholder version and returns in fixed lines what the search needs. It also decides which source is asked at all: without a tax link the Findok stays off, without an EU-law link EUR-Lex.
| Line | Content |
|---|---|
GEBIET | area of law (pointer to the rules and documents of the area) |
RIS | 3–5 queries to the RIS, narrow → broad; plus GERICHTE (competent collections: VwGH, VfGH, Justiz, BVwG …) |
NORMEN AT | the relevant provisions (§ 2 EStG 1988, Art 15 DBA …) – for the wording from federal law |
BUNDESLAND | for provincial law the province and its provisions |
FINDOK | queries to BFG and BMF – only for tax law |
PARLAMENT | names of acts and amendments for the materials |
EU | queries to EUR-Lex/CJEU – only for EU law |
NORMEN DE / GERICHTE DE | German provisions and federal courts (BGH, BAG …) where Germany is involved |
LIT | literature queries in German and English |
EGMR | English queries, only if the ECHR is involved |
The instruction to the AI is written with real umlauts – with ASCII examples the AI wrote “ae/ss” and the RIS found nothing. Very short inputs (under five words) are expressly expanded. If the AI returns nothing – no key, empty answer, wrong form –, the search falls back to the words of the text, and a diagnosis reports the reason; it also checks whether the RIS is reachable and whether filters or too many words emptied the search.
2.4Area of law, rules and own documents
One or more areas of law can be chosen; their additional rules and documents go along, the choice itself only as a pointer – the facts are decisive. Own documents (firm standard, leaflets) are searched in two ways: by wording (BM25) and by meaning – a small language model (multilingual-e5-small) runs locally; the mix is 60 % wording, 40 % meaning. Observed on one real document (small sample): paraphrased questions found the passage in 3 of 5 instead of 1 of 5 cases. Only the matching excerpt with its heading goes along. The documents of a chosen area of law go along in full as long as together they do not exceed 24,000 characters; otherwise they are split into sections of about 1,500 characters and those best matching the facts go along (rare terms count more), in document order. Previously they were cut off in sequence – what stood at the back of a large document never arrived. Tested with test documents: the key passage at the end of a large first document, in the second and in the short third document went along each time (4 of 4 cases).
Rights before every import. Before documents are added – documents, gold standard and the works of a style profile when it is created –, the window “Confirm the rights to the documents” appears: the list of files with a traffic light per file from the local licence check running in the background (one reading, not legal advice), and the mandatory tick “I confirm that all rights to these documents have been cleared beforehand and that I am liable for their use myself”. For documents marked red – classification “permission required”, e.g. publishers' works, journal articles or excerpts from licensed databases – there is an additional tick “a licence or permission of the rights holder exists”; without it they are added but not sent to the AI, not even as gold standard or into a style profile. Every confirmation is recorded with time, Windows user, purpose, file names and classification in the program folder under Protokoll\rechtebestaetigungen.log; there is no second question when the files are read in. The manufacturer accepts no liability for the rights to imported texts (licence agreement 1.2, clause 4.4).
3Part II – Query: sources, relevance and request
3.1The sources and when they are asked
| Source | What | When |
|---|---|---|
| RIS Rechtsprechung | OGH, VwGH, VfGH, BVwG, LVwG, legal principles | always |
| RIS Bundes- und Landesrecht | text of the named and cited provisions | always |
| Findok | BFG and BMF – only for tax law | tax link |
| Parliament | legislative materials | if requested |
| Germany | NeuRIS, gesetze-im-internet.de, Open Legal Data, GovData | German link |
| Literature | OpenAlex, Crossref, DOAJ (German and English) | always |
| EUR-Lex, EuGH, EGMR | Cellar/SPARQL; ECtHR as citation only | EU law, ECHR |
| entscheidsuche.ch | Swiss case law | Swiss link |
Each source returns three times what goes out; what counts is how well an entry fits the text – a match in the provisions or the case number counts double, the same work from several services once. The RIS is queried with throttling (at most 0.5 requests per second, no parallel connections) – this applies to every RIS call, including the case-law search per court; the other sources run alongside at the same time. A short network outage is retried once after 1.5 s, but not after “Cancel”.
3.2Relevance check by the AI
Before the statutory texts are added, the AI checks every entry against the facts and discards what does not fit; chapter 1 of the report names what was discarded. This happens before the statute search so that the provisions of discarded entries are not added at all – in a medical liability case, for instance, no asylum provisions entered the request any more.
3.3The request to the AI
The request consists of the rule set (expert-opinion style, interpretation by rank and method, scope as chosen), the additional rules of the chosen areas of law, own documents, the block of entries and the facts, plus a checklist of sub-questions. Every entry stands in the block with origin, court or publisher, number, date, link and licence notice – with the rule to cite only from it; literature is an aid to interpretation and is cited with author, year and DOI only if it is among the entries. The last rule requires a plausibility test of every word, also in the facts: what is unclear is reported rather than guessed.
Style adoption (options → input/output tab, off by default): with the tick “Write the answer in the style of a style profile” the AI writes in the style of a particular person. The button “Style profiles …” opens a window with the profiles per person – one folder Stil\<name> each in the program folder – and the steps create, open folder, create style profile, use for answers and switch off. To create a profile the program selects excerpts from the works locally (beginning, end and evenly spread paragraphs; at most 40,000 characters, 2,500 to 12,000 per work, at most 40 works, without file names) and measures figures locally: sentence length, nominal style, passive voice, perspective, connectives, spellings such as zB, iSd and Rz, quotation marks, structure. Then follow the confirmation of rights (2.4), pseudonymisation as for the documents and – always – the check before sending; then it goes once to the AI provider set. The provider writes a style profile in its own words – tone, sentence structure, choice of words, structure, argument, citation style, what the person avoids, plus a writing instruction –, without names, without words or phrases from the samples verbatim, at most 900 words; the costs appear in the cost book under “Stilprofil”. Afterwards only the profile goes along with each request, never the works and never the profile's name. Content, binding to the sources, citation and checking rules and the prescribed form take precedence; in correction mode the profile does not apply. Only own works or works whose author has consented may be used.
| Item | Implementation |
|---|---|
| Providers | Claude, ChatGPT, Mistral, Ollama locally; Claude via Amazon Bedrock and ChatGPT via Azure OpenAI with processing in the EU – the key stays on the computer, encrypted with Windows data protection (DPAPI) |
| Prompt caching | rule set always marked; the request only when repeated within an hour, in study mode and for continuations – a single new question stays unmarked |
| Reasoning models | additional budget for reasoning so the answer does not come back empty; standard and highest care with the model's full depth of reasoning; only the expressly chosen draft reasons shorter (medium); short auxiliary calls little |
| Word and sense check | with the main model; optionally via the fast Haiku model of the same provider (off by default); a proof-reading is only accepted if placeholders, numbers and sections remain unchanged |
| Continuation | if the answer stops at the length limit it is continued seamlessly up to six times |
| Context window | if the request does not fit the window of a smaller model (Claude Haiku 4.5: 200,000 tokens, Mistral: 128,000), lower-priority parts are left out first; the program reports this in the report on the answer |
| Progress bar | every step with AI and model; “Cancel” ends the request at once, the cancellation is logged; optionally a checklist of all steps with status and duration, switchable during the request; during the assessment synthesis the progress window shows no help pop-ups |
| Backup and costs | every answer saved at once; every call with costs by tariff in the cost book |
4Part III – Validation: checking against the sources
4.1The yardstick
AI answers in law rarely fail because they miss the one right solution – often several are tenable. The danger is that they assert something false: a decision that does not exist; a real case number with a wrong date; an entry that does not support the statement; a provision from the wrong legal order or in the wrong version; a fact that is not in the facts. All of this can be checked against the sources themselves – without a model solution.
4.2The checking rules in the program
| Rule | What is checked | Status in the report |
|---|---|---|
| Citation against the entries | case numbers, legal principle numbers and sections in the answer are matched with the entries and the input text | supported (research / your text) |
| Official look-up | unsupported decisions are looked up: RIS (VwGH, VfGH, OGH, BVwG, LVwG, legal principles), Findok, NeuRIS (German federal courts), Cellar (CJEU) – at most 8 per answer; beyond that “not looked up (at most 8 …)” in the report | officially confirmed · DATE DIFFERS · NOT SUPPORTED (not found officially) · not checkable · not looked up |
| Provisions | cited sections against entries and text; without an entry: do the section and the cited paragraph exist in federal law in force (RIS)? – at most 6 per answer; with an entry: the cited paragraph against the supplied wording | supported · no entry – exists in the RIS · DOES NOT EXIST · PARAGRAPH DOES NOT EXIST · not looked up (maximum) |
| Source support | does the cited entry support the statement? Every footnoted statement is held against the wording of its entry from the research (legal principle, statutory text, paragraph, guidance page) – by the main model, on the placeholder version, at most 25 statements; the answer itself stays unchanged. Additional switch “also official sources” (off by default): citations not from the research but confirmed officially (decisions in the RIS, provisions in federal law) are fetched verbatim and also held against the statement – additional RIS calls, throttled | supported · only partly supported · STATEMENT NOT SUPPORTED (with reason) · not assessable |
| Unsupported items in detail (since 10 Oct 2026, always on) | for every decision, provision and literature reference that cannot be verified or was added by the AI, a paragraph of its own below the check list: what is missing, which statement of the answer it is meant to support, whether that statement is thereby unsupported (or still supported in the same footnote), and where to search for the source – per court and legal source the database and search field | “No starting point” if the item is so incomplete or contradictory that no search can be set up (file number in no court's format, literature without author and work) – the statement then needs a new source |
| Literature from the sources (since 10 Oct 2026, always on) | does every literature reference come from what the AI had? Footnotes AND running text are checked – commentary with margin number by author, section and margin number (also in the courts' style, e.g. “Tz” instead of “Rz”), article by author, year and page – against all sources including full texts of decisions, your text and your documents | supported – named in the sources – content of the work not checked (green) · named in a source, but without “cited in …” (orange, if the source is a decision) · supported – from your text or from your documents (green) · NOT AMONG THE SOURCES – added by the AI (orange, marked red in the answer document; followed by the result of catalogue and register – a red catalogue finding stays red) |
| Literature check (on by default) | does the cited work exist? Books and commentaries in the catalogue of the German National Library (SRU, metadata CC0: author or editor, title, year); ISBN by check digit (ISBN-10/13) and comparison with the DNB whether it belongs to the cited work; DOI via doi.org (registered?); articles via Crossref (title and author) – with caution, many Austrian journals are not listed there. At most 8 works per answer in the catalogue (per work, not per passage); only literature details from the answer go out (author, title, year, ISBN, DOI), no client data. The content of commentaries is never read – the paragraph stays behind the paywall | supported – from the research (literature) · work exists – passage (para./page) not checkable (grey) · WORK NOT FOUND IN THE CATALOGUE – please check (red, only if neither work nor author is in the catalogue) · ISBN INVALID (red) · ISBN DOES NOT MATCH THE CITED WORK (red) · not unambiguously checkable (orange) – for references not among the sources, after “NOT AMONG THE SOURCES – added by the AI” |
Not supported is not the same as invented: only what demonstrably does not exist counts as invented. An assessment without supported entries carries a notice at the top; the source chapter and the attribution of all sources used are appended by the program itself, not by the AI.
Since 7 October 2026 literature appears per work in the verification report, since 10 October 2026 also from the running text; the summary names it in one sentence: “Literature: N references – x from the sources or your documents, y NOT AMONG THE SOURCES (added by the AI), of which z not found in the catalogue or faulty.” A reference that is in none of the sources provided comes from the AI's training knowledge – this is exactly where invented works and misattributed margin numbers arise; it is therefore reported even if the work exists. Whether the paragraph or page supports the statement remains open – the content of commentaries is never read.
The existence check of provisions queries the version in force: a provision that applied in the assessment period and has since been repealed appears as “does not exist”, as does a section of a foreign legal order with the same abbreviation (e.g. § 32d EStG of German law) – the status therefore asks expressly whether another law is meant. Laws outside Austrian federal law (treaties, EU law) are not checked by this rule.
4.3The verification report
The result is available three times: at the end of the answer document (Word or LibreOffice Writer) as the table “Verification report of the sources” with no., citation, footnote with page, status in its colour and the full source with link; in the archive as chapter 6; and as a separate part “Verification report” in the archive window (HTML, Word, PDF). Citations without support are red in the answer text. The AI's footnotes become real footnotes on the page where they are referenced; no paragraph is split across a page break.
4.4Checked where everyone has the same basis
Case law and statutes are the common foundation on which every citation must ultimately rest – there the Reporter is fully connected (RIS, the German federal courts and statutes, EUR-Lex, CJEU and ECtHR). For legal literature the gap remains that everyone has: commentaries, handbooks and articles sit in publishers' databases. The Reporter names this openly instead of hiding it, and narrows it: the literature check verifies whether the cited work exists; whether the paragraph supports the statement is left to your review.
4.5Limits and work in progress
Further checking rules are planned and will only be described once they are in the program: the version of a provision in the assessment period, format checks of case numbers per court, detection of foreign legal orders and a module for appeals with deadlines computed in code. A benchmark from published decisions is not used as the yardstick – it would come from the same world of sources as the research and would not be independent. Whether an answer is complete and professionally good, the sources alone do not show; for that there is the study mode with the gold standard as an optional scientific add-on – described in the study dossier.
5Re-insertion, answer document and archive
The answer comes back with placeholders. Word or LibreOffice Writer – depending on the setting – shows it with the real data, marked green; “insert real data” or “keep placeholders” is your decision. The answer document is filed unchanged in the archive and used for Word, LibreOffice and PDF; only the HTML view reassembles everything. Every query stays in the archive – grouped by day, with full-text search – as AI assessment, research and log, verification report or all together; the placeholder mapping is stored only locally and readable only by the own user.
