Agentic Ontology Workbench Azure Cosmos DB · Aldervane Mutual

Workload: HIS-01 Turns: 0 / 16 Reasoner: gpt-5.4-nano Factual Equivalence: 3,880 Facts (100%)
Theorem Tested: Factual equivalence does not imply operational equivalence for a bounded reasoner.
Both graphs provably encode the identical 3,880 facts verified against Azure Cosmos DB.
Naive Schema (224 Vertices · Foreign Keys & JSON Blobs)
Entities Trapped in Properties
Designed Workload-First (886 Vertices · Verb-Phrase Edges)
P1–P7 Walkable Architecture
Azure Cosmos DB Gremlin & Agent Tool Stream Idle (Ready to Step)
Click [Run Agent Traversal] to dispatch tool calls (find_nodes, get_node, traverse, describe_edges). Execution receipts from live Azure Cosmos DB Gremlin API will stream here turn by turn...

Operational Outcome Receipt

Scenario Question:
What was the status of Claim C-31049 on April 15, 2024?
Naive Graph Result
Pending execution
Turns: -
Designed Graph Result
Pending execution
Turns: -
Status: Ready for Benchmark Execution

When the P4 decoy property is active on the Designed graph, gpt-5.4-nano inspects the Claim vertex and reads the convenience property immediately, falling into the 0.000 accuracy inversion trap.

The Playbook: Seven Principles Measured in Azure Field Empirical Receipts

P1. Start from Questions

Workload competency questions dictate vocabulary and addressability before schema modeling.

Receipt: Prevents 28 false refusals
P2. If Named, It’s a Vertex

Entities sealed in JSON blobs are unrecognizable to bounded models.

Receipt: Exclusions jump 0.500 → 0.889
P3. Names Are the API

Verb-phrase edges (claims_under, shuts_out) act as tool function signatures.

Receipt: Renaming cost 0.108 accuracy
P4. Beware Convenience Decoys

Derived convenience properties on vertices lure agents away from reified timelines.

Receipt: Cost 100% of History band (0.000 vs 0.667)
P5. Metadata That Earns Its Place

Temporal validity, closed enums, and provenance documents make answers verifiable.

Receipt: Provenance accuracy 1.000 vs 0.750
P6. Geometry as Precision Tool

Derived shortcuts (paid_under) compress paths specifically where the workload walks.

Receipt: Target question 1.000 vs 0.667
P7. Model Absence & Refusal

Explicit negative knowledge paths allow clean NOT_MODELED discovery.

Receipt: Perfect 1.000 refusal contract

Understanding Graph Traversal Ontologies for Tool-Calling Agents

How does reifying temporal events into vertices change an agent's step-by-step graph traversal compared to storing flat convenience properties?

Property graphs represent entities as vertices and connections as directed edges with associated key/value properties. In agentic tool execution, an autonomous agent interacts with graph databases through discrete API calls such as node lookups and edge traversals. When an ontology collapses temporal history into a single snapshot property (like `current_status: "denied"`), a bounded agent reading the initial vertex card may halt prematurely rather than traversing reified event nodes, missing historical states that were valid on an earlier query date.

The workbench runs a scripted front-end JavaScript simulation where Gremlin traversals, turn counters, and model actions are deterministic pedagogical fixtures. The presented benchmark numbers (such as 3,880 facts, accuracy scores, and token costs) illustrate conceptual trade-offs rather than live production runs against an active Azure Cosmos DB Gremlin service.

Try a worked example

To observe this behavior, leave scenario HIS-01 selected and the decoy checkbox marked, then click 'Run Agent Traversal'. Notice that the agent inspects the Claim vertex on Turn 2, finds current_status ('denied'), and terminates with the failed status 'denied (FAILED DECOY)'. Next, uncheck 'Shadowing Decoy', click 'Run Agent Traversal' again, and observe that the agent instead calls describe_edges and traverses has_status_event across dated vertices (2024-03-02, 2024-04-10, 2024-07-22), determining that the ground truth on April 15, 2024 was 'in_review'.

Property Graphs and Step-by-Step Traversal Semantics

In property graph models such as Apache TinkerPop, a graph consists of vertices, directed edges, and properties. Graph processes are structured as traversals that step along explicit referential links between vertices and edges. Apache TinkerPop Gremlin Reference Documentation

Steps such as g.V().hasLabel(), out(), and outE() allow traversers to navigate adjacent elements or inspect value maps. In tool-calling architectures, language models issue these individual query steps sequentially to assemble context. Apache TinkerPop Gremlin Reference Documentation

Reification vs Convenience Properties in Ontology Design

When mutable states are collapsed into vertex properties, historical transitions are lost unless modeled explicitly. By reifying state changes into distinct event vertices linked via date-bearing edges, queries requiring historical validity can be evaluated systematically over an ordered timeline. Apache TinkerPop Gremlin Reference Documentation

Adding shortcut convenience properties to a root node can improve single-turn read performance for current states, but introduces an ambiguity trap if agents prioritize immediate vertex attributes over multi-hop relational walks.

Sources and further reading

Authored ontology fixtures do not establish benchmark evidence

Read the explanation

The history fixture contains three dated events: March second submitted, April tenth in review and July twenty second denied. For April fifteenth the latest prior event is April tenth, so the authored result is in review. A convenience property carrying current denied status cannot answer that historical question. This page writes those answers into a simulated log; it never queries a real graph database or invokes the selected model. In the history scenario, selecting the nano label with decoy active chooses three timer ticks; otherwise five. The logs announce premature exit at turn two or the correct historical answer at turn four. Those displayed reasoning turns differ from the timer tick count. The model dropdown is a branch selector, not an API call, and the maximum-turn field is a display value rather than the timer stopping condition. The export declares two hundred twenty four naive nodes and eight hundred eighty six designed nodes, with fixed edge counts and three thousand eight hundred eighty total facts. Lossless equivalence verified is always true in the export. The small visual example has only eight designed nodes and nine edges; it is not the claimed full benchmark. Accuracy labels, environment names and pass messages are authored fixtures, not independent receipts. No provider or remote database was used or tested here.

Super generates helpful tools and automates fact-checking across the internet proactively. If you enjoyed this tool, build your own with Super and share it with a friend.