Find observable evidence
Identify moments where the system’s organizing conditions can be inspected.
Proposed standards architecture
Cognitive Systems Observability
A framework for determining whether an adaptive cognitive system retains the ability to decide and act effectively toward its authorized goals.
CSO examines constraints, goals, orientation, relevance, concepts, coherence, and agency.
Why observability
Proposed standards architecture
See loss of effective action before it becomes visible failure.
An AI-enabled system may continue to produce plausible outputs while its goals, constraints, concepts, or sense of what matters slowly come apart. The failure may not be visible in any one response. It appears later, when the system can no longer decide and act effectively toward the purpose it was authorized to serve.
CSO makes those conditions visible early enough to matter. It examines whether the conditions required for effective, authorized action are still holding together—before a visible failure leaves fewer options to correct course.
The framework separates what can be observed from an explanation of why it happened and from any decision about what to do next.
Reference architecture
Observe whether a system can still pursue its authorized goals.
CSO examines observable evidence, structural change, the legitimacy of that change, and the reliability of the measures used to assess it.
Inspect structural change
Observe what persists, changes, or degrades across the dimensions of organization.
Evaluate legitimacy
Determine whether a change is authorized, justified, adaptive, or unresolved.
Validation and calibration
Validate the observation system itself.
Test whether the opportunities, indicators, thresholds, and governance determinations are reliable enough to use.
What CSO observes
The conditions of effective action.
Constraints, goals, orientation, relevance, concepts, and coherence are not separate features on a checklist. Together, they shape whether a system can retain the ability to decide and act effectively as its environment and knowledge evolve. CSO calls that emergent capacity agency.
Constraints
Boundaries that remain active.
Goals
Authorized direction over time.
Orientation
The integrated direction of goals and constraints.
Relevance
Attention to what materially matters.
Concepts
Definitions and distinctions that retain meaning.
Coherence
Consistency among organizing structures.
Agency
The retained ability to decide and act effectively toward authorized goals.
The aim is an earlier, more useful view of whether the system is retaining the capacity to act effectively in the future.
Standards ecosystem
Observation needs stewardship.
An observation system is only useful if people can inspect its evidence, challenge its thresholds, and decide what a signal warrants.
Observation modules
Distinct conditions
Monitor whether constraints, goals, orientation, relevance, concepts, coherence, and agency remain intact through time.
Alignment protocols
Legible determinations
Define what can be observed, whether change is legitimate, and whether measurements are calibrated and trustworthy.
Standards stewardship
Reviewable standards
Keep governance integrity, review, revision, maturity, and retirement of standards themselves subject to examination.
Position and evidence status
Current status and open work.
- Position
- Proposed standards architecture and active research line within AIDE Research.
- Current form
- Framework, reference architecture, monitoring modules, protocols, and standards stewardship.
- Open work
- Calibration, thresholds, intervention effectiveness, domain profiles, and longitudinal evaluation.
- Boundary
- CSO distinguishes signals and structural conditions; it does not itself establish causality or authorize action.