Tnega / Review notebook

A Review Notebook for Civil Engineers to Evaluate Frontier Models

By Saba Azadegan. Structural fundamentals for two readers: the engineer who wants them back in hand, and the evaluator who needs to know where an AI model's structural reasoning can go wrong and how to check it.

Each section has the idea in plain words, a worked example with a figure (every number computed in a script and checked two ways), a practice problem with its answer, a trap to test on AI models, and the agent check: a check a review agent runs with a tool rather than from memory.

Selected examples are tasks in the expert eval harness, with numerical checks, a rubric and the expert's notes. The traps are hypotheses until they are run on Claude and Gemini models; results will be added with the model version and date.

1. Load path and static equilibrium

Written: 31 sections, 34 figures, 8 harness tasks

2. Loads and load combinations

Written: 28 sections, 28 figures, 8 harness tasks

3. Structural analysis

Written: 23 sections, 23 figures, 8 harness tasks

4. Section behaviour

Planned

5. Reinforced concrete design

Planned

6. Stability

Planned

7. Dynamics and seismic

Planned

8. Foundations

Planned

9. Steel basics

Planned