Buckets:
195 kB
8 files
Updated 8 days ago
Ctrl+K
| Name | Size | Uploaded | Xet hash |
|---|---|---|---|
| MANIFEST.json | 1.09 kB xet | 8fde109d | |
| README.md | 2.72 kB xet | d1d46ad9 | |
| arena_kernel.js | 1.19 kB xet | f9d7a2dc | |
| benchmark_suite.json | 178 kB xet | e9dad580 | |
| evaluator.py | 3.94 kB xet | f72f94b3 | |
| prm_verifier.py | 5.41 kB xet | 59b4ba08 | |
| quickstart.ipynb | 1.72 kB xet | 9cdacc7a | |
| synthetic_cot_generator.py | 1.8 kB xet | 75d85aae |
Quantitative LLM Reasoning Vault
📌 Overview
This vault contains the production-grade research codebase, evaluation harnesses, synthetic CoT generation pipelines, and cryptographic manifests for Process Reward Supervision and Quantitative Reasoning LLM Benchmarking.
📁 Manifest & File Structure
| File | Type | Purpose |
|---|---|---|
evaluator.py |
Python CLI & Library | Benchmarking suite scoring reasoning chains against ground truth |
prm_verifier.py |
Python Class | Process Reward Model step scoring & fallacy pinpointer |
synthetic_cot_generator.py |
Python Script | Procedural generator of multi-step stochastic calculus derivations |
benchmark_suite.json |
Dataset JSON | High-density benchmark test split with ground truth CoTs |
arena_kernel.js |
JavaScript Kernel | In-browser & Node.js verification engine for step evaluation |
quickstart.ipynb |
Jupyter Notebook | Interactive tutorial demonstrating PRM step scoring |
MANIFEST.json |
Cryptographic Ledger | SHA256 hashes and byte lengths for all vault assets |
README.md |
Markdown Documentation | Reproduction instructions and architectural specification |
🚀 Quick Execution
# Run benchmark evaluation
python evaluator.py --benchmarks benchmark_suite.json --samples 25
# Generate synthetic CoT traces
python synthetic_cot_generator.py
🔗 Integrated Ecosystem
- Interactive Arena: At1uri/fin-reasoning-arena
- Process Reward Model: At1uri/financial-reasoning-process-reward-model
- Benchmark Dataset: At1uri/quantitative-reasoning-cot-benchmarks
- Flagship Collection: Institutional Quantitative AI Suite
- Total size
- 195 kB
- Files
- 8
- Last updated
- Nov 14
- Pre-warmed CDN
- US EU US EU