Ask about COBOL
Response
Response will appear here...
Quick Examples
93.8%
Translation Accuracy
85%
CICS/DB2 Semantics
74K
Training Examples
7B
Parameters
📊 V2 Benchmark Results March 2026
| Test | V1 | V2 | Change |
|---|---|---|---|
| Translation (Java) | 100% | 100% | ✅ |
| Translation (Python) | 100% | 87.5% | ⚠️ |
| CICS Transaction | N/A | 85.2% | 🆕 |
| DB2 Query | N/A | 69.0% | 🆕 |
| Code Explanation | 0% | 53.9% | 🚀 +53.9% |
| JCL Explanation | 57% | 67.9% | 🚀 +10.9% |
| Modernization Advice | 50% | 71.5% | 🚀 +21.5% |
| Overall Average | 70.9% | 70.0% | ~ |
V2 uses semantic similarity scoring (70%) + keyword matching (30%) for more accurate evaluation.