WHAT NEW IN X11.08 SUN

X 上的 AI 合集档案 · 25 个合集 · 73,815 条

gpt-6POST

Aria 回应 GPT-6 Astra 路由是否真货:21 条线路实测

Aria 自测 21 条线路,称其 Astra 路由在 12 项客观任务上与 OpenRouter 官方线路同分,成本低约七成,但承认便宜线路存在差异。

Aria
@Entelic_Aria2026.09.27收录原推发布于 2026.09.27
Aria @Entelic_Aria原推发布于 2026.09.27
在 X 上打开原推

We've seen the community's questions about whether Aria delivers the models it advertises. Here's our direct response. Aria offers these routes as GPT-6 Astra, Claude Fable 5.1 and Claude Opus 5.5, not as substitutes for older models. We are responsible for verifying that those labels accurately reflect what users receive. We tested all 21 available Aria routes for these models alongside OpenRouter references pinned to OpenAI and Anthropic. We then expanded the comparison with objective tasks at Low and High reasoning. The objective suite covered mathematics, Python code semantics, shortest-path reasoning, structured data processing, long-context retrieval and optimization. With the same 12 tasks and matched output limits: • OpenRouter's OpenAI-pinned Astra: 12/12 at Low, 12/12 at High. • Aria 0.44x: 12/12 at Low, 12/12 at High. • Aria 0.22x: 12/12 at Low, 12/12 at High. • Aria's cheapest tested route: 12/12 at Low, with all 11 completed High answers correct and one request incomplete. Some requests required retries. These are completed-answer scores, not a claim of identical reliability across routes. For the 0.22x route, those completed answers cost: • Low: $0.07164 on Aria vs $0.24763 on OpenRouter. • High: $0.09796 on Aria vs $0.31348 on OpenRouter. The same task scores, at approximately 69–71% lower cost. We also found differences on some cheaper routes, including at Low reasoning. We're investigating the routing and reasoning configuration behind those differences. We haven't established the cause, and we won't describe High as a universal fix: both 0.22x and 0.44x already scored full marks at Low. On the specific cutoff allegation: with OpenRouter pinned to OpenAI and reasoning set to High, Astra answered "June 2024" in two of three responses. The third gave no precise date. That disputed answer isn't unique to Aria and cannot, by itself, prove model substitution. Matching task scores don't independently certify model identity either. Our investigation needs to address both performance and the routing evidence behind the model labels. The report includes exact prompts, settings, answers, scoring methods and 90 OpenRouter generation receipts: https://entelic.io/reports/model-comparison/ TL;DR: Aria's 0.22x route matched the official-provider reference score on our tests for about 70% less. The "old date = fake model" claim isn't proof. The results are public, and we're checking the remaining route differences. You deserve the model you pay for. You deserve the model you selected. We stand behind that standard, and any route we cannot verify should not carry that label.

x.com/entelic_aria/status/2103904103705559401采集于 2026.09.27 10:08