Compare
The comparison nobody in this category writes.
Every ranking of backtesting tools we could find was written by one of the tools, with itself in first place, against criteria it never published. So here are the criteria first, then the comparisons — including the row where we lose.
What gets checked, and why
Eight questions, asked of every product the same way. Each one is a checkable property of a system rather than a judgement about quality, because a rubric made of judgements is just an opinion with a table around it.
Out-of-sample data held back by the system
Validation the user has to remember to run is validation that gets skipped exactly when a result already looks good.
Counts the strategy variants tried
The number of attempts behind a result is the single largest input to whether it is real. It can only be reported by a system that kept them.
Reports selection-corrected performance
A deflated Sharpe ratio, or equivalent. Without it, a raw figure is presented as a measurement when it is the winner of a search.
Reports probability of backtest overfitting
PBO is a property of the whole search rather than of one strategy, so reporting it requires the trials matrix to exist.
Walk-forward analysis by default
Offered as an option is not the same as applied to everything. The distinction only matters when you would rather not run it.
Cost model enforced, not user-set
A slippage assumption you can lower until the strategy passes is a preference, not an assumption.
Grading separated from proposing
An optimizer told to maximize a backtest result will maximize the backtest result. Whether the grader shares that objective is architecture, and architecture is checkable.
Available to use today
Included because it is where Lagias currently loses, and a rubric that omits the author’s weakness is not a rubric.
The roundup
Head-to-head
- Lagias vs QuantConnectQuantConnect is a full quant research platform with a mature MCP server. Lagias is a validation harness. Where they overlap, and who should use which.
- Lagias vs LuxAlgoLuxAlgo turns plain language into backtested strategies with an agent that also optimizes them. Lagias separates grading from proposing. What that changes.
What this page is not
It is not a performance comparison. Lagias is pre-launch, so nobody outside the team can check our results, and we have not run competitors against a controlled benchmark. Everything scored here is about what a system measures and reports, which is verifiable from public documentation — not about what anybody earns, which is not.
Claims about other products are read from their public pages, with the source and the date shown on each comparison. Where a page does not answer one of the eight questions, the answer is recorded as “not stated” rather than as a failure. Those are different things.