What this category covers
Research controls for testing strategies without contaminating results through leakage, overfitting or unrealistic execution assumptions. Each concept page explains the quantitative meaning, how the idea is used in portfolio or market analysis, the relevant formula or analytical framework, variables, a compact example and the main limitations to keep in view.
Core concepts
Quick entry pointsAll Backtesting, Validation & Research Design concepts
104 entriesAnchored Walk-Forward
Anchored Walk-Forward is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceAs-Reported Data
As-Reported Data is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceBacktest Benchmark
Backtest Benchmark is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinanceBacktest Confidence Interval
Backtest Confidence Interval is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinanceBacktest Error Bars
Backtest Error Bars is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinanceBacktest Leakage
Backtest Leakage is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinanceBacktest Overfitting
Backtest Overfitting is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinanceBid-Ask Spread Modeling
Bid-Ask Spread Modeling is a quantitative model or framework used in backtesting, validation & research design to convert assumptions and observed market information into a structured estimate, state or decision rule. Its value comes from making the relationships explicit enough to calibrate, test and compare rather than relying on intuition alone.
Quantitative FinanceBlocked Cross-Validation
Blocked Cross-Validation is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceBootstrap Backtest
Bootstrap Backtest is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinanceBorrow Cost Modeling
Borrow Cost Modeling is a quantitative model or framework used in backtesting, validation & research design to convert assumptions and observed market information into a structured estimate, state or decision rule. Its value comes from making the relationships explicit enough to calibrate, test and compare rather than relying on intuition alone.
Quantitative FinanceCapacity Modeling
Capacity Modeling is a quantitative model or framework used in backtesting, validation & research design to convert assumptions and observed market information into a structured estimate, state or decision rule. Its value comes from making the relationships explicit enough to calibrate, test and compare rather than relying on intuition alone.
Quantitative FinanceCapacity-Adjusted Performance
Capacity-Adjusted Performance is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceChampion-Challenger Validation
Champion-Challenger Validation is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceCombinatorial Purged Cross-Validation
Combinatorial Purged Cross-Validation is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceCorporate Action Bias
Corporate Action Bias is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceCost-Adjusted Performance
Cost-Adjusted Performance is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceCurve Fitting
Curve Fitting is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceData Snooping
Data Snooping is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceDeflated Sharpe Ratio
Deflated Sharpe Ratio is a quantitative measure used to summarize a specific property of returns, risk, dependence or model performance. Its interpretation depends on the sampling window, benchmark, frequency and assumptions used to construct it.
Quantitative FinanceDelisting Bias
Delisting Bias is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceEconomic Significance
Economic Significance is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceEmbargoed Cross-Validation
Embargoed Cross-Validation is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceEvent-Driven Backtest
Event-Driven Backtest is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinanceExecution Delay
Execution Delay is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceExpanding Window Backtest
Expanding Window Backtest is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinanceFalse Strategy Discovery
False Strategy Discovery is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceFeature Leakage
Feature Leakage is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceFinancing Cost Modeling
Financing Cost Modeling is a quantitative model or framework used in backtesting, validation & research design to convert assumptions and observed market information into a structured estimate, state or decision rule. Its value comes from making the relationships explicit enough to calibrate, test and compare rather than relying on intuition alone.
Quantitative FinanceForward-Chaining Validation
Forward-Chaining Validation is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceFuture Information Leakage
Future Information Leakage is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceHaircut Sharpe Ratio
Haircut Sharpe Ratio is a quantitative measure used to summarize a specific property of returns, risk, dependence or model performance. Its interpretation depends on the sampling window, benchmark, frequency and assumptions used to construct it.
Quantitative FinanceHistorical Backtest
Historical Backtest is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinanceHoldout Sample
Holdout Sample is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceHyperparameter Stability
Hyperparameter Stability is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceIn-Sample Period
In-Sample Period is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceIndependent Model Validation
Independent Model Validation is a quantitative model or framework used in backtesting, validation & research design to convert assumptions and observed market information into a structured estimate, state or decision rule. Its value comes from making the relationships explicit enough to calibrate, test and compare rather than relying on intuition alone.
Quantitative FinanceLatency Assumption
Latency Assumption is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceLimit Order Fill Model
Limit Order Fill Model is a quantitative model or framework used in backtesting, validation & research design to convert assumptions and observed market information into a structured estimate, state or decision rule. Its value comes from making the relationships explicit enough to calibrate, test and compare rather than relying on intuition alone.
Quantitative FinanceLiquidity Constraint Backtest
Liquidity Constraint Backtest is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinanceLive-to-Backtest Degradation
Live-to-Backtest Degradation is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinanceLook-Ahead Bias
Look-Ahead Bias is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceMarket Impact Modeling
Market Impact Modeling is a quantitative model or framework used in backtesting, validation & research design to convert assumptions and observed market information into a structured estimate, state or decision rule. Its value comes from making the relationships explicit enough to calibrate, test and compare rather than relying on intuition alone.
Quantitative FinanceMarket Order Fill Model
Market Order Fill Model is a quantitative model or framework used in backtesting, validation & research design to convert assumptions and observed market information into a structured estimate, state or decision rule. Its value comes from making the relationships explicit enough to calibrate, test and compare rather than relying on intuition alone.
Quantitative FinanceModel Selection Bias
Model Selection Bias is a quantitative model or framework used in backtesting, validation & research design to convert assumptions and observed market information into a structured estimate, state or decision rule. Its value comes from making the relationships explicit enough to calibrate, test and compare rather than relying on intuition alone.
Quantitative FinanceModel Validation
Model Validation is a quantitative model or framework used in backtesting, validation & research design to convert assumptions and observed market information into a structured estimate, state or decision rule. Its value comes from making the relationships explicit enough to calibrate, test and compare rather than relying on intuition alone.
Quantitative FinanceMonte Carlo Backtest
Monte Carlo Backtest is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinanceMonte Carlo Cross-Validation
Monte Carlo Cross-Validation is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceMultiple Comparison Correction
Multiple Comparison Correction is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceMultiple Testing Bias
Multiple Testing Bias is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinanceNaive Benchmark
Naive Benchmark is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceNested Cross-Validation
Nested Cross-Validation is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceOptimization Bias
Optimization Bias is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceOrder Fill Assumption
Order Fill Assumption is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceOut-of-Sample Decay
Out-of-Sample Decay is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceOut-of-Sample Period
Out-of-Sample Period is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceP-Hacking
P-Hacking is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinancePaper Trading Validation
Paper Trading Validation is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceParameter Robustness
Parameter Robustness is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceParameter Stability
Parameter Stability is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceParameter Tuning Bias
Parameter Tuning Bias is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinancePartial Fill Assumption
Partial Fill Assumption is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinancePermutation Backtest
Permutation Backtest is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinancePlacebo Test
Placebo Test is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinancePrice Improvement Assumption
Price Improvement Assumption is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceProbability of Backtest Overfitting
Probability of Backtest Overfitting is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinancePublication Bias
Publication Bias is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinancePurged Cross-Validation
Purged Cross-Validation is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceRandom Strategy Benchmark
Random Strategy Benchmark is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceRebalance Delay
Rebalance Delay is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceReconstitution Bias
Reconstitution Bias is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceRegime Backtest
Regime Backtest is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinanceResearcher Degrees of Freedom
Researcher Degrees of Freedom is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceRestated Data Bias
Restated Data Bias is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceRolling Subperiod Analysis
Rolling Subperiod Analysis is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceRolling Window Backtest
Rolling Window Backtest is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinanceScenario Backtest
Scenario Backtest is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinanceSelection Bias under Backtesting
Selection Bias under Backtesting is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinanceSensitivity Analysis of Parameters
Sensitivity Analysis of Parameters is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceShadow Portfolio
Shadow Portfolio is a portfolio-construction or portfolio-analysis concept that formalizes how capital, exposures or risk are combined across positions. It is typically evaluated together with constraints, turnover, liquidity and estimation uncertainty rather than in isolation.
Quantitative FinanceShort Availability Modeling
Short Availability Modeling is a quantitative model or framework used in backtesting, validation & research design to convert assumptions and observed market information into a structured estimate, state or decision rule. Its value comes from making the relationships explicit enough to calibrate, test and compare rather than relying on intuition alone.
Quantitative FinanceSignal Decay Analysis
Signal Decay Analysis is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceSignal Delay
Signal Delay is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceSlippage Modeling
Slippage Modeling is a quantitative model or framework used in backtesting, validation & research design to convert assumptions and observed market information into a structured estimate, state or decision rule. Its value comes from making the relationships explicit enough to calibrate, test and compare rather than relying on intuition alone.
Quantitative FinanceStatistical Significance in Backtests
Statistical Significance in Backtests is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinanceStrategy Decay
Strategy Decay is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceStress Backtest
Stress Backtest is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinanceSubperiod Analysis
Subperiod Analysis is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceSurvivorship Bias
Survivorship Bias is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceTarget Leakage
Target Leakage is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceTemporal Leakage
Temporal Leakage is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceTest Window
Test Window is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinanceTime-Series Cross-Validation
Time-Series Cross-Validation is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceTimestamp Leakage
Timestamp Leakage is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceTraining Window
Training Window is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceTransaction Cost Modeling
Transaction Cost Modeling is a quantitative model or framework used in backtesting, validation & research design to convert assumptions and observed market information into a structured estimate, state or decision rule. Its value comes from making the relationships explicit enough to calibrate, test and compare rather than relying on intuition alone.
Quantitative FinanceTurnover Modeling
Turnover Modeling is a quantitative model or framework used in backtesting, validation & research design to convert assumptions and observed market information into a structured estimate, state or decision rule. Its value comes from making the relationships explicit enough to calibrate, test and compare rather than relying on intuition alone.
Quantitative FinanceTurnover-Adjusted Performance
Turnover-Adjusted Performance is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceUnanchored Walk-Forward
Unanchored Walk-Forward is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceValidation Window
Validation Window is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceVectorized Backtest
Vectorized Backtest is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinanceVintage Data Backtest
Vintage Data Backtest is a statistical diagnostic used in backtesting, validation & research design to test a specific property of data, residuals, forecasts or model behavior. The result is evidence about an assumption or hypothesis, not a standalone trading signal.
Quantitative FinanceWalk-Forward Analysis
Walk-Forward Analysis is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.
Quantitative FinanceWalk-Forward Optimization
Walk-Forward Optimization is a quantitative-finance concept used within backtesting, validation & research design. It provides a precise language for describing how market data, uncertainty, models or portfolio decisions are measured and tested.