Question - Explain how you would handle a trading model with 25 factors
differently than one with 100. What would you ask or do next if the 100
factor model had 25% better performance than the 25 factor model?
Solution -
1. Initial Assessment:
• Begin by conducting statistical analysis on the performance metrics of both models, including
hypothesis testing to determine if the performance difference is statistically significant.
• Utilize techniques such as bootstrapping or Monte Carlo simulations to assess the uncertainty
around performance estimates.
2. Backtesting:
• Employ rigorous statistical methods such as time-series analysis, including autoregressive
integrated moving average (ARIMA) modeling, to backtest both models.
• Conduct sensitivity analysis using techniques like rolling-window analysis or out-of-sample testing
to evaluate the stability of results.
3. Factor Analysis:
• Utilize multivariate statistical techniques such as principal component analysis (PCA) or factor
analysis to identify and evaluate the additional factors introduced in the 100-factor model.
• Perform statistical tests such as F-tests or t-tests to assess the significance and contribution of
each factor to portfolio performance.
4. Model Interpretation:
• Employ regression analysis to interpret the relationship between factors and portfolio returns,
including coefficient interpretation and hypothesis testing on factor loadings.
• Utilize statistical diagnostics such as residual analysis to identify any anomalies or model
misspecifications.
5. Risk Management:
• Conduct statistical analysis on risk measures such as value-at-risk (VaR) and conditional
value-at-risk (CVaR) to assess the risk characteristics of both models.
• Utilize portfolio optimization techniques such as mean-variance optimization or risk parity to
construct portfolios that balance risk and return efficiently.
6. Computational Considerations:
• Assess the computational complexity of both models using techniques such as algorithmic
complexity analysis or profiling.
• Utilize statistical tools such as regression analysis to quantify the trade-offs between model
complexity and computational resources.
7. Decision Making:
• Use statistical inference techniques such as Bayesian analysis or decision theory to make informed
decisions on whether to adopt the 100-factor model based on its statistical superiority and practical
feasibility.
• Conduct sensitivity analysis on key decision parameters to assess the robustness of the
decision-making process.