Financial Signal Processing and Machine Learning

by Akansu, Ali N.; Kulkarni, Sanjeev R.; Malioutov, Dmitry M.

• ISBN13: 9781118745670
• ISBN10: 1118745671
• eBook ISBN(s): 9781118745632
• Edition: 1st
• Format: Hardcover
• Copyright: 2016-05-31
• Publisher: Wiley-IEEE Press
• More Book Details
• Purchase Benefits

Summary

The modern financial industry has been required to deal with large and diverse portfolios in a variety of asset classes often with limited market data available. Financial Signal Processing and Machine Learning unifies a number of recent advances made in signal processing and machine learning for the design and management of investment portfolios and financial engineering. This book bridges the gap between these disciplines, offering the latest information on key topics including characterizing statistical dependence and correlation in high dimensions, constructing effective and robust risk measures, and their use in portfolio optimization and rebalancing. The book focuses on signal processing approaches to model return, momentum, and mean reversion, addressing theoretical and implementation aspects. It highlights the connections between portfolio theory, sparse learning and compressed sensing, sparse eigen-portfolios, robust optimization, non-Gaussian data-driven risk measures, graphical models, causal analysis through temporal-causal modeling, and large-scale copula-based approaches.

Key features:

• Highlights signal processing and machine learning as key approaches to quantitative finance.
• Offers advanced mathematical tools for high-dimensional portfolio construction, monitoring, and post-trade analysis problems.
• Presents portfolio theory, sparse learning and compressed sensing, sparsity methods for investment portfolios. including eigen-portfolios, model return, momentum, mean reversion and non-Gaussian data-driven risk measures with real-world applications of these techniques.
• Includes contributions from leading researchers and practitioners in both the signal and information processing communities, and the quantitative finance community.

Author Biography

Ali N. Akansu, Electrical and Computer Engineering Department, New Jersey Institute of Technology (NJIT), USA
Dr. Akansu is a Professor of Electrical and Computer Engineering at NJIT, USA. Prof. Akansu was VP R&D at IDT Corporation and the founding President and CEO of PixWave, Inc. He has sat on the board of an investment fund and has been an academic visitor at David Sarnoff Research Center, IBM T.J. Watson Research Center, and GEC-Marconi Electronic Systems.Prof. Akansu was a Visiting Professor at Courant Institute of Mathematical Sciences of New York University performing research on Quantitative Finance. He is a Fellow of the IEEE and was the Lead Guest Editor of the recent special issue of IEEE Journal of Selected Topics in Signal Processing on Signal Processing Methods in Finance and Electronic Trading.

Sanjeev R. Kulkarni, Department of Electrical Engineering, Princeton University, USA
Dr. Kulkarni is currently Professor of Electrical Engineering at Princeton University, and Director of Princeton’s Keller Center. He is an affiliated faculty member of the Department of Operations Research and Financial Engineering and the Department of Philosophy, and has taught a broad range of courses across a number of departments (Electrical Engineering, Computer Science, Philosophy, and Operations Research & Financial Engineering). He has received 7 E-Council Excellence in Teaching Awards. He spent 1998 with Susquehanna International Group and was a regular consultant there from 1997 to 2001, working on statistical arbitrage and analysis of firm-wide stock trading. Prof. Kulkarni is a Fellow of the IEEE.

Dmitry Malioutev, IBM Research, USA
Dr. Dmitry Malioutov is a research staff member in the machine learning group of the Cognitive Algorithms department at IBM Research. Dmitry received the Ph.D. and the S.M. degrees in Electrical Engineering and Computer Science from MIT where he was part of the Laboratory for Information and Decision Systems. Prior to joining IBM, Dmitry had spent several years as an applied researcher in high-frequency trading in DRW Trading, Chicago, and as a postdoctoral researcher in Microsoft Research, Cambridge, UK. His research interests include interpretable machine learning; sparse signal representation; inference and learning in graphical models, message passing algorithms; Statistical risk modeling, robust covariance estimation; portfolio optimization. Dr. Malioutov received the 2010 IEEE Signal Processing Society best 5-year paper award, and a 2006 IEEE ICASSP student paper award, and the MIT Presidential fellowship. Dr. Malioutov serves on the IEEE-SPS machine learning for signal processing technical committee, and is an associate editor of the IEEE Transactions on Signal Processing, and a guest editor of the IEEE Journal on Selected Topics in Signal Processing.

Table of Contents

List of Contributors xiii

Preface xv

1 Overview 1
Ali N. Akansu, Sanjeev R. Kulkarni, and Dmitry Malioutov

1.1 Introduction 1

1.2 A Bird's-Eye View of Finance 2

1.2.1 Trading and Exchanges 4

1.2.2 Technical Themes in the Book 5

1.3 Overview of the Chapters 6

1.3.1 Chapter 2: "Sparse Markowitz Portfolios" by Christine De Mol 6

1.3.2 Chapter 3: "Mean-Reverting Portfolios: Tradeoffs between Sparsity and Volatility" by Marco Cuturi and Alexandre d'Aspremont 7

1.3.3 Chapter 4: "Temporal Causal Modeling" by Prabhanjan Kambadur, Aurelie C. Lozano, and Ronny Luss 7

1.3.4 Chapter 5: "Explicit Kernel and Sparsity of Eigen Subspace for the AR(1) Process" by Mustafa U. Torun, Onur Yilmaz and Ali N. Akansu 7

1.3.5 Chapter 6: "Approaches to High-Dimensional Covariance and Precision Matrix Estimation" by Jianqing Fan, Yuan Liao, and Han Liu 7

1.3.6 Chapter 7: "Stochastic Volatility: Modeling and Asymptotic Approaches to Option Pricing and Portfolio Selection" by Matthew Lorig and Ronnie Sircar 7

1.3.7 Chapter 8: "Statistical Measures of Dependence for Financial Data" by David S. Matteson, Nicholas A. James, and William B. Nicholson 8

1.3.8 Chapter 9: "Correlated Poisson Processes and Their Applications in Financial Modeling" by Alexander Kreinin 8

1.3.9 Chapter 10: "CVaR Minimizations in Support Vector Machines" by Junya Gotoh and Akiko Takeda 8

1.3.10 Chapter 11: "Regression Models in Risk Management" by Stan Uryasev 8

1.4 Other Topics in Financial Signal Processing and Machine Learning 9

2 Sparse Markowitz Portfolios 11
Christine De Mol

2.1 Markowitz Portfolios 11

2.2 Portfolio Optimization as an Inverse Problem: The Need for Regularization 13

2.3 Sparse Portfolios 15

2.4 Empirical Validation 17

2.5 Variations on the Theme 18

2.5.1 Portfolio Rebalancing 18

2.5.2 Portfolio Replication or Index Tracking 19

2.5.3 Other Penalties and Portfolio Norms 19

2.6 Optimal Forecast Combination 20

3 Mean-Reverting Portfolios 23
Marco Cuturi and Alexandre d'Aspremont

3.1 Introduction 23

3.1.1 Synthetic Mean-Reverting Baskets 24

3.1.2 Mean-Reverting Baskets with Sufficient Volatility and Sparsity 24

3.2 Proxies for Mean Reversion 25

3.2.1 Related Work and Problem Setting 25

3.2.2 Predictability 26

3.2.3 Portmanteau Criterion 27

3.2.4 Crossing Statistics 28

3.3 Optimal Baskets 28

3.3.1 Minimizing Predictability 29

3.3.2 Minimizing the Portmanteau Statistic 29

3.3.3 Minimizing the Crossing Statistic 29

3.4 Semidefinite Relaxations and Sparse Components 30

3.4.1 A Semidefinite Programming Approach to Basket Estimation 30

3.4.2 Predictability 30

3.4.3 Portmanteau 31

3.4.4 Crossing Stats 31

3.5 Numerical Experiments 32

3.5.1 Historical Data 32

3.5.2 Mean-reverting Basket Estimators 33

3.5.3 Jurek and Yang (2007) Trading Strategy 33

3.5.4 Transaction Costs 33

3.5.5 Experimental Setup 36

3.5.6 Results 36

3.6 Conclusion 39

4 Temporal Causal Modeling 41
Prabhanjan Kambadur, Aurelie C. Lozano, and Ronny Luss

4.1 Introduction 41

4.2 TCM 46

4.2.1 Granger Causality and Temporal Causal Modeling 46

4.2.2 Grouped Temporal Causal Modeling Method 47

4.2.3 Synthetic Experiments 49

4.3 Causal Strength Modeling 51

4.4 Quantile TCM (Q-TCM) 52

4.4.1 Modifying Group OMP for Quantile Loss 52

4.4.2 Experiments 53

4.5 TCM with Regime Change Identification 55

4.5.1 Model 56

4.5.2 Algorithm 58

4.5.3 Synthetic Experiments 60

4.5.4 Application: Analyzing Stock Returns 62

4.6 Conclusions 63

5 Explicit Kernel and Sparsity of Eigen Subspace for the AR(1) Process 67
Mustafa U. Torun, Onur Yilmaz, and Ali N. Akansu

5.1 Introduction 67

5.2 Mathematical Definitions 68

5.2.1 Discrete AR(1) Stochastic Signal Model 68

5.2.2 Orthogonal Subspace 69

5.3 Derivation of Explicit KLT Kernel for a Discrete AR(1) Process 72

5.3.1 A Simple Method for Explicit Solution of a Transcendental Equation 73

5.3.2 Continuous Process with Exponential Autocorrelation 74

5.3.3 Eigenanalysis of a Discrete AR(1) Process 76

5.3.4 Fast Derivation of KLT Kernel for an AR(1) Process 79

5.4 Sparsity of Eigen Subspace 82

5.4.1 Overview of Sparsity Methods 83

5.4.2 pdf-Optimized Midtread Quantizer 84

5.4.3 Quantization of Eigen Subspace 86

5.4.4 pdf of Eigenvector 87

5.4.5 Sparse KLT Method 89

5.4.6 Sparsity Performance 91

5.5 Conclusions 97

6 Approaches to High-Dimensional Covariance and Precision Matrix Estimations 100
Jianqing Fan, Yuan Liao, and Han Liu

6.1 Introduction 100

6.2 Covariance Estimation via Factor Analysis 101

6.2.1 Known Factors 103

6.2.2 Unknown Factors 104

6.2.3 Choosing the Threshold 105

6.2.4 Asymptotic Results 105

6.2.5 A Numerical Illustration 107

6.3 Precision Matrix Estimation and Graphical Models 109

6.3.1 Column-wise Precision Matrix Estimation 110

6.3.2 The Need for Tuning-insensitive Procedures 111

6.3.3 TIGER: A Tuning-insensitive Approach for Optimal Precision Matrix Estimation 112

6.3.4 Computation 114

6.3.5 Theoretical Properties of TIGER 114

6.3.6 Applications to Modeling Stock Returns 115

6.3.7 Applications to Genomic Network 118

6.4 Financial Applications 119

6.4.1 Estimating Risks of Large Portfolios 119

6.4.2 Large Panel Test of Factor Pricing Models 121

6.5 Statistical Inference in Panel Data Models 126

6.5.1 Efficient Estimation in Pure Factor Models 126

6.5.2 Panel Data Model with Interactive Effects 127

6.5.3 Numerical Illustrations 130

6.6 Conclusions 131

7 Stochastic Volatility 135
Matthew Lorig and Ronnie Sircar

7.1 Introduction 135

7.1.1 Options and Implied Volatility 136

7.1.2 Volatility Modeling 137

7.2 Asymptotic Regimes and Approximations 141

7.2.1 Contract Asymptotics 142

7.2.2 Model Asymptotics 142

7.2.3 Implied Volatility Asymptotics 143

7.2.4 Tractable Models 145

7.2.5 Model Coefficient Polynomial Expansions 146

7.2.6 Small "Vol of Vol" Expansion 152

7.2.7 Separation of Timescales Approach 152

7.2.8 Comparison of the Expansion Schemes 154

7.3 Merton Problem with Stochastic Volatility: Model Coefficient Polynomial Expansions 155

7.3.1 Models and Dynamic Programming Equation 155

7.3.2 Asymptotic Approximation 157

7.3.3 Power Utility 159

7.4 Conclusions 160

8 Statistical Measures of Dependence for Financial Data 162
David S. Matteson, Nicholas A. James, and William B. Nicholson

8.1 Introduction 162

8.2 Robust Measures of Correlation and Autocorrelation 164

8.2.1 Transformations and Rank-Based Methods 166

8.2.2 Inference 169

8.2.3 Misspecification Testing 171

8.3 Multivariate Extensions 174

8.3.1 Multivariate Volatility 175

8.3.2 Multivariate Misspecification Testing 176

8.3.3 Granger Causality 176

8.3.4 Nonlinear Granger Causality 177

8.4 Copulas 179

8.4.1 Fitting Copula Models 180

8.4.2 Parametric Copulas 181

8.4.3 Extending beyond Two Random Variables 183

8.4.4 Software 185

8.5 Types of Dependence 185

8.5.1 Positive and Negative Dependence 185

8.5.2 Tail Dependence 187

9 Correlated Poisson Processes and Their Applications in Financial Modeling 191
Alexander Kreinin

9.1 Introduction 191

9.2 Poisson Processes and Financial Scenarios 193

9.2.1 Integrated Market-Credit Risk Modeling 193

9.2.2 Market Risk and Derivatives Pricing 194

9.2.3 Operational Risk Modeling 194

9.2.4 Correlation of Operational Events 195

9.3 Common Shock Model and Randomization of Intensities 196

9.3.1 Common Shock Model 196

9.3.2 Randomization of Intensities 196

9.4 Simulation of Poisson Processes 197

9.4.1 Forward Simulation 197

9.4.2 Backward Simulation 200

9.5 Extreme Joint Distribution 207

9.5.1 Reduction to Optimization Problem 207

9.5.2 Monotone Distributions 208

9.5.3 Computation of the Joint Distribution 214

9.5.4 On the Frechet-Hoeffding Theorem 215

9.5.5 Approximation of the Extreme Distributions 217

9.6 Numerical Results 219

9.6.1 Examples of the Support 219

9.6.2 Correlation Boundaries 221

9.7 Backward Simulation of the Poisson-Wiener Process 222

9.8 Concluding Remarks 227

Appendix A 229

A.1 Proof of Lemmas 9.2 and 9.3 229

A.1.1 Proof of Lemma 9.2 229

A.1.2 Proof of Lemma 9.3 230

10 CVaR Minimizations in Support Vector Machines 233
Jun-ya Gotoh and Akiko Takeda

10.1 What Is CVaR? 234

10.1.1 Definition and Interpretations 234

10.1.2 Basic Properties of CVaR 238

10.1.3 Minimization of CVaR 240

10.2 Support Vector Machines 242

10.2.1 Classification 242

10.2.2 Regression 246

10.3 ν-SVMs as CVaR Minimizations 247

10.3.1 ν-SVMs as CVaR Minimizations with Homogeneous Loss 247

10.3.2 ν-SVMs as CVaR Minimizations with Nonhomogeneous Loss 251

10.3.3 Refining the ν-Property 253

10.4 Duality 256

10.4.1 Binary Classification 256

10.4.2 Geometric Interpretation of ν-SVM 257

10.4.3 Geometric Interpretation of the Range of ν for ν-SVC 258

10.4.4 Regression 259

10.4.5 One-class Classification and SVDD 259

10.5 Extensions to Robust Optimization Modelings 259

10.5.1 Distributionally Robust Formulation 259

10.5.2 Measurement-wise Robust Formulation 261

10.6 Literature Review 262

10.6.1 CVaR as a Risk Measure 263

10.6.2 From CVaR Minimization to SVM 263

10.6.3 From SVM to CVaR Minimization 263

10.6.4 Beyond CVaR 263

11 Regression Models in Risk Management 266
Stan Uryasev

11.1 Introduction 267

11.2 Error and Deviation Measures 268

11.3 Risk Envelopes and Risk Identifiers 271

11.3.1 Examples of Deviation Measures D, Corresponding Risk Envelopes Q, and Sets of Risk Identifiers QD(X) 272

11.4 Error Decomposition in Regression 273

11.5 Least-Squares Linear Regression 275

11.6 Median Regression 277

11.7 Quantile Regression and Mixed Quantile Regression 281

11.8 Special Types of Linear Regression 283

11.9 Robust Regression 284

References, Further Reading, and Bibliography 287

Index 289