ALBERT

Note: Contents Preface to the Second Edition Preface to the First Edition 1. Images, Arrays, and Matrices 1.1 Multispectral Satellite Images 1.2 Algebra of Vectors and Matrices 1.2.1 Elementary Properties 1.2.2 Square Matrices 1.2.3 Singular Matrices 1.2.4 Symmetric, Positive Definite Matrices 1.2.5 Linear Dependence and Vector Spaces 1.3 Eigenvalues and Eigenvectors 1.4 Singular Value Decomposition 1.5 Vector Derivatives 1.6 Finding Minima and Maxima 1.7 Exercises 2. Image Statistics 2.1 Random Variables 2.1.1 Discrete Random Variables 2.1.2 Continuous Random Variables 2.1.3 Normal Distribution 2.2 Random Vectors 2.3 Parameter Estimation 2.3.1 Sampling a Distribution 2.3.2 Interval Estimation 2.3.3 Provisional Means 2.4 Hypothesis Testing and Sample Distribution Functions 2.4.1 Chi-Square Distribution 2.4.2 Student-t Distribution 2.4.3 F-Distribution 2.5 Conditional Probabilities, Bayes' Theorem, and Classification 2.6 Ordinary Linear Regression 2.6.1 One Independent Variable 2.6.2 More Than One Independent Variable 2.6.3 Regularization, Duality, and the Gram Matrix 2.7 Entropy and Information 2.7.1 Kullback-Leibler Divergence 2.7.2 Mutual Information 2.8 Exercises 3. Transformations 3.1 Discrete Fourier Transform 3.2 Discrete Wavelet Transform 3.2.1 Haar Wavelets 3.2.2 Image Compression 3.2.3 Multiresolution Analysis 3.2.3.1 Dilation Equation and Refinement Coefficients 3.2.3.2 Cascade Algorithm 3.2.3.3 Mother Wavelet 3.2.3.4 Daubechies D4 Scaling Function 3.3 Principal Components 3.3.1 Primal Solution 3.3.2 Dual Solution 3.4 Minimum Noise Fraction 3.4.1 Additive Noise 3.4.2 Minimum Noise Fraction Transformation in ENVI 3.5 Spatial Correlation 3.5.1 Maximum Autocorrelation Factor 3.5.2 Noise Estimation 3.6 Exercises 4. Filters, Kernels, and Fields 4.1 Convolution Theorem 4.2 Linear Filters 4.3 Wavelets and Filter Banks 4.3.1 One-Dimensional Arrays 4.3.2 Two-Dimensional Arrays 4.4 Kernel Methods 4.4.1 Valid Kernels 4.4.2 Kernel PCA 4.5 Gibbs-Markov Random Fields 4.6 Exercises 5. Image Enhancement and Correction 5.1 Lookup Tables and Histogram Functions 5.2 Filtering and Feature Extraction 5.2.1 Edge Detection 5.2.2 Invariant Moments 5.3 Panchromatic Sharpening 5.3.1 HSV Fusion 5.3.2 Brovey Fusion 5.3.3 PCA Fusion 5.3.4 DWT Fusion 5.3.5 A Trous Fusion 5.3.6 Quality Index 5.4 Topographic Correction 5.4.1 Rotation, Scaling, and Translation 5.4.2 Imaging Transformations 5.4.3 Camera Models and RFM Approximations 5.4.4 Stereo Imaging and Digital Elevation Models 5.4.5 Slope and Aspect 5.4.6 Illumination Correction 5.5 Image-Image Registration 5.5.1 Frequency-Domain Registration 5.5.2 Feature Matching 5.5.2.1 High-Pass Filtering 5.5.2.2 Closed Contours 5.5.2.3 Chain Codes and Moments 5.5.2.4 Contour Matching 5.5.2.5 Consistency Check 5.5.2.6 Implementation in IDL 5.5.3 Resampling and Warping 5.6 Exercises 6. Supervised Classification: Part 1 6.1 Maximum a Posteriori Probability 6.2 Training Data and Separability 6.3 Maximum Likelihood Classification 6.3.1 ENVI's Maximum Likelihood Classifier 6.3.2 Modified Maximum Likelihood Classifier 6.4 Gaussian Kernel Classification 6.5 Neural Networks 6.5.1 Neural Network Classifier 6.5.2 Cost Functions 6.5.3 Backpropagation 6.5.4 Overfitting and Generalization 6.6 Support Vector Machines 6.6.1 Linearly Separable Classes 6.6.1.1 Primal Formulation 6.6.1.2 Dual Formulation 6.6.1.3 Quadratic Programming and Support Vectors 6.6.2 Overlapping Classes 6.6.3 Solution with Sequential Minimal Optimization 6.6.4 Multiclass SVMs 6.6.5 Kernel Substitution 6.6.6 Modified SVM Classifier 6.7 Exercises 7. Supervised Classification: Part 2 7.1 Postprocessing 7.1.1 Majority Filtering 7.1.2 Probabilistic Label Relaxation 7.2 Evaluation and Comparison of Classification Accuracy 7.2.1 Accuracy Assessment 7.2.2 Model Comparison 7.3 Adaptive Boosting 7.4 Hyperspectral Analysis 7.4.1 Spectral Mixture Modeling 7.4.2 Unconstrained Linear Unmixing 7.4.3 Intrinsic End-Members and Pixel Purity 7.5 Exercises 8. Unsupervised Classification 8.1 Simple Cost Functions 8.2 Algorithms That Minimize the Simple Cost Functions 8.2.1 K-Means Clustering 8.2.2 Kernel K-Means Clustering 8.2.3 Extended K-Means Clustering 8.2.4 Agglomerative Hierarchical Clustering 8.2.5 Fuzzy K-Means Clustering 8.3 Gaussian Mixture Clustering 8.3.1 Expectation Maximization 8.3.2 Simulated Annealing 8.3.3 Partition Density 8.3.4 Implementation Notes 8.4 Including Spatial Information 8.4.1 Multiresolution Clustering 8.4.2 Spatial Clustering 8.5 Benchmark 8.6 Kohonen Self-Organizing Map 8.7 Image Segmentation 8.7.1 Segmenting a Classified Image 8.7.2 Object-Based Classification 8.7.3 Mean Shift 8.8 Exercises 9. Change Detection 9.1 Algebraic Methods 9.2 Postclassification Comparison 9.3 Principal Components Analysis 9.3.1 Iterated PCA 9.3.2 Kernel PCA 9.4 Multivariate Alteration Detection 9.4.1 Canonical Correlation Analysis 9.4.2 Orthogonality Properties 9.4.3 Scale Invariance 9.4.4 Iteratively Reweighted MAD 9.4.5 Correlation with the Original Observations 9.4.6 Regularization 9.4.7 Postprocessing 9.5 Decision Thresholds and Unsupervised Classification of Changes 9.6 Radiometrie Normalization 9.7 Exercises Appendix A: Mathematical Tools A.l Cholesky Decomposition A.2 Vector and Inner Product Spaces A.3 Least Squares Procedures A.3.1 Recursive Linear Regression A.3.2 Orthogonal Linear Regression Appendix B: Efficient Neural Network Training Algorithms B.1 Hessian Matrix B.1.1 R-Operator B.1.1.1 Determination of Rv{n} B.1.1.2 Determination of Rv{δo} B.1.1.3 Determination of Rv{δh} B.1.2 Calculating the Hessian B.2 Scaled Conjugate Gradient Training B.2.1 Conjugate Directions B.2.2 Minimizing a Quadratic Function B.2.3 Algorithm B.3 Kaiman Filter Training B.3.1 Linearization B.3.2 Algorithm B.4 A Neural Network Classifier with Hybrid Training Appendix C: ENVI Extensions in IDL C.1 Installation C.2 Extensions C.2.1 Kernel Principal Components Analysis C.2.2 Discrete Wavelet Transform Fusion C.2.3 A Trous Wavelet Transform Fusion C.2.4 Quality Index C.2.5 Calculating Heights of Man-Made Structures in High-Resolution Imagery C.2.6 Illumination Correction C.2.7 Image Registration C.2.8 Maximum Likelihood Classification C.2.9 Gaussian Kernel Classification C.2.10 Neural Network Classification C.2.11 Support Vector Machine Classification C.2.12 Probabilistic Label Relaxation C.2.13 Classifier Evaluation and Comparison C.2.14 Adaptive Boosting a Neural Network Classifier C.2.15 Kernel K-Means Clustering C.2.16 Agglomerative Hierarchical Clustering C.2.17 Fuzzy K-Means Clustering C.2.18 Gaussian Mixture Clustering C.2.19 Kohonen Self-Organizing Map C.2.20 Classified Image Segmentation C.2.21 Mean Shift Segmentation C.2.22 Multivariate Alteration Detection C.2.23 Viewing Changes C.2.24 Radiometric Normalization Appendix D: Mathematical Notation References Index