Remote Sensing and Gis Accuracy Assessment

by Lunetta; Ross S.

• ISBN13: 9781566704434
• ISBN10: 156670443X
• Format: Hardcover
• Copyright: 2004-07-27
• Publisher: CRC Press

Summary

The development of robust accuracy assessment methods for the validation of spatial data represents a difficult challenge for the geospatial science community. Obstacles to robust assessments include continuous data characteristics and positional errors, demanding ongoing development by GIS and remote sensing experts.Based upon a special symposium sponsored by the U.S. Environmental Protection Agency (EPA), Remote Sensing and GIS Accuracy Assessment evaluates the important scientific elements related to the performance of accuracy assessments for remotely sensed data, GIS data analysis, and integration products. Scientists from federal, state, and local governments, academia, and nongovernmental organizations present twenty technical chapters that examine sampling issues, reference data collection, edge and boundary effects, error matrix and fuzzy assessments, error budget analysis, and change detection accuracy assessment.The book includes the keynote presentation by Russell G. Congalton that provides a historical accuracy assessment overview, articulatescurrent technical shortcomings, and identified numerous issues that were debated throughout the symposium. All chapters underwent a peer review and were determined to be valuable to the remote sensing and GIS community. The editors arranged the chapters as a series of complementary scientific topics to provide you with a detailed treatise on spatial data accuracy assessment issues.

Table of Contents

Putting the Map Back in Map Accuracy Assessment
Russell G. Congalton
Introduction	1	(1)
Accuracy Assessment Overview	2	(4)
Historical Review	2	(1)
Established Techniques and Considerations	3	(1)
The Error Matrix	3	(1)
Discrete Multivariate Analysis	4	(1)
Sampling Size and Scheme	4	(2)
Spatial Autocorrelation	6	(1)
Current Issues and Needs	6	(3)
Sampling Issues	6	(1)
Edge and Boundary Effects	6	(1)
Reference Data Collection	7	(1)
Beyond the Error Matrix: Fuzzy Assessment	7	(1)
Error Budget Analysis	8	(1)
Change Detection Accuracy Assessment	8	(1)
Summary	9	(4)
References	10	(3)
Sampling Design for Accuracy Assessment of Large-Area, Land-Cover Maps: Challenges and Future Directions
Stephen V. Stehman
Introduction	13	(2)
Meeting the Challenge of Cost-Effective Sampling Design	15	(6)
Strata vs. Clusters: The Cost vs. Precision Paradox	15	(1)
Flexibility of the NLCD Design	16	(1)
Comparison of the Three Options	17	(1)
Stratification and Local Spatial Control	18	(3)
Existing Data	21	(1)
Added-Value Uses of Accuracy Assessment Data	21	(1)
Nonprobability Sampling	22	(1)
Policy Aspects of Probability vs. Nonprobability Sampling	23	(1)
Statistical Computing	23	(1)
Practical Realities of Sampling Design	24	(1)
Principle 1	24	(1)
Principle 2	24	(1)
Principle 3	25	(1)
Principle 4	25	(1)
Discussion	25	(1)
Summary	26	(5)
References	27	(4)
Validation of Global Land-Cover Products by the Committee on Earth Observing Satellites
Jeffrey T. Morisette
Jeffrey L. Privette
Alan Strahler
Philippe Mayaux
Christopher O. Justice
Introduction	31	(3)
Committee on Earth Observing Satellites	31	(1)
Approaches to Land-Cover Validation	32	(2)
Lessons Learned from IGPB Discover	34	(1)
Validation of the European Commission's Global Land-Cover 2000	34	(1)
Validation of the Modis Global Land-Cover Product	35	(1)
CEOS Land Product Validation Subgroup	36	(3)
Fine-Resolution Image Quality and Availability	37	(1)
Local Knowledge Requirements	37	(2)
Resource Requirements	39	(1)
Summary	39	(2)
Acknowledgments	39	(1)
References	39	(2)
In Situ Estimates of Forest LAI for MODIS Data Validation
John S. Iiames, Jr.
Andrew N. Pilant
Timothy E. Lewis
Introduction	41	(2)
Study Area	43	(1)
Background	43	(4)
TRAC Measurements	43	(2)
Hemispherical Photography Measurements	45	(1)
Combining TRAC and Hemispherical Photography	45	(1)
Satellite Data	46	(1)
MODIS LAI and NDVI Products	46	(1)
Methods	47	(5)
Sampling Frame Design	47	(1)
Biometric Mensuration	48	(2)
TRAC Measurements	50	(1)
Hemispherical Photography	51	(1)
Hemispherical Photography Quality Assurance	52	(1)
Discussion	52	(2)
LAI Accuracy Assessment	52	(1)
Hemispherical Photography	52	(2)
Satellite Remote Sensing Issues	54	(1)
Summary	54	(5)
Acknowledgments	55	(1)
References	55	(4)
Light Attenuation Profiling as an Indicator of Structural Changes in Coastal Marshes
Elijah Ramsey III
Gene Nelson
Frank Baarnes
Ruth Spell
Introduction	59	(2)
Marsh Canopy Descriptions	60	(1)
Methods	61	(3)
Field Collection Methods	61	(1)
Area Frequency Sampling	62	(1)
Vertical Frequency Sampling	62	(1)
Atypical Canopy Structures	62	(1)
Changing Sun Zenith	63	(1)
Results	64	(5)
Vertical Frequency Sampling	64	(1)
Atypical Canopy Structures	65	(2)
Changing Sun Zenith	67	(2)
Discussion	69	(2)
Summary	71	(4)
Acknowledgments	72	(1)
References	72	(3)
Participatory Reference Data Collection Methods for Accuracy Assessment of Land-Cover Change Maps
John Sydenstricker-Neto
Andrea Wright Parmenter
Stephen D. DeGloria
Introduction	75	(3)
Study Objectives	77	(1)
Study Area	77	(1)
Methods	78	(4)
Imagery	78	(1)
Reference Data Collection	79	(1)
Data Processing	80	(1)
Image Classification	81	(1)
Accuracy Assessment	81	(1)
Results and Discussion	82	(4)
Classified Imagery and Land-Cover Change	82	(2)
Map Accuracy Assessment	84	(1)
Bringing Users into the Map	85	(1)
Conclusions	86	(1)
Summary	87	(4)
Acknowledgments	88	(1)
References	88	(3)
Thematic Accuracy Assessment of Regional Scale Land-Cover Data
Siamak Khorram
Joseph F. Knight
Halil I. Cakir
Introduction	91	(1)
Approach	92	(2)
Sampling Design	92	(1)
Training	93	(1)
Photographic Interpretation	93	(1)
Interpretation Protocol	93	(1)
Interpretation Procedures	94	(1)
Quality Assurance and Quality Control	94	(1)
Results	94	(7)
Accuracy Estimates	94	(5)
Issues and Problems	99	(1)
Heterogeneity	99	(1)
Acquisition Dates	99	(1)
Location Errors	99	(2)
Further Research	101	(4)
Acknowledgments	101	(1)
References	101	(1)
Appendix A: MRLC Classification Scheme and Class Definitions	102	(3)
An Independent Reliability Assessment for the Australian Agricultural Land-Cover Change Project 1990/91--1995
Michele Barson
Vivienne Bordas
Kim Lowell
Kim Malafant
Introduction	105	(3)
Methods	108	(1)
Results	109	(2)
Discussion and Conclusions	111	(1)
Summary	112	(4)
Acknowledgments	113	(1)
References	113	(3)
Assessing the Accuracy of Satellite-Derived Land-Cover Classification Using Historical Aerial Photography, Digital Orthophoto Quadrangles, and Airborne Video Data
Susan M. Skirvin
William G. Kepner
Stuart E. Marsh
Samuel E. Drake
John K. Maingi
Curtis M. Edmonds
Christopher J. Watts
David R. Williams
Introduction	116	(1)
Background	116	(2)
Upper San Pedro Watershed Study Area	116	(1)
Reference Data Sources for Accuracy Assessment	117	(1)
Reporting Accuracy Assessment Results	118	(1)
Methods	118	(5)
Image Classification	118	(1)
Sampling Design	119	(1)
Historical Aerial Photography	120	(1)
Image Collection, Preparation, and Site Selection	121	(1)
Photograph Interpretation and Assessment	121	(1)
Digital Orthophoto Quadrangles	121	(1)
Interpreter Calibration	121	(1)
Sample Point Selection	122	(1)
Airborne Videography	122	(1)
Video and GIS Data Preparation	122	(1)
Video Sample Point Selection	122	(1)
Random Frame Selection and Evaluation	123	(1)
Results	123	(2)
Aerial Photography Method	123	(1)
Digital Orthophoto Quadrangle Method	124	(1)
Airborne Videography Method	124	(1)
Discussion	125	(3)
Map Accuracies	125	(1)
Class Confusion	125	(3)
Future Research	128	(1)
Conclusions	128	(1)
Summary	128	(5)
Acknowledgments	129	(1)
References	129	(4)
Using Classification Consistency in Interscene Overlap Areas to Model Spatial Variations in Land-Cover Accuracy over Large Geographic Regions
Bert Guindon
Curtis M. Edmonds
Introduction	133	(1)
Link between Classification Consistency and Accuracy	134	(1)
Using Consistency within a Classification Methodology	135	(2)
Great Lakes Results	137	(5)
Variation of Consistency among Clusters of a Given Class	138	(1)
Aspects of Scene-Based Consistency Overlays	139	(1)
Aspects of the Accumulated Confidence Layer	139	(2)
Relationship of Accumulated Confidence and User's Accuracy	141	(1)
Conclusions	142	(1)
Summary	142	(3)
References	142	(3)
Geostatistical Mapping of Thematic Classification Uncertainty
Phaedon C. Kyriakidis
Xiaohang Liu
Michael F. Goodchild
Introduction	145	(2)
Methods	147	(6)
Classification Based on Remotely Sensed Data	147	(1)
Geostatistical Modeling of Context	148	(2)
Combining Spectral and Contextual Information	150	(2)
Mapping Thematic Classification Accuracy	152	(1)
Generation of Simulated TM Reflectance Values	152	(1)
Results	153	(7)
Spectral and Spatial Classifications	155	(1)
Merging Spectral and Contextual Information	155	(3)
Mapping Classification Accuracy	158	(2)
Discussion	160	(1)
Conclusions	160	(1)
Summary	161	(2)
References	161	(2)
An Error Matrix Approach to Fuzzy Accuracy Assessment: The NIMA Geocover Project
Kass Green
Russell G. Congalton
Introduction	163	(1)
Background	164	(1)
Methods	165	(3)
Classification Scheme	166	(1)
Sampling Design	166	(1)
Site Labeling	167	(1)
Compilation of the Deterministic and Fuzzy Error Matrix	168	(1)
Results	168	(2)
Discussion and Conclusions	170	(1)
Summary	171	(2)
References	171	(1)
Appendix A: Classification Rules	172	(1)
Mapping Spatial Accuracy and Estimating Landscape Indicators from Thematic Land-Cover Maps Using Fuzzy Set Theory
Liem T. Tran
S. Taylor Jarnagin
C. Gregory Knight
Latha Baskaran
Introduction	173	(1)
Methods	174	(6)
Multilevel Agreement	176	(1)
Spatial Accuracy Map	177	(1)
Degrees of Fuzzy Membership	177	(1)
Fuzzy Membership Rules	178	(2)
Fuzzy Land-Cover Maps	180	(1)
Deriving Landscape Indicators	180	(1)
Results and Discussion	180	(6)
Conclusions	186	(1)
Summary	186	(3)
Acknowledgments	187	(1)
References	187	(2)
Fuzzy Set and Spatial Analysis Techniques for Evaluating Thematic Accuracy of a Land-Cover Map
Sarah R. Falzarano
Kathryn A. Thomas
Introduction	189	(3)
Accuracy Assessment	189	(1)
Analysis of Reference Data	190	(1)
Binary Analysis	190	(1)
Fuzzy Set Analysis	191	(1)
Spatial Analysis	191	(1)
Background	192	(1)
Methodology	192	(4)
Reference Data	192	(1)
Binary Analysis	192	(1)
Fuzzy Set Analysis	192	(2)
Spatial Analysis	194	(2)
Results	196	(2)
Binary Analysis	196	(1)
Fuzzy Set Analysis	196	(1)
Spatial Analysis	196	(2)
Discussion	198	(6)
Summary	204	(5)
References	204	(2)
Appendix A: Arizona Gap Analysis Classification System	206	(3)
The Effects of Classification Accuracy on Landscape Indices
Guofan Shao
Wenchun Wu
Introduction	209	(1)
Methods	210	(3)
Relative Errors of Area (REA)	211	(2)
Results	213	(1)
Discussion	214	(3)
Conclusions	217	(2)
Summary	219	(3)
Acknowledgments	219	(1)
References	219	(3)
Assessing Uncertainty in Spatial Landscape Metrics Derived from Remote Sensing Data
Daniel G. Brown
Elisabeth A. Addink
Jiunn-Der Duh
Mark A. Bowersox
Introduction	222	(1)
Background	223	(1)
Methods	224	(2)
Precision of Landscape Change Metrics	224	(1)
Comparing Class Definitions	224	(1)
Landsat Classifications	224	(1)
Aerial Photography Interpretations	224	(1)
Landscape Simulations	225	(1)
Ecotone Abruptness	225	(1)
Fragmentation	225	(1)
Results	226	(4)
Precision of Landscape Metrics	226	(1)
Comparing Class Definitions	227	(1)
Comparing TM Classifications	227	(1)
Comparing Photographic Classifications	228	(1)
Landscape Simulations	229	(1)
Ecotone Abruptness	229	(1)
Forest Fragmentation	229	(1)
Discussion	230	(1)
Conclusions	230	(1)
Summary	231	(2)
Acknowledgments	232	(1)
References	232	(1)
Components of Agreement between Categorical Maps at Multiple Resolutions
R. Gil Pontius, Jr.
Beth Suedmeyer
Introduction	233	(3)
Map Comparison	233	(1)
Puzzle Example	234	(2)
Methods	236	(9)
Example Data	236	(1)
Data Requirements and Notation	236	(3)
Minimum Function	239	(1)
Agreement Expressions and Information Components	239	(3)
Agreement and Disagreement	242	(2)
Multiple Resolutions	244	(1)
Results	245	(3)
Discussion	248	(2)
Common Applications	248	(1)
Quantity Information	249	(1)
Stratification and Multiple Resolutions	250	(1)
Conclusions	250	(1)
Summary	251	(2)
Acknowledgments	251	(1)
References	251	(2)
Accuracy Assessments of Airborne Hyperspectral Data for Mapping Opportunistic Plant Species in Freshwater Coastal Wetlands
Ricardo D. Lopez
Curtis M. Edmonds
Anne C. Neale
Terrence Slonecker
K. Bruce Jones
Daniel T. Heggem
John G. Lyon
Eugene Jaworski
Donald Garofalo
David Williams
Introduction	253	(1)
Background	254	(1)
Methods	255	(6)
Remote Sensor Data Acquisition and Processing	255	(4)
Field Reference Data Collection	259	(1)
Accuracy Assessment of Vegetation Maps	260	(1)
Results	261	(3)
Field Reference Data Measurements	261	(1)
Distinguishing between Phragmites and Typha	261	(1)
Semiautomated Phragmites Mapping	261	(1)
Accuracy Assessment	262	(2)
Discussion	264	(1)
Conclusions	265	(1)
Summary	265	(4)
Acknowledgments	266	(1)
References	266	(3)
A Technique for Assessing the Accuracy of Subpixel Impervious Surface Estimates Derived from Landsat TM Imagery
S. Taylor Jarnagin
David B. Jennings
Donald W. Ebert
Introduction	269	(1)
Methods	270	(5)
Study Area	270	(2)
Data	272	(1)
Spatial Processing	272	(2)
Statistical Processing	274	(1)
Results and Discussion	275	(2)
Conclusions	277	(1)
Summary	278	(3)
Acknowledgments	279	(1)
References	279	(2)
Area and Positional Accuracy of DMSP Nighttime Lights Data
Christopher D. Elvidge
Jeffrey Safran
Ingrid L. Nelson
Benjamin T. Tuttle
Vinita Ruth Hobson
Kimberly E. Baugh
John B. Dietz
Edward H. Erwin
Introduction	281	(2)
Methods	283	(3)
Modeling a Smoothed OLS Pixel Footprint	283	(1)
OLS Data Preparation	284	(1)
Target Selection and Measurement	285	(1)
Results	286	(3)
Geolocation Accuracy	286	(2)
Comparison of OLS Lighting Areas and ETM+ Areas	288	(1)
Multiplicity of OLS Light Detections	288	(1)
Conclusions	289	(2)
Summary	291	(2)
Acknowledgments	291	(1)
References	291	(2)
Index	293