Background & Aims: High-resolution microendoscopy is an optical imaging technique with the potential to improve the accuracy of endoscopic screening for esophageal squamous neoplasia. Although these microscopic images can be interpreted readily by trained personnel, quantitative image analysis software could facilitate the use of this technology in low-resource settings. In this study, we developed and evaluated quantitative image analysis criteria for the evaluation of neoplastic and non-neoplastic squamous esophageal mucosa. Methods: We performed an image analysis of 177 patients undergoing standard upper endoscopy for screening or surveillance of esophageal squamous neoplasia, using high-resolution microendoscopy, at 2 hospitals in China and at 1 hospital in the United States from May 2010 to October 2012. Biopsy specimens were collected from imaged sites (n = 375), and a consensus diagnosis was provided by 2 expert gastrointestinal pathologists and used as the standard. Results: Quantitative information from the high-resolution images was used to develop an algorithm to identify high-grade squamous dysplasia or invasive squamous cell cancer, based on histopathology findings. Optimal performance was obtained using the mean nuclear area as the basis for classification, resulting in sensitivities and specificities of 93% and 92% in the training set, 87% and 97% in the test set, and 84% and 95% in an independent validation set, respectively. Conclusions: High-resolution microendoscopy with quantitative image analysis can aid in the identification of esophageal squamous neoplasia. Use of software-based image guides may overcome issues of training and expertise in low-resource settings, allowing for widespread use of these optical biopsy technologies.