Abstract
The computational reconstruction of surface topographies from scanning electron microscope (SEM) images has been extensively investigated in the past, but fundamental image processing problems still exist. Since conventional approaches adapted from general-purpose image processing have not sufficiently met the requirements in terms of resolution and reliability, we have explored combining different methods to obtain better results.
This paper presents a least-squares combination of conventional stereoscopy with “shape from shading” and a way of obtaining self-consistent surface profiles from stereoscopy and “stereo-intrinsic shape from shading” using dynamic programming techniques. Results are presented showing how this combined analysis of multi-sensorial data yields improvements of the reconstructed surface topography that cannot be obtained from individual sensor signals alone.
Similar content being viewed by others
References
Barnard ST, Fischler MA (1982) Computational stereo. ACM Computing Surveys 14(4):553–572
Beil W, Carlsen IC, Desai V, Reimer L (1989) Three-dimensional digital surface reconstruction in scanning electron microscopy using signals of a multiple detector system. In: Proceedings of the First International Conference on 3-D Image Processing in Microscopy, Giessen, European Journal of Cell Biology 25(48): 13–16
Bellman R (1957) Dynamic programming. Princeton University Press, Princeton, NJ
Böngeler R, Reimer L, Senkel R (1988) Variable multiple detector system for secondary and backscattered electrons in a scanning electron microscope. In: EUREM 88, Inst. Phys. Conf. Ser. 93(1):239–240
Breton BC, Thong JTL, Nixon WC (1987) A contactless 3-D measuring technique for IC inspection. In: Proceedings on Integrated Circuit Metrology, Inspection, and Process Control, SPIE 775:109–117
Bruckstein AM (1988) On shape from shading. Computer Vision, Graphics, and Image Processing 44:139–154
Burt PJ (1988) Smart sensing within a pyramid vision machine. In: Proceedings of the IEEE 76(8): 1006–1015
Canny JF (1983) Finding edges and lines in images. Technical Report 720, MIT Artificial Intelligence Lab, Cambridge, MA
Carlsen IC (1985) Reconstruction of true surface topographies in scanning electron microscopes using backscattered electrons. Scanning 7:169–177
Chen JS, Huertas A, Medioni G (1987) Fast convolution with Laplacian-of-Gaussian masks. IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-9(4):584–590
Desai V, Reimer L (1988) Diffusion model for backscattered electrons using a diffusion matrix based on Monte Carlo calculations. In: EUREM 88, Inst. Phys. Conf. Ser. 93(2):371–372
Eastman RD, Waxman AM (1987) Using disparity functionals for stereo correspondence and surface reconstruction. Computer Vision, Graphics, and Image Processing 39:73–101
Ferrie FP, Le vine MD (1989) Where and why local shading analysis works. IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-11(2): 198–206
Grimson WEL (1981) From images to surfaces—A computational study of the human early visual system. The MIT Press, Cambridge, MA
Hackbusch W (1985) Multi-grid methods and applications. Springer Series on Computational Mathematics, Springer-Verlag, Berlin
Hejna J, Reimer L (1987) Backscattered electron multidetektor systems for improved quantitative topographic contrast. Scanning 9:162–172
Hoff W, Ahuja N (1989) Surfaces from stereo: Integrating feature matching, disparity estimation, and contour detection. IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-11(2): 121–136
Horn BKP (1975) Obtaining shape from shading information. In: Winston PH (ed) The psychology of computer vision. McGraw-Hill, New York, pp. 115–155
Horn BKP (1977) Understanding image intensities. Artificial Intelligence 8:201–231
Horn BKP, Brooks MJ (1986) The variational approach to shape from shading. Computer Vision, Graphics, and Image Processing 33:174–208
Ikeuchi K (1987) Determining a depth map using a dual photometric stereo. International Journal of Robotics Research 6(1): 15–31
Ikeuchi K, Horn BKP (1981) Numerical shape from shading and occluding boundaries. Artificial Intelligence 17:141–184
Kaczmarek D, Czyzewski Z, Hejna J, Radzimski Z (1987) Investigation of surface topography using the back-scattered electron signal. Scanning 9:109–116
Kholodilov OV, Grigoryev AYa, Myshkin NK (1987) Reconstruction of true topographies of solid surfaces in scanning electron microscopes using secondary electrons. Scanning 9:156–161
Lebiedzik J (1979) An automatic topographical surface reconstruction in the SEM. Scanning 2:230–237
Lebiedzik J, White EW (1975) Multiple detector method for quantitative determination of microtopography in the SEM. Scanning Electron Microscopy, IITRI Chicago: 181–188
Lee CH, Rosenfeld A (1985) Improved methods of estimating shape from shading using the light source coordinate system. Artificial Intelligence 26:125–143
Marr D, Hildreth E (1979) Theory of edge detection. A.I. Memo 518, MIT Artificial Intelligence Lab, Cambridge, MA
Marr D, Poggio T (1977) A computational theory of human stereo vision. A.I. Memo 451, MIT Artificial Intelligence Lab, Cambridge, MA
Mayhew JEW, Frisby JP (1981) Psychophysical and computational studies towards a theory of human stereopsis. Artificial Intelligence 17:349–385
McIntosh JH, Mutch KM (1988) Matching straight lines. Computer Vision, Graphics, and Image Processing 43:386–408
Mohan R, Medioni G, Nevatia R (1989) Stereo error detection, correction, and evaluation. IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-11(2): 113–120
Newbury DE (1975) Image formation in the scanning electron microscope. In: Goldstein JI, Yakowitz H (eds) Practical scanning electron microscopy. Plenum Press, New York, pp. 95–148
Olsen SI (1990) Stereo correspondence by surface reconstruction. IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-12(3):309–315
Ohta Y, Kanade T (1985) Stereo by intra- and interscanline search using dynamic programming. IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-7(2): 139–154
Pentland AP (1984) Local shading analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-6(2): 170–187
Pollard SB, Mayhew JEW, Frisby JP (1985) PMF: A stereo correspondence algorithm using a disparity gradient limit. Perception 14:449–470
Reimer L, Böngeler R, Desai V (1987) Shape from shading using multiple detector signals in scanning electron microscopy. Scanning Microscopy 1(3):963–973
Reimer L, Riepenhausen M (1985) Detector strategy for secondary and backscattered electrons using multiple detector systems. Scanning 7:221–238
Reimer L, Riepenhausen M, Schierjott M (1986) Signal of backscattered electrons at edges and surface steps in dependence on surface tilt and take-off direction. Scanning 8:164–175
Reimer L, Stelter D (1987) Monte Carlo calculations of electron emission at surface edges. Scanning Microscopy 1(3):951–962
Rosenfeld A (1984) Multiresolution image processing and analysis. Springer-Verlag, Berlin
Sato H, O-Hori M (1982) Surface roughness measurement by scanning electron microscope. Annals of the CIRP 31(1):457–462
Sato H, O-Hori M (1986) Measurement of surface shape by scanning electron microscope using detection of normal. Annals of the CIRP 35(1):365–368
Suganuma T (1985) Measurement of surface topography using SEM with two secondary electron detectors. Journal of Electron Microscopy 34(4):328–337
Tanimoto S, Pavlidis T (1975) A hierarchical data structure for picture processing. Computer Graphics and Image Processing 4:104–119
Wells OC (1957) The construction of a SEM and its application to the study of fibres. Ph.D. dissertation, University of Cambridge
Wickramasinghe HK (1989) Scanned-probe microscopes. Scientific American 261(4):74–81
Woodham RJ (1980) Photometric method for determining surface orientation from multiple images. Optical Engineering 19(1):139–144
Wu Z, Li L (1988) A line-integration based method for depth recovery from surface normals. Computer Vision, Graphics, and Image Processing 43:53–66
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Beil, W., Carlsen, I.C. Surface reconstruction from stereoscopy and “shape from shading” in SEM images. Machine Vis. Apps. 4, 271–285 (1991). https://doi.org/10.1007/BF01815304
Issue Date:
DOI: https://doi.org/10.1007/BF01815304