ALBERT

Description: The history of the Controlled Ecological Life Support System program, initiated by NASA in the late 1970s to explore the use of bioregenerative methods of life support, is reviewed. The project focused on examining the process involved in converting inorganic minerals and gases into life support materials using sunlight as the primary energy source. The research, planning, and technological development required by the CELSS program and conducted at NASA field centers, at various universities, and by commercial organizations are reviewed. Research activities at universities have focused upon exploring methods of reducing the size of the system, reducing system power requirements, understanding issues that are associated with its long-term stability, and identifying new technologies that might be useful in improving its efficiency. Research activities at Ames research center have focused on the use of common duckweed as a high biomass-producing plant, which is high in protein and on waste processing.

Description: The bioregenerative life support systems research at Johnson Space Center focuses on the use of lunar regolith as a plant growth medium. Current dissolution experiments are being conducted to ascertain the response of lunar regolith to various solvents and weathering environments. The transformation of lunar minerals into minerals such as zeolites which would be more conducive to plant growth is also investigated. A study is currently underway to examine the ability of zeolite/apatite mixtures to provide N, P, and K through dissolution and ion exchange. The development and characterization of simulated lunar regolith for preliminary experimentation are also discussed. The life support systems technology used on the Mercury, Gemini, Apollo, and Shuttle missions is reviewed and current research on regenerative life support systems technology for potential use in Space Station Freedom is discussed.

Description: The CELSS Breadboard Project is described, noting that it was initiated to study aspects of a CELSS for long-term space missions. Topics for extensive investigation included air and water regeneration, engineering control, and food production. The many options available for growing food crops in commercial plant growth chambers were investigated and the best of this information was translated to the Biomass Production Chamber (BPC). The chamber contains 20 sq m of crop growing area under 96 400 W HPS lamps; sixteen 0.25 sq m plant growth trays used on each of four growing shelves for a total of 64 trays; and one 256-L nutrient solution reservoir with the appropriate continuous-flow, thin-film plumbing for each shelf. A heating, ventilating, and air-conditioning system maintains atmospheric conditions and serves to distribute oxygen and carbon dioxide and maintain pressure at 12 mm of water. The control and monitoring subsystem, which uses a programmable logic controller, manages the BPC subsystems.

Description: Advantages and disadvantages of synthetic soils are discussed. It is pointed out that synthetic soils may provide the proper physical and chemical properties necessary to maximize plant growth, such as a toxic-free composition and cation exchange capacities. The importance of nutrient retention, aeration, moisture retention, and mechanical support as qualities for synthetic soils are stressed. Zeoponics, or the cultivation of plants in zeolite substrates that both contain essential plant-growth cations on their exchange sites and have minor amounts of mineral phases and/or anion-exchange resins that supply essential plant growth ions, is discussed. It is suggested that synthetic zeolites at lunar bases could provide adsorption media for separation of various gases, act as catalysts and as molecular sieves, and serve as cation exchangers in sewage-effluent treatment, radioactive-waste disposal, and pollution control. A flow chart of a potential zeoponics system illustrates this process.

Description: This paper investigates the efficiency of low- and high-atomic number materials used as protective shields against biologically effective radiation in doses equivalent to those expected in low-earth-orbit and interplanetary manned missions. Results are presented on calculations for single-material shields from polyethylene, water, Be, Al, Fe, and Ta and multilayer shelds made from the combinations of any two or any three of these materials, for both LEO and interplanetary conditions. It is shown that, whereas for protons and Galactic cosmic rays the ordering of shield materials has a negligible effect, for electrons and secondary bremsstrahlung, both the order and the composition are important parameters. It was found that low-atomic-number materials are most effective shields against protons and galactic cosmic rays, and are most effective in decreasing bremsstrahlung production, while high-atomic-number shields are the best attenuators of both primary electrons (if the dose is dominated by primary electrons) and secondary bremsstrahlung (if this is produced).

Description: NASA research on the functioning of biological systems in space and the resulting improvement in space suits and life-support systems is discussed. The centrifuge facility which will provide the major elements of a life science research facility for Spacelab and Space Station Freedom is described, and the Vestibular Research Facility for studying motion sickness in space is examined. The aluminum AX-5 space suit and the Controlled Ecological Life-Support System are described, and biomedical sensors for studying bone mass changes in space are discussed. Studies on the use of exercise to control tissue-fluid shifts in space are described.

Description: The operation and evaluation of a bioreactor designed for high intensity oxygen transfer in a microgravity environment is described. The reactor itself consists of a zero headspace liquid phase separated from the air supply by a long length of silicone rubber tubing through which the oxygen diffuses in and the carbon dioxide diffuses out. Mass transfer studies show that the oxygen is film diffusion controlled both externally and internally to the tubing and not by diffusion across the tube walls. Methods of upgrading the design to eliminate these resistances are proposed. Cell growth was obtained in the fermenter using Saccharomyces cerevisiae showing that this concept is capable of sustaining cell growth in the terrestrial simulation.

Description: A mixture of ammonium hydroxide with acetic acid and a slurry of human feces, urine, and wipes were used as CELSS model wastes to be wet-oxidized at temperatures from 250 to 500 C, i.e. below and above the critical point of water (374 C and 218 kg/sq cm or 21.4 MPa). The effects of oxidation temperature ( 250-500 C) and residence time (0-120 mn) on carbon and nitrogen and on metal corrosion from the reactor material were studied. Almost all of the organic matter in the model wastes was oxidized in the temperature range from 400 to 500 C, above the critical conditions for water. In contrast, only a small portion of the organic matter was oxidized at subcritical conditions. A substantial amount of nitrogen remained in solution in the form of ammonia at temperatures ranging from 350 to 450 C suggesting that, around 400 C, organic carbon is completely oxidized and most of the nitrogen is retained in solution. The Hastelloy C-276 alloy reactor corroded during subcritical and supercritical water oxidation.

Description: The production rate and solid content of waste streams found in a life support system for a space habitat (in which plants are grown for food) are discussed. Two recycling scenarios, derived from qualitative considerations as opposed to quantitative mass and energy balances, tradeoff studies, etc., are presented; they reflect differing emphases on and responses to the waste stream formation rates and their composition, as well as indicate the required products from waste treatment that are needed in a life support system. The data presented demonstrate the magnitude of the challenge to developing a life support system for a space habitat requiring a high degree of closure.

Description: Research and technology development issues centering on the recycling of materials within a bioregenerative life support system are reviewed. The importance of recovering waste materials for subsequent use is emphasized. Such material reclamation will substantially decrease the energy penalty paid for bioregenerative life support systems, and can potentially decrease the size of the system and its power demands by a significant amount. Reclamation of fixed nitrogen and the sugars in cellulosic materials is discussed.

Description: The photosynthesis and productivity of Lemna gibba is analyzed for CELSS based plant growth. Net photosynthesis of Lemna gibba is determined as a function of incident photosynthetic photon flux (PPF), with the light coming from above, below, or from both directions. Light from below is about 75 percent as effective as from above when the stand is sparse, but much less so with dense stands. High rates of photosynthesis are measured at 750 micromol / sq m per sec PPF and 1500 micromol/ mol CO2 at densities up to 660 g fresh weight (FW)/ sq m with young cultures. The analysis includes diagrams illustrating the net photosynthesis response to bilateral lighting of a sparse stand of low assimilate Lemna gibba; the effect of stand density on the net photosynthesis response to bilateral lighting of high assimilate Lemna gibba; the net photosynthesis response to ambient CO2 of sparse stands of Lemna gibba; and the time course of net photosynthesis and respiration per unit chamber and per unit dry weight of Lemna gibba.

Description: Several activities are performed related to the definition and creation of telerobotic systems. The effort and investment required to create architectures for these complex systems can be enormous; however, the magnitude of process can be reduced if structured design techniques are applied. A number of informal methodologies supporting certain aspects of the design process are available. More recently, prototypes of integrated tools supporting all phases of system design from requirements analysis to code generation and hardware layout have begun to appear. Activities related to system architecture of telerobots are described, including current activities which are designed to provide a methodology for the comparison and quantitative analysis of alternative system architectures.

Description: Two types of precedence relationship representations for mechanical assembly sequences are presented: precedence relationships between the establishment of one connection between two parts and the establishment of another connection, and precedence relationships between the establishment of one connection and states of the assembly process. Precedence relationship representations have the advantage of being very compact. The problem with these representations was how to guarantee their correctness and completeness. Two theorems are presented each of which leads to the generation of one type of precedence relationship representation guaranteeing its correctness and completeness for a class of assemblies.

Description: The analysis and development of a manipulator redundant in structure and sensor devices controlled by a distributed multiprocessor architecture are discussed. The goal has been the realization of a modular structure of the manipulator with evident aspects of flexibility and transportability. The distributed control structure, thanks to his modularity and flexibility could be integrated in the future into an operative structure aimed to space telerobotics. The architecture is applied to the 6 DOF manipulator Gilberto.

Description: The control of a multifingered hand slave in order to accurately exert arbitrary forces and impart small movements to a grasped object is, at present, a knotty problem in teleoperation. Although a number of articulated robotic hands have been proposed in the recent past for dexterous manipulation in autonomous robots, the possible use of such hands as slaves in teleoperated manipulation is hindered by the present lack of sensors in those hands, and (even if those sensors were available) by the inherent difficulty of transmitting to the master operator the complex sensations elicited by such sensors at the slave level. An analysis of different problems related to sensor-based telemanipulation is presented. The general sensory systems requirements for dexterous slave manipulators are pointed out and the description of a practical sensory system set-up for the developed robotic system is presented. The problem of feeding back to the human master operator stimuli that can be interpreted by his central nervous system as originated during real dexterous manipulation is then considered. Finally, some preliminary work aimed at developing an instrumented glove designed purposely for commanding the master operation and incorporating Kevlar tendons and tension sensors, is discussed.

Description: Reflected-force feedback is an important aspect of teleoperations. The objective is to determine the ability of the human operator to respond to that force. Telerobotics operation is simulated by computer control of a motor-driven device with capabilities for programmable force feedback and force measurement. A computer-controlled motor drive is developed that provides forces against the fingers as well as (angular) position control. A load cell moves in a circular arc as it is pushed by a finger and measures reaction forces on the finger. The force exerted by the finger on the load cell and the angular position are digitized and recorded as a function of time by the computer. Flexure forces of the index, long and ring fingers of the human hand in opposition to the motor driven load cell are investigated. Results of the following experiments are presented: (1) Exertion of maximum finger force as a function of angle; (2) Exertion of target finger force against a computer controlled force; and (3) Test of the ability to move to a target force against a force that is a function of position. Averaged over ten individuals, the maximum force that could be exerted by the index or long finger is about 50 Newtons, while that of the ring finger is about 40 Newtons. From the tests of the ability of a subject to exert a target force, it was concluded that reflected-force feedback can be achieved with the direct kinesthetic perception of force without the use of tactile or visual clues.

Description: After a brief tutorial on the NASA/National Bureau of Standards Standard Reference Model for Telerobot Control System Architecture (NASREM) functional architecture, the approach to its implementation is shown. First, interfaces must be defined which are capable of supporting the known algorithms. This is illustrated by considering the interfaces required for the SERVO level of the NASREM functional architecture. After interface definition, the specific computer architecture for the implementation must be determined. This choice is obviously technology dependent. An example illustrating one possible mapping of the NASREM functional architecture to a particular set of computers which implements it is shown. The result of choosing the NASREM functional architecture is that it provides a technology independent paradigm which can be mapped into a technology dependent implementation capable of evolving with technology in the laboratory and in space.

Description: Much of the technology planned for use in NASA's Flight Telerobotic Servicer (FTS) and the Demonstration Test Flight (DTF) is relatively new and untested. To provide the answers needed to design safe, reliable, and fully functional robotics for flight, NASA/GSFC is developing a robotics technology testbed for research of issues such as zero-g robot control, dual arm teleoperation, simulations, and hierarchical control using a high level programming language. The testbed will be used to investigate these high risk technologies required for the FTS and DTF projects. The robotics technology testbed is centered around the dual arm teleoperation of a pair of 7 degree-of-freedom (DOF) manipulators, each with their own 6-DOF mini-master hand controllers. Several levels of safety are implemented using the control processor, a separate watchdog computer, and other low level features. High speed input/output ports allow the control processor to interface to a simulation workstation: all or part of the testbed hardware can be used in real time dynamic simulation of the testbed operations, allowing a quick and safe means for testing new control strategies. The NASA/National Bureau of Standards Standard Reference Model for Telerobot Control System Architecture (NASREM) hierarchical control scheme, is being used as the reference standard for system design. All software developed for the testbed, excluding some of simulation workstation software, is being developed in Ada. The testbed is being developed in phases. The first phase, which is nearing completion, and highlights future developments is described.

Description: A study was conducted to develop a preliminary definition of the Flight Telerobotic Servicer (FTS) that could be used to understand the operational concepts and scenarios for the FTS. Called the Tinman, this design concept was also used to begin the process of establishing resources and interfaces for the FTS on Space Station Freedom, the National Space Transportation System shuttle orbiter, and the Orbital Maneuvering vehicle. Starting with an analysis of the requirements and task capabilities as stated in the Phase B study requirements document, the study identified eight major design drivers for the FTS. Each of these design drivers and their impacts on the Tinman design concept are described. Next, the planning that is currently underway for providing resources for the FTS on Space Station Freedom is discussed, including up to 2000 W of peak power, up to four color video channels, and command and data rates up to 500 kbps between the telerobot and the control station. Finally, an example is presented to show how the Tinman design concept was used to analyze task scenarios and explore the operational capabilities of the FTS. A structured methodology using a standard terminology consistent with the NASA/National Bureau of Standards Standard Reference Model for Telerobot Control System Architecture (NASREM) was developed for this analysis.

Description: Key to an efficient accomplishment of space station servicing operations is the development of a scenario where the presence of man in space is well integrated with the capability of teleoperated and automatic robot system outside the stations. Results focusing on mission requirements, trajectory sequences, propulsion subsystem features, and manipulative kit characteristics relevant to proximity servicing during a Man Tended Free Flyers Robotic Mission (MTFF-RM) are illustrated.

Description: An integration of 3-D vision systems with robot manipulators will allow robots to operate in a poorly structured environment by visually locating targets and obstacles. However, by using computer vision for objects acquisition makes the problem of overall system calibration even more difficult. Indeed, in a CAD based manipulation a control architecture has to find an accurate mapping between the 3-D Euclidean work space and a robot configuration space (joint angles). If a stereo vision is involved, then one needs to map a pair of 2-D video images directly into the robot configuration space. Neural Network approach aside, a common solution to this problem is to calibrate vision and manipulator independently, and then tie them via common mapping into the task space. In other words, both vision and robot refer to some common Absolute Euclidean Coordinate Frame via their individual mappings. This approach has two major difficulties. First a vision system has to be calibrated over the total work space. And second, the absolute frame, which is usually quite arbitrary, has to be the same with a high degree of precision for both robot and vision subsystem calibrations. The use of computer vision to allow robust fine motion manipulation in a poorly structured world which is currently in progress is described along with the preliminary results and encountered problems.

Description: Telerobotics studies remote control of distant robots by a human operator using supervisory or direct control. Even if the robot manipulators has vision or other senses, problems arise involving control, communications, and delay. The communication delays that may be expected with telerobots working in space stations while being controlled from an Earth lab have led to a number of experiments attempting to circumvent the problem. This delay in communication is a main motivating factor in moving from well understood instantaneous hands-on manual control to less well understood supervisory control; the ultimate step would be the realization of a fully autonomous robot. The 3-D model control plays a crucial role in resolving many conflicting image processing problems that are inherent in resolving in the bottom-up approach of most current machine vision processes. The 3-D model control approach is also capable of providing the necessary visual feedback information for both the control algorithms and for the human operator.

Description: An adaptive control algorithm is proposed for a class of nonlinear systems, such as robotic manipulators, which is capable of improving its performance in repetitive motions. When the task is repeated, the error between the desired trajectory and that of the system is guaranteed to decrease. The design is based on the combination of a direct adaptive control and a learning process. This method does not require any knowledge of the dynamic parameters of the system.

Description: The Flight Telerobotic Servicer (FTS) program will require an ability to develop, in a cost effective manner, many simulation models for design, analysis, performance evaluation, and crew training. Computational speed and the degree of modeling fidelity associated with each simulation must be commensurate with problem objectives. To demonstrate evolving state-of-the-art general purpose multibody modeling capabilities, to validate these by laboratory testing, and to expose their modeling shortcomings, two focus problems at the opposite ends of the simulation spectrum are defined: (1) Coarse Acquisition Control Dynamics. Create a real time man-in-the-control-loop simulator. Provide animated graphical display of robot arm dynamics and tactile feedback sufficient for cueing the operator. Interface simulator software with human operated tactile feedback controller; i.e., the Kraft mini-master. (2) Fine, Precision Mode Control Dynamics. Create a high speed, high fidelity simulation model for the design, analysis, and performance evaluation of autonomous 7 degree-of-freedom (DOF) trajectory control algorithms. This model must contain detail dynamic models for all significant dynamics elements within the robot arm, such as joint drive mechanisms.

Description: The Flight Telerobotic Servicer (FTS) is being developed by the Goddard Space Flight Center (GSFC) for performing a variety of assembly, servicing, inspection and maintenance tasks on the Space Station. The Project Office at GSFC has tasked the Engineering Directorate to assemble a robotics research and development program which will support the FTS project. The activities center around support for the Development Test Flight (DTF) on the Space Shuttle and investigations of operational problems associated with the FTS on Space Station Freedom. For the DTF, areas such as control algorithms, safety systems, and end-effectors will be developed. For FTS operations, the emphasis will be to develop a dual-arm bi-lateral force-reflecting teleoperator and use it as an FTS Operational Simulator (FTSOS). The simulator will be used to investigate operational techniques, camera configurations, operator interfacing, orbital replacement unit (ORU) designs, end-effector designs, and training techniques. After a series of test activities, reports will be generated for input to the DTF and FTS designs.

Description: The definition of manipulability ellipsoids for dual robot systems is given. A suitable kineto-static formulation for dual cooperative robots is adopted which allows for a global task space description of external and internal forces, and relative velocities. The well known concepts of force and velocity manipulability ellipsoids for a single robot are formally extended and the contributions of the two single robots to the cooperative system ellipsoids are illustrated. Duality properties are discussed. A practical case study is developed.

Description: The manipulator design discussed here results from the examination of some of the reasons why redundancy is necessary in general purpose manipulation systems. A spherical joint design actuated in-parallel, having the many advantages of parallel actuation, is described. In addition, the benefits of using redundant actuators are discussed and illustrated in the design by the elimination of loci of singularities from the usable workspace with the addition of only one actuator. Finally, what is known by the authors about space robotics requirements is summarized and the relevance of the proposed design matched against these requirements. The design problems outlined here are viewed as much from the mechanical engineering aspect as from concerns arising from the control and the programming of manipulators.

Description: The presence of redundant degrees of freedom in a manipulator structure leads to a physical phenomenon known as a self-motion, which is a continuous motion of the manipulator joints that leaves the end-effector motionless. In the first part of the paper, a global manifold mapping reformulation of manipulator kinematics is reviewed, and the inverse kinematic solution for redundant manipulators is developed in terms of self-motion manifolds. Global characterizations of the self-motion manifolds in terms of their number, geometry, homotopy class, and null space are reviewed using examples. Much previous work in redundant manipulator control has been concerned with the redundancy resolution problem, in which methods are developed to determine, or resolve, the motion of the joints in order to achieve end-effector trajectory control while optimizing additional objective functions. Redundancy resolution problems can be equivalently posed as the control of self-motions. Alternatives for redundancy resolution are briefly discussed.

Description: The U.S. Bureau of Mines is approaching the problems of accidents and efficiency in the mining industry through the application of automation and robotics to mining systems. This technology can increase safety by removing workers from hazardous areas of the mines or from performing hazardous tasks. The short-term goal of the Automation and Robotics program is to develop technology that can be implemented in the form of an autonomous mining machine using current continuous mining machine equipment. In the longer term, the goal is to conduct research that will lead to new intelligent mining systems that capitalize on the capabilities of robotics. The Bureau of Mines Automation and Robotics program has been structured to produce the technology required for the short- and long-term goals. The short-term goal of application of automation and robotics to an existing mining machine, resulting in autonomous operation, is expected to be accomplished within five years. Key technology elements required for an autonomous continuous mining machine are well underway and include machine navigation systems, coal-rock interface detectors, machine condition monitoring, and intelligent computer systems. The Bureau of Mines program is described, including status of key technology elements for an autonomous continuous mining machine, the program schedule, and future work. Although the program is directed toward underground mining, much of the technology being developed may have applications for space systems or mining on the Moon or other planets.

Description: The approach for arriving at design guidelines for assembly by robots in outerspace is illustrated. The use of robots in a zero gravity environment necessitates that extra factors over and above normal design guidelines be taken into account. Besides, many of the guidelines for assembly by robots on earth do not apply in space. However, considering the axioms for normal design and assembly as one set, guidelines for design and robotic assembly as another, and guidelines for design and assembly in space as the third set, unions and intersections of these sets can generate guidelines for two or more of these conditions taken together - say design and manual assembly in space. Therein lies the potential to develop expert systems in the future, which would use an exhaustive database and similar guidelines to arrive at those required by a superposition of these conditions.

Description: Most robotic systems today are designed one at a time, at a high cost of time and money. This wasteful approach has been necessary because the industry has not established a foundation for the continued evolution of intelligent machines. The next generation of robots will have to be generic, versatile machines capable of absorbing new technology rapidly and economically. This approach is demonstrated in the success of the personal computer, which can be upgraded or expanded with new software and hardware at virtually every level. Modularity is perceived as a major opportunity to reduce the 6 to 7 year design cycle time now required for new robotic manipulators, greatly increasing the breadth and speed of diffusion of robotic systems in manufacturing. Modularity and its crucial role in the next generation of intelligent machines are the focus of interest. The main advantages that modularity provides are examined; types of modules needed to create a generic robot are discussed. Structural modules designed by the robotics group at the University of Texas at Austin are examined to demonstrate the advantages of modular design.

Description: An experimental study was conducted to determine the effects of various forms of visual and force feedback on human performance for several telemanipulation tasks. Experiments were conducted with varying frame rates and subtended visual angles, with and without force feedback.

Description: Data describing the microsurgeon's hand dynamics was recorded and analyzed in order to provide an accurate model for the telemicrosurgery application of the Bimanual Telemicro-operation Test Bed. The model, in turn, will guide the development of algorithms for the control of robotic systems in bimanual telemicro-operation tasks. Measurements were made at the hand-tool interface and include position, acceleration and force between the tool-finger interface. Position information was captured using an orthogonal pulsed magnetic field positioning system resulting in measurements in all six degrees-of-freedom (DOF). Acceleration data at the hands was obtained using accelerometers positioned in a triaxial arrangement on the back of the hand allowing measurements in all three cartesian-coordinate axes. Force data was obtained by using miniature load cells positioned between the tool and the finger and included those forces experienced perpendicular to the tool shaft and those transferred from the tool-tissue site. Position data will provide a minimum/maximum reference frame for the robotic system's work space or envelope. Acceleration data will define the response times needed by the robotic system in order to emulate and subsequently outperform the human operator's tool movements. The force measurements will aid in designing a force-reflective, force-scaling system as well as defining the range of forces the robotic system will encounter. All analog data was acquired by a 16-channel analog-to-digital conversion system residing in a IBM PC/AT-compatible computer at the Center's laboratory. The same system was also used to analyze and present the data.

Description: A new and simple approach to configuration control of redundant manipulators is presented. In this approach, the redundancy is utilized to control the manipulator configuration directly in task space, where the task will be performed. A number of kinematic functions are defined to reflect the desirable configuration that will be achieved for a given end-effector position. The user-defined kinematic functions and the end-effector Cartesian coordinates are combined to form a set of task-related configuration variables as generalized coordinates for the manipulator. An adaptive scheme is then utilized to globally control the configuration variables so as to achieve tracking of some desired reference trajectories. This accomplishes the basic task of desired end-effector motion, while utilizing the redundancy to achieve any additional task through the desired time variation of the kinematic functions. The control law is simple and computationally very fast, and does not require the complex manipulator dynamic model.

Description: A frequent complaint in the computer oriented trade journals is that current hardware technology is progressing so quickly that software developers cannot keep up. A example of this phenomenon can be seen in the field of microcomputer graphics. To exploit the advantages of new mechanisms of information storage and retrieval, new approaches must be made towards incorporating existing programs as well as developing entirely new applications. A particular area of need is the correlation of discrete image elements to textural information. The interactive digital video (IDV) interface embodies a new concept in software design which addresses these needs. The IDV interface is a patented device and language independent process for identifying image features on a digital video display and which allows a number of different processes to be keyed to that identification. Its capabilities include the correlation of discrete image elements to relevant text information and the correlation of these image features to other images as well as to program control mechanisms. Sophisticated interrelationships can be set up between images, text, and program control mechanisms.

Description: Medical illustration is a field of visual communication with a long history. Traditional medical illustrations are static, 2-D, printed images; highly realistic depictions of the gross morphology of anatomical structures. Today medicine requires the visualization of structures and processes that have never before been seen. Complex 3-D spatial relationships require interpretation from 2-D diagnostic imagery. Pictures that move in real time have become clinical and research tools for physicians. Medical illustrators are involved with the development of interactive visual displays for three different, but not discrete, functions: as educational materials, as clinical and research tools, and as data bases of standard imagery used to produce visuals. The production of interactive displays in the medical arts is examined.

Description: One of the most remarkable perceptual properties of common experience is that the perceived shapes of known objects are constant despite movements about them which transform their projections on the retina. This perceptual ability is one aspect of shape constancy (Thouless, 1931; Metzger, 1953; Borresen and Lichte, 1962). It requires that the viewer be able to sense and discount his or her relative position and orientation with respect to a viewed object. This discounting of relative position may be derived directly from the ranging information provided from stereopsis, from motion parallax, from vestibularly sensed rotation and translation, or from corollary information associated with voluntary movement. It is argued that: (1) errors in exocentric judgements of the azimuth of a target generated on an electronic perspective display are not viewpoint-independent, but are influenced by the specific geometry of their perspective projection; (2) elimination of binocular conflict by replacing electronic displays with actual scenes eliminates a previously reported equidistance tendency in azimuth error, but the viewpoint dependence remains; (3) the pattern of exocentrically judged azimuth error in real scenes viewed with a viewing direction depressed 22 deg and rotated + or - 22 deg with respect to a reference direction could not be explained by overestimation of the depression angle, i.e., a slant overestimation.

Description: Pictorial displays whose primary purpose is to convey accurate information about the 3-D spatial layout of an environment are discussed. How and how well, pictures can convey such information is discussed. It is suggested that picture perception is not best approached as a unitary, indivisible process. Rather, it is a complex process depending on multiple, partially redundant, interacting sources of visual information for both the real surface of the picture and the virtual space beyond. Each picture must be assessed for the particular information that it makes available. This will determine how accurately the virtual space represented by the picture is seen, as well as how it is distorted when seen from the wrong viewpoint.

Description: Systematic errors in perception and memory present a challenge to theories of perception and memory and to applied psychologists interested in overcoming them as well. A number of systematic errors in memory for maps and graphs are reviewed, and they are accounted for by an analysis of the perceptual processing presumed to occur in comprehension of maps and graphs. Visual stimuli, like verbal stimuli, are organized in comprehension and memory. For visual stimuli, the organization is a consequence of perceptual processing, which is bottom-up or data-driven in its earlier stages, but top-down and affected by conceptual knowledge later on. Segregation of figure from ground is an early process, and figure recognition later; for both, symmetry is a rapidly detected and ecologically valid cue. Once isolated, figures are organized relative to one another and relative to a frame of reference. Both perceptual (e.g., salience) and conceptual factors (e.g., significance) seem likely to affect selection of a reference frame. Consistent with the analysis, subjects perceived and remembered curves in graphs and rivers in maps as more symmetric than they actually were. Symmetry, useful for detecting and recognizing figures, distorts map and graph figures alike. Top-down processes also seem to operate in that calling attention to the symmetry vs. asymmetry of a slightly asymmetric curve yielded memory errors in the direction of the description. Conceptual frame of reference effects were demonstrated in memory for lines embedded in graphs. In earlier work, the orientation of map figures was distorted in memory toward horizontal or vertical. In recent work, graph lines, but not map lines, were remembered as closer to an imaginary 45 deg line than they had been. Reference frames are determined by both perceptual and conceptual factors, leading to selection of the canonical axes as a reference frame in maps, but selection of the imaginary 45 deg as a reference frame in graphs.

Description: The status of motion as a minimal information source for perceiving the environmental properties of surface segregation, three-dimensional (3-D) form, displacement, and dynamics is discussed. The selection of these particular properties was motivated by a desire to present research on perceiving properties that span the range of dimensional complexity.

Description: The classical notion of how things are seen is that perception is passive, that the eyes are windows, and in floods reality. Physiological work of the 19th century cast doubt on this view that perception is passive acceptance of reality. Perception is not at the present time a popular topic for philosophers. This must be partly because scientific accounts of perception have now gone a long way away from appearances. They depend on physiological and psycho-physical experiments which require technical investigation and do not fall within traditional concepts of philosophy. Theories of visual perception are examined, both from a physical and psycho-physical standpoint.

Description: Recent development in video technology, such as the liquid crystal displays and shutters, have made it feasible to incorporate stereoscopic depth into the 3-D representations on 2-D displays. However, depth has already been vividly portrayed in video displays without stereopsis using the classical artists' depth cues described by Helmholtz (1866) and the dynamic depth cues described in detail by Ittleson (1952). Successful static depth cues include overlap, size, linear perspective, texture gradients, and shading. Effective dynamic cues include looming (Regan and Beverly, 1979) and motion parallax (Rogers and Graham, 1982). Stereoscopic depth is superior to the monocular distance cues under certain circumstances. It is most useful at portraying depth intervals as small as 5 to 10 arc secs. For this reason it is extremely useful in user-video interactions such as telepresence. Objects can be manipulated in 3-D space, for example, while a person who controls the operations views a virtual image of the manipulated object on a remote 2-D video display. Stereopsis also provides structure and form information in camouflaged surfaces such as tree foliage. Motion parallax also reveals form; however, without other monocular cues such as overlap, motion parallax can yield an ambiguous perception. For example, a turning sphere, portrayed as solid by parallax can appear to rotate either leftward or rightward. However, only one direction of rotation is perceived when stereo-depth is included. If the scene is static, then stereopsis is the principal cue for revealing the camouflaged surface structure. Finally, dynamic stereopsis provides information about the direction of motion in depth (Regan and Beverly, 1979). Clearly there are many spatial constraints, including spatial frequency content, retinal eccentricity, exposure duration, target spacing, and disparity gradient, which - when properly adjusted - can greatly enhance stereodepth in video displays.

Description: Observers frequently underestimate the in-depth slant of rectangles under reduction conditions. This also occurs for slanted rectangles depicted on a flat display medium. Perrone (1982) provides a model for judged slant based upon properties of the 2-D trapezoidal projection of the rectangle. Two important parameters of this model are the angle of convergence of the sides of the trapezoid and the projected length of the trapezoid. This model was tested using a range of stimulus rectangles and found that the model failed to predict some of the major trends in the data. However, when the projected width of the base of the trapezoid projection was used in the model, instead of the projected length, excellent agreement between the theoretical and obtained slant judgements resulted. The good fit between the experimental data and the new model predictions indicates that perceived slant estimates are highly correlated with specifiable features in the stimulus display.

Description: Limited cue, open-loop tasks in which a human observer indicates distances or relations among distances are discussed. By open-loop tasks, it is meant tasks in which the observer gets no feedback as to the accuracy of the responses. What happens when cues are added and when the loop is closed are considered. The implications of this research for the effectiveness of visual displays is discussed. Errors in visual distance tasks do not necessarily mean that the percept is in error. The error could arise in transformations that intervene between the percept and the response. It is argued that the percept is in error. It is also argued that there exist post-perceptual transformations that may contribute to the error or be modified by feedback to correct for the error.

Description: Experiences raise a number of concerns for future spatial-display developers. While the promise of spatial displays is great, the cost of their development will be correspondingly large. The knowledge and skills which must be coordinated to ensure successful results is unprecedent. From the viewpoint of the designer, basic knowledge of how human beings perceive and process complex displays appears fragmented and largely unquantified. Methodologies for display development require prototyping and testing with subject pilots for even small changes. Useful characterizations of the range of differences between individual users is nonexistent or at best poorly understood. The nature, significance, and frequency of interpretation errors associated with complex integrated displays is unexplored and undocumented territory. Graphic displays have intuitive appeal and can achieve face validity much more readily than earlier symbolic displays. The risk of misleading the pilot is correspondingly greater. Thus while some in the research community are developing the tools and techniques necessary for effective spatial-display development, potential users must be educated about the issues so that informed choices can be made. The scope of the task facing all is great. The task is challenging and the potential for meaningful contributions at all levels is high indeed.

Description: In each of two studies, subjects were exposed to a continuously changing prismatic displacement with a mean value of 19 prism diopters (variable displacement) and to a fixed 19-diopter displacement (fixed displacement). In Experiment 1, significant adaptation (post-pre shifts in hand-eye coordination) was found for fixed, but not for variable, displacement. Experiment 2 demonstrated that adaptation was obtained for variable displacement, but it was very fragile and is lost if the measures of adaptation are preceded by even a very brief exposure of the hand to normal or near-normal vision. Contrary to the results of some previous studies, an increase in within-S dispersion was not found of target pointing responses as a result of exposure to variable displacement.

Description: Displays are now being used extensively throughout the society. More and more time is spent watching television, movies, computer screens, etc. Furthermore, in an increasing number of cases, the observer interacts with the display and plays the role of operator as well as observer. To a large extent, the normal behavior in the normal environment can also be thought of in these same terms. Taking liberties with Shakespeare, it might be said, all the world's a display and all the individuals in it are operators in and on the display. Within this general context of interactive display systems, a discussion is began with a conceptual overview of a particular class of such systems, namely, teleoperator systems. The notion is considered of telepresence and the factors that limit telepresence, including decorrelation between the: (1) motor output of the teleoperator as sensed directly via the kinesthetic/tactual system, and (2) the motor output of the teleoperator as sensed indirectly via feedback from the slave robot, i.e., via a visual display of the motor actions of the slave robot. Finally, the deleterious effect of time delay (a particular decorrelation) on sensory-motor adaptation (an important phenomenon related to telepresence) is examined.

Description: The user interface of a computer system is a visual display that provides information about the status of operations on data within the computer and control options to the user that enable adjustments to these operations. From the very beginning of computer technology the user interface was a spatial display, although its spatial features were not necessarily complex or explicitly recognized by the users. All text and nonverbal signs appeared in a virtual space generally thought of as a single flat plane of symbols. Current technology of high performance workstations permits any element of the display to appear as dynamic, multicolor, 3-D signs in a virtual 3-D space. The complexity of appearance and the user's interaction with the display provide significant challenges to the graphic designer of current and future user interfaces. In particular, spatial depiction provides many opportunities for effective communication of objects, structures, processes, navigation, selection, and manipulation. Issues are presented that are relevant to the graphic designer seeking to optimize the user interface's spatial attributes for effective visual communication.

Description: For better or worse, virtual imaging displays are with us in the form of narrow-angle combining-glass presentations, head-up displays (HUD), and head-mounted projections of wide-angle sensor-generated or computer-animated imagery (HMD). All military and civil aviation services and a large number of aerospace companies are involved in one way or another in a frantic competition to develop the best virtual imaging display system. The success or failure of major weapon systems hangs in the balance, and billions of dollars in potential business are at stake. Because of the degree to which national defense is committed to the perfection of virtual imaging displays, a brief consideration of their status, an investigation and analysis of their problems, and a search for realistic alternatives are long overdue.

Description: Spatial displays, and a constraint that they do not place on the use of spatial instruments are discussed. Much of the work done in visual perception by psychologists and by computer scientists has concerned displays that show the motion of rigid objects. Typically, if one assumes that objects are rigid, one can then proceed to understand how the constant shape of the object can be perceived (or computed) as it moves through space. The author maintains that photographs and cinema are visual displays that are also powerful forms of art. Their efficacy, in part, stems from the fact that, although viewpoint is constrained when composing them, it is not nearly so constrained when viewing them. It is obvious, according to the author, that human visual systems did not evolve to watch movies or look at photographs. Thus, what photographs and movies present must be allowed in the rule-governed system under which vision evolved. Machine-vision algorithms, to be applicable to human vision, should show the same types of tolerance.

Description: Converging evidence from several sources indicates that two distinct representations of visual space mediate perception and visually guided behavior, respectively. The two maps of visual space follow different rules; spatial values in either one can be biased without affecting the other. Ordinarily the two maps give equivalent responses because both are veridically in register with the world; special techniques are required to pull them apart. One such technique is saccadic suppression: small target displacements during saccadic eye movements are not preceived, though the displacements can change eye movements or pointing to the target. A second way to separate cognitive and motor-oriented maps is with induced motion: a slowly moving frame will make a fixed target appear to drift in the opposite direction, while motor behavior toward the target is unchanged. The same result occurs with stroboscopic induced motion, where the frame jump abruptly and the target seems to jump in the opposite direction. A third method of separating cognitive and motor maps, requiring no motion of target, background or eye, is the Roelofs effect: a target surrounded by an off-center rectangular frame will appear to be off-center in the direction opposite the frame. Again the effect influences perception, but in half of the subjects it does not influence pointing to the target. This experience also reveals more characteristics of the maps and their interactions with one another, the motor map apparently has little or no memory, and must be fed from the biased cognitive map if an enforced delay occurs between stimulus presentation and motor response. In designing spatial displays, the results mean that what you see isn't necessarily what you get. Displays must be designed with either perception or visually guided behavior in mind.

Description: The extent to which perceptual judgements within egocentric and exocentric frames of reference are subject to illusory disturbances and long term modifications is discussed. It is argued that well known spatial illusions, such as the oculogyral illusion and induced visual motion have usually been discussed without proper attention being paid to the frame of reference within which they occur, and that this has led to the construction of inadequate theories and inappropriate procedures for testing them.

Description: Principles for the design of dynamic spatial instruments for communicating quantitative information to viewers are considered through a brief review of the history of pictorial communication. Pictorial communication is seen to have two directions: (1) from the picture to the viewer; and (2) from the viewer to the picture. Optimization of the design of interactive instruments using pictorial formats requires an understanding of the manipulative, perceptual, and cognitive limitations of human viewers.

Description: The preflight planning, analysis, procedures development, and operations support for the Space Transportation System payload deployment and retrieval missions utilizing the Shuttle Remote Manipulator System are summarized. Analysis of the normal operational loads and failure induced loads and motion are factored into all procedures. Both the astronaut flight crews and the Mission Control Center flight control teams receive considerable training for standard and mission specific operations. The real time flight control team activities are described.

Description: A representation is discussed of symbolic temporal relations, called IxTeT, that is both powerful enough at the reasoning level for tasks such as plan generation, refinement and modification, and efficient enough for dealing with real time constraints in action monitoring and reactive planning. Such representation for dealing with time is needed in a teleoperated space robot. After a brief survey of known approaches, the proposed representation shows its computational efficiency for managing a large data base of temporal relations. Reactive planning with IxTeT is described and exemplified through the problem of mission planning and modification for a simple surveying satellite.

Description: Part of the activity in the area of collision avoidance related to the Hermes spaceplane is reported. A collision avoidance software system which was defined, developed and implemented in this project is presented. It computes the intersection between the solids representing the arm, the payload, and the objects. It is feasible with respect to the resources available on board, considering its performance.

Description: Complex force reflective teleoperation systems are often very difficult to analyze due to the large number of components and control loops involved. One mode of a force reflective teleoperator is described. An analysis of the performance of the system based on a linear analysis of the general full order model is presented. Reduced order models are derived and correlated with the full order models. Basic effects of force feedback and position feedback are examined and the effects of time delays between the master and slave are studied. The results show that with symmetrical position-position control of teleoperators, a basic trade off must be made between the intersystem stiffness of the teleoperator, and the impedance felt by the operator in free space.

Description: A series of ten task levels of increasing difficulty was compiled for use in comparative performance evaluations of available and future robotics technology. Each level has a breakdown of ten additional levels of difficulty to provide a layering of 100 levels. It is assumed that each level of task performance must be achieved by the system before it can be appropriately considered for the next level.

Description: The human factors design process in developing a shuttle orbiter aft flight deck workstation testbed is described. In developing an operator workstation to control various laboratory telerobots, strong elements of human factors engineering and ergonomics are integrated into the design process. The integration of human factors is performed by incorporating user feedback at key stages in the project life-cycle. An operator centered design approach helps insure the system users are working with the system designer in the design and operation of the system. The design methodology is presented along with the results of the design and the solutions regarding human factors design principles.

Description: The force-reflecting teleoperator breadboard is described. It is the first system among available Research and Development systems with the following combined capabilities: (1) The master input device is not a replica of the slave arm. It is a general purpose device which can be applied to the control of different robot arms through proper mathematical transformations. (2) Force reflection generated in the master hand controller is referenced to forces and moments measured by a six DOF force-moment sensor at the base of the robot hand. (3) The system permits a smooth spectrum of operations between full manual, shared manual and automatic, and full automatic (called traded) control. (4) The system can be operated with variable compliance or stiffness in force-reflecting control. Some of the key points of the system are the data handling and computing architecture, the communication method, and the handling of mathematical transformations. The architecture is a fully synchronized pipeline. The communication method achieves optimal use of a parallel communication channel between the local and remote computing nodes. A time delay box is also implemented in this communication channel permitting experiments with up to 8 sec time delay. The mathematical transformations are computed faster than 1 msec so that control at each node can be operated at 1 kHz servo rate without interpolation. This results in an overall force-reflecting loop rate of 200 Hz.

Description: The motions of robotic manipulators mounted on spacecraft can disturb the spacecraft's positions and attitude. These disturbances can surpass the ability of the system's attitude control reaction jets to control them, for the disturbances increase as manipulator speeds increase. If the manipulator moves too quickly the resulting disturbances can exceed the saturation levels of the reaction jets, causing excessive spacecraft motions. A method for planning space manipulator's motions is presented, so that tasks can be performed as quickly as possible without saturating the system's attitude control jets.

Description: Control problems of sampled data systems which are subject to random sample rate variations and delays are studied. Due to the rapid growth of the use of computers more and more systems are controlled digitally. Complex systems such as space telerobotic systems require the integration of a number of subsystems at different hierarchical levels. While many subsystems may run on a single processor, some subsystems require their own processor or processors. The subsystems are integrated into functioning systems through communications. Communications between processes sharing a single processor are also subject to random delays due to memory management and interrupt latency. Communications between processors involve random delays due to network access and to data collisions. Furthermore, all control processes involve delays due to casual factors in measuring devices and to signal processing. Traditionally, sampling rates are chosen to meet the worst case communication delay. Such a strategy is wasteful as the processors are then idle a great proportion of the time; sample rates are not as high as possible resulting in poor performance or in the over specification of control processors; there is the possibility of missing data no matter how low the sample rate is picked. Asymptotical stability with probability one for randomly sampled multi-dimensional linear systems is studied. A sufficient condition for the stability is obtained. This condition is so simple that it can be applied to practical systems. A design procedure is also shown.

Description: A layered-abduction model of perception is presented which unifies bottom-up and top-down processing in a single logical and information-processing framework. The process of interpreting the input from each sense is broken down into discrete layers of interpretation, where at each layer a best explanation hypothesis is formed of the data presented by the layer or layers below, with the help of information available laterally and from above. The formation of this hypothesis is treated as a problem of abductive inference, similar to diagnosis and theory formation. Thus this model brings a knowledge-based problem-solving approach to the analysis of perception, treating perception as a kind of compiled cognition. The bottom-up passing of information from layer to layer defines channels of information flow, which separate and converge in a specific way for any specific sense modality. Multi-modal perception occurs where channels converge from more than one sense. This model has not yet been implemented, though it is based on systems which have been successful in medical and mechanical diagnosis and medical test interpretation.

Description: Robotics research has begun to address the modeling and implementation of a wide variety of unstructured tasks. Examples include automated navigation, platform servicing, custom fabrication and repair, deployment and recovery, and science exploration. Such tasks are poorly described at onset; the workspace layout is partially unfamiliar, and the task control sequence is only qualitatively characterized. The robot must model the workspace, plan detailed physical actions from qualitative goals, and adapt its instantaneous control regimes to unpredicted events. Developing robust representations and computational approaches for these sensing, planning, and control functions is a major challenge. The underlying domain constraints are very general, and seem to offer little guidance for well-bounded approximation of object shape and motion, manipulation postures and trajectories, and the like. This generalized modeling problem is discussed, with an emphasis on the role of sensing. It is also discussed that unstructured tasks often have, in fact, a high degree of underlying physical symmetry, and such implicit knowledge should be drawn on to model task performance strategies in a methodological fashion. A group-theoretic decomposition of the workspace organization, task goals, and their admissible interactions are proposed. This group-mechanical approach to task representation helps to clarify the functional interplay of perception and control, in essence, describing what perception is specifically for, versus how it is generically modeled. One also gains insight how perception might logically evolve in response to needs of more complex motor skills. It is discussed why, of the many solutions that are often mathematically admissible to a given sensory motor-coordination problem, one may be preferred over others.

Description: The European Columbus Scenario is established. One of the Columbus Elements, the Man Tended Free Flyer will be designed for fully autonomous operation in order to provide the environment for micro gravity facilities. The Concept of an autonomous automation system which perform servicing of facilities and deals with related logistic tasks is discussed.

Description: The concepts and main elements of a RObot Technology EXperiment (ROTEX) proposed to fly with the next German spacelab mission, D2, are presented. It provides a 1 meter size, six axis robot inside a spacelab rack, equipped with a multisensory gripper (force-torque sensors, an array of range finders, and mini stereo cameras). The robot will perform assembly and servicing tasks in a generic way, and will grasp a floating object. The man machine and supervisory control concepts for teleoperation from the spacelab and from ground are discussed. The predictive estimation schemes for an extensive use of time-delay compensating 3D computer graphics are explained.

Description: A simple dynamic model proposed for flexible links is briefly reviewed and experimental control results are presented for different flexible systems. A simple dynamic model is useful for rapid prototyping of manipulators and their control systems, for possible application to manipulator design decisions, and for real time computation as might be applied in model based or feedforward control. Such a model is proposed, with the further advantage that clear physical arguments and explanations can be associated with its simplifying features and with its resulting analytical properties. The model is mathematically equivalent to Rayleigh's method. Taking the example of planar bending, the approach originates in its choice of two amplitude variables, typically chosen as the link end rotations referenced to the chord (or the tangent) motion of the link. This particular choice is key in establishing the advantageous features of the model, and it was used to support the series of experiments reported.

Description: A decentralized trajectory controller for robotic manipulators is designed and tested using a multiprocessor architecture and a PUMA 560 robot arm. The controller is made up of a nominal model-based component and a correction component based on a variable structure suction control approach. The second control component is designed using bounds on the difference between the used and actual values of the model parameters. Since the continuous manipulator system is digitally controlled along a trajectory, a discretized equivalent model of the manipulator is used to derive the controller. The motivation for decentralized control is that the derived algorithms can be executed in parallel using a distributed, relatively inexpensive, architecture where each joint is assigned a microprocessor. Nonlinear interaction and coupling between joints is treated as a disturbance torque that is estimated and compensated for.

Description: There is a growing need for humans to perform complex remote operations and to extend the intelligence and experience of experts to distant applications. It is asserted that a blending of human intelligence, modern information technology, remote control, and intelligent autonomous systems is required, and have coined the term tele-autonomous technology, or tele-automation, for methods producing intelligent action at a distance. Tele-automation goes beyond autonomous control by blending in human intelligence. It goes beyond tele-operation by incorporating as much autonomy as possible and/or reasonable. A new approach is discussed for solving one of the fundamental problems facing tele-autonomous systems: The need to overcome time delays due to telemetry and signal propagation. New concepts are introduced called time and position clutches, that allow the time and position frames between the local user control and the remote device being controlled, to be desynchronized respectively. The design and implementation of these mechanisms are described in detail. It is demonstrated that these mechanisms lead to substantial telemanipulation performance improvements, including the result of improvements even in the absence of time delays. The new controls also yield a simple protocol for control handoffs of manipulation tasks between local operators and remote systems.

Description: The design, construction, control and application of a three fingered robot hand with nine degrees of freedom and built-in multi-component force sensors is described. The adopted gripper kinematics are justified and optimized with respect to grasping and manipulation flexibility. The hand was constructed with miniature motor drive systems imbedded into the fingers. The control is hierarchically structured and is implemented on a simple PC-AT computer. The hand's dexterity and intelligence are demonstrated with some experiments.

Description: The Jet Propulsion Laboratory's (JPL) Telerobot Testbed is an integrated robotic testbed used to develop, implement, and evaluate the performance of advanced concepts in autonomous, tele-autonomous, and tele-operated control of robotic manipulators. Using the Telerobot Testbed, researchers demonstrated several of the capabilities and technological advances in the control and integration of robotic systems which have been under development at JPL for several years. In particular, the Telerobot Testbed was recently employed to perform a near completely automated, end-to-end, satellite grapple and repair sequence. The task of integrating existing as well as new concepts in robot control into the Telerobot Testbed has been a very difficult and timely one. Now that researchers have completed the first major milestone (i.e., the end-to-end demonstration) it is important to reflect back upon experiences and to collect the knowledge that has been gained so that improvements can be made to the existing system. It is also believed that the experiences are of value to the others in the robotics community. Therefore, the primary objective here will be to use the Telerobot Testbed as a case study to identify real problems and technological gaps which exist in the areas of robotics and in particular systems integration. Such problems have surely hindered the development of what could be reasonably called an intelligent robot. In addition to identifying such problems, researchers briefly discuss what approaches have been taken to resolve them or, in several cases, to circumvent them until better approaches can be developed.

Description: The purpose is to review a variety of trajectory generation techniques which may be applied to space telerobots and to identify problems which need to be addressed in future telerobot motion control systems. As a starting point for the development of motion generation systems for space telerobots, the operation and limitations of traditional path-oriented trajectory generation approaches are discussed. This discussion leads to a description of more advanced techniques which have been demonstrated in research laboratories, and their potential applicability to space telerobots. Examples of this work include systems that incorporate sensory-interactive motion capability and optimal motion planning. Additional considerations which need to be addressed for motion control of a space telerobot are described, such as redundancy resolution and the description and generation of constrained and multi-armed cooperative motions. A task decomposition module for a hierarchical telerobot control system which will serve as a testbed for trajectory generation approaches which address these issues is also discussed briefly.

Description: Robot manipulators are designed to perform tasks which would otherwise be executed by a human operator. No manipulator can even approach the speed and accuracy with which humans execute these tasks. But manipulators have the capability to exceed human ability in one particular area: strength. Through any reasonable observation and experience, the human's ability to perform a variety of physical tasks is limited not by his intelligence, but by his physical strength. If, in the appropriate environment, we can more closely integrate the mechanical power of a machine with intellectually driven human hand under the supervisory control of the human's intellect, we will then have a system which is superior to a loosely-integrated combination of a human and his fully automated robot as in the present day robotic systems. We must therefore develop a fundamental approach to the problem of this extending human mechanical power in certain environments. Extenders will be a class of robots worn by humans to increase human mechanical ability, while the wearer's intellect remains the central intelligent control system for manipulating the extender. The human body, in physical contact with the extender, exchanges information signals and power with the extender. Commands are transferred to the extender via the contact forces between the wearer and the extender as opposed to use of joystick (master arm), push-button or key-board to execute such commands that were used in previous man amplifiers. Instead, the operator becomes an integral part of the extender while executing the task. In this unique configuration the mechanical power transfer between the human and extender occurs in addition to information signal transfer. When the wearer uses the extender to touch and manipulate an object, the extender transfers to the wearer's hand, in feedback fashion, a scaled-down value of the actual external load which the extender is manipulating. This natural feedback force on the wearer's hand allows him to feel the scaled-down value of the external forces in the manipulations. Extenders can be utilized to maneuver very heavy loads in factories, shipyards, airports, and construction sites. In some instances, for example, extenders can replace forklifts. The experimental results for a prototype extender are discussed.

Description: The Operator Control Station of the Jet Propulsion Laboratory (JPL)/NASA Telerobot Demonstrator System provides the man-machine interface between the operator and the system. It provides all the hardware and software for accepting human input for the direct and indirect (supervised) manipulation of the robot arms and tools for task execution. Hardware and software are also provided for the display and feedback of information and control data for the operator's consumption and interaction with the task being executed. The hardware design, system architecture, and its integration and interface with the rest of the Telerobot Demonstrator System are discussed.

Description: Dexterous telerobots incorporating 17 or more degrees of freedom operating under coordinated, sensor-driven computer control will play important roles in future space operations. They will also be used on Earth in assignments like fire fighting, construction and battlefield support. A real time, reflexive obstacle avoidance system, seen as a functional requirement for such massively redundant manipulators, was developed using arm-mounted proximity sensors to control manipulator pose. The project involved a review and analysis of alternative proximity sensor technologies for space applications, the development of a general-purpose algorithm for synthesizing sensor inputs, and the implementation of a prototypical system for demonstration and testing. A 7 degree of freedom Robotics Research K-2107HR manipulator was outfitted with ultrasonic proximity sensors as a testbed, and Robotics Research's standard redundant motion control algorithm was modified such that an object detected by sensor arrays located at the elbow effectively applies a force to the manipulator elbow, normal to the axis. The arm is repelled by objects detected by the sensors, causing the robot to steer around objects in the workspace automatically while continuing to move its tool along the commanded path without interruption. The mathematical approach formulated for synthesizing sensor inputs can be employed for redundant robots of any kinematic configuration.

Description: Two issues are addressed which arise in the task of detecting anomalous behavior in complex systems with numerous sensor channels: how to adjust alarm thresholds dynamically, within the changing operating context of the system, and how to utilize sensors selectively, so that nominal operation can be verified reliably without processing a prohibitive amount of sensor data. The approach involves simulation of a causal model of the system, which provides information on expected sensor values, and on dependencies between predicted events, useful in assessing the relative importance of events so that sensor resources can be allocated effectively. The potential applicability of this work to the execution monitoring of robot task plans is briefly discussed.

Description: A scheme for the representation of objects, the Successive Spherical Approximation (SSA), facilitates the rapid planning of collision-free paths in a 3-D, dynamic environment. The hierarchical nature of the SSA allows collision-free paths to be determined efficiently while still providing for the exact representation of dynamic objects. The concept of a freespace cell is introduced to allow human 3-D conceptual knowledge to be used in facilitating satisfying choices for paths. Collisions can be detected at a rate better than 1 second per environment object per path. This speed enables the path planning process to apply a hierarchy of rules to create a heuristically satisfying collision-free path.

Description: Object recognition through the use of input from multiple sensors is an important aspect of an autonomous manipulation system. In tactile object recognition, it is necessary to determine the location and orientation of object edges and surfaces. A controller is proposed that utilizes a tactile sensor in the feedback loop of a manipulator to track along edges. In the control system, the data from the tactile sensor is first processed to find edges. The parameters of these edges are then used to generate a control signal to a hybrid controller. Theory is presented for tactile edge detection and an edge tracking controller. In addition, experimental verification of the edge tracking controller is presented.

Description: The focus of the research is to build a compact, high performance lightstripe rangefinder using a Very Large Scale Integration (VLSI) smart photosensor array. Rangefinding, the measurement of the three-dimensional profile of an object or scene, is a critical component for many robotic applications, and therefore many techniques were developed. Of these, lightstripe rangefinding is one of the most widely used and reliable techniques available. Though practical, the speed of sampling range data by the conventional light stripe technique is severely limited. A conventional light stripe rangefinder operates in a step-and-repeat manner. A stripe source is projected on an object, a video image is acquired, range data is extracted from the image, the stripe is stepped, and the process repeats. Range acquisition is limited by the time needed to grab the video images, increasing linearly with the desired horizontal resolution. During the acquisition of a range image, the objects in the scene being scanned must be stationary. Thus, the long scene sampling time of step-and-repeat rangefinders limits their application. The fast range sensor proposed is based on the modification of this basic lightstripe ranging technique in a manner described by Sato and Kida. This technique does not require a sampling of images at various stripe positions to build a range map. Rather, an entire range image is acquired in parallel while the stripe source is swept continuously across the scene. Total time to acquire the range image data is independent of the range map resolution. The target rangefinding system will acquire 1,000 100 x 100 point range images per second with 0.5 percent range accuracy. It will be compact and rugged enough to be mounted on the end effector of a robot arm to aid in object manipulation and assembly tasks.

Description: The development of a flexible operation test-bed, based around a commercially available ASEA industrial robot is described. The test-bed was designed to investigate fundamental human factors issues concerned with the unique problems of robotic manipulation in the hostile environment of Space.

Description: Each planetary mission requires a complex space vehicle which integrates several functions to accomplish the mission and science objectives. A Mars Rover is one of these vehicles, and extends the normal spacecraft functionality with two additional functions: surface mobility and sample acquisition. All functions are assembled into a hierarchical and structured format to understand the complexities of interactions between functions during different mission times. It can graphically show data flow between functions, and most importantly, the necessary control flow to avoid unambiguous results. Diagrams are presented organizing the functions into a structured, block format where each block represents a major function at the system level. As such, there are six blocks representing telecomm, power, thermal, science, mobility and sampling under a supervisory block called Data Management/Executive. Each block is a simple collection of state machines arranged into a hierarchical order very close to the NASREM model for Telerobotics. Each layer within a block represents a level of control for a set of state machines that do the three primary interface functions: command, telemetry, and fault protection. This latter function is expanded to include automatic reactions to the environment as well as internal faults. Lastly, diagrams are presented that trace the system operations involved in moving from site to site after site selection. The diagrams clearly illustrate both the data and control flows. They also illustrate inter-block data transfers and a hierarchical approach to fault protection. This systems architecture can be used to determine functional requirements, interface specifications and be used as a mechanism for grouping subsystems (i.e., collecting groups of machines, or blocks consistent with good and testable implementations).

Description: The U.S. Bureau of Mines is developing a computer model to analyze the human factors aspect of mining machine operator compartments. The model will be used as a research tool and as a design aid. It will have the capability to perform the following: simulated anthropometric or reach assessment, visibility analysis, illumination analysis, structural analysis of the protective canopy, operator fatigue analysis, and computation of an ingress-egress rating. The model will make extensive use of graphics to simplify data input and output. Two dimensional orthographic projections of the machine and its operator compartment are digitized and the data rebuilt into a three dimensional representation of the mining machine. Anthropometric data from either an individual or any size population may be used. The model is intended for use by equipment manufacturers and mining companies during initial design work on new machines. In addition to its use in machine design, the model should prove helpful as an accident investigation tool and for determining the effects of machine modifications made in the field on the critical areas of visibility and control reach ability.

Description: The following question is addressed: How much force should operators exert, or experience, when operating a telemanipulator master-controller for sustained periods without encountering significant fatigue and discomfort, and without loss of stability in psychometric perception of force. The need to minimize exertion demands to avoid fatigue is diametrically opposed by the need to present a wide range of force stimuli to enhance perception of applied or reflected forces. For 104 minutes subjects repetitiously performed a series of 15 s isometric pinch grasps; controlled at 5, 15, and 25 percent of their maximum voluntary strength. Cyclic pinch grasps were separated by rest intervals of 7.5 and 15 s. Upon completion of every 10 minute period, subjects interrupted grasping activities to gage the intensity of fatigue and discomfort in the hand and forearm using a cross-modal matching technique. A series of psychometric tests were then conducted to determine accuracy and stability in the subject's perception of force experienced. Results showed that onset of sensations of discomfort and fatigue were dependent upon the magnitude of grasp force, work/rest ratio, and progression of task. Declines in force magnitude estimation slopes, indicating a reduction in force perception sensitivity, occurred with increased grasp force when work/rest ratios were greater than 1.0. Specific recommendations for avoiding discomfort and shifts in force perception, by limiting pinch grasp force required for master-controller operation and range of force reflection or work/rest ratios, are provided.

Description: Projects recently completed or in progress at MIT Man-Machine Systems Laboratory are summarized. (1) A 2-part impedance network model of a single degree of freedom remote manipulation system is presented in which a human operator at the master port interacts with a task object at the slave port in a remote location is presented. (2) The extension of the predictor concept to include force feedback and dynamic modeling of the manipulator and the environment is addressed. (3) A system was constructed to infer intent from the operator's commands and the teleoperation context, and generalize this information to interpret future commands. (4) A command language system is being designed that is robust, easy to learn, and has more natural man-machine communication. A general telerobot problem selected as an important command language context is finding a collision-free path for a robot.

Description: Using a method based upon resolving joint velocities using reciprocal screw quantities, compact analytical expressions are generated for the inverse solution of the joint rates of a seven revolute (spherical-revolute-spherical) manipulator. The method uses a sequential decomposition of screw coordinates to identify reciprocal screw quantities used in the resolution of a particular joint rate solution, and also to identify a Jacobian null-space basis used for the direct solution of optimal joint rates. The results of the screw decomposition are used to study special configurations of the manipulator, generating expressions for the inverse velocity solution for all non-singular configurations of the manipulator, and identifying singular configurations and their characteristics. Two functions are therefore served: a new general method for the solution of the inverse velocity problem is presented; and complete analytical expressions are derived for the resolution of the joint rates of a seven degree of freedom manipulator useful for telerobotic and industrial robotic application.

Description: The Robotics Research Model K-1207 manipulator is a redundant 7R serial link arm with offsets at all joints. To uniquely determine joint angles for a given end-effector configuration, the redundancy is parameterized by a scalar variable which corresponds to the angle between the manipulator elbow plane and the vertical plane. The forward kinematic mappings from joint-space to end-effector configuration and elbow angle, and the augmented Jacobian matrix which gives end-effector and elbow angle rates as a function of joint rates, are also derived.

Description: A 17 axis anthropomorphic manipulator, providing coordinated control of two seven degree of freedom arms mounted on a three degree of freedom torso-waist assembly, is presented. This massively redundant telerobot, designated the Robotics Research K/B-2017 Dexterous Manipulator, employs a modular mechanism design with joint-mounted actuators based on brushless motors and harmonic drive gear reducers. Direct joint torque control at the servo level causes these high-output joint drives to behave like direct-drive actuators, facilitating the implementation of an effective impedance control scheme. The redundant, but conservative motion control system models the manipulator as a spring-loaded linkage with viscous damping and rotary inertia at each joint. This approach allows for real time, sensor-driven control of manipulator pose using a hierarchy of competing rules, or objective functions, to avoid unplanned collisions with objects in the workplace, to produce energy-efficient, graceful motion, to increase leverage, to control effective impedance at the tool or to favor overloaded joints.

Description: An important property of an intelligent robot is to be able to determine the location of an object in 3-D space. A general object localization system structure is proposed, some important issues on localization discussed, and an overview given for current available object localization algorithms and systems. The algorithms reviewed are characterized by their feature extracting and matching strategies; the range finding methods; the types of locatable objects; and the mathematical formulating methods.

Description: Through a phased development such as a laboratory-based research testbed, the NASA/OAST Telerobot Testbed provides an environment for system test and demonstration of the technology which will usefully complement, significantly enhance, or even replace manned space activities. By integrating advanced sensing, robotic manipulation and intelligent control under human-interactive supervision, the Testbed will ultimately demonstrate execution of a variety of generic tasks suggestive of space assembly, maintenance, repair, and telescience. The Testbed system features a hierarchical layered control structure compatible with the incorporation of evolving technologies as they become available. The Testbed system is physically implemented in a computing architecture which allows for ease of integration of these technologies while preserving the flexibility for test of a variety of man-machine modes. The development currently in progress on the functional and implementation architectures of the NASA/OAST Testbed and capabilities planned for the coming years are presented.

Description: In view of space activities like International Space Station, Man-Tended-Free-Flyer (MTFF) and free flying platforms, the development of intelligent robotic systems is gaining increasing importance. The range of applications that have to be performed by robotic systems in space includes e.g., the execution of experiments in space laboratories, the service and maintenance of satellites and flying platforms, the support of automatic production processes or the assembly of large network structures. Some of these tasks will require the development of bi-armed or of multiple robotic systems including functional redundancy. For the development of robotic systems which are able to perform this variety of tasks a hierarchically structured modular concept of automation is required. This concept is characterized by high flexibility as well as by automatic specialization to the particular sequence of tasks that have to be performed. On the other hand it has to be designed such that the human operator can influence or guide the system on different levels of control supervision, and decision. This leads to requirements for the hardware and software concept which permit a range of application of the robotic systems from telemanipulation to autonomous operation. The realization of this goal requires strong efforts in the development of new methods, software and hardware concepts, and the integration into an automation concept.

Description: The inverse kinematics solution, a modal position control algorithm, and path planning results for a 7 degree of freedom manipulator are presented. The redundant arm consists of two links with shoulder and elbow joints and a spherical wrist. The inverse kinematics problem for tip position is solved and the redundant joint is identified. It is also shown that a locus of tip positions exists in which there are kinematic limitations on self-motion. A computationally simple modal position control algorithm has been developed which guarantees a nearly constant closed-loop dynamic response throughout the workspace. If all closed-loop poles are assigned to the same location, the algorithm can be implemented with very little computation. To further reduce the required computation, the modal gains are updated only at discrete time intervals. Criteria are developed for the frequency of these updates. For commanding manipulator movements, a 5th-order spline which minimizes jerk provides a smooth tip-space path. Schemes for deriving a corresponding joint-space trajectory are discussed. Modifying the trajectory to avoid joint torque saturation when a tip payload is added is also considered. Simulation results are presented.

Description: A Cartesian-space position/force controller is presented for redundant robots. The proposed control structure partitions the control problem into a nonredundant position/force trajectory tracking problem and a redundant mapping problem between Cartesian control input F is a set member of the set R(sup m) and robot actuator torque T is a set member of the set R(sup n) (for redundant robots, m is less than n). The underdetermined nature of the F yields T map is exploited so that the robot redundancy is utilized to improve the dynamic response of the robot. This dynamically optimal F yields T map is implemented locally (in time) so that it is computationally efficient for on-line control; however, it is shown that the map possesses globally optimal characteristics. Additionally, it is demonstrated that the dynamically optimal F yields T map can be modified so that the robot redundancy is used to simultaneously improve the dynamic response and realize any specified kinematic performance objective (e.g., manipulability maximization or obstacle avoidance). Computer simulation results are given for a four degree of freedom planar redundant robot under Cartesian control, and demonstrate that position/force trajectory tracking and effective redundancy utilization can be achieved simultaneously with the proposed controller.

Description: A computer-based form of multimedia art is proposed that uses the computer to fuse aspects of painting, sculpture, dance, music, film, and other media into a one-to-one synthesia of image and sound for spatially synchronous 3-D projection. Called synesthetic art, this conversion of many varied media into an aesthetically unitary experience determines the character and requirements of the system and its software. During the start-up phase, computer stereographic systems are unsuitable for software development. Eventually, a new type of illusory-projective supermedium will be required to achieve the needed combination of large-format projection and convincing real life presence, and to handle the vast amount of 3-D visual and acoustic information required. The influence of the concept on the author's research and creative work is illustrated through two examples.

Description: The Mechanical Universe project required the production of over 550 different animated scenes, totaling about 7 and 1/2 hours of screen time. The project required the use of a wide range of techniques and motivated the development of several different software packages. A documentation is presented of many aspects of the project, encompassing artistic design issues, scientific simulations, software engineering, and video engineering.

Description: Subjects judged eye level, defined in three distinct ways relative to three distinct reference planes: a gravitational horizontal, giving the gravitationally referenced eye level (GREL); a visible surface, giving the surface-referenced eye level (SREL); and a plane fixed with respect to the head, giving the head-referenced eye level (HREL). The information available for these judgements was varied by having the subjects view an illuminated target that could be placed in a box which: (1) was pitched at various angles, (2) was illuminated or kept in darkness, (3) was moved to different positions along the subject's head-to-foot body axis, and (4) was viewed with the subjects upright or reclining. The results showed: (1) judgements of GREL made in the dark were 2.5 deg lower than in the light, with a significantly greater variability; (2) judged GREL was shifted approximately half of the way toward SREL when these two eye levels did not coincide; (3) judged SREL was shifted about 12 percent of the way toward HREL when these two eye levels did not coincide, (4) judged HREL was shifted about half way toward SREL when these two eye level did not coincide and when the subject was upright (when the subject was reclining, HREL was shifted approx. 90 percent toward SREL); (5) the variability of the judged HREL in the dark was nearly twice as great with the subject reclining than with the subject upright. These results indicate that gravity is an important source of information for judgement of eye level. In the absence of information concerning the direction of gravity, the ability to judge HREL is extremely poor. A visible environment does not seem to afford precise information as to judgements of direction, but it probably does afford significant information as to the stability of these judgements.

Description: Computer-generated displays are becoming increasingly popular in aerospace applications. The use of stereo 3-D technology provides an opportunity to present depth perceptions which otherwise might be lacking. In addition, the third dimension could also be used as an additional dimension along which information can be encoded. Historically, the stereo 3-D displays have been used in entertainment, in experimental facilities, and in the handling of hazardous waste. In the last example, the source of the stereo images generally has been remotely controlled television camera pairs. The development of a stereo 3-D pictorial primary flight display used in a flight simulation environment is described. The applicability of stereo 3-D displays for aerospace crew stations to meet the anticipated needs for 2000 to 2020 time frame is investigated. Although, the actual equipment that could be used in an aerospace vehicle is not currently available, the lab research is necessary to determine where stereo 3-D enhances the display of information and how the displays should be formatted.

Description: Transfer of information across disciplines is promoted, while basic and applied researchers are cautioned about the danger of assuming simple relationships between stimulus information, perceptual impressions, and performance including pattern recognition and sensorimotor skills. A theoretical and empirical foundation was developed predicting those relationships.

Description: In recent years, there has been a rapid growth in the ability to obtain detailed data on large complex structures in three dimensions. This development occurred first in the medical field, with CAT (computer aided tomography) scans and now magnetic resonance imaging, and in seismological exploration. With the advances in supercomputing and computational fluid dynamics, and in experimental techniques in fluid dynamics, there is now the ability to produce similar large data fields representing 3D structures and phenomena in these disciplines. These developments have produced a situation in which currently there is access to data which is too complex to be understood using the tools available for data reduction and presentation. Researchers in these areas are becoming limited by their ability to visualize and comprehend the 3D systems they are measuring and simulating.

Description: It is well known that the orientation of an optical pattern relative to egocentric or extraneous references affects its figural quality, that is, alters its perceived form and concomitantly delays or quickens its identification (Rock 1973). A square presented in the frontal plane to an upright person (S), for instance, changes from a box to a diamond when it is rotated with respect to the S's median plane by 45 deg. This angle, that is, the angle between the orientations of the pattern in which the two apparent figures (Gestalten) attain a summit of purity and distinctness, will be called the figural disparity of the pattern. If, as in this case, the S is upright, the retinal meridian and the subjective vertical (SV) are both in the viewer's median plane. The question arises with respect to which of these orientation references the two figures are identified. The answer may be found when the pattern and the S are oriented in such a way that the projections of the retinal meridian and the SV into the plane of the pattern diverge by the pattern's figural disparity or its periodic multiples: that is, in this case of a square by 45 or 135 deg, respectively. Similarly, which reference determines whether an equilateral triangle is seen as a pyramid or a traffic warning sign may be revealed at a divergence of SV and retinal meridian of 60 or 180 deg, respectively. It is generally found that for head roll tilts (Rho) and figural disparities of up to 90 deg, the figure whose axis coincides with the SV is seen. At head tilts of Rho=180 deg, however, the retinal reference dominates, as a rule independently of the figural disparity.

Description: Spatial display instruments convey information about both the identity and the location of objects in order to assist surgeons, astronauts, pilots, blind individuals, and others in identification, remote manipulations, navigation, and obstacle avoidance. Scientists believe that these instruments have not reached their full potential and that progress toward new applications, including the possibility of restoring sight to the blind, will be accelerated by advancing the understanding of perceptual processes. This stimulating challenge to basic researchers was advanced by Paul Bach-Y-Rita (1972) and by the National Academy of Science (1986) report on Electronic Aids for the Blind. Although progress has been made, new applications of spatial display instruments in medicine, space, aviation, and rehabilitation await improved theoretical and empirical foundations.