Publications

The computer vision field has undergone a revolution of sorts in the past five years. Moore's law has driven real-time image processing from the domain of dedicated, expensive hardware, to the domain of commercial off-the-shelf computers. This thesis describes their work on the design, analysis and implementation of a Real-Time Shape from Silhouette Sensor (RT S{sup 3}). The system produces time-varying volumetric data at real-time rates (10-30Hz). The data is in the form of binary volumetric images. Until recently, using this technique in a real-time system was impractical due to the computational burden. In this thesis they review the previous work in the field, and derive the mathematics behind volumetric calibration, silhouette extraction, and shape-from-silhouette. For the sensor implementation, they use four color camera/framegrabber pairs and a single high-end Pentium III computer. The color cameras were configured to observe a common volume. This hardware uses the RT S{sup 3} software to track volumetric motion. Two types of shape-from-silhouette algorithms were implemented and their relative performance was compared. They have also explored an application of this sensor to markerless motion tracking. In his recent review of work done in motion tracking Gavrila states that results of markerless vision based 3D tracking are still limited. The method proposed in this paper not only expands upon the previous work but will also attempt to overcome these limitations.

This paper describes a system, which acquires 3D data and tracks an eleven degree of freedom human model in real-time. Using four cameras we create a time-varying volumetric image (a visual hull) of anything moving in the space observed by all four cameras. The sensor is currently operating in a volume of approximately 500,000 voxels (1.5 inch cubes) at a rate of 25 Hz. The system is able to track the upper body dynamics of a human (x,y position of the body, a torso rotation, and four rotations per arm). Both data acquisition and tracking occur on one computer at a rate of 16 Hz. We also developed a calibration procedure, which allows the system to be moved and be recalibrated quickly. Furthermore we display in real-time, either the data overlaid with the joint locations or a human avatar. Lastly our system has been implemented to perform crane gesture recognition.

Abstract not provided.

Traditionally law enforcement agencies have relied on basic measurement and imaging tools, such as tape measures and cameras, in recording a crime scene. A disadvantage of these methods is that they are slow and cumbersome. The development of a portable system that can rapidly record a crime scene with current camera imaging, 3D geometric surface maps, and contribute quantitative measurements such as accurate relative positioning of crime scene objects, would be an asset to law enforcement agents in collecting and recording significant forensic data. The purpose of this project is to develop a feasible prototype of a fast, accurate, 3D measurement and imaging system that would support law enforcement agents to quickly document and accurately record a crime scene.

With a goal of producing faster, safer, and cheaper technologies for nuclear waste cleanup, Sandia is actively developing and extending intelligent systems technologies. Graphical Programming is a key technology for robotic waste cleanup that Sandia is developing for this goal. This paper describes Sancho, Sandia most advanced Graphical Programming supervisory software. Sancho, now operational on several robot systems, incorporates all of Sandia`s recent advances in supervisory control. Sancho, developed to rapidly apply Graphical Programming on a diverse set of robot systems, uses a general set of tools to implement task and operational behavior. Sancho can be rapidly reconfigured for new tasks and operations without modifying the supervisory code. Other innovations include task-based interfaces, event-based sequencing, and sophisticated GUI design. These innovations have resulted in robot control programs and approaches that are easier and safer to use than teleoperation, off-line programming, or full automation.