Abstract
The goal of this paper is to describe a method to position a robot arm at any visible point of a given workspace without an explicit on line use of the analytical form of the transformations between real space and camera coordinates (camera calibration) or between cartesian and joint coordinates (direct or inverse kinematics of the robot arm). The formulation uses a discrete network of points distributed all over the workspace in which a procedure is given to measure certain Jacobian matrices which represent a good local linear approximation to the unknown compound transformation between camera and joint coordinates. This approach is inspired by the biological observation of the vestibulo-ocular reflex in humans (VOR). We show that little space is needed to store the transformation at a given scale, as feedback on the visual coordinates is used to improve precision up to the limit of the visual system. This characteristic also allows the plant to cope with disturbances in camera positioning or robot parameters. Furthermore, if the dimension of the visual space is equal or bigger than the motor space dimension, the transformation can be inverted, resulting in a realistic model of the plant able to be used to train other methods for the determination of visuo-motor mapping. As a test of the method an experiment to position a real robot arm is presented, together with another experiment showing the robot executing a simple task (building a tower of blocks).
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Amillo and Arriaga: 1986, Análisis Mathemático con Aplicaciones a la Computación, McGraw-Hill.
Albus, S. J.: 1981, A neurological model, in Brains, Behaviour and Robotics, BYTE Books, McGraw-Hill.
Atkeson, C. G.: April 1991, Using locally weighted regression for robot learning, in Proc. IEEE Int. Conf. on Robotics and Automation, Sacramento, CA, IEEE Computer Society Press, pp. 958–963.
Bien, Z., Jang, W., and Park, J.: 1993, Characterization and use of feature-Jacobian matrix for visual servoing, in Visual Servoing, World Scientific, pp. 317–363.
Bentley, J. L. and Papadimitriou, C. H.: April 1980, Two papers on computational geometry, Tech. Report CMU-CS-80-109, Dept. of Computer Science, Carnegie-Mellon University.
Conkie, A. and Chongstitvatana, P.: 1990, An uncalibrated stereo visual servo system, in Proc. British Machine Vision Conf., Oxford, pp. 277–280.
Corke, P. I.: 1993, Visual control of robot manipulators, in Visual Servoing, A Review, World Scientific, pp. 1–31.
Domingo, J.: September 1991, Stereo part mating, Master's Thesis, Department of Artificial Intelligence, Univ. of Edinburgh.
Domingo, J.: November 1993, Implantación y Comparación de diversos Métodos para Control de Robot basados en Visión, PhD Thesis, Departamento de Informática y Electrónica, Univ. de Valencia.
Feddema, J. T., Lee, C. S. G., and Mitchell, O. R.: 1993, Feature-based visual servoing of robotic systems, in Visual Servoing, World Scientific, pp. 105–138.
Hashimoto, K. and Kimura, H.: 1993, LQ optimal and nonlinear approaches to visual servoing, in Visual Servoing, World Scientific, pp. 139–164.
Krose, J. A., van der Smagt, P. P., and Groen, F. C. A.: 1993, One eyed self learning robot manipulator, in Bekey et al. (eds), Neural Networks in Robotics, Kluwer Academic Publishers, pp. 19–27.
Miller, W. T., Glanz, F. H., and Kraft, L. G.: 1990, Real-time dynamic control of an industrial manipulator using a neural-network-based learning controller, in IEEE Trans. Robotics and Automation 6(1), 1–9.
Nelson, B. J. and Khosla, P. K.: 1994, The resolvability ellipsoid for visual servoing, in Proc. Vision and Pattern Recognition CVPR94, Washington, DC.
Nelson, B., Papanikopoulos, N. P., and Khosla, P. K.: 1993, Visual servoing for robotic assembly, in Visual Servoing, World Scientific, pp. 139–164.
Pellionisz, A.: 1985, Tensorial aspects of the multidimensional approach to the vestibulo-oculomotor reflex and gaze, in Berthod and Melvill Jones (eds), Adaptive Mechanisms in Gaze Control.
PellioniszA. and LlinásR.: 1980, Tensorial approach to the geometry of the brain function: Cerebellar coordination via a metric tensor, Neuroscience 5, 1125–1136.
Tsai, R. Y.: 1987, A versatile camera calibration technique for high accuracy 3d machine vision metrology using off-the-shelf tv cameras and lenses, in IEEE Trans. Robotics and Automation 3, 323–344.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Domingo, J., Pelechano, J. Measurement and storage of a network of jacobians as a method for the visual positioning of a robot arm. J Intell Robot Syst 16, 407–422 (1996). https://doi.org/10.1007/BF00270451
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF00270451