[go: up one dir, main page]

CN114918923B - A method and system for a robotic arm to avoid the human body in a close-range human-machine collaboration environment - Google Patents

A method and system for a robotic arm to avoid the human body in a close-range human-machine collaboration environment Download PDF

Info

Publication number
CN114918923B
CN114918923B CN202210699792.0A CN202210699792A CN114918923B CN 114918923 B CN114918923 B CN 114918923B CN 202210699792 A CN202210699792 A CN 202210699792A CN 114918923 B CN114918923 B CN 114918923B
Authority
CN
China
Prior art keywords
joint
human body
mechanical arm
arm
path
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210699792.0A
Other languages
Chinese (zh)
Other versions
CN114918923A (en
Inventor
周乐来
艾嘉琦
李贻斌
田新诚
宋锐
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong University
Original Assignee
Shandong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong University filed Critical Shandong University
Priority to CN202210699792.0A priority Critical patent/CN114918923B/en
Publication of CN114918923A publication Critical patent/CN114918923A/en
Application granted granted Critical
Publication of CN114918923B publication Critical patent/CN114918923B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1656Programme controls characterised by programming, planning systems for manipulators
    • B25J9/1664Programme controls characterised by programming, planning systems for manipulators characterised by motion, path, trajectory planning
    • B25J9/1666Avoiding collision or forbidden zones
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J18/00Arms
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1674Programme controls characterised by safety, monitoring, diagnostic
    • B25J9/1676Avoiding collision or forbidden zones
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1679Programme controls characterised by the tasks executed

Landscapes

  • Engineering & Computer Science (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Manipulator (AREA)

Abstract

本发明提出了一种近距人机协作环境下机械臂规避人体方法及系统,属于人机协作下的机械路径规划技术领域。包括:通过IMU惯性传感器获取人体上半身关节点位置信息;将得到的人体关节点位置信息转换成机械臂工作空间下的等效障碍物;基于等效障碍物,在为机械臂给定简单任务的基础上,使用改进的RRT‑CONNECT方法进行避碰工作路径生成;对生成的工作路径进行优化,并驱动机械臂进行移动。本发明通过IMU获取人体的状态,将该状态转换到机械臂工作空间之中,再用改进的RRT‑CONNECT的方法扩展得到机械臂避碰路径,从而避免操作员与机械臂在近距离协同工作时的碰撞。

The invention proposes a method and system for a robot arm to avoid the human body in a close-range human-machine collaboration environment, and belongs to the technical field of mechanical path planning under human-machine collaboration. Including: obtaining the position information of the upper body joint points of the human body through the IMU inertial sensor; converting the obtained joint point position information of the human body into equivalent obstacles in the working space of the robotic arm; based on the equivalent obstacles, when given a simple task for the robotic arm Based on this, the improved RRT‑CONNECT method is used to generate a collision avoidance working path; the generated working path is optimized and the robotic arm is driven to move. This invention obtains the state of the human body through the IMU, converts the state into the working space of the robotic arm, and then uses the improved RRT-CONNECT method to expand the collision avoidance path of the robotic arm, thereby preventing the operator and the robotic arm from working together at close range. time collision.

Description

一种近距人机协作环境下机械臂规避人体方法及系统A method and system for a robotic arm to avoid the human body in a close-range human-machine collaboration environment

技术领域Technical field

本发明属于人机协作下的机械路径规划技术领域,尤其涉及一种近距人机协作环境下机械臂规避人体方法及系统。The invention belongs to the technical field of mechanical path planning under human-machine collaboration, and in particular relates to a method and system for a robotic arm to avoid the human body in a close-range human-machine collaboration environment.

背景技术Background technique

本部分的陈述仅仅是提供了与本发明相关的背景技术信息,不必然构成在先技术。The statements in this section merely provide background technical information related to the present invention and do not necessarily constitute prior art.

传统的工业机器人具有高精度、高速度、高负载的特点,所以传统的工业机器人都具有部署成本高的特点。随着社会的发展,涌现了越来越多的小批量、定制化、短周期的任务需求,使用传统的工业机器人就显得成本太高,因此出现了协作型机器人,协作机器人的核心就是“人机协作”。人机协作是指人与机器人近距离共同完成一项任务,而人机协作过程中的安全问题一直是人机协作发展中的重点与难点。虽然目前一些主流的协作机械臂已经包含了一些安全措施,当机械臂检测到碰撞后会产生急停从而避免对人体产生伤害,但是这种方式会导致机械臂停机重启,轻则影响效率,重则损坏机械臂。Traditional industrial robots have the characteristics of high precision, high speed and high load, so traditional industrial robots have the characteristics of high deployment cost. With the development of society, more and more small-batch, customized, and short-cycle task requirements have emerged. It is too expensive to use traditional industrial robots. Therefore, collaborative robots have emerged. The core of collaborative robots is "human machine collaboration”. Human-machine collaboration refers to humans and robots completing a task together at close range, and safety issues during human-machine collaboration have always been the focus and difficulty in the development of human-machine collaboration. Although some current mainstream collaborative robot arms have included some safety measures. When the robot arm detects a collision, it will make an emergency stop to avoid harm to the human body. However, this method will cause the robot arm to stop and restart, which will affect the efficiency at best and the worst at worst. Otherwise, the mechanical arm will be damaged.

在人机协作的避碰中,对于人体的姿态识别尤为重要目前对人体的追踪方式大致分为光学、声学、机械外骨骼、惯性传感器IMU等几方面。光学通过相机对Mark点的追踪来获取人体信息,这就导致其有要求无遮挡环境的缺点。声学的追踪效果难以达到避碰的需求,机械外骨骼比较僵硬且受限制较大,惯性传感器虽然可能会受到较强磁场的影响,但考虑到大部分场景不会出现强大磁场,相较之下惯性传感器的实际应用价值更高。In the collision avoidance of human-machine collaboration, the posture recognition of the human body is particularly important. The current tracking methods of the human body are roughly divided into optical, acoustic, mechanical exoskeleton, inertial sensor IMU and other aspects. Optics obtains human body information through camera tracking of Mark points, which leads to the disadvantage of requiring an unobstructed environment. The acoustic tracking effect is difficult to meet the requirements of collision avoidance. The mechanical exoskeleton is relatively stiff and highly restricted. Although the inertial sensor may be affected by a strong magnetic field, considering that strong magnetic fields will not appear in most scenes, in comparison The practical application value of inertial sensors is even higher.

目前针对机械臂的避障研究主要分为RRT和人工势场法几种,但是都是应用在简单的场景之中,实现基础的静止障碍物避障和一些简易移动障碍物的避障功能,没有办法使用在人机协作的场景之中。At present, research on obstacle avoidance of robotic arms is mainly divided into RRT and artificial potential field methods, but they are all applied in simple scenarios to achieve basic obstacle avoidance of stationary obstacles and some simple moving obstacles. There is no way to use it in human-machine collaboration scenarios.

发明内容Contents of the invention

为克服上述现有技术的不足,本发明提供了一种近距人机协作环境下机械臂规避人体方法及系统,通过IMU获取人体的状态,将该状态转换到机械臂工作空间之中,再用改进的RRT-CONNECT的方法扩展得到机械臂避碰路径,从而避免操作员与机械臂在近距离协同工作时的碰撞。In order to overcome the above-mentioned shortcomings of the prior art, the present invention provides a method and system for a robot arm to avoid the human body in a close-range human-machine collaboration environment. The state of the human body is acquired through the IMU, and the state is converted into the working space of the robot arm. The improved RRT-CONNECT method is used to expand the collision avoidance path of the robotic arm to avoid collisions between the operator and the robotic arm when they work together at close range.

为实现上述目的,本发明的一个或多个实施例提供了如下技术方案:To achieve the above objectives, one or more embodiments of the present invention provide the following technical solutions:

本发明第一方面提供了一种近距人机协作环境下机械臂规避人体方法,包括:The first aspect of the present invention provides a method for a robotic arm to avoid the human body in a close human-machine collaboration environment, including:

获取人体上半身关节点位置信息;Obtain the joint point position information of the upper body of the human body;

将人体关节点位置信息转换成机械臂工作空间下的等效障碍物;Convert human body joint point position information into equivalent obstacles in the robotic arm workspace;

基于等效障碍物,在为机械臂给定简单任务的基础上,进行避碰工作路径生成;Based on equivalent obstacles and given a simple task for the robotic arm, the collision avoidance working path is generated;

对生成的工作路径进行优化,并驱动机械臂进行移动。Optimize the generated working path and drive the robotic arm to move.

本发明第二方面提供了一种近距人机协作环境下机械臂规避人体系统,包括:A second aspect of the present invention provides a system for a robot arm to avoid the human body in a close-range human-machine collaboration environment, including:

惯性传感器、处理器和机械臂;inertial sensors, processors, and robotic arms;

所述惯性传感器用于获取人体上半身关节点位置信息,并将人体上半身关节点位置信息传输给处理器;The inertial sensor is used to obtain the joint point position information of the upper body of the human body and transmit the joint point position information of the upper body of the human body to the processor;

所述处理器用于将人体关节点位置信息转换成机械臂工作空间下的等效障碍物,并基于等效障碍物,在为机械臂给定简单任务的基础上,进行避碰工作路径生成和优化,并将优化后的路径指令传输给机械臂;The processor is used to convert human body joint point position information into equivalent obstacles in the robot arm's working space, and based on the equivalent obstacles, based on a simple task given to the robot arm, generates and generates collision avoidance working paths. Optimize and transmit the optimized path instructions to the robotic arm;

所述机械臂用于接收处理器发出的路径指令,并根据路径指令进行移动。The robotic arm is used to receive path instructions issued by the processor and move according to the path instructions.

本发明第三方面提供了计算机可读存储介质,其上存储有程序,该程序被处理器执行时实现如本发明第一方面所述的近距人机协作环境下机械臂规避人体方法中的步骤。A third aspect of the present invention provides a computer-readable storage medium on which a program is stored. When the program is executed by a processor, the method for a robot arm to avoid the human body in a close human-machine collaboration environment as described in the first aspect of the present invention is implemented. step.

本发明第四方面提供了电子设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的程序,所述处理器执行所述程序时实现如本发明第一方面所述的近距人机协作环境下机械臂规避人体方法中的步骤。A fourth aspect of the present invention provides an electronic device, including a memory, a processor, and a program stored in the memory and executable on the processor. When the processor executes the program, the near-field method as described in the first aspect of the present invention is implemented. Steps in the method for robot arms to avoid the human body in a human-machine collaboration environment.

以上一个或多个技术方案存在以下有益效果:One or more of the above technical solutions have the following beneficial effects:

本发明提供了一种在特定的近距离人机协作工作环境下,机械臂实时规避人体的方法与系统。通过IMU获取人体的状态,将该状态转换到机械臂工作空间之中,再用改进的RRT-CONNECT的方法扩展得到机械臂避碰路径,从而避免操作员与机械臂在近距离协同工作时的碰撞。The present invention provides a method and system for a robotic arm to avoid the human body in real time in a specific close-range human-machine collaboration working environment. The state of the human body is obtained through the IMU, and the state is converted into the workspace of the robotic arm. The improved RRT-CONNECT method is then used to expand the collision avoidance path of the robotic arm, thereby avoiding collisions between the operator and the robotic arm when they work together at close range. collision.

本发明附加方面的优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本发明的实践了解到。Additional advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.

附图说明Description of the drawings

构成本发明的一部分的说明书附图用来提供对本发明的进一步理解,本发明的示意性实施例及其说明用于解释本发明,并不构成对本发明的不当限定。The description and drawings that constitute a part of the present invention are used to provide a further understanding of the present invention. The illustrative embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention.

图1是本发明实施例所提供的一种近距离人机协作环境下基于IMU的机械臂规避人体方法的流程示意图;Figure 1 is a schematic flow chart of a method for an IMU-based robotic arm to avoid the human body in a close-range human-machine collaboration environment provided by an embodiment of the present invention;

图2是本申请实施例所提供的人体上半身IMU的分布以及人体上半身关节点位示意图;Figure 2 is a schematic diagram of the distribution of IMUs in the upper body of the human body and the joint points of the upper body of the human body provided by the embodiment of the present application;

图3是本申请实施例所提供的测试系统环境以及其中坐标系分布示意图;Figure 3 is a schematic diagram of the test system environment and the coordinate system distribution provided by the embodiment of the present application;

图4是本申请实施例所提供的改进的RRT-CONNECT生成避碰路径流程示意图;Figure 4 is a schematic flowchart of the improved RRT-CONNECT generation of collision avoidance paths provided by the embodiment of the present application;

图5是本申请实施例所提供的测试系统操作流程图。Figure 5 is an operation flow chart of the test system provided by the embodiment of the present application.

具体实施方式Detailed ways

下面结合附图与实施例对本公开作进一步说明。The present disclosure will be further described below in conjunction with the accompanying drawings and examples.

应该指出,以下详细说明都是例示性的,旨在对本申请提供进一步的说明。除非另有指明,本文使用的所有技术和科学术语具有与本申请所属技术领域的普通技术人员通常理解的相同含义。It should be noted that the following detailed description is illustrative and is intended to provide further explanation of the present application. Unless otherwise defined, all technical and scientific terms used herein have the same meanings commonly understood by one of ordinary skill in the art to which this application belongs.

需要注意的是,这里所使用的术语仅是为了描述具体实施方式,而非意图限制根据本申请的示例性实施方式。如在这里所使用的,除非上下文另外明确指出,否则单数形式也意图包括复数形式,此外,还应当理解的是,当在本说明书中使用术语“包含”和/或“包括”时,其指明存在特征、步骤、操作、器件、组件和/或它们的组合。It should be noted that the terms used herein are only for describing specific embodiments and are not intended to limit the exemplary embodiments according to the present application. As used herein, the singular forms are also intended to include the plural forms unless the context clearly indicates otherwise. Furthermore, it will be understood that when the terms "comprises" and/or "includes" are used in this specification, they indicate There are features, steps, operations, means, components and/or combinations thereof.

在本公开中,术语如“上”、“下”、“左”、“右”、“前”、“后”、“竖直”、“水平”、“侧”、“底”等指示的方位或位置关系为基于附图所示的方位或位置关系,只是为了便于叙述本公开各部件或元件结构关系而确定的关系词,并非特指本公开中任一部件或元件,不能理解为对本公开的限制。In this disclosure, terms such as "upper", "lower", "left", "right", "front", "rear", "vertical", "horizontal", "side", "bottom", etc. The orientation or positional relationship is based on the orientation or positional relationship shown in the drawings. It is only a relative word determined to facilitate the description of the structural relationship of various components or elements of the present disclosure. It does not specifically refer to any component or element of the present disclosure and cannot be understood as a reference to the present disclosure. Public restrictions.

本公开中,术语如“固接”、“相连”、“连接”等应做广义理解,表示可以是固定连接,也可以是一体地连接或可拆卸连接;可以是直接相连,也可以通过中间媒介间接相连。对于本领域的相关科研或技术人员,可以根据具体情况确定上述术语在本公开中的具体含义,不能理解为对本公开的限制。In this disclosure, terms such as "fixed", "connected", "connected", etc. should be understood in a broad sense, indicating that it can be a fixed connection, an integral connection or a detachable connection; it can be directly connected, or it can be connected through an intermediate connection. Media are indirectly connected. For relevant scientific researchers or technicians in this field, the specific meanings of the above terms in this disclosure can be determined according to specific circumstances, and should not be understood as limitations of this disclosure.

实施例一Embodiment 1

本实施例公开了一种近距人机协作环境下机械臂规避人体方法。This embodiment discloses a method for a robotic arm to avoid the human body in a close-range human-machine collaboration environment.

如图1所示,一种近距人机协作环境下机械臂规避人体方法,包括以下步骤:As shown in Figure 1, a method for a robotic arm to avoid the human body in a close human-machine collaboration environment includes the following steps:

(1)获取人体上半身关节点位置信息;(1) Obtain the position information of the joint points of the upper body of the human body;

(2)将人体关节点位置信息转换成机械臂工作空间下的等效障碍物;(2) Convert human body joint point position information into equivalent obstacles in the robotic arm working space;

(3)基于等效障碍物,在为机械臂给定简单任务的基础上,进行避碰工作路径生成;(3) Based on equivalent obstacles and given a simple task for the robotic arm, generate a collision avoidance working path;

(4)对生成的工作路径进行优化,并驱动机械臂进行移动。(4) Optimize the generated working path and drive the robotic arm to move.

对下文使用的坐标系符号进行说明:Explain the coordinate system symbols used below:

G:世界坐标系;G: world coordinate system;

S:惯性测量单元坐标系;S: Inertial measurement unit coordinate system;

B:人体基坐标系;B: Human body-based coordinate system;

R:机械臂工作空间笛卡尔坐标系;R: Cartesian coordinate system of robotic arm workspace;

D:世界坐标系下的选取一点的坐标系。D: The coordinate system of a selected point in the world coordinate system.

(1)获取人体上半身关节点位置信息,具体为:(1) Obtain the joint point position information of the upper body of the human body, specifically:

通过IMU惯性传感器获取人体上半身关节点位置信息,在操作员胸部下侧、左臂上半关节、左臂下半关节、右臂上半关节、右臂下半关节分别放置一个IMU传感器,通过将IMU与人体关节绑定,用IMU的姿态变化来表示人体的运动状态变化。The position information of the joint points of the upper body of the human body is obtained through the IMU inertial sensor. An IMU sensor is placed on the lower side of the operator's chest, the upper half joint of the left arm, the lower half joint of the left arm, the upper half joint of the right arm, and the lower half joint of the right arm. The IMU is bound to the joints of the human body, and the posture changes of the IMU are used to represent changes in the human body's motion state.

首先,获取各个单关节的旋转矩阵:人体基坐标系在全局坐标戏中的姿态表示为惯性测量单元坐标系在全局坐标系中的姿态表示为/>人体基坐标系在惯性测量单元坐标系的姿态表示为/> First, obtain the rotation matrix of each single joint: the posture of the human body base coordinate system in the global coordinate scene is expressed as The attitude of the inertial measurement unit coordinate system in the global coordinate system is expressed as/> The posture of the human body base coordinate system in the inertial measurement unit coordinate system is expressed as/>

IMU可以传回单位四元数数据Q=[qx qy qz qw],由四元数转化为旋转矩阵得到:The IMU can return unit quaternion data Q = [q x q y q z q w ], which is obtained by converting the quaternion into a rotation matrix:

然后,获取人体关节点位置信息,如附图2所示,当人体的肢体尺寸已知时,人体的上半身位姿信息可以用0~7的8个点位置信息来表示,当操作员坐在凳子上时,首先坐直进行初始位置标定:Then, obtain the joint point position information of the human body, as shown in Figure 2. When the limb size of the human body is known, the upper body posture information of the human body can be represented by 8 point position information from 0 to 7. When the operator sits When sitting on a stool, first sit up straight and perform initial position calibration:

在静止不动的情况下,通过关节长度可以得到0~7的8个点位初始位置。When stationary, the initial positions of 8 points from 0 to 7 can be obtained through the joint length.

0点在人体坐标系{B}下的位置坐标为PB0=[x0 y0 z0]T。0点位置坐标不会随着操作员动作而改变。The position coordinate of point 0 in the human body coordinate system {B} is P B0 = [x 0 y 0 z 0 ] T . The coordinates of the 0-point position will not change with the operator's actions.

1点的初始位置在{B}点坐标系下为PB1=[x1 y1 z1]T,利用胸部IMU传感器的姿态变化来等效人体上半身躯干的姿态变化,可以得到人体状态变化后的1点在{B}点坐标系下的位置坐标为 The initial position of point 1 is P B1 = [x 1 y 1 z 1 ] T in the coordinate system of point {B}. Using the posture change of the chest IMU sensor to equivalent the posture change of the upper body trunk of the human body, we can obtain the state change of the human body. The position coordinates of 1 point in the coordinate system of point {B} are

计算2点的位置时,以1点坐标系为基准点,得到2点在1点坐标系下的初始位置坐标为P12=[x2 y2 z2]T。同上,人体状态变化后的2点在{B}点坐标系下的位置坐标为综上可以得出2点在{B}点坐标系下的位置坐标为PB2′=PB1′+P12′。When calculating the position of 2 points, use the 1-point coordinate system as the reference point, and obtain the initial position coordinates of 2 points in the 1-point coordinate system as P 12 = [x 2 y 2 z 2 ] T . Same as above, the position coordinates of the two points in the {B} point coordinate system after the human body state changes are In summary, it can be concluded that the position coordinates of the two points in the coordinate system of point {B} are P B2 ′=P B1 ′+P 12 ′.

其余点位置坐标原理同2点,可以得到PB3、PB4、PB5、PB6、PB7等总共8个关节点坐标。The position coordinate principle of the remaining points is the same as that of 2 points, and a total of 8 joint point coordinates such as P B3 , P B4 , P B5 , P B6 , and P B7 can be obtained.

(2)将人体关节点位置信息转换成机械臂工作空间下的等效障碍物,具体过程是:(2) Convert human body joint point position information into equivalent obstacles in the robotic arm working space. The specific process is:

首先将步骤(1)得到的在人体基坐标系{B}下的人体关节点位置信息转换至机械臂工作空间笛卡尔坐标系{R}下。将人体基坐标系{B}与{D}坐标系重合,可以得到{D}坐标系下的关节点位置信息为:First, the human body joint point position information obtained in step (1) under the human body base coordinate system {B} is converted to the Cartesian coordinate system {R} of the robot arm work space. By overlapping the human body base coordinate system {B} and the {D} coordinate system, the joint point position information in the {D} coordinate system can be obtained as:

PDi=PBi(i=0,1,2,...,7)P Di =P Bi (i=0,1,2,...,7)

在{D}坐标系下的点位置DP在{R}坐标系下的位置RP可以表示为:The point position D P in the {D} coordinate system and the position R P in the {R} coordinate system can be expressed as:

对应可以得到人体上半身关节点在机械臂工作空间{R}坐标系下的位置坐标:Correspondingly, the position coordinates of the joint points of the upper body of the human body in the {R} coordinate system of the robot arm workspace can be obtained:

其中,PDi为关节点在{D}坐标系下的坐标;PBi为关节点在{B}坐标系下的坐标;PRi为关节点在{R}坐标系下的坐标;为{D}坐标系相对{R}坐标系的旋转矩阵;RPDORG为在{R}坐标系下的{D}坐标系原点的位置矢量。Among them, P Di is the coordinate of the joint point in the {D} coordinate system; P Bi is the coordinate of the joint point in the {B} coordinate system; P Ri is the coordinate of the joint point in the {R} coordinate system; is the rotation matrix of the {D} coordinate system relative to the {R} coordinate system; R P DORG is the position vector of the origin of the {D} coordinate system in the {R} coordinate system.

然后,将人体转化为机械臂工作空间笛卡尔坐标系下的障碍物。因为操作员在工作台上进行操作时,只有大小手臂会有可能与机械臂碰撞,所以机械臂的避碰只需要避开人体的大小手臂即可。Then, the human body is transformed into an obstacle in the Cartesian coordinate system of the robot arm's workspace. Because when the operator is operating on the workbench, only the large and small arms may collide with the robotic arm, so the robot arm only needs to avoid the human body's large and small arms to avoid collisions.

采用圆柱体包络法,将人体的两对大小手臂可以看作是四个等效的圆柱体,一个圆柱的位置信息可以由圆柱体的顶面与底面中心点坐标与圆柱半径表示,因此左侧大手臂的等效圆柱障碍物可以表示为:Using the cylinder envelope method, the two pairs of large and small arms of the human body can be regarded as four equivalent cylinders. The position information of a cylinder can be represented by the coordinates of the center points of the top and bottom surfaces of the cylinder and the radius of the cylinder, so the left The equivalent cylindrical obstacle of the side arm can be expressed as:

Obs_Lb=[PR2x PR2y PR2z PR3x PR3y PR3z r]Obs_Lb=[P R2x P R2y P R2z P R3x P R3y P R3z r]

P2为2点坐标,P3为3点坐标,r为手臂半径。同理其余大小手臂可以等效为:P 2 is the 2-point coordinate, P 3 is the 3-point coordinate, and r is the arm radius. In the same way, the other large and small arms can be equivalent to:

Obs_Ls=[PR3x PR3y PR3z PR4x PR4y PR4z r]Obs_Ls=[P R3x P R3y P R3z P R4x P R4y P R4z r]

Obs_Rb=[PR5x PR5y PR5z PR6x PR6y PR6z r]Obs_Rb=[P R5x P R5y P R5z P R6x P R6y P R6z r]

Obs_Rs=[PR6x PR6y PR6z PR7x PR7y PR7z r]Obs_Rs=[P R6x P R6y P R6z P R7x P R7y P R7z r]

(3)基于等效障碍物,在为机械臂给定简单任务的基础上,使用改进的RRT-CONNECT方法进行避碰工作路径生成。(3) Based on equivalent obstacles and given a simple task for the robotic arm, the improved RRT-CONNECT method is used to generate a collision avoidance working path.

本实施例以六轴机械臂为例,RRT-CONNECT的具体流程如图4所示,具体过程是:This embodiment takes a six-axis robotic arm as an example. The specific process of RRT-CONNECT is shown in Figure 4. The specific process is:

Step1:在机械臂关节空间下给定初始位置点qinit与目标位置点qgoal,qinit与qgoal为六维向量。Step1: Given the initial position point q init and the target position point q goal in the robot arm joint space, q init and q goal are six-dimensional vectors.

Step2:更新任务起点为当前机械臂的关节位置q′init,然后更新步骤2得到的人体手臂障碍物信息。Step2: Update the task starting point to the joint position q′ init of the current robotic arm, and then update the human arm obstacle information obtained in step 2.

Step3:以初始关节位置q′init与目标关节位置qgoal为根节点,生成快速扩展随机树TreeA与TreeB。Step3: Using the initial joint position q′ init and the target joint position q goal as root nodes, generate rapidly expanding random trees TreeA and TreeB.

随机树中包含关节位置向量的集合Q_List以及其中关节向量的连接关系。以TreeA为例,在关节空间中随机取一个关节位置向量qsample,遍历随机树TreeA中的所有关节向量,找到距离qsample最近的关节向量qnearThe random tree contains a set Q_List of joint position vectors and the connection relationship between the joint vectors. Taking TreeA as an example, randomly pick a joint position vector q sample in the joint space, traverse all joint vectors in the random tree TreeA, and find the joint vector q near that is closest to q sample .

其中,||q-qsample||为q与qsample之间的欧氏距离,qnear到qsample的方向为随机树新节点qnew的扩展方向。在qnew的扩展长度上,由于qnew为六维向量,这里将六维向量看作两个三维向量,设定扩展步长为L,则第一个三维变量的扩展坐标为:Among them, ||qq sample || is the Euclidean distance between q and q sample , and the direction from q near to q sample is the expansion direction of the new node q new of the random tree. In terms of the expansion length of q new , since q new is a six-dimensional vector, here the six-dimensional vector is regarded as two three-dimensional vectors, and the expansion step is set to L, then the expansion coordinates of the first three-dimensional variable are:

qnew[0]=qnear[0]+L*cos(θz)cos(θy)q new [0]=q near [0]+L*cos(θ z )cos(θ y )

qnew[1]=qnear[1]+L*cos(θz)sin(θy)q new [1]=q near [1]+L*cos(θ z )sin(θ y )

qnew[2]=qnear[2]+L*sin(θz)q new [2]=q near [2]+L*sin(θ z )

其中:in:

θy=arctan((qsample[1]-qnear[1])/(qsample[0]-qnear[0])),θ y =arctan((q sample [1]-q near [1])/(q sample [0]-q near [0])),

θz=arctan((qsample[2]-qnear[2])/[(qsample[0]-qnear[0])2+(qsample[1]-qnear[1])2]1/2)θ z =arctan((q sample [2]-q near [2])/[(q sample [0]-q near [0]) 2 +(q sample [1]-q near [1]) 2 ] 1/2 )

同理,第二个三维变量的扩展坐标为:In the same way, the expanded coordinates of the second three-dimensional variable are:

qnew[3]=qnear[3]+L*cos(θz2)cos(θy2)q new [3]=q near [3]+L*cos(θ z2 )cos(θ y2 )

qnew[4]=qnear[4]+L*cos(θz2)sin(θy2)q new [4]=q near [4]+L*cos(θ z2 )sin(θ y2 )

qnew[5]=qnear[5]+L*sin(θz2)q new [5]=q near [5]+L*sin(θ z2 )

其中:in:

θy2=arctan((qsample[4]-qnear[4])/(qsample[3]-qnear[3])),θ y2 = arctan((q sample [4]-q near [4])/(q sample [3]-q near [3])),

θz2=arctan((qsample[5]-qnear[5])/[(qsample[3]-qnear[3])2+(qsample[4]-qnear[4])2]1/2)。θ z2 = arctan((q sample [5]-q near [5])/[(q sample [3]-q near [3]) 2 +(q sample [4]-q near [4]) 2 ] 1/2 ).

依据这种方式,可以实现在关节空间下的六维向量的随机取值,且取得的值可以一定程度上削减不同关节的扩展长度不一导致的各关节速度差异较大的情况。According to this method, the random value of the six-dimensional vector in the joint space can be realized, and the obtained value can reduce to a certain extent the large difference in the speed of each joint caused by the different expansion lengths of different joints.

Step4:碰撞检测判定。具体内容如下:通过正运动学可以计算得到六轴机械臂的各个关节点坐标paxis(0,1,2,3,4,5,6,7),对应的可以得到机械臂的近似碰撞模型:Step4: Collision detection and determination. The specific content is as follows: Through forward kinematics, the coordinates p axis (0,1,2,3,4,5,6,7) of each joint point of the six-axis robotic arm can be calculated, and the corresponding approximate collision model of the robotic arm can be obtained :

Obs_Axis6=[Paxis6x Paxis6y Paxis6z Paxis7x Paxis7y Paxis7z r]Obs_Axis6=[P axis6x P axis6y P axis6z P axis7x P axis7y P axis7z r]

Obs_Axis5=[Paxis5x Paxis5y Paxis5z Paxis6x Paxis6y Paxis6z r]Obs_Axis5=[P axis5x P axis5y P axis5z P axis6x P axis6y P axis6z r]

Obs_Axis4=[Paxis4x Paxis4y Paxis4z Paxis5x Paxis5y Paxis5z r]Obs_Axis4=[P axis4x P axis4y P axis4z P axis5x P axis5y P axis5z r]

然后依次对机械臂等效圆柱体与人体手臂等效圆柱体进行最小距离d的计算,设置一定的保护范围dm(dm>r1+r2),r1与r2分别为人体等效障碍物的半径长度与机械臂等效障碍物的半径长度。当d≤dm时,认为两者发生碰撞,否则认为两者为发生碰撞。Then calculate the minimum distance d between the equivalent cylinder of the robotic arm and the equivalent cylinder of the human arm in sequence, and set a certain protection range dm (dm>r1+r2). r1 and r2 are the radius lengths of the equivalent obstacles of the human body respectively. The radius length of the obstacle equivalent to the robot arm. When d≤dm, the two are considered to have collided, otherwise they are considered to have collided.

Step5:判断正反向树是否连接,具体方法为,检测正向树与反向树的两个新增节点之间的路径是否会出现碰撞现象,若产生碰撞则未连接,若路径上均未产生碰撞则已连接。Step5: Determine whether the forward and reverse trees are connected. The specific method is to detect whether there will be a collision in the path between the two new nodes of the forward tree and the reverse tree. If there is a collision, it is not connected. If there is no collision on the path, If a collision occurs, it is connected.

Step6:对正逆随机树进行整合得到完整的避碰路径Step6: Integrate forward and reverse random trees to obtain a complete collision avoidance path

(4)对生成的工作路径进行优化,并驱动机械臂进行移动。(4) Optimize the generated working path and drive the robotic arm to move.

对生成的工作路径进行优化,并驱动机械臂进行移动的具体过程是:The specific process of optimizing the generated working path and driving the robotic arm to move is:

由于RRT-CONNECT得到的路径存在一定的随机性,需要进行一定的优化处理,对随机树中的一个关节空间位置节点qn,计算qn之后几个关节空间位置节点qk(k>n)与qn之间的距离||qk-qn||,检测距离qn最小的关节qm与qn之间的路径是否会发生碰撞信息,若无碰撞发生,则将qm作为qn的下一关节。该方法可以有效缩短路径长度,减少无用的随机节点。然后将优化后的路径进行插值离散,驱动机械臂进行移动。Since the path obtained by RRT-CONNECT has a certain degree of randomness, certain optimization processing is required. For a joint space position node q n in the random tree, calculate several joint space position nodes q k after q n (k>n) The distance between q n and q n ||q k -q n ||, detect whether the path between the joint q m and q n with the smallest distance q n will cause collision information. If no collision occurs, q m will be used as q The next joint of n . This method can effectively shorten the path length and reduce useless random nodes. The optimized path is then interpolated and discretized to drive the robotic arm to move.

驱动机械臂移动的步骤如下:检测当前机械臂关节空间位置与下一个移动的关节空间位置是否会发生碰撞,若发生碰撞,则重新规划路径;若不发生碰撞,则驱动机械臂到达该关节空间位置。The steps to drive the robot arm to move are as follows: detect whether the current joint space position of the robot arm collides with the next moving joint space position. If a collision occurs, re-plan the path; if no collision occurs, drive the robot arm to reach the joint space. Location.

实施例二Embodiment 2

本实施例公开了一种近距人机协作环境下机械臂规避人体系统,包括:This embodiment discloses a system for a robot arm to avoid the human body in a close-range human-machine collaboration environment, including:

惯性传感器、处理器和机械臂;inertial sensors, processors, and robotic arms;

所述惯性传感器用于获取人体上半身关节点位置信息,并将人体上半身关节点位置信息传输给处理器;The inertial sensor is used to obtain the joint point position information of the upper body of the human body and transmit the joint point position information of the upper body of the human body to the processor;

所述处理器用于将人体关节点位置信息转换成机械臂工作空间下的等效障碍物,并基于等效障碍物,在为机械臂给定简单任务的基础上,进行避碰工作路径生成和优化,并将优化后的路径传输给机械臂;The processor is used to convert human body joint point position information into equivalent obstacles in the robot arm's working space, and based on the equivalent obstacles, based on a simple task given to the robot arm, generates and generates collision avoidance working paths. Optimize and transmit the optimized path to the robotic arm;

所述机械臂用于接收处理器发出的路径,并根据路径进行移动。The robotic arm is used to receive the path sent by the processor and move according to the path.

实施例三Embodiment 3

本实施例的目的是提供计算机可读存储介质。The purpose of this embodiment is to provide a computer-readable storage medium.

计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现如本公开实施例1所述的近距人机协作环境下机械臂规避人体方法中的步骤。A computer-readable storage medium has a computer program stored thereon. When the program is executed by a processor, the steps of the method for a robot arm to avoid the human body in a close-range human-machine collaboration environment are implemented as described in Embodiment 1 of the present disclosure.

实施例四Embodiment 4

本实施例的目的是提供电子设备。The purpose of this embodiment is to provide electronic equipment.

电子设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的程序,所述处理器执行所述程序时实现如本公开实施例1所述的近距人机协作环境下机械臂规避人体方法中的步骤。The electronic device includes a memory, a processor, and a program stored in the memory and executable on the processor. When the processor executes the program, the machine in a close-range human-machine collaboration environment as described in Embodiment 1 of the present disclosure is realized. Steps in the arm avoidance method.

以上实施例二、三和四的装置中涉及的各步骤与方法实施例一相对应,具体实施方式可参见实施例一的相关说明部分。术语“计算机可读存储介质”应该理解为包括一个或多个指令集的单个介质或多个介质;还应当被理解为包括任何介质,所述任何介质能够存储、编码或承载用于由处理器执行的指令集并使处理器执行本发明中的任一方法。Each step involved in the devices of the above second, third and fourth embodiments corresponds to the first method embodiment. For specific implementation details, please refer to the relevant description part of the first embodiment. The term "computer-readable storage medium" shall be understood to include a single medium or multiple media that includes one or more sets of instructions; and shall also be understood to include any medium capable of storing, encoding, or carrying instructions for use by a processor. The executed instruction set causes the processor to perform any method in the present invention.

本领域技术人员应该明白,上述本发明的各模块或各步骤可以用通用的计算机装置来实现,可选地,它们可以用计算装置可执行的程序代码来实现,从而,可以将它们存储在存储装置中由计算装置来执行,或者将它们分别制作成各个集成电路模块,或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。本发明不限制于任何特定的硬件和软件的结合。Those skilled in the art should understand that each module or each step of the present invention described above can be implemented by a general-purpose computer device. Alternatively, they can be implemented by program codes executable by the computing device, so that they can be stored in a storage device. The device is executed by a computing device, or they are respectively made into individual integrated circuit modules, or multiple modules or steps among them are made into a single integrated circuit module. The invention is not limited to any specific combination of hardware and software.

上述虽然结合附图对本发明的具体实施方式进行了描述,但并非对本发明保护范围的限制,所属领域技术人员应该明白,在本发明的技术方案的基础上,本领域技术人员不需要付出创造性劳动即可做出的各种修改或变形仍在本发明的保护范围以内。Although the specific embodiments of the present invention have been described above in conjunction with the accompanying drawings, they do not limit the scope of the present invention. Those skilled in the art should understand that based on the technical solutions of the present invention, those skilled in the art do not need to perform creative work. Various modifications or variations that can be made are still within the protection scope of the present invention.

Claims (8)

1. A method for avoiding human bodies by a mechanical arm in a near man-machine cooperation environment is characterized by comprising the following steps:
acquiring the position information of an articular point of the upper body of a human body;
converting the position information of the joint points of the human body into equivalent barriers in the working space of the mechanical arm;
based on equivalent barriers, generating a collision avoidance working path on the basis of giving a simple task to the mechanical arm;
optimizing the generated working path and driving the mechanical arm to move;
the collision avoidance working path is generated, and the specific process is as follows:
step1: giving an initial position point in the joint space of the mechanical armIs +.>
Step2: updating the task starting point to be the joint position of the current mechanical armThen updating the obstacle information;
step3: in the initial joint positionTo the target joint position->Expanding a new node by using a new node expansion method to generate a rapid expansion random tree TreeA and a rapid expansion random tree TreeB;
step4: performing collision detection, executing Step5 if no collision is determined, otherwise executing Step3;
step5: judging whether the forward tree and the reverse tree are connected, if the judgment result is that the forward tree and the reverse tree are connected, executing Step6, otherwise, executing Step3;
step6: integrating the forward and reverse random trees to obtain a complete collision prevention path;
the new node expansion method is used for expanding the new node, and the specific contents are as follows:
randomly taking a joint position vector in joint spaceTraversing all joint vectors in the random tree to find distance +.>Nearest joint vector->Then
wherein ,for q and->Euclidean distance between->To->Is the new node of the random tree->Q_List is a set of joint position vectors;
at the position ofIs extended by six-dimensional vector +.>Regarding two three-dimensional vectors, setting the expansion step length in the three-dimensional space as L, and then the expansion coordinate of the first three-dimensional variable is as follows:
wherein :
the extended coordinates of the second three-dimensional variable are:
wherein :
2. the method for avoiding human body by using the mechanical arm in the near-distance man-machine cooperation environment according to claim 1, wherein the obtaining of the position information of the joint point of the upper body of the human body is specifically as follows:
and acquiring position information of the lower side of the chest, the upper half joint of the left arm, the lower half joint of the left arm, the upper half joint of the right arm and the lower half joint of the right arm under the human body base coordinate system B.
3. The method for avoiding human bodies by using the mechanical arm in the near-distance man-machine cooperation environment according to claim 2, wherein the method is characterized in that the position information of the joint points of the human bodies is converted into equivalent obstacles in the working space of the mechanical arm, and comprises the following specific processes:
and converting the position information of the human body articulation point under the human body base coordinate system B into a mechanical arm working space Cartesian coordinate system R, and then converting the human body into an obstacle under the mechanical arm working space Cartesian coordinate system R.
4. The robotic arm of claim 1 in a near man-machine collaboration environmentThe human body evading method is characterized in that in the collision detection, the coordinates of each joint point of the six-axis mechanical arm are obtained through positive kinematics calculationThe collision model of the mechanical arm is obtained as follows:
5. the method for avoiding human bodies by using the mechanical arm in the near-distance man-machine cooperation environment according to claim 1, wherein the method is characterized in that the generated working path is optimized and the mechanical arm is driven to move, and the specific process is as follows:
detecting whether the joint space position of the current mechanical arm collides with the joint space position of the next movement, and if so, re-planning a path; if no collision occurs, the mechanical arm is driven to reach the joint space position.
6. The utility model provides a robotic arm avoids human system under close-range man-machine cooperation environment which characterized in that includes:
inertial sensor, processor and mechanical arm;
the inertial sensor is used for acquiring the position information of the joint point of the upper body of the human body and transmitting the position information of the joint point of the upper body of the human body to the processor;
the processor is used for converting the position information of the joint points of the human body into equivalent barriers in the working space of the mechanical arm, generating and optimizing a collision avoidance working path on the basis of giving a simple task to the mechanical arm based on the equivalent barriers, and transmitting an optimized path instruction to the mechanical arm;
the mechanical arm is used for receiving a path instruction sent by the processor and moving according to the path instruction;
the collision avoidance working path is generated, and the specific process is as follows:
step1: giving an initial position point in the joint space of the mechanical armIs +.>
Step2: updating the task starting point to be the joint position of the current mechanical armThen updating the obstacle information;
step3: in the initial joint positionTo the target joint position->Expanding a new node by using a new node expansion method to generate a rapid expansion random tree TreeA and a rapid expansion random tree TreeB;
step4: performing collision detection, executing Step5 if no collision is determined, otherwise executing Step3;
step5: judging whether the forward tree and the reverse tree are connected, if the judgment result is that the forward tree and the reverse tree are connected, executing Step6, otherwise, executing Step3;
step6: integrating the forward and reverse random trees to obtain a complete collision prevention path;
the new node expansion method is used for expanding the new node, and the specific contents are as follows:
randomly taking a joint position vector in joint spaceTraversing all joint vectors in the random tree to find distance +.>Nearest joint vector->Then
wherein ,for q and->Euclidean distance between->To->Is the new node of the random tree->Q_List is a set of joint position vectors;
at the position ofIs extended by six-dimensional vector +.>Regarding two three-dimensional vectors, setting the expansion step length in the three-dimensional space as L, and then the expansion coordinate of the first three-dimensional variable is as follows:
wherein :
the extended coordinates of the second three-dimensional variable are:
wherein :
7. a computer readable storage medium having stored thereon a program, which when executed by a processor, performs the steps of the method for robotic arm avoidance of human body in a near man machine collaboration environment according to any of claims 1-5.
8. Electronic device comprising a memory, a processor and a program stored on the memory and executable on the processor, characterized in that the processor, when executing the program, realizes the steps in the method for avoiding a human body by a mechanical arm in a near man-machine cooperation environment according to any one of claims 1-5.
CN202210699792.0A 2022-06-20 2022-06-20 A method and system for a robotic arm to avoid the human body in a close-range human-machine collaboration environment Active CN114918923B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210699792.0A CN114918923B (en) 2022-06-20 2022-06-20 A method and system for a robotic arm to avoid the human body in a close-range human-machine collaboration environment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210699792.0A CN114918923B (en) 2022-06-20 2022-06-20 A method and system for a robotic arm to avoid the human body in a close-range human-machine collaboration environment

Publications (2)

Publication Number Publication Date
CN114918923A CN114918923A (en) 2022-08-19
CN114918923B true CN114918923B (en) 2023-09-22

Family

ID=82814185

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210699792.0A Active CN114918923B (en) 2022-06-20 2022-06-20 A method and system for a robotic arm to avoid the human body in a close-range human-machine collaboration environment

Country Status (1)

Country Link
CN (1) CN114918923B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109620410A (en) * 2018-12-04 2019-04-16 微创(上海)医疗机器人有限公司 The method and system of mechanical arm anticollision, medical robot
CN112975939A (en) * 2019-12-12 2021-06-18 中国科学院沈阳自动化研究所 Dynamic trajectory planning method for cooperative mechanical arm
CN113172631A (en) * 2021-05-11 2021-07-27 西南交通大学 An autonomous obstacle avoidance method for robotic arm based on improved RRT algorithm
CN113352319A (en) * 2021-05-08 2021-09-07 上海工程技术大学 Redundant mechanical arm obstacle avoidance trajectory planning method based on improved fast expansion random tree

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ES2590078T3 (en) * 2006-03-03 2016-11-18 Universal Robots A/S Programmable robot and user interface

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109620410A (en) * 2018-12-04 2019-04-16 微创(上海)医疗机器人有限公司 The method and system of mechanical arm anticollision, medical robot
CN112975939A (en) * 2019-12-12 2021-06-18 中国科学院沈阳自动化研究所 Dynamic trajectory planning method for cooperative mechanical arm
CN113352319A (en) * 2021-05-08 2021-09-07 上海工程技术大学 Redundant mechanical arm obstacle avoidance trajectory planning method based on improved fast expansion random tree
CN113172631A (en) * 2021-05-11 2021-07-27 西南交通大学 An autonomous obstacle avoidance method for robotic arm based on improved RRT algorithm

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
不确定环境下移动机器人路径规划算法研究;李贻斌等;《杭州电子科技大学学报》;第25卷(第2期);10-13 *
基于改进型RRT-Connect算法的六自由度机械臂路径规划研究;徐启航;《硕士电子期刊》;全文 *

Also Published As

Publication number Publication date
CN114918923A (en) 2022-08-19

Similar Documents

Publication Publication Date Title
CN108705532B (en) Mechanical arm obstacle avoidance path planning method and device and storage device
CN114080583B (en) Visual teaching and repetitive movement manipulation system
JP3945279B2 (en) Obstacle recognition apparatus, obstacle recognition method, obstacle recognition program, and mobile robot apparatus
Feng et al. A human-tracking robot using ultra wideband technology
JP2019501384A (en) Autonomous positioning navigation equipment, positioning navigation method and autonomous positioning navigation system
Li et al. A novel recurrent neural network for improving redundant manipulator motion planning completeness
CN111515928B (en) Mechanical arm motion control system
Shen et al. Research and implementation of SLAM based on LIDAR for four-wheeled mobile robot
Ren et al. Integrated task sensing and whole body control for mobile manipulation with series elastic actuators
Lee et al. Fast perception, planning, and execution for a robotic butler: Wheeled humanoid m-hubo
JP2003266349A (en) Position recognition method, device thereof, program thereof, recording medium thereof, and robot device provided with position recognition device
Zhou et al. Local observation based reactive temporal logic planning of human-robot systems
Han et al. Grasping control method of manipulator based on binocular vision combining target detection and trajectory planning
Li et al. Multi-joint active collision avoidance for robot based on depth visual perception
CN114918923B (en) A method and system for a robotic arm to avoid the human body in a close-range human-machine collaboration environment
CN115407769A (en) Control method and system of mobile handling robot based on Cartographer algorithm
Siradjuddin et al. A real-time model based visual servoing application for a differential drive mobile robot using beaglebone black embedded system
Chung et al. An intelligent service robot for transporting object
Maeda et al. Frequency response experiments of 3-d pose full-tracking visual servoing with eye-vergence hand-eye robot system
Shauri et al. Sensor integration and fusion for autonomous screwing task by dual-manipulator hand robot
WO2020010625A1 (en) Method and system for optimizing kinematic model of robot, and storage device.
Vahrenkamp et al. Planning and execution of grasping motions on a humanoid robot
Ling et al. Design and test of a multifunctional mobile manipulator control system on an experimental platform
Bauer et al. Autonomous vision-based rapid aerial grasping
Ge et al. An object localization system using monocular camera and two-axis-controlled laser ranging sensor for mobile robot

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant