CN116061171A - Adjusting arm control method, device, system, computer equipment and storage medium - Google Patents
Adjusting arm control method, device, system, computer equipment and storage medium Download PDFInfo
- Publication number
- CN116061171A CN116061171A CN202211095317.9A CN202211095317A CN116061171A CN 116061171 A CN116061171 A CN 116061171A CN 202211095317 A CN202211095317 A CN 202211095317A CN 116061171 A CN116061171 A CN 116061171A
- Authority
- CN
- China
- Prior art keywords
- control
- angular velocity
- expected
- joint
- expected angular
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 238000003860 storage Methods 0.000 title abstract description 13
- 230000001133 acceleration Effects 0.000 claims abstract description 67
- 230000003213 activating effect Effects 0.000 claims abstract description 8
- 230000004913 activation Effects 0.000 claims description 97
- 238000004590 computer program Methods 0.000 claims description 26
- 230000001629 suppression Effects 0.000 claims description 13
- 238000004364 calculation method Methods 0.000 claims description 11
- 230000009466 transformation Effects 0.000 claims description 8
- 230000000670 limiting effect Effects 0.000 claims description 5
- 230000005764 inhibitory process Effects 0.000 claims 1
- 230000003993 interaction Effects 0.000 abstract description 16
- 238000012545 processing Methods 0.000 abstract description 9
- 230000033001 locomotion Effects 0.000 description 30
- 238000010586 diagram Methods 0.000 description 16
- 230000002452 interceptive effect Effects 0.000 description 7
- 239000011159 matrix material Substances 0.000 description 6
- 230000008859 change Effects 0.000 description 5
- 238000013473 artificial intelligence Methods 0.000 description 4
- 238000013528 artificial neural network Methods 0.000 description 4
- 238000004422 calculation algorithm Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 230000002688 persistence Effects 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- OKTJSMMVPCPJKN-UHFFFAOYSA-N Carbon Chemical compound [C] OKTJSMMVPCPJKN-UHFFFAOYSA-N 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000033228 biological regulation Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 229910021389 graphene Inorganic materials 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000036961 partial effect Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1602—Programme controls characterised by the control system, structure, architecture
Landscapes
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Robotics (AREA)
- Mechanical Engineering (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
本申请涉及一种调整臂控制方法、装置、系统、计算机设备、存储介质。所述方法包括:通过获取控制指令,识别控制指令的控制类型,确定控制类型对应的触发逻辑的状态;控制类型分为接触式控制和非接触式控制;若触发逻辑为激活状态,基于控制指令的控制类型,获取与控制指令对应的末端期望角速度;根据末端期望角速度获取末端期望角加速度,根据末端期望角速度和末端期望角加速度控制调整臂末端执行预设操作。采用本方法能够提供多种调整臂的交互方式,并为每种交互方式配置一个处理逻辑防止误触,只需要激活对应的触发逻辑,就能够采用对应的交互方式控制调整臂,提高了调整臂的控制效率。
The present application relates to an adjustment arm control method, device, system, computer equipment, and storage medium. The method includes: by acquiring the control instruction, identifying the control type of the control instruction, and determining the state of the trigger logic corresponding to the control type; the control type is divided into contact control and non-contact control; if the trigger logic is active, based on the control instruction According to the control type, the end expected angular velocity corresponding to the control command is obtained; the end expected angular acceleration is obtained according to the end expected angular velocity, and the end of the adjustment arm is controlled to perform preset operations according to the end expected angular velocity and end expected angular acceleration. This method can provide a variety of interaction modes for the adjustment arm, and configure a processing logic for each interaction mode to prevent false touches. Only by activating the corresponding trigger logic, the adjustment arm can be controlled in the corresponding interaction mode, which improves the adjustment arm. control efficiency.
Description
技术领域technical field
本申请涉及人工智能技术领域,特别是涉及一种调整臂控制方法、装置、系统、计算机设备、存储介质和计算机程序产品。The present application relates to the technical field of artificial intelligence, in particular to an adjustment arm control method, device, system, computer equipment, storage medium and computer program product.
背景技术Background technique
目前在单孔手术机器人系统中,一般由一个带有多个自由度的内窥镜,多个多自由度器械,器械与内窥镜通过单孔进入病人体内进行手术操作。在该系统中,器械与内窥镜均可通过主从单独控制。器械与内窥镜整体可以通过调整臂绕不动点进行调整。内窥镜视野可通过调整内窥镜器械位置,也可以通过调整关节实现整体移动调整。在内窥镜控制模式时,工作人员仅能通过触摸屏选择内窥镜控制模式,控制手段单一,一旦出现人机交互不顺畅的问题,就会导致控制效率低下。At present, in the single-hole surgical robot system, an endoscope with multiple degrees of freedom and multiple multi-degree-of-freedom instruments are generally used. The instruments and the endoscope enter the patient's body through a single hole for surgical operation. In this system, instruments and endoscopes can be independently controlled by master and slave. The instrument and the endoscope as a whole can be adjusted by the adjusting arm around the fixed point. The endoscopic field of view can be adjusted by adjusting the position of the endoscopic instrument, or by adjusting the joints to achieve overall movement adjustment. In the endoscope control mode, the staff can only select the endoscope control mode through the touch screen, and the control method is single. Once the problem of unsmooth human-computer interaction occurs, the control efficiency will be low.
然而,目前的单孔手术机器人存在控制效率较低的问题。However, the current single-hole surgical robot has the problem of low control efficiency.
发明内容Contents of the invention
基于此,有必要针对上述技术问题,提供一种能够提高机器人控制效率的调整臂控制方法、装置、计算机设备、计算机可读存储介质和计算机程序产品。Based on this, it is necessary to address the above technical problems and provide an adjustment arm control method, device, computer equipment, computer readable storage medium and computer program product that can improve robot control efficiency.
第一方面,本申请提供了一种调整臂控制方法。所述方法包括:In a first aspect, the present application provides a method for controlling an adjusting arm. The methods include:
获取控制指令,识别控制指令的控制类型,确定控制类型对应的触发逻辑的状态;控制类型分为接触式控制和非接触式控制;Obtain control instructions, identify the control type of the control instruction, and determine the state of the trigger logic corresponding to the control type; the control types are divided into contact control and non-contact control;
若触发逻辑为激活状态,基于控制指令的控制类型,获取与控制指令对应的末端期望角速度;If the trigger logic is active, based on the control type of the control command, obtain the terminal expected angular velocity corresponding to the control command;
根据末端期望角速度获取末端期望角加速度,根据末端期望角速度和末端期望角加速度控制调整臂末端执行预设操作。Obtain the terminal desired angular acceleration according to the terminal desired angular velocity, and control the end of the adjustment arm to perform preset operations according to the terminal desired angular velocity and the terminal desired angular acceleration.
在其中一个实施例中,确定控制类型对应的触发逻辑的状态,包括:In one of the embodiments, determining the state of the trigger logic corresponding to the control type includes:
若控制指令为接触式控制,确定触发逻辑为瞬时触发逻辑或持续触发逻辑;If the control instruction is contact control, determine whether the trigger logic is instantaneous trigger logic or continuous trigger logic;
若控制指令为非接触式控制,确定触发逻辑为手势触发逻辑。If the control command is non-contact control, it is determined that the trigger logic is gesture trigger logic.
在其中一个实施例中,获取控制指令之前,还包括:In one of the embodiments, before obtaining the control instruction, it also includes:
获取激活指令,并识别激活指令的激活类型;激活类型分为接触式激活和非接触式激活;Obtain the activation instruction and identify the activation type of the activation instruction; the activation type is divided into contact activation and non-contact activation;
若激活类型为接触式激活,获取激活指令的输入时长;If the activation type is contact activation, get the input duration of the activation command;
若输入时长不满足持续条件,激活瞬时触发逻辑。If the input duration does not meet the continuous condition, activate the instantaneous trigger logic.
在其中一个实施例中,方法还包括:In one embodiment, the method also includes:
若输入时长满足持续条件,激活持续触发逻辑。If the input duration satisfies the continuous condition, activate the continuous trigger logic.
在其中一个实施例中,方法还包括:In one embodiment, the method also includes:
若激活类型为非接触式激活,则获取激活指令中的手势信息;If the activation type is non-contact activation, obtain the gesture information in the activation command;
若手势信息满足变换条件,激活手势触发逻辑。If the gesture information satisfies the conversion condition, the gesture trigger logic is activated.
在其中一个实施例中,方法还包括:In one embodiment, the method also includes:
若触发逻辑为未激活状态,不获取与控制指令对应的末端期望角速度,将控制指令作为误触指令。If the trigger logic is in an inactive state, the terminal expected angular velocity corresponding to the control command is not obtained, and the control command is regarded as a false touch command.
在其中一个实施例中,基于控制指令的控制类型,获取与控制指令对应的末端期望角速度,包括:In one of the embodiments, based on the control type of the control command, obtaining the terminal expected angular velocity corresponding to the control command includes:
基于控制类型,计算与控制指令对应的初始期望角速度;Based on the control type, calculating an initial desired angular velocity corresponding to the control command;
对初始期望角速度进行死区抑制,调整初始期望角速度的取值,得到末端期望角速度。Perform dead zone suppression on the initial desired angular velocity, adjust the value of the initial desired angular velocity, and obtain the terminal desired angular velocity.
在其中一个实施例中,基于控制指令的控制类型,计算与控制指令对应的初始期望角速度,包括:In one of the embodiments, based on the control type of the control command, the initial expected angular velocity corresponding to the control command is calculated, including:
若控制指令为接触式控制,从控制指令中获取角度信息或角速度信息;If the control command is contact control, obtain angle information or angular velocity information from the control command;
根据角度信息或角速度信息,计算得到初始期望角速度。According to the angle information or the angular velocity information, the initial expected angular velocity is calculated.
在其中一个实施例中,方法还包括:In one embodiment, the method also includes:
若控制指令为非接触式控制,从控制指令中获取手势信息;If the control command is non-contact control, gesture information is obtained from the control command;
根据手势信息,计算得到初始期望角速度。According to the gesture information, the initial expected angular velocity is calculated.
在其中一个实施例中,对初始期望角速度进行死区抑制,调整初始期望角速度的取值,得到末端期望角速度,包括:In one of the embodiments, the dead zone suppression is performed on the initial expected angular velocity, and the value of the initial expected angular velocity is adjusted to obtain the terminal expected angular velocity, including:
若初始期望角速度的大小处于死区范围,末端期望角速度为0;If the initial desired angular velocity is within the dead zone, the terminal desired angular velocity is 0;
若初始期望角速度的大小处于线性区范围,将初始期望角速度作为末端期望角速度;If the size of the initial expected angular velocity is in the range of the linear region, the initial expected angular velocity is used as the terminal expected angular velocity;
若初始期望角速度的大小处于正限幅区范围,将正限幅值作为末端期望角速度;If the magnitude of the initial desired angular velocity is within the range of the positive clipping area, the positive clipping value is used as the terminal desired angular velocity;
若初始期望角速度的大小处于负限幅区范围,将负限幅值作为末端期望角速度。If the magnitude of the initial expected angular velocity is within the range of the negative limit range, the negative limit value is used as the end expected angular velocity.
在其中一个实施例中,根据末端期望角速度和末端期望角加速度控制调整臂末端执行预设操作,包括:In one of the embodiments, the end of the adjusting arm is controlled to perform preset operations according to the desired angular velocity and the desired angular acceleration of the terminal, including:
根据末端期望角速度和末端期望角加速度计算得到调整臂关节对应的关节期望位置,并根据关节期望位置获取调整臂关节对应的期望力矩;Calculate the expected position of the joint corresponding to the joint of the adjusting arm according to the expected angular velocity and the expected angular acceleration of the end, and obtain the expected torque corresponding to the joint of the adjusting arm according to the expected position of the joint;
基于期望力矩控制调整臂关节,以控制调整臂末端执行预设操作。Control the adjustment arm joint based on the desired torque to control the end of the adjustment arm to perform preset operations.
在其中一个实施例中,根据末端期望角速度和末端期望角加速度计算得到调整臂关节对应的关节期望位置,包括:In one of the embodiments, the expected position of the joint corresponding to the joint of the adjusting arm is calculated according to the expected angular velocity of the terminal and the expected angular acceleration of the terminal, including:
获取调整臂的关节当前所处的关节位置;Obtain the current joint position of the joint of the adjustment arm;
根据末端期望角速度、末端期望角加速度和关节位置,采用微分运动学计算得到调整臂的关节对应的关节期望角速度、关节期望角加速度和关节速度;According to the expected angular velocity of the terminal, the expected angular acceleration of the terminal and the position of the joint, the differential kinematics is used to calculate the expected angular velocity of the joint, the expected angular acceleration of the joint and the joint velocity corresponding to the joint of the adjustment arm;
根据关节期望角速度、关节期望角加速度和关节速度,采用积分运动学计算得到关节期望位置。According to joint expected angular velocity, joint expected angular acceleration and joint velocity, integral kinematics is used to calculate joint expected position.
第二方面,本申请还提供了一种调整臂控制装置。所述装置包括:In a second aspect, the present application also provides an adjustment arm control device. The devices include:
获取模块,用于获取控制指令,识别控制指令的控制类型,确定控制类型对应的触发逻辑的状态;控制类型分为接触式控制和非接触式控制;The obtaining module is used to obtain control instructions, identify the control type of the control instruction, and determine the state of the trigger logic corresponding to the control type; the control types are divided into contact control and non-contact control;
运算模块,用于若触发逻辑为激活状态,基于控制指令的控制类型,获取与控制指令对应的末端期望角速度;The calculation module is used to obtain the terminal expected angular velocity corresponding to the control command based on the control type of the control command if the trigger logic is activated;
控制模块,用于根据末端期望角速度获取末端期望角加速度,根据末端期望角速度和末端期望角加速度控制调整臂末端执行预设操作。The control module is used to obtain the desired angular acceleration of the terminal according to the desired angular velocity of the terminal, and control the terminal of the adjustment arm to perform a preset operation according to the desired angular velocity of the terminal and the desired angular acceleration of the terminal.
第三方面,本申请还提供了一种调整臂控制系统。所述系统包括:In a third aspect, the present application also provides an adjustment arm control system. The system includes:
控制台,用于获取控制指令,识别控制指令的控制类型,确定控制类型对应的触发逻辑的状态;若触发逻辑为激活状态,基于控制类型,计算与控制指令对应的初始期望角速度,并传输初始期望角速度至调整臂台车;The console is used to obtain control instructions, identify the control type of the control instruction, and determine the state of the trigger logic corresponding to the control type; if the trigger logic is activated, based on the control type, calculate the initial expected angular velocity corresponding to the control instruction, and transmit the initial Expected angular velocity to the adjusting arm trolley;
调整臂台车,用于对初始期望角速度进行死区抑制,调整初始期望角速度的取值,得到末端期望角速度;根据末端期望角速度获取末端期望角加速度,根据末端期望角速度和末端期望角加速度控制调整臂末端执行预设操作。The adjusting arm trolley is used to suppress the dead zone of the initial desired angular velocity, adjust the value of the initial desired angular velocity, and obtain the terminal desired angular velocity; obtain the terminal desired angular acceleration according to the terminal desired angular velocity, and control the adjustment according to the terminal desired angular velocity and terminal desired angular acceleration The end of the arm performs preset operations.
第四方面,本申请还提供了一种计算机设备。所述计算机设备包括存储器和处理器,所述存储器存储有计算机程序,所述处理器执行所述计算机程序时实现以下步骤:In a fourth aspect, the present application also provides a computer device. The computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the following steps when executing the computer program:
获取控制指令,识别控制指令的控制类型,确定控制类型对应的触发逻辑的状态;控制类型分为接触式控制和非接触式控制;Obtain control instructions, identify the control type of the control instruction, and determine the state of the trigger logic corresponding to the control type; the control types are divided into contact control and non-contact control;
若触发逻辑为激活状态,基于控制指令的控制类型,获取与控制指令对应的末端期望角速度;If the trigger logic is active, based on the control type of the control command, obtain the terminal expected angular velocity corresponding to the control command;
根据末端期望角速度获取末端期望角加速度,根据末端期望角速度和末端期望角加速度控制调整臂末端执行预设操作。Obtain the terminal desired angular acceleration according to the terminal desired angular velocity, and control the end of the adjustment arm to perform preset operations according to the terminal desired angular velocity and the terminal desired angular acceleration.
第五方面,本申请还提供了一种计算机可读存储介质。所述计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现以下步骤:In a fifth aspect, the present application further provides a computer-readable storage medium. The computer-readable storage medium has a computer program stored thereon, and when the computer program is executed by a processor, the following steps are implemented:
获取控制指令,识别控制指令的控制类型,确定控制类型对应的触发逻辑的状态;控制类型分为接触式控制和非接触式控制;Obtain control instructions, identify the control type of the control instruction, and determine the state of the trigger logic corresponding to the control type; the control types are divided into contact control and non-contact control;
若触发逻辑为激活状态,基于控制指令的控制类型,获取与控制指令对应的末端期望角速度;If the trigger logic is active, based on the control type of the control command, obtain the terminal expected angular velocity corresponding to the control command;
根据末端期望角速度获取末端期望角加速度,根据末端期望角速度和末端期望角加速度控制调整臂末端执行预设操作。Obtain the terminal desired angular acceleration according to the terminal desired angular velocity, and control the end of the adjustment arm to perform preset operations according to the terminal desired angular velocity and the terminal desired angular acceleration.
第六方面,本申请还提供了一种计算机程序产品。所述计算机程序产品,包括计算机程序,该计算机程序被处理器执行时实现以下步骤:In a sixth aspect, the present application further provides a computer program product. The computer program product includes a computer program, and when the computer program is executed by a processor, the following steps are implemented:
获取控制指令,识别控制指令的控制类型,确定控制类型对应的触发逻辑的状态;控制类型分为接触式控制和非接触式控制;Obtain control instructions, identify the control type of the control instruction, and determine the state of the trigger logic corresponding to the control type; the control types are divided into contact control and non-contact control;
若触发逻辑为激活状态,基于控制指令的控制类型,获取与控制指令对应的末端期望角速度;If the trigger logic is active, based on the control type of the control command, obtain the terminal expected angular velocity corresponding to the control command;
根据末端期望角速度获取末端期望角加速度,根据末端期望角速度和末端期望角加速度控制调整臂末端执行预设操作。Obtain the terminal desired angular acceleration according to the terminal desired angular velocity, and control the end of the adjustment arm to perform preset operations according to the terminal desired angular velocity and the terminal desired angular acceleration.
上述调整臂控制方法、装置、系统、计算机设备、存储介质和计算机程序产品,通过获取控制指令,识别控制指令的控制类型,确定控制类型对应的触发逻辑的状态;控制类型分为接触式控制和非接触式控制;若触发逻辑为激活状态,基于控制指令的控制类型,获取与控制指令对应的末端期望角速度;根据末端期望角速度获取末端期望角加速度,根据末端期望角速度和末端期望角加速度控制调整臂末端执行预设操作。能够提供多种调整臂的交互方式,并为每种交互方式配置一个处理逻辑防止误触,只需要激活对应的触发逻辑,就能够采用对应的交互方式控制调整臂,提高了调整臂的控制效率。The control method, device, system, computer equipment, storage medium, and computer program product of the above-mentioned adjusting arm, by obtaining the control instruction, identifying the control type of the control instruction, and determining the state of the trigger logic corresponding to the control type; the control type is divided into contact control and Non-contact control; if the trigger logic is active, based on the control type of the control command, obtain the terminal desired angular velocity corresponding to the control command; obtain the terminal desired angular acceleration according to the terminal desired angular velocity, and control and adjust according to the terminal desired angular velocity and terminal desired angular acceleration The end of the arm performs preset operations. It can provide a variety of interaction modes of the adjustment arm, and configure a processing logic for each interaction mode to prevent false touches. Only need to activate the corresponding trigger logic, the adjustment arm can be controlled in the corresponding interaction mode, which improves the control efficiency of the adjustment arm .
附图说明Description of drawings
图1为一个实施例中调整臂控制方法的流程示意图;Fig. 1 is a schematic flow chart of an adjusting arm control method in an embodiment;
图2为一个实施例中控制类型和触发逻辑的对应关系示意图;Fig. 2 is a schematic diagram of the corresponding relationship between control types and trigger logic in an embodiment;
图3为一个实施例中接触式交互装置结构示意图;Fig. 3 is a schematic structural diagram of a contact interaction device in an embodiment;
图4为一个实施例中非接触式交互装置结构示意图;Fig. 4 is a schematic structural diagram of a non-contact interaction device in an embodiment;
图5为一个实施例中瞬时触发逻辑的流程示意图;Fig. 5 is a schematic flow diagram of the instantaneous trigger logic in an embodiment;
图6为一个实施例中持续触发逻辑的流程示意图;Fig. 6 is a schematic flow chart of continuous trigger logic in an embodiment;
图7为一个实施例中手势触发逻辑的流程示意图;FIG. 7 is a schematic flow diagram of gesture trigger logic in an embodiment;
图8为一个实施例中手势姿态识别的流程示意图;FIG. 8 is a schematic flow chart of gesture recognition in an embodiment;
图9为一个实施例中手势姿态坐标系示意图;Fig. 9 is a schematic diagram of a gesture posture coordinate system in an embodiment;
图10为一个实施例中死区抑制的原理示意图;Fig. 10 is a schematic diagram of the principle of dead zone suppression in an embodiment;
图11为一个实施例中预测末端角加速度的原理示意图;Fig. 11 is a schematic diagram of the principle of predicting terminal angular acceleration in one embodiment;
图12为一个实施例中计算期望力矩的原理示意图;Fig. 12 is a schematic diagram of the principle of calculating the expected torque in one embodiment;
图13为一个实施例中调整臂控制系统的结构示意图;Fig. 13 is a schematic structural diagram of an adjusting arm control system in an embodiment;
图14为一个实施例中调整臂控制系统的组成设备示意图;Fig. 14 is a schematic diagram of components of the adjusting arm control system in one embodiment;
图15为一个实施例中控制台工作流程示意图;Fig. 15 is a schematic diagram of console workflow in one embodiment;
图16为一个实施例中调整臂台车工作流程示意图;Fig. 16 is a schematic diagram of the work flow of the adjusting arm trolley in one embodiment;
图17为一个实施例中调整臂控制装置的结构框图;Fig. 17 is a structural block diagram of an adjusting arm control device in an embodiment;
图18为一个实施例中计算机设备的内部结构图。Figure 18 is a diagram of the internal structure of a computer device in one embodiment.
具体实施方式Detailed ways
为了使本申请的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本申请进行进一步详细说明。应当理解,此处描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.
本申请实施例提供的调整臂控制方法,可以应用于机器人,机器人至少包括控制器和调整臂,调整臂至少包括调整臂关节和调整臂末端。机器人是自动执行工作的机器装置。它既可以接受人类指挥,又可以运行预先编排的程序,也可以根据以人工智能技术制定的原则纲领行动。机器人的任务是协助或取代人类工作的工作,例如生产、建筑业、医疗等工作。The adjustment arm control method provided in the embodiment of the present application can be applied to a robot. The robot includes at least a controller and an adjustment arm, and the adjustment arm includes at least an adjustment arm joint and an adjustment arm end. A robot is a machine device that performs work automatically. It can accept human command, run pre-programmed programs, and act according to principles formulated with artificial intelligence technology. The task of robots is to assist or replace human work, such as production, construction, medical and other work.
在一个实施例中,如图1所示,提供了一种调整臂控制方法,以该方法应用于单孔手术机器人为例进行说明,包括以下步骤:In one embodiment, as shown in FIG. 1 , a control method for adjusting an arm is provided. The application of the method to a single-hole surgical robot is used as an example for illustration, including the following steps:
步骤102,获取控制指令,识别控制指令的控制类型,确定控制类型对应的触发逻辑的状态;控制类型分为接触式控制和非接触式控制。
可选的,控制指令可分为接触式控制与非接触式控制两种,分别通过不同的控制设备或传感器进行获取,不同控制类型的控制指令包含不同的期望运动参数,且对应不同的触发逻辑。其中,接触式控制可细分为三轴角度传感控制与三轴角速度传感控制,非接触式为手势点云传感控制。激活逻辑分为瞬时触发、持续触发和手势触发三种。期望运动参数分为角度输入、角速度输入与手势输入三种。各控制类型与对应的触发逻辑和期望运动参数如图2所示。例如,单孔手术机器人控制器配置有多个交互传感控制设备,三轴角度传感控制可由摇杆输入,输入的期望运动参数为角度;三轴角速度传感控制可由触摸球输入,输入的期望运动参数为角速度;手势点云可由激光扫描输入,输入的期望运动参数为手势。根据获取到的控制指令的输入内容判断控制指令的控制类型,若获取到的控制指令是接触式控制(包括三轴角度传感控制和三轴角速度传感控制),则确定当前对应的触发逻辑是瞬时触发逻辑或者持续触发逻辑,若获取到的控制指令是非接触式控制,则确定当前对应的触发逻辑是手势触发逻辑。Optionally, the control commands can be divided into two types: contact control and non-contact control, which are respectively obtained through different control devices or sensors. Control commands of different control types contain different expected motion parameters and correspond to different trigger logics . Among them, contact control can be subdivided into three-axis angle sensing control and three-axis angular velocity sensing control, and non-contact control is gesture point cloud sensing control. The activation logic is divided into three types: instantaneous trigger, continuous trigger and gesture trigger. The expected motion parameters are divided into three types: angle input, angular velocity input and gesture input. Each control type and the corresponding trigger logic and expected motion parameters are shown in Figure 2. For example, the single-hole surgical robot controller is equipped with multiple interactive sensing control devices. The three-axis angle sensor control can be input by the joystick, and the input desired motion parameter is angle; the three-axis angular velocity sensor control can be input by the touch ball, and the input The expected motion parameter is angular velocity; the gesture point cloud can be input by laser scanning, and the input expected motion parameter is gesture. Determine the control type of the control command according to the input content of the obtained control command. If the obtained control command is contact control (including three-axis angle sensor control and three-axis angular velocity sensor control), determine the current corresponding trigger logic It is instantaneous trigger logic or continuous trigger logic. If the acquired control instruction is non-contact control, it is determined that the current corresponding trigger logic is gesture trigger logic.
步骤104,若触发逻辑为激活状态,基于控制指令的控制类型,获取与控制指令对应的末端期望角速度。
可选的,如果当前控制类型对应的触发逻辑为激活状态,则可以采用当前控制类型的控制指令对调整臂进行控制。例如,当前的瞬时触发逻辑处于激活状态,若获取的控制指令为接触式控制,则从控制指令中获取期望运动参数,处理期望运动参数得到末端期望角速度。通常情况下,瞬时触发逻辑需要提前按下开关激活,持续触发逻辑需要持续按住开关激活,手势触发逻辑需要提前通过完成指定动作激活。Optionally, if the trigger logic corresponding to the current control type is activated, the control instruction of the current control type can be used to control the adjustment arm. For example, the current instantaneous trigger logic is active, and if the obtained control command is touch control, the desired motion parameters are obtained from the control command, and the desired motion parameters are processed to obtain the terminal desired angular velocity. Usually, the instantaneous trigger logic needs to be activated by pressing the switch in advance, the continuous trigger logic needs to be continuously pressed to activate the switch, and the gesture trigger logic needs to be activated by completing the specified action in advance.
在一个可行的实施方式中,若触发逻辑为未激活状态,不从控制指令中获取期望运动参数,将控制指令作为误触指令。In a feasible implementation manner, if the trigger logic is in an inactive state, the desired motion parameter is not obtained from the control command, and the control command is used as a false touch command.
具体的,如果当前存在触发逻辑为激活状态,但获取到的控制指令的控制类型与其不对应,则会将当前控制指令判定为误触控制,不做处理。例如,当前的瞬时触发逻辑处于激活状态,当前的手势触发逻辑处于未激活状态,若获取的控制指令为非接触式控制,则将当前控制指令判定为误触控制,不做处理。Specifically, if the current trigger logic is active, but the control type of the obtained control instruction does not correspond to it, the current control instruction will be determined as false touch control and will not be processed. For example, the current instantaneous trigger logic is active, and the current gesture trigger logic is inactive. If the acquired control command is non-contact control, the current control command is determined to be false touch control and is not processed.
步骤106,根据末端期望角速度获取末端期望角加速度,根据末端期望角速度和末端期望角加速度控制调整臂末端执行预设操作。Step 106: Obtain the desired angular acceleration of the terminal according to the desired angular velocity of the terminal, and control the terminal of the adjustment arm to perform a preset operation according to the desired angular velocity of the terminal and the desired angular acceleration of the terminal.
可选的,单孔手术机器人可以根据末端期望角速度进行差分计算得到相应的末端期望角加速度;单孔手术机器人也可以从外部数据中读取与末端期望角速度相匹配的末端期望角加速度;还可以由外部处理设备(外部处理设备与单孔手术机器人实时通讯)接收单孔手术机器人生成的末端期望角速度,根据末端期望角速度进行差分计算得到相应的末端期望角加速度,再将末端期望角加速度传输给单孔手术机器人。Optionally, the single-hole surgical robot can perform differential calculation according to the expected angular velocity of the terminal to obtain the corresponding expected angular acceleration of the terminal; the single-hole surgical robot can also read the expected angular acceleration of the terminal that matches the expected angular velocity of the terminal from external data; it is also possible The external processing device (the external processing device communicates with the single-hole surgical robot in real time) receives the terminal expected angular velocity generated by the single-hole surgical robot, calculates the difference according to the terminal expected angular velocity to obtain the corresponding terminal expected angular acceleration, and then transmits the terminal expected angular acceleration to the Single-port surgical robot.
具体的,根据末端期望角速度与调整臂各关节的当前位置,末端期望角速度已经通过死区抑制与极大值抑制处理,直接通过前馈预测进行末端期望角加速度预测,然后由末端期望角速度、末端期望角加速度和调整臂各关节的当前位置,计算得到调整臂各关节的期望位置,最后根据调整臂各关节的期望位置计算出各关节的期望力矩,对各关节输出对应的期望力矩,控制调整臂末端执行预设操作。Specifically, according to the desired angular velocity of the terminal and the current position of each joint of the adjustment arm, the desired angular velocity of the terminal has been processed by dead zone suppression and maximum value suppression, and the desired angular acceleration of the terminal is predicted directly through feed-forward prediction, and then the desired angular velocity of the terminal, terminal The expected angular acceleration and the current position of each joint of the adjustment arm are calculated to obtain the expected position of each joint of the adjustment arm, and finally the expected torque of each joint is calculated according to the expected position of each joint of the adjustment arm, and the corresponding expected torque is output to each joint to control the adjustment The end of the arm performs preset operations.
上述调整臂控制方法中,通过获取控制指令,识别控制指令的控制类型,确定控制类型对应的触发逻辑的状态;控制类型分为接触式控制和非接触式控制;若触发逻辑为激活状态,基于控制指令的控制类型,获取与控制指令对应的末端期望角速度;根据末端期望角速度获取末端期望角加速度,根据末端期望角速度和末端期望角加速度控制调整臂末端执行预设操作。能够提供多种调整臂的交互方式,并为每种交互方式配置一个处理逻辑防止误触,只需要激活对应的触发逻辑,就能够采用对应的交互方式控制调整臂,提高了调整臂的控制效率。In the control method of the above-mentioned adjusting arm, by obtaining the control instruction, identifying the control type of the control instruction, and determining the state of the trigger logic corresponding to the control type; the control type is divided into contact control and non-contact control; if the trigger logic is activated, based on The control type of the control command is to obtain the terminal expected angular velocity corresponding to the control command; to obtain the terminal expected angular acceleration according to the terminal expected angular velocity, and to control and adjust the end of the arm to perform preset operations according to the terminal expected angular velocity and terminal expected angular acceleration. It can provide a variety of interaction modes of the adjustment arm, and configure a processing logic for each interaction mode to prevent false touches. Only need to activate the corresponding trigger logic, the adjustment arm can be controlled in the corresponding interaction mode, which improves the control efficiency of the adjustment arm .
在一个实施例中,确定控制类型对应的触发逻辑的状态,包括:若控制指令为接触式控制,确定触发逻辑为瞬时触发逻辑或持续触发逻辑;若控制指令为非接触式控制,确定触发逻辑为手势触发逻辑。In one embodiment, determining the state of the trigger logic corresponding to the control type includes: if the control instruction is contact control, determining that the trigger logic is instantaneous trigger logic or continuous trigger logic; if the control instruction is non-contact control, determining the trigger logic Trigger logic for gestures.
可选的,通过接触式交互装置获取接触式控制指令,如图3所示,在机器人控制器上配备接触式交互装置,该装置包括三轴传感装置和触发装置,三轴传感装置可输出三轴角速度ω=[ωx,ωy,ωz]T或三轴旋转角θ=[θx,θy,θz]T;触发装置用于防止误触、增加系统安全性,具有瞬时触发与持续触发两种触发模式,可以按下点按开关激活瞬时触发逻辑,也可以持续持续按住按压开关激活持续触发逻辑。Optionally, the contact control command is obtained through the contact interaction device, as shown in Figure 3, the robot controller is equipped with a contact interaction device, which includes a three-axis sensing device and a trigger device, and the three-axis sensing device can be Output three-axis angular velocity ω=[ω x ,ω y ,ω z ] T or three-axis rotation angle θ=[θ x ,θ y ,θ z ] T ; the trigger device is used to prevent false touches and increase system safety, with There are two trigger modes: instantaneous trigger and continuous trigger. You can press the button to activate the instantaneous trigger logic, or press and hold the button continuously to activate the continuous trigger logic.
通过非接触式交互装置获取非接触式控制指令,如图4所示,在机器人控制器上配备非接触式交互装置,其中该装置可识别手部点云,该设备可以预先指定两种姿势用以控制激活手势触发逻辑,例如图中姿势一与姿势二。非接触式交互装置获取手部点云后,按手势识别流程输出手势识别结果。Obtain non-contact control instructions through a non-contact interactive device, as shown in Figure 4, a non-contact interactive device is equipped on the robot controller, where the device can recognize the point cloud of the hand, and the device can pre-designate two gestures for Trigger logic with control activation gestures, such as gesture 1 and gesture 2 in the figure. After the non-contact interaction device acquires the hand point cloud, it outputs the gesture recognition result according to the gesture recognition process.
本实施例中,若控制指令为接触式控制,确定触发逻辑为瞬时触发逻辑或持续触发逻辑;若控制指令为非接触式控制,确定触发逻辑为手势触发逻辑。能够识别出当前控制类型对应的触发逻辑,从而进一步判断是否已经激活触发逻辑,防止控制指令为误触产生。In this embodiment, if the control command is touch control, the trigger logic is determined to be instantaneous trigger logic or continuous trigger logic; if the control command is non-contact control, the trigger logic is determined to be gesture trigger logic. It can identify the trigger logic corresponding to the current control type, so as to further judge whether the trigger logic has been activated, and prevent the control command from being generated by false touch.
在一个实施例中,获取控制指令之前,还包括:获取激活指令,并识别激活指令的激活类型;激活类型分为接触式激活和非接触式激活;若激活类型为接触式激活,获取激活指令的输入时长;若输入时长不满足持续条件,激活瞬时触发逻辑。若输入时长满足持续条件,激活持续触发逻辑。In one embodiment, before obtaining the control instruction, it also includes: obtaining the activation instruction, and identifying the activation type of the activation instruction; the activation type is divided into contact activation and non-contact activation; if the activation type is contact activation, obtaining the activation instruction The input duration; if the input duration does not meet the continuous condition, activate the instantaneous trigger logic. If the input duration satisfies the continuous condition, activate the continuous trigger logic.
可选的,一种情况,通过接触式触发装置激活瞬时触发逻辑,当触发装置为瞬时触发时,为防止误触操作,通过如图5所示的逻辑进行控制。在瞬时触发后,开启对调整臂的控制,如果一段时间未进行操作,那么自动结束调整臂的运动映射。图中调整臂运动的判定可由调整臂电机是否处于使能状态进行判断;触发装置激发在应用中可采用按钮按下、感应到手部压力等方式;是否操作的判定可以通过传感器的反馈值是否有变化;引入计数器的目的在于计算未进行操作的时间;调整臂运动开始代表着向调整臂发送电机使能命令;调整臂运动结束代表着向调整臂发送电机去使能命令,停止激活瞬时触发逻辑。Optionally, in one case, the instantaneous trigger logic is activated by the contact trigger device. When the trigger device is instantaneous trigger, in order to prevent false touch operation, the logic shown in FIG. 5 is used for control. After a momentary trigger, the control of the adjustment arm is turned on, and if no operation is performed for a period of time, the motion mapping of the adjustment arm is automatically ended. The judgment of the movement of the adjustment arm in the figure can be judged by whether the motor of the adjustment arm is in the enabled state; the trigger device can be activated in the application by pressing a button, sensing hand pressure, etc.; whether the operation can be judged by the feedback value of the sensor. Change; the purpose of introducing a counter is to count the time of no operation; the start of the adjustment arm movement means sending the motor enable command to the adjustment arm; the end of the adjustment arm movement means sending the motor de-enable command to the adjustment arm, and stop activating the instantaneous trigger logic .
另一种情况,通过接触式触发装置激活持续触发逻辑,当触发装置为持续触发时,为防止误触操作,通过如图6所示的逻辑进行控制。在持续触发时,允许对调整臂进行控制,在未持续触发时,结束对调整臂运动的控制。调整臂运动开始代表着向调整臂发送电机使能命令;调整臂运动结束代表着向调整臂发送电机去使能命令,停止激活持续触发逻辑。In another case, the continuous trigger logic is activated by the contact trigger device. When the trigger device is continuous trigger, in order to prevent false touch operation, control is performed through the logic shown in FIG. 6 . When the trigger is continuous, the control of the adjustment arm is allowed, and when the trigger is not continuous, the control of the movement of the adjustment arm is terminated. The beginning of the movement of the adjustment arm means sending the motor enable command to the adjustment arm; the end of the movement of the adjustment arm means sending the motor disenable command to the adjustment arm, and the activation of the continuous trigger logic is stopped.
本实施例中,获取激活指令,并识别激活指令的激活类型;激活类型分为接触式激活和非接触式激活;若激活类型为接触式激活,获取激活指令的输入时长;若输入时长不满足持续条件,激活瞬时触发逻辑。若输入时长满足持续条件,激活持续触发逻辑。能够选择激活一种触发逻辑,防止控制调整臂过程中的误触操作。In this embodiment, the activation instruction is obtained, and the activation type of the activation instruction is identified; the activation type is divided into contact activation and non-contact activation; if the activation type is contact activation, the input duration of the activation instruction is obtained; if the input duration does not meet the Continuous condition, activates the momentary trigger logic. If the input duration satisfies the continuous condition, activate the continuous trigger logic. A trigger logic can optionally be activated to prevent false touches during control of the adjustment arm.
在一个实施例中,方法还包括:若激活类型为非接触式激活,则获取激活指令中的手势信息;若手势信息满足变换条件,激活手势触发逻辑。In one embodiment, the method further includes: if the activation type is non-contact activation, acquiring gesture information in the activation instruction; if the gesture information satisfies the transformation condition, activating gesture trigger logic.
可选的,通过非接触式触发装置的手势识别激活手势触发逻辑,为防止误触操作,通过如图7所示的逻辑进行控制。图中,姿态一->姿态二表示识别结果从姿态一转变为姿态二,即当调整臂不运动时,如果手势识别结果从姿态一切换为姿态二,调整臂运动开始运动,且需要记录手部初始坐标系,记此时测量坐标系到手部坐标系的坐标转换矩阵为当调整臂运动时,如果姿态二不再保持,则调整臂运动结束,停止激活手势触发逻辑。Optionally, the gesture trigger logic is activated by the gesture recognition of the non-contact trigger device, and the logic shown in FIG. 7 is used for control in order to prevent false touch operations. In the figure, pose 1 -> pose 2 means that the recognition result changes from pose 1 to pose 2, that is, when the adjustment arm does not move, if the gesture recognition result switches from pose 1 to pose 2, the movement of the adjustment arm starts to move, and the hand needs to be recorded. The initial coordinate system of the body, the coordinate conversion matrix from the measurement coordinate system to the hand coordinate system at this time is When the adjustment arm is in motion, if gesture 2 is no longer maintained, the adjustment arm movement ends and the gesture trigger logic is stopped.
具体的,获取激活指令中的手势信息的方式如图8所示,在手部关键点匹配中,需将输入的手部点云通过姿态匹配算法转换为手部关键点三维坐标。在判别类别中,需使用经过预训练的深度神经网络以排序后的手部关键点坐标为输入,以姿势一、姿势二与其他姿势的概率为输出,取概率最大值为输出的类别。在滤波输出中,会对第二步中输出的类别进行滤波,避免在神经网络输出出现瞬时误判、漏检时判别类别的变化。如果神经网络输出结果为姿势二,需使用使用经过预训练的深度神经网络以排序后的手部关键点坐标为输入,以手部姿态角为输出。将姿态角转换为姿态旋转矩阵输出 Specifically, the way to obtain the gesture information in the activation command is shown in Figure 8. In the hand key point matching, the input hand point cloud needs to be converted into the three-dimensional coordinates of the hand key points through the gesture matching algorithm. In the discriminative category, it is necessary to use the pre-trained deep neural network to take the sorted key point coordinates of the hand as the input, take the probabilities of pose 1, pose 2 and other poses as the output, and take the maximum value of the probability as the output category. In the filtering output, the category output in the second step is filtered to avoid the change of the category when the neural network output has instantaneous misjudgment or missed detection. If the output result of the neural network is pose 2, it is necessary to use the pre-trained deep neural network with the sorted hand key point coordinates as input and the hand pose angle as output. Convert attitude angle to attitude rotation matrix output
本实施例中,若激活类型为非接触式激活,则获取激活指令中的手势信息;若手势信息满足变换条件,激活手势触发逻辑。能够选择激活一种触发逻辑,防止控制调整臂过程中的误触操作。In this embodiment, if the activation type is non-contact activation, the gesture information in the activation instruction is acquired; if the gesture information satisfies the transformation condition, the gesture trigger logic is activated. A trigger logic can optionally be activated to prevent false touches during control of the adjustment arm.
在一个实施例中,基于控制指令的控制类型,获取与控制指令对应的末端期望角速度,包括:基于控制类型,计算与控制指令对应的初始期望角速度;对初始期望角速度进行死区抑制,调整初始期望角速度的取值,得到末端期望角速度。In one embodiment, based on the control type of the control instruction, obtaining the terminal expected angular velocity corresponding to the control instruction includes: calculating the initial expected angular velocity corresponding to the control instruction based on the control type; performing dead-zone suppression on the initial expected angular velocity, adjusting the initial The value of the expected angular velocity is used to obtain the terminal expected angular velocity.
可选的,在根据控制指令计算得到初始期望角速度之后,需要对初始期望角速度进行处理死区抑制,从而调整初始期望角速度的过大或者过小取值,得到末端期望角速度,实际采用末端期望角速度控制调整臂。Optionally, after the initial expected angular velocity is calculated according to the control command, it is necessary to suppress the initial expected angular velocity by processing the dead zone, so as to adjust the value of the initial expected angular velocity that is too large or too small to obtain the terminal desired angular velocity, and actually adopt the terminal desired angular velocity Control the adjustment arm.
本实施例中,基于控制类型,计算与控制指令对应的初始期望角速度;对初始期望角速度进行死区抑制,调整初始期望角速度的取值,得到末端期望角速度。能够防止失误操作、外界影像等因素对调整臂控制带来的不利影响,提高调整臂控制的可靠性。In this embodiment, based on the control type, the initial expected angular velocity corresponding to the control command is calculated; the initial expected angular velocity is suppressed by a dead zone, and the value of the initial expected angular velocity is adjusted to obtain the terminal expected angular velocity. It can prevent the adverse effects of misoperation, external images and other factors on the control of the adjustment arm, and improve the reliability of the control of the adjustment arm.
在一个实施例中,基于控制指令的控制类型,计算与控制指令对应的初始期望角速度,包括:若控制指令为接触式控制,从控制指令中获取角度信息或角速度信息;根据角度信息或角速度信息,计算得到初始期望角速度。若控制指令为非接触式控制,从控制指令中获取手势信息;根据手势信息,计算得到初始期望角速度。In one embodiment, based on the control type of the control instruction, calculating the initial expected angular velocity corresponding to the control instruction includes: if the control instruction is touch control, obtaining angle information or angular velocity information from the control instruction; according to the angle information or angular velocity information , calculate the initial desired angular velocity. If the control instruction is non-contact control, the gesture information is obtained from the control instruction; according to the gesture information, the initial expected angular velocity is calculated.
可选的,一种情况,通过接触式控制指令的输入,需要输出单孔不动点处坐标系Os的期望旋转角速度ωs,计算公式为其中,K为对角系数矩阵,用以对控制比例进行限制。Optionally, in one case, through the input of contact control commands, it is necessary to output the expected rotational angular velocity ω s of the coordinate system O s at the fixed point of the single hole, and the calculation formula is Among them, K is the diagonal coefficient matrix, which is used to limit the control ratio.
另一种情况,通过非接触式控制指令的输入,获取控制指令中的手势信息与图8所示的方式相同。如图9所示,需要输出单孔不动点处坐标系Os的期望旋转角速度ωs。其中,记录当前手相对于测量设备的坐标变换矩阵为通过计算可得当前手相对于初始状态的旋转变换矩阵通过旋转微分,可得手部坐标系在初始坐标系的旋转角速度,记为ωh。末端期望角速度计算公式为ωs=Kωh,其中K为对角系数矩阵,用以对控制比例进行限制。In another case, the gesture information in the control command is acquired through the input of the non-contact control command in the same manner as shown in FIG. 8 . As shown in Fig. 9, it is necessary to output the expected rotational angular velocity ω s of the coordinate system O s at the fixed point of the single hole. Among them, record the coordinate transformation matrix of the current hand relative to the measuring device as pass Calculate the rotation transformation matrix of the current hand relative to the initial state Through rotation differentiation, the rotational angular velocity of the hand coordinate system in the initial coordinate system can be obtained, denoted as ω h . The formula for calculating the terminal desired angular velocity is ω s =Kω h , where K is the diagonal coefficient matrix, which is used to limit the control ratio.
本实施例中,若控制指令为接触式控制,从控制指令中获取角度信息或角速度信息;根据角度信息或角速度信息,计算得到初始期望角速度。若控制指令为非接触式控制,从控制指令中获取手势信息;根据手势信息,计算得到初始期望角速度。能够根据不同类型的控制指令,识别出不同的期望运动参数,并采用不同的处理方式对不同的期望运动参数进行计算,均计算得到初始期望角速度。In this embodiment, if the control instruction is touch control, angle information or angular velocity information is obtained from the control instruction; and an initial desired angular velocity is calculated according to the angle information or angular velocity information. If the control instruction is non-contact control, the gesture information is obtained from the control instruction; according to the gesture information, the initial expected angular velocity is calculated. According to different types of control instructions, different expected motion parameters can be identified, and different processing methods can be used to calculate different expected motion parameters, and the initial expected angular velocity can be calculated.
在一个实施例中,对初始期望角速度进行死区抑制,调整初始期望角速度的取值,得到末端期望角速度,包括:若初始期望角速度的大小处于死区范围,末端期望角速度为0;若初始期望角速度的大小处于线性区范围,将初始期望角速度作为末端期望角速度;若初始期望角速度的大小处于正限幅区范围,将正限幅值作为末端期望角速度;若初始期望角速度的大小处于负限幅区范围,将负限幅值作为末端期望角速度。In one embodiment, the dead zone suppression is performed on the initial expected angular velocity, and the value of the initial expected angular velocity is adjusted to obtain the terminal expected angular velocity, including: if the magnitude of the initial expected angular velocity is in the dead zone range, the terminal expected angular velocity is 0; if the initial expected angular velocity The magnitude of the angular velocity is in the range of the linear region, and the initial expected angular velocity is taken as the end expected angular velocity; if the magnitude of the initial expected angular velocity is in the range of the positive clipping region, the positive clipping value is used as the terminal desired angular velocity; if the magnitude of the initial desired angular velocity is in the negative clipping range, the negative limit value is used as the end desired angular velocity.
可选的,如图10所示,预先配置好正限幅区范围、负限幅区范围和死区范围,将每次得到的初始期望角速度进行死区抑制和限幅抑制。Optionally, as shown in FIG. 10 , the positive clipping zone range, the negative clipping zone range and the dead zone range are preconfigured, and the dead zone suppression and clipping suppression are performed on each initial desired angular velocity obtained each time.
本实施例中,提供一种典型的输入死区抑制原理,对于零附近的轻微输入变化,输出恒为零,保障了在收到轻微噪声干扰时不对运动进行触发,在死区外是线性区与限幅区,限幅抑制的作用是避免奇异值与过高的指令速度造成机械的高速运动。In this embodiment, a typical input dead zone suppression principle is provided. For a slight input change near zero, the output is always zero, which ensures that the motion will not be triggered when a slight noise interference is received. Outside the dead zone is a linear zone As with the limit area, the function of limit suppression is to avoid the high-speed movement of the machine caused by the singular value and the high command speed.
在一个实施例中,根据末端期望角速度和末端期望角加速度控制调整臂末端执行预设操作,包括:获取调整臂的关节当前所处的关节位置;根据末端期望角速度、末端期望角加速度和关节位置,采用微分运动学计算得到调整臂的关节对应的关节期望角速度、关节期望角加速度和关节速度;根据关节期望角速度、关节期望角加速度和关节速度,采用积分运动学计算得到关节期望位置,并根据关节期望位置获取调整臂关节对应的期望力矩;基于期望力矩控制调整臂关节,以控制调整臂末端执行预设操作。In one embodiment, the terminal of the adjusting arm is controlled to perform preset operations according to the expected angular velocity and the expected angular acceleration of the end, including: obtaining the current joint position of the joint of the adjusting arm; , using differential kinematics to calculate the joint expected angular velocity, joint expected angular acceleration, and joint velocity corresponding to the joints of the adjusting arm; according to the joint expected angular velocity, joint expected angular acceleration, and joint velocity, the integral kinematics is used to calculate the joint expected position, and according to The expected position of the joint obtains the expected torque corresponding to the joint of the adjusting arm; based on the expected torque, the joint of the adjusting arm is controlled to control the end of the adjusting arm to perform a preset operation.
可选的,如图11所示,末端期望角加速度的计算主要通过差分末端期望角速度得到,结合LSTM对输入状态进行特征识别,LSTM网络有助于记忆用户的使用习惯从而给出更精确的预测,使用softmax输出权重对经典算法输出进行权重分配,结合了人工智能与经典算法,在保证预测准确的同时保证了预测的可靠性与安全性。Optionally, as shown in Figure 11, the calculation of the terminal expected angular acceleration is mainly obtained through the differential terminal expected angular velocity, combined with LSTM for feature recognition of the input state, the LSTM network helps to memorize the user's usage habits and give more accurate predictions , using the softmax output weight to assign weights to the output of the classic algorithm, combining artificial intelligence and classic algorithms, ensuring the reliability and security of the prediction while ensuring the accuracy of the prediction.
进一步的,如图12所示,获取当前的各调整臂关节位置q,将调整臂关节位置q、调整臂末端期望角速度ωs和末端期望角加速度αsc,经由微分运动学子模块,可计算获得各关节速度各关节期望角速度和各关节期望角加速度经由积分运动学子模块后,得到调整臂各关节期望位置qsc。通过上述各个变量的输入,采用动力学前馈+PD控制器计算输出调整臂关节对应的期望力矩,经过滤波模块后对力矩进行输出,每一个期望力矩用来控制一个调整臂关节的运动。Further, as shown in Figure 12, the current joint position q of each adjustment arm is acquired, and the joint position q of the adjustment arm, the expected angular velocity ω s at the end of the adjustment arm and the expected angular acceleration α sc at the end of the adjustment arm can be calculated and obtained through the differential kinematics sub-module Each joint speed Expected angular velocity of each joint and the expected angular acceleration of each joint After the integral kinematics sub-module, the expected position q sc of each joint of the adjustment arm is obtained. Through the input of the above variables, the dynamic feedforward + PD controller is used to calculate and output the expected torque corresponding to the adjustment arm joint, and the torque is output after passing through the filtering module. Each expected torque is used to control the movement of an adjustment arm joint.
本实施例中,结合人工智能与经典算法,对末端期望角速度进行预测得到末端期望角加速度,结合各关节位置计算各关节的期望力矩,能够保证调整臂控制的可靠性与安全性。In this embodiment, artificial intelligence and classical algorithms are combined to predict the expected angular velocity of the terminal to obtain the expected angular acceleration of the terminal, and the expected torque of each joint is calculated in combination with the position of each joint, which can ensure the reliability and safety of the control of the adjusting arm.
在一个实施例中,一种调整臂控制方法,包括:In one embodiment, a method of adjusting an arm control comprises:
获取激活指令,并识别激活指令的激活类型;激活类型分为接触式激活和非接触式激活;若激活类型为接触式激活,获取激活指令的输入时长;若输入时长不满足持续条件,激活瞬时触发逻辑。若输入时长满足持续条件,激活持续触发逻辑。若激活类型为非接触式激活,则获取激活指令中的手势信息;若手势信息满足变换条件,激活手势触发逻辑。Get the activation instruction and identify the activation type of the activation instruction; the activation type is divided into contact activation and non-contact activation; if the activation type is contact activation, obtain the input duration of the activation instruction; if the input duration does not meet the continuous condition, the activation is instantaneous trigger logic. If the input duration satisfies the continuous condition, activate the continuous trigger logic. If the activation type is non-contact activation, the gesture information in the activation instruction is obtained; if the gesture information satisfies the transformation condition, the gesture trigger logic is activated.
获取控制指令,识别控制指令的控制类型,控制类型分为接触式控制和非接触式控制;若控制指令为接触式控制,确定触发逻辑为瞬时触发逻辑或持续触发逻辑;若控制指令为非接触式控制,确定触发逻辑为手势触发逻辑。Obtain the control instruction and identify the control type of the control instruction. The control type is divided into contact control and non-contact control; if the control instruction is contact control, determine whether the trigger logic is instantaneous trigger logic or continuous trigger logic; if the control instruction is non-contact mode control, determine the trigger logic as gesture trigger logic.
若触发逻辑为未激活状态,不获取与控制指令对应的末端期望角速度,将控制指令作为误触指令。If the trigger logic is in an inactive state, the terminal expected angular velocity corresponding to the control command is not obtained, and the control command is regarded as a false touch command.
若触发逻辑为激活状态,控制指令为接触式控制,从控制指令中获取角度信息或角速度信息;根据角度信息或角速度信息,计算得到初始期望角速度。若控制指令为非接触式控制,从控制指令中获取手势信息;根据手势信息,计算得到初始期望角速度。若初始期望角速度的大小处于死区范围,末端期望角速度为0;若初始期望角速度的大小处于线性区范围,将初始期望角速度作为末端期望角速度;若初始期望角速度的大小处于正限幅区范围,将正限幅值作为末端期望角速度;若初始期望角速度的大小处于负限幅区范围,将负限幅值作为末端期望角速度。If the trigger logic is active and the control command is contact control, the angle information or angular velocity information is obtained from the control command; according to the angle information or angular velocity information, the initial desired angular velocity is calculated. If the control instruction is non-contact control, the gesture information is obtained from the control instruction; according to the gesture information, the initial expected angular velocity is calculated. If the size of the initial desired angular velocity is in the dead zone range, the terminal desired angular velocity is 0; if the size of the initial desired angular velocity is in the range of the linear region, take the initial desired angular velocity as the terminal desired angular velocity; if the size of the initial desired angular velocity is in the range of the positive clipping region, The positive limit value is used as the end expected angular velocity; if the initial expected angular velocity is within the range of the negative limit range, the negative limit value is used as the end expected angular velocity.
根据末端期望角速度获取末端期望角加速度;获取调整臂的关节当前所处的关节位置;根据末端期望角速度、末端期望角加速度和关节位置,采用微分运动学计算得到调整臂的关节对应的关节期望角速度、关节期望角加速度和关节速度;根据关节期望角速度、关节期望角加速度和关节速度,采用积分运动学计算得到关节期望位置,并根据关节期望位置获取调整臂关节对应的期望力矩;基于期望力矩控制调整臂关节,以控制调整臂末端执行预设操作。Obtain the desired angular acceleration of the terminal according to the desired angular velocity of the terminal; obtain the current joint position of the joint of the adjusting arm; according to the expected angular velocity of the terminal, the expected angular acceleration of the terminal and the position of the joint, use differential kinematics to calculate the joint expected angular velocity corresponding to the joint of the adjusting arm , joint expected angular acceleration and joint velocity; according to the joint expected angular velocity, joint expected angular acceleration and joint velocity, the expected position of the joint is calculated by integral kinematics, and the expected torque corresponding to the arm joint is obtained according to the expected position of the joint; based on the expected torque control Adjustment arm joints to control the end of the adjustment arm to perform preset operations.
在一个实施例中,一种调整臂控制方法,以该方法应用于如图13所示的调整臂控制系统为例,系统由控制台与调整臂台车构成:In one embodiment, a method for controlling an adjusting arm, taking the method applied to the adjusting arm control system shown in Figure 13 as an example, the system consists of a console and an adjusting arm trolley:
控制台,用于获取控制指令,识别控制指令的控制类型,确定控制类型对应的触发逻辑的状态;若触发逻辑为激活状态,基于控制类型,计算与控制指令对应的初始期望角速度,并传输初始期望角速度至调整臂台车;The console is used to obtain control instructions, identify the control type of the control instruction, and determine the state of the trigger logic corresponding to the control type; if the trigger logic is activated, based on the control type, calculate the initial expected angular velocity corresponding to the control instruction, and transmit the initial Expected angular velocity to the adjusting arm trolley;
调整臂台车,用于对初始期望角速度进行死区抑制,调整初始期望角速度的取值,得到末端期望角速度;根据末端期望角速度获取末端期望角加速度,根据末端期望角速度和末端期望角加速度控制调整臂末端执行预设操作。如图14所示,调整臂台车可选用单孔调整臂台车或多孔调整臂台车,以单孔调整臂台车进行说明,单孔调整臂台车上搭载的内窥镜具有绕不动点的三个调整关节,即图中的q1,q2,q3,称这三个关节构成的运动链路为调整臂。The adjusting arm trolley is used to suppress the dead zone of the initial desired angular velocity, adjust the value of the initial desired angular velocity, and obtain the terminal desired angular velocity; obtain the terminal desired angular acceleration according to the terminal desired angular velocity, and control the adjustment according to the terminal desired angular velocity and terminal desired angular acceleration The end of the arm performs preset operations. As shown in Figure 14, the adjustable arm trolley can be single-hole adjustable arm trolley or multi-hole adjustable arm trolley. The single-hole adjustable arm trolley is used for illustration. The three adjustment joints of the moving point, ie, q 1 , q 2 , and q 3 in the figure, call the motion link formed by these three joints an adjustment arm.
进一步的,控制台还包括交互传感模块、激活逻辑模块与期望运动模块。如图15所示,交互传感模块主要通过传感器接收与人的交互信号并转换为传感输出信号,激活逻辑模块通过传感输出信号输出调整臂的激活信号,期望运动模块通过传感输出信号与激活信号输出调整臂末端期望运动速度。Further, the console also includes an interactive sensing module, an activation logic module and a desired motion module. As shown in Figure 15, the interactive sensing module mainly receives the interaction signal with people through the sensor and converts it into a sensing output signal. The activation logic module outputs the activation signal of the adjustment arm through the sensing output signal. It is expected that the motion module will output the signal through the sensing With the activation signal output adjust the desired movement speed of the end of the arm.
具体的,交互传感模块,用于获取控制指令,识别控制指令的控制类型,控制类型分为接触式控制和非接触式控制;若控制指令为接触式控制,确定触发逻辑为瞬时触发逻辑或持续触发逻辑;若控制指令为非接触式控制,确定触发逻辑为手势触发逻辑。Specifically, the interactive sensing module is used to obtain control instructions and identify the control types of the control instructions. The control types are divided into contact control and non-contact control; if the control instruction is contact control, determine the trigger logic as instantaneous trigger logic or Continuous trigger logic; if the control instruction is non-contact control, determine that the trigger logic is gesture trigger logic.
激活逻辑模块,用于获取激活指令,并识别激活指令的激活类型;激活类型分为接触式激活和非接触式激活;若激活类型为接触式激活,获取激活指令的输入时长;若输入时长不满足持续条件,激活瞬时触发逻辑。若输入时长满足持续条件,激活持续触发逻辑。若激活类型为非接触式激活,则获取激活指令中的手势信息;若手势信息满足变换条件,激活手势触发逻辑。The activation logic module is used to obtain the activation instruction and identify the activation type of the activation instruction; the activation type is divided into contact activation and non-contact activation; if the activation type is contact activation, obtain the input duration of the activation instruction; if the input duration is not The continuous condition is met, activating the momentary trigger logic. If the input duration satisfies the continuous condition, activate the continuous trigger logic. If the activation type is non-contact activation, the gesture information in the activation instruction is obtained; if the gesture information satisfies the transformation condition, the gesture trigger logic is activated.
期望运动模块,用于若触发逻辑为激活状态,控制指令为接触式控制,从控制指令中获取角度信息或角速度信息;根据角度信息或角速度信息,计算得到初始期望角速度。若控制指令为非接触式控制,从控制指令中获取手势信息;根据手势信息,计算得到初始期望角速度。还用于若触发逻辑为未激活状态,不获取与控制指令对应的末端期望角速度,将控制指令作为误触指令。The desired motion module is used to obtain angle information or angular velocity information from the control instruction if the trigger logic is active and the control instruction is contact control; and calculate the initial expected angular velocity according to the angle information or angular velocity information. If the control instruction is non-contact control, the gesture information is obtained from the control instruction; according to the gesture information, the initial expected angular velocity is calculated. It is also used for if the trigger logic is in an inactive state, the terminal expected angular velocity corresponding to the control command is not obtained, and the control command is regarded as a false touch command.
进一步的,调整臂台车还包括输入死区模块、前馈预测模块与关节控制模块,如图16所示,输入死区模块主要接收末端期望运动速度并对指令信号进行死区抑制,前馈预测模块主要对指令加速度进行预测计算,关节控制模块主要通过前两个模块传递的信息进行关节的力矩控制。Furthermore, the adjusting arm trolley also includes an input dead zone module, a feedforward prediction module and a joint control module. The prediction module mainly predicts and calculates the command acceleration, and the joint control module mainly controls the torque of the joint through the information transmitted by the first two modules.
具体的,输入死区模块,用于若初始期望角速度的大小处于死区范围,末端期望角速度为0;若初始期望角速度的大小处于线性区范围,将初始期望角速度作为末端期望角速度;若初始期望角速度的大小处于正限幅区范围,将正限幅值作为末端期望角速度;若初始期望角速度的大小处于负限幅区范围,将负限幅值作为末端期望角速度。Specifically, input the dead zone module, for if the size of the initial desired angular velocity is in the dead zone range, the terminal desired angular velocity is 0; if the size of the initial desired angular velocity is in the linear range, the initial desired angular velocity is used as the terminal desired angular velocity; if the initial desired angular velocity If the magnitude of the angular velocity is within the range of the positive clipping area, the positive clipping value is used as the end expected angular velocity; if the initial expected angular velocity is within the range of the negative clipping area, the negative clipping value is taken as the terminal expected angular velocity.
前馈预测模块,用于根据末端期望角速度获取末端期望角加速度。The feedforward prediction module is used to obtain the terminal desired angular acceleration according to the terminal desired angular velocity.
关节控制模块,用于获取调整臂的关节当前所处的关节位置;根据末端期望角速度、末端期望角加速度和关节位置,采用微分运动学计算得到调整臂的关节对应的关节期望角速度、关节期望角加速度和关节速度;根据关节期望角速度、关节期望角加速度和关节速度,采用积分运动学计算得到关节期望位置,并根据关节期望位置获取调整臂关节对应的期望力矩;基于期望力矩控制调整臂关节,以控制调整臂末端执行预设操作。The joint control module is used to obtain the current joint position of the joint of the adjusting arm; according to the expected angular velocity of the terminal, the expected angular acceleration of the terminal and the position of the joint, the differential kinematics is used to calculate the expected angular velocity and the expected angle of the joint corresponding to the joint of the adjusting arm Acceleration and joint velocity; according to the expected angular velocity of the joint, the expected angular acceleration of the joint and the joint velocity, the expected position of the joint is calculated by using integral kinematics, and the expected torque corresponding to the arm joint is obtained according to the expected position of the joint; the arm joint is adjusted based on the expected torque control, Use the control to adjust the end of the arm to perform preset operations.
本系统通过在控制台上加入交互装置,对调整臂的三个调整关节进行力矩控制,达到调整视野得目的。值得注意的是,对于内窥镜臂绕不动点具有三个旋转自由度的多孔调整臂台车,也适用于本方法对内窥镜姿态进行调整。The system controls the torque of the three adjusting joints of the adjusting arm by adding an interactive device on the console to achieve the purpose of adjusting the field of view. It is worth noting that the porous adjustment arm trolley with three rotational degrees of freedom around the fixed point of the endoscope arm is also suitable for adjusting the attitude of the endoscope by this method.
应该理解的是,虽然如上所述的各实施例所涉及的流程图中的各个步骤按照箭头的指示依次显示,但是这些步骤并不是必然按照箭头指示的顺序依次执行。除非本文中有明确的说明,这些步骤的执行并没有严格的顺序限制,这些步骤可以以其它的顺序执行。而且,如上所述的各实施例所涉及的流程图中的至少一部分步骤可以包括多个步骤或者多个阶段,这些步骤或者阶段并不必然是在同一时刻执行完成,而是可以在不同的时刻执行,这些步骤或者阶段的执行顺序也不必然是依次进行,而是可以与其它步骤或者其它步骤中的步骤或者阶段的至少一部分轮流或者交替地执行。It should be understood that although the steps in the flow charts involved in the above embodiments are shown sequentially according to the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least some of the steps in the flow charts involved in the above-mentioned embodiments may include multiple steps or stages, and these steps or stages are not necessarily executed at the same time, but may be performed at different times For execution, the execution order of these steps or stages is not necessarily performed sequentially, but may be executed in turn or alternately with other steps or at least a part of steps or stages in other steps.
基于同样的发明构思,本申请实施例还提供了一种用于实现上述所涉及的调整臂控制方法的调整臂控制装置。该装置所提供的解决问题的实现方案与上述方法中所记载的实现方案相似,故下面所提供的一个或多个调整臂控制装置实施例中的具体限定可以参见上文中对于调整臂控制方法的限定,在此不再赘述。Based on the same inventive concept, an embodiment of the present application further provides an adjustment arm control device for implementing the above-mentioned adjustment arm control method. The solution to the problem provided by the device is similar to the implementation described in the above method, so the specific limitations in one or more embodiments of the adjustment arm control device provided below can be referred to above for the adjustment arm control method limited and will not be repeated here.
在一个实施例中,如图17所示,提供了一种调整臂控制装置170,包括:获取模块171、运算模块172和控制模块173,其中:In one embodiment, as shown in FIG. 17 , an adjustment arm control device 170 is provided, including: an
获取模块171,用于获取控制指令,识别控制指令的控制类型,确定控制类型对应的触发逻辑的状态;控制类型分为接触式控制和非接触式控制;The acquiring
运算模块172,用于若触发逻辑为激活状态,基于控制指令的控制类型,获取与控制指令对应的末端期望角速度;The
控制模块173,用于根据末端期望角速度获取末端期望角加速度,根据末端期望角速度和末端期望角加速度控制调整臂末端执行预设操作。The
在一个实施例中,获取模块171还用于若控制指令为接触式控制,确定触发逻辑为瞬时触发逻辑或持续触发逻辑;若控制指令为非接触式控制,确定触发逻辑为手势触发逻辑。In one embodiment, the acquiring
在一个实施例中,装置还包括:In one embodiment, the device also includes:
激活模块174,用于获取激活指令,并识别激活指令的激活类型;激活类型分为接触式激活和非接触式激活;若激活类型为接触式激活,获取激活指令的输入时长;若输入时长不满足持续条件,激活瞬时触发逻辑。
在一个实施例中,激活模块174还用于若输入时长满足持续条件,激活持续触发逻辑。In one embodiment, the
在一个实施例中,激活模块174还用于若激活类型为非接触式激活,则获取激活指令中的手势信息;若手势信息满足变换条件,激活手势触发逻辑。In one embodiment, the
在一个实施例中,运算模块172还用于若触发逻辑为未激活状态,不获取与控制指令对应的末端期望角速度,将控制指令作为误触指令。In one embodiment, the
在一个实施例中,运算模块172还用于基于控制类型,计算与控制指令对应的初始期望角速度;对初始期望角速度进行死区抑制,调整初始期望角速度的取值,得到末端期望角速度。In one embodiment, the
在一个实施例中,运算模块172还用于若控制指令为接触式控制,从控制指令中获取角度信息或角速度信息;根据角度信息或角速度信息,计算得到初始期望角速度。In one embodiment, the
在一个实施例中,运算模块172还用于若控制指令为非接触式控制,从控制指令中获取手势信息;根据手势信息,计算得到初始期望角速度。In one embodiment, the
在一个实施例中,运算模块172还用于若初始期望角速度的大小处于死区范围,末端期望角速度为0;若初始期望角速度的大小处于线性区范围,将初始期望角速度作为末端期望角速度;若初始期望角速度的大小处于正限幅区范围,将正限幅值作为末端期望角速度;若初始期望角速度的大小处于负限幅区范围,将负限幅值作为末端期望角速度。In one embodiment, the
在一个实施例中,控制模块173还用于根据末端期望角速度和末端期望角加速度计算得到调整臂关节对应的关节期望位置,并根据关节期望位置获取调整臂关节对应的期望力矩;基于期望力矩控制调整臂关节,以控制调整臂末端执行预设操作。In one embodiment, the
在一个实施例中,控制模块173还用于获取调整臂的关节当前所处的关节位置;根据末端期望角速度、末端期望角加速度和关节位置,采用微分运动学计算得到调整臂的关节对应的关节期望角速度、关节期望角加速度和关节速度;根据关节期望角速度、关节期望角加速度和关节速度,采用积分运动学计算得到关节期望位置。In one embodiment, the
上述调整臂控制装置中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于计算机设备中的处理器中,也可以以软件形式存储于计算机设备中的存储器中,以便于处理器调用执行以上各个模块对应的操作。Each module in the above-mentioned control device for the adjustment arm can be fully or partially realized by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, and can also be stored in the memory of the computer device in the form of software, so that the processor can invoke and execute the corresponding operations of the above-mentioned modules.
在一个实施例中,提供了一种计算机设备,该计算机设备可以是终端,其内部结构图可以如图18所示。该计算机设备包括处理器、存储器、输入/输出接口、通信接口、显示单元和输入装置。其中,处理器、存储器和输入/输出接口通过系统总线连接,通信接口、显示单元和输入装置通过输入/输出接口连接到系统总线。其中,该计算机设备的处理器用于提供计算和控制能力。该计算机设备的存储器包括非易失性存储介质、内存储器。该非易失性存储介质存储有操作系统和计算机程序。该内存储器为非易失性存储介质中的操作系统和计算机程序的运行提供环境。该计算机设备的输入/输出接口用于处理器与外部设备之间交换信息。该计算机设备的通信接口用于与外部的终端进行有线或无线方式的通信,无线方式可通过WIFI、移动蜂窝网络、NFC(近场通信)或其他技术实现。该计算机程序被处理器执行时以实现一种调整臂控制方法。该计算机设备的显示单元用于形成视觉可见的画面,可以是显示屏、投影装置或虚拟现实成像装置,显示屏可以是液晶显示屏或电子墨水显示屏,该计算机设备的输入装置可以是显示屏上覆盖的触摸层,也可以是计算机设备外壳上设置的按键、轨迹球或触控板,还可以是外接的键盘、触控板或鼠标等。In one embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure may be as shown in FIG. 18 . The computer device includes a processor, a memory, an input/output interface, a communication interface, a display unit and an input device. Wherein, the processor, the memory and the input/output interface are connected through the system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input/output interface. Wherein, the processor of the computer device is used to provide calculation and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The input/output interface of the computer device is used for exchanging information between the processor and external devices. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be realized through WIFI, mobile cellular network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, a method for controlling the adjusting arm is realized. The display unit of the computer equipment is used to form a visually visible picture, and may be a display screen, a projection device or a virtual reality imaging device, the display screen may be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment may be a display screen The touch layer covered on the top can also be a button, a trackball or a touch pad arranged on the computer equipment casing, or an external keyboard, touch pad or mouse.
本领域技术人员可以理解,图18中示出的结构,仅仅是与本申请方案相关的部分结构的框图,并不构成对本申请方案所应用于其上的计算机设备的限定,具体的计算机设备可以包括比图中所示更多或更少的部件,或者组合某些部件,或者具有不同的部件布置。Those skilled in the art can understand that the structure shown in Figure 18 is only a block diagram of a partial structure related to the solution of this application, and does not constitute a limitation to the computer equipment on which the solution of this application is applied. The specific computer equipment can be More or fewer components than shown in the figures may be included, or some components may be combined, or have a different arrangement of components.
在一个实施例中,还提供了一种计算机设备,包括存储器和处理器,存储器中存储有计算机程序,该处理器执行计算机程序时实现上述各方法实施例中的步骤。In one embodiment, there is also provided a computer device, including a memory and a processor, where a computer program is stored in the memory, and the processor implements the steps in the above method embodiments when executing the computer program.
在一个实施例中,提供了一种计算机可读存储介质,其上存储有计算机程序,该计算机程序被处理器执行时实现上述各方法实施例中的步骤。In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the steps in the foregoing method embodiments are implemented.
在一个实施例中,提供了一种计算机程序产品,包括计算机程序,该计算机程序被处理器执行时实现上述各方法实施例中的步骤。In one embodiment, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the steps in the foregoing method embodiments are implemented.
需要说明的是,本申请所涉及的用户信息(包括但不限于用户设备信息、用户个人信息等)和数据(包括但不限于用于分析的数据、存储的数据、展示的数据等),均为经用户授权或者经过各方充分授权的信息和数据,且相关数据的收集、使用和处理需要遵守相关国家和地区的相关法律法规和标准。It should be noted that the user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all It is information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的计算机程序可存储于一非易失性计算机可读取存储介质中,该计算机程序在执行时,可包括如上述各方法的实施例的流程。其中,本申请所提供的各实施例中所使用的对存储器、数据库或其它介质的任何引用,均可包括非易失性和易失性存储器中的至少一种。非易失性存储器可包括只读存储器(Read-OnlyMemory,ROM)、磁带、软盘、闪存、光存储器、高密度嵌入式非易失性存储器、阻变存储器(ReRAM)、磁变存储器(Magnetoresistive Random Access Memory,MRAM)、铁电存储器(Ferroelectric Random Access Memory,FRAM)、相变存储器(Phase Change Memory,PCM)、石墨烯存储器等。易失性存储器可包括随机存取存储器(Random Access Memory,RAM)或外部高速缓冲存储器等。作为说明而非局限,RAM可以是多种形式,比如静态随机存取存储器(Static Random Access Memory,SRAM)或动态随机存取存储器(Dynamic RandomAccess Memory,DRAM)等。本申请所提供的各实施例中所涉及的数据库可包括关系型数据库和非关系型数据库中至少一种。非关系型数据库可包括基于区块链的分布式数据库等,不限于此。本申请所提供的各实施例中所涉及的处理器可为通用处理器、中央处理器、图形处理器、数字信号处理器、可编程逻辑器、基于量子计算的数据处理逻辑器等,不限于此。Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above-mentioned embodiments can be completed by instructing related hardware through computer programs, and the computer programs can be stored in a non-volatile computer-readable memory In the medium, when the computer program is executed, it may include the processes of the embodiments of the above-mentioned methods. Wherein, any reference to storage, database or other media used in the various embodiments provided in the present application may include at least one of non-volatile and volatile storage. Non-volatile memory can include read-only memory (Read-Only Memory, ROM), tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive variable memory (ReRAM), magnetic variable memory (Magnetoresistive Random Access Memory, MRAM), Ferroelectric Random Access Memory (FRAM), Phase Change Memory (Phase Change Memory, PCM), graphene memory, etc. The volatile memory may include random access memory (Random Access Memory, RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the various embodiments provided in this application may include at least one of a relational database and a non-relational database. The non-relational database may include a blockchain-based distributed database, etc., but is not limited thereto. The processors involved in the various embodiments provided by this application can be general-purpose processors, central processing units, graphics processors, digital signal processors, programmable logic devices, data processing logic devices based on quantum computing, etc., and are not limited to this.
以上实施例的各技术特征可以进行任意的组合,为使描述简洁,未对上述实施例中的各个技术特征所有可能的组合都进行描述,然而,只要这些技术特征的组合不存在矛盾,都应当认为是本说明书记载的范围。The technical features of the above embodiments can be combined arbitrarily. To make the description concise, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, they should be It is considered to be within the range described in this specification.
以上所述实施例仅表达了本申请的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对本申请专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本申请构思的前提下,还可以做出若干变形和改进,这些都属于本申请的保护范围。因此,本申请的保护范围应以所附权利要求为准。The above-mentioned embodiments only express several implementation modes of the present application, and the description thereof is relatively specific and detailed, but should not be construed as limiting the patent scope of the present application. It should be noted that those skilled in the art can make several modifications and improvements without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application should be determined by the appended claims.
Claims (15)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211095317.9A CN116061171A (en) | 2022-09-06 | 2022-09-06 | Adjusting arm control method, device, system, computer equipment and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211095317.9A CN116061171A (en) | 2022-09-06 | 2022-09-06 | Adjusting arm control method, device, system, computer equipment and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
CN116061171A true CN116061171A (en) | 2023-05-05 |
Family
ID=86173760
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202211095317.9A Pending CN116061171A (en) | 2022-09-06 | 2022-09-06 | Adjusting arm control method, device, system, computer equipment and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN116061171A (en) |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120150408A1 (en) * | 2009-09-18 | 2012-06-14 | Honda Motor Co., Ltd. | Control device of omnidirectional vehicle |
CN106239503A (en) * | 2016-06-30 | 2016-12-21 | 杭州电子科技大学 | A kind of double-wheel self-balancing robot control system based on part known parameters |
CN109227545A (en) * | 2018-10-30 | 2019-01-18 | 闽江学院 | A kind of flexible mechanical arm target tracking control method based on reachable set estimation |
CN111497964A (en) * | 2020-04-27 | 2020-08-07 | 山东大学 | A distributed control system for an electric-driven quadruped robot |
CN111515951A (en) * | 2020-04-29 | 2020-08-11 | 江苏集萃华科智能装备科技有限公司 | Teleoperation system and teleoperation control method for robot |
CN111745644A (en) * | 2020-05-29 | 2020-10-09 | 东莞市易联交互信息科技有限责任公司 | Gesture-based remote control trolley control method and system and storage medium |
CN112770688A (en) * | 2018-10-03 | 2021-05-07 | Cmr外科有限公司 | Method and system for providing assistance to a user of a surgical robotic system |
CN114310974A (en) * | 2021-12-08 | 2022-04-12 | 清华大学 | A robot teleoperation method and device based on six-dimensional force signal |
CN114650900A (en) * | 2019-10-29 | 2022-06-21 | Cmr外科有限公司 | Robot joint control |
-
2022
- 2022-09-06 CN CN202211095317.9A patent/CN116061171A/en active Pending
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120150408A1 (en) * | 2009-09-18 | 2012-06-14 | Honda Motor Co., Ltd. | Control device of omnidirectional vehicle |
CN106239503A (en) * | 2016-06-30 | 2016-12-21 | 杭州电子科技大学 | A kind of double-wheel self-balancing robot control system based on part known parameters |
CN112770688A (en) * | 2018-10-03 | 2021-05-07 | Cmr外科有限公司 | Method and system for providing assistance to a user of a surgical robotic system |
CN109227545A (en) * | 2018-10-30 | 2019-01-18 | 闽江学院 | A kind of flexible mechanical arm target tracking control method based on reachable set estimation |
CN114650900A (en) * | 2019-10-29 | 2022-06-21 | Cmr外科有限公司 | Robot joint control |
CN111497964A (en) * | 2020-04-27 | 2020-08-07 | 山东大学 | A distributed control system for an electric-driven quadruped robot |
CN111515951A (en) * | 2020-04-29 | 2020-08-11 | 江苏集萃华科智能装备科技有限公司 | Teleoperation system and teleoperation control method for robot |
CN111745644A (en) * | 2020-05-29 | 2020-10-09 | 东莞市易联交互信息科技有限责任公司 | Gesture-based remote control trolley control method and system and storage medium |
CN114310974A (en) * | 2021-12-08 | 2022-04-12 | 清华大学 | A robot teleoperation method and device based on six-dimensional force signal |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11344374B2 (en) | Detection of unintentional movement of a user interface device | |
CN103112007B (en) | Based on the man-machine interaction method of hybrid sensor | |
JP6811465B2 (en) | Learning device, learning method, learning program, automatic control device, automatic control method and automatic control program | |
CN103207671A (en) | Touch free operation of ablator workstation by use of depth sensors | |
CN103207670A (en) | Touch free operation of devices by use of depth sensors | |
JP2014512530A (en) | Coordinate positioning device | |
CN111402287B (en) | System and method for standardized evaluation of activity sequences | |
US20110310013A1 (en) | Interface apparatus and method for contact-free space input/output | |
Fukuoka et al. | FaceDrive: Facial expression driven operation to control virtual supernumerary robotic arms | |
CN111507425A (en) | Pattern recognition method and system based on airbag array tactile perception | |
Zhang et al. | Digital twin-enabled grasp outcomes assessment for unknown objects using visual-tactile fusion perception | |
US10065111B1 (en) | Mapping user interactions with a controller to a hand position | |
WO2023178984A1 (en) | Methods and systems for multimodal hand state prediction | |
CN108051001B (en) | A robot movement control method, system and inertial sensing control device | |
CN116061171A (en) | Adjusting arm control method, device, system, computer equipment and storage medium | |
CN113791690A (en) | Man-machine interaction public equipment with real-time emotion recognition function | |
US12099684B2 (en) | Input location correction based on device motion | |
CN115958595B (en) | Robotic arm guidance method, device, computer equipment and storage medium | |
US11755150B2 (en) | Input location correction based on device motion | |
Al-Okby et al. | Development and testing of intelligent wheelchair controller for quadriplegic patients | |
Xie et al. | Enhanced Recognition for Finger Gesture-Based Control in Humanoid Robots Using Inertial Sensors | |
Wang et al. | Center-of-Mass-Based Object Regrasping: A Reinforcement Learning Approach and the Effects of Perception Modality | |
CN110427106A (en) | Body-sensing action data processing method, equipment and computer readable storage medium | |
CN110877335A (en) | An adaptive markerless robotic arm trajectory tracking method based on hybrid filter | |
CN118893634B (en) | Model training method and device and mechanical arm system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |