CN119036459A - Man-machine interaction control method and system for wearable flexible outer limb - Google Patents
Man-machine interaction control method and system for wearable flexible outer limb Download PDFInfo
- Publication number
- CN119036459A CN119036459A CN202411384632.2A CN202411384632A CN119036459A CN 119036459 A CN119036459 A CN 119036459A CN 202411384632 A CN202411384632 A CN 202411384632A CN 119036459 A CN119036459 A CN 119036459A
- Authority
- CN
- China
- Prior art keywords
- flexible external
- limb
- joint
- human
- interaction control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1602—Programme controls characterised by the control system, structure, architecture
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/0006—Exoskeletons, i.e. resembling a human figure
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1615—Programme controls characterised by special kind of manipulator, e.g. planar, scara, gantry, cantilever, space, closed chain, passive/active joints and tendon driven manipulators
Landscapes
- Engineering & Computer Science (AREA)
- Robotics (AREA)
- Mechanical Engineering (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Orthopedic Medicine & Surgery (AREA)
- Automation & Control Theory (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The invention provides a man-machine interaction control method and system for a wearable flexible outer limb, which are used for carrying out data processing based on Kalman filtering through action data captured in real time by an inertial sensor and a Hall sensor to obtain accurate pose of the flexible outer limb, combining the obtained accurate pose of the flexible outer limb with target action data based on symmetry of a human kinematic chain to adjust the flexible outer limb, and integrating various sensor technologies and the Kalman filtering technology.
Description
Technical Field
The invention belongs to the technical field of man-machine interaction control, and particularly relates to a man-machine interaction control method and system for a wearable flexible outer limb.
Background
The statements in this section merely provide background information related to the present disclosure and may not necessarily constitute prior art.
The flexible outer limb robot has the characteristics of high flexibility, high safety and the like, and is widely applied to assisting people in completing tasks such as detection, grabbing and carrying, rehabilitation and medical treatment and the like.
Symmetrical task tasks can ensure coordination and synchronization of flexible outer limbs in complex operating environments. The current method for realizing symmetrical operation has various limitations, such as insufficient sensor precision, data processing delay, poor environmental adaptability and the like.
Disclosure of Invention
In order to overcome the defects of the prior art, the invention provides the man-machine interaction control method and system for the wearable flexible outer limb, which are integrated with various sensor technologies, perform data processing and integration updating by using Kalman filtering, have the advantages of high precision, quick response, good environmental adaptability and the like, and can realize the accurate symmetrical operation of the flexible outer limb.
To achieve the above object, a first aspect of the present invention provides a human-computer interaction control method of a wearable flexible outer limb, the method comprising:
acquiring a measured value when the outer limb performs a task through an inertial sensor arranged at a joint of the flexible outer limb;
defining a Kalman filtering state vector, and obtaining a state transition matrix based on the current measured value of the inertial sensor and the predicted value of the next moment;
establishing an observation equation of Kalman filtering, and obtaining a state covariance matrix of Kalman filtering prediction based on the state transition matrix;
Updating a state covariance matrix and a state vector based on observed values of an inertial sensor and a Hall sensor arranged at the joint of the flexible outer limb to obtain the joint pose of the flexible outer limb;
And taking the obtained joint pose of the flexible outer limb as feedback data, and adjusting the pose of the flexible outer limb by combining the feedback data with target motion data obtained based on the symmetry of an ergonomic chain.
A second aspect of the invention provides a human-machine interaction control system for a wearable flexible outer limb, the system comprising:
the acquisition module is used for acquiring a measured value when the outer limb executes a task through an inertial sensor arranged at the joint of the flexible outer limb;
the computing module is used for defining a Kalman filtering state vector and obtaining a state transition matrix based on the current measured value of the inertial sensor and the predicted value of the next moment;
The prediction module is used for establishing an observation equation of Kalman filtering and obtaining a state covariance matrix predicted by the Kalman filtering based on the state transition matrix;
The updating module is used for updating the state covariance matrix and the state vector based on the observed values of the inertial sensor and the Hall sensor arranged at the joint of the flexible outer limb to obtain the joint pose of the flexible outer limb;
And the adjusting module is used for taking the obtained joint pose of the flexible outer limb as feedback data, and adjusting the pose of the flexible outer limb by combining the obtained joint pose of the flexible outer limb with target action data obtained based on the symmetry of the human kinematic chain.
A third aspect of the invention provides a computer device comprising a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory in communication via the bus when the computer device is in operation, the machine-readable instructions when executed by the processor performing a method of human-machine interaction control of a wearable flexible outer limb.
A fourth aspect of the invention provides a computer readable storage medium having a computer program stored thereon, which when executed by a processor performs a method of human-machine interaction control of a wearable flexible outer limb.
The one or more of the above technical solutions have the following beneficial effects:
According to the invention, the motion data captured in real time by the inertial sensor and the Hall sensor are processed based on Kalman filtering to obtain accurate pose of the flexible outer limb, the obtained accurate pose of the flexible outer limb is combined with the target motion data based on symmetry of the human kinematic chain to adjust the flexible outer limb, and the flexible outer limb automatic control device integrates various sensor technologies and Kalman filtering technologies, has the advantages of high precision, quick response, good environmental adaptability and the like, and can realize accurate symmetrical operation of the flexible outer limb.
Additional aspects of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention.
FIG. 1 is a flowchart of a man-machine interaction control method according to a first embodiment of the invention;
FIG. 2 is a flow chart of the pose processing according to the first embodiment of the present invention in combination with sensor data;
fig. 3 is a flowchart of a particle swarm optimization algorithm according to an embodiment of the invention.
Detailed Description
It should be noted that the following detailed description is exemplary and is intended to provide further explanation of the invention. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.
It is noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of exemplary embodiments according to the present invention.
Embodiments of the invention and features of the embodiments may be combined with each other without conflict.
Example 1
The embodiment discloses a man-machine interaction control method of a wearable flexible outer limb, comprising the following steps:
acquiring a measured value when the outer limb performs a task through an inertial sensor arranged at a joint of the flexible outer limb;
defining a Kalman filtering state vector, and obtaining a state transition matrix based on the current measured value of the inertial sensor and the predicted value of the next moment;
establishing an observation equation of Kalman filtering, and obtaining a state covariance matrix of Kalman filtering prediction based on the state transition matrix;
Updating a state covariance matrix and a state vector based on observed values of an inertial sensor and a Hall sensor arranged at the joint of the flexible outer limb to obtain the joint pose of the flexible outer limb;
And taking the obtained joint pose of the flexible outer limb as feedback data, and adjusting the pose of the flexible outer limb by combining the feedback data with target motion data obtained based on the symmetry of an ergonomic chain.
The following describes in detail a human-computer interaction control method for a wearable flexible outer limb according to the embodiment with reference to fig. 1, which specifically includes:
S1, arranging a sensor at a limb joint of a wearer needing a work task.
The step S1 comprises the following steps:
S1.1, mounting an IMU and a Hall sensor at the joint of a wearer.
The IMU is used for acquiring acceleration, angular velocity and magnetic field direction data of the flexible outer limb, and the Hall sensor is used for acquiring absolute angle data of the flexible outer limb.
S2, capturing action data of limbs in real time, and processing the data to ensure stability and accuracy of the data.
As shown in fig. 2, S2 includes the steps of:
And S2.1, carrying out initial calibration on the IMU to eliminate zero offset errors and scaling errors. The hall sensor is calibrated under a known magnetic field to determine the relationship between the magnetic field strength and direction and the sensor output.
S2.2, performing initial pose estimation, estimating a pitch angle, a roll angle and an azimuth angle, and calculating the angular change of the pose through numerical integration.
And S2.3, reading sensor data in real time, and performing more accurate data fusion by using a Kalman filter to provide more accurate pose estimation.
In the pose estimation of the flexible outer limb, a state vector X k is first defined, including information such as joint angle, angular velocity, and acceleration.
The state transfer equation describes the dynamic change of the system, and the change of angle can be obtained based on the angular velocity measurement of the IMU. By integrating the angular velocity, the angle at the next moment is obtained:
X k-1 is state estimation obtained by the result of the Kalman filter at the last moment, and combines the data of the IMU and the Hall sensor; Is a predicted state vector, a is a state transition matrix used to predict the state of the system next step, B is a control input matrix, U k is a control input, set 0;W k in this application is process noise, representing uncertainty in the state model.
The observation equation, which describes the relationship of the measurements taken from the sensors to the system state, can be written as:
Zk=HXk+Vk
Wherein Z k is the observed data of the combined IMU and Hall sensor, H is the observed matrix, the state vector is mapped to the measured value, and V k is the measured noise, which represents the measured error of the sensor.
Kalman filtering is divided into two main steps, prediction and updating.
Predicting the state at the current time from the previous state and the sensor data using a state transition equation:
Wherein, Is the predicted state covariance, Q is the process noise covariance matrix, representing the uncertainty of the prediction.
The updating step combines the actual measurements of the hall sensor and IMU to correct the predicted state, preventing drift in long-term operation.
The kalman gain K k is used to weigh the predicted and measured values.
Where R is the measurement noise covariance matrix, representing the uncertainty of the sensor measurements.
Combining the predicted state with the actual measured data to update the current state estimate:
And updating covariance:
And S3, based on a symmetry principle, mapping the motion data of the wearer into symmetrical motion data of the flexible outer limb.
As shown in fig. 3, S3 includes the steps of:
S3.1, according to the symmetry of the human kinematic chain, taking the human body midline of a wearer as a symmetry axis, an axis which is vertically downward from the top of the head to the pelvis is generally selected, and the axis divides the human body into a left part and a right part. The axis is used for defining the joint action mapping relation on the left side and the right side so as to ensure that the generated symmetrical action accords with the natural symmetrical movement characteristic of a human body.
And S3.2, mirror-turning the joint data of the wearer based on the symmetry axis, namely mapping the data of the left joint to the right joint and vice versa, and generating complete symmetrical motion data by mapping in the mode.
And S3.3, selecting a proper optimization algorithm to optimize the action of the mapping flexible outer limb. For example, by reducing abrupt changes in the angular change of the joint, limiting abrupt changes in angular velocity, etc., the joint is made smoother and more natural, and thus, uncoordinated or stiff movements are avoided.
Taking a particle swarm optimization algorithm as an example:
initializing, namely, representing a combination of motion data by each particle, determining the initial position of the particle by mapping to generate symmetrical motion data, and representing the speed of motion change by the speed of the particle.
The fitness function is defined by measuring smoothness and naturalness by calculating joint angle changes, angular velocity changes, acceleration changes between successive time steps. At times t and t+1, the mapped joint angles are θ t and θ t+1, the mapped joint angular velocities are ω t and ω t+1, and the mapped joint accelerations are a t and a t+1, then:
The above parts are weighted and combined into a comprehensive fitness function:
f=w1fangle+w2fv+w3fa
Where w 1,w2,w3 is a different weight coefficient.
The fitness function is used to evaluate the solution for good or bad, and the better the fitness value, the closer the solution represented by the particle is to the optimal solution, and directs the search direction and whether a sufficiently good solution has been found.
Updating the particle velocity:
Wherein: is the velocity of particle i at the kth generation, w is the inertial weight, controls the exploratory ability of the particle, c 1 and c 2 are learning factors for balancing individual experience and population experience, r 1 and r 2 are random numbers to ensure diversity; Is the historical optimal position of particle i, g best is the global optimal position in the population, calculated by the fitness function.
If the current fitness value of the particle is better than the historical optimal value, the historical optimal position is updated, and the particle position is updated:
Repeated fitness evaluation and continuous updating And g best, if the fitness function converges or reaches the preset iteration times, generating action data to be executed by the optimized flexible outer limb according to the obtained global optimal solution g best.
And S4, transmitting the mapped symmetrical action data to a control system of the flexible outer limb, detecting the joint pose of the flexible outer limb in real time as feedback, and driving the flexible outer limb to execute corresponding symmetrical action.
And S4.1, transmitting the optimized symmetrical action data to a control system of the flexible outer limb.
And S4.2, driving the flexible outer limb to reach the target position and posture, and executing corresponding symmetrical actions.
And S4.3, reading the IMU and Hall sensor data installed in the flexible outer limb joint in real time, and estimating the actual pose according to the step in S2.
And S4.4, taking the fused actual pose estimation result as feedback data, and continuously adjusting the pose of the flexible outer limb by combining the feedback data with the symmetrical motion data optimized in the S3 so as to realize accurate symmetrical operation.
Example two
An object of the present embodiment is to provide a human-computer interaction control system of a wearable flexible outer limb, including:
the acquisition module is used for acquiring a measured value when the outer limb executes a task through an inertial sensor arranged at the joint of the flexible outer limb;
the computing module is used for defining a Kalman filtering state vector and obtaining a state transition matrix based on the current measured value of the inertial sensor and the predicted value of the next moment;
The prediction module is used for establishing an observation equation of Kalman filtering and obtaining a state covariance matrix predicted by the Kalman filtering based on the state transition matrix;
The updating module is used for updating the state covariance matrix and the state vector based on the observed values of the inertial sensor and the Hall sensor arranged at the joint of the flexible outer limb to obtain the joint pose of the flexible outer limb;
And the adjusting module is used for taking the obtained joint pose of the flexible outer limb as feedback data, and adjusting the pose of the flexible outer limb by combining the obtained joint pose of the flexible outer limb with target action data obtained based on the symmetry of the human kinematic chain.
Example III
It is an object of the present embodiment to provide a computing device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, which processor implements the steps of the method described above when executing the program.
Example IV
An object of the present embodiment is to provide a computer-readable storage medium.
A computer readable storage medium having stored thereon a computer program which when executed by a processor performs the steps of the above method.
The steps involved in the devices of the second, third and fourth embodiments correspond to those of the first embodiment of the method, and the detailed description of the embodiments can be found in the related description section of the first embodiment. The term "computer-readable storage medium" shall be taken to include a single medium or multiple media that includes one or more sets of instructions, and shall also be taken to include any medium that is capable of storing, encoding or carrying a set of instructions for execution by the processor and that cause the processor to perform any one of the methodologies of the present invention.
It will be appreciated by those skilled in the art that the modules or steps of the invention described above may be implemented by general-purpose computer means, alternatively they may be implemented by program code executable by computing means, whereby they may be stored in storage means for execution by computing means, or they may be made into individual integrated circuit modules separately, or a plurality of modules or steps in them may be made into a single integrated circuit module. The present invention is not limited to any specific combination of hardware and software.
While the foregoing description of the embodiments of the present invention has been presented in conjunction with the drawings, it should be understood that it is not intended to limit the scope of the invention, but rather, it is intended to cover all modifications or variations within the scope of the invention as defined by the claims of the present invention.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202411384632.2A CN119036459A (en) | 2024-09-30 | 2024-09-30 | Man-machine interaction control method and system for wearable flexible outer limb |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202411384632.2A CN119036459A (en) | 2024-09-30 | 2024-09-30 | Man-machine interaction control method and system for wearable flexible outer limb |
Publications (1)
Publication Number | Publication Date |
---|---|
CN119036459A true CN119036459A (en) | 2024-11-29 |
Family
ID=93570045
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202411384632.2A Pending CN119036459A (en) | 2024-09-30 | 2024-09-30 | Man-machine interaction control method and system for wearable flexible outer limb |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN119036459A (en) |
-
2024
- 2024-09-30 CN CN202411384632.2A patent/CN119036459A/en active Pending
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5330138B2 (en) | Reinforcement learning system | |
US11235461B2 (en) | Controller and machine learning device | |
Sutanto et al. | Encoding physical constraints in differentiable newton-euler algorithm | |
CN110076772B (en) | Grabbing method and device for mechanical arm | |
CA2735262C (en) | Inverse kinematics | |
Jin et al. | The adaptive Kalman filter based on fuzzy logic for inertial motion capture system | |
Armesto et al. | Multi-rate fusion with vision and inertial sensors | |
Yousuf et al. | Information fusion of GPS, INS and odometer sensors for improving localization accuracy of mobile robots in indoor and outdoor applications | |
JP2022543926A (en) | System and Design of Derivative-Free Model Learning for Robotic Systems | |
CN107618678A (en) | Attitude control information consolidation method of estimation under attitude of satellite angular deviation | |
US6484131B1 (en) | Localization and tracking system | |
CN114367990B (en) | A tactile external force estimation method for robotic arm based on a mixed model of mechanism data | |
JP7034264B2 (en) | Self-position estimation method | |
CN112571420B (en) | Dual-function model prediction control method under unknown parameters | |
Al-Fahoum et al. | Design of a modified Madgwick filter for quaternion-based orientation estimation using AHRS | |
CN113910218A (en) | Robot calibration method and device based on kinematics and deep neural network fusion | |
Meng et al. | Spring-imu fusion-based proprioception for feedback control of soft manipulators | |
Vertzberger et al. | Adaptive attitude estimation using a hybrid model-learning approach | |
CN107621261B (en) | Adaptive optimal-REQUEST algorithm for inertial-geomagnetic combined attitude calculation | |
Wöhle et al. | A robust quaternion based Kalman filter using a gradient descent algorithm for orientation measurement | |
CN119036459A (en) | Man-machine interaction control method and system for wearable flexible outer limb | |
CN110375773A (en) | MEMS inertial navigation system posture initial method | |
CN116310991A (en) | Backboard drop point prediction method and backboard drop point prediction system based on reinforcement learning | |
Xu et al. | A proposed attitude estimator with reliability test criteria for sensor data fusion | |
KR20110056185A (en) | Posture Estimation Method and Apparatus Using Li-Algebra and Kalman Filters |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |