[go: up one dir, main page]

CN111823212A - A garbage bottle cleaning robot and control method - Google Patents

A garbage bottle cleaning robot and control method Download PDF

Info

Publication number
CN111823212A
CN111823212A CN202010698942.7A CN202010698942A CN111823212A CN 111823212 A CN111823212 A CN 111823212A CN 202010698942 A CN202010698942 A CN 202010698942A CN 111823212 A CN111823212 A CN 111823212A
Authority
CN
China
Prior art keywords
garbage
robot
bottle
host
micro
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010698942.7A
Other languages
Chinese (zh)
Other versions
CN111823212B (en
Inventor
陈灯
汪佳俊
赵亮
张聪
代文
李祯鹏
蒯志炎
谭文雄
冯晨光
魏巍
张彦铎
吴云韬
周华兵
刘玮
段功豪
王逸文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhan Yinxing Technology Co ltd
Wuhan Institute of Technology
Original Assignee
Wuhan Yinxing Technology Co ltd
Wuhan Institute of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuhan Yinxing Technology Co ltd, Wuhan Institute of Technology filed Critical Wuhan Yinxing Technology Co ltd
Priority to CN202010698942.7A priority Critical patent/CN111823212B/en
Publication of CN111823212A publication Critical patent/CN111823212A/en
Application granted granted Critical
Publication of CN111823212B publication Critical patent/CN111823212B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J5/00Manipulators mounted on wheels or on carriages
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J19/00Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
    • B25J19/02Sensing devices
    • B25J19/04Viewing devices
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1602Programme controls characterised by the control system, structure, architecture
    • B25J9/161Hardware, e.g. neural networks, fuzzy logic, interfaces, processor
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1656Programme controls characterised by programming, planning systems for manipulators
    • B25J9/1664Programme controls characterised by programming, planning systems for manipulators characterised by motion, path, trajectory planning
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1679Programme controls characterised by the tasks executed
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1694Programme controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697Vision controlled systems
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02WCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO WASTEWATER TREATMENT OR WASTE MANAGEMENT
    • Y02W30/00Technologies for solid waste management
    • Y02W30/10Waste collection, transportation, transfer or storage, e.g. segregated refuse collecting, electric or hybrid propulsion

Landscapes

  • Engineering & Computer Science (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Automation & Control Theory (AREA)
  • Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Fuzzy Systems (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
  • Manipulator (AREA)

Abstract

The invention discloses a garbage bottle cleaning and picking robot and a control method thereof, wherein the garbage bottle cleaning and picking robot comprises a bottom plate, a middle layer clapboard, a shell and a mechanical arm, and further comprises a micro host, a development board, a binocular vision camera and a laser radar. The robot generates a map through equipment such as a laser radar module and a GPS module, automatically patrols and examines and avoids obstacles, and can be remotely operated and acquire various data through a remote controller. The robot provided by the invention can be used for automatically cleaning and picking up the garbage bottles, and has the advantages that: the automatic cleaning and sorting of the garbage bottles are realized, the recycling difficulty of the garbage bottles is reduced, the urban environment is beautified, and the labor force and the cleaning cost are saved.

Description

一种垃圾瓶清捡机器人及控制方法A garbage bottle cleaning robot and control method

技术领域technical field

本发明涉及智能机器人技术领域,特别是指一种垃圾瓶清捡机器人及控制方法。The invention relates to the technical field of intelligent robots, in particular to a garbage bottle cleaning robot and a control method.

背景技术Background technique

随着中国社会老龄化的现象日益凸显,国内劳动力成本不断上升,人口红利逐渐消失,当前采用人力维护清洁的方式存在人工死角,清洁效率低,打扫不及时等问题,而且清洁工不仅很辛苦,劳动机械性重复,劳动强度大,而且劳动环境导致较高慢性呼吸道疾病发病率,甚至复杂多变的交通和路况会置他们生命于危险之中。With the increasingly prominent phenomenon of China's aging society, domestic labor costs continue to rise, and the demographic dividend is gradually disappearing. The current method of manual maintenance and cleaning has problems such as artificial dead ends, low cleaning efficiency, and untimely cleaning. Moreover, the cleaners are not only very hard, but also The labor is mechanically repetitive and labor-intensive, and the labor environment leads to a high incidence of chronic respiratory diseases, and even complex and changeable traffic and road conditions will put their lives in danger.

但现有的扫地机器人仍存在不少弊端:1.扫地机器人普遍采用旋转毛刷式结构,使得内部清理维护困难;2.大部分扫地机器人应用场景小,只适合于室内干燥且平坦的地面;3.应用范围也较小,只适合清洁灰尘、碎屑等小型垃圾,面对如塑料瓶等稍大点垃圾无能为力。垃圾瓶属于可回收垃圾,将塑料瓶或玻璃瓶等与其他垃圾放置在一起处理,会增加回收处理的难度,减少了可回收材料的回收率,同时增加了污染。However, the existing sweeping robots still have many drawbacks: 1. The sweeping robot generally adopts a rotating brush structure, which makes internal cleaning and maintenance difficult; 2. Most sweeping robots have small application scenarios and are only suitable for indoor dry and flat ground; 3. The scope of application is also small. It is only suitable for cleaning small garbage such as dust and debris. It is powerless to face slightly larger garbage such as plastic bottles. Garbage bottles are recyclable garbage. Placing plastic or glass bottles together with other garbage will increase the difficulty of recycling, reduce the recycling rate of recyclable materials, and increase pollution.

发明内容SUMMARY OF THE INVENTION

有鉴于此,本发明提供了一种垃圾瓶清捡机器人。In view of this, the present invention provides a garbage bottle cleaning robot.

本发明提供一种垃圾瓶清捡机器人,包括:底板、中间层隔板、外壳、机械臂和微型主机,底板下表面设置有主动轮、步进电机和万向从动轮,底板上表面设置有所述微型主机、开发板和步进电机驱动器,步进电机驱动器用于驱动所述步进电机,进而带动主动轮控制机器人运动,微型主机与所述开发板电连接,作为上位机控制作为下位机的所述开发板;The invention provides a garbage bottle cleaning robot, comprising: a bottom plate, a middle layer partition, a casing, a mechanical arm and a micro-host; the lower surface of the bottom plate is provided with a driving wheel, a stepping motor and a universal driven wheel; the upper surface of the bottom plate is provided with a driving wheel, a stepping motor and a universal driven wheel The micro-host, the development board and the stepper motor driver, the stepper motor driver is used to drive the stepper motor, and then drives the driving wheel to control the movement of the robot, the micro-host is electrically connected to the development board, and is used as a host computer to control as a subordinate computer. The development board of the machine;

中间层隔板通过连接柱固定连接于所述底板上,所述机械臂固定连接于所述中间层隔板上表面的一端;The intermediate layer partition is fixedly connected to the bottom plate through a connecting column, and the mechanical arm is fixedly connected to one end of the upper surface of the intermediate layer partition;

外壳固定于所述底板上并包裹所述中间层隔板,外壳上表面一端设置有预留开口,以便所述机械臂从预留开口伸出,将清捡的垃圾瓶投入到外壳上表面的中间固定有的垃圾篓中,上表面另一端固定有激光雷达;The outer shell is fixed on the bottom plate and wraps the middle layer partition, and one end of the upper surface of the outer shell is provided with a reserved opening, so that the robotic arm can extend from the reserved opening and put the collected garbage bottles into the upper surface of the outer shell. In the garbage basket fixed in the middle, the lidar is fixed on the other end of the upper surface;

机械臂末端装载双目视觉摄像头,与机械臂共同构成手眼系统,用于清捡垃圾瓶;The end of the robotic arm is equipped with a binocular vision camera, which together with the robotic arm constitutes a hand-eye system for picking up garbage bottles;

微型主机包括有神经网络芯片,所述神经网络芯片用于根据所述激光雷达和所述双目视觉摄像头获取的反馈信息判断待清捡目标是否为垃圾瓶。The micro-host includes a neural network chip, and the neural network chip is used for judging whether the object to be cleaned is a garbage bottle according to the feedback information obtained by the lidar and the binocular vision camera.

本发明通过设计了一种垃圾瓶清捡机器人,通过神经网络芯片进行学习,根据所述激光雷达和所述双目视觉摄像头获取的反馈信息判断待清捡目标是否为垃圾瓶,并进行高效清捡处理,可以增加可回收材料的回收率,降低日常垃圾清扫的难度,还可以对特殊环境如游客较多的环境起到比传统垃圾清扫机器人更好的清洁效果。The invention designs a garbage bottle cleaning robot, learns through a neural network chip, judges whether the object to be cleaned is a garbage bottle according to the feedback information obtained by the laser radar and the binocular vision camera, and performs efficient cleaning. Picking up and processing can increase the recovery rate of recyclable materials, reduce the difficulty of daily garbage cleaning, and can also have a better cleaning effect than traditional garbage cleaning robots in special environments such as environments with many tourists.

优选的,所述开发板为Arduino Uno开发板。Preferably, the development board is an Arduino Uno development board.

优选的,所述连接柱为6个,使得整体结构更加稳定。Preferably, the number of the connecting columns is 6, so that the overall structure is more stable.

优选的,所述主动轮、万向从动轮,步进电机和步进电机驱动器均为两个。Preferably, the driving wheel, the universal driven wheel, the stepping motor and the stepping motor driver are all two.

优选的,底板上还设置有降压模块、4G通信模块、GPS模块和电池;Preferably, a step-down module, a 4G communication module, a GPS module and a battery are also provided on the bottom plate;

微型主机与开发板、激光雷达、机械臂、双目视觉摄像头、4G通信模块和GPS模块电连接,用于作为上位机通信并控制所有与微型主机电连接的部件;The micro-host is electrically connected with the development board, lidar, robotic arm, binocular vision camera, 4G communication module and GPS module, and is used to communicate as a host computer and control all components electrically connected to the micro-host;

优选的,双目视觉摄像头和机械臂与上位机相连,使用摄像头对垃圾瓶进行识别,通过机械臂进行抓取。将摄像头于机械臂夹爪上角度固定设置,便于通过对机械臂姿态的判断进而对摄像头的拍摄角度进行控制。Preferably, the binocular vision camera and the robotic arm are connected to the host computer, the camera is used to identify the garbage bottles, and the robotic arm is used for grabbing. The angle of the camera is fixed on the gripper of the manipulator, which is convenient to control the shooting angle of the camera by judging the posture of the manipulator.

可选的,激光雷达和上位机相连,并进行对垃圾瓶大小、形状和材质的辅助判断。Optionally, the lidar is connected to the upper computer, and performs auxiliary judgment on the size, shape and material of the garbage bottle.

外壳上还固定有4G天线,并与4G通信模块电连接。A 4G antenna is also fixed on the casing, and is electrically connected with the 4G communication module.

可选的,机器人安装其他通信模块如蓝牙模块进行远程通信。Optionally, the robot is installed with other communication modules such as Bluetooth modules for remote communication.

优选的,步进电机驱动器同时与开发板和步进电机电连接,并接收开发板的脉冲信息,从而根据脉冲信息驱动步进电机,并由所述步进电机带动主动轮进行移动。Preferably, the stepper motor driver is electrically connected to the development board and the stepper motor at the same time, and receives pulse information of the development board, so as to drive the stepper motor according to the pulse information, and the stepper motor drives the driving wheel to move.

优选的,电池通过降压模块与步进电机驱动器、微型主机、激光雷达和机械臂电连接,并进行供电。Preferably, the battery is electrically connected to the stepper motor driver, the micro-host, the lidar and the robotic arm through the step-down module, and supplies power.

优选的,垃圾瓶清捡机器人还包括WIFI模块,Preferably, the garbage bottle cleaning robot further includes a WIFI module,

WIFI模块与微型主机电连接,用于远程通信。The WIFI module is electrically connected with the micro-host for remote communication.

可选的,判断WIFI模块是否与网络连接,若连接,则使用WIFI模块进行远程通信,若未连接,则通过4G通信模块进行远程通信。Optionally, it is judged whether the WIFI module is connected to the network, if connected, the WIFI module is used for remote communication, and if not, the 4G communication module is used for remote communication.

可选的,机器人有两个步进电机,每个步进电机附近还安装有加速度传感器,并与开发板电连接,用于校正机器人的速度。Optionally, the robot has two stepper motors, and an acceleration sensor is installed near each stepper motor and is electrically connected to the development board for correcting the speed of the robot.

机械臂末端还安装有激光测距传感器和温湿度传感器,并与开发板电连接,用于校正机器人的精度。The end of the robotic arm is also equipped with a laser ranging sensor and a temperature and humidity sensor, and is electrically connected to the development board for correcting the robot's accuracy.

本发明还提供一种垃圾瓶清捡机器人的控制方法,基于机器人系统框架ROS进行设计,控制上述的任一种垃圾瓶清捡机器人,方法包括:The present invention also provides a control method for a garbage bottle cleaning robot, which is designed based on the robot system framework ROS to control any of the above garbage bottle cleaning robots. The method includes:

S1、机器人的微型主机通过激光雷达获得工作区域的地图;S1. The micro-host of the robot obtains the map of the working area through the lidar;

S2、所述微型主机在所述工作区域上自动规划路线巡检;S2, the micro-host automatically plans a route inspection on the working area;

S3、神经网络芯片控制所述激光雷达和所述双目视觉摄像头在巡检的过程中识别垃圾瓶;S3. The neural network chip controls the lidar and the binocular vision camera to identify garbage bottles during the inspection process;

S4、激光雷达结合所述GPS模块测算所述垃圾瓶相对所述机器人在地图上的坐标;S4, the laser radar combined with the GPS module to measure the coordinates of the garbage bottle relative to the robot on the map;

S5、机器人行驶至所述垃圾瓶的所在位置;S5, the robot travels to the location of the garbage bottle;

S6、双目视觉摄像头测算所述垃圾瓶与机械臂的相对位置信息;S6, the binocular vision camera measures the relative position information of the garbage bottle and the mechanical arm;

S7、微型主机控制所述机械臂捡起所述垃圾瓶并放入垃圾篓,并继续进行巡检。S7. The micro-host controls the robotic arm to pick up the garbage bottle and put it into the garbage basket, and continue to perform inspection.

优选的,所述工作区域的地图由SLAM构建。Preferably, the map of the working area is constructed by SLAM.

可选的,所述工作区域的地图也可以通过WIFI模块等通过远程通信手段获取。Optionally, the map of the working area can also be acquired through remote communication means such as a WIFI module.

优选的,所述一种垃圾瓶清捡机器人的控制方法还包括:Preferably, the control method for the garbage bottle cleaning robot further includes:

微型主机通过与微型主机电连接的所述WIFI模块或4G模块与远程控制器进行通信,所述通信包括:接收所述远程控制器发出的远程控制信号,或发送周边环境障碍物信息、机器人定位信息和机器人视野信息给所述远程控制器。The micro-host communicates with the remote controller through the WIFI module or 4G module electrically connected to the micro-host, and the communication includes: receiving a remote control signal sent by the remote controller, or sending information on obstacles in the surrounding environment, robot positioning information and robot field of view information to the remote controller.

优选的,所述步骤S3包括:Preferably, the step S3 includes:

神经网络芯片根据所述激光雷达和所述双目视觉摄像头的反馈信息,构建神经网络进行训练,并识别所述垃圾瓶的形状和材质。The neural network chip constructs a neural network for training according to the feedback information of the lidar and the binocular vision camera, and recognizes the shape and material of the garbage bottle.

可选的,激光雷达和双目视觉摄像头分别获取目标信息构建相应的训练集和验证集,并构建神经网络进行训练,通过人工智能图像识别技术识别垃圾瓶的形状,判断目标是否为垃圾瓶。还可以通过激光雷达和双目视觉摄像头一起进行神经网络训练,以进一步提高对垃圾瓶材质判断的准确率,并实现精准捡拾塑料瓶或玻璃瓶的效果。Optionally, the lidar and binocular vision cameras respectively obtain target information to construct corresponding training sets and verification sets, and construct a neural network for training, identify the shape of the garbage bottle through artificial intelligence image recognition technology, and determine whether the target is a garbage bottle. Neural network training can also be performed together with lidar and binocular vision cameras to further improve the accuracy of judging the material of garbage bottles, and achieve the effect of accurately picking up plastic or glass bottles.

本发明还提供一种垃圾瓶清捡机器人的控制系统,基于机器人系统框架ROS进行设计,控制上述的任一种垃圾瓶清捡机器人,包括:The present invention also provides a control system for a garbage bottle cleaning robot, which is designed based on the robot system framework ROS to control any of the above garbage bottle cleaning robots, including:

地图服务节点,用于通过激光雷达和GPS模块获得工作区域的地图;The map service node is used to obtain the map of the working area through the lidar and GPS module;

路径规划节点,用于通过所述微型主机在工作区域上自动规划路线巡检;A path planning node, used for automatically planning a route inspection on the work area through the micro-host;

神经网络节点,用于通过所述神经网络芯片控制所述激光雷达和双目视觉摄像头在巡检的过程中识别垃圾瓶;A neural network node, used to control the lidar and binocular vision camera to identify garbage bottles during the inspection process through the neural network chip;

GPS节点,用于通过所述GPS模块和所述激光雷达测算所述垃圾瓶相对所述机器人在地图上的坐标;The GPS node is used to measure the coordinates of the garbage bottle relative to the robot on the map through the GPS module and the lidar;

电机控制节点,用于行驶至所述垃圾瓶的位置;a motor control node for driving to the position of the garbage bottle;

摄像头节点,用于通过所述双目视觉摄像头测算所述垃圾瓶与所述机械臂的相对位置信息;a camera node, used to measure the relative position information of the garbage bottle and the robotic arm through the binocular vision camera;

机械臂节点,用于通过所述微型主机控制所述机械臂捡起所述垃圾瓶并放入垃圾篓,并继续进行巡检。The robotic arm node is used to control the robotic arm to pick up the garbage bottle and put it into the garbage basket through the micro-host, and continue the inspection.

优选的,系统还包括:Preferably, the system further includes:

激光雷达节点,用于将激光雷达扫描出的障碍物信息发布给路径规划节点,或将扫描出的垃圾瓶信息发布给神经网络节点。The lidar node is used to publish the obstacle information scanned by the lidar to the path planning node, or publish the scanned garbage bottle information to the neural network node.

机器人姿态发布节点,用于向各节点发布机器人各传感器和部件的坐标变换,例如将激光测距传感器的数值发送给微型主机进行处理。The robot attitude publishing node is used to publish the coordinate transformation of each sensor and component of the robot to each node, such as sending the value of the laser ranging sensor to the micro-host for processing.

优选的,系统还包括:Preferably, the system further includes:

通信节点,用于通过所述微型主机通过与微型主机电连接的所述WIFI模块或4G模块与远程控制器进行通信,所述通信包括:接收所述远程控制器发出的远程控制信号,或发送周边环境障碍物信息、机器人定位信息和机器人视野信息给所述远程控制器。A communication node for communicating with a remote controller through the micro-host through the WIFI module or 4G module electrically connected to the micro-host, and the communication includes: receiving a remote control signal sent by the remote controller, or sending Surrounding environment obstacle information, robot positioning information and robot vision information are sent to the remote controller.

优选的,所述远程控制器可以是工业机器人控制器,也可以是手机APP,可以通过微型主机连接的WIFI模块或4G模块与机器人的通信节点通信,可人为控制机器人行驶,接收机器人激光雷达,GPS模块和双目视觉摄像头模块等发布的信息,在室内外均能远程控制机器人。Preferably, the remote controller can be an industrial robot controller or a mobile phone APP, which can communicate with the communication node of the robot through the WIFI module or 4G module connected to the micro-host, and can manually control the robot to drive and receive the robot lidar, The information released by the GPS module and binocular vision camera module can remotely control the robot both indoors and outdoors.

本发明还提供一种电子设备,所述设备包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时实现上述方法实施例中记载的任何一种垃圾瓶清捡机器人的控制方法的部分或全部步骤。The present invention also provides an electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that the processor executes the computer program At the same time, some or all of the steps of the control method of any garbage bottle cleaning robot described in the above method embodiments are realized.

本发明还提供一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现上述方法实施例中记载的任何一种垃圾瓶清捡机器人的控制方法的部分或全部步骤。The present invention further provides a computer-readable storage medium storing a computer program, characterized in that, when the computer program is executed by a processor, any one of the garbage bottles described in the foregoing method embodiments is implemented. Part or all of the steps of the control method of the pick-up robot.

附图说明Description of drawings

此处所说明的附图用来提供对本发明的进一步理解,构成本申请的一部分,本申请的示意性实施例及其说明用于解释本发明,并不构成对本发明的不当限定。在附图中:The accompanying drawings described herein are used to provide a further understanding of the present invention and constitute a part of the present application. The schematic embodiments and descriptions of the present application are used to explain the present invention and do not constitute an improper limitation of the present invention. In the attached image:

图1是本发明实施例中的一种垃圾瓶清捡机器人结构示意图;1 is a schematic structural diagram of a garbage bottle cleaning robot according to an embodiment of the present invention;

图2是本发明实施例中的一种垃圾瓶清捡机器人控制方法流程图;2 is a flowchart of a control method for a garbage bottle cleaning robot in an embodiment of the present invention;

图3是本发明实施例中的机器人右向内部结构示意图;FIG. 3 is a schematic diagram of a rightward internal structure of a robot in an embodiment of the present invention;

图4是本发明实施例中的机器人左向内部结构示意图;4 is a schematic diagram of the left-hand internal structure of a robot in an embodiment of the present invention;

图5是本发明实施例中的各节点实际通信示意图。FIG. 5 is a schematic diagram of actual communication of each node in an embodiment of the present invention.

图中:In the picture:

1、底板2、主动轮3、步进电机4、从动轮5、微型主机6、开发板7、步进电机驱动器8、降压模块9、4G通信模块10、GPS模块11、电池12、中间层隔板13、连接柱14、机械臂15、外壳16、垃圾篓17、4G天线18、激光雷达19、双目视觉摄像头。1. Bottom plate 2, driving wheel 3, stepping motor 4, driven wheel 5, micro host 6, development board 7, stepping motor driver 8, step-down module 9, 4G communication module 10, GPS module 11, battery 12, middle Layer partition 13, connecting column 14, robotic arm 15, housing 16, trash can 17, 4G antenna 18, lidar 19, binocular vision camera.

具体实施方式Detailed ways

以下结合附图对本发明的原理和特征进行描述,所举实例只用于解释本发明,并非用于限定本发明的范围。The principles and features of the present invention will be described below with reference to the accompanying drawings. The examples are only used to explain the present invention, but not to limit the scope of the present invention.

本发明的实施例提供一种垃圾瓶清捡机器人,如图1所示,包括:底板1、中间层隔板12、外壳15、机械臂14和微型主机5,底板1下表面设置有主动轮2、步进电机3和万向从动轮4,底板1上表面设置有所述微型主机5、开发板6和步进电机驱动器7,步进电机驱动器7用于驱动所述步进电机3,进而带动主动轮2控制机器人运动,微型主机5与所述开发板6电连接,作为上位机控制作为下位机的所述开发板6;An embodiment of the present invention provides a garbage bottle cleaning robot, as shown in FIG. 1 , comprising: a bottom plate 1 , a middle layer partition 12 , a casing 15 , a mechanical arm 14 and a micro host 5 , and a driving wheel is provided on the lower surface of the bottom plate 1 2. The stepping motor 3 and the universal driven wheel 4, the upper surface of the base plate 1 is provided with the micro-host 5, the development board 6 and the stepping motor driver 7, and the stepping motor driver 7 is used to drive the stepping motor 3, Then drive the driving wheel 2 to control the movement of the robot, and the micro-host 5 is electrically connected with the development board 6, as the upper computer controls the development board 6 as the lower computer;

中间层隔板12通过连接柱13固定连接于所述底板1上,所述机械臂14固定连接于所述中间层隔板12上表面的一端;The intermediate layer partition plate 12 is fixedly connected to the bottom plate 1 through the connecting column 13, and the mechanical arm 14 is fixedly connected to one end of the upper surface of the intermediate layer partition plate 12;

外壳15固定于所述底板1上并包裹所述中间层隔板12,外壳15上表面一端设置有预留开口,以便所述机械臂14从预留开口伸出,将清捡的垃圾瓶投入到外壳15上表面的中间固定有的垃圾篓16中,上表面另一端固定有激光雷达18;The outer shell 15 is fixed on the bottom plate 1 and wraps the intermediate layer partition 12. One end of the upper surface of the outer shell 15 is provided with a reserved opening, so that the robotic arm 14 can extend from the reserved opening and put the collected garbage bottles into into the trash can 16 fixed in the middle of the upper surface of the casing 15, and the lidar 18 is fixed at the other end of the upper surface;

机械臂14末端装载双目视觉摄像头19,与机械臂14共同构成手眼系统,用于清捡垃圾瓶;The end of the robotic arm 14 is equipped with a binocular vision camera 19, which together with the robotic arm 14 constitutes a hand-eye system for picking up garbage bottles;

微型主机5包括有神经网络芯片,所述神经网络芯片用于根据所述激光雷达18和所述双目视觉摄像头19获取的反馈信息判断待清捡目标是否为垃圾瓶。The micro host 5 includes a neural network chip, and the neural network chip is used to judge whether the object to be cleaned is a garbage bottle according to the feedback information obtained by the lidar 18 and the binocular vision camera 19 .

优选的,底板1上还设置有降压模块8、4G通信模块9、GPS模块10和电池11,机器人的内部如图3和图4所示;Preferably, the bottom plate 1 is also provided with a step-down module 8, a 4G communication module 9, a GPS module 10 and a battery 11, and the interior of the robot is shown in Figures 3 and 4;

微型主机5与开发板6、激光雷达18、机械臂14、双目视觉摄像头19、4G通信模块9和GPS模块10电连接,用于作为上位机通信并控制所有与微型主机5电连接的部件;The micro-host 5 is electrically connected to the development board 6 , the lidar 18 , the robotic arm 14 , the binocular vision camera 19 , the 4G communication module 9 and the GPS module 10 , and is used to communicate as a host computer and control all the components that are electrically connected to the micro-host 5 ;

外壳上15还固定有4G天线17,并与4G通信模块9电连接。A 4G antenna 17 is also fixed on the casing 15 and is electrically connected with the 4G communication module 9 .

优选的,步进电机驱动器7同时与开发板6和步进电机3电连接,并接收开发板6的脉冲信息,从而根据脉冲信息驱动步进电机3,并由所述步进电机3带动主动轮2进行移动。Preferably, the stepper motor driver 7 is electrically connected to the development board 6 and the stepper motor 3 at the same time, and receives the pulse information of the development board 6, so as to drive the stepper motor 3 according to the pulse information, and the stepper motor 3 drives the active Wheel 2 to move.

优选的,电池11通过降压模块8与步进电机驱动器7、微型主机5、激光雷达18和机械臂14电连接,并进行供电。Preferably, the battery 11 is electrically connected to the stepper motor driver 7 , the micro-host 5 , the lidar 18 and the robotic arm 14 through the step-down module 8 , and supplies power.

优选的,垃圾瓶清捡机器人还包括WIFI模块,Preferably, the garbage bottle cleaning robot further includes a WIFI module,

WIFI模块与微型主机5电连接,用于远程通信。The WIFI module is electrically connected with the micro host 5 for remote communication.

本发明的实施例还提供一种垃圾瓶清捡机器人的控制方法,基于机器人系统框架ROS进行设计,控制上述的任一种垃圾瓶清捡机器人,如图2所示,方法包括:An embodiment of the present invention also provides a control method for a garbage bottle cleaning robot, which is designed based on the robot system framework ROS to control any of the above garbage bottle cleaning robots, as shown in FIG. 2 , the method includes:

S1、机器人的所述微型主机通过所述激光雷达获得工作区域的地图;S1. The micro-host of the robot obtains a map of the working area through the lidar;

S2、所述微型主机在所述工作区域上自动规划路线巡检;S2, the micro-host automatically plans a route inspection on the working area;

S3、所述神经网络芯片控制所述激光雷达和所述双目视觉摄像头在巡检的过程中识别垃圾瓶;S3, the neural network chip controls the lidar and the binocular vision camera to identify garbage bottles during the inspection process;

S4、所述激光雷达结合所述GPS模块测算所述垃圾瓶相对所述机器人在地图上的坐标;S4, the lidar combined with the GPS module to measure the coordinates of the garbage bottle relative to the robot on the map;

S5、所述机器人行驶至所述垃圾瓶的所在位置;S5, the robot travels to the location of the garbage bottle;

S6、所述双目视觉摄像头测算所述垃圾瓶与机械臂的相对位置信息;S6, the binocular vision camera measures the relative position information of the garbage bottle and the robotic arm;

S7、所述微型主机控制所述机械臂捡起所述垃圾瓶并放入垃圾篓,并继续进行巡检。S7. The micro-host controls the robotic arm to pick up the garbage bottle and put it into the garbage basket, and continue to perform inspection.

优选的,所述一种垃圾瓶清捡机器人的控制方法还包括:Preferably, the control method for the garbage bottle cleaning robot further includes:

微型主机通过与微型主机电连接的所述WIFI模块或4G模块与远程控制器进行通信,所述通信包括:接收所述远程控制器发出的远程控制信号,或发送周边环境障碍物信息、机器人定位信息和机器人视野信息给所述远程控制器。The micro-host communicates with the remote controller through the WIFI module or 4G module electrically connected to the micro-host, and the communication includes: receiving a remote control signal sent by the remote controller, or sending information on obstacles in the surrounding environment, robot positioning information and robot field of view information to the remote controller.

优选的,所述步骤S3包括:Preferably, the step S3 includes:

神经网络芯片根据所述激光雷达和所述双目视觉摄像头的反馈信息,构建神经网络进行训练,并识别所述垃圾瓶的形状和材质。The neural network chip constructs a neural network for training according to the feedback information of the lidar and the binocular vision camera, and recognizes the shape and material of the garbage bottle.

可选的,激光雷达和双目视觉摄像头分别通过反馈信息构建相应的训练集和验证集,并构建神经网络进行训练,通过人工智能图像识别技术识别垃圾瓶的形状,判断目标是否为垃圾瓶。还可以通过激光雷达和双目视觉摄像头一起进行神经网络训练,以进一步提高对垃圾瓶材质判断的准确率,并实现精准捡拾塑料瓶或玻璃瓶的效果。Optionally, the lidar and binocular vision cameras respectively construct corresponding training sets and verification sets through feedback information, and construct a neural network for training, identify the shape of the garbage bottle through artificial intelligence image recognition technology, and determine whether the target is a garbage bottle. Neural network training can also be performed together with lidar and binocular vision cameras to further improve the accuracy of judging the material of garbage bottles, and achieve the effect of accurately picking up plastic or glass bottles.

上述实施例中涉及到的细胞神经网络或卷积神经网络(Cellular/ConvolutionalNeural Networks,CNN)芯片,在实际具体实施中,也可以替换为其它机器视觉识别芯片,例如基于浅度学习(Shallow Learning)的机器视觉识别芯片、基于自动编码器(AutoEncoder)、稀疏编码(Sparse Coding)、限制玻尔兹曼机(RestrictedBoltzmannMachine,RBM)、深信度网络(Deep Belief Networks)等深度学习(Deep Learning)算法的机器视觉识别芯片。The cellular neural network or convolutional neural network (Cellular/ConvolutionalNeural Networks, CNN) chip involved in the above-mentioned embodiment can also be replaced with other machine vision recognition chips in actual implementation, for example, based on shallow learning (Shallow Learning) based on deep learning algorithms such as AutoEncoder, Sparse Coding, Restricted Boltzmann Machine (RBM), and Deep Belief Networks. Machine vision recognition chip.

本发明的实施例还提供一种垃圾瓶清捡机器人的控制系统,基于机器人系统框架ROS进行设计,控制上述的任一种垃圾瓶清捡机器人,包括:An embodiment of the present invention also provides a control system for a garbage bottle cleaning robot, which is designed based on the robot system framework ROS to control any of the above garbage bottle cleaning robots, including:

地图服务节点,用于通过所述激光雷达获得工作区域的地图;a map service node, used to obtain a map of the work area through the lidar;

路径规划节点,用于通过所述微型主机在工作区域上自动规划路线巡检;A path planning node, used for automatically planning a route inspection on the work area through the micro-host;

神经网络节点,用于通过所述神经网络芯片控制所述激光雷达和双目视觉摄像头在巡检的过程中识别垃圾瓶;A neural network node, used to control the lidar and binocular vision camera to identify garbage bottles during the inspection process through the neural network chip;

GPS节点,用于通过所述GPS模块和所述激光雷达测算所述垃圾瓶相对所述机器人在地图上的坐标;The GPS node is used to measure the coordinates of the garbage bottle relative to the robot on the map through the GPS module and the lidar;

电机控制节点,用于行驶至所述垃圾瓶的位置;a motor control node for driving to the position of the garbage bottle;

摄像头节点,用于通过所述双目视觉摄像头测算所述垃圾瓶与所述机械臂的相对位置信息;a camera node, used to measure the relative position information of the garbage bottle and the robotic arm through the binocular vision camera;

机械臂节点,用于通过所述微型主机控制所述机械臂捡起所述垃圾瓶并放入垃圾篓,并继续进行巡检。The robotic arm node is used to control the robotic arm to pick up the garbage bottle and put it into the garbage basket through the micro-host, and continue the inspection.

在一个具体的实施例中,各节点基于机器人系统框架ROS进行设计,具体节点通信示意图如图5所示:In a specific embodiment, each node is designed based on the robot system framework ROS, and a schematic diagram of specific node communication is shown in Figure 5:

电机控制节点处理速度命令,并根据速度命令向下位机输出脉冲信号。该节点会订阅路径规划节点或远程控制节点发布的cmd_vel话题,话题的具体消息格式主要为:The motor control node processes the speed command and outputs a pulse signal to the lower computer according to the speed command. The node will subscribe to the cmd_vel topic published by the path planning node or the remote control node. The specific message format of the topic is mainly:

Vector3 linearVector3 linear

Vector3 angularVector3 angular

Vector3在ROS系统框架中的定义为:Vector3 is defined in the ROS system framework as:

float32 xfloat32x

float32 yfloat32 y

float32 zfloat32z

该话题包含机器人在空间坐标系中x、y、z三个方向的线速度和角速度。电机控制节点接收话题后将速度解算成两主动轮分别的转速,然后进一步转换为脉冲频率,控制下位机引脚的脉冲信号,从而驱动电机。This topic covers the linear and angular velocities of the robot in the three directions of x, y, and z in the space coordinate system. After receiving the topic, the motor control node calculates the speed into the respective rotation speeds of the two driving wheels, and then further converts it into a pulse frequency to control the pulse signal of the pin of the lower computer, thereby driving the motor.

在一个具体的实施例中,地图服务节点将SLAM所得地图以map话题发布,map话题的主要消息格式如下:In a specific embodiment, the map service node publishes the map obtained by SLAM as a map topic, and the main message format of the map topic is as follows:

MapMetaData infoMapMetaData info

int8[]dataint8[]data

该话题包含地图的元数据、占用概率。This topic contains the metadata of the map, the probability of occupancy.

在一个具体的实施例中,GPS节点发布odom话题,odom话题消息格式主要为:In a specific embodiment, the GPS node publishes the odom topic, and the odom topic message format is mainly:

geometry_msgs/PoseWithCovariance posegeometry_msgs/PoseWithCovariance pose

该话题包含机器人的位置信息,GPS节点将GPS提供的经纬度坐标在SLAM所得地图上标定转换后,发布odom话题。This topic contains the location information of the robot, and the GPS node publishes the odom topic after calibrating and converting the latitude and longitude coordinates provided by GPS on the map obtained by SLAM.

在一个具体的实施例中,摄像头节点通过compressed_image话题发布拍摄的图像信息,通过一个训练的网络进行识别塑料瓶,实时监测视野中是否有塑料瓶垃圾,若检测出目标,则利用双目的视差测算出该目标的距离,计算出目标在SLAM所得地图上的坐标,发布move_goal动作请求,待接收到请求完成的反馈信息后,进一步测出目标与机器人相对位置,发出grip_goal动作请求。在未检测到目标时,随机生成可到达的目标点,发送move_goal请求。In a specific embodiment, the camera node publishes the captured image information through the compressed_image topic, identifies plastic bottles through a trained network, monitors whether there is plastic bottle garbage in the field of view in real time, and uses binocular parallax if a target is detected. Measure the distance of the target, calculate the coordinates of the target on the map obtained by SLAM, and issue a move_goal action request. After receiving the feedback information of the completion of the request, further measure the relative position of the target and the robot, and issue a grip_goal action request. When no target is detected, randomly generate a reachable target point and send a move_goal request.

compressed_image的主要消息格式为:The main message format of compressed_image is:

string formatstring format

uint8[]datauint8[]data

该话题包含图像数据的格式,图像的缓冲数据。This topic contains the format of the image data, the buffered data of the image.

move_goal的主要消息格式为:The main message format of move_goal is:

float64 xfloat64x

float64 yfloat64 y

float64 zfloat64 z

该动作消息表示目标点在SLAM地图上的位置坐标。The action message indicates the location coordinates of the target point on the SLAM map.

grip_goal的消息格式为:The message format of grip_goal is:

float64 xfloat64x

float64 yfloat64 y

float64 zfloat64 z

float64 wfloat64 w

包含了目标相对于机器人的坐标,以及目标的姿态。Contains the coordinates of the target relative to the robot and the pose of the target.

在一个具体的实施例中,机械臂节点接收grip_goal动作请求后,通过逆运动学出机械臂的目标姿态,控制机械臂运动,抓取目标,放入垃圾篓,然后反馈完成信息给摄像头节点。In a specific embodiment, after receiving the grip_goal action request, the robot arm node learns the target posture of the robot arm through inverse kinematics, controls the movement of the robot arm, grabs the target, puts it in the trash, and then feeds back the completion information to the camera node.

在一个具体的实施例中,路径规划节点是ROS中提供的路径规划节点,包含全局规划和局部规划节点,路径规划节点订阅tf、odom、scan、map话题,在收到move_goal动作请求后,通过全局规划规划出到达目标点的总体路径,再由局部规划规划出每一小段路程的行驶速度,实现实时避障,将速度通过cmd_vel话题发布,在到达目标点附近后,反馈完成信息给摄像头节点。路径规划节点还会对SLAM地图进行更新。In a specific embodiment, the path planning node is a path planning node provided in ROS, including global planning and local planning nodes. The path planning node subscribes to tf, odom, scan, and map topics. The overall path to the target point is planned by the global planning, and the driving speed of each short distance is planned by the local planning to achieve real-time obstacle avoidance. The speed is published through the cmd_vel topic. After reaching the vicinity of the target point, the completion information is fed back to the camera node. . The path planning node also updates the SLAM map.

优选的,系统还包括:Preferably, the system further includes:

激光雷达节点,用于将激光雷达扫描出的障碍物信息发布给路径规划节点,或将扫描出的垃圾瓶信息发布给神经网络节点。The lidar node is used to publish the obstacle information scanned by the lidar to the path planning node, or publish the scanned garbage bottle information to the neural network node.

机器人姿态发布节点,用于向各节点发布机器人各传感器和部件的坐标变换,例如将激光测距传感器的数值发送给微型主机进行处理。The robot attitude publishing node is used to publish the coordinate transformation of each sensor and component of the robot to each node, such as sending the value of the laser ranging sensor to the micro-host for processing.

在一个具体的实施例中,激光雷达节点负责将雷达扫描出的障碍物信息发布给路径规划节点,发布scan话题,该话题的消息格式主要为:In a specific embodiment, the lidar node is responsible for publishing the obstacle information scanned by the radar to the path planning node, and publishing the scan topic. The message format of the topic is mainly:

Header headerHeader header

float32 angel_minfloat32 angel_min

float32 angle_maxfloat32 angle_max

float32 angle_incrementfloat32 angle_increment

float32 time_incrementfloat32 time_increment

float32 scan_timefloat32 scan_time

float32 range_minfloat32 range_min

float32 range_maxfloat32 range_max

float32[]rangesfloat32[]ranges

float32[]intensitiesfloat32[]intensities

该话题包含扫描顺序增加的id序列,激光数据的时间戳,扫描数据的名字,开始扫描的角度,结束扫描的角度,每次扫描增加的角度,测量的时间间隔,扫描的时间间隔,测距的最小值,测距的最大值,一周的障碍物距离,光的强度。这些话题消息首先会用于SLAM,以构建机器人周围环境的地图,SLAM在ROS中有功能包,可直接调用,该地图以栅格图的形式表示,用于导航中的全局规划。该话题也会由路径规划节点订阅,用于导航中的局部规划以及更新地图。This topic contains the sequence of increasing id's in the scan order, the time stamp of the laser data, the name of the scan data, the angle to start the scan, the angle to end the scan, the angle to increase for each scan, the measurement interval, the scan interval, and the ranging. The minimum value of , the maximum value of ranging, the obstacle distance of a week, and the intensity of light. These topic messages will first be used in SLAM to build a map of the robot's surrounding environment. SLAM has a function package in ROS that can be called directly. The map is represented in the form of a grid map for global planning in navigation. This topic is also subscribed by the route planning node, which is used for local planning in navigation and updating the map.

在一个具体的实施例中,机器人姿态发布节点发布tf话题,该话题的消息格式主要为:In a specific embodiment, the robot gesture publishing node publishes a tf topic, and the message format of the topic is mainly:

Transform tf::TransformTransform tf::Transform

该话题包含机器人各部件、传感器的坐标变换数据。This topic includes coordinate transformation data of robot parts and sensors.

优选的,系统还包括:Preferably, the system further includes:

通信节点,用于通过所述微型主机通过与微型主机电连接的所述WIFI模块或4G模块与远程控制器进行通信,所述通信包括:接收所述远程控制器发出的远程控制信号,或发送周边环境障碍物信息、机器人定位信息和机器人视野信息给所述远程控制器。A communication node for communicating with a remote controller through the micro-host through the WIFI module or 4G module electrically connected to the micro-host, and the communication includes: receiving a remote control signal sent by the remote controller, or sending Surrounding environment obstacle information, robot positioning information and robot vision information are sent to the remote controller.

优选的,所述远程控制器可以是工业机器人控制器,也可以是手机APP,可以通过微型主机连接的WIFI模块或4G模块与机器人的通信节点通信,可人为控制机器人行驶,接收机器人激光雷达,GPS模块和双目视觉摄像头模块等发布的信息,在室内外均能远程控制机器人。Preferably, the remote controller can be an industrial robot controller or a mobile phone APP, which can communicate with the communication node of the robot through the WIFI module or 4G module connected to the micro-host, and can manually control the robot to drive and receive the robot lidar, The information released by the GPS module and binocular vision camera module can remotely control the robot both indoors and outdoors.

本发明还提供一种电子设备,所述设备包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时实现上述方法实施例中记载的任何一种垃圾瓶清捡机器人的控制方法的部分或全部步骤。The present invention also provides an electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that the processor executes the computer program At the same time, some or all of the steps of the control method of any garbage bottle cleaning robot described in the above method embodiments are realized.

本发明还提供一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现上述方法实施例中记载的任何一种垃圾瓶清捡机器人的控制方法的部分或全部步骤。The present invention further provides a computer-readable storage medium storing a computer program, characterized in that, when the computer program is executed by a processor, any one of the garbage bottles described in the foregoing method embodiments is implemented. Part or all of the steps of the control method of the pick-up robot.

上述所有可选技术方案,可以采用任意结合形成本公开的可选实施例,在此不再一一赘述。All the above-mentioned optional technical solutions can be combined arbitrarily to form optional embodiments of the present disclosure, which will not be repeated here.

本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的方法步骤,能够以电子硬件、计算机软件或者二者的结合来实现,为了清楚地说明硬件和软件的可互换性,在上述说明中已经按照功能一般性地描述了各示例的组成及步骤。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本发明的范围。Those skilled in the art can realize that the method steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two, in order to clearly illustrate the interoperability of hardware and software Alternatively, the components and steps of each example have been described generally in terms of functionality in the foregoing description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of the present invention.

以上,仅为本发明的具体实施方式,但本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到各种等效的修改或替换,这些修改或替换都应涵盖在本发明的保护范围之内。因此,本发明的保护范围应以权利要求的保护范围为准。The above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of various equivalent modifications or modifications within the technical scope disclosed by the present invention. Replacement, these modifications or replacements should all be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be subject to the protection scope of the claims.

Claims (10)

1. The utility model provides a clear robot of picking up of garbage bottle which characterized in that includes: the robot comprises a bottom plate (1), a middle-layer partition plate (12), a shell (15), a mechanical arm (14) and a micro host (5), wherein a driving wheel (2), a stepping motor (3) and a universal driven wheel (4) are arranged on the lower surface of the bottom plate (1), the micro host (5), a development board (6) and a stepping motor driver (7) are arranged on the upper surface of the bottom plate (1), the stepping motor driver (7) is used for driving the stepping motor (3) to further drive the driving wheel (2) to control the robot to move, and the micro host (5) is electrically connected with the development board (6) and used as an upper computer to control the development board (6) as a lower computer;
the middle layer clapboard (12) is fixedly connected to the bottom plate (1) through a connecting column (13), and the mechanical arm (14) is fixedly connected to one end of the upper surface of the middle layer clapboard (12);
the shell (15) is fixed on the bottom plate (1) and wraps the middle layer partition plate (12), a reserved opening is formed in one end of the upper surface of the shell (15), so that the mechanical arm (14) can extend out of the reserved opening to put the cleaned garbage bottle into a garbage basket (16) fixed in the middle of the upper surface of the shell (15), and a laser radar (18) is fixed to the other end of the upper surface;
a binocular vision camera (19) is mounted at the tail end of the mechanical arm (14), and the mechanical arm (14) and the binocular vision camera form a hand-eye system which is used for cleaning the garbage bottles;
the micro host (5) comprises a neural network chip, and the neural network chip is used for judging whether the target to be picked up is a garbage bottle or not according to feedback information acquired by the laser radar (18) and the binocular vision camera (19).
2. The trash bottle picking robot of claim 1,
the bottom plate (1) is also provided with a voltage reduction module (8), a 4G communication module (9), a GPS module (10) and a battery (11);
the micro host (5) is electrically connected with the development board (6), the laser radar (18), the mechanical arm (14), the binocular vision camera (19), the 4G communication module (9) and the GPS module (10) and used for being used as a host computer for communication and controlling all parts electrically connected with the micro host (5);
and a 4G antenna (17) is also fixed on the shell (15) and is electrically connected with the 4G communication module (9).
3. The trash bottle picking robot of claim 2,
step motor driver (7) simultaneously with develop board (6) with step motor (3) electricity is connected, and the receipt the pulse information of development board (6), thereby according to pulse information drive step motor (3), and by step motor (3) drive action wheel (2) move.
4. The trash bottle picking robot of claim 3,
the battery (11) is electrically connected with the stepping motor driver (7), the micro host (5), the laser radar (18) and the mechanical arm (14) through the voltage reduction module (8) and supplies power.
5. The trash bottle picking robot of claim 4, further comprising a WIFI module,
the WIFI module is electrically connected with the micro host (5) and used for remote communication.
6. A control method of a clear garbage bottle picking robot, designed based on a robot system framework ROS, for controlling the clear garbage bottle picking robot according to any one of claims 1-5, comprising:
s1, the micro host of the robot obtains a map of a working area through a laser radar;
s2, automatically planning a route for inspection on the working area by the micro host;
s3, the neural network chip controls the laser radar and the binocular vision camera to identify the trash bottle in the inspection process;
s4, the laser radar is combined with the GPS module to measure and calculate the coordinates of the garbage bottles on a map relative to the robot;
s5, the robot drives to the position of the garbage bottle;
s6, the binocular vision camera measures and calculates the relative position information of the garbage bottle and the mechanical arm;
and S7, the micro host controls the mechanical arm to pick up the trash bottle and place the trash bottle into a trash basket, and the inspection is continued.
7. The method for controlling the trash bottle picking robot according to claim 6, further comprising:
the micro host communicates with the remote controller through a WIFI module or a 4G module electrically connected with the micro host, and the communication comprises: and receiving a remote control signal sent by the remote controller, or sending surrounding environment obstacle information, robot positioning information and robot vision information to the remote controller.
8. The method for controlling a trash bottle picking robot according to claim 6, wherein the step S3 includes:
and the neural network chip constructs a neural network for training according to the feedback information of the laser radar and the binocular vision camera, and identifies the shape and the material of the garbage bottle.
9. A control system of a clear garbage bottle picking robot, designed based on a robot system framework ROS, for controlling the clear garbage bottle picking robot according to any one of claims 1-5, comprising:
the map service node is used for obtaining a map of a working area through the laser radar;
the path planning node is used for automatically planning a route to patrol on a working area through the micro host;
the neural network node is used for controlling the laser radar and the binocular vision camera to identify the garbage bottle in the routing inspection process through the neural network chip;
the GPS node is used for measuring and calculating the coordinates of the garbage bottle on a map relative to the robot through the GPS module and the laser radar;
the motor control node is used for driving to the position of the garbage bottle;
the camera node is used for measuring and calculating the relative position information of the garbage bottle and the mechanical arm through the binocular vision camera;
and the mechanical arm node is used for controlling the mechanical arm to pick up the garbage bottle and put the garbage bottle into the garbage basket through the micro host, and continuously performing routing inspection.
10. The control system of the trash can picking robot of claim 9, further comprising:
the communication node is used for communicating with a remote controller through the WIFI module or the 4G module which is electrically connected with the micro-host through the micro-host, and the communication node comprises: and receiving a remote control signal sent by the remote controller, or sending surrounding environment obstacle information, robot positioning information and robot vision information to the remote controller.
CN202010698942.7A 2020-07-20 2020-07-20 Garbage bottle picking robot and control method Active CN111823212B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010698942.7A CN111823212B (en) 2020-07-20 2020-07-20 Garbage bottle picking robot and control method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010698942.7A CN111823212B (en) 2020-07-20 2020-07-20 Garbage bottle picking robot and control method

Publications (2)

Publication Number Publication Date
CN111823212A true CN111823212A (en) 2020-10-27
CN111823212B CN111823212B (en) 2024-11-15

Family

ID=72923583

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010698942.7A Active CN111823212B (en) 2020-07-20 2020-07-20 Garbage bottle picking robot and control method

Country Status (1)

Country Link
CN (1) CN111823212B (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112207845A (en) * 2020-11-06 2021-01-12 天津科技大学 Robot for automatically sorting, transporting and putting garbage
CN112372645A (en) * 2020-11-10 2021-02-19 广东电网有限责任公司 Robot for power distribution station
CN112757270A (en) * 2021-02-08 2021-05-07 深圳市壹通道科技有限公司 Multimedia message auditing robot
CN113829363A (en) * 2021-09-16 2021-12-24 武汉工程大学 Intelligent inspection robot and inspection method for 5G base station data center
CN114193425A (en) * 2022-02-18 2022-03-18 浙江博城机器人科技有限公司 Inspection device and method based on visual detection
CN114872010A (en) * 2022-06-21 2022-08-09 安徽信息工程学院 Intelligent unmanned carrying device based on neural network algorithm
CN115890677A (en) * 2022-11-29 2023-04-04 中国农业大学 Dead chicken picking robot for standardized cage chicken house and method thereof
WO2023050641A1 (en) * 2021-09-30 2023-04-06 上海仙途智能科技有限公司 Remote control over driverless sweeping vehicle
CN117921622A (en) * 2024-03-25 2024-04-26 宁波昂霖智能装备有限公司 Control method of robot for picking up garbage and robot for picking up garbage

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN206194270U (en) * 2016-09-20 2017-05-24 成都钻天猴科技有限责任公司 Educational machine people is built to multi -functional intention
CN108834576A (en) * 2018-06-07 2018-11-20 华南农业大学 A kind of citrus picking robot and its implementation based on binocular vision
CN109079743A (en) * 2018-09-17 2018-12-25 张石磊 It is a kind of to pick up rubbish robot automatically
KR101974641B1 (en) * 2018-05-14 2019-08-23 하천용 Intergrated system for optimizing wast managemrnt by self guided AI robot
CN110924340A (en) * 2019-11-25 2020-03-27 武汉思睿博特自动化系统有限公司 Mobile robot system for intelligently picking up garbage and implementation method
CN212497738U (en) * 2020-07-20 2021-02-09 武汉工程大学 A garbage bottle cleaning robot

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN206194270U (en) * 2016-09-20 2017-05-24 成都钻天猴科技有限责任公司 Educational machine people is built to multi -functional intention
KR101974641B1 (en) * 2018-05-14 2019-08-23 하천용 Intergrated system for optimizing wast managemrnt by self guided AI robot
CN108834576A (en) * 2018-06-07 2018-11-20 华南农业大学 A kind of citrus picking robot and its implementation based on binocular vision
CN109079743A (en) * 2018-09-17 2018-12-25 张石磊 It is a kind of to pick up rubbish robot automatically
CN110924340A (en) * 2019-11-25 2020-03-27 武汉思睿博特自动化系统有限公司 Mobile robot system for intelligently picking up garbage and implementation method
CN212497738U (en) * 2020-07-20 2021-02-09 武汉工程大学 A garbage bottle cleaning robot

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
张涛: ""机器人概论"", 30 September 2019, 机械工业出版社, pages: 18 - 20 *
郝丽娜: ""工业机器人控制技术"", 30 November 2018, 华中科技大学出版社, pages: 170 - 171 *

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112207845A (en) * 2020-11-06 2021-01-12 天津科技大学 Robot for automatically sorting, transporting and putting garbage
CN112372645A (en) * 2020-11-10 2021-02-19 广东电网有限责任公司 Robot for power distribution station
CN112757270A (en) * 2021-02-08 2021-05-07 深圳市壹通道科技有限公司 Multimedia message auditing robot
CN113829363A (en) * 2021-09-16 2021-12-24 武汉工程大学 Intelligent inspection robot and inspection method for 5G base station data center
WO2023050641A1 (en) * 2021-09-30 2023-04-06 上海仙途智能科技有限公司 Remote control over driverless sweeping vehicle
CN114193425A (en) * 2022-02-18 2022-03-18 浙江博城机器人科技有限公司 Inspection device and method based on visual detection
CN114193425B (en) * 2022-02-18 2022-05-17 浙江博城机器人科技有限公司 Inspection device and method based on visual detection
CN114872010A (en) * 2022-06-21 2022-08-09 安徽信息工程学院 Intelligent unmanned carrying device based on neural network algorithm
CN115890677A (en) * 2022-11-29 2023-04-04 中国农业大学 Dead chicken picking robot for standardized cage chicken house and method thereof
CN115890677B (en) * 2022-11-29 2024-06-11 中国农业大学 Dead chicken picking robot for standardized cage chicken house and method thereof
CN117921622A (en) * 2024-03-25 2024-04-26 宁波昂霖智能装备有限公司 Control method of robot for picking up garbage and robot for picking up garbage
CN117921622B (en) * 2024-03-25 2024-06-04 宁波昂霖智能装备有限公司 Control method of robot for picking up garbage and robot for picking up garbage

Also Published As

Publication number Publication date
CN111823212B (en) 2024-11-15

Similar Documents

Publication Publication Date Title
CN111823212A (en) A garbage bottle cleaning robot and control method
CN111331612A (en) An intelligent long-arm disinfection robot based on vision system
CN109900280A (en) A kind of livestock and poultry information Perception robot and map constructing method based on independent navigation
CN114847803A (en) Robot positioning method and device, electronic equipment, storage medium
CN108177149A (en) Movable mechanical arm control system and method based on MR and motion planning technology
CN112728293A (en) Intelligent pipeline detection robot and control method thereof
CN115299245B (en) A control method and control system for an intelligent fruit picking robot
Gowda et al. Industrial Automated Multipurpose Robot Using WIFI
CN114080905B (en) Picking method based on digital twins and cloud picking robot system
CN211324756U (en) Intelligent cleaning robot
CN106964121A (en) A kind of intelligent patrol detection picks up the device of table tennis
CN107450556A (en) ROS-based autonomous navigation intelligent wheelchair
CN109144044A (en) The robot autonomous navigation of one kind and kinetic control system and method
CN106679661A (en) Simultaneous localization and mapping system and method assisted by search and rescue robot arms
CN110604518A (en) Sweeping robot and control method for sweeping robot
CN211022482U (en) Cleaning robot
CN108388180B (en) A control system for a pipeline inspection and cleaning robot
CN108536146A (en) The intelligent control method of localization for Mobile Robot recharging base based on path and RSSI
CN115599103A (en) Explosion-proof intelligent inspection robot system for petrochemical field
CN212683969U (en) An orchard multi-robot physical model
CN210990015U (en) Floor sweeping robot
CN107962546A (en) A kind of image recognition element follows pickup robot
CN210819526U (en) Mechanical arm autonomous navigation moving system
CN216697069U (en) Mobile Robot Control System Based on ROS2
CN115890677B (en) Dead chicken picking robot for standardized cage chicken house and method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant