CN109853379B - Cable-stayed bridge cable detection robot based on visual detection - Google Patents
Cable-stayed bridge cable detection robot based on visual detection Download PDFInfo
- Publication number
- CN109853379B CN109853379B CN201910256434.0A CN201910256434A CN109853379B CN 109853379 B CN109853379 B CN 109853379B CN 201910256434 A CN201910256434 A CN 201910256434A CN 109853379 B CN109853379 B CN 109853379B
- Authority
- CN
- China
- Prior art keywords
- cable
- frame
- gear train
- transmission mechanism
- robot
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 30
- 230000000007 visual effect Effects 0.000 title abstract description 5
- 230000007246 mechanism Effects 0.000 claims abstract description 92
- 230000005540 biological transmission Effects 0.000 claims abstract description 57
- 238000003825 pressing Methods 0.000 claims abstract description 29
- 230000009194 climbing Effects 0.000 claims abstract description 18
- 230000001360 synchronised effect Effects 0.000 claims abstract description 12
- 238000007689 inspection Methods 0.000 claims description 12
- 238000011179 visual inspection Methods 0.000 claims description 8
- 229910052782 aluminium Inorganic materials 0.000 claims description 7
- XAGFODPZIPBFFR-UHFFFAOYSA-N aluminium Chemical group [Al] XAGFODPZIPBFFR-UHFFFAOYSA-N 0.000 claims description 7
- WHXSMMKQMYFTQS-UHFFFAOYSA-N Lithium Chemical compound [Li] WHXSMMKQMYFTQS-UHFFFAOYSA-N 0.000 claims description 6
- 229910052744 lithium Inorganic materials 0.000 claims description 6
- 239000000463 material Substances 0.000 claims description 5
- 238000009434 installation Methods 0.000 claims description 2
- 229920002635 polyurethane Polymers 0.000 claims description 2
- 239000004814 polyurethane Substances 0.000 claims description 2
- 230000000694 effects Effects 0.000 abstract description 14
- 230000006835 compression Effects 0.000 description 7
- 238000007906 compression Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 7
- 238000012423 maintenance Methods 0.000 description 5
- 230000036316 preload Effects 0.000 description 5
- 238000000034 method Methods 0.000 description 4
- 230000007547 defect Effects 0.000 description 3
- 230000017525 heat dissipation Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000001816 cooling Methods 0.000 description 2
- 230000009193 crawling Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 229910052751 metal Inorganic materials 0.000 description 2
- 239000002184 metal Substances 0.000 description 2
- 230000002572 peristaltic effect Effects 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 239000000725 suspension Substances 0.000 description 2
- 229910001094 6061 aluminium alloy Inorganic materials 0.000 description 1
- 241001292396 Cirrhitidae Species 0.000 description 1
- 229910000831 Steel Inorganic materials 0.000 description 1
- 206010044565 Tremor Diseases 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 244000145845 chattering Species 0.000 description 1
- 239000011248 coating agent Substances 0.000 description 1
- 238000000576 coating method Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 238000004146 energy storage Methods 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 235000001968 nicotinic acid Nutrition 0.000 description 1
- 230000008855 peristalsis Effects 0.000 description 1
- 238000012797 qualification Methods 0.000 description 1
- 239000010959 steel Substances 0.000 description 1
- 238000012876 topography Methods 0.000 description 1
Landscapes
- Manipulator (AREA)
- Toys (AREA)
Abstract
Description
技术领域Technical field
本发明属于检测机器人技术领域,具体涉及一种基于视觉检测的斜拉桥缆索检测机器人。The invention belongs to the technical field of detection robots, and specifically relates to a cable-stayed bridge cable detection robot based on visual detection.
背景技术Background technique
拉索类桥梁因跨度大、造型美观、经济适用等特点,被广泛应用。斜拉桥尺寸的增大带来了桥梁检测方面的一系列问题,其中对缆索的检测非常重要,缆索是斜拉桥上的主要承重构件,它的可靠性直接影响了桥梁的安全性。为了确保缆索的安全使用,需要定时对缆索的安全性能进行检测和维护。Cable bridges are widely used due to their large span, beautiful appearance, economical and practical characteristics. The increase in the size of cable-stayed bridges has brought about a series of problems in bridge detection, among which the detection of cables is very important. Cables are the main load-bearing components of cable-stayed bridges, and their reliability directly affects the safety of the bridge. In order to ensure the safe use of cables, the safety performance of the cables needs to be tested and maintained regularly.
目前,国内外使用缆索维护的方法主要有两种,一种是针对小型斜拉桥使用的液压升降平台进行缆索维护,另一种是利用预先装在塔顶的吊点。用钢丝拖动吊篮搭载工作人员沿缆索进行维护。这两种应用于工程实际的缆索维护方式,主要由人工检测。不仅效率低下,而且难以保障人员安全。人工检测已不再实用,使用工业机器人代替人工检测缆索成为必然趋势,在实际工程应用中有着重要的价值。At present, there are two main methods of cable maintenance at home and abroad. One is to perform cable maintenance on a hydraulic lifting platform used in small cable-stayed bridges, and the other is to use lifting points pre-installed on the top of the tower. Use steel wire to drag the hanging basket to carry workers along the cable for maintenance. These two cable maintenance methods used in actual engineering are mainly inspected manually. Not only is it inefficient, but it is also difficult to ensure personnel safety. Manual inspection is no longer practical. The use of industrial robots to replace manual inspection of cables has become an inevitable trend and has important value in practical engineering applications.
国内外针对斜拉索专用的检测机器人研究报道并不是很多,虽有研究,但真正实用的技术还没有,总的来说处于初期阶段。韩国成均馆大学针对悬索桥缆索爬行机器人做了一系列研究。研制出一款轮式爬行机器人,该机器人在爬行缆索时其稳定性好,轮式机器人速度快,效率高,更适合在大型悬索桥上使用。这款机器人对缆索的直径有一定的适应性,但结构比较复杂,重量较大。此款机器人由于结构复杂,重量较大,未能够大规模应用于桥梁检测中。上海交通大学研制出气动蠕动式缆索维护机器人。气动蠕动式采用仿生学的原理,利用了蠕动的方式爬升或下降。远距离输送空气,存在沿程压力损失,限制了机器人的爬升速度。机器人携带气体管线爬行到高空,管线的重量使得机器人容易偏心,限制了爬缆机器人的发挥,不适用于斜拉桥缆索检测。There are not many research reports on inspection robots dedicated to cable-stayed cables at home and abroad. Although there are studies, the truly practical technology is not yet available. Generally speaking, it is in its early stages. Sungkyunkwan University in South Korea has conducted a series of research on cable crawling robots for suspension bridges. A wheeled crawling robot has been developed. The robot has good stability when climbing cables. The wheeled robot is fast and efficient, and is more suitable for use on large suspension bridges. This robot has certain adaptability to the diameter of the cable, but its structure is complex and its weight is heavy. Due to its complex structure and heavy weight, this robot has not been widely used in bridge inspection. Shanghai Jiao Tong University has developed a pneumatic peristaltic cable maintenance robot. The pneumatic peristaltic type adopts the principle of bionics and uses peristalsis to climb or descend. When air is transported over long distances, there is pressure loss along the way, which limits the climbing speed of the robot. The robot carries the gas pipeline and crawls to high altitude. The weight of the pipeline makes the robot easy to eccentric, which limits the performance of the cable-climbing robot and is not suitable for cable-stayed bridge cable inspection.
现有爬缆机器人由于本体结构和控制系统难以满足杆径变化以及桥面与缆索之间倾角的变化,爬缆机器人多采用在缆索一侧爬缆,一侧夹紧,而且框架结构不对称,框架中心线与缆索轴线不重合,造成爬缆机器人产生偏心、机器人螺旋爬升等情况,现有爬缆机器人结构复杂、重量大,难以广泛应用于工程实际中。所采用的视觉检测系统较简易,不能实时融合多个视觉摄像头采集的图像并进行分析。Due to the body structure and control system of existing cable-climbing robots, it is difficult to cope with changes in rod diameter and changes in the inclination angle between the bridge deck and the cable. Cable-climbing robots mostly climb on one side of the cable and clamp it on one side, and the frame structure is asymmetrical. The centerline of the frame does not coincide with the axis of the cable, causing the cable-climbing robot to be eccentric and the robot to spiral. The existing cable-climbing robot has a complex structure and heavy weight, making it difficult to be widely used in engineering practice. The visual inspection system used is relatively simple and cannot fuse and analyze images collected by multiple visual cameras in real time.
发明内容Contents of the invention
本发明的目的在于克服现有技术的不足,提供一种基于视觉检测的斜拉桥缆索检测机器人,能够有效地解决现有技术中缆索检测机器人抱缆效果不佳、框架结构不对称,从而产生偏心、机器人螺旋爬升,并且无法自适应变杆径工作等问题。The purpose of the present invention is to overcome the shortcomings of the existing technology and provide a cable-stayed bridge cable detection robot based on visual detection, which can effectively solve the problem of poor cable holding effect and asymmetric frame structure of the cable detection robot in the existing technology. Problems such as eccentricity, robot spiral climbing, and inability to adaptively change rod diameter.
本发明的目的是这样实现的:一种基于视觉检测的斜拉桥缆索检测机器人,包括外框架及设于外框架内的压紧机构和轮系传动机构,所述外框架包括六块框架板,所述框架板依次连接围成六边形的外框架,间隔设置的框架板外侧面均设有上下对称布置的直线轴承,所述框架板的外侧面分别固定安装有电子元件和电池组;The object of the present invention is achieved as follows: a cable-stayed bridge cable inspection robot based on visual inspection, including an outer frame and a pressing mechanism and a gear train transmission mechanism located in the outer frame. The outer frame includes six frame plates. , the frame plates are connected in sequence to form a hexagonal outer frame, and the outer sides of the spaced frame plates are equipped with linear bearings arranged symmetrically up and down. Electronic components and battery packs are fixedly installed on the outer sides of the frame plates;
所述压紧机构设于间隔设置的框架板上,并沿框架板上下对称布置,其一端穿过框架板外的直线轴承,另一端抵触轮系传动机构,所述压紧机构的轴线在水平面上的投影呈Y形,沿周向均布,使压紧机构同时从三个方向对缆索压紧;The pressing mechanism is installed on spaced frame plates and is symmetrically arranged up and down along the frame plate. One end of the pressing mechanism passes through the linear bearing outside the frame plate, and the other end resists the gear train transmission mechanism. The axis of the pressing mechanism is on the horizontal plane. The projection on the cable is Y-shaped and evenly distributed along the circumferential direction, allowing the compression mechanism to compress the cable from three directions at the same time;
所述轮系传动机构设置于对称布置的压紧机构之间,轮系传动机构在水平面上的投影呈Δ形,沿周向均布设置三个,通过压紧机构将轮系传动机构压紧在缆索表面,轮系传动机构和压紧机构在水平面上的投影在围抱缆索时形成的内切圆直径变化范围为150mm~200mm,所述轮系传动机构包括壳体组件和设置于壳体组件内的滚轮装置和驱动电机,所述滚轮装置和驱动电机分别与壳体组件固接,滚轮装置由驱动电机驱动,三个驱动电机同步驱动滚轮装置实现轮系传动机构同时从三个方向同步爬缆;The wheel train transmission mechanism is arranged between symmetrically arranged pressing mechanisms. The projection of the wheel train transmission mechanism on the horizontal plane is Δ-shaped, and three are evenly distributed along the circumferential direction. The wheel train transmission mechanism is pressed on the cable through the pressing mechanism. On the surface, the diameter of the inscribed circle formed by the projection of the gear train transmission mechanism and the pressing mechanism on the horizontal plane when surrounding the cable ranges from 150mm to 200mm. The gear train transmission mechanism includes a housing assembly and is arranged in the housing assembly. The roller device and the drive motor are fixedly connected to the housing assembly respectively. The roller device is driven by the drive motor. The three drive motors drive the roller device synchronously to realize the gear train transmission mechanism to climb the cable synchronously from three directions at the same time. ;
所述缆索检测机器人还包括无线适配器,所述无线适配器用于接收电子元件发射的信号并与计算机连接,通过计算机遥控检测机器人,并对传输回来的图像进行实时处理;The cable detection robot also includes a wireless adapter. The wireless adapter is used to receive signals emitted by electronic components and connect to a computer, remotely control the detection robot through the computer, and perform real-time processing on the images transmitted back;
所述缆索检测机器人的框架板上部还设有摄像头,通过无线传输的方式将拍摄的图像视频数据传输回计算机。The cable detection robot is also equipped with a camera on the upper part of the frame plate, which transmits the captured image and video data back to the computer through wireless transmission.
采用六块框架板围合成六边形的外框架,利用六边形框架是对称形状,能够有效减轻框架系统质心与缆索轴线不重合而产生的偏心影响,并且框架板外表面易于对电子元件进行安装,具有便于散热、操作便捷、拆装迅速等特点。Six frame plates are used to form a hexagonal outer frame. The hexagonal frame is symmetrical, which can effectively reduce the eccentricity effect caused by the misalignment of the center of mass of the frame system and the cable axis. Moreover, the outer surface of the frame plate is easy to inspect electronic components. It has the characteristics of easy installation, easy heat dissipation, convenient operation, and quick disassembly and assembly.
进一步的,所述压紧机构包括导向杆、弹簧和用于调节弹簧预紧力的螺母,所述导向杆的一端伸出直线轴承后与螺母螺接,另一端伸入与轮系传动机构固定连接的轴承座后与轮系传动机构抵触,所述弹簧套设在导向杆上并置于框架板内侧与轴承座之间,通过导向杆导向,通过螺母调节弹簧预紧力使机器人在围抱缆索时,轮系传动机构抵紧缆索、实现爬缆。压紧机构通过弹簧沿着导向杆进行弹力预紧,通过螺母调节的方式使得预紧力调节在合适的范围内。Further, the compression mechanism includes a guide rod, a spring and a nut for adjusting the spring preload force. One end of the guide rod extends out of the linear bearing and is screwed to the nut, and the other end extends into the gear train transmission mechanism to be fixed. The connected bearing seat collides with the gear train transmission mechanism. The spring is sleeved on the guide rod and placed between the inside of the frame plate and the bearing seat. It is guided by the guide rod and the spring preload is adjusted by the nut so that the robot can surround it. When the cable is used, the gear train transmission mechanism presses against the cable to achieve cable climbing. The compression mechanism performs elastic preloading along the guide rod through a spring, and the preloading force is adjusted within an appropriate range by adjusting the nut.
进一步的,所述轮系传动机构的壳体组件包括L型导向杆支承板、L型电机安装板和翼板,所述导向杆支承板上下对称布置,电机安装板和翼板设于对称布置的导向杆支承板之间并相对设置,所述翼板沿竖向设置两块,导向杆支承板、电机安装板和翼板相互连接形成壳体;所述滚轮装置包括主动轮、从动轮和带座轴承,所述带座轴承对称设于主动轮、从动轮的转轴上,靠近翼板一侧的带座轴承与翼板固定连接,靠近电机安装板一侧的带座轴承与电机安装板固定连接,所述驱动电机固定于电机安装板并设于两块翼板之间,通过带传动为主动轮传递动力。通过压紧机构中弹簧的弹力将轮系传动机构压紧在缆索表面,一组传动机构通过一个驱动电机以带传动的方式进行动力传递。Further, the housing assembly of the gear train transmission mechanism includes an L-shaped guide rod support plate, an L-shaped motor mounting plate and a wing plate. The guide rod support plate is symmetrically arranged up and down, and the motor mounting plate and wing plates are arranged symmetrically. The guide rod support plates are arranged opposite each other, and two wing plates are arranged vertically. The guide rod support plate, the motor mounting plate and the wing plates are connected to each other to form a housing; the roller device includes a driving wheel, a driven wheel and a The seated bearing is symmetrically arranged on the rotating shaft of the driving wheel and the driven wheel. The seated bearing on the side close to the wing plate is fixedly connected to the wing plate. The seated bearing on the side close to the motor mounting plate is connected to the motor mounting plate. Fixed connection, the driving motor is fixed on the motor mounting plate and is located between two wing plates, and transmits power to the driving wheel through belt transmission. The gear train transmission mechanism is pressed against the surface of the cable by the elastic force of the spring in the compression mechanism, and a set of transmission mechanisms transmit power through a drive motor in the form of belt drive.
进一步的,所述框架板为铝板,框架板的左右两侧形成镂空,其中部开设有凹槽,安装有压紧机构的框架板凹槽内固定安装锂电池组,为驱动电机供电,其余框架板的凹槽内固定安装的电子元件为电机控制器和无线模块。采用铝板并且在两侧设置镂空、中间铣削形成凹槽,可实现机器人整体轻量化,铝板金属表面能够迅速导热,将部件工作时产生的热量迅速与外界环境相传导,起到散热降温的效果。Further, the frame plate is an aluminum plate. Hollows are formed on the left and right sides of the frame plate, and a groove is provided in the middle. A lithium battery pack is fixedly installed in the groove of the frame plate equipped with a pressing mechanism to power the drive motor. The remaining frames The electronic components fixedly installed in the grooves of the board are motor controllers and wireless modules. The use of aluminum plates with hollows on both sides and grooves milled in the middle can reduce the overall weight of the robot. The metal surface of the aluminum plate can quickly conduct heat, and the heat generated when the components are working can be quickly conducted to the external environment, thereby achieving a heat dissipation and cooling effect.
进一步的,所述框架板的上部还设有摄像头安装支架,用于紧固摄像头。Furthermore, the upper part of the frame plate is also provided with a camera mounting bracket for fastening the camera.
进一步的,所述电机控制器由计算机控制,实现三个驱动电机同步驱动。通过计算机控制三个控制器,达到三个驱动电机同步驱动的效果。三个电机同步驱动技术不仅提高机器人爬缆动力,而且避免了现有技术的驱动轮在工作时不同步而引起的震颤问题。Furthermore, the motor controller is controlled by a computer to realize synchronous driving of three drive motors. Through computer control of three controllers, the effect of synchronous driving of three drive motors is achieved. The three-motor synchronous drive technology not only improves the robot's cable-climbing power, but also avoids the vibration problem caused by the existing technology's drive wheels being out of sync during operation.
进一步的,所述主动轮和从动轮的轮面采用聚氨酯材质制作。取材方便,降低成本。Furthermore, the wheel surfaces of the driving wheel and the driven wheel are made of polyurethane material. It is convenient to obtain materials and reduce costs.
由于采用了上述技术方案,本发明具有如下有益效果:Due to the adoption of the above technical solutions, the present invention has the following beneficial effects:
1、采用六块框架板围合成六边形的外框架,利用六边形框架是对称形状,能够有效减轻框架系统质心与缆索轴线不重合而产生的偏心影响,并且框架板外表面易于对电子元件进行安装,框架板采用铝板,能够迅速导热、将部件工作时产生的热量迅速与外界环境相传导,起到散热降温的效果。1. Six frame plates are used to form a hexagonal outer frame. The hexagonal frame is symmetrical, which can effectively reduce the eccentricity effect caused by the misalignment of the center of mass of the frame system and the cable axis, and the outer surface of the frame plate is easy to affect the electronics. The components are installed, and the frame plate is made of aluminum plate, which can quickly conduct heat and quickly conduct the heat generated when the components are working to the external environment, thereby achieving a heat dissipation and cooling effect.
2、压紧机构和轮系传动机构在水平面的投影上沿周向均布设置,使压紧机构、轮系传动机构同时从三个方向对缆索压紧和同步爬缆。2. The pressing mechanism and the gear train transmission mechanism are evenly distributed along the circumferential direction on the projection of the horizontal plane, so that the pressing mechanism and the gear train transmission mechanism can compress the cable from three directions at the same time and climb the cable synchronously.
3、采用上下对称布置的压紧机构,设计两根弹簧布置在导向杆上,能够平衡单支弹簧推力对单点的作用过大、应力集中等问题,以此减小驱动轮与缆索表面的正压力的增量值,能够增强缆索检测机器人的越障能力。3. Adopt a pressing mechanism arranged symmetrically up and down, and design two springs arranged on the guide rod, which can balance the excessive effect of a single spring thrust on a single point, stress concentration and other problems, thereby reducing the friction between the driving wheel and the cable surface. The incremental value of positive pressure can enhance the obstacle surmounting ability of the cable detection robot.
4、通过计算机控制三个控制器,达到三个驱动电机同步驱动的效果,三个电机同步驱动技术不仅提高机器人爬缆动力,而且避免了现有技术的驱动轮在工作时不同步而引起的震颤问题,减少机器人在高空中出现卡死、打滑等现象。4. Through computer control of three controllers, the effect of synchronous driving of three driving motors is achieved. The three motor synchronous driving technology not only improves the robot's cable climbing power, but also avoids the problems caused by the unsynchronized driving wheels of the existing technology during operation. The tremor problem reduces the phenomenon of robots getting stuck and slipping in high altitudes.
5、三个驱动电机同步驱动,由于是呈环形120°布置,三个主动轮均有动力输出。形成了多驱传动结构,三个从动轮平行布置增强了机器人运动时的稳定性,极大程度上提高了机器人的爬缆能力。5. The three drive motors are driven synchronously. Since they are arranged in a 120° annular shape, all three driving wheels have power output. A multi-drive transmission structure is formed, and the three driven wheels are arranged in parallel to enhance the stability of the robot during movement and greatly improve the robot's cable climbing ability.
附图说明Description of drawings
图1是本发明的主视图;Figure 1 is a front view of the present invention;
图2是图1中A-A剖视图;Figure 2 is a cross-sectional view of A-A in Figure 1;
图3是轮系传动机构的主视图;Figure 3 is a front view of the gear train transmission mechanism;
图4是图3的B-B剖视图;Figure 4 is a B-B cross-sectional view of Figure 3;
图5是轮系传动机构的俯视图;Figure 5 is a top view of the gear train transmission mechanism;
图6是本发明的结构示意图;Figure 6 is a schematic structural diagram of the present invention;
图7是检测机器人的工作流程图。Figure 7 is a work flow chart of the detection robot.
附图标记Reference signs
附图中,1为框架板,2为直线轴承,3为电池组,4为压紧机构,5为轮系传动机构,6为缆索,7为驱动电机,8为摄像头,9为轴承座,10为电机控制器,11为无线模块,12为摄像头安装支架,In the attached figure, 1 is the frame plate, 2 is the linear bearing, 3 is the battery pack, 4 is the pressing mechanism, 5 is the gear train transmission mechanism, 6 is the cable, 7 is the drive motor, 8 is the camera, and 9 is the bearing seat. 10 is the motor controller, 11 is the wireless module, 12 is the camera mounting bracket,
41为导向杆,42为弹簧,43为螺母,41 is the guide rod, 42 is the spring, 43 is the nut,
51为导向杆支承板,52为电机安装板,53为翼板,54为主动轮,55为从动轮,56为带座轴承,57为主动轮转轴,58为从动轮转轴51 is the guide rod support plate, 52 is the motor mounting plate, 53 is the wing plate, 54 is the driving wheel, 55 is the driven wheel, 56 is the seated bearing, 57 is the driving wheel shaft, and 58 is the driven wheel shaft.
具体实施方式Detailed ways
下面结合附图对本发明的实施例作进一步详细说明。The embodiments of the present invention will be described in further detail below with reference to the accompanying drawings.
参见图1-图6,一种基于视觉检测的斜拉桥缆索检测机器人,包括外框架及设于外框架内的压紧机构4和轮系传动机构5,所述外框架包括六块框架板1,所述框架板1依次连接围成六边形的外框架,间隔设置的框架板1外侧面均设有上下对称布置的直线轴承2,框架板1的外侧面分别固定安装有电子元件和电池组3;在本实施例中,所述框架板1选用6061铝板为框架板制作材料,为了减轻整体重量,在框架板1的左右两侧6mm处挖空减重,形成镂空,并在左右两边切制60°斜角,形成框架板1,通过螺栓装配成六边形外框架,其中部铣去4mm厚的铝材,形成凹槽,安装有压紧机构4的框架板凹槽内固定安装锂电池组3,为驱动电机7供电,其余框架板1的凹槽内固定安装电机控制器10和无线模块11。Referring to Figures 1-6, a cable-stayed bridge cable inspection robot based on visual inspection includes an outer frame, a pressing mechanism 4 and a gear train transmission mechanism 5 located in the outer frame. The outer frame includes six frame plates. 1. The frame plates 1 are connected in sequence to form a hexagonal outer frame. The outer sides of the spaced frame plates 1 are equipped with linear bearings 2 arranged symmetrically up and down. Electronic components and electronic components are fixedly installed on the outer sides of the frame plates 1. Battery pack 3; In this embodiment, the frame plate 1 uses 6061 aluminum plate as the frame plate material. In order to reduce the overall weight, 6mm on the left and right sides of the frame plate 1 are hollowed out to reduce weight, forming hollows, and on the left and right sides. A 60° bevel is cut on both sides to form a frame plate 1, which is assembled into a hexagonal outer frame through bolts. A 4mm thick aluminum material is milled out in the middle to form a groove, and a pressing mechanism 4 is installed in the frame plate groove to be fixed. Install the lithium battery pack 3 to power the drive motor 7, and the motor controller 10 and the wireless module 11 are fixedly installed in the grooves of the remaining frame plates 1.
所述压紧机构4设于间隔设置的框架板1上,并沿框架板1上下对称布置,其一端穿过框架板1外的直线轴承2,另一端抵触轮系传动机构5,压紧机构4的轴线在水平面上的投影呈Y形,沿周向均布,使压紧机构4同时从三个方向对缆索6压紧;在本实施例中,所述压紧机构包括导向杆41、弹簧42和用于调节弹簧42预紧力的螺母43,导向杆41的一端伸出直线轴承2后与螺母43螺接,另一端伸入与轮系传动机构5固定连接的轴承座9后与轮系传动机构5抵触,所述弹簧42套设在导向杆41上并置于框架板1内侧与轴承座9之间,通过导向杆41导向,通过螺母43调节弹簧42预紧力使机器人在围抱缆索6时,轮系传动机构5抵紧缆索6、实现爬缆。压紧机构通过弹簧沿着导向杆进行弹力预紧,通过螺母调节的方式使得预紧力调节在合适的范围内。本发明的机器人在缆索6上运动时,依靠弹簧42的预紧与缆索6表面所产生的正压力,使得机器人与缆索6表面产生一定摩擦力,以此来克服重力的作用。弹簧42的预紧力不能过大也不能过小,过大的预紧力会额外增加电机的启动转矩,甚至让机器人卡死不动。过小的预紧力达不到机器人静止抱缆的要求。为了使其能够自适应杆径的变化,通过整体的受力分析,对弹簧进行优化。考虑到强度以及应力集中问题,设计两根弹簧42布置在导向杆41上,来平衡单支弹簧42推力对单点的作用过大,应力集中,造成设计不合理的问题。在弹簧42产生相同弹性力来满足机器人工作的情况下,刚度系数越小的弹簧预紧,机器人的越障能力就越强。利用MATLAB数学工具对弹簧参数进行优化,与电机转矩、静止状态所需摩擦力进行参数关联,选取弹簧参数最优解,以此来减小驱动轮与缆索表面的正压力的增量值,增强缆索检测机器人的越障能力。The pressing mechanism 4 is installed on the spaced frame plate 1 and is arranged symmetrically up and down along the frame plate 1. One end of it passes through the linear bearing 2 outside the frame plate 1, and the other end resists the gear train transmission mechanism 5. The pressing mechanism The projection of the axis 4 on the horizontal plane is Y-shaped, evenly distributed along the circumferential direction, so that the pressing mechanism 4 presses the cable 6 from three directions at the same time; in this embodiment, the pressing mechanism includes a guide rod 41 and a spring 42 and a nut 43 for adjusting the pretightening force of the spring 42. One end of the guide rod 41 extends out of the linear bearing 2 and is screwed to the nut 43, and the other end extends into the bearing seat 9 that is fixedly connected to the gear train transmission mechanism 5 and then is connected to the gear train. The transmission mechanism 5 resists, and the spring 42 is sleeved on the guide rod 41 and placed between the inside of the frame plate 1 and the bearing seat 9. It is guided by the guide rod 41, and the pre-tightening force of the spring 42 is adjusted through the nut 43 so that the robot can surround the robot. When the cable 6 is moved, the gear train transmission mechanism 5 is pressed against the cable 6 to realize cable climbing. The compression mechanism performs elastic preloading along the guide rod through a spring, and the preloading force is adjusted within an appropriate range by adjusting the nut. When the robot of the present invention moves on the cable 6, it relies on the pretension of the spring 42 and the positive pressure generated on the surface of the cable 6 to generate a certain friction between the robot and the surface of the cable 6, thereby overcoming the effect of gravity. The preload force of spring 42 cannot be too large or too small. Excessive preload force will additionally increase the starting torque of the motor and even cause the robot to get stuck. A pre-tightening force that is too small cannot meet the requirements of the robot's static cable holding. In order to make it adaptive to changes in rod diameter, the spring is optimized through overall force analysis. Considering the strength and stress concentration issues, two springs 42 are designed to be arranged on the guide rod 41 to balance the excessive effect of the thrust of a single spring 42 on a single point and stress concentration, resulting in unreasonable design problems. When the spring 42 generates the same elastic force to satisfy the robot's work, the smaller the stiffness coefficient of the spring preload, the stronger the robot's ability to overcome obstacles. Use MATLAB mathematical tools to optimize the spring parameters, correlate them with the motor torque and friction required in the static state, and select the optimal solution for the spring parameters to reduce the incremental value of the positive pressure on the surface of the drive wheel and cable. Enhance the obstacle surmounting ability of the cable detection robot.
所述轮系传动机构5设置于对称布置的压紧机构4之间,轮系传动机构5在水平面上的投影呈Δ形,沿周向均布设置三个,通过压紧机构4将轮系传动机构5压紧在缆索6表面,轮系传动机构5和压紧机构4在水平面上的投影在围抱缆索时形成的内切圆直径变化范围为150mm~200mm,所述轮系传动机构5包括壳体组件和设置于壳体组件内的滚轮装置和驱动电机7,所述滚轮装置和驱动电机7分别与壳体组件固接,滚轮装置由驱动电机7驱动,三个驱动电机7同步驱动滚轮装置实现轮系传动机构5同时从三个方向同步爬缆;The wheel train transmission mechanism 5 is arranged between the symmetrically arranged pressing mechanisms 4. The projection of the wheel train transmission mechanism 5 on the horizontal plane is Δ-shaped, and three of them are evenly distributed along the circumferential direction. The wheel train transmission mechanism 5 is connected by the pressing mechanism 4. 5 is pressed on the surface of the cable 6. The projection of the gear train transmission mechanism 5 and the compression mechanism 4 on the horizontal plane when surrounding the cable changes in the diameter range of 150 mm to 200 mm. The gear train transmission mechanism 5 includes a shell. The body assembly and the roller device and drive motor 7 arranged in the shell assembly. The roller device and the drive motor 7 are respectively fixed to the shell assembly. The roller device is driven by the drive motor 7. The three drive motors 7 drive the roller device synchronously. Realize the gear train transmission mechanism 5 to simultaneously climb cables from three directions;
在本实施例中,所述轮系传动机构5的壳体组件包括L型导向杆支承板51、L型电机安装板52和翼板53,导向杆支承板51上下对称布置,电机安装板52和翼板53设于对称布置的导向杆支承板51之间并相对设置,所述翼板53沿竖向设置两块,导向杆支承板51、电机安装板52和翼板53相互连接形成壳体组件;所述滚轮装置包括主动轮54、从动轮55和带座轴承56,所述带座轴承56对称设于主动轮、从动轮的转轴57、58上,靠近翼板53一侧的带座轴承56与翼板53固定连接,靠近电机安装板52一侧的带座轴承56与电机安装板52固定连接,所述驱动电机7固定于电机安装板52并设于两块翼板53之间,通过带传动为主动轮54传递动力。通过压紧机构中弹簧42的弹力将轮系传动机构5压紧在缆索6表面,一组传动机构通过一个驱动电机7以带传动的方式进行动力传递。In this embodiment, the housing assembly of the gear train transmission mechanism 5 includes an L-shaped guide rod support plate 51, an L-shaped motor mounting plate 52 and a wing plate 53. The guide rod support plate 51 is arranged symmetrically up and down, and the motor mounting plate 52 The guide rod support plate 51, the motor mounting plate 52 and the wing plates 53 are connected to each other to form a shell. body assembly; the roller device includes a driving wheel 54, a driven wheel 55 and a seated bearing 56. The seated bearing 56 is symmetrically located on the rotating shafts 57 and 58 of the driving wheel and the driven wheel. The belt on the side close to the wing plate 53 The seat bearing 56 is fixedly connected to the wing plate 53. The seated bearing 56 on the side close to the motor mounting plate 52 is fixedly connected to the motor mounting plate 52. The drive motor 7 is fixed to the motor mounting plate 52 and is located between the two wing plates 53. During this time, power is transmitted to the driving wheel 54 through belt transmission. The gear train transmission mechanism 5 is pressed against the surface of the cable 6 by the elastic force of the spring 42 in the compression mechanism. A set of transmission mechanisms transmits power through a drive motor 7 in a belt drive manner.
本发明的缆索检测机器人还包括无线适配器(图中未示出),所述无线适配器用于接收无线模块发射的信号并与计算机连接,通过计算机遥控检测机器人,并对传输回来的图像进行实时处理,及时作出相应的反馈。缆索检测机器人的框架板1上还设有摄像头8,摄像头8安装在框架板1上部的摄像头安装支架12上,通过无线传输的方式将拍摄的图像视频数据传输回计算机。The cable detection robot of the present invention also includes a wireless adapter (not shown in the figure). The wireless adapter is used to receive the signal transmitted by the wireless module and connect with the computer, remotely control the detection robot through the computer, and perform real-time processing on the transmitted image. , make corresponding feedback in a timely manner. The frame plate 1 of the cable inspection robot is also provided with a camera 8. The camera 8 is installed on the camera mounting bracket 12 on the upper part of the frame plate 1 and transmits the captured image and video data back to the computer through wireless transmission.
本发明利用计算机语言编写程序,通过计算机控制三个电机控制器,达到三个驱动电机同步驱动的效果;三个电机同步驱动不仅提高机器人爬缆动力,还由于同步驱动避免了现有技术的驱动轮在工作时不同步而引起的震颤问题,三个驱动电机同步驱动,由于是呈环形120°布置,三个主动轮均有动力输出。形成了多驱传动结构,三个从动轮平行布置增强了机器人运动时的稳定性,极大程度上提高了机器人的爬缆能力,本发明机器人可适用于0~90°的缆索攀爬检测,攀爬性能优秀。The invention uses computer language to write programs and controls three motor controllers through the computer to achieve the effect of synchronous driving of three driving motors; the synchronous driving of the three motors not only improves the robot's cable climbing power, but also avoids the driving of the prior art due to the synchronous driving. To avoid the vibration problem caused by the wheels being out of sync during operation, the three driving motors are driven synchronously. Since they are arranged in a 120° annular shape, all three driving wheels have power output. A multi-drive transmission structure is formed, and the three driven wheels are arranged in parallel to enhance the stability of the robot during movement and greatly improve the robot's cable climbing ability. The robot of the present invention can be used for cable climbing detection from 0 to 90°. Excellent climbing performance.
本发明采用三个驱动电机进行驱动,为了确保动力,以大容量的锂电池组为驱动电机供电,锂电池蓄能性能优良,并且体积与重量较小,能够减轻机器人自身重量。电机控制器、锂电池组、无线接收发射模块等部件贴合安装在框架板凹槽内,铝板金属表面能够迅速导热,将部件工作时产生的热量迅速与外界环境相传导,起到散热降温的效果。The invention uses three driving motors for driving. In order to ensure power, a large-capacity lithium battery pack is used to power the driving motors. The lithium battery has excellent energy storage performance and is small in size and weight, which can reduce the weight of the robot itself. The motor controller, lithium battery pack, wireless receiving and transmitting module and other components are installed in the groove of the frame plate. The metal surface of the aluminum plate can quickly conduct heat, and the heat generated when the components are working is quickly conducted to the external environment to dissipate heat and cool down. Effect.
本发明可以通过计算机中的人机控制界面在地面对检测机器人进行遥控,控制驱动电机的转动与速度,可以在很远的距离上控制缆索检测机器人的工作状态,且爬缆最大速度在9米/分钟以上。通过处理反馈回来的电信号,转化为检测机器人的位移,在人机控制界面能够显示位置距离信息。在检测到缺陷的时候,能够对缺陷在缆索上进行精确定位。而设置在外框架上的摄像头可以将图像视频实时传输回地面,人在地面上就能够观察到缆索表面形貌的破坏程度,并根据实际情况采取相应的措施,从而确保缆索安全。The invention can remotely control the detection robot on the ground through the human-machine control interface in the computer, control the rotation and speed of the driving motor, and can control the working state of the cable detection robot at a long distance, and the maximum speed of the cable climbing is 9 m/min and above. By processing the feedback electrical signal, it is converted into the displacement of the detected robot, and the position and distance information can be displayed on the human-machine control interface. When a defect is detected, it can be accurately located on the cable. The camera set on the outer frame can transmit images and videos back to the ground in real time. People on the ground can observe the degree of damage to the surface of the cable and take appropriate measures according to the actual situation to ensure the safety of the cable.
本发明的缆索检测机器人携带摄像头或相机在高空缆索上作业,对缆索表面进行检测。通过传输在计算机中的图像,利用视觉软件的halcon算子将各个摄像头或相机采集的图像进行拼接融合,获取缆索表面全貌图。通过深度学习的方法,对图中的缺陷进行特征匹配,判断缺陷的类型。进而达到机器人代替人工来检测缆索的目的。The cable detection robot of the present invention carries a camera or camera to operate on a high-altitude cable to detect the surface of the cable. Through the images transmitted in the computer, the halcon operator of the vision software is used to splice and fuse the images collected by each camera or camera to obtain a complete picture of the cable surface. Through deep learning, feature matching is performed on the defects in the image to determine the type of defect. This achieves the purpose of using robots to detect cables instead of humans.
这里需要说明的是,本发明所描述的工作状态是按照最恶劣的工况进行的,机器人运动在垂直于桥面的缆索上,本技术方案描述是为了体现机器人能够适应各种不同角度的缆索检测,而不是单一的位置结构的限定。本发明在不同斜度缆索运动时,自身能够适应150mm~200mm的杆径变化,中途无需人工干预。It should be noted here that the working state described in the present invention is carried out according to the worst working conditions. The robot moves on the cable perpendicular to the bridge deck. The description of this technical solution is to show that the robot can adapt to various cables at different angles. Detection rather than qualification of a single location structure. The invention can adapt to changes in rod diameter of 150mm to 200mm when cables move at different inclinations, without manual intervention in the process.
本发明的缆索检测机器人攀爬、越障性能良好,可以攀爬各种倾斜角度的缆索,且缆索直径的适应面广,对缆索PE护套的外包覆层损伤小,同步驱动不会出现颤震现象,减少机器人在高空中出现卡死、打滑等现象。通过计算机控制驱动电机的转动,可以在很远的距离上控制缆索检测机器人的活动,摄像头可以将图像视频实时传输回地面,人在地面上就能够观察到缆索表面形貌的破坏程度,并根据实际情况采取相应的措施,从而确保缆索安全,具有很高的实用价值,具有非常重要的工程应用和推广价值。The cable detection robot of the present invention has good climbing and obstacle-crossing performance, can climb cables with various inclination angles, has a wide adaptability to the cable diameter, has little damage to the outer coating of the cable PE sheath, and will not cause synchronous driving. The chattering phenomenon reduces the phenomenon of robots getting stuck and slipping in high altitudes. By using a computer to control the rotation of the drive motor, the activities of the cable detection robot can be controlled over a long distance. The camera can transmit images and videos back to the ground in real time. People on the ground can observe the degree of damage to the surface topography of the cable and detect it based on the Corresponding measures should be taken according to the actual situation to ensure the safety of the cable, which has high practical value and has very important engineering application and promotion value.
最后说明的是,以上优选实施例仅用以说明本发明的技术方案而非限制,尽管通过上述优选实施例已经对本发明进行了详细的描述,但本领域技术人员应当理解,可以在形式上和细节上对其作出各种各样的改变,而不偏离本发明权利要求书所限定的范围。Finally, it should be noted that the above preferred embodiments are only used to illustrate the technical solution of the present invention rather than to limit it. Although the present invention has been described in detail through the above preferred embodiments, those skilled in the art should understand that it can be implemented in the form and Various changes can be made to the details without departing from the scope of the invention as defined by the claims.
Claims (5)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910256434.0A CN109853379B (en) | 2019-04-01 | 2019-04-01 | Cable-stayed bridge cable detection robot based on visual detection |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910256434.0A CN109853379B (en) | 2019-04-01 | 2019-04-01 | Cable-stayed bridge cable detection robot based on visual detection |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109853379A CN109853379A (en) | 2019-06-07 |
CN109853379B true CN109853379B (en) | 2023-12-26 |
Family
ID=66902846
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910256434.0A Active CN109853379B (en) | 2019-04-01 | 2019-04-01 | Cable-stayed bridge cable detection robot based on visual detection |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109853379B (en) |
Families Citing this family (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110205930A (en) * | 2019-06-13 | 2019-09-06 | 广东承信公路工程检验有限公司 | Novel bridge cable intelligent measurement robot |
CN110295544B (en) * | 2019-07-29 | 2024-02-06 | 武汉冠油科技有限公司 | Rotary crawling detector for detecting external cross section shape of bridge inhaul cable |
CN110823906A (en) * | 2019-11-14 | 2020-02-21 | 西安石油大学 | A bridge cable flaw detection robot |
CN110952445A (en) * | 2019-12-02 | 2020-04-03 | 广东交科检测有限公司 | Cable body detection device for cable-stayed bridge cable |
CN110924300A (en) * | 2019-12-10 | 2020-03-27 | 中国科学院深圳先进技术研究院 | Deicing robot |
CN111058377A (en) * | 2019-12-31 | 2020-04-24 | 哈尔滨理工大学 | A wheeled climbing robot |
CN111206497B (en) * | 2020-03-12 | 2025-05-13 | 上海圭目机器人有限公司 | A preload drive device for a preloaded rope climbing robot |
CN112414942B (en) * | 2020-11-27 | 2023-09-01 | 长安大学 | Visual cable detection device with adjustable detection space closed shooting distance |
CN113123230A (en) * | 2021-05-04 | 2021-07-16 | 北华大学 | Bridge detection mechanism for civil engineering |
CN113650695B (en) * | 2021-09-25 | 2024-05-07 | 重庆大学 | Rigid-flexible coupled climbing robot |
CN114197304A (en) * | 2021-11-18 | 2022-03-18 | 中国地质大学(武汉) | A cable detection robot |
CN114875783B (en) * | 2022-01-06 | 2023-12-08 | 长沙理工大学 | Portable cable climbing detection robot |
CN114319102B (en) * | 2022-01-21 | 2023-02-28 | 山东大学 | Cable detection robot and working method thereof |
CN115015374B (en) * | 2022-08-09 | 2022-11-15 | 中电建路桥集团有限公司 | Bridge cable wire device of detecting a flaw |
CN116021520A (en) * | 2022-12-30 | 2023-04-28 | 中铁大桥科学研究院有限公司 | Control method and related equipment of intelligent bridge inhaul cable detection robot |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102007059235A1 (en) * | 2007-12-07 | 2009-06-10 | Marcel Vecchi | Device for processing a stay cable of a cable-stayed bridge |
CN104153301A (en) * | 2014-04-15 | 2014-11-19 | 宁波职业技术学院 | Cable maintenance robot |
CN204435224U (en) * | 2015-01-16 | 2015-07-01 | 华中科技大学 | A kind of Character of Cable Force of Cable stayed Bridge robot motion device |
CN204530472U (en) * | 2015-02-27 | 2015-08-05 | 西南交通大学 | Robot capable of crawling cable |
CN206204783U (en) * | 2016-11-11 | 2017-05-31 | 郑东江 | A kind of wheeled cable detecting robot |
CN209703303U (en) * | 2019-04-01 | 2019-11-29 | 重庆科技学院 | A kind of cable detection robot for cable-stayed bridge |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10471973B2 (en) * | 2016-08-24 | 2019-11-12 | Infrastructure Preservation Corporation | Cable stay transport vehicle and inspection system and related methods |
-
2019
- 2019-04-01 CN CN201910256434.0A patent/CN109853379B/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102007059235A1 (en) * | 2007-12-07 | 2009-06-10 | Marcel Vecchi | Device for processing a stay cable of a cable-stayed bridge |
CN104153301A (en) * | 2014-04-15 | 2014-11-19 | 宁波职业技术学院 | Cable maintenance robot |
CN204435224U (en) * | 2015-01-16 | 2015-07-01 | 华中科技大学 | A kind of Character of Cable Force of Cable stayed Bridge robot motion device |
CN204530472U (en) * | 2015-02-27 | 2015-08-05 | 西南交通大学 | Robot capable of crawling cable |
CN206204783U (en) * | 2016-11-11 | 2017-05-31 | 郑东江 | A kind of wheeled cable detecting robot |
CN209703303U (en) * | 2019-04-01 | 2019-11-29 | 重庆科技学院 | A kind of cable detection robot for cable-stayed bridge |
Also Published As
Publication number | Publication date |
---|---|
CN109853379A (en) | 2019-06-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109853379B (en) | Cable-stayed bridge cable detection robot based on visual detection | |
CN207359084U (en) | A kind of oil gas field fire-fighting is remotely controlled crusing robot system | |
CN209703303U (en) | A kind of cable detection robot for cable-stayed bridge | |
CN205394516U (en) | Patrol and examine robot under hazardous environment | |
CN209682199U (en) | A kind of mine monitoring rail polling robot | |
CN106556684A (en) | A kind of new electrically driven (operated) detector for cables and detection method | |
CN102923318A (en) | Weak impact type butting system for androgynous stiffness damping closed loop feedback control | |
CN103990829A (en) | End effector for forming holes for aircraft assembly and using method thereof | |
CN107059611B (en) | Multi-rotor-wing inhaul cable detection robot and inhaul cable detection method thereof | |
CN216634394U (en) | Composite main power device of inspection robot capable of walking on cable | |
CN212771927U (en) | Cable climbing robot | |
CN111730611A (en) | Mechanical structure of a high-voltage transmission line patrol robot | |
CN110823906A (en) | A bridge cable flaw detection robot | |
CN113232006A (en) | Intelligent inspection robot, intelligent inspection system and inspection method for coal chemical industry | |
CN106930185B (en) | A kind of robot creeped for Character of Cable Force of Cable stayed Bridge | |
CN112454248B (en) | Auxiliary dismounting device for large underwater robot sealing cabin cover | |
CN115091474A (en) | An omnidirectional high-precision inspection robot for ultra-high voltage overhead transmission lines | |
CN104029215A (en) | Arm joint structure of small underwater hydraulic manipulator | |
CN113998100B (en) | A robot and control method for aerial contact nondestructive testing operations | |
CN211014061U (en) | A variable diameter bridge cable detection device | |
CN116902240A (en) | In-service wind power blade girder hidden danger detection robot and detection method thereof | |
Liu et al. | Adhesion-adaptive control of a novel bridge-climbing robot | |
CN111805501A (en) | Flexible variable-diameter permanent-magnet adsorption wheat wheel type cylinder climbing robot system | |
CN109557173B (en) | Nondestructive testing device | |
CN104637550B (en) | Visual observation mechanism working in nuclear fusion chamber and control method thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |