CN114549808A - Method for extracting image characteristics of roof in coal roadway empty-roof area - Google Patents
Method for extracting image characteristics of roof in coal roadway empty-roof area Download PDFInfo
- Publication number
- CN114549808A CN114549808A CN202210095250.2A CN202210095250A CN114549808A CN 114549808 A CN114549808 A CN 114549808A CN 202210095250 A CN202210095250 A CN 202210095250A CN 114549808 A CN114549808 A CN 114549808A
- Authority
- CN
- China
- Prior art keywords
- image
- roof
- extracting
- coal
- pixel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 239000003245 coal Substances 0.000 title claims abstract description 31
- 230000008569 process Effects 0.000 claims abstract description 24
- 238000001514 detection method Methods 0.000 claims abstract description 12
- 238000001914 filtration Methods 0.000 claims abstract description 9
- 239000011435 rock Substances 0.000 claims abstract description 8
- 230000011218 segmentation Effects 0.000 claims abstract description 8
- 230000009466 transformation Effects 0.000 claims abstract description 7
- 238000007781 pre-processing Methods 0.000 claims abstract 2
- 230000005540 biological transmission Effects 0.000 claims description 11
- 238000004364 calculation method Methods 0.000 claims description 9
- 230000001131 transforming effect Effects 0.000 claims description 5
- 230000006835 compression Effects 0.000 claims description 3
- 238000007906 compression Methods 0.000 claims description 3
- 238000011156 evaluation Methods 0.000 abstract 1
- 230000005641 tunneling Effects 0.000 abstract 1
- 238000009412 basement excavation Methods 0.000 description 5
- 235000002566 Capsicum Nutrition 0.000 description 2
- 239000006002 Pepper Substances 0.000 description 2
- 241000722363 Piper Species 0.000 description 2
- 235000016761 Piper aduncum Nutrition 0.000 description 2
- 235000017804 Piper guineense Nutrition 0.000 description 2
- 235000008184 Piper nigrum Nutrition 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 150000003839 salts Chemical class 0.000 description 2
- 230000001629 suppression Effects 0.000 description 2
- 230000007812 deficiency Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000011105 stabilization Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/10—Image enhancement or restoration using non-spatial domain filtering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
- G06T5/92—Dynamic range modification of images or parts thereof based on global image properties
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/12—Edge-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20024—Filtering details
- G06T2207/20032—Median filtering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20048—Transform domain processing
- G06T2207/20061—Hough transform
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Data Mining & Analysis (AREA)
- Life Sciences & Earth Sciences (AREA)
- Artificial Intelligence (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- General Engineering & Computer Science (AREA)
- Image Processing (AREA)
Abstract
Description
技术领域technical field
本申请涉及煤巷空顶技术领域,具体而言,涉及一种煤巷空顶区顶板图像特征的提取方法。The present application relates to the technical field of open roofs of coal roadways, and in particular, to a method for extracting image features of roofs in open roof areas of coal roadways.
背景技术Background technique
煤炭工业的智能化是时代的必然要求,而智能化掘进是煤矿智能化的重要环节。对于煤巷智能化掘进而言,需要着重强调对煤巷顶板的控制,这关系到智能掘进是否持续地安全高效执行。The intelligence of the coal industry is an inevitable requirement of the times, and intelligent excavation is an important part of the intelligentization of coal mines. For the intelligent excavation of coal roadway, it is necessary to emphasize the control of the roof of the coal roadway, which is related to whether the intelligent excavation can be carried out safely and efficiently continuously.
巷道支护始终滞后于综掘机破岩一段距离,无可避免的会产生一定范围的裸露空间,这一部分顶板叫空顶区,空顶区具有一定自稳性能,而当前并没有一个定性的标准来确定空顶区的自稳性能,从而无法为智能掘进提供超前预判,所以急需一个煤巷空顶区顶板图像特征的提取方法。The roadway support always lags behind the rock breaking of the fully mechanized excavator for a certain distance, which inevitably results in a certain range of exposed space. This part of the roof is called the empty roof area. The empty roof area has a certain self-stabilizing performance, but there is currently no qualitative Therefore, it is impossible to provide advance prediction for intelligent excavation, so a method for extracting the roof image features of the empty roof area of coal roadway is urgently needed.
发明内容SUMMARY OF THE INVENTION
为了弥补以上不足,本申请提供了一种煤巷空顶区顶板图像特征的提取方法,旨在改善当前并没有一个定性的标准来确定空顶区的自稳性能,从而无法为智能掘进提供超前预判。In order to make up for the above deficiencies, the present application provides a method for extracting the image features of the roof of the empty roof area of a coal roadway, aiming to improve the current lack of a qualitative standard to determine the self-stabilization performance of the roof area, so that it cannot provide advanced technology for intelligent excavation. Anticipate.
本申请实施例提供了一种煤巷空顶区顶板图像特征的提取方法,包括有以下方法步骤:The embodiment of the present application provides a method for extracting image features of a roof in a hollow roof area of a coal roadway, including the following method steps:
S1、待综掘机割完煤体后,调整摄像机镜头位置对准空顶区裸露顶板;S1. After the fully mechanized excavator finishes cutting the coal body, adjust the position of the camera lens to aim at the exposed roof of the empty roof area;
S2、利用井上连接电脑采集一张张裸顶图像;S2. Use the well-connected computer to collect bare-top images;
S3、对裸顶图像进行预处理,分别采用伽马修正、中值滤波对图片的亮度和噪音进行调节消除;S3. Preprocess the bare-top image, and use gamma correction and median filtering to adjust and eliminate the brightness and noise of the image;
S4、图片经区域生长分割与霍夫变换提取岩体结构面轮廓;S4. The image is extracted by region growth segmentation and Hough transform to extract the contour of rock mass structure surface;
S5、对结构面轮廓细化以及间隔点连接,获取结构面骨架;S5. Refine the outline of the structural surface and connect the space points to obtain the skeleton of the structural surface;
S6、计算结构面特征参数,包括裂隙间隙宽度与粗糙度,对巷道裸顶进行分类。S6. Calculate the characteristic parameters of the structure surface, including the width and roughness of the crack gap, and classify the bare roof of the roadway.
在上述实现过程中,该方法可编程形成系统,空顶区顶板图像特征提取方法可以全自动处理,全过程均无人工干预,比较准确的对裸顶图像进行定性评价,对智能掘进超前探测以及如何支护干预提供较好的数据基础,并且通过多种算法处理,实现对空顶区顶板图像进行有效的计算处理,能够有效的实现对图片的亮度和噪音进行调节消除,并且提取岩体结构面轮廓,对结构面轮廓细化以及间隔点连接,获取结构面骨架,再计算结构面特征参数,包括裂隙间隙宽度与粗糙度,对巷道裸顶进行分类。In the above implementation process, the method can be programmed to form a system, and the feature extraction method of the roof image of the empty roof area can be processed automatically without manual intervention in the whole process. How to support the intervention to provide a better data basis, and through a variety of algorithm processing, to achieve effective calculation and processing of the roof image of the empty roof area, can effectively adjust and eliminate the brightness and noise of the picture, and extract the rock mass structure Surface profile, refine the profile of the structure surface and connect the interval points, obtain the skeleton of the structure surface, and then calculate the characteristic parameters of the structure surface, including the width and roughness of the crack gap, to classify the bare roof of the roadway.
在一种具体的实施方案中,所述S1中的调整摄像机镜头位置使得摄像机镜头与空顶保持相对的平行,即使得摄像机镜头拍摄的画面的平整,并且在摄像机镜头进行拍摄的时候,保持摄像机镜头平衡,防止晃动。In a specific embodiment, the adjustment of the position of the camera lens in S1 makes the camera lens and the ceiling remain relatively parallel, that is, the picture captured by the camera lens is flat, and when the camera lens is shooting, the camera is kept The lens is balanced to prevent shake.
在上述实现过程中,使得摄像机镜头能够拍摄平整的图片,有效的提高图片的后续处理过程,保持图片的精准度。In the above implementation process, the camera lens can take a flat picture, which effectively improves the subsequent processing process of the picture and maintains the accuracy of the picture.
在一种具体的实施方案中,所述摄像机镜头在进行拍摄的时候,通过补光灯实现对空顶进行补光照明,且补光照明采用无影LED灯进行照明。In a specific embodiment, when the camera lens is shooting, the supplementary light is used to illuminate the empty ceiling, and the supplementary light is illuminated by shadowless LED lights.
在上述实现过程中,在较为黑暗的煤巷中进行拍摄清晰的画面,并且减少阴影,提高图片处理过程的精度。In the above implementation process, clear pictures are taken in a relatively dark coal lane, and shadows are reduced to improve the accuracy of the picture processing process.
在一种具体的实施方案中,所述S2中的电脑采集裸顶图像的时候,通过存储数据卡或者是USB传输方式进行传输,且摄像机在进行裸顶图像存储的时候,对裸顶图像进行压缩存储。In a specific embodiment, when the computer in S2 collects the bare-top image, it transmits through a storage data card or a USB transmission method, and when the camera stores the bare-top image, it performs Compressed storage.
在上述实现过程中,煤巷较深,线缆传输较为浪费资源,以及无线传输信号不好,容易造成图片丢失数据,通过存储数据卡或者是USB传输保持图片的精准度。In the above implementation process, the coal lane is deep, the cable transmission is more wasteful of resources, and the wireless transmission signal is not good, which may easily cause the picture to lose data.
在一种具体的实施方案中,所述电脑在通过存储数据卡或者是USB传输接收图片的时候,先对图片进行传输到电脑上,然后对图片进行无损解码处理,然后将图片进行预处理。In a specific implementation, when the computer receives the picture through the storage data card or USB transmission, it first transmits the picture to the computer, then performs lossless decoding processing on the picture, and then preprocesses the picture.
在上述实现过程中,在拍摄图片之后,对图片进行加压存储,可以提高存储量,且解码处理,便于实现对图片进行处理操作。In the above implementation process, after a picture is taken, the picture is compressed and stored, which can increase the storage capacity, and the decoding process is convenient to realize the processing operation of the picture.
在一种具体的实施方案中,所述S3中的伽马修正是用来针对影片或是影像系统里对于光线的辉度或是三色刺激值所进行非线性的运算或反运算,由下列幂定律公式所定义的,In a specific implementation, the gamma correction in S3 is used to perform nonlinear operations or inverse operations on the luminance or tristimulus values of light in a film or imaging system, and is determined by the following Defined by the power law formula,
Vout=AVin λ,V out =AV in λ ,
其中A是一个常量,输入和输出的值都为非负实数值,在A=1的通常情况下,输入输出的值的范围都是在0到1之间,伽马值γ<1的情况时被称作编码伽马值,而执行这个编码运算所使用上述幂定律的过程也叫做伽马压缩;相对地,伽马值γ>1的情况时被称作解码伽马值,而执行这个解码运算所使用上述幂定律的过程也叫做伽马展开,所述伽马修正对明度和灰度计算公式如下:where A is a constant, and the input and output values are non-negative real values. In the usual case of A=1, the input and output values range from 0 to 1, and the gamma value γ<1 When the gamma value is called encoding gamma value, the process of performing the above-mentioned power law for this encoding operation is also called gamma compression; on the contrary, when the gamma value γ>1 is called decoding gamma value, and performing this The above-mentioned power-law process used in the decoding operation is also called gamma expansion. The gamma correction has the following formulas for calculating lightness and grayscale:
RGB明度计算公式:RGB brightness calculation formula:
L取值范围为0-1,The value range of L is 0-1,
RGB灰度计算公式:RGB grayscale calculation formula:
在上述实现过程中,通过伽马修正可以实现对图片进行有效的色彩处理,提高图像的色彩和明度,便于后续进行除噪。In the above implementation process, effective color processing of the picture can be achieved through gamma correction, the color and brightness of the image can be improved, and subsequent noise removal can be facilitated.
在一种具体的实施方案中,所述S3中的中值滤波是对一个滑动窗口内的诸像素灰度值排序,用其中值代替窗口中心象素的原来灰度值,用于实现对图像进行除噪处理,所述中值滤波的步骤如下所示:In a specific implementation, the median filter in S3 is to sort the gray values of pixels in a sliding window, and use the median value to replace the original gray value of the center pixel of the window, so as to realize the image Perform noise removal processing, and the steps of the median filter are as follows:
S301、将滤波模板,即含有若干个点的滑动窗口在图像中漫游,并将模板中心与图中某个像素位置重合;S301, roaming the filter template, namely a sliding window containing several points, in the image, and overlapping the template center with a certain pixel position in the figure;
S302、读取模板中各对应像素的灰度值;S302, read the gray value of each corresponding pixel in the template;
S303、将这些灰度值从小到大排列;S303, arrange these grayscale values from small to large;
S304、取这一列数据的中间数据,将其赋给对应模板中心位置的像素,如果窗口中有奇数个元素,中值取元素按灰度值大小排序后的中间元素灰度值,如果窗口中有偶数个元素,中值取元素按灰度值大小排序后,中间两个元素灰度的平均值。S304. Take the middle data of this column of data, and assign it to the pixel at the center position of the corresponding template. If there are an odd number of elements in the window, the median value is the gray value of the middle element after the elements are sorted according to the size of the gray value. If there are an even number of elements, the median value is the average of the gray levels of the two middle elements after the elements are sorted by gray value.
在上述实现过程中,中值滤波对脉冲干扰级椒盐噪声的抑制效果好,在抑制随机噪声的同时能有效保护边缘少受模糊。In the above implementation process, the median filter has a good suppression effect on the impulse interference level salt and pepper noise, and can effectively protect the edges from blurring while suppressing random noise.
在一种具体的实施方案中,所述S4中的区域生长分割的步骤如下所示:In a specific embodiment, the step of region growth segmentation in the S4 is as follows:
S401、对图像顺序扫描,找到第1个还没有归属的像素,设该像素为(x0,y0);S401, scan the image sequentially, find the first pixel that has not yet been attributed, and set the pixel to be (x0, y0);
S402、以(x0,y0)为中心,考虑(x0,y0)的8邻域像素(x,y)如果(x0,y0)满足生长准则,将(x,y)与(x0,y0)合并在同一区域内,同时将(x,y)压入堆栈;S402. Taking (x0, y0) as the center, consider the 8-neighborhood pixel (x, y) of (x0, y0), if (x0, y0) satisfies the growth criterion, combine (x, y) with (x0, y0) In the same area, push (x, y) onto the stack at the same time;
S403、从堆栈中取出一个像素,把它当作(x0,y0)返回到S402中;S403, take out a pixel from the stack and return it to S402 as (x0, y0);
S404、当堆栈为空时,返回到S401中;S404, when the stack is empty, return to S401;
S405、重复S401-S404直到图像中的每个点都有归属时,生长结束。S405, repeating S401-S404 until each point in the image has an attribution, and the growth ends.
在上述实现过程中,区域生长方法是根据同一物体区域内象素的相似性质来聚集象素点的方法,将相邻的具有同样性质的象素或其它区域归并到目前的区域中从而逐步增长区域。In the above implementation process, the region growing method is a method of gathering pixels according to the similar properties of pixels in the same object region, and merging adjacent pixels or other regions with the same properties into the current region to gradually grow area.
在一种具体的实施方案中,所述S4中的霍夫变换用于检测间断点边界形状,通过将图像坐标空间变换到参数空间,来实现直线与曲线的拟合;In a specific embodiment, the Hough transform in S4 is used to detect the boundary shape of the discontinuous point, and the fitting of the straight line and the curve is realized by transforming the image coordinate space into the parameter space;
直线坐标参数空间Linear Coordinate Parameter Space
在图像x-y坐标空间中,经过点(xi,yi)的直线表示为:In the image x-y coordinate space, the line passing through the point (xi, yi) is represented as:
yi=axi+b,yi=axi+b,
其中,参数a为斜率,b为截矩,Among them, the parameter a is the slope, b is the intercept,
通过点(xi,yi)的直线有无数条,且对应于不同的a和b值,There are an infinite number of straight lines passing through the point (xi, yi), which correspond to different a and b values,
如果将xi和yi视为常数,而将原本的参数a和b看作变量,则式子表示为:If xi and yi are regarded as constants, and the original parameters a and b are regarded as variables, the formula is expressed as:
b=-xia+yi,b=-xia+yi,
这样就变换到了参数平面a-b,这个变换就是直角坐标中对于(xi,yi)点的Hough变换;In this way, it is transformed to the parameter plane a-b, which is the Hough transform of the (xi, yi) point in Cartesian coordinates;
极坐标参数空间Polar coordinate parameter space
极坐标中用如下参数方程表示一条直线,In polar coordinates, a straight line is represented by the following parametric equation,
ρ=xcosθ+ysinθ,ρ=xcosθ+ysinθ,
其中,ρ代表直线到原点的垂直距离,θ代表x轴到直线垂线的角度,取值范围为±90°;Among them, ρ represents the vertical distance from the line to the origin, θ represents the angle from the x-axis to the vertical line of the line, and the value range is ±90°;
曲线检测Curve detection
Hough变换同样适用于方程已知的曲线检测,The Hough transform is also suitable for curve detection where the equation is known,
对于已知的圆方程,其直角坐标的一般方程为:For a known circle equation, the general equation for its rectangular coordinates is:
(x-a)2+(y-b)2=r2,(x-a)2+(y-b)2=r2,
其中,(a,b)为圆心坐标,r为圆的半径;Among them, (a, b) are the coordinates of the center of the circle, and r is the radius of the circle;
那么,参数空间可以表示为(a,b,r),图像坐标空间中的一个圆对应参数空间中的一个点;Then, the parameter space can be expressed as (a, b, r), a circle in the image coordinate space corresponds to a point in the parameter space;
任意形状的检测Detection of Arbitrary Shapes
首先选取该形状中的任意点(a,b)为参考点,然后从任意形状图形的边缘每一点上,计算其切线方向φ和到参考点(a,b)位置的偏移矢量r,以及r与x轴的夹角α;First select any point (a, b) in the shape as the reference point, then from each point on the edge of the arbitrary shape, calculate its tangent direction φ and the offset vector r to the position of the reference point (a, b), and The angle α between r and the x-axis;
参考点(a,b)的位置可由下式算出:The position of the reference point (a, b) can be calculated by the following formula:
a=x+r(φ)cos(α(φ))a=x+r(φ)cos(α(φ))
b=x+r(φ)sin(α(φ))。b=x+r(φ)sin(α(φ)).
在上述实现过程中,霍夫变换实现对图片进行检测间断点边界形状,通过将图像坐标空间变换到参数空间,来实现直线与曲线的拟合。In the above implementation process, the Hough transform realizes the detection of the discontinuous point boundary shape of the picture, and the fitting of the straight line and the curve is realized by transforming the image coordinate space into the parameter space.
附图说明Description of drawings
为了更清楚地说明本申请实施方式的技术方案,下面将对实施方式中所需要使用的附图作简单地介绍,应当理解,以下附图仅示出了本申请的某些实施例,因此不应被看作是对范围的限定,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他相关的附图。In order to illustrate the technical solutions of the embodiments of the present application more clearly, the following briefly introduces the accompanying drawings used in the embodiments. It should be understood that the following drawings only show some embodiments of the present application, and therefore do not It should be regarded as a limitation of the scope, and for those of ordinary skill in the art, other related drawings can also be obtained according to these drawings without any creative effort.
图1是本申请实施方式提供的方法步骤流程示意图;1 is a schematic flowchart of method steps provided by an embodiment of the present application;
图2为本申请实施方式提供的中值滤波的步骤流程示意图;2 is a schematic flowchart of steps of median filtering provided by an embodiment of the present application;
图3为本申请实施方式提供的区域生长分割的步骤流程示意图。FIG. 3 is a schematic flowchart of the steps of region growth and segmentation provided by an embodiment of the present application.
具体实施方式Detailed ways
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行描述。The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments of the present application.
为使本申请实施方式的目的、技术方案和优点更加清楚,下面将结合本申请实施方式中的附图,对本申请实施方式中的技术方案进行清楚、完整地描述,显然,所描述的实施方式是本申请一部分实施方式,而不是全部的实施方式。基于本申请中的实施方式,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施方式,都属于本申请保护的范围。In order to make the purposes, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments This is a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.
因此,以下对在附图中提供的本申请的实施方式的详细描述并非旨在限制要求保护的本申请的范围,而是仅仅表示本申请的选定实施方式。基于本申请中的实施方式,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施方式,都属于本申请保护的范围。Thus, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.
应注意到:相似的标号和字母在下面的附图中表示类似项,因此,一旦某一项在一个附图中被定义,则在随后的附图中不需要对其进行进一步定义和解释。It should be noted that like numerals and letters refer to like items in the following figures, so once an item is defined in one figure, it does not require further definition and explanation in subsequent figures.
在本申请的描述中,需要理解的是,术语“中心”、“纵向”、“横向”、“长度”、“宽度”、“厚度”、“上”、“下”、“前”、“后”、“左”、“右”、“竖直”、“水平”、“顶”、“底”、“内”、“外”、“顺时针”、“逆时针”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述本申请和简化描述,而不是指示或暗示所指的设备或元件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本申请的限制。In the description of this application, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", " rear, left, right, vertical, horizontal, top, bottom, inside, outside, clockwise, counterclockwise, etc., or The positional relationship is based on the orientation or positional relationship shown in the drawings, which is only for the convenience of describing the present application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, Therefore, it should not be construed as a limitation on this application.
此外,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本申请的描述中,“多个”的含义是两个或两个以上,除非另有明确具体的限定。In addition, the terms "first" and "second" are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implying the number of indicated technical features. Thus, a feature defined as "first" or "second" may expressly or implicitly include one or more of that feature. In the description of the present application, "plurality" means two or more, unless otherwise expressly and specifically defined.
在本申请中,除非另有明确的规定和限定,术语“安装”、“相连”、“连接”、“固定”等术语应做广义理解,例如,可以是固定连接,也可以是可拆卸连接,或成一体;可以是直接相连,也可以通过中间媒介间接相连,可以是两个元件内部的连通或两个元件的相互作用关系。对于本领域的普通技术人员而言,可以根据具体情况理解上述术语在本申请中的具体含义。In this application, unless otherwise expressly specified and limited, the terms "installed", "connected", "connected", "fixed" and other terms should be understood in a broad sense, for example, it may be a fixed connection or a detachable connection , or integrated; it can be directly connected or indirectly connected through an intermediate medium, and it can be the internal connection of two elements or the interaction relationship between the two elements. For those of ordinary skill in the art, the specific meanings of the above terms in this application can be understood according to specific situations.
在本申请中,除非另有明确的规定和限定,第一特征在第二特征之“上”或之“下”可以包括第一和第二特征直接接触,也可以包括第一和第二特征不是直接接触而是通过它们之间的另外的特征接触。而且,第一特征在第二特征“之上”、“上方”和“上面”包括第一特征在第二特征正上方和斜上方,或仅仅表示第一特征水平高度高于第二特征。第一特征在第二特征“之下”、“下方”和“下面”包括第一特征在第二特征正下方和斜下方,或仅仅表示第一特征水平高度小于第二特征。In this application, unless otherwise expressly specified and defined, a first feature "on" or "under" a second feature may include direct contact between the first and second features, or may include the first and second features Not directly but through additional features between them. Also, the first feature being "above", "over" and "above" the second feature includes the first feature being directly above and obliquely above the second feature, or simply means that the first feature is level higher than the second feature. The first feature is "below", "below" and "below" the second feature includes the first feature being directly below and diagonally below the second feature, or simply means that the first feature has a lower level than the second feature.
请参阅图1-3,本申请提供一种煤巷空顶区顶板图像特征的提取方法,包括有以下方法步骤:Please refer to FIGS. 1-3 , the present application provides a method for extracting image features of a roof in a hollow roof area of a coal roadway, including the following method steps:
S1、待综掘机割完煤体后,调整摄像机镜头位置对准空顶区裸露顶板;S1. After the fully mechanized excavator finishes cutting the coal body, adjust the position of the camera lens to aim at the exposed roof of the empty roof area;
S2、利用井上连接电脑采集一张张裸顶图像;S2. Use the well-connected computer to collect bare-top images;
S3、对裸顶图像进行预处理,分别采用伽马修正、中值滤波对图片的亮度和噪音进行调节消除;S3. Preprocess the bare-top image, and use gamma correction and median filtering to adjust and eliminate the brightness and noise of the image;
S4、图片经区域生长分割与霍夫变换提取岩体结构面轮廓;S4. The image is extracted by region growth segmentation and Hough transform to extract the contour of rock mass structure surface;
S5、对结构面轮廓细化以及间隔点连接,获取结构面骨架;S5. Refine the outline of the structural surface and connect the space points to obtain the skeleton of the structural surface;
S6、计算结构面特征参数,包括裂隙间隙宽度与粗糙度,对巷道裸顶进行分类。S6. Calculate the characteristic parameters of the structure surface, including the width and roughness of the crack gap, and classify the bare roof of the roadway.
在上述实现过程中,该方法可编程形成系统,空顶区顶板图像特征提取方法可以全自动处理,全过程均无人工干预,比较准确的对裸顶图像进行定性评价,对智能掘进超前探测以及如何支护干预提供较好的数据基础,并且通过多种算法处理,实现对空顶区顶板图像进行有效的计算处理,能够有效的实现对图片的亮度和噪音进行调节消除,并且提取岩体结构面轮廓,对结构面轮廓细化以及间隔点连接,获取结构面骨架,再计算结构面特征参数,包括裂隙间隙宽度与粗糙度,对巷道裸顶进行分类。In the above implementation process, the method can be programmed to form a system, and the feature extraction method of the roof image of the empty roof area can be processed automatically without manual intervention in the whole process. How to support the intervention to provide a better data basis, and through a variety of algorithm processing, to achieve effective calculation and processing of the roof image of the empty roof area, can effectively adjust and eliminate the brightness and noise of the picture, and extract the rock mass structure Surface profile, refine the profile of the structure surface and connect the interval points, obtain the skeleton of the structure surface, and then calculate the characteristic parameters of the structure surface, including the width and roughness of the crack gap, to classify the bare roof of the roadway.
在实施例中,所述S1中的调整摄像机镜头位置使得摄像机镜头与空顶保持相对的平行,即使得摄像机镜头拍摄的画面的平整,并且在摄像机镜头进行拍摄的时候,保持摄像机镜头平衡,防止晃动,使得摄像机镜头能够拍摄平整的图片,有效的提高图片的后续处理过程,保持图片的精准度。In the embodiment, the adjustment of the position of the camera lens in S1 makes the camera lens remain relatively parallel to the ceiling, that is, the image captured by the camera lens is flat, and when the camera lens is shooting, the balance of the camera lens is maintained to prevent Shaking enables the camera lens to take a flat picture, effectively improving the subsequent processing of the picture and maintaining the accuracy of the picture.
在具体方案中,所述摄像机镜头在进行拍摄的时候,通过补光灯实现对空顶进行补光照明,且补光照明采用无影LED灯进行照明,在较为黑暗的煤巷中进行拍摄清晰的画面,并且减少阴影,提高图片处理过程的精度。In a specific scheme, when the camera lens is shooting, the supplementary light is used to achieve supplementary lighting for the empty ceiling, and the supplementary light is illuminated by shadowless LED lights, and the shooting is clear in a relatively dark coal lane. picture, and reduce shadows, improve the accuracy of the picture processing process.
在实施例中,所述S2中的电脑采集裸顶图像的时候,通过存储数据卡或者是USB传输方式进行传输,且摄像机在进行裸顶图像存储的时候,对裸顶图像进行压缩存储,煤巷较深,线缆传输较为浪费资源,以及无线传输信号不好,容易造成图片丢失数据,通过存储数据卡或者是USB传输保持图片的精准度。In the embodiment, when the computer in S2 collects the bare-top image, it transmits through a storage data card or a USB transmission method, and when the camera stores the bare-top image, it compresses and stores the bare-top image, and the The lane is deep, the cable transmission is a waste of resources, and the wireless transmission signal is not good, which may easily cause the loss of data in the picture. The accuracy of the picture can be maintained through the storage data card or USB transmission.
在具体的实施中,所述电脑在通过存储数据卡或者是USB传输接收图片的时候,先对图片进行传输到电脑上,然后对图片进行无损解码处理,然后将图片进行预处理,在拍摄图片之后,对图片进行加压存储,可以提高存储量,且解码处理,便于实现对图片进行处理操作。In a specific implementation, when the computer receives a picture through a storage data card or a USB transmission, it first transmits the picture to the computer, then performs lossless decoding processing on the picture, and then preprocesses the picture, before taking the picture. Afterwards, pressurized storage of the picture can increase the storage capacity, and decoding processing facilitates the realization of the picture processing operation.
在一种具体的实施方案中,所述S3中的伽马修正是用来针对影片或是影像系统里对于光线的辉度或是三色刺激值所进行非线性的运算或反运算,由下列幂定律公式所定义的,In a specific implementation, the gamma correction in S3 is used to perform nonlinear operations or inverse operations on the luminance or tristimulus values of light in a film or imaging system, and is determined by the following Defined by the power law formula,
Vout=AVin λ,V out =AV in λ ,
其中A是一个常量,输入和输出的值都为非负实数值,在A=1的通常情况下,输入输出的值的范围都是在0到1之间,伽马值γ<1的情况时被称作编码伽马值,而执行这个编码运算所使用上述幂定律的过程也叫做伽马压缩;相对地,伽马值γ>1的情况时被称作解码伽马值,而执行这个解码运算所使用上述幂定律的过程也叫做伽马展开,所述伽马修正对明度和灰度计算公式如下:where A is a constant, and the input and output values are non-negative real values. In the usual case of A=1, the input and output values range from 0 to 1, and the gamma value γ<1 is called encoding the gamma value, and the process of performing the above-mentioned power law of the encoding operation is also called gamma compression; on the contrary, when the gamma value γ>1 is called decoding the gamma value, and performing this The above-mentioned power-law process used in the decoding operation is also called gamma expansion. The gamma correction has the following formulas for calculating lightness and grayscale:
RGB明度计算公式:RGB brightness calculation formula:
L取值范围为0-1,The value range of L is 0-1,
RGB灰度计算公式:RGB grayscale calculation formula:
通过伽马修正可以实现对图片进行有效的色彩处理,提高图像的色彩和明度,便于后续进行除噪。Through gamma correction, effective color processing can be achieved on the picture, which improves the color and brightness of the image, and facilitates subsequent noise removal.
在实施方案中,所述S3中的中值滤波是对一个滑动窗口内的诸像素灰度值排序,用其中值代替窗口中心象素的原来灰度值,用于实现对图像进行除噪处理,所述中值滤波的步骤如下所示:In an embodiment, the median filter in S3 is to sort the gray values of pixels in a sliding window, and use the median value to replace the original gray value of the center pixel of the window, so as to realize the denoising process of the image. , the steps of the median filter are as follows:
S301、将滤波模板,即含有若干个点的滑动窗口在图像中漫游,并将模板中心与图中某个像素位置重合;S301, roaming the filter template, namely a sliding window containing several points, in the image, and overlapping the template center with a certain pixel position in the figure;
S302、读取模板中各对应像素的灰度值;S302, read the gray value of each corresponding pixel in the template;
S303、将这些灰度值从小到大排列;S303, arrange these grayscale values from small to large;
S304、取这一列数据的中间数据,将其赋给对应模板中心位置的像素,如果窗口中有奇数个元素,中值取元素按灰度值大小排序后的中间元素灰度值,如果窗口中有偶数个元素,中值取元素按灰度值大小排序后,中间两个元素灰度的平均值。S304. Take the middle data of this column of data, and assign it to the pixel at the center position of the corresponding template. If there are an odd number of elements in the window, the median value is the gray value of the middle element after the elements are sorted according to the size of the gray value. If there are an even number of elements, the median value is the average of the gray levels of the two middle elements after the elements are sorted by gray value.
中值滤波对脉冲干扰级椒盐噪声的抑制效果好,在抑制随机噪声的同时能有效保护边缘少受模糊。The median filter has a good suppression effect on the impulse interference level salt and pepper noise, and can effectively protect the edges from blurring while suppressing random noise.
在有益的方案中,所述S4中的区域生长分割的步骤如下所示:In an advantageous solution, the step of region growing segmentation in S4 is as follows:
S401、对图像顺序扫描,找到第1个还没有归属的像素,设该像素为(x0,y0);S401, scan the image sequentially, find the first pixel that has not been attributed, and set the pixel to be (x0, y0);
S402、以(x0,y0)为中心,考虑(x0,y0)的8邻域像素(x,y)如果(x0,y0)满足生长准则,将(x,y)与(x0,y0)合并在同一区域内,同时将(x,y)压入堆栈;S402. Taking (x0, y0) as the center, consider the 8-neighborhood pixel (x, y) of (x0, y0), if (x0, y0) satisfies the growth criterion, combine (x, y) with (x0, y0) In the same area, push (x, y) onto the stack at the same time;
S403、从堆栈中取出一个像素,把它当作(x0,y0)返回到S402中;S403, take out a pixel from the stack and return it to S402 as (x0, y0);
S404、当堆栈为空时,返回到S401中;S404, when the stack is empty, return to S401;
S405、重复S401-S404直到图像中的每个点都有归属时,生长结束。S405, repeating S401-S404 until each point in the image has an attribution, and the growth ends.
区域生长方法是根据同一物体区域内象素的相似性质来聚集象素点的方法,将相邻的具有同样性质的象素或其它区域归并到目前的区域中从而逐步增长区域。The region growing method is a method of gathering pixels according to the similar properties of pixels in the same object region, and merges adjacent pixels or other regions with the same properties into the current region to gradually increase the region.
在具体中,所述S4中的霍夫变换用于检测间断点边界形状,通过将图像坐标空间变换到参数空间,来实现直线与曲线的拟合;Specifically, the Hough transform in the S4 is used to detect the boundary shape of the discontinuous point, and the fitting of the straight line and the curve is realized by transforming the image coordinate space into the parameter space;
直线坐标参数空间Linear Coordinate Parameter Space
在图像x-y坐标空间中,经过点(xi,yi)的直线表示为:In the image x-y coordinate space, the line passing through the point (xi, yi) is represented as:
yi=axi+b,yi=axi+b,
其中,参数a为斜率,b为截矩,Among them, the parameter a is the slope, b is the intercept,
通过点(xi,yi)的直线有无数条,且对应于不同的a和b值,There are an infinite number of straight lines passing through the point (xi, yi), which correspond to different a and b values,
如果将xi和yi视为常数,而将原本的参数a和b看作变量,则式子表示为:If xi and yi are regarded as constants, and the original parameters a and b are regarded as variables, the formula is expressed as:
b=-xia+yi,b=-xia+yi,
这样就变换到了参数平面a-b,这个变换就是直角坐标中对于(xi,yi)点的Hough变换;In this way, it is transformed to the parameter plane a-b, and this transformation is the Hough transformation of the (xi, yi) point in Cartesian coordinates;
极坐标参数空间Polar coordinate parameter space
极坐标中用如下参数方程表示一条直线,In polar coordinates, a straight line is represented by the following parametric equation,
ρ=xcosθ+ysinθ,ρ=xcosθ+ysinθ,
其中,ρ代表直线到原点的垂直距离,θ代表x轴到直线垂线的角度,取值范围为±90°;Among them, ρ represents the vertical distance from the line to the origin, θ represents the angle from the x-axis to the vertical line of the line, and the value range is ±90°;
曲线检测Curve detection
Hough变换同样适用于方程已知的曲线检测,The Hough transform is also suitable for curve detection where the equation is known,
对于已知的圆方程,其直角坐标的一般方程为:For a known circle equation, the general equation for its rectangular coordinates is:
(x-a)2+(y-b)2=r2,(x-a)2+(y-b)2=r2,
其中,(a,b)为圆心坐标,r为圆的半径;Among them, (a, b) are the coordinates of the center of the circle, and r is the radius of the circle;
那么,参数空间可以表示为(a,b,r),图像坐标空间中的一个圆对应参数空间中的一个点;Then, the parameter space can be expressed as (a, b, r), a circle in the image coordinate space corresponds to a point in the parameter space;
任意形状的检测Detection of Arbitrary Shapes
首先选取该形状中的任意点(a,b)为参考点,然后从任意形状图形的边缘每一点上,计算其切线方向φ和到参考点(a,b)位置的偏移矢量r,以及r与x轴的夹角α;First select any point (a, b) in the shape as the reference point, then from each point on the edge of the arbitrary shape, calculate its tangent direction φ and the offset vector r to the position of the reference point (a, b), and The angle α between r and the x-axis;
参考点(a,b)的位置可由下式算出:The position of the reference point (a, b) can be calculated by the following formula:
a=x+r(φ)cos(α(φ))a=x+r(φ)cos(α(φ))
b=x+r(φ)sin(α(φ))。b=x+r(φ)sin(α(φ)).
霍夫变换实现对图片进行检测间断点边界形状,通过将图像坐标空间变换到参数空间,来实现直线与曲线的拟合。The Hough transform realizes the detection of the discontinuous point boundary shape of the picture, and realizes the fitting of the straight line and the curve by transforming the image coordinate space into the parameter space.
具体的实施步骤如下:The specific implementation steps are as follows:
第一步、待综掘机割完煤体后,调整摄像机镜头位置对准空顶区裸露顶板;The first step, after the fully mechanized excavator has finished cutting the coal body, adjust the position of the camera lens to aim at the exposed roof of the empty roof area;
第二步、利用井上连接电脑采集一张张裸顶图像;The second step is to use the well-connected computer to collect bare-top images;
第三步、对裸顶图像进行预处理,分别采用伽马修正、中值滤波对图片的亮度和噪音进行调节消除;The third step is to preprocess the bare-top image, and use gamma correction and median filtering to adjust and eliminate the brightness and noise of the image;
第四步、图片经区域生长分割与霍夫变换提取岩体结构面轮廓;The fourth step, the image is extracted by region growth segmentation and Hough transform to extract the outline of rock mass structure surface;
第五步、对结构面轮廓细化以及间隔点连接,获取结构面骨架;The fifth step is to refine the outline of the structural surface and connect the interval points to obtain the skeleton of the structural surface;
第六步、计算结构面特征参数,包括裂隙间隙宽度与粗糙度,对巷道裸顶进行分类。The sixth step is to calculate the characteristic parameters of the structure surface, including the width and roughness of the crack gap, and classify the bare roof of the roadway.
以上所述仅为本申请的实施例而已,并不用于限制本申请的保护范围,对于本领域的技术人员来说,本申请可以有各种更改和变化。凡在本申请的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本申请的保护范围之内。应注意到:相似的标号和字母在下面的附图中表示类似项,因此,一旦某一项在一个附图中被定义,则在随后的附图中不需要对其进行进一步定义和解释。The above descriptions are merely examples of the present application, and are not intended to limit the protection scope of the present application. For those skilled in the art, various modifications and changes may be made to the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included within the protection scope of this application. It should be noted that like numerals and letters refer to like items in the following figures, so once an item is defined in one figure, it does not require further definition and explanation in subsequent figures.
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应所述以权利要求的保护范围为准。The above are only specific embodiments of the present application, but the protection scope of the present application is not limited to this. should be covered within the scope of protection of this application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210095250.2A CN114549808A (en) | 2022-01-26 | 2022-01-26 | Method for extracting image characteristics of roof in coal roadway empty-roof area |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210095250.2A CN114549808A (en) | 2022-01-26 | 2022-01-26 | Method for extracting image characteristics of roof in coal roadway empty-roof area |
Publications (1)
Publication Number | Publication Date |
---|---|
CN114549808A true CN114549808A (en) | 2022-05-27 |
Family
ID=81674345
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210095250.2A Withdrawn CN114549808A (en) | 2022-01-26 | 2022-01-26 | Method for extracting image characteristics of roof in coal roadway empty-roof area |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN114549808A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115100224A (en) * | 2022-06-29 | 2022-09-23 | 中国矿业大学 | A method and system for extracting head-on cross fissures in coal mine roadway |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112419250A (en) * | 2020-11-13 | 2021-02-26 | 湖北工业大学 | Pavement crack digital image extraction, crack repair and crack parameter calculation method |
-
2022
- 2022-01-26 CN CN202210095250.2A patent/CN114549808A/en not_active Withdrawn
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112419250A (en) * | 2020-11-13 | 2021-02-26 | 湖北工业大学 | Pavement crack digital image extraction, crack repair and crack parameter calculation method |
Non-Patent Citations (1)
Title |
---|
杨森: "基于岩体分类系统的煤巷掘进工作面顶板质量智能感知研究", 万方, 25 September 2019 (2019-09-25) * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115100224A (en) * | 2022-06-29 | 2022-09-23 | 中国矿业大学 | A method and system for extracting head-on cross fissures in coal mine roadway |
CN115100224B (en) * | 2022-06-29 | 2024-04-23 | 中国矿业大学 | Extraction method and system for coal mine roadway tunneling head-on cross fracture |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7343046B2 (en) | Systems and methods for organizing image data into regions | |
US7986831B2 (en) | Image processing apparatus, image processing method and computer program | |
JP4242532B2 (en) | Digital image data classification method | |
RU2601185C2 (en) | Method, system and computer data medium for face detection | |
CN112419250A (en) | Pavement crack digital image extraction, crack repair and crack parameter calculation method | |
CN111179243A (en) | Small-size chip crack detection method and system based on computer vision | |
CN110473221B (en) | Automatic target object scanning system and method | |
Rosenfeld | Image pattern recognition | |
CN109858325B (en) | Table detection method and device | |
CN108416355A (en) | A kind of acquisition method of the industry spot creation data based on machine vision | |
CN111814678A (en) | Video monitoring-based method and system for identifying coal flow in conveyor belt | |
CN108109157A (en) | A kind of rock mass analysis and assessment method based on digital panorama borehole image | |
US8861871B2 (en) | Image signature extraction device | |
CN111046950A (en) | Image processing method and device, storage medium and electronic device | |
CN107832674A (en) | A kind of method for detecting lane lines | |
CN113284158B (en) | Image edge extraction method and system based on structural constraint clustering | |
CN114972575A (en) | A Line Fitting Algorithm Based on Contour Edge | |
CN114549808A (en) | Method for extracting image characteristics of roof in coal roadway empty-roof area | |
CN116052020A (en) | UAV-based fast image interpretation method | |
CN109191516B (en) | Rotation correction method and device of structured light module and readable storage medium | |
CN116718599A (en) | Apparent crack length measurement method based on three-dimensional point cloud data | |
CN112070771B (en) | Adaptive threshold segmentation method, device and storage medium based on HS channel | |
CN111986169A (en) | Door and window detection method, system, terminal and medium | |
CN117934863A (en) | Adaptive FAST corner detection optimization algorithm based on grayscale mean | |
CN110246139B (en) | Method for rapidly extracting plankton in-situ image ROI (region of interest) based on double thresholds |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WW01 | Invention patent application withdrawn after publication | ||
WW01 | Invention patent application withdrawn after publication |
Application publication date: 20220527 |