CN114820368B - Damaged ceramic image restoration method and system based on 3D scanning - Google Patents
Damaged ceramic image restoration method and system based on 3D scanning Download PDFInfo
- Publication number
- CN114820368B CN114820368B CN202210450053.8A CN202210450053A CN114820368B CN 114820368 B CN114820368 B CN 114820368B CN 202210450053 A CN202210450053 A CN 202210450053A CN 114820368 B CN114820368 B CN 114820368B
- Authority
- CN
- China
- Prior art keywords
- image
- image set
- depth
- plane
- damaged
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/77—Retouching; Inpainting; Scratch removal
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Image Processing (AREA)
Abstract
The invention relates to the technical field of image processing, in particular to a damaged ceramic image restoration method and system based on 3D scanning, wherein the method comprises the following steps: acquiring a first plane image set and a first depth image set which are obtained by respectively carrying out image acquisition on broken ceramics by a monocular camera and a binocular camera under a plurality of same viewpoints; determining a damaged area of damaged ceramics according to the first plane image set, and performing image restoration on the damaged area to obtain a second plane image set; synthesizing the first depth image set to obtain a second depth image; repairing the second depth image according to the second plane image set to obtain a three-dimensional model of damaged ceramics; the invention can improve the efficiency of image restoration and perfectly reproduce the whole appearance of the ceramic as much as possible.
Description
Technical Field
The invention relates to the technical field of image processing, in particular to a damaged ceramic image restoration method and system based on 3D scanning.
Background
The virtual reality application based on the immersive 3D panoramic video can bring immersive experience such as immersive, depth feeling and interaction to the user, and has wide market demands and application values.
The ceramic is used for generating the 3D panoramic video, so that a user can remotely experience the effect, and due to the fact that the existing ceramic is damaged, when the damaged ceramic is subjected to three-dimensional reconstruction, a high-efficiency restoration algorithm needs to be researched so as to perfectly reproduce the whole appearance of the ceramic as much as possible.
Disclosure of Invention
The invention aims to provide a damaged ceramic image restoration method and system based on 3D scanning, which are used for solving one or more technical problems in the prior art and at least providing a beneficial selection or creation condition.
In order to achieve the above object, the present invention provides the following technical solutions:
A damaged ceramic image restoration method based on 3D scanning, the method comprising the steps of:
step S100, a first plane image set and a first depth image set which are obtained by respectively carrying out image acquisition on broken ceramics by a monocular camera and a binocular camera under a plurality of same viewpoints are obtained;
The first plane image set comprises a plurality of first plane images, the first depth image set comprises a plurality of first depth images, and the first plane images and the first depth images acquired under the same view point correspond to the same part of the damaged ceramic;
Step S200, determining a damaged area of damaged ceramics according to the first plane image set, and carrying out image restoration on the damaged area to obtain a second plane image set;
step S300, synthesizing the first depth image set to obtain a second depth image;
And step S400, repairing the second depth image according to the second plane image set to obtain a three-dimensional model of the damaged ceramic.
Further, the step S200 includes:
step S210, carrying out foreground image extraction on each first plane image in the first plane image set by adopting ALPHA MATTING matting algorithm to obtain a second plane image set;
Step S220, binarizing each second planar image in the second planar image set to obtain a plurality of binarized images;
step S230, determining two-dimensional coordinates of each pixel point in each binarized image, performing defect identification on the binarized image according to the coordinate direction by adopting a sliding window, and determining a defect area in the binarized image;
and step S240, performing image restoration on the defect area in each binarized image to obtain a third plane image set.
Further, the step S240 includes:
Step S241, selecting a group of pixel points in the defect area row by row or column by column according to the sliding direction of the sliding window;
step S242, synchronously calculating the average gray value of 8 neighborhood pixel points of each pixel point in the group of pixel points, and giving the average gray value to the pixel point to obtain a new gray value of each pixel point in the group of pixel points;
Step S243, each pixel point in the group of pixel points is updated to sum (pi.2 2 i) in turn, wherein sum () represents a summation function, and pi represents a new gray value of the ith neighborhood pixel point of the pixel point;
Step S244, repeating steps S241 to S244 until each pixel point of the defect area in each binarized image is updated, so as to obtain a third plane image set.
Further, the step S300 includes:
Step S310, dividing the points of each first depth image in the first depth image set according to a nine-square grid, taking the center point and the corner points of the nine-square grid as characteristic points, and forming a triangle sheet by the center point of the nine-square grid and any two adjacent corner points;
step S320, numbering each characteristic point in the first depth image set, and determining three-dimensional space coordinates of 3 characteristic points in each triangular piece to form a coordinate set corresponding to each triangular piece;
and step S330, registering the triangular plates with the same coordinate set in the first depth image set, merging the registered triangular plates to splice each first depth image in the first depth image set and synthesize a second depth image.
Further, the step S400 includes:
Step S410, determining the two-dimensional coordinates of the feature points according to the three-dimensional space coordinates of the feature points in the second depth image;
And step S420, keeping the depth information of the feature points in the second depth image unchanged, and replacing the RGB values of the feature points with the RGB values of the pixel points corresponding to the two-dimensional coordinates in the third plane image set to obtain the three-dimensional ceramic image.
A computer readable storage medium, wherein a computer program is stored on the computer readable storage medium, and the computer program when executed by a processor realizes the steps of the damaged ceramic image repair method based on 3D scanning.
A broken ceramic image restoration system based on 3D scanning, the system comprising:
at least one processor;
At least one memory for storing at least one program;
The at least one program, when executed by the at least one processor, causes the at least one processor to implement the broken ceramic image restoration method based on 3D scanning of any of the above.
The beneficial effects of the invention are as follows: the invention discloses a damaged ceramic image restoration method and a system based on 3D scanning, wherein the image restoration is carried out through a two-dimensional first plane image set, so that the efficiency of image restoration can be improved; the invention combines the two-dimensional image and the three-dimensional image to play respective advantages, can improve the efficiency of image restoration and can perfectly reproduce the integral appearance of the ceramic as much as possible.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions of the prior art, the drawings that are needed in the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic flow chart of a damaged ceramic image repair method based on 3D scanning in an embodiment of the invention;
FIG. 2 is a block diagram of a connection of a broken ceramic image restoration system based on 3D scanning in an embodiment of the invention.
Detailed Description
The conception, specific structure, and technical effects produced by the present application will be clearly and completely described below with reference to the embodiments and the drawings to fully understand the objects, aspects, and effects of the present application. It should be noted that, without conflict, the embodiments of the present application and features of the embodiments may be combined with each other.
Referring to fig. 1, fig. 1 shows a damaged ceramic image repairing method based on 3D scanning according to an embodiment of the present application, where the method includes the following steps:
step S100, a first plane image set and a first depth image set which are obtained by respectively carrying out image acquisition on broken ceramics by a monocular camera and a binocular camera under a plurality of same viewpoints are obtained;
The first plane image set comprises a plurality of first plane images, the first depth image set comprises a plurality of first depth images, and the first plane images and the first depth images acquired under the same view point correspond to the same part of the damaged ceramic;
Step S200, determining a damaged area of damaged ceramics according to the first plane image set, and carrying out image restoration on the damaged area to obtain a second plane image set;
step S300, synthesizing the first depth image set to obtain a second depth image;
And step S400, repairing the second depth image according to the second plane image set to obtain a three-dimensional model of the damaged ceramic.
In the embodiment provided by the invention, a first plane image set and a first depth image set of the same part in the damaged ceramic are respectively obtained, a damaged area of the damaged ceramic is determined according to the first plane image set, and the damaged area is subjected to image restoration to obtain a second plane image set, so that a restored two-dimensional image is obtained; then repairing the spliced second depth image according to the second plane image set to obtain a three-dimensional model of the damaged ceramic; according to the invention, the two-dimensional image and the three-dimensional image are combined, so that the respective advantages are exerted, the image restoration efficiency can be improved, and the overall appearance of the ceramic can be perfectly reproduced as much as possible.
In a preferred embodiment, the step S200 includes:
step S210, carrying out foreground image extraction on each first plane image in the first plane image set by adopting ALPHA MATTING matting algorithm to obtain a second plane image set;
Step S220, binarizing each second planar image in the second planar image set to obtain a plurality of binarized images;
step S230, determining two-dimensional coordinates of each pixel point in each binarized image, performing defect identification on the binarized image according to the coordinate direction by adopting a sliding window, and determining a defect area in the binarized image;
and step S240, performing image restoration on the defect area in each binarized image to obtain a third plane image set.
In a preferred embodiment, the step S240 includes:
Step S241, selecting a group of pixel points in the defect area row by row or column by column according to the sliding direction of the sliding window;
it should be noted that, if the sliding direction of the sliding window is from left to right, a manner of selecting a group of pixel points in the defect area is to sequentially select a column from left to right; if the sliding direction of the sliding window is from top to bottom, selecting a group of pixel points in the defect area in a mode of sequentially selecting one row from top to bottom;
step S242, synchronously calculating the average gray value of 8 neighborhood pixel points of each pixel point in the group of pixel points, and giving the average gray value to the pixel point to obtain a new gray value of each pixel point in the group of pixel points;
Step S243, each pixel point in the group of pixel points is updated to sum (pi.2 2 i) in turn, wherein sum () represents a summation function, and pi represents a new gray value of the ith neighborhood pixel point of the pixel point;
Step S244, repeating steps S241 to S244 until each pixel point of the defect area in each binarized image is updated, so as to obtain a third plane image set.
In a preferred embodiment, the step S300 includes:
Step S310, dividing the points of each first depth image in the first depth image set according to a nine-square grid, taking the center point and the corner points of the nine-square grid as characteristic points, and forming a triangle sheet by the center point of the nine-square grid and any two adjacent corner points;
step S320, numbering each characteristic point in the first depth image set, and determining three-dimensional space coordinates of 3 characteristic points in each triangular piece to form a coordinate set corresponding to each triangular piece;
and step S330, registering the triangular plates with the same coordinate set in the first depth image set, merging the registered triangular plates to splice each first depth image in the first depth image set and synthesize a second depth image.
In a preferred embodiment, the step S400 includes:
determining two-dimensional coordinates of the feature points according to the three-dimensional space coordinates of the feature points in the second depth image;
and keeping the depth information of the feature points in the second depth image unchanged, and replacing the RGB values of the feature points with the RGB values of the pixel points corresponding to the two-dimensional coordinates in the third plane image set to obtain the three-dimensional ceramic image.
Corresponding to the method of fig. 1, referring to fig. 2, an embodiment of the present invention further provides a damaged ceramic image repair system based on 3D scanning, the system comprising: memory 11, processor 12, and a computer program stored on memory 11 and executable on processor 12.
The processor 12 and the memory 11 may be connected by a bus or other means.
The non-transitory software programs and instructions required to implement the ceramic surface damage detection method of the above-described embodiments are stored in the memory 11, which when executed by the processor 12, perform the ceramic surface damage detection method of the above-described embodiments.
The content in the method embodiment is applicable to the system embodiment, the functions specifically realized by the system embodiment are the same as those of the method embodiment, and the achieved beneficial effects are the same as those of the method embodiment.
Furthermore, an embodiment of the present invention provides a computer-readable storage medium storing computer-executable instructions that are executed by a processor or controller, for example, by one of the above-described embodiments of the electronic device, so that the above-described processor performs the ceramic surface damage detection method in the above-described embodiment.
Those of ordinary skill in the art will appreciate that all or some of the steps, systems, and methods of the invention described above may be implemented as software, firmware, hardware, or any suitable combination thereof. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as known to those skilled in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer. Furthermore, as is well known to those of ordinary skill in the art, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media.
While the preferred embodiment of the present invention has been described in detail, the present invention is not limited to the above embodiment, and various equivalent modifications and substitutions can be made by those skilled in the art without departing from the spirit of the present invention, and these equivalent modifications and substitutions are intended to be included in the scope of the present invention as defined in the appended claims.
Claims (4)
1. A damaged ceramic image restoration method based on 3D scanning, the method comprising the steps of:
step S100, a first plane image set and a first depth image set which are obtained by respectively carrying out image acquisition on broken ceramics by a monocular camera and a binocular camera under a plurality of same viewpoints are obtained;
The first plane image set comprises a plurality of first plane images, the first depth image set comprises a plurality of first depth images, and the first plane images and the first depth images acquired under the same view point correspond to the same part of the damaged ceramic;
step S200, determining a damaged area of damaged ceramics according to the first plane image set, and carrying out image restoration on the damaged area to obtain a third plane image set;
step S300, synthesizing the first depth image set to obtain a second depth image;
step S400, repairing the second depth image according to the third plane image set to obtain a three-dimensional model of damaged ceramics;
The step S200 includes:
step S210, carrying out foreground image extraction on each first plane image in the first plane image set by adopting ALPHA MATTING matting algorithm to obtain a second plane image set;
Step S220, binarizing each second planar image in the second planar image set to obtain a plurality of binarized images;
step S230, determining two-dimensional coordinates of each pixel point in each binarized image, performing defect identification on the binarized image according to the coordinate direction by adopting a sliding window, and determining a defect area in the binarized image;
step S240, performing image restoration on the defect area in each binarized image to obtain a third plane image set;
the step S300 includes:
Step S310, dividing the points of each first depth image in the first depth image set according to a nine-square grid, taking the center point and the corner points of the nine-square grid as characteristic points, and forming a triangle sheet by the center point of the nine-square grid and any two adjacent corner points;
step S320, numbering each characteristic point in the first depth image set, and determining three-dimensional space coordinates of 3 characteristic points in each triangular piece to form a coordinate set corresponding to each triangular piece;
step S330, registering triangular plates with the same coordinate set in the first depth image set, merging the registered triangular plates to splice each first depth image in the first depth image set and synthesize a second depth image;
the step S400 includes:
Step S410, determining the two-dimensional coordinates of the feature points according to the three-dimensional space coordinates of the feature points in the second depth image;
And step S420, keeping the depth information of the feature points in the second depth image unchanged, and replacing the RGB values of the feature points with the RGB values of the pixel points corresponding to the two-dimensional coordinates in the third plane image set to obtain the three-dimensional ceramic image.
2. The method for repairing a damaged ceramic image based on 3D scanning according to claim 1, wherein step S240 comprises:
Step S241, selecting a group of pixel points in the defect area row by row or column by column according to the sliding direction of the sliding window;
step S242, synchronously calculating the average gray value of 8 neighborhood pixel points of each pixel point in the group of pixel points, and giving the average gray value to the pixel point to obtain a new gray value of each pixel point in the group of pixel points;
Step S243, each pixel point in the group of pixel points is updated to sum (pi.2 2 i) in turn, wherein sum () represents a summation function, and pi represents a new gray value of the ith neighborhood pixel point of the pixel point;
Step S244, repeatedly executing steps S241 to S243 until each pixel point of the defect area in each binarized image is updated, thereby obtaining a third plane image set.
3. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon a computer program which, when executed by a processor, implements the steps of the 3D scan-based broken ceramic image restoration method according to any of claims 1 to 2.
4. A broken ceramic image restoration system based on 3D scanning, the system comprising:
at least one processor;
At least one memory for storing at least one program;
The at least one program, when executed by the at least one processor, causes the at least one processor to implement the broken ceramic image restoration method based on 3D scanning as set forth in any one of claims 1 to 2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210450053.8A CN114820368B (en) | 2022-04-27 | 2022-04-27 | Damaged ceramic image restoration method and system based on 3D scanning |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210450053.8A CN114820368B (en) | 2022-04-27 | 2022-04-27 | Damaged ceramic image restoration method and system based on 3D scanning |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114820368A CN114820368A (en) | 2022-07-29 |
| CN114820368B true CN114820368B (en) | 2024-08-02 |
Family
ID=82508604
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210450053.8A Active CN114820368B (en) | 2022-04-27 | 2022-04-27 | Damaged ceramic image restoration method and system based on 3D scanning |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114820368B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118351099B (en) * | 2024-04-30 | 2024-12-03 | 中国中建设计研究院有限公司 | Automatic repair and positioning method and system for flaw stone |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109325990A (en) * | 2017-07-27 | 2019-02-12 | 腾讯科技（深圳）有限公司 | Image processing method and image processing apparatus, storage medium |
| CN112785688A (en) * | 2021-01-27 | 2021-05-11 | 广东职业技术学院 | Three-dimensional image reconstruction method and system for ceramic artwork |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8433157B2 (en) * | 2006-05-04 | 2013-04-30 | Thomson Licensing | System and method for three-dimensional object reconstruction from two-dimensional images |
| CN108961203B (en) * | 2018-02-19 | 2023-07-18 | 江苏新时高温材料股份有限公司 | A method for 3D reconstruction of defects in hollow plate ceramic membranes using ultrasonic and machine vision techniques |
| CN111970503B (en) * | 2020-08-24 | 2023-08-22 | 腾讯科技（深圳）有限公司 | Three-dimensional method, device and equipment for two-dimensional image and computer readable storage medium |
| CN112465723A (en) * | 2020-12-04 | 2021-03-09 | 北京华捷艾米科技有限公司 | Method and device for repairing depth image, electronic equipment and computer storage medium |
| CN112903703A (en) * | 2021-01-27 | 2021-06-04 | 广东职业技术学院 | Ceramic surface defect detection method and system based on image processing |
-
2022
- 2022-04-27 CN CN202210450053.8A patent/CN114820368B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109325990A (en) * | 2017-07-27 | 2019-02-12 | 腾讯科技（深圳）有限公司 | Image processing method and image processing apparatus, storage medium |
| CN112785688A (en) * | 2021-01-27 | 2021-05-11 | 广东职业技术学院 | Three-dimensional image reconstruction method and system for ceramic artwork |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114820368A (en) | 2022-07-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9013482B2 (en) | Mesh generating apparatus, method and computer-readable medium, and image processing apparatus, method and computer-readable medium | |
| CN111291584B (en) | Method and system for identifying two-dimensional code position | |
| US8452081B2 (en) | Forming 3D models using multiple images | |
| US8433157B2 (en) | System and method for three-dimensional object reconstruction from two-dimensional images | |
| US10043278B2 (en) | Method and apparatus for reconstructing 3D face with stereo camera | |
| Wang et al. | Stereoscopic inpainting: Joint color and depth completion from stereo images | |
| US20120176478A1 (en) | Forming range maps using periodic illumination patterns | |
| US20120177283A1 (en) | Forming 3d models using two images | |
| US20120176380A1 (en) | Forming 3d models using periodic illumination patterns | |
| JP2009536499A (en) | System and method for reconstructing a three-dimensional object from a two-dimensional image | |
| JP6762570B2 (en) | Image processing equipment, image processing method, and image processing program | |
| TW201123073A (en) | Image processing apparatus, image processing method, and program | |
| GB2565354A (en) | Method and corresponding device for generating a point cloud representing a 3D object | |
| CN110766767B (en) | Method, system and device for acquiring Gray code structured light image | |
| KR102061152B1 (en) | System for providing ar service and method for generating 360 angle rotatable image file thereof | |
| Alsadik et al. | Efficient use of video for 3D modelling of cultural heritage objects | |
| KR102158390B1 (en) | Method and apparatus for image processing | |
| CN114820368B (en) | Damaged ceramic image restoration method and system based on 3D scanning | |
| CN112243518A (en) | Method and device for acquiring depth map and computer storage medium | |
| CN113724365B (en) | Three-dimensional reconstruction method and device | |
| KR20170047780A (en) | Low-cost calculation apparatus using the adaptive window mask and method therefor | |
| JP2012105019A (en) | Image processing device, method, and program thereof | |
| CN112652056B (en) | 3D information display method and device | |
| CN115690180A (en) | Vector map registration method, registration system, electronic device and storage medium | |
| KR101993961B1 (en) | Hole Filling Method for Arbitrary View Image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |