CN110058483A - Autofocus system, projection device, Atomatic focusing method and storage medium - Google Patents
Autofocus system, projection device, Atomatic focusing method and storage medium Download PDFInfo
- Publication number
- CN110058483A CN110058483A CN201810049955.4A CN201810049955A CN110058483A CN 110058483 A CN110058483 A CN 110058483A CN 201810049955 A CN201810049955 A CN 201810049955A CN 110058483 A CN110058483 A CN 110058483A
- Authority
- CN
- China
- Prior art keywords
- distance
- lens assembly
- projected image
- autofocus system
- projection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 44
- 238000004590 computer program Methods 0.000 claims description 13
- 238000005259 measurement Methods 0.000 abstract description 9
- 238000010586 diagram Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 4
- 230000008901 benefit Effects 0.000 description 2
- 239000013078 crystal Substances 0.000 description 2
- 238000003702 image correction Methods 0.000 description 2
- 230000001788 irregular Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- JEIPFZHSYJVQDO-UHFFFAOYSA-N ferric oxide Chemical compound O=[Fe]O[Fe]=O JEIPFZHSYJVQDO-UHFFFAOYSA-N 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/02—Mountings, adjusting means, or light-tight connections, for optical elements for lenses
- G02B7/04—Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification
- G02B7/09—Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification adapted for automatic focusing or varying magnification
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B21/00—Projectors or projection-type viewers; Accessories therefor
- G03B21/14—Details
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B21/00—Projectors or projection-type viewers; Accessories therefor
- G03B21/14—Details
- G03B21/147—Optical correction of image distortions, e.g. keystone
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B21/00—Projectors or projection-type viewers; Accessories therefor
- G03B21/14—Details
- G03B21/53—Means for automatic focusing, e.g. to compensate thermal effects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/74—Projection arrangements for image reproduction, e.g. using eidophor
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Projection Apparatus (AREA)
- Automatic Focus Adjustment (AREA)
- Transforming Electric Information Into Light Information (AREA)
Abstract
The present invention provides a kind of autofocus system, projection device, Atomatic focusing method and storage medium, the autofocus system includes: spatial light modulator, lens assembly, at least three range units and control device, wherein, the spatial light modulator is provided with the modulation areas for carrying out light modulation, and the light of the modulation areas outgoing passes through the lens assembly and forms projected image；The range unit is set to the position not on the same line at the modulation areas edge, and range unit is the distance of projected position corresponding on the range unit current location to the projected image for measuring first distance, the first distance；The control device is electrically connected with the multiple range unit, and the multiple first distances and preset rules for being obtained according to the range unit measurement control the lens assembly adjustment projection focal length accordingly or are corrected to the projected image.
Description
Technical field
The present invention relates to projection art, in particular to a kind of autofocus system, projection device, Atomatic focusing method
And storage medium.
Background technique
Currently, range unit is arranged in camera lens outer ring in part projection device, camera lens is measured to projection metope by telemetry
Distance.It is corresponding that automatic focusing system inside projection device adjusts the rotation of the focusing ring outside camera lens according to the distance
Angle, so that the image clearly projected.In addition, the image correction system inside projection device is according to the distance come to projection
Image is corrected.
It but is inclined when projecting metope, or since the distance of the partial region of projected picture can not detect, lead
The auto-focusing and method for correcting image for causing this projection device can bring some errors, so that at least partly area of projected image
Domain is unintelligible or in irregular shape.
Summary of the invention
The present invention, which provides one kind, can be realized auto-focusing and projection image correction, and improve the automatic right of focusing accuracy
Burnt system and its Atomatic focusing method, the present invention also provides a kind of projection device and computer readable storage mediums.
A kind of autofocus system, the autofocus system include:
Spatial light modulator is provided with the modulation areas for carrying out light modulation；
Lens assembly, the light of the modulation areas outgoing pass through the lens assembly and form projected image；
At least three range units are set to the position not on the same line at the modulation areas edge, each survey
Away from device for measuring first distance, the first distance be on the range unit current location to the projected image with its
The distance of corresponding projected position；And
Control device is electrically connected at least three range unit, for being surveyed according at least three range unit
The first distance and corresponding preset rules measured controls the lens assembly adjustment projection focal length or accordingly to the throwing
Shadow image is corrected.
A kind of projection device, including autofocus system as described above.
A kind of Atomatic focusing method is applied to an autofocus system, and the autofocus system includes space light modulation
Device and lens assembly, the spatial light modulator are provided with the modulation areas for carrying out light modulation, the modulation areas outgoing
Light pass through the lens assembly and form projected image, the Atomatic focusing method includes:
At least three first distances are obtained, at least three first distance is on the modulation areas edge not same
At least three positions on one straight line are respectively to the distance of corresponding projected position in the projected image；
The lens assembly adjustment projection is accordingly controlled according at least three first distance and corresponding preset rules
Focal length is corrected the projected image.
A kind of projection device, the projection device include processor, and the processor is used to execute to store in memory
The step of Atomatic focusing method as described above is realized when computer program.
A kind of computer readable storage medium, is stored thereon with computer program, and the computer program is held by processor
The step of Atomatic focusing method as described above is realized when row.
First distance obtained in autofocus system and Atomatic focusing method provided by the invention can be with respect to entire
The measurement of projected image, the projector distance of the projection device is more accurate, and modulates the camera lens according to the first distance and fill
The projection focal length set is corrected the projected image, to improve the auto-focusing and figure of the autofocus system
As the accuracy of correction, the projected image being emitted using the projection device of the autofocus system and the Atomatic focusing method
In regular shape, clarity is more evenly.
Detailed description of the invention
Fig. 1 is the perspective view for the projection device that present pre-ferred embodiments provide.
Fig. 2 is the main light path schematic diagram of autofocus system of projection device as shown in Figure 1.
Fig. 3 is main light path schematic diagram in another embodiment of autofocus system 230 as shown in Figure 2.
Fig. 4 is the structural block diagram of the autofocus system of projection device as shown in Figure 1.
Fig. 5 is the flow chart of the Atomatic focusing method of projection device as shown in Figure 1.
Main element symbol description
| Projection device | 100 |
| Ontology | 110 |
| Lens assembly | 120、220 |
| Modulation areas | 121 |
| Corner | A'-D' |
| Lens | 122 |
| Luminous lens | 123 |
| Focusing ring | 129 |
| Autofocus system | 130 |
| Range unit | 131 |
| Control device | 136 |
| Driving device | 137 |
| Driving chip | 137a |
| Motor | 137b |
| Plane | x、y |
| Corner | A-D |
The present invention that the following detailed description will be further explained with reference to the above drawings.
Specific embodiment
To better understand the objects, features and advantages of the present invention, with reference to the accompanying drawing and specific real
Applying example, the present invention will be described in detail.It should be noted that in the absence of conflict, embodiments herein and embodiment
In feature can be combined with each other.
In the following description, numerous specific details are set forth in order to facilitate a full understanding of the present invention, described embodiment is only
It is a part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, ordinary skill people
Member's every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
Unless otherwise defined, all technical and scientific terms used herein and belong to technical field of the invention
The normally understood meaning of technical staff is identical.Term as used herein in the specification of the present invention is intended merely to description tool
The purpose of the embodiment of body, it is not intended that in the limitation present invention.
Fig. 1, Fig. 2 and Fig. 4 are please referred to, Fig. 1 is the projection signal for the projection device 100 that present pre-ferred embodiments provide
Figure, Fig. 2 are the main light path schematic diagram of the autofocus system 130 of projection device 100 as shown in Figure 1, and Fig. 4 is such as Fig. 1 institute
The structural block diagram of the autofocus system 130 of the projection device 100 shown.Projection device 100 includes ontology 110 and auto-focusing system
System 130.
Further, autofocus system 130 includes spatial light modulator, lens assembly 120, at least three range units
131, control device 136 and driving device 137, control device 136 are electrically connected with range unit 131 and driving device 137 respectively.
Autofocus system 130 is used for according at least three range units 131 obtained at least three first distances of measurement and corresponding
Preset rules, the corresponding lens assembly 120 that controls adjust projection focal length or are corrected to the projected image.
Further, spatial light modulator is set to inside ontology 110, including the modulation areas for carrying out light modulation
121, the light that modulation areas 121 is emitted passes through lens assembly 120 and forms a projected image on plane x.To indicate clear, say
The modulation areas 121 of the spatial light modulator is only shown, the other structures of the spatial light modulator are omitted in bright book attached drawing.
In present embodiment, plane x is vertical with the optical axis of lens assembly 120.
Modulation areas 121 involved in the embodiment of the present invention may include: DMD (digital micro-mirror
Device, digital micromirror) the other well known optical modulator chip of chip and this field, such as LCD (crystal projection, Liquid
Crystal Display), LCOS (crystal projection of monocrystalline system, Liquid Crystal On Silico) chip etc..
As Figure 1-Figure 2, lens assembly 120 is set to one end of ontology 110, is provided at least in lens assembly 120
One lens.The lens 122 and luminous lens 123 in lens assembly 120 are shown in Fig. 2.Wherein, luminous lens 123 are apart from institute
State projected image distance recently.Light is successively emitted by lens 122 and luminous lens 123 after the reflection of over-modulation region 121.
It is understood that in other embodiments, lens assembly 120 can also include other lenses.What modulation areas 121 was emitted
Light sequentially passes through the lens in lens assembly 120, is emitted eventually by luminous lens 123.Final lens assembly 120 is projected out
What is come is the magnified picture of a quadrangle.Any point and a position pair in the projected image on 121 surface of modulation areas
It answers.
At least three range units 131 are respectively arranged at the position not on the same line on 121 edge of modulation areas,
For each range unit 131 for measuring first distance, the first distance that each range unit 131 measures is its current location to institute
State the distance of projected position corresponding in projected image.Since three points not on the same line can determine that one is flat
Face, then at least three range units 131 determined plane x position and modulation areas 121 to the projected image edge away from
From.
Range unit 131 includes one of infrared ray distance means or laser distance device.Range unit 131 uses phase
Position method measures the first distance, i.e., the light of 131 pairs of range unit sendings carry out amplitude modulation and to measure emergent ray round-trip
The phase delay of the primary generation, further according to the wavelength of emergent ray, convert distance representated by the phase delay.One
In kind embodiment, range unit 131 measures first distance using impulse method, i.e., the light of 131 pairs of range unit sendings are through putting down
It is received again by range unit 131 after the reflection of face x, range unit 131 records the light round-trip time.According to emergent ray
Wavelength, converse the first distance.In addition, range unit 131 may include distance measuring sensor and processing unit, the place
Reason unit handles the output signal of the sensor to obtain the first distance.In another embodiment, ranging
Device 131 includes distance measuring sensor, and control device 136 is handled to obtain described the to the output signal of the distance measuring sensor
One distance.
Control device 136 can be set inside lens assembly 120, can be single-chip microcontroller, central processing unit
(Central Processing Unit, CPU), can also be other general processors, digital signal processor (Digital
Signal Processor, DSP), specific integrated circuit (Application Specific Integrated Circuit,
ASIC), ready-made programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic
Device, discrete gate or transistor logic, discrete hardware components etc..General processor can be microprocessor or described
Processor is also possible to any conventional processor etc..
Control device 136 is used for according to multiple range units 131 obtained multiple first distances of measurement and corresponding default
Rule, the corresponding lens assembly 120 that controls adjust projection focal length or are corrected to the projected image.
In the case where the projector distance determines, the lens assembly 120 of projection device 100 is moved to the projection focal length
The clarity highest of the picture projected on position.
In addition, light is incident upon the plane x for being used for scattering light by projection device 100, therefore projection device 100 is opposite
The projected image is influenced whether in the position of projection plane x and angle and the distortion of lens assembly 120, so that the perspective view
As being shown as irregular quadrangle.At least three range units 131 are set to 121 edge of modulation areas by projection device 100
On position not on the same line, can determine institute according at least three first distances and corresponding preset rules that measure
State whether projected image has occurred geometric distortion, to further execute corresponding correction step to different types of geometric distortion
Suddenly.Most common geometric distortion is trapezoidal distortion, and projection device 100 can come with the function of vertical keystone correction, or there are also water
Flat trapezoid correction function.It is understood that projection device 100 can be carried out by the way of software correction or mechanical checkout
Geometric correction.
In one embodiment, control device 136 obtains ideal correspondingly at least three first distance
Distance.The ideal distance is the first distance when projected image is not distorted.And according to each first distance and often
A corresponding ideal distance of first distance and corresponding preset rules, obtain the deviation of each first distance.Specifically, described right
The preset rules answered are as follows: it is corresponding that the difference between ideal distance for taking the first distance corresponding obtains the first distance
Deviation.Whether in error range control device 136 judges the corresponding deviation of each ideal distance；If wherein at least one is managed
Want then to adjust apart from corresponding deviation beyond the error range in the projected image at least one described ideal distance pair
In the region answered after the size of each pixel, judge the deviation whether in error range again；If each ideal distance pair
The deviation answered is in the error range, then correction terminates, if the corresponding deviation of at least one ideal distance exceeds the mistake
Poor range then further adjusts at least one described ideal distance and corresponds to the pixel size in display area.
Preferably, if the corresponding ideal distance ratio of each deviation is in the range of -0.05~0.05.In the present invention
A preferred embodiment in, if the corresponding ideal distance ratio of each deviation is in the range of -0.03~0.03.
In a preferred embodiment of the invention, the corresponding ideal distance ratio of each deviation is -0.01~0.01
In range, in the range, the projected image is perceived in human eye shows as regular quadrilateral in range.It is appreciated that
Ideally, each deviation is 0, so that the projected image is rectangle, but actual error precision is difficult to
Accomplish this point, can only level off to so that each deviation is close to 0.
It is understood that can be adjusted first, in accordance with first trend, for example increase during adjusting pixel size
Pixel size in big corresponding region.Current deviation and last obtained deviation are done into ratio after adjusting according to first trend
Compared with adjusting corresponding area according to the opposite trend of the first trend if current deviation is greater than last obtained deviation
The size of domain pixel.In one embodiment, the pixel that control device 136 is adjusted according to proportionality coefficient in corresponding region is big
It is small.For example, the pixel adjustment proportionality coefficient at adjacent image edge is big in corresponding region, the pixel far from image border adjusts ratio
Coefficient is small.It is understood that the relationships such as direct proportion or index can also be met between the proportionality coefficient and location of pixels,
Here with no restrictions.
It is understood that provided by the invention be not limited to above-mentioned enumerate to the projected image corrected method
Method, can also be can be obtained according at least three first distance and other preset rules to the projected image into
The method of row correction.
Further, driving device 137 adjusts described according to the output signal of control device 136 control lens assembly 120
Projection focal length.
Three first distances that autofocus system 130 provided in an embodiment of the present invention measures are 121 surface of modulation areas
On edge at least three positions not on the same line to the projected image corresponding position distance, described three first away from
From the distance that the plane and modulation areas 121 determined where the projected image arrives the projected image edge, so that automatically
The projector distance that focusing system 130 obtains can with respect to entire projected image, so that the measurement of the projector distance is more accurate,
The automatic focusing accuracy for improving the autofocus system is emitted using the projection device 100 of autofocus system 130
The clarity of projected image is more evenly.In addition, due to autofocus system 130 measured 121 marginal surface of modulation areas up to
Few three positions not on the same line to the projected image corresponding position distance, so as to determine the perspective view
It seem the no figure for rule, if projected image is not the figure of rule, autofocus system 130 is further according to image border
Information is corrected the projected image.
In present embodiment, 121 surface of modulation areas is in rectangle, including four corner A'-D'.Modulation areas 121 is each
A range unit 131 is arranged in corner.Include in the projected image and the one-to-one corner A-D of corner A'-D'.Four rangings
The first distance that device 131 measures is respectively distance of the corner A' to corner A, the distance of corner B' to corner B, corner C' to angle
Fall the distance of C, distance of the corner D' to corner D.
It is understood that in other embodiments, range unit 131 can also be set to modulation areas 121 except angle
Fall the fringe region other than A'-D'.For example the midpoint in modulation areas 121 at least three different edges is respectively arranged with
One range unit 131, to measure three positions on 121 edge of modulation areas not on the same line to the projected image pair
Answer the distance of marginal position.
Further, the distance between modulation areas 121 and luminous lens 123 are second distance, autofocus system 130
It controls lens assembly 120 and adjusts corresponding preset rules when focal length are as follows: take between each first distance and the second distance
Difference, and multiple differences are averaged to obtain the projector distance.Projector distance i.e. in the preferred embodiment of the present invention refers to
Lens assembly 120 arrives the average distance at the projected image edge.It is understood that in one embodiment, it is automatic right
Burnt system 130 controls lens assembly 120 and adjusts corresponding preset rules when focal length are as follows: takes the flat of at least three first distance
Mean value, and the average value and the difference of the second distance is taken to obtain the projector distance.
Referring to Fig. 3, for main light path schematic diagram in another embodiment of autofocus system 230 as shown in Figure 2.
In present embodiment, the light that autofocus system 230 is emitted is transmitted through plane y and forms projected image.It is preferred real with the present invention
The main distinction for applying example is, the optical axis out of plumb of plane y and lens assembly 220.Autofocus system 230 and auto-focusing
System 130 is identical, does not repeat them here herein.In this case, autofocus system 230 can equally obtain modulation areas and arrive
The first distance at the projected image edge, the projector distance can with respect to entire projected image, thus it is described projection away from
From measurement it is more accurate, improve the accuracy of the lens assembly auto-focusing, the clarity of described image picture is more evenly.
In addition, whether autofocus system 230 can determine the projected image according to multiple first distances and corresponding preset rules
For the figure of rule, if projected image is not the figure of rule, autofocus system 230 is further according to image edge information pair
The projected image is corrected.
As shown in figure 4, after the projector distance that control device 136 is obtained using range unit 131, output and the throwing
Number of pulses of the shadow in corresponding pulse signal, the pulse signal is corresponding with the projector distance.Wherein, driving device
137 include driving chip 137a and motor 137b, and driving chip 137a believes according to the corresponding driving of the output of pulse signal
Number, motor 137b receives the driving signal and the focusing ring 129 of lens assembly 120 is driven to rotate corresponding angle.Focusing ring
129 are set on lens assembly 120, for adjusting the projection focal length of lens assembly 120.
Specifically, when the projector distance is h1, the projected image is made clearly to need to adjust 129 rotation phase of focusing ring
The angle answered is γ 1, and motor 137b rotates corresponding angle γ 1, the driving signal duration that driving chip 137a is provided
For t1, the number of pulses that control device 136 is sent to driving chip 137a is m1.Wherein, hmin < h1 < hmax, hmin are described
The minimum value of projector distance, hmax are the maximum value of projector distance.
When the projection is away from being h2, so that the projected image is clearly needed to adjust focusing ring 129 and rotate corresponding angles
Corresponding angle γ 2 is rotated for γ 2, motor 137b, the driving signal duration that driving chip 137a is provided is t2, corresponding
The number of pulses that control device 136 is sent to driving chip 137a is m2.Wherein, hmin < h2 < hmax.
When the projection is away from being h3, the projected image is made clearly to need to adjust the corresponding angle γ of focusing ring rotation
3, motor 137b rotate corresponding angle γ 3, and the driving signal duration that driving chip provides is t3, control device 136
The number of pulses sent to driving chip is m3.Wherein, hmin < h3 < hmax.
Control device 136 establishes the relationship between the projector distance and the number of pulses according to above data.Work as control
Device 136 processed obtains the projector distance, according to the projection away from acquisition and the projector distance respective pulses quantity, output packet
The pulse signal of the number of pulses is included, driving chip 137a is provided to motor 137b according to the number of pulses and driven letter
Number corresponding duration so that motor 137b rotates corresponding angle, and then controls the 129 corresponding angles of rotation of focusing ring
Degree.
In one embodiment, control device 136 obtains umber of pulse corresponding with the projector distance according to look-up table
Amount.Control device 136 establishes the corresponding relationship between the projector distance and the number of pulses；When projection device 100 projects
When, control device 136 obtains number of pulses corresponding with the projector distance according to the projector distance, and exports corresponding pulses
Signal.It is understood that autofocus system 130 can also include storage device, the storage device can be used for storing meter
Corresponding relationship between calculation machine program and/or module and the projector distance and the number of pulses.Control device 136 passes through fortune
Row executes the computer program and/or module that are stored in the storage device, and read the projector distance with it is described
Corresponding relationship between number of pulses realizes the function of autofocus system 130.The storage device can mainly include storage journey
Sequence area and storage data area, wherein storing program area can application program needed for storage program area and automatic focusing function
Deng；Storage data area can store the corresponding relationship etc. between the projector distance and the number of pulses.In addition, storage device can
It, can also be hard including non-volatile memory device, such as hard disk, memory, plug-in type to include high random access storage device
Disk, intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card, flash card
(Flash Card), at least one disk storage device part, flush memory device or other volatile solid-state storage device parts.
Referring to Fig. 5, the flow chart of the Atomatic focusing method for projection device 100 as shown in Figure 1.The auto-focusing
Method is applied to autofocus system 130, and autofocus system 130 includes spatial light modulator, lens assembly 120, at least three
A range unit 131, control device 136 and driving device 137, control device 136 are electrically connected with range unit and driving device 137
It connects.Spatial light modulator includes the modulation areas 121 for carrying out light modulation, and the light that modulation areas 121 is emitted passes through camera lens
Device 120 forms projected image.
The Atomatic focusing method includes:
S1: obtaining at least three first distances, and at least three first distance is on 121 edge of modulation areas not same
At least three positions on one straight line are respectively to the distance of corresponding projected position in the projected image.
In the embodiment of the present invention, at least three first distances are measured by least three range units 131.Specifically, until
Few three range units 131 are respectively arranged at the position not on the same line on 121 edge of modulation areas, each ranging dress
131 are set for measuring first distance, the first distance that range unit 131 measures be on its current location to the projected image with
The distance of its corresponding projected position.Since three points not on the same line can determine a plane, then at least three survey
It has been determined that the distance at the projected image edge is arrived in the position of plane x and modulation areas 121 away from device 131.
Range unit 131 includes one of infrared ray distance means or laser distance device.Range unit 131 uses phase
Position method measures the first distance, i.e., the light of 131 pairs of range unit sendings carry out amplitude modulation and to measure emergent ray round-trip
The phase delay of the primary generation, further according to the wavelength of emergent ray, convert distance representated by the phase delay.One
In kind embodiment, range unit 131 measures first distance using impulse method, i.e., the light of 131 pairs of range unit sendings are through putting down
It is received again by range unit 131 after the reflection of face x, range unit 131 records the light round-trip time.According to emergent ray
Wavelength, converse the first distance.In addition, range unit 131 may include distance measuring sensor and processing unit, the place
Reason unit handles the output signal of the sensor to obtain the first distance.In another embodiment, ranging
Device 131 includes distance measuring sensor, and control device 136 is handled to obtain described the to the output signal of the distance measuring sensor
One distance.
In two kinds of embodiments as shown in Figures 2 and 3, the first distance that range unit 131 measures is modulator zone
The distance at the projected image edge is arrived in domain 121, since three points not on the same line can determine a plane, then at least
The position of plane where three range units 131 have determined the projected image and modulation areas 121 arrive the projected image side
The distance of edge.
S2: the projection focal length is adjusted according at least three first distance and corresponding preset rules or to the throwing
Shadow image is corrected.
It is described that the adjustment throwing of lens assembly 120 is accordingly controlled according at least three first distance and corresponding preset rules
Shadow focal length, comprising the following steps:
S211: lens assembly 120 and the perspective view are obtained according to the multiple first distance and corresponding preset rules
Projector distance as between.
During autofocus system 130 adjusts the projection focal length, control device 136 is used to be filled according to multiple rangings
It sets multiple first distances that 131 measurements obtain and preset rules obtains the projector distance.Lens assembly 120 may include multiple
Lens, wherein apart from nearest lens be luminous lens 123 with the projected image, modulation areas 121 and luminous lens 123 it
Between distance be second distance.
Autofocus system 130 adjusts the corresponding preset rules of the projection focal length are as follows: take each first distance with it is described
Difference between second distance, and multiple differences are averaged to obtain the projector distance.In another embodiment, certainly
Dynamic focusing system 130 adjusts the corresponding preset rules of the projection focal length are as follows: takes the average value of multiple first distances, and takes described
The difference of average value and the second distance obtains the projector distance.
Since at least three first distance is the distance that modulation areas 121 arrives the projected image edge, so that from
The projector distance that dynamic focusing method obtains can with respect to entire projected image, so that the measurement of the projector distance is more accurate,
The automatic focusing accuracy for improving the Atomatic focusing method, the throwing being emitted using the projection device 100 of Atomatic focusing method
The clarity of shadow image is more evenly.
S212: lens assembly 120 is accordingly controlled according to the projector distance and adjusts the projection focal length.Including:
S2121: control device 136 establishes the corresponding relationship between the projector distance and output pulse signal.
Specifically, when the projector distance is h1, the projected image is made clearly to need to adjust 129 rotation phase of focusing ring
The angle answered is γ 1, and motor 137b rotates corresponding angle γ 1, the driving signal duration that driving chip 137a is provided
For t1, the number of pulses that control device 136 is sent to driving chip 137a is m1.Wherein, hmin < h1 < hmax, hmin are described
The minimum value of projector distance, hmax are the maximum value of projector distance.
When the projection is away from being h2, so that the projected image is clearly needed to adjust focusing ring 129 and rotate corresponding angles
Corresponding angle γ 2 is rotated for γ 2, motor 137b, the driving signal duration that driving chip 137a is provided is t2, corresponding
The number of pulses that control device 136 is sent to driving chip 137a is m2.Wherein, hmin < h2 < hmax.
When the projection is away from being h3, the projected image is made clearly to need to adjust the corresponding angle γ of focusing ring rotation
3, motor 137b rotate corresponding angle γ 3, and the driving signal duration that driving chip provides is t3, control device 136
The number of pulses sent to driving chip is m3.Wherein, hmin < h3 < hmax.
Control device 136 establishes the relationship between the projector distance and the number of pulses according to above data.One
In kind embodiment, control device 136 obtains number of pulses corresponding with the projector distance according to look-up table.
S2122: control device 136 exports corresponding pulse signal according to projector distance.
S2123: driving device 137 accordingly controls the lens assembly 120 according to the pulse signal and adjusts the projection
Focal length.
Driving device 137 includes driving chip 137a and motor 137b.Wherein driving chip 137a is according to the pulse
Quantity provides the duration corresponding with driving signal to motor 137b, so that motor 137b rotates corresponding angle, into
And control the 129 corresponding angle of rotation of focusing ring.
In one embodiment, it is described according at least three first distance and corresponding preset rules to the throwing
Shadow image is corrected, comprising the following steps:
S221: it obtains and the one-to-one ideal distance of at least three first distances.The ideal distance is described
First distance when projected image is not distorted.
S222: it according to each first distance, ideal distance corresponding with each first distance and corresponding preset rules, obtains
To the deviation of each first distance.
The corresponding preset rules are as follows: the difference between ideal distance for taking the first distance corresponding obtains often
The corresponding deviation of a ideal distance.
S223: whether in error range to judge the corresponding deviation of each ideal distance；
If the corresponding deviation of wherein at least one ideal distance exceeds the error range, adjust in the projected image
In region corresponding at least one described ideal distance after the size of each pixel, return step S223.
If the corresponding deviation of each ideal distance is in error range, correction terminates.
Preferably, if the corresponding ideal distance ratio of each deviation is in the range of -0.05~0.05.In the present invention
A preferred embodiment in, if the corresponding ideal distance ratio of each deviation is in the range of -0.03~0.03.
In a preferred embodiment of the invention, if the corresponding ideal distance ratio of each deviation is -0.01~0.01
In the range of.In the range, the projected image is perceived in human eye shows as regular quadrilateral in range.It can manage
Solution, ideally, each deviation is 0, so that the projected image is rectangle, but actual error precision is difficult
To accomplish this point, can only level off to so that each deviation is close to 0.
It is understood that can be adjusted first, in accordance with first trend, for example increase during adjusting pixel size
Pixel size in big corresponding region.Return step S223 after adjusting according to first trend obtains current deviation with last
To deviation compare, if current deviation is greater than last obtained deviation, according to the trend opposite with the first trend
To adjust the size of corresponding region pixel.In one embodiment, control device 136 adjusts corresponding area according to proportionality coefficient
Pixel size in domain.For example, the pixel adjustment proportionality coefficient of neighboring edge is big in corresponding region, the pixel far from edge is adjusted
Proportionality coefficient is small.It is understood that direct proportion or index can also be met between the proportionality coefficient and range pixel position
Etc. relationships, herein with no restrictions.
It is understood that provided by the invention be not limited to above-mentioned enumerate to the projected image corrected method
Method, can also be can be obtained according at least three first distance and other preset rules to the projected image into
The method of row correction.
Three first distances in Atomatic focusing method provided in an embodiment of the present invention are on 121 marginal surface of modulation areas
Distance of at least three positions not on the same line to the projected image corresponding position, three first distances determination
Plane and modulation areas 121 where the projected image arrive the distance at the projected image edge, so that auto-focusing system
The projector distance that system 130 obtains can be improved with respect to entire projected image so that the measurement of the projector distance is more accurate
The accuracy of the lens assembly auto-focusing, the clarity of described image picture more evenly, in addition, according to modulation areas 121
Distance of at least three positions not on the same line to the projected image corresponding position, auto-focusing system on marginal surface
System 130, which can also be realized, is corrected the projected image.
In one embodiment, control device 136 executes the above-mentioned Atomatic focusing method stored in the storage device
The step of.In another embodiment, projection device 100 includes processor and memory, and the processor is for executing institute
The step of stating the Atomatic focusing method stored in memory.Projection device 100 can also include light-source system and other this fields
Known optical element.
If the Atomatic focusing method is realized in the form of SFU software functional unit and sells or make as independent product
Used time can store in a computer readable storage medium.Based on this understanding, the present invention realizes above-described embodiment
All or part of the process in method can also instruct relevant hardware to complete, the calculating by computer program
Machine program can be stored in a computer readable storage medium, and the computer program is when being executed by processor, it can be achieved that above-mentioned
The step of each embodiment of the method.Wherein, the computer program includes computer program code, the computer program code
It can be source code form, object identification code form, executable file or certain intermediate forms etc..The computer-readable medium can
With include: can carry the computer program code any entity or device, recording medium, USB flash disk, mobile hard disk, magnetic disk,
CD, computer storage, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random
Access Memory), electric carrier signal, telecommunication signal and software distribution medium etc..It should be noted that the computer
The content that readable medium includes can carry out increase and decrease appropriate according to the requirement made laws in jurisdiction with patent practice, such as
It does not include electric carrier signal and telecommunication signal according to legislation and patent practice, computer-readable medium in certain jurisdictions.
In several embodiment/modes provided by the present invention, it should be appreciated that the method and apparatus, it can also
To realize in other way, Installation practice described above is only illustrative, the division of the module, only
It is a kind of logical function partition, there may be another division manner when realization.
It is obvious to a person skilled in the art that invention is not limited to the details of the above exemplary embodiments, Er Qie
In the case where without departing substantially from spirit or essential attributes of the invention, the present invention can be realized in other specific forms.Therefore, no matter
From the point of view of which point, the present embodiments are to be considered as illustrative and not restrictive, and the scope of the present invention is by appended power
Benefit requires rather than above description limits, it is intended that all by what is fallen within the meaning and scope of the equivalent elements of the claims
Variation is included in the present invention.Any reference signs in the claims should not be construed as limiting the involved claims.This
Outside, it is clear that one word of " comprising " does not exclude other units or steps, and odd number is not excluded for plural number.That states in device claim is multiple
Device can also be implemented through software or hardware by the same device or system.The first, the second equal words are used to indicate name
Claim, and does not indicate any particular order.
Finally it should be noted that the above examples are only used to illustrate the technical scheme of the present invention and are not limiting, although reference
Preferred embodiment describes the invention in detail, those skilled in the art should understand that, it can be to of the invention
Technical solution is modified or equivalent replacement, without departing from the spirit and scope of the technical solution of the present invention.
Claims (13)
1. a kind of autofocus system, which is characterized in that the autofocus system includes:
Spatial light modulator is provided with the modulation areas for carrying out light modulation；
Lens assembly, the light of the modulation areas outgoing pass through the lens assembly and form projected image；
At least three range units are set to the position not on the same line at the modulation areas edge, each ranging dress
It sets for measuring first distance, the first distance is corresponding on the range unit current location to the projected image
Projected position distance；And
Control device is electrically connected at least three range unit, for being measured according at least three range unit
The first distance and corresponding preset rules arrived controls the lens assembly adjustment projection focal length or to the perspective view accordingly
As being corrected.
2. autofocus system as described in claim 1, which is characterized in that the modulation areas includes four corners, described
Projection device includes four range units, and a range unit is arranged in every nook and cranny.
3. autofocus system as described in claim 1, which is characterized in that the control device according to the first distance and
Corresponding preset rules obtain the projector distance between the lens assembly and the projected image, and according to the projection away from
The projection focal length is adjusted from the lens assembly is controlled accordingly.
4. autofocus system as claimed in claim 3, which is characterized in that projected image described in distance in the lens assembly
Nearest lens are luminous lens, and the distance between the modulation areas and the luminous lens are second distance, the correspondence
Preset rules are as follows: take the difference between each first distance and the second distance, and multiple differences be averaged to obtain
The projector distance.
5. autofocus system as described in claim 1, which is characterized in that the autofocus system further includes driving dress
It sets, the driving device controls the lens assembly according to the output signal of the control device and adjusts the projection focal length.
6. autofocus system as claimed in claim 5, which is characterized in that the driving device includes driving chip and electronic
Machine, the control device export pulse signal corresponding with the projector distance, and the driving chip is according to the pulse signal
Export corresponding driving signal, the motor receive the driving signal and drive the focusing ring of the lens assembly rotate with
The corresponding angle of the projector distance.
7. autofocus system as described in claim 1, which is characterized in that at least three range unit includes infrared ray
One of range unit or laser ranging system or combination.
8. a kind of projection device, which is characterized in that including the autofocus system as described in claim 1-7 any one.
9. a kind of Atomatic focusing method is applied to an autofocus system, the autofocus system includes spatial light modulator
And lens assembly, the spatial light modulator are provided with the modulation areas for carrying out light modulation, the modulation areas outgoing
Light passes through the lens assembly and forms projected image, which is characterized in that the Atomatic focusing method includes:
At least three first distances are obtained, at least three first distance is on the modulation areas edge not with always
At least three positions on line are respectively to the distance of corresponding projected position in the projected image；
The lens assembly adjustment projection focal length is accordingly controlled according at least three first distance and corresponding preset rules
Or the projected image is corrected.
10. Atomatic focusing method as claimed in claim 9, which is characterized in that described according at least three first distance
And corresponding preset rules accordingly control the lens assembly adjustment projection focal length, comprising:
According at least three first distance and corresponding preset rules obtain the lens assembly and the projected image it
Between projector distance；
The lens assembly is controlled accordingly according to the projector distance adjusts the projection focal length.
11. Atomatic focusing method as claimed in claim 10, which is characterized in that perspective view described in distance in the lens assembly
As nearest lens be luminous lens, the distance between the modulation areas and the luminous lens be second distance, it is described right
The preset rules answered are as follows: take the difference between each first distance and second distance, and multiple differences are averaged to obtain institute
State projector distance.
12. a kind of projection device, which is characterized in that the projection device includes processor, and the processor is for executing storage
The step of Atomatic focusing method as described in any one of claim 9-11 is realized when the computer program stored in device.
13. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program
The step of Atomatic focusing method as described in any one of claim 9-11 is realized when being executed by processor.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810049955.4A CN110058483B (en) | 2018-01-18 | 2018-01-18 | Autofocus system, projection device, autofocus method and storage medium |
| PCT/CN2018/080885 WO2019140782A1 (en) | 2018-01-18 | 2018-03-28 | Automatic focusing system, projection apparatus, automatic focusing method, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810049955.4A CN110058483B (en) | 2018-01-18 | 2018-01-18 | Autofocus system, projection device, autofocus method and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110058483A true CN110058483A (en) | 2019-07-26 |
| CN110058483B CN110058483B (en) | 2022-06-10 |
Family
ID=67301234
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810049955.4A Active CN110058483B (en) | 2018-01-18 | 2018-01-18 | Autofocus system, projection device, autofocus method and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110058483B (en) |
| WO (1) | WO2019140782A1 (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110456602A (en) * | 2019-08-22 | 2019-11-15 | 歌尔股份有限公司 | A kind of projection pattern means for correcting of optical projection system, method and system |
| CN111586386A (en) * | 2020-06-01 | 2020-08-25 | 光峰光电(无锡)有限公司 | Ultra-short-focus projection method capable of automatically focusing and bidirectionally correcting trapezoid |
| CN112333435A (en) * | 2020-10-30 | 2021-02-05 | 歌尔科技有限公司 | Data adjusting method, terminal device and computer readable storage medium |
| CN114885138A (en) * | 2021-11-16 | 2022-08-09 | 海信视像科技股份有限公司 | Projection equipment and automatic focusing method |
| WO2023116393A1 (en) * | 2021-12-24 | 2023-06-29 | 深圳光峰科技股份有限公司 | Focusing method for projection device and projection device |
| CN117956279A (en) * | 2024-03-26 | 2024-04-30 | 山东沪金精工科技股份有限公司 | Mechanical equipment management system and management method based on image recognition technology |
| WO2025051013A1 (en) * | 2023-09-07 | 2025-03-13 | 青岛海信激光显示股份有限公司 | Laser projection device, focusing method and storage medium |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113203735B (en) * | 2021-05-11 | 2024-03-15 | 宁波胤瑞生物医学仪器有限责任公司 | Chip detection device |
| CN115883798A (en) * | 2021-09-29 | 2023-03-31 | 中强光电股份有限公司 | Focus adjustment method |
| CN114415459B (en) * | 2022-01-21 | 2024-05-14 | 广州瑞格尔电子有限公司 | Projector side projection adjusting method and adjusting device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5570140A (en) * | 1993-07-08 | 1996-10-29 | Mitsubishi Denki Kabushiki Kaisha | Projection unit for projection type display apparatus |
| JP2005070415A (en) * | 2003-08-25 | 2005-03-17 | Casio Comput Co Ltd | Projection apparatus, projection method, and program |
| CN1806436A (en) * | 2003-06-13 | 2006-07-19 | 卡西欧计算机株式会社 | Projector with tilt-angle detecting capability |
| CN105227838A (en) * | 2015-09-28 | 2016-01-06 | 广东欧珀移动通信有限公司 | A kind of image processing method and mobile terminal |
| CN106200225A (en) * | 2016-09-21 | 2016-12-07 | 北京小米移动软件有限公司 | The trapezoidal distortion correction method of projector and device |
| CN206650793U (en) * | 2016-09-29 | 2017-11-17 | 意法半导体(R&D)有限公司 | Image projecting equipment |
| CN107490927A (en) * | 2016-06-12 | 2017-12-19 | 中兴通讯股份有限公司 | Projected focus method and projecting apparatus based on camera |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH089309A (en) * | 1994-06-23 | 1996-01-12 | Canon Inc | Display method and its device |
| JP3772870B2 (en) * | 2003-08-25 | 2006-05-10 | カシオ計算機株式会社 | Projection apparatus, projection method, and program |
| JP6205777B2 (en) * | 2013-03-22 | 2017-10-04 | カシオ計算機株式会社 | Projection apparatus, projection method, and program for projection |
| CN107454372B (en) * | 2016-06-01 | 2021-05-14 | 中兴通讯股份有限公司 | Image correction method and device and projector |
-
2018
- 2018-01-18 CN CN201810049955.4A patent/CN110058483B/en active Active
- 2018-03-28 WO PCT/CN2018/080885 patent/WO2019140782A1/en active Application Filing
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5570140A (en) * | 1993-07-08 | 1996-10-29 | Mitsubishi Denki Kabushiki Kaisha | Projection unit for projection type display apparatus |
| CN1806436A (en) * | 2003-06-13 | 2006-07-19 | 卡西欧计算机株式会社 | Projector with tilt-angle detecting capability |
| JP2005070415A (en) * | 2003-08-25 | 2005-03-17 | Casio Comput Co Ltd | Projection apparatus, projection method, and program |
| CN1768527A (en) * | 2003-08-25 | 2006-05-03 | 卡西欧计算机株式会社 | Projector device, projection method, and recording medium for storing projection method |
| CN105227838A (en) * | 2015-09-28 | 2016-01-06 | 广东欧珀移动通信有限公司 | A kind of image processing method and mobile terminal |
| CN107490927A (en) * | 2016-06-12 | 2017-12-19 | 中兴通讯股份有限公司 | Projected focus method and projecting apparatus based on camera |
| CN106200225A (en) * | 2016-09-21 | 2016-12-07 | 北京小米移动软件有限公司 | The trapezoidal distortion correction method of projector and device |
| CN206650793U (en) * | 2016-09-29 | 2017-11-17 | 意法半导体(R&D)有限公司 | Image projecting equipment |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110456602A (en) * | 2019-08-22 | 2019-11-15 | 歌尔股份有限公司 | A kind of projection pattern means for correcting of optical projection system, method and system |
| CN111586386A (en) * | 2020-06-01 | 2020-08-25 | 光峰光电(无锡)有限公司 | Ultra-short-focus projection method capable of automatically focusing and bidirectionally correcting trapezoid |
| CN112333435A (en) * | 2020-10-30 | 2021-02-05 | 歌尔科技有限公司 | Data adjusting method, terminal device and computer readable storage medium |
| CN114885138A (en) * | 2021-11-16 | 2022-08-09 | 海信视像科技股份有限公司 | Projection equipment and automatic focusing method |
| WO2023116393A1 (en) * | 2021-12-24 | 2023-06-29 | 深圳光峰科技股份有限公司 | Focusing method for projection device and projection device |
| WO2025051013A1 (en) * | 2023-09-07 | 2025-03-13 | 青岛海信激光显示股份有限公司 | Laser projection device, focusing method and storage medium |
| CN117956279A (en) * | 2024-03-26 | 2024-04-30 | 山东沪金精工科技股份有限公司 | Mechanical equipment management system and management method based on image recognition technology |
| CN117956279B (en) * | 2024-03-26 | 2024-05-28 | 山东沪金精工科技股份有限公司 | Mechanical equipment management system and management method based on image recognition technology |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110058483B (en) | 2022-06-10 |
| WO2019140782A1 (en) | 2019-07-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110058483A (en) | Autofocus system, projection device, Atomatic focusing method and storage medium | |
| US7876384B2 (en) | Rear projection imaging system with image warping distortion correction system and associated method | |
| CN114466173A (en) | Projection equipment and projection display control method for automatically throwing screen area | |
| CN100394249C (en) | Projection-type display optical system | |
| WO2015172537A1 (en) | Dlp micro projector | |
| EP3144726A1 (en) | Linear dlp micro projector | |
| CN102608855A (en) | Lamp optical system for projected display of 3-LCOS (Liquid Crystal On Silicon) laser | |
| JP2008022551A (en) | System, method and video projector for automatically correcting image before projection | |
| US8870390B2 (en) | Low Z-height projection system for projecting structured light for 3D imaging | |
| US11512945B2 (en) | Control method for projector and projector | |
| US20020063852A1 (en) | Projection system and method of automatic focus | |
| CN102466957A (en) | Compact DLP miniature projector module | |
| CN101375612B (en) | Projection apparatus, projection method | |
| CN203811977U (en) | DLP micro projector | |
| CN107843335B (en) | Target surface veiling glare illuminance measurement device and measurement method | |
| CN110876045B (en) | Projection method and projector | |
| CN109598682A (en) | Image processing method, device and equipment | |
| CN115883799A (en) | Projector and projection method | |
| CN108496112B (en) | Projector and control method of projector | |
| US10284827B2 (en) | Automatic adjustment method and device for color wheel | |
| CN106990661A (en) | A kind of DLP projection system for 3-D scanning | |
| CN109634032B (en) | Image processing method and device | |
| CN112444930A (en) | Projection lens, focusing method and device of projection lens and projector | |
| CN110471246A (en) | Ray machine regulating system and method | |
| CN114842779A (en) | Laser projection image display method, device and computer storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |