CN105791681A - Control method, control device and electronic device - Google Patents

Abstract

The invention discloses a control method for controlling the flashlight of an imaging device. The imaging device comprises a laser distance measuring device. The control method comprises a first control step, a processing step and a second control step. The first control step is used for controlling the laser distance measuring device to emit lasers, thus obtaining the object distance of the human face of a photographed user. The processing step is used for processing a preview image obtained by the imaging device, thus identifying the age of the photographed user. The second control step is used for controlling the brightness of the flashlight according to the age and the object distance. Moreover, the invention also discloses a control device and an electronic device. According to the control method, the control device and the electronic device provided by the embodiment of the invention, the age information of the photographed user can be obtained according to a human face identification technique; through combination of the object distance of the photographed user, the brightness of the flashlight is controlled; the security of the user can be ensured; and moreover, the brightness of the flashlight demanded for photographing can be ensured.

Description

Control method, control device and electronic device

technical field

The invention relates to imaging technology, in particular to a control method, a control device and an electronic device.

Background technique

When taking pictures in low-light conditions, it is usually necessary to turn on the flash, but the existing mobile phones usually only have a fixed brightness when the flash is turned on. In some occasions, direct shooting of people will cause discomfort to users, and may even cause harm to young users. .

Contents of the invention

The present invention aims to solve at least one of the technical problems existing in the prior art. Therefore, the present invention needs to provide a control method, a control device and an electronic device.

The control method in the embodiment of the present invention is used to control the flash of an imaging device, the imaging device includes a laser distance measuring device, and the control method includes the following steps:

The first control step is to control the laser ranging device to emit laser light to obtain the object distance of the user's face being photographed;

a processing step of processing the preview image acquired by the imaging device to identify the age of the captured user; and

The second control step is to control the brightness of the flash light according to the age and the object distance.

The control device in the embodiment of the present invention is used to control the flash of the imaging device, the imaging device includes a laser distance measuring device, and the control device includes:

A first control module, the first control module is used to control the laser distance measuring device to emit laser light to obtain the object distance of the user's face;

a processing module, the processing module is used to process the preview image acquired by the imaging device to identify the age of the captured user; and

A second control module, the second control module is used to control the brightness of the flash light according to the age and the object distance.

An electronic device according to an embodiment of the present invention includes an imaging device and the above-mentioned control device.

The control method, control device, and electronic device in the embodiments of the present invention obtain the age information of the photographed user according to the face recognition technology, and control the brightness of the flashlight in combination with the object distance of the photographed user's face, so as to ensure the safety of the user and at the same time Ensure the brightness of the flash required for taking pictures.

Advantages of additional aspects of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.

Description of drawings

The above and/or additional aspects and advantages of the present invention will become apparent and comprehensible from the description of the embodiments in conjunction with the following drawings, wherein:

Fig. 1 is a schematic flowchart of a control method according to an embodiment of the present invention.

Fig. 2 is a schematic diagram of functional modules of the control device according to the embodiment of the present invention.

Fig. 3 is a schematic flowchart of a control method in some embodiments of the present invention.

Fig. 4 is a schematic diagram of functional modules of a control device in some embodiments of the present invention.

Fig. 5 is a schematic flowchart of a control method in some embodiments of the present invention.

Fig. 6 is a schematic flowchart of a control method in some embodiments of the present invention.

Fig. 7 is a state diagram of a control method in some embodiments of the present invention.

Fig. 8 is a schematic flowchart of a control device in some embodiments of the present invention.

detailed description

Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the drawings are exemplary, are only for explaining the embodiments of the present invention, and should not be construed as limiting the embodiments of the present invention.

Please refer to FIG. 1 , a control method according to an embodiment of the present invention is used to control a flash of an imaging device. Wherein, the imaging device includes a laser distance measuring device.

The control method includes the following steps:

S10, controlling the laser ranging device to emit laser light to obtain the object distance of the user's face;

S20, processing the preview image acquired by the imaging device to identify the age of the captured user; and

S30, control the brightness of the flash according to age and object distance.

Referring to FIG. 2 , the control device 100 according to the embodiment of the present invention includes a first control module 10 , a processing module 20 and a second control module 30 . As an example, the control method in the embodiment of the present invention can be realized by the control device 100 in the embodiment of the present invention, and can be applied to the electronic device 1000 , and the electronic device 1000 can include the control device 100 and the imaging device 200 . The imaging device 200 includes a flash 40 and a laser ranging device 50 .

Wherein, step S10 of the control method in the embodiment of the present invention can be realized by the first control module 10 , step S20 can be realized by the processing module 20 , and step S30 can be realized by the second control module 30 . That is to say, the first control module 10 is used to control the laser ranging device 50 to emit laser light to obtain the object distance of the photographed user's face. The processing module 20 is used for processing the preview image acquired by the imaging device 200 to identify the age of the captured user. The second control module 30 is used to control the brightness of the flashlight 40 according to age and object distance.

When taking pictures in a low-light environment, due to insufficient light, it is usually necessary to turn on a flash or a fill light to improve the lighting conditions of the subject. Low-light environments include but are not limited to environments with no or few light sources at night, as well as cloudy, dark, backlit or backlit environments during the day, all of which require the flash to be turned on when taking pictures.

Common flashes include light-emitting diode (LED) flashes and xenon flashes. LED flash lamps make the PN junction itself form an energy level by applying a voltage across the PN junction of the LED, and then electrons transition on this energy level and generate photons to emit light. The xenon flash lamp excites xenon gas ionization conduction through high-voltage electricity, so that the electric energy stored in the capacitor is converted into light energy through the discharge of the flash tube to complete the flash. The brightness and color temperature of Xenon flash lamp are better than LED. According to design and product requirements, electronic devices often use flashlights including LED flashlights or combinations of LED flashlights and Xenon flashlights.

Since the flashlight flashes instantaneously and has high brightness when it is working, it will make human eyes feel uncomfortable and even cause damage to eyesight when shooting portraits at close range.

A typical scene of the control method in the embodiment of the present invention may be shooting a portrait within a certain distance in a low-light environment.

When taking pictures, the user turns on the electronic device 1000 to enter the camera application. The electronic device 1000 can be a mobile phone, and the display screen of the mobile phone is used as a viewfinder. The user selects the subject through the display screen. Usually, the display screen includes a focusing frame. The subject is placed in the focus frame so that the imaging device 200 knows the subject that needs to be focused.

The imaging device 200 includes a laser distance measuring device 50, so the laser focus mode can be used to focus on the subject user. The laser distance measuring device 50 includes a laser emitting device (not shown in the figure) and a laser receiving device (not shown in the figure). Laser focusing mainly utilizes the characteristics of strong concentration of infrared light and is not easy to diffuse. By recording the time difference when infrared light is emitted from the laser emitting device, reflected from the target surface, and finally received, the image signal processor calculates the distance from the target to the imaging device. This distance is the object distance in the focusing process, and then calculate the specific value of the image distance that needs to be adjusted according to the focal length of the lens module, and then adjust the focusing position to achieve focusing. In particular, the laser focus mode is more advantageous than other focus modes in low-light environments.

It can be understood that since the portrait needs to be photographed, the laser emitted by the laser emitting device will be emitted to the face of the person, and the object distance thus obtained is the face-to-object distance.

The processing module 20 processes the preview image acquired by the imaging device 200, recognizes the face area through face recognition technology, and identifies the age of the captured user according to the current light conditions and feature values such as skin color and facial features of the face in the preview image. The recognized age value will be displayed to the user through the UI

It can be understood that the age recognized during the face recognition process may not be accurate due to lighting conditions, and the recognition result can be considered acceptable when the difference between the recognized age and the real age is within a certain range. For example, for a 3-year-old subject user, as long as the identification is between 1-5 years old, it can be considered as being within the correct result range.

The second control module 30 will control the brightness of the flashlight 50 when shooting according to the identified age of the user being photographed and the current object distance of the face.

It can be understood that for the same subject user, the shorter the object distance, the stronger the discomfort caused by the momentary flash of the same brightness. For different users, when the object distance is the same, the younger the user, the stronger the discomfort caused by the instant flash of the same brightness, and the greater the damage.

Therefore, the brightness of the flash will be controlled according to the object distance and the age of the user being photographed. For example, the younger the age and the closer the object distance, the lower the brightness of the flash.

To sum up, the control method, the control device 100 and the electronic device 1000 according to the embodiment of the present invention obtain the age information of the captured user according to the face recognition technology, and control the brightness of the flashlight in combination with the object distance of the captured user's face, which can To ensure the safety of users, at the same time, it can ensure the brightness of the flash required for taking pictures.

In some implementations, the electronic device 1000 may be an electronic terminal with a camera function, such as a mobile phone or a tablet computer. The imaging device 200 includes a front camera or/and a rear camera.

It can be understood that the electronic device 1000 includes but not limited to examples of this embodiment.

Referring to Fig. 3, in some embodiments, step S10 also includes the steps of:

S11, controlling the laser ranging device to emit multiple laser beams to the face of the user to be photographed to form multiple photographed points;

S12, processing the returned laser light received by the laser ranging device to obtain object distances of multiple photographed points; and

S13. Obtain the object distance of the human face according to the plurality of object distances.

Referring to FIG. 4 , in some embodiments, the first control module 10 includes: a control submodule 11 , a processing submodule 12 and an acquisition submodule 13 . Step S11 can be implemented by the control submodule 11, step S12 can be implemented by the processing submodule 12, and step S13 can be implemented by the acquisition submodule. In other words, the control sub-module 11 is used to control the laser distance measuring device 50 to emit multiple laser beams to the faces of the users to be photographed to form multiple photographed points. The processing sub-module 12 is used for processing the returned laser light received by the laser ranging device 50 to obtain object distances of multiple photographed points. The acquisition sub-module 13 is used to acquire the object distance of the human face according to multiple object distances.

Because the human face is not a plane but a bumpy three-dimensional. Therefore, in order to obtain a relatively accurate object distance, the object distance should be measured for the concave part and the convex part of the face respectively, so as to obtain multiple object distances. And process multiple object distances, for example, take an average value, so as to obtain the object distance of the face.

Referring to Fig. 5, in some embodiments, step S20 also includes the steps of:

S21, process the preview image to identify the area of the face; and

S22. Acquire the age of the captured user according to the area of the face and the object distance.

In some implementations, step S21 and step S22 can be implemented by the processing module 20 .

It can be understood that for users of the same age group, when the object distance is constant, the size of the face area is basically the same. Therefore, after determining the object distance, identifying the area of the human face in the preview image can determine the age of the photographed user. It should be noted that, as explained in the foregoing embodiments, the age identification does not necessarily require an accurate value of age, as long as it is a relatively accurate age group.

Preferably, before leaving the factory, the electronic device 1000 can perform machine learning to form a corresponding relationship by acquiring a large amount of object distance, face area and user age, and establish a corresponding database. In actual operation, after obtaining the object distance and determining the face area, the user's age or the age group of the user's age can be obtained.

Please refer to Fig. 6 and Fig. 7, in some embodiments, step S21 comprises steps:

S211, process the preview image to identify the first area where the face is located; and

S212. Determine an area within a predetermined distance from the center of the first area as the face area according to the object distance.

In some implementations, step S211 and step S212 can be implemented by the processing module 20 .

It can be understood that in a low-light environment, the difference between the face color and the background color is small, so the accuracy of face recognition is low. That is to say, the first area is an area including but not limited to a human face. As shown in FIG. 7 , the first area includes a human face, object A, and object B. Therefore, using the first area as the face area to identify the age of the captured user will not be accurate enough. It is necessary to determine the area of the face more accurately according to the acquired object distance, that is to say, determine the area of the face from the first area according to the object distance.

In some embodiments, the laser ranging device 50 may include a plurality of laser emitting devices, so that multiple laser beams can be emitted to different parts of the first area, for example, to the cheekbones, forehead, jaw, nose and other parts of the human face. A subject formed by multiple subjects and other subjects in the shooting background. Of course, in some implementations, the user can also control the electronic device 1000 so that the laser distance measuring device 50 respectively emits laser light to the photographed points to obtain the corresponding object distance.

For the object distance of multiple shooting points, a reference distance can be determined by taking the average value, or the center of the face, such as the object distance at the nose, can be selected as the reference distance, and the reference distance can be divided into a certain range of areas area as the face area. Points outside this range are used as redundant information, that is, non-face area areas. In this way, valid face regions can be identified.

In some embodiments, there are multiple object distances, multiple user ages, and multiple brightness of the flashlight 50, and each object distance and each age corresponds to a brightness threshold.

It can be understood that for the same object distance, the younger the age of the user, the lower the brightness of the flashlight 50 can be tolerated. For the same user, the smaller the object distance corresponding to the user, the lower the brightness that can be tolerated.

Before the electronic device 1000 leaves the factory, data can be obtained by simulating corresponding scenes through experiments, so as to set brightness thresholds corresponding to each object distance and each age, and establish a related database. In actual operation, the corresponding brightness threshold is corresponding to the obtained object distance and the recognized age.

In such an embodiment, the older the user is, the higher the brightness threshold of the flashlight 50 is.

When setting, the brightness threshold corresponding to the minimum age group can be used as a reference, and the corresponding brightness threshold can be gradually increased as the age increases.

Referring to FIG. 8, in some implementations, step S30 includes the steps of:

S31. Determine the corresponding brightness threshold according to the age of the user; and

S32. Control the brightness of the flashlight 50 according to the threshold of the object distance and the brightness.

In some embodiments, step S31 and step S32 can be implemented by the second control module 30 .

In operation, after determining the user's age, a corresponding brightness threshold may be determined. While controlling the flashlight 50, the brightness can be adjusted within the threshold range according to the current lighting environment. For example, when the light condition is not good, the brightness of the upper limit of the threshold can be used, and when the light condition is good, the brightness can be continuously lowered on the basis of the threshold.

In some implementations, the user interface may be used to display whether the night portrait setting is enabled, and the brightness of the flashlight 50 is controlled only after the setting is started. However, it is not necessary to control the brightness of the flashlight 50 when shooting buildings or scenes.

For other undeployed parts of the control device 100 and the electronic device 1000 in the embodiment of the present invention, reference may be made to the corresponding part of the control method in the above embodiment, and will not be elaborated here.

In describing the embodiments of the present invention, it should be understood that the terms "center", "longitudinal", "transverse", "length", "width", "thickness", "upper", "lower", "front ", "Back", "Left", "Right", "Vertical", "Horizontal", "Top", "Bottom", "Inside", "Outside", "Clockwise", "Counterclockwise", etc. The orientation or positional relationship is based on the orientation or positional relationship shown in the drawings, and is only for the convenience of describing the embodiment of the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, use a specific configuration and operation, and therefore should not be construed as limiting the embodiments of the present invention.

In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of said features. In the description of the embodiments of the present invention, "plurality" means two or more, unless otherwise specifically defined.

In the description of the embodiments of the present invention, it should be noted that unless otherwise specified and limited, the terms "installation", "connection", and "connection" should be understood in a broad sense, for example, it can be a fixed connection or a It is a detachable connection, or an integral connection; it can be mechanically connected, it can be electrically connected, or it can communicate with each other; it can be directly connected or indirectly connected through an intermediary, and it can be internal communication between two components or two components interaction relationship. Those of ordinary skill in the art can understand the specific meanings of the above terms in the embodiments of the present invention according to specific situations.

In the embodiments of the present invention, unless otherwise clearly specified and limited, the first feature being "on" or "under" the second feature may include direct contact between the first and second features, and may also include the first and second features. The second features are not in direct contact but through another feature between them. Moreover, "above", "above" and "above" the first feature on the second feature include that the first feature is directly above and obliquely above the second feature, or simply means that the first feature is horizontally higher than the second feature. "Below", "below" and "under" the first feature to the second feature include that the first feature is directly above and obliquely above the second feature, or simply means that the first feature is less horizontal than the second feature.

The above disclosure provides many different embodiments or examples for implementing different structures of embodiments of the present invention. To simplify the disclosure of the embodiments of the present invention, the components and arrangements of specific examples are described above. Of course, they are only examples and are not intended to limit the invention. Furthermore, embodiments of the present invention may repeat reference numerals and/or reference letters in different instances, such repetition is for simplicity and clarity and does not in itself indicate a relationship between the various embodiments and/or arrangements discussed. . In addition, embodiments of the present invention provide examples of various specific processes and materials, but one of ordinary skill in the art may recognize the use of other processes and/or the use of other materials.

In the description of this specification, reference to the terms "one embodiment", "some embodiments", "exemplary embodiments", "example", "specific examples" or "some examples" etc. Specific features, structures, materials, or features described in an embodiment or example are included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the described specific features, structures, materials or characteristics may be combined in any suitable manner in any one or more embodiments or examples.

Any process or method descriptions in flowcharts or otherwise described herein may be understood to represent modules, segments or portions of code comprising one or more executable instructions for implementing specific logical functions or steps of the process , and the scope of preferred embodiments of the invention includes alternative implementations in which functions may be performed out of the order shown or discussed, including substantially concurrently or in reverse order depending on the functions involved, which shall It is understood by those skilled in the art to which the embodiments of the present invention pertain.

The logic and/or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a sequenced listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium, For use with instruction execution systems, devices, or devices (such as computer-based systems, systems including processing modules, or other systems that can fetch instructions from instruction execution systems, devices, or devices and execute instructions), or in conjunction with these instruction execution systems, devices or equipment used. For the purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate or transmit a program for use in or in conjunction with an instruction execution system, device, or device. More specific examples (non-exhaustive list) of computer-readable media include the following: electrical connection with one or more wires (electronic device), portable computer disk case (magnetic device), random access memory (RAM), Read Only Memory (ROM), Erasable and Editable Read Only Memory (EPROM or Flash Memory), Fiber Optic Devices, and Portable Compact Disc Read Only Memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program can be printed, since the program can be read, for example, by optically scanning the paper or other medium, followed by editing, interpretation or other suitable processing if necessary. processing to obtain the program electronically and store it in computer memory.

It should be understood that each part of the embodiments of the present invention may be implemented by hardware, software, firmware or a combination thereof. In the embodiments described above, various steps or methods may be implemented by software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques known in the art: Discrete logic circuits, ASICs with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

Those of ordinary skill in the art can understand that all or part of the steps carried by the methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. During execution, one or a combination of the steps of the method embodiments is included.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing module, each unit may exist separately physically, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. If the integrated modules are realized in the form of software function modules and sold or used as independent products, they can also be stored in a computer-readable storage medium.

The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, and the like.

Although the embodiments of the present invention have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limiting the present invention, those skilled in the art can make the above-mentioned The embodiments are subject to changes, modifications, substitutions and variations.

Claims (17)

1. A control method, for controlling the flashlight of an imaging device, said imaging device comprising a laser distance measuring device, characterized in that said control method comprises the steps: The first control step is to control the laser ranging device to emit laser light to obtain the object distance of the user's face being photographed; a processing step of processing the preview image acquired by the imaging device to identify the age of the captured user; and The second control step is to control the brightness of the flash light according to the age and the object distance. 2. The control method according to claim 1, wherein the first control step comprises: controlling the laser distance measuring device to emit multiple laser beams to the human face to form a plurality of photographed points; processing the returned laser light received by the laser ranging device to obtain the object distances of the plurality of photographed points; and The object distance of the human face is acquired according to the plurality of object distances. 3. control method as claimed in claim 1, is characterized in that, described processing step comprises: processing the preview image to identify an area of the human face; and The age is determined according to the area and the object distance. 4. control method as claimed in claim 3 is characterized in that, the step of the area of described recognition human face comprises: processing the preview image to identify a first region where the face is located; and An area within a predetermined distance from a center of the first area is determined as the area according to the object distance. 5. The control method according to claim 1, wherein the object distance includes a plurality, the age includes a number, and the brightness includes a plurality, and each of the object distances and each of the ages corresponds to A brightness threshold. 6 . The control method according to claim 5 , wherein the higher the age, the higher the brightness threshold. 7 . 7. control method as claimed in claim 6 is characterized in that, described second control step comprises: determining a corresponding threshold of the brightness according to the age; and The brightness of the flashlight is controlled according to the object distance and the brightness threshold. 8. A control device for controlling the flash of an imaging device, the imaging device comprising a laser distance measuring device, characterized in that the control device comprises: A first control module, the first control module is used to control the laser distance measuring device to emit laser light to obtain the object distance of the user's face; a processing module, the processing module is used to process the preview image acquired by the imaging device to identify the age of the captured user; and A second control module, the second control module is used to control the brightness of the flash light according to the age and the object distance. 9. The control device according to claim 7, wherein the first control module comprises: A control submodule, the control submodule is used to control the laser distance measuring device to emit multiple laser beams to the human face to form multiple photographed points; A processing submodule, the processing submodule is used to process the returned laser light received by the laser ranging device to obtain the object distance of the plurality of photographed points; and An acquisition submodule, configured to acquire the object distance of the human face according to the plurality of object distances. 10. The control device according to claim 7, wherein the processing module is configured to process the preview image to identify the area of the human face and obtain the age according to the area and the object distance. 11. The control device according to claim 10, wherein the processing module is further configured to process the preview image to identify the first area where the face is located and divide the first area according to the object distance. The area of the region within a predetermined distance from the center of is determined as the area. 12. The control device according to claim 7, wherein the object distance includes a plurality, the age includes a number, and the brightness includes a plurality, and each of the object distances and each of the ages corresponds to A brightness threshold. 13. The control device according to claim 12, wherein the higher the age, the higher the brightness threshold. 14. The control device according to claim 13, wherein the second control module is configured to determine the corresponding brightness threshold according to the age and control the brightness threshold according to the object distance and the brightness threshold. the brightness of the flash. 15. An electronic device, comprising an imaging device and the control device according to any one of claims 8-14. 16. The electronic device according to claim 15, wherein the electronic device comprises a mobile phone or a tablet computer. 17. The electronic device according to claim 15, wherein the imaging device comprises a rear camera.