CN107277363A - Image processing method, image processing apparatus and electronic equipment - Google Patents

Abstract

The application provides a kind of image processing method, image processing apparatus and electronic equipment.Described image processing method, including：Start camera to obtain the base image where target subject；Target subject is focused to obtain the blur-free imaging of the target subject；According to the angle of inclination of the camera lens of position adjustment camera of the target subject in the base image, to obtain result images.Image processing method, device and the electronic equipment of the application is based on shift shaft type camera lens module, realizes the inclination of camera lens, so as to effectively improve the virtualization effect of image.

Description

Image processing method, image processing device and electronic equipment

technical field

The present application relates to the technical field of mobile communication, and in particular to an image processing method, an image processing device and electronic equipment.

Background technique

With the development of electronic technology, more and more electronic devices are equipped with cameras to capture images, and the effects of captured images are more and more valued by users.

At present, in order to highlight the subject, it is necessary to perform blur processing on scenes other than the subject, that is, to focus on the subject, and to blur images of other subjects other than the subject. At present, in terms of high-end cameras, the focus of the image can be changed by rotating the camera head of the camera to change the incident light path, thereby realizing the blurring of part of the image. Tilt-shift photography was originally a common shooting method on large-format cameras. It rotates the lens, uses the shift (Shift) and tilt (Tilt) of the optical axis to correct perspective distortion, and can also choose the focus arbitrarily. Focus on the plane and change the clear range, which can actually increase the depth of field and blur the background.

However, the rotatable tilt-shift lens is bulky and poorly integrated for electronic equipment. However, in the current mobile phone camera module, the image plane and the optical axis of the lens are usually vertical, and the lens can only move along the focusing direction. It is impossible to increase the depth of field and blur the background by rotating the lens.

Contents of the invention

In view of the above-mentioned shortcomings of the prior art, the purpose of the present application is to provide an image processing method, an image processing device and an electronic device, which are used to solve the problems of poor image blurring effect in the prior art.

In order to achieve the above purpose and other related purposes, the first aspect of the present application provides an image processing method, including the following steps: start the camera to obtain the basic image where the target object is located; focus on the target object to obtain the target image clear imaging of the object; adjusting the inclination angle of the lens of the camera according to the position of the target object in the basic image to obtain a result image.

In some embodiments of the first aspect of the present application, the step of focusing on the target object to obtain a clear image of the target object includes: determining the shooting focal length according to the distance between the target object and the lens of the camera; The lens of the camera is focused according to the determined shooting focal length to obtain a clear image of the target object.

In some embodiments of the first aspect of the present application, in some embodiments of the first aspect of the present application, the step of adjusting the tilt angle of the lens of the camera according to the position of the target object in the basic image includes : Determine the tilt direction of the lens of the camera according to the position of the target object in the basic image; adjust the lens of the camera to a preset tilt angle according to the determined tilt direction.

In some embodiments of the first aspect of the present application, the step of determining the tilting direction of the camera lens according to the position of the target object in the basic image includes: calculating the position of the target object in the basic image The opposite direction of is used as the tilt direction of the lens of the camera.

In some embodiments of the first aspect of the present application, the step of adjusting the lens of the camera to a preset tilt angle according to the determined tilt direction includes: adjusting the lens of the camera to the preset tilt angle according to the determined tilt direction maximum inclination angle.

In some embodiments of the first aspect of the present application, the step of adjusting the lens of the camera to a preset tilt angle according to the determined tilt direction includes: adjusting the lens of the camera according to the determined tilt direction based on a selection instruction Adjust to the tilt angle corresponding to the selection command.

In the second aspect of the present application, an image processing device is provided, including: an image acquisition unit, configured to obtain a basic image of a target object through a camera; a processing unit, configured to focus on the target object to obtain the target image clear imaging of the object; an adjustment unit, configured to adjust the inclination angle of the lens of the camera according to the position of the target object in the basic image, so as to obtain a result image.

In some implementations of the second aspect of the present application, the processing unit includes: a focal length determination unit, which determines the shooting focal length according to the distance between the target object and the lens of the camera; The lens is focused to obtain a clear image of the target subject.

In some embodiments of the second aspect of the present application, the adjustment unit includes: a direction adjustment unit, configured to determine the tilt direction of the lens of the camera according to the position of the target object in the basic image; an angle adjustment unit, to The lens of the camera is adjusted to a preset tilt angle according to the determined tilt direction.

In some implementations of the second aspect of the present application, the direction adjustment unit is configured to use the direction opposite to the position of the target object in the basic image as the tilt direction of the lens of the camera.

In some implementations of the second aspect of the present application, the angle adjustment unit is configured to adjust the lens of the camera to a maximum tilt angle of the lens according to the determined tilt direction.

In some implementations of the second aspect of the present application, the angle adjustment unit is configured to adjust the lens of the camera according to the determined tilt direction to a tilt angle corresponding to the selection command based on the selection command.

In some implementations of the second aspect of the present application, the image processing device further includes: a display unit configured to display the acquired basic image, the clear imaging of the target object, and the resulting image.

In some embodiments of the second aspect of the present application, the display unit is further configured to display a selection instruction and an image formed after adjusting the tilt angle of the lens based on the selection instruction.

The third aspect of the present application provides an electronic device, including: a camera and a processor, the processor is used to obtain the basic image of the target object through the camera, and focus on the target object to obtain the image of the target object Clear imaging and adjusting the tilt angle of the lens of the camera according to the position of the target object in the basic image to obtain a result image.

In some embodiments of the third aspect of the present application, the electronic device further includes: a display screen, configured to display the acquired basic image, the clear imaging of the target object, and the resulting image.

As mentioned above, the image processing method, image processing device and electronic equipment of the present application have the following beneficial effects:

The image processing method of the present application determines the inclination direction of the lens through the position of the target object in the basic image, and obtains a high-quality blur effect by adjusting the inclination angle of the lens.

In addition, the size of the tilt angle can also be controlled based on the selection instruction, thereby further improving the blurring effect of the image, and greatly improving the practicability of the device and user experience.

Description of drawings

FIG. 1 is a schematic diagram of the architecture of an image processing device of the present application in an implementation manner.

FIG. 2 is a schematic diagram showing the position of the target subject in the basic image in the present application.

FIG. 3 is a schematic diagram showing the structure of the tilt-shift lens module of the present application.

FIG. 4 is a schematic flowchart of an implementation of the image processing method of the present application.

detailed description

The implementation of the present application will be described by specific specific examples below, and those skilled in the art can easily understand other advantages and effects of the present application from the content disclosed in this specification.

In the following description, reference is made to the accompanying drawings, which illustrate several embodiments of the application. It is to be understood that other embodiments may be utilized, and that mechanical, structural, electrical, and operational changes may be made without departing from the spirit and scope of the present disclosure. The following detailed description should not be considered as limiting, And the scope of the embodiments of the present application is defined only by the claims of the issued patent. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the application. Spatially relative terms such as "upper", "lower", "left", "right", "below", "below", "lower", "above", "upper", etc., may be used in the text for ease of explanation The relationship of one element or feature to another element or feature shown in the figures.

Furthermore, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It should be further understood that the terms "comprising", "including "Indicates the presence of said features, steps, operations, elements, components, items, species, and/or groups, but does not exclude one or more other features, steps, operations, elements, components, items, species, and/or The existence, occurrence or addition of groups. The terms "or" and "and/or" as used herein are to be construed as inclusive, or to mean either one or any combination. Thus, "A, B or C" or "A, B and/or C" means "any of the following: A; B; C; A and B; A and C; B and C; A, B and C". An exception to this definition occurs when certain methods are inherently mutually exclusive.

Please refer to FIG. 1 . FIG. 1 is a schematic structural diagram of an image processing device of the present application in an implementation manner. As shown in the figure, the image processing device 100 includes: an image acquisition unit 10 , a processing unit 20 and an adjustment unit 30 .

The image acquisition unit 10 is used to acquire the basic image of the target subject through the camera. Specifically, the camera may include: a lens and a photosensitive element. The photosensitive element is, for example, a Charge Coupled Device (CCD), a Complementary Metal-Oxide Semiconductor (CMOS) element or other elements. The image acquisition unit 10 may be a combination of hardware and software, and is used to drive the camera to acquire the basic image where the target object is located. Specifically, the image light waves acquired by the photosensitive element are converted into electrical signals pixel by pixel, and the converted electrical signals are transmitted to the image acquisition unit for processing frame by frame, so as to generate appropriate imaging signals, and finally acquire the target image. The base image where the subject is located. In this embodiment, the target subject refers to the subject corresponding to the target subject in the image field of the lens.

The processing unit 20 is used to focus on the target object to obtain a clear image of the target object; in this embodiment, the processing unit 20 may include: a focal length determination unit and a focusing unit, (not shown in the figure out), the focal length determining unit is used to determine the shooting focal length according to the distance between the target shooting object and the camera lens; the focusing unit is used to focus the camera lens according to the determined shooting focal length to obtain the target shooting object Clear imaging.

In this embodiment, auto focus (Auto Focus) can be used to achieve clear imaging of the target object. Auto focus can be used in cameras and mobile phone cameras to take pictures, so that the blur and spots of the picture can be eliminated, and the picture can be changed into clear and bright. Specifically, in this embodiment, focusing on the target object can be achieved by means of face auto focus (Face Auto Focus) or manual touch focus (Touch Auto Focus).

The adjustment unit 30 is configured to adjust the tilt angle of the lens of the camera according to the position of the target object in the basic image, so as to obtain a result image.

In this embodiment, the adjustment unit includes: a direction adjustment unit and an angle adjustment unit (not shown in the figure). The direction adjustment unit is used to determine the tilt direction of the lens of the camera according to the position of the target object in the basic image; the angle adjustment unit is used to adjust the lens of the camera to a preset tilt according to the determined tilt direction angle. Specifically, the direction adjusting unit is configured to use the direction opposite to the position of the target object in the basic image as the tilt direction of the lens of the camera.

Taking mobile phone photography as an example, please refer to Figure 2. Figure 2 shows a schematic diagram of the position of the target object in the basic image in this application. As shown in the figure, the basic image P where the target object F is located is acquired by the mobile phone camera, and The base image P is displayed by a display screen. If the position of the target object F in the basic image P is "upper left", then the direction adjustment unit uses "lower right" as the tilting direction of the camera. The position of the target subject F in the basic image P can be realized by a platform end including an image signal processor (Image Signal Processing, ISP). The platform end of the mobile phone includes but is not limited to Qualcomm (Qualcomm), Intel (Intel), Samsung and more.

After the tilt direction of the camera is obtained, the tilt angle of the camera is adjusted by the angle adjustment unit. In one implementation, the angle adjustment unit adjusts the lens of the camera to the maximum tilt angle of the lens according to the determined tilt direction . In the above example, the working mode of the angle adjustment unit is: adjust the lens of the camera to the maximum tilt angle according to the tilt direction of "lower right", such as the maximum tilt angle of the tilt-shift (Tilt-shift) lens of a mobile phone is 1.5 degrees.

Tilt-shift optical image stabilization motor (Optical Image Stabilization, OIS), different from ordinary auto focus (Auto Focus, AF) motor, the spring suspension system of the tilt-shift OIS motor not only allows the lens to move along the focus direction The movement also allows the lens to make a slight tilt in any direction relative to a fulcrum of the rotation axis, and the tilt angle can reach 1.5°. Please refer to FIG. 3 . FIG. 3 shows a schematic structural diagram of the tilt-shift lens module of the present application. As shown in the figure, the tilt-shift lens module includes: a lens 31 , a tilt-shift focus driver (Tilt/AF actuator) 32 , an image sensor (imagesensor) 33, a software module (Tilt/AF algorithm) 34 for shifting focus, a shutter release (shutter release) 35, an image processor (ISP) 36, and an optical image stabilization gyroscope (OIS gyroscope) )37.

Use the shifting lens module shown in Figure 3 to shoot the shooting scene 40 and display it on the display screen of the mobile phone, and determine the position of the target object in the basic image by the image processor 36, for example, target shooting The position of the object in the basic image is located in the upper left position in the basic image as shown in the figure; then the tilt direction of the lens 31 of the tilt-shift lens is determined to be "bottom right" by the tilt-shift focusing software module 34, and the tilt angle is this The maximum inclination angle of the lens 31 (such as 1.5 degrees), then the lens 31 is driven by the shifting focus driver 32 so that the lens 31 is tilted to the lower right until it is tilted to the maximum inclination angle (such as 1.5 degrees) of the lens. Spend).

In this embodiment, the image processing apparatus may further include: a display unit 40 . The display unit 40 is used for displaying the obtained basic image, the clear imaging of the target object and the resulting image.

Taking a mobile phone as an example, the display unit may be implemented by a touch screen of the mobile phone, and the touch screen of the mobile phone may accept user input based on tactile and/or tactile contact. The touch screen forms a touch-sensitive surface that accepts user input. The touch screen and touch screen controller (along with any associated modules and/or instruction sets in memory) detect contact on the touch screen (and any movement or interruption of said touch) and translate the detected contact into a Interaction of user interface objects such as one or more soft keys on the touch screen. In one exemplary embodiment, the point of contact between the touch screen and the user corresponds to one or more fingers of the user. The touch screen may use LCD (Liquid Crystal Display) technology or LPD (Light Emitting Polymer Display) technology, although in other embodiments other display technologies may be used. Touchscreens and touchscreen controllers can detect contact and its movement or interruption using any of a variety of touch-sensitive technologies, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays , or other techniques for determining one or more points of contact with the touchscreen. Touch screens display visual output from portable devices, while touch-sensitive panels provide no visual output. The touch screen may have a resolution higher than 100dpi. In one exemplary embodiment, the touch screen may have a resolution of approximately 168dpi. A user may use any suitable object or accessory, such as a stylus, finger, etc., to contact the touch screen.

Continuing to refer to FIG. 2 and FIG. 3 , in other implementation manners, the angle adjustment unit may also adjust the lens of the camera according to the determined tilt direction to a tilt angle corresponding to the selection command based on the selection command. The display unit can also display the selection instruction and the image formed after adjusting the tilt angle of the lens based on the selection instruction.

Still taking the mobile phone as an example, when the image acquired by the shifting lens module is displayed on the touch screen of the mobile phone, the user can perform a touch-focus operation on the image on the touch screen based on actual needs (of course, you can also choose to focus on the face); At this time, the user outputs a "focus selection instruction" through the touch screen, and based on the "focus selection instruction", the image processor 36 in the shifting lens module determines the target subject (ie, the subject corresponding to the user's touch operation) The position on the basic image, for example, if the target object is located at the upper left position shown in FIG. on the phone's touch screen. At this time, the user can select the tilt angle based on the feedback information on the touch screen, that is, output the "tilt angle selection command" through the touch screen, and based on the "tilt angle selection command", the lens 31 is carried out by the shift-axis focusing driver 32. Angle selection command "corresponding inclination angle, and after the inclination is completed, the image acquired after the inclination is displayed on the touch screen, such as the inclination angle corresponding to the inclination angle selection command output by the user is 1.0 degrees, then the inclination angle of the lens 31 is Tilt 1.0 degree, after tilting 1.0 degree, the image of shooting scene 40 is obtained by the shifting lens module, and the image is displayed on the touch screen. At this time, due to the inclination angle of the lens 31 , images other than the target object are blurred. If the image blur effect after tilting is not satisfactory at this time, the user can continue to input tilt angle selection commands based on the user interface, such as increasing the tilt angle or decreasing the tilt angle, etc., to achieve the best blur effect.

The aforementioned selection instruction can be input by the user interface on the touch screen, and the user interface object is an object constituting the user interface of the device, which can include but not limited to text, image, icon, soft key (or "virtual button"), drop-down menu, Radio buttons, checkboxes, selectable lists, and more. The displayed user interface objects may include: non-interactive objects for conveying information or constituting the appearance of the user interface, interactive objects available for user interaction, or a combination thereof.

The basic image, selection instructions and tilt angles of this embodiment can all be stored in a memory, and the memory can include a high-speed random access memory, and can also include a non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices or other non-volatile solid-state storage devices. In some embodiments, the memory may also include memory remote from the one or more processors, such as network-attached memory accessed via RF circuitry or an external port and a communication network (not shown), which may be the Internet , one or more intranets, local area networks (LANs), wide area networks (WLANs), storage area networks (SANs), etc., or suitable combinations thereof. A memory controller may control access to memory by other components of the device, such as the CPU and peripheral interfaces.

The image processing apparatus of this embodiment can be applied to electronic equipment. The electronic device may include: a camera and a processor, the processor is used to obtain a basic image of the target object through the camera, focus on the target object to obtain a clear image of the target object, and Adjust the tilt angle of the lens of the camera at the position in the base image to obtain the result image. The electronic device further includes: a display screen for displaying the acquired basic image, the clear imaging of the target object, and the resulting image.

The electronic devices include, but are not limited to, notebook computers, tablet computers, mobile phones, smart phones, media players, personal digital assistants (PDAs), digital cameras, etc., and combinations of two or more thereof. The electronic device includes memory, a memory controller, one or more processing units (CPUs), peripheral interfaces, RF circuitry, audio circuitry, speakers, microphones, input/output (I/O) subsystems, touch screens, other output or control devices, and external ports. These components communicate over one or more communication buses or signal lines. The electronic device also includes a power system for powering various components. The power system may include a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a charging system, power failure detection circuitry, power converters or inverters, power status indicators (e.g., light emitting diodes, LED ), and any other components associated with the generation, management, and distribution of electrical energy in portable devices.

The camera in the electronic device of this embodiment can be realized by using the shifting lens module shown in FIG. 3 . The processor may be a Qualcomm chip including an image processor or the like. The display screen may be a touch screen and provide a user interface; user interface objects are objects that constitute the user interface of the device, and may include but are not limited to text, images, icons, soft keys (or "virtual buttons"), pull-down menus, radio buttons Buttons, checkboxes, selectable lists, and more. The displayed user interface objects may include: non-interactive objects for conveying information or constituting the appearance of the user interface, interactive objects available for user interaction, or a combination thereof.

Specifically, the shooting scene 40 is captured by the shifting lens module shown in FIG. 3 and displayed on the display screen of the mobile phone, and the image processor 36 determines the position of the target object in the basic image, such as , the position of the target subject in the basic image is shown in the figure, which is located at the upper left position in the basic image; then the tilt direction of the lens 31 of the tilt-shift lens is determined to be "bottom right" and tilted by the tilt-shift focusing software module 34 The angle is the maximum inclination angle (such as 1.5 degrees) of the lens 31, and then the lens 31 is driven by the shift-axis focusing driver 32 so that the lens 31 tilts to the lower right until it reaches the maximum inclination angle with the lens (such as 1.5 degrees).

Of course, the user can also input the selection command based on the user interface on the touch screen, that is, when the image captured by the shifting lens module is displayed on the touch screen of the mobile phone, the user can touch the image on the touch screen based on actual needs. Focusing operation (of course, you can also choose to focus on the face); at this time, the user outputs a "focus selection instruction" through the touch screen, and based on the "focus selection instruction", the image processor 36 in the shifting lens module determines the target shooting Object (that is, the object corresponding to the user's touch operation) on the basic image, for example, the target object is located in the upper left position shown in FIG. is the lower right, and at the same time, the tiltable angle range is displayed on the touch screen of the mobile phone. At this time, the user can select the tilt angle based on the feedback information on the touch screen, that is, output the "tilt angle selection command" through the touch screen, and based on the "tilt angle selection command", the lens 31 is carried out by the shift-axis focusing driver 32. Angle selection command "corresponding inclination angle, and after the inclination is completed, the image acquired after the inclination is displayed on the touch screen, such as the inclination angle corresponding to the inclination angle selection command output by the user is 1.0 degrees, then the inclination angle of the lens 31 is Tilt 1.0 degree, after tilting 1.0 degree, the image of shooting scene 40 is obtained by the shifting lens module, and the image is displayed on the touch screen. At this time, due to the inclination angle of the lens 31 , images other than the target object are blurred. If the image blur effect after tilting is not satisfactory at this time, the user can continue to input tilt angle selection commands based on the user interface, such as increasing the tilt angle or decreasing the tilt angle, etc., to achieve the best blur effect.

At present, due to the small inclination angle of the current axis-shifting OIS lens, it is far from the virtual effect of the axis-shifting camera, and the image processing device and electronic equipment of the present application combine the axis-shifting OIS lens with a lens with a long focal length and a large aperture. Reduce the depth of field to make the blur effect more obvious. When the camera enters the tilt-shift photography mode, the in-focus object plane is determined by means of face focusing, touch auto-focus, etc., and the tilt direction of the lens is determined by judging the position of the in-focus object plane in the frame, so as to realize the tilt-shift photography. Through such In this way, the blurring effect of the image is improved, and the user experience is further improved.

Referring to FIG. 4, FIG. 4 shows a schematic flow chart of the image processing method of the present application in an implementation manner. As shown in the figure, the image processing method includes: step S10, start the camera to obtain the basic image where the target object is located; step S20, focus on the target object to obtain a clear image of the target object; step S30, adjust the tilt angle of the lens of the camera according to the position of the target object in the basic image, so as to obtain a result image.

In this embodiment, the step S20, the step of focusing on the target object to obtain a clear image of the target object includes: determining the shooting focal length according to the distance between the target object and the lens of the camera; The focal length is used to focus the lens of the camera to obtain a clear image of the target object. Specifically, auto focus (Auto Focus) can be used to achieve clear imaging of the target object. Auto focus can be used in cameras and mobile phone cameras to take pictures, so that the blur and spots of the picture can be eliminated, and the picture can be changed into clear and bright. Specifically, in this embodiment, focusing on the target subject can be achieved through face auto focus (Face Auto Focus) or manual touch focus (TouchAuto Focus).

The step S30, the step of adjusting the tilt angle of the lens of the camera according to the position of the target object in the basic image includes: determining the tilt direction of the lens of the camera according to the position of the target object in the basic image; The lens of the camera is adjusted to a preset tilt angle according to the determined tilt direction. Specifically, in an implementation example, the opposite direction of the position of the target object in the basic image can be used as the tilt direction of the lens of the camera, and at the same time, the lens of the camera can be adjusted to the lens according to the determined tilt direction. maximum inclination angle. In another implementation example, the opposite direction of the position of the target object in the basic image may be used as the tilt direction of the lens of the camera, and at the same time, the lens of the camera is adjusted according to the determined tilt direction to The tilt angle corresponding to the selection command.

Specifically, step S30 may be implemented by the adjustment unit shown in FIG. 1 , and the adjustment unit may include: a direction adjustment unit and an angle adjustment unit (not shown in the figure). The direction adjustment unit is used to determine the tilt direction of the lens of the camera according to the position of the target object in the basic image; the angle adjustment unit is used to adjust the lens of the camera to a preset tilt according to the determined tilt direction angle. Specifically, the direction adjusting unit is configured to use the direction opposite to the position of the target object in the basic image as the tilt direction of the lens of the camera.

Taking mobile phone photography as an example, please refer to Figure 2. Figure 2 shows the position of the target subject in the basic image in this application. The display screen displays the basic image P. If the position of the target object F in the basic image P is "upper left", then the direction adjustment unit uses "lower right" as the tilting direction of the camera. The position of the target subject F in the basic image P can be realized by a platform end including an image signal processor (Image Signal Processing, ISP). The platform end of the mobile phone includes but is not limited to Qualcomm (Qualcomm), Intel (Intel), Samsung and more.

After the tilt direction of the camera is obtained, the tilt angle of the camera is adjusted by the angle adjustment unit. In one implementation, the angle adjustment unit adjusts the lens of the camera to the maximum tilt angle of the lens according to the determined tilt direction . In the above example, the working mode of the angle adjustment unit is: adjust the lens of the camera to the maximum tilt angle according to the tilt direction of "lower right", such as the maximum tilt angle of the tilt-shift (Tilt-shift) lens of a mobile phone is 1.5 degrees.

Tilt-shift optical image stabilization motor (Optical Image Stabilization, OIS), different from ordinary auto focus (Auto Focus, AF) motor, the spring suspension system of the tilt-shift OIS motor not only allows the lens to move along the focus direction The movement also allows the lens to make a slight tilt in any direction relative to a fulcrum of the rotation axis, and the tilt angle can reach 1.5°. Please refer to FIG. 3 . FIG. 3 shows a schematic structural diagram of the tilt-shift lens module of the present application. As shown in the figure, the tilt-shift lens module includes: a lens 31 , a tilt-shift focus driver (Tilt/AF actuator) 32 , an image sensor (imagesensor) 33, a software module (Tilt/AF algorithm) 34 for shifting focus, a shutter release (shutter release) 35, an image processor (ISP) 36, and an optical image stabilization gyroscope (OIS gyroscope) )37.

Use the shifting lens module shown in Figure 3 to shoot the shooting scene 40 and display it on the display screen of the mobile phone, and determine the position of the target object in the basic image by the image processor 36, for example, target shooting The position of the object in the basic image is located in the upper left position in the basic image as shown in the figure; then the tilt direction of the lens 31 of the tilt-shift lens is determined to be "bottom right" by the tilt-shift focusing software module 34, and the tilt angle is this The maximum inclination angle of the lens 31 (such as 1.5 degrees), then the lens 31 is driven by the shifting focus driver 32 so that the lens 31 is tilted to the lower right until it is tilted to the maximum inclination angle (such as 1.5 degrees) of the lens. Spend).

In this embodiment, the image processing apparatus may further include: a display unit 40 . The display unit 40 is used for displaying the obtained basic image, the clear imaging of the target object and the resulting image.

Taking a mobile phone as an example, the display unit may be implemented by a touch screen of the mobile phone, and the touch screen of the mobile phone may accept user input based on tactile and/or tactile contact. The touch screen forms a touch-sensitive surface that accepts user input. The touch screen and touch screen controller (along with any associated modules and/or instruction sets in memory) detect contact on the touch screen (and any movement or interruption of said touch) and translate the detected contact into a Interaction of user interface objects such as one or more soft keys on the touch screen. In one exemplary embodiment, the point of contact between the touch screen and the user corresponds to one or more fingers of the user. The touch screen may use LCD (Liquid Crystal Display) technology or LPD (Light Emitting Polymer Display) technology, although in other embodiments other display technologies may be used. Touchscreens and touchscreen controllers can detect contact and its movement or interruption using any of a variety of touch-sensitive technologies, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays , or other techniques for determining one or more points of contact with the touchscreen. Touch screens display visual output from portable devices, while touch-sensitive panels provide no visual output. The touch screen may have a resolution higher than 100dpi. In one exemplary embodiment, the touch screen may have a resolution of approximately 168dpi. A user may use any suitable object or accessory, such as a stylus, finger, etc., to contact the touch screen.

Continuing to refer to FIG. 2 and FIG. 3 , in other implementation manners, the angle adjustment unit may also adjust the lens of the camera according to the determined tilt direction to a tilt angle corresponding to the selection command based on the selection command. The display unit can also display the selection instruction and the image formed after adjusting the tilt angle of the lens based on the selection instruction.

Still taking the mobile phone as an example, when the image acquired by the shifting lens module is displayed on the touch screen of the mobile phone, the user can perform a touch-focus operation on the image on the touch screen based on actual needs (of course, you can also choose to focus on the face); At this time, the user outputs a "focus selection instruction" through the touch screen, and based on the "focus selection instruction", the image processor 36 in the shifting lens module determines the target subject (ie, the subject corresponding to the user's touch operation) The position on the basic image, for example, if the target object is located at the upper left position shown in FIG. on the phone's touch screen. At this time, the user can select the tilt angle based on the feedback information on the touch screen, that is, output the "tilt angle selection command" through the touch screen, and based on the "tilt angle selection command", the lens 31 is carried out by the shift-axis focusing driver 32. Angle selection command "corresponding inclination angle, and after the inclination is completed, the image acquired after the inclination is displayed on the touch screen, such as the inclination angle corresponding to the inclination angle selection command output by the user is 1.0 degrees, then the inclination angle of the lens 31 is Tilt 1.0 degree, after tilting 1.0 degree, the image of shooting scene 40 is obtained by the shifting lens module, and the image is displayed on the touch screen. At this time, due to the inclination angle of the lens 31 , images other than the target object are blurred. If the image blur effect after tilting is not satisfactory at this time, the user can continue to input tilt angle selection commands based on the user interface, such as increasing the tilt angle or decreasing the tilt angle, etc., to achieve the best blur effect.

The aforementioned selection instruction can be input by the user interface on the touch screen, and the user interface object is an object constituting the user interface of the device, which can include but not limited to text, image, icon, soft key (or "virtual button"), drop-down menu, Radio buttons, checkboxes, selectable lists, and more. The displayed user interface objects may include: non-interactive objects for conveying information or constituting the appearance of the user interface, interactive objects available for user interaction, or a combination thereof.

The basic image, selection instructions and tilt angles of this embodiment can all be stored in a memory, and the memory can include a high-speed random access memory, and can also include a non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices or other non-volatile solid-state storage devices. In some embodiments, the memory may also include memory remote from the one or more processors, such as network-attached memory accessed via RF circuitry or an external port and a communication network (not shown), which may be the Internet , one or more intranets, local area networks (LANs), wide area networks (WLANs), storage area networks (SANs), etc., or suitable combinations thereof. A memory controller may control access to memory by other components of the device, such as the CPU and peripheral interfaces.

In summary, the image processing method, image processing device, and electronic equipment of the present application determine the tilt direction and adjust the tilt angle through the position of the target object on the basic image, thereby obtaining the virtual effect of the image, which not only effectively improves the The imaging effect of the image is improved, and the practicability of the device is also greatly improved. Therefore, the present application effectively overcomes various shortcomings in the prior art and has high industrial application value.

The above-mentioned embodiments are only illustrative to illustrate the principles and effects of the present application, but are not intended to limit the present application. Any person familiar with the technology can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present application. Therefore, all equivalent modifications or changes made by those skilled in the art without departing from the spirit and technical ideas disclosed in the application shall still be covered by the claims of the application.

Claims (10)

1. An image processing method, characterized in that, comprising the following steps: Start the camera to obtain the basic image of the target object; Focusing on the target object to obtain a clear image of the target object; Adjusting the inclination angle of the lens of the camera according to the position of the target object in the basic image to obtain a result image. 2. The image processing method according to claim 1, wherein the step of focusing on the target subject to obtain a clear image of the target subject comprises: Determine the shooting focal length according to the distance between the target object and the camera lens; The lens of the camera is focused according to the determined shooting focal length to obtain a clear image of the target object. 3. The image processing method according to claim 1, wherein the step of adjusting the angle of inclination of the lens of the camera according to the position of the target subject in the basic image comprises: determining the tilt direction of the lens of the camera according to the position of the target object in the basic image; The lens of the camera is adjusted to a preset tilt angle according to the determined tilt direction. 4. The image processing method according to claim 3, wherein the step of determining the tilt direction of the lens of the camera according to the position of the target object in the base image comprises: placing the target object in the base image The opposite direction of the position in the image is used as the tilt direction of the lens of the camera. 5. The image processing method according to claim 3, wherein the step of adjusting the lens of the camera to a preset tilt angle according to the determined tilt direction comprises: adjusting the lens of the camera to the maximum tilt angle of the lens according to the determined tilt direction; and/or Adjusting the lens of the camera according to the determined tilt direction to a tilt angle corresponding to the selection command based on the selection command. 6. An image processing device, comprising: An image acquisition unit, configured to acquire the basic image where the target subject is located through the camera; a processing unit, configured to focus on a target object to obtain a clear image of the target object; The adjustment unit is configured to adjust the inclination angle of the lens of the camera according to the position of the target object in the basic image, so as to obtain a result image. 7. The image processing device according to claim 6, wherein the processing unit comprises: The focal length determining unit determines the shooting focal length according to the distance between the target object and the lens of the camera; The focusing unit is configured to focus the lens of the camera according to the determined shooting focal length to obtain a clear image of the target object. 8. The image processing device according to claim 6, wherein the adjustment unit comprises: a direction adjustment unit, configured to determine the tilt direction of the lens of the camera according to the position of the target object in the basic image; The angle adjustment unit adjusts the lens of the camera to a preset inclination angle according to the determined inclination direction. 9. The image processing device according to claim 8, wherein the direction adjustment unit is used for: Taking the reverse direction of the position of the target object in the basic image as the tilt direction of the lens of the camera; and/or The lens of the camera is adjusted to the maximum tilt angle of the lens according to the determined tilt direction. 10. An electronic device, characterized in that it includes: a camera and a processor, the processor is used to obtain a basic image of the target object through the camera, and focus on the target object to obtain a clear image of the target object and adjusting the tilt angle of the lens of the camera according to the position of the target object in the basic image to obtain a result image.