CN104469152B - The automatic camera method and system of Wearable - Google Patents

Abstract

The invention discloses an automatic camera method and system for a wearable device. The system includes an eye movement detection module, a calculation module, a camera module and a storage module; the eye movement detection module detects eye movement and outputs eye movement data; the calculation module according to the The eye movement data identifies eye pauses, and outputs the line of sight direction and shooting instructions when the eyeballs pause; after the camera module receives the shooting instructions, it starts shooting after focusing according to the line of sight direction when the eyeballs pause, and outputs photos; the storage module is used for The photo is stored. When people look at something with their eyes, they first turn their eyes to a fixed position, pause, and then focus to see the image clearly. The invention imitates this process, detects the pause in the eye movement, and recognizes when the eyeball pauses. Direction of sight and automatic focus, automatic photo recording, can record the user's real vision more realistically and efficiently, and restore the image seen by the human eye in real time.

Description

Automatic camera method and system for wearable devices

【Technical field】

The invention relates to the technical field of smart devices, in particular to an automatic camera method and system for wearable devices.

【Background technique】

With the development of science and technology, smart products have been integrated into people's daily life. Smart phones and smart tablets are relatively common smart products, which bring great convenience to people's work and life. However, the personalized needs of users are also increasing. In this case, wearable devices such as smart glasses have emerged as the times require. For example, the Google Smart Glasses released by Google in 2012. The camera has a touchpad on the frame, and the user can take pictures by blinking. However, current wearable devices, especially smart glasses, although there are many ways to automatically take pictures and record them, such as timing pictures, blinking pictures, etc., none of them can truly and efficiently automatically record the images seen by human eyes.

【Content of invention】

Based on this, in order to solve the problems existing in existing wearable devices, the present invention provides an automatic imaging method and system for wearable devices, which imitates the biological function of the human eye, automatically restores the images seen by the eyes truly and efficiently, and records The user's real field of vision.

The content of the embodiment of the present invention is specifically as follows:

An automatic camera system for a wearable device, including an eye movement detection module, a computing module, a camera module and a storage module;

The eye movement detection module detects eye movement and outputs eye movement data;

The calculation module recognizes eye pauses according to the eye movement data, and outputs the line of sight direction and shooting instructions when the eye balls pause;

After the camera module receives the shooting instruction, it starts shooting after focusing according to the line of sight direction when the eyeballs pause, and outputs a photo;

The storage module is used for storing the photos.

Correspondingly, the embodiment of the present invention also provides a method for automatically taking pictures of a wearable device, including the following steps:

Drive the eye movement detection module to detect eye movement and output eye movement data;

Identify eye pauses according to the eye movement data, and calculate the line of sight direction when the eyeballs pause;

The camera module is driven to focus according to the line of sight direction when the eyeballs pause, and then starts to shoot, output and store the photos.

The present invention imitates the biological function of human eyes, because when people look at something with their eyes, they first turn their eyes to a fixed position, pause, and then focus to see the image clearly. The invention imitates this process, detects the pause in eye movement, recognizes the line of sight direction when the eyeball pauses, automatically focuses, automatically takes pictures and records, can record the user's real vision more realistically and efficiently, and restore the image seen by the human eye in real time.

【Description of drawings】

FIG. 1 is a schematic structural diagram of an automatic camera system of a wearable device in Embodiment 1 of the present invention;

2 is a schematic structural diagram of an automatic camera system of a wearable device in Embodiment 2 of the present invention;

3 is a schematic flowchart of an automatic camera method for a wearable device in an embodiment of the present invention;

Fig. 4 is a schematic flowchart of a method for screening photos in an embodiment of the present invention.

【detailed description】

The content of the present invention will be further described below in conjunction with the accompanying drawings. It should be noted that, in the following description, for the convenience of explanation, the wearable device only takes smart glasses as an example, but this cannot limit the protection scope of the present invention.

Embodiment one

As shown in FIG. 1 , the automatic camera system of smart glasses in the first embodiment includes an eye movement detection module 1 , a calculation module 2 , a camera module 3 and a storage module 4 . Among them, the eye movement detection module 1 can be set on the frame of the smart glasses to detect the user's eye movement in real time, such as the center of the pupil as the moving point, the corner of the eye as the reference point, and the relative position between the center of the pupil and the corner of the eye as the eye movement A side reaction of the eyeball movement data, which includes the above-mentioned relative position of the pupil center and the corner of the eye, eyeball rotation angle, etc. Calculation module 2 recognizes eye pauses by analyzing eye movement data, because when people use their eyes to look at an object, the eyeballs first rotate, then pause, keep the eyeballs still, and then focus to see the image clearly Therefore, the calculation module 2 needs to find out the point of eyeball pause through the situation of eyeball movement, identify the eyeball pause, and calculate the line of sight direction when the eyeball pauses according to eyeball movement data such as the relative position of the pupil center and the corner of the eye point, eyeball rotation angle, and Send a shooting instruction to the camera module 3 .

After receiving the shooting instruction from the computing module 2, the camera module 3 focuses according to the line of sight direction when the eyeballs pause, starts shooting after the focusing is completed, and outputs photos. According to the different cameras in the camera module 3, this process can be divided into the following two solutions:

When the camera adopts a rotating camera, the rotating camera rotates to the line of sight direction when the eyeballs pause, and performs center focus, and starts shooting after the focus is completed. This camera method is biased towards shooting objects.

When the wide-angle camera is selected as the camera, in the framing of the wide-angle camera, determine its corresponding scene position according to the direction of sight, and focus on the position, and start shooting after the focus is completed. This camera method has a large angle and a large field of view, which can accommodate the current scene. more objects.

After the camera module 3 finishes taking pictures, it outputs the pictures and stores them in the storage module 4, which is convenient for users to view.

To sum up, the automatic camera system of the wearable device in this embodiment is a bionic system. Through the eyeball pause in the eyeball movement of the device, it can automatically take pictures, automatically record the images seen by the eyes truly and efficiently, and record the user's real field of vision. .

Embodiment two

As shown in FIG. 2 , the automatic camera system of the wearable device in the second embodiment includes an eye movement detection module 1 , a computing module 2 , a camera module 3 , a storage module 4 , a marking module 5 and a timing module 6 . Among them, the eye movement detection module 1 detects the user's eye movement in real time, and outputs eye movement data, including the angle and orientation of the eye movement. The calculating module 2 recognizes eye pauses by analyzing the eye movement data, and calculates the line of sight direction when the eye pauses according to the eye movement data such as eye rotation angle and orientation, and sends a shooting instruction to the camera module 3 .

After the camera module 3 receives the shooting instruction sent by the calculation module 2, it focuses according to the line of sight direction when the eyeballs pause, starts to shoot after the focus is completed, and outputs the photo, which is stored in the storage module 4, which is convenient for the user to check.

The user can filter photos at any time, and set flags for the photos by the marking module 5. The flags include important and unimportant. If the user is interested in a certain photo, it can be set as important. When not set, the system defaults to unimportant; The photos that are set as important can be stored in the memory module 4 for a long time.

Each photo in the storage module 4 has its corresponding shooting time, and the timing module 6 periodically calculates the remaining retention time of each photo according to the retention time threshold set in advance by the system. If the unimportant photo expires, That is, when the remaining retention time is zero, the photo is deleted from the storage module 4 . Certainly in another embodiment, if a certain photo is set as important, the timing module 6 will no longer calculate the remaining retention time of the photo, so that it is always stored in the storage module 4, and the timing module 6 is reduced. Calculation amount, when the photo is re-marked as unimportant, the timing module 6 continues to calculate the remaining retention time of the photo, but at this time, the calculation starting point is no longer the shooting time of the photo, but the flag is changed to unimportant Time, for example, the shooting date of photo P is 10 o'clock on November 11, 2014, and the retention time threshold is set to 7 days, then at 10 o'clock on November 12, 2014, the timing module 6 takes the shooting time of November 11, 2014 With 10:00 as the time starting point, the remaining retention time of photo P is calculated as 6 days. Assuming that the user marks the photo P as important at 10:00 on November 13, 2014, the timing module 6 no longer calculates the remaining time of the photo P; assuming that the user marks the photo P as unimportant at 10:00 on November 14, 2014, Then the timing module 6 recalculates the remaining retention time of the photo P. For example, at 10:00 on November 15, 2014, the timing module 6 starts at 10:00 on November 14, 2014 when the modification is marked as unimportant, and calculates the photo The remaining retention time of P is 6 days.

Through the above method, the photos that the user does not care about can be regularly cleaned up, the storage space of the storage module 4 can be saved, and the continuous operation of the automatic camera system can be ensured.

To sum up, the automatic camera system of the wearable device in this embodiment automatically takes pictures through the pause of the eyeballs in the eyeball movement of the device, automatically records the images seen by the eyes truly and efficiently, and records the user's real field of vision. , and calculate the remaining retention time of the photos, regularly clean up the photos that the user does not care about, save storage space, and ensure the continuity of the system.

Correspondingly, the present invention also provides an automatic camera method for a wearable device, as shown in FIG. 3 , including the following steps:

S11 drives the eye movement detection module to detect eye movement and output eye movement data;

S12 Recognize eye pauses according to the eye movement data, and calculate the line of sight direction when the eyeballs pause;

S13 drives the camera module to focus according to the line of sight direction when the eyeballs pause, and then starts shooting;

S14 outputs photos and stores them.

Specifically, the user's eye movement is detected in real time through the eye movement detection module, such as the center of the pupil as the moving point, the corner of the eye as the reference point, and the relative position between the center of the pupil and the corner of the eye as a side reaction of the eye movement, and the eye movement is output Data, the data includes the above-mentioned relative position of the center of the pupil and the corner of the eye, the angle of eyeball rotation, etc. By analyzing eye movement data, eye pauses can be identified, because when people use their eyes to look at an object, the eyeballs first rotate, then pause, keep the eyeballs still, and then focus to see the image clearly. , after identifying the eyeball pause, calculate the line of sight direction when the eyeball pauses according to the eye movement data such as the relative position of the pupil center and the corner of the eye point, the eyeball rotation angle, etc.

After obtaining the line of sight direction when the eyeballs pause, the driving camera module focuses according to the line of sight direction when the eyeballs pause, and starts shooting after the focus is completed, and outputs photos for storage. According to the different cameras in the camera module, this process can be divided into the following two solutions:

When the camera module includes a rotating camera, drive the rotating camera to rotate to the line of sight when the eyeballs pause, perform center focusing, and start shooting after the focusing is completed. This camera mode is biased towards shooting in a single direction and is suitable for shooting distant views.

When the camera module includes a wide-angle camera, drive the wide-angle camera to determine its corresponding scene position according to the direction of sight, and focus on the position, and start shooting after the focus is completed. many objects.

After the photo corresponding to the image seen by the user's eyes is obtained through the above method, in a specific implementation manner, the following steps are also included:

S21 setting a flag on the photo, the flag including important and unimportant;

S22 calculates the remaining retention time of the photo according to the retention time threshold;

S23 When the remaining retention time of the photo marked as unimportant is zero, delete the photo.

Users can filter the photos taken at any time. The specific method is: set interesting photos as important, uninteresting photos as unimportant, and the system will default to unimportant if the user does not set; important photos can be stored for a long time.

Each photo has its corresponding shooting time, and the remaining retention time of each photo can be calculated according to the retention time threshold preset by the system. When a photo marked as unimportant expires, that is, when its remaining retention time is zero, Delete the photo. Of course, in another implementation, if a certain photo is set as important, the remaining retention time of the photo will not be calculated to reduce the calculation amount of the system, and the photo will always be kept in the storage space. When re-marking as unimportant, continue to calculate the remaining retention time of the photo, but at this time, the calculation starting point is no longer the shooting time of the photo, but the time when the flag is changed to unimportant, for example, the shooting date of photo P It is 10 o'clock on November 11, 2014, and the retention time threshold is set to 7 days, then at 10 o'clock on November 12, 2014, the timing module 6 calculates the photo P based on the shooting time at 10 o'clock on November 11, 2014. The remaining retention time of 6 days. Assuming that the user marks the photo P as important at 10:00 on November 13, 2014, the timing module 6 no longer calculates the remaining time of the photo P; assuming that the user marks the photo P as unimportant at 10:00 on November 14, 2014, Then the timing module 6 recalculates the remaining retention time of the photo P. For example, at 10:00 on November 15, 2014, the timing module 6 starts at 10:00 on November 14, 2014 when the modification is marked as unimportant, and calculates the photo P The remaining retention time of P is 6 days.

Through the above method, the photos that the user does not care about can be regularly cleaned up, saving system storage space and ensuring the continuity of the system.

The above-mentioned embodiments only express several implementation modes of the present invention, and the description thereof is relatively specific and detailed, but should not be construed as limiting the patent scope of the present invention. It should be pointed out that those skilled in the art can make several modifications and improvements without departing from the concept of the present invention, and these all belong to the protection scope of the present invention. Therefore, the protection scope of the patent for the present invention should be based on the appended claims.

Claims (6)

1. An automatic camera system of a wearable device, comprising an eye movement detection module, a computing module, a camera module and a storage module; The eye movement detection module detects eye movement and outputs eye movement data; The calculation module identifies eye pauses according to the eye movement data, calculates the gaze direction when the eyeballs pause, and outputs the gaze direction and shooting instructions when the eyeballs pause; After the camera module receives the shooting instruction, it starts shooting after focusing according to the line of sight direction when the eyeballs pause, and outputs a photo; The storage module is used to store the photos; It also includes a marking module and a timing module, the marking module is used to set a flag on the photo, and the flag includes important and unimportant; if no flag is set for a certain photo, the system defaults to the flag of the photo as unimportant; The timing module is used to calculate the remaining retention time of the photo according to the retention time threshold, and when the remaining retention time of the photo marked as unimportant is zero, the storage module deletes the photo. 2. The automatic camera system of a wearable device according to claim 1, wherein the camera module includes a rotating camera, and the rotating camera rotates to the line of sight direction when the eyeballs pause, then performs center focusing, and performs shoot. 3. The automatic camera system of a wearable device according to claim 1, wherein the camera module includes a wide-angle camera, and the wide-angle camera determines the corresponding position in the viewfinder of the wide-angle camera according to the line of sight direction when the eyeballs pause. scene position, and shoot after focusing on the corresponding scene position. 4. An automatic camera method for a wearable device, comprising the steps of: Drive the eye movement detection module to detect eye movement and output eye movement data; Recognize eye pauses according to the eye movement data, calculate the line of sight direction when the eyeballs pause, and output the line of sight direction and shooting instructions when the eyeballs pause; Drive the camera module to focus according to the line of sight direction when the eyeballs pause, then start shooting, output photos and store them; Set flags on the photos, the flags include important and unimportant; If no flag is set for a certain photo, the system defaults the flag of the photo as unimportant; calculating the remaining retention time of the photo according to the retention time threshold; When the remaining retention time of the unimportant photo is zero, the photo is deleted. 5. The automatic camera method of a wearable device according to claim 4, wherein the process of driving the camera module to focus according to the line of sight direction when the eyeballs pause includes the following steps: the camera module includes a rotating camera, drives The rotating camera rotates to the line of sight direction when the eyeballs pause, and then focuses on the center. 6. The automatic camera method for a wearable device according to claim 4, wherein the process of driving the camera module to focus according to the line of sight direction when the eyeballs pause includes the following steps: the camera module includes a wide-angle camera, drives The wide-angle camera determines the corresponding scene position in the viewfinder of the wide-angle camera according to the line of sight direction when the eyeball pauses, and focuses on the corresponding scene position.