CN104914981A - Information processing method and electronic equipment - Google Patents

Abstract

The invention provides an information processing method and electronic equipment, and the technical problem that in the prior art, electronic equipment including a mirror surface display screen cannot achieve the remote interaction with a user is solved. The method comprises the steps that parameter information of an operating body located in front of a display screen is acquired on the basis of an image acquisition device, and the parameter information is used for building a first digital image corresponding to the operating body located in front of the display screen; on the basis of the parameter information, calculation is performed according to a predefined algorithm to obtain the first digital image, wherein the first digital image is used for determining the input operation of the operating body and matched with a first virtual image; when the operating body performs the first input operation, a first instruction corresponding to the first input operation is determined through the first digital image, and the action of the operating body performing the first input operation is presented through the first virtual image.

Description

A kind of information processing method and electronic equipment

Technical field

The present invention relates to electronic technology field, particularly relate to a kind of information processing method and electronic equipment.

Background technology

Minute surface display screen, as the term suggests, can reflect as mirror exactly and present the virtual image, the content of electronic equipment needs display can be shown again as common display screen.Just be supplied to a kind of experience newly of user so like this, that be exactly user while seeing displaying contents, the virtual image of oneself can also be seen.

So, when user is when using minute surface display screen, user can be clear that oneself operational motion, and such as oneself lifts arm, or does a click action etc. with right hand forefinger before minute surface display screen.So when minute surface display screen is at displaying contents, what the operational motion that user just can see oneself seemingly can be corresponding with displaying contents, such as see that the virtual image clicks " music " icon be presented on screen.But in the prior art, user can see being similar to the such effect of input on minute surface display screen.

Further, in the prior art, if user needs to input really click the action of " music " icon, mouse or touch-control icon can only be used to realize, and can not the input operation that needs of remote conveying access customer.So it is remote mutual that the electronic equipment that prior art comprises minute surface display screen cannot realize with user.

Summary of the invention

This application provides a kind of information processing method and electronic equipment, the electronic equipment comprising minute surface display screen in order to solve prior art cannot realize the technical matters mutual at a distance with user, by determining the input operation of user and user's virtual image, thus realize the technique effect mutual at a distance of user and electronic equipment.

On the one hand, this application provides a kind of information processing method, be applied to an electronic equipment, described electronic equipment comprises display screen and the image collecting device that has mirror effect, present first virtual image symmetrical with being positioned at the described operating body before described display screen when the operating body of described electronic equipment is positioned at before described display screen by the mirror effect of described display screen, described method comprises:

Be positioned at the parameter information of the described operating body before described display screen based on described image acquisition device, described parameter information is for building first digital picture corresponding with being positioned at the described operating body before described display screen;

Calculate according to pre-defined algorithm based on described parameter information, obtain described first digital picture, wherein, described first digital picture is for determining the input operation of described operating body, and described first digital picture is mated with described first virtual image;

When described operating body carries out the first input operation, determine by described first digital picture the first instruction that described first input operation is corresponding, and present by described first virtual image action that described operating body carries out described first input operation.

Optionally, described carry out the first input operation when described operating body time, determine by described first digital picture the first instruction that described first input operation is corresponding, and present after described operating body carries out the action of described first input operation by described first virtual image, described method also comprises:

At described display screen display first displaying contents;

Respond described first instruction, and control based on described first instruction the second displaying contents that the display of described display screen is different from described first displaying contents.

Optionally, described carry out the first input operation when described operating body time, the first instruction that described first input operation is corresponding is determined by described first digital picture, and present by described first virtual image action that described operating body carries out described first input operation, or described first instruction of described response, and based on described first instruction control described display screen display be different from the second displaying contents of described first displaying contents after, described method also comprises:

Judge that whether described first input operation meets first pre-conditioned, obtain the first judged result;

When described first is judged as YES, control the Part I of described first digital picture of described display screen display.

Optionally, describedly to calculate according to pre-defined algorithm based on described parameter information, obtain described first digital picture, be specially:

Based on described parameter information, obtain displaying contents at least one first coordinate in human eye coordinate system of described display screen;

Based on described parameter information, obtain the primary importance information of user's eyes;

Based on described primary importance information and at least one first coordinate described, carry out the first calculating, obtain described first digital picture.

Optionally, described based on described primary importance information and at least one first coordinate described, carry out the first calculating, obtain described first digital picture, be specially:

Based on primary importance information, build the homography matrix that described human eye coordinate is tied to the display plane coordinate system of described display screen;

According at least one first coordinate described and described homography matrix, obtain described displaying contents at least one second coordinate in described display plane coordinate system;

Based at least one second coordinate described, obtain described first digital picture.

On the other hand, present invention also provides a kind of electronic equipment, comprise display screen and image collecting device that one has mirror effect, present first virtual image symmetrical with being positioned at the described operating body before described display screen when the operating body of described electronic equipment is positioned at before described display screen by the mirror effect of described display screen, described electronic equipment also comprises:

First obtains unit, and for being positioned at the parameter information of the described operating body before described display screen based on described image acquisition device, described parameter information is for building first digital picture corresponding with being positioned at the described operating body before described display screen;

Second obtains unit, for calculating according to pre-defined algorithm based on described parameter information, obtain described first digital picture, wherein, described first digital picture is for determining the input operation of described operating body, and described first digital picture is mated with described first virtual image;

Determining unit, for when described operating body carries out the first input operation, determines by described first digital picture the first instruction that described first input operation is corresponding, and presents by described first virtual image action that described operating body carries out described first input operation.

Optionally, described electronic equipment also comprises:

Display unit, for described carry out the first input operation when described operating body time, the first instruction that described first input operation is corresponding is determined by described first digital picture, and present after described operating body carries out the action of described first input operation, at described display screen display first displaying contents by described first virtual image; Respond described first instruction, and control based on described first instruction the second displaying contents that the display of described display screen is different from described first displaying contents.

Optionally, described electronic equipment also comprises:

First judging unit, for described carry out the first input operation when described operating body time, the first instruction that described first input operation is corresponding is determined by described first digital picture, and present by described first virtual image action that described operating body carries out described first input operation, or described first instruction of described response, and based on described first instruction control described display screen display be different from the second displaying contents of described first displaying contents after, judge that whether described first input operation meets first pre-conditioned, obtain the first judged result;

Control module, for when described first is judged as YES, controls the Part I of described first digital picture of described display screen display.

Optionally, described second acquisition unit specifically comprises:

First obtains module, for based on described parameter information, obtains displaying contents at least one first coordinate in human eye coordinate system of described display screen;

Second obtains module, for based on described parameter information, obtains the primary importance information of user's eyes;

3rd obtains module, for based on described primary importance information and at least one first coordinate described, carries out the first calculating, obtains described first digital picture.

Optionally, described 3rd obtain module specifically for:

Based on primary importance information, build the homography matrix that described human eye coordinate is tied to the display plane coordinate system of described display screen;

According at least one first coordinate described and described homography matrix, obtain described displaying contents at least one second coordinate in described display plane coordinate system;

Based at least one second coordinate described, obtain described first digital picture.

Above-mentioned one or more technical scheme in the embodiment of the present application, at least has one or more technique effects following:

1, in the technical scheme of the application, first the parameter information of the described operating body before described display screen is positioned at based on described image acquisition device, described parameter information is for building first digital picture corresponding with being positioned at the described operating body before described display screen, then calculate according to pre-defined algorithm based on described parameter information, obtain described first digital picture, described first digital picture is for determining the input operation of described operating body, and described first digital picture is mated with described first virtual image, so, when described operating body carries out the first input operation, the first instruction that described first input operation is corresponding is determined by described first digital picture, and present by described first virtual image action that described operating body carries out described first input operation, solve the electronic equipment that prior art comprises minute surface display screen and cannot realize the technical matters mutual at a distance with user, after achieving image acquisition units acquisition parameter information, first input operation of user is determined by building the first digital picture, thus make user can carry out technique effect mutual at a distance with electronic equipment.

Accompanying drawing explanation

Fig. 1 is the information processing method process flow diagram in the application one embodiment;

Fig. 2 is the preset algorithm schematic diagram in the application one embodiment;

Fig. 3 is the first displaying contents schematic diagram in the application one embodiment;

Fig. 4 is the second displaying contents schematic diagram in the application one embodiment;

Fig. 5 is the first digital picture Part I schematic diagram in the application one embodiment;

Fig. 6 is another the first digital picture Part I schematic diagram in the application one embodiment;

Fig. 7 is the electronic devices structure schematic diagram in another embodiment of the application.

Embodiment

This application provides a kind of information processing method and electronic equipment, the electronic equipment comprising minute surface display screen in order to solve prior art cannot realize the technical matters mutual at a distance with user, by determining the input operation of user and user's virtual image, thus realize the technique effect mutual at a distance of user and electronic equipment.

In order to solve the problems of the technologies described above, technical scheme general thought provided by the invention is as follows:

Be positioned at the parameter information of the described operating body before described display screen based on described image acquisition device, described parameter information is for building first digital picture corresponding with being positioned at the described operating body before described display screen;

Calculate according to pre-defined algorithm based on described parameter information, obtain described first digital picture, wherein, described first digital picture is for determining the input operation of described operating body, and described first digital picture is mated with described first virtual image;

When described operating body carries out the first input operation, determine by described first digital picture the first instruction that described first input operation is corresponding, and present by described first virtual image action that described operating body carries out described first input operation.

In the technical scheme of the application, first the parameter information of the described operating body before described display screen is positioned at based on described image acquisition device, described parameter information is for building first digital picture corresponding with being positioned at the described operating body before described display screen, then calculate according to pre-defined algorithm based on described parameter information, obtain described first digital picture, described first digital picture is for determining the input operation of described operating body, and described first digital picture is mated with described first virtual image, so, when described operating body carries out the first input operation, the first instruction that described first input operation is corresponding is determined by described first digital picture, and present by described first virtual image action that described operating body carries out described first input operation, solve the electronic equipment that prior art comprises minute surface display screen and cannot realize the technical matters mutual at a distance with user, after achieving image acquisition units acquisition parameter information, first input operation of user is determined by building the first digital picture, thus make user can carry out technique effect mutual at a distance with electronic equipment.

Below by accompanying drawing and specific embodiment, technical solution of the present invention is described in detail, the specific features being to be understood that in the embodiment of the present application and embodiment is the detailed description to technical scheme, instead of the restriction to technical scheme, when not conflicting, the technical characteristic in the embodiment of the present application and embodiment can combine mutually.

In the embodiment of the present application, provide a kind of information processing method and electronic equipment, in concrete enforcement, electronic equipment can be smart mobile phone, also can be notebook computer or desktop computer, as long as have minute surface display screen and image acquisition units, concrete, in the embodiment of the present application, will not be restricted.In the following description, for notebook computer, the information processing method in the embodiment of the present application and electronic equipment will be described in detail.

Embodiment one:

Before introducing the information processing method of the embodiment of the present application, the basic structure of the electronic equipment first method of the embodiment of the present application applied makes a presentation, electronic equipment in the embodiment of the present application comprises the display screen of a mirror effect, namely no matter when whether display screen powers on, display screen surface can present first virtual image of operating body by the physical phenomenon of self, according to optical physics principle, first virtual image and operation are symmetrical about minute surface.In addition, electronic equipment in the embodiment of the present application, also has an image acquisition units, further, please refer to Fig. 7, and the electronic equipment in the embodiment of the present application also comprises:

First obtains unit 1, and for being positioned at the parameter information of the described operating body before described display screen based on described image acquisition device, described parameter information is for building first digital picture corresponding with being positioned at the described operating body before described display screen;

Second obtains unit 2, for calculating according to pre-defined algorithm based on described parameter information, obtain described first digital picture, wherein, described first digital picture is for determining the input operation of described operating body, and described first digital picture is mated with described first virtual image;

Determining unit 3, for when described operating body carries out the first input operation, determine by described first digital picture the first instruction that described first input operation is corresponding, and present by described first virtual image action that described operating body carries out described first input operation.

Below the first information processing method in the application is described in detail, please refer to Fig. 1.

S1: the parameter information being positioned at the described operating body before described display screen based on described image acquisition device.

In the embodiment of the present application, in order to the input operation of determination operation body, need first to obtain parameter information, specifically, obtain parameter information obtains the described operating body before being positioned at described display screen at least one two field picture particular by image acquisition units in step S1, at least one two field picture, extract the parameter information needed for the embodiment of the present application.

We have such one to experience in actual life, when to move or after rotation head, although the virtual image in mirror keeps symmetrical with actual object, but, because the viewpoint of people has become, thus in the border seen of people as also there occurs change.So, in order to the input operation of user can be determined exactly, just need the visual angle knowing now user.After having had the view parameter information of user, the first digital picture could be built.

Specifically, in the embodiment of the present application, at least one two field picture obtained by image acquisition units, by face capturing technology or Eye Recognition etc. on described at least one two field picture, obtain the particular location of the eyes of user, so just obtain the viewpoint position of human eye.Wherein, the concrete grammar obtaining position of human eye in the picture has detailed introduction in the prior art, and therefore the application has not just repeated herein one by one.

S2: calculate according to pre-defined algorithm based on described parameter information, obtains described first digital picture.

After obtaining parameter information in step sl, as long as carry out pre-defined algorithm to parameter information, just can obtain the first digital picture.Specifically, in the embodiment of the present application, the specific implementation process of step S2 is:

Based on described parameter information, obtain displaying contents at least one first coordinate in human eye coordinate system of described display screen;

Based on described parameter information, obtain the primary importance information of user's eyes;

Based on described primary importance information and at least one first coordinate described, carry out the first calculating, obtain described first digital picture.

Specifically, for convenience of description, suppose that our human eye is also a video camera or image acquisition units, corresponding coordinate system is called human eye coordinate system.First based on parameter information, obtain displaying contents at least one first coordinate in human eye coordinate system, namely we first will obtain the every bit in displaying contents, the coordinate under people's eye coordinates.Then, from parameter information, obtain the primary importance information of user's eyes, because primary importance information determines the final picture that human eye is seen same object.Finally, based on primary importance information and at least one first coordinate, just acquisition first digital picture can be calculated by first.

And wherein, based on described primary importance information and at least one first coordinate described, carry out the first calculating, obtain described first digital picture, be specially again:

Based on primary importance information, build the homography matrix that described human eye coordinate is tied to the display plane coordinate system of described display screen;

According at least one first coordinate described and described homography matrix, obtain described displaying contents at least one second coordinate in described display plane coordinate system;

Based at least one second coordinate described, obtain described first digital picture.

In order to be described in detail to above-mentioned algorithm, please refer to Fig. 2 below, explanation is below a detailed process, can not illustrate separately for step above, but in detail computation process is based on the thought in above-mentioned steps.In fig. 2, we regard the eyes of user as people's eye camera, and the display plane of display screen is ABCD, image acquisition units carry out image acquisition at K point, for convenience of description, suppose that the imaging plane of the imaging plane of image acquisition units and display screen is coplanar.The primary importance information obtained by parameter information, namely position of human eye is E point, and A ' B ' C ' D ' is human eye imaging plane.Further, human eye coordinate is x _ey _ez _e, the three dimensional physical coordinate of image acquisition units is x _cy _cz _c.The computation process of the application for convenience of description, at this only with X(x, y, z) put as example illustrates, but in specific implementation process, have several points, the disposal route of all the other each points is similar.

Suppose by analysis, obtaining the coordinate of user's human eye under three dimensional physical coordinate is E(x _e, y _e, z _e), the coordinate of center under three dimensional physical coordinate of display screen display plane ABCD is O(x _o, y _o, z _o).Suppose that human eye is in moving process, the sight line of user towards the center of display screen, so human eye coordinate system x _ey _ez _ez-axis direction at three dimensional physical coordinate system x _cy _cz _cunder vector representation be suppose the display plane of display screen be ABCD perpendicular to ground, and be y with gravity direction _ethe direction of axle, and y _ethe vector representation of axle under three dimensional physical coordinate system is r _y=(0 ,-1,0).So, x can be determined according to right-hand rule _evector representation under three dimensional physical coordinate system is r _x=r _y× r _z.In order to ensure three axle strict orthogonal of three dimensional physical coordinate system each other, therefore need r _ydo following correction, r ' _y=r _z× r _x.

Next, respectively to r _x, r ' _y, r _zbe normalized operation, obtain again due to r ₁, r ₂, r ₃e can be expressed as respectively under human eye coordinate system _x=(1,0,0), e _y=(0,1,0), e _z=(0,0,1), so easily expects, supposes that we just can rotate to from human eye coordinate system the parallel space of three dimensional physical coordinate system through a rotation.So there is R _er ₁=e _x, R _er ₂=e _y, R _er ₃=e _z, so, the rotation matrix R that three dimensional physical coordinate is tied to the rotation of human eye coordinate system can be obtained _e=[re ₁re ₂re ₃] ^-1=[r _e1r _e2r _e3].

Further, the coordinate of human eye E under human eye coordinate system is (0,0,0), three dimensional physical coordinate system and human eye coordinate system just can be allowed to overlap again, namely realize, from three dimensional physical coordinate system transformation to human eye coordinate system, therefore can obtaining after rotation through a translation $R_e+t_e=R_e\left[\begin{array}{c}{x}_e\\ y_e\\ z_e\end{array}\right]+t_e=0,$ Thus calculate the translation vector that three dimensional physical coordinate is tied to human eye coordinate system and be $t_e=-R_{e}E=-R_e\left[\begin{array}{c}{x}_e\\ y_e\\ z_e\end{array}\right].$ Thus according to R _eand t _ethe external parameter that just can obtain people's eye camera is [R _et _e]=[r _e1r _e2r _e3t _e].

Further, the inner parameter matrix of known person eye camera is A _e, X point is m point in the imaging of eyes imaging plane A ' B ' C ' D ', can calculate acquisition ${\mathrm{\λ}}_1\left[\begin{array}{c}u\\ v\\ 1\end{array}\right]=A_e\left[R_e{t}_e\right]\left[\begin{array}{c}x\\ y\\ z\\ 1\end{array}\right]$ (formula 1), wherein supposes that the coordinate of m under human eye coordinate system is m=(u, v, 1), λ ₁for X point is to the vertical range of display screen imaging plane.

Suppose the line of X point and human eye E and hand over screen imaging plane in x point, if then x point is equivalent to X imaging and x point under human eye current location, so user just can see that display x point is corresponding with the X point in the virtual image.Similarly, can obtain ${\mathrm{\λ}}_2\left[\begin{array}{c}u\\ v\\ 1\end{array}\right]=A_e\left[R_e{t}_e\right]\left[\begin{array}{c}{x}^{\′}\\ y^{\′}\\ z^{\′}\\ 1\end{array}\right]$ (formula 2), λ ₂for x point is to the vertical range of eyes imaging plane A ' B ' C ' D '.Display plane due to display screen be ABCD be z _cthe plane of=0, so above-mentioned formula just can be simplified to ${\mathrm{\λ}}_2\left[\begin{array}{c}u\\ v\\ 1\end{array}\right]\text{=}{A}_e\left[R_e{t}_e\right]\left[\begin{array}{c}{x}^{\′}\\ y^{\′}\\ 0\\ 1\end{array}\right]A_e\left[r_{e1}{r}_{e2}{r}_{e3}{t}_e\right]\left[\begin{array}{c}{x}^{\′}\\ y^{\′}\\ 0\\ 1\end{array}\right]=A_e[r_{e1}$ $r_{e2}{t}_e]H_e\left[\begin{array}{c}{x}^{\′}\\ y^{\′}\\ 1\end{array}\right].$ Wherein, H _eit is exactly homography matrix.

Finally, formula (1) and formula (2) Simultaneous Equations just can be obtained $\mathrm{\λ}\left[\begin{array}{c}{x}^{\′}\\ y^{\′}\\ 1\end{array}\right]={\left[r_{e1}{r}_{e2}{t}_e\right]}^{-1}[r_{e1}$ $r_{e2}{r}_{e3}{t}_e]\left[\begin{array}{c}x\\ y\\ z\\ 1\end{array}\right]$ (formula 3).λ=λ ₁/λ ₂。Visible, by the above-mentioned explanation for preset algorithm, after we obtain the concrete coordinate figure of an X under three dimensional physical coordinate system, just can obtain the coordinate of X point on display screen imaging plane, so be presented at as X point on the position calculated, with the visual angle of oneself, user just can see that the x point of display and the virtual image of oneself are corresponding.

Enumerate two concrete examples below to calculate.

In specific implementation process, the coordinate of λ and the X point in above-mentioned formula 3, is easy to obtain by image acquisition units, suppose that the coordinate of X under three dimensional physical coordinate system is (1 ,-2,3), λ=2, the homography matrix that the primary importance information based on the acquisition of at least one image constructs is $[r_{e1}{r}_{e2}$ ${t_e]}^{-1}=\left[\begin{array}{ccc}1& 0& 0\\ 0& 1& 0\\ 0& 0& 1\end{array}\right],$ $\left[r_{e1}{r}_{e2}{r}_{e3}{t}_e\right]=\left[\begin{array}{cccc}1& 2& 4& 6\\ 8& 8& 6& 7\\ 2& 8& 5& 1\end{array}\right],$ So calculate according to formula 3 and obtain $\left[\begin{array}{c}{x}^{\′}\\ y^{\′}\\ 1\end{array}\right]=\left[\begin{array}{c}7.5\\ 8.5\\ 1\end{array}\right],$ I.e. x '=7.5, y '=8.5.

The coordinate of X under three dimensional physical coordinate system is (10 ,-8,6), λ=13, and the homography matrix that the primary importance information based on the acquisition of at least one image constructs is $[r_{e1}{r}_{e2}{t}_e{]}^{-1}=\left[\begin{array}{ccc}1& 0& 0\\ 0& 1& 0\\ 0& 0& 1\end{array}\right],$ [re1re2re3te]= $\left[\begin{array}{cccc}1& 2& 4& 6\\ 8& 8& 6& 7\\ 2& 8& 5& 1\end{array}\right],$ So calculate according to formula 3 and obtain $\left[\begin{array}{c}{x}^{\′}\\ y^{\′}\\ 1\end{array}\right]=\left[\begin{array}{c}1.846\\ 4.538\\ 1\end{array}\right],$ I.e. x '=1.846, y '=4.528.

More example has just repeated no longer one by one.

After being obtained by the coordinate in display screen plane of each point, the first digital picture can be obtained.

S3: when described operating body carries out the first input operation, determines by described first digital picture the first instruction that described first input operation is corresponding, and presents by described first virtual image action that described operating body carries out described first input operation.

In the embodiment of the present application, the first digital picture is input operation for determining user.That is, the input operation of user is determined by the first digital picture.This is because, first digital picture is according to the primary importance information architecture of user's eyes in parameter information, so, when user move or rotation head and cause viewpoint to change time, first digital picture also can respective change, so the first digital picture can determine user now viewpoint can see which type of the virtual image of oneself is, and the input operation of oneself specifically what kind of.

Such as, when user sees that the virtual image oneself pointed is at click " music " icon, but the finger of user does not touch display screen, defined the click action of user by the first digital picture, thus the first instruction generated is for opening the instruction of " music " program.

Or, when user sees that the virtual image of oneself arm has been done one and waved arm action, what define user by the first digital picture waves arm action, be defined in user in relation between the input action and instruction supposing electronic equipment and have instruction corresponding when waving arm input action for be adjusted to the highest by brightness of display screen, the first instruction that so now electronic equipment generates is that brightness of display screen is adjusted to maximum instruction.

Again or, the face seeing oneself in minute surface of user, then the first input operation be user face from just to display screen to right rotation 45 degree, defined the rotary head action of user by the first digital picture, and what define user is have rotated 45 degree to the right.Specify video fast forward 3 minutes in relation between the input action and instruction supposing electronic equipment within user's rotary head to the right 30, more than 30 degree or 30 degree by video fast forward 5 minutes, within rotary head left 30, video is stepped back 3 minutes, more than 30 degree or 30 degree video is stepped back 5 minutes, so electronic equipment now generates the video fast forward instruction of 5 minutes.

Further, after step s 3, corresponding first instruction of the first input operation due to user, so in order to allow user see, the embodiment of the present application also comprises:

At described display screen display first displaying contents;

Respond described first instruction, and control based on described first instruction the second displaying contents that the display of described display screen is different from described first displaying contents.

Specifically, first, show first content on a display screen, first content can be document, picture or video etc., and the application does not do concrete restriction.After electronic equipment detects the first instruction, respond the first instruction, and can control based on the first instruction the second displaying contents that display screen display is different from the first displaying contents.That is, first input operation of user can change the displaying contents of electronic equipment.

With object lesson, the first displaying contents and the second displaying contents are described below.

Such as, the first displaying contents is as shown in Figure 3, and electronic equipment shows the winter articles for use such as peaked cap, scarf, snow boots on a display screen, and user sees first virtual image of oneself in display screen, and can see the first displaying contents simultaneously.After user sees these winter articles for use, whether these articles for use of wanting to have a try are applicable to oneself.So, user lifts arm, sees that the virtual image of oneself left hand drops on peaked cap, and then left hand is moved to again the crown of oneself by user, is similar to the action peaked cap on display screen being clothed to oneself crown.By the first digital picture built, electronic equipment determines that user has made the action that is dressed peaked cap, so display screen shows the second displaying contents, to be moved to the position on the crown respective user first virtual image from original display position as shown peaked cap, so user will see the crown of peaked cap at oneself, as shown in Figure 4.

Certainly, first displaying contents and the second displaying contents can also be other, and such as the first displaying contents is a dialog box, and first input operation of user is the X button clicking dialog box, but user does not use mouse or body motion perception sensor, does not also have touching display screen.Determined the operation of user by the first digital picture after, so the second displaying contents is exactly the displaying contents after close box; Or, such as the first displaying contents is the 3rd page of novel, user has brandished the right hand, but user does not use mouse or body motion perception sensor, so the second displaying contents of display screen is exactly the 4th page of novel, technician belonging to the application can select according to actual needs, and the application does not do concrete restriction.

Further, in the embodiment of the present application, also comprise:

Judge that whether described first input operation meets first pre-conditioned, obtain the first judged result;

When described first is judged as YES, control the Part I of described first digital picture of described display screen display.

Because user is when using the display screen in the embodiment of the present application, different needs may be had, such as wish that the picture seen can zoom in or out, or revolve turnback etc., so user can meet first pre-conditioned the first input operation by some and controls electronic equipment and show the first digital picture, to meet the demand of oneself.

In the embodiment of the present application, first pre-conditioned can be that electronic equipment is in the electronic device built-in before dispatching from the factory, the such as right hand waves 90 degree, arm, also can be that user oneself pre-sets, such as electronic device prompts user inputs an operation, user and can like inputting according to the needs of oneself, as the face of oneself moved to the place of distance 3 centimetres from the place of distance display screen 30 centimetres, or user does the action etc. that is faced upward 15 degree, electronic equipment obtains the operation of user's input by image acquisition units, and be encoded to first pre-conditioned.

When user needs the Part I of display first digital picture, as long as user inputs again meet pre-conditioned input operation.

In order to clearly illustrate, be described below by two concrete examples.

User A is provided with the first pre-conditioned more than 5 degree, head of facing upward for user in advance.When user A gets up morning, when shaving before electronic equipment, suppose now to show the image of screen display first digital picture just for overlapping with first virtual image that user can see.In order to the chin of oneself can be seen clearly, user A just by head near display screen, and slightly to be faced upward by the head of oneself simultaneously, suppose 8 degree or 10 degree, the image acquisition units Information Monitoring of electronic equipment, now the first input operation meets first pre-conditioned.The region that electronic equipment analyzes user A eyeball fixes is now the chin of oneself, in order to the chin that user A can be made to see oneself clearly, electronic equipment controls the Part I that display screen only shows the first digital picture, namely user wishes the part seeing and see clearly most, be exactly the chin of oneself under application scenarios at this moment, as shown in Figure 5.

User B is provided with the first pre-conditioned head distance display screen for user in advance and is less than 3 centimetres and has the action of finger slip from top to down.When user B gets up morning, when drawing informer before electronic equipment, suppose now to show the image of screen display first digital picture just for overlapping with first virtual image that user can see.In order to the eye of oneself can be seen clearly, user B by head near display screen, when user B head distance display screen is less than 3 centimetres, the finger of user B has done a top-down sliding action before display screen, the image acquisition units Information Monitoring of electronic equipment, the region analyzing user B eyeball fixes is now the eye of oneself.Now the first input operation meets first pre-conditioned, in order to the eye that user B can be made to see oneself clearly, electronic equipment controls the Part I that display screen only shows the first digital picture, namely user wishes the part seeing and see clearly most, be exactly the eye of oneself under application scenarios at this moment, as shown in Figure 6.

Visible, in the technical scheme of the application, first the parameter information of the described operating body before described display screen is positioned at based on described image acquisition device, described parameter information is for building first digital picture corresponding with being positioned at the described operating body before described display screen, then calculate according to pre-defined algorithm based on described parameter information, obtain described first digital picture, described first digital picture is for determining the input operation of described operating body, and described first digital picture is mated with described first virtual image, so, when described operating body carries out the first input operation, the first instruction that described first input operation is corresponding is determined by described first digital picture, and present by described first virtual image action that described operating body carries out described first input operation, thus, solve the electronic equipment comprising Bright View how to obtain and to determine the technical matters of input operation of user, achieve after obtaining parameter information by image acquisition units, the technique effect of first input operation of user is determined by building the first digital picture.

Further, although disclose the method for some remote man-machine interactions in the prior art, as obtained the action of user's hand or finger by image acquisition units, but method of the prior art is only that the hand of user or finger are inputted cursor as one, user's body can not be identified, and the change can not passing through any part of induction user's body is as input operation, as the input operation of head and hand etc.

Further, in order to identify the input operation of user's body in prior art, user needs to hold an inductor, as game paddle, or on body worn sensing apparatus.But, in the technical scheme of the application, do not need to wear any sensing apparatus on the body of user, just can identify the action of the whole health of user, input operation correspondence prompting (being similar to cursor prompt) of the electronic equipment that now first virtual image that presents in mirror effect of user just provides as the embodiment of the present application is completely the same with the actual act of user, the electronic equipment that first digital picture of the parameter information gathered by image acquisition units constructed by pre-defined algorithm can make the embodiment of the present application provide obtains the input operation of any one part of user's body and electronic equipment is responded accordingly.

Embodiment two:

Please refer to Fig. 7, the embodiment of the present application provides a kind of electronic equipment, electronic equipment in the embodiment of the present application comprises the display screen of a mirror effect, namely no matter when whether display screen powers on, display screen surface can present first virtual image of operating body by the physical phenomenon of self, according to optical physics principle, first virtual image and operation are symmetrical about minute surface.In addition, electronic equipment in the embodiment of the present application, also has an image acquisition units, further, please refer to Fig. 7, and the electronic equipment in the embodiment of the present application also comprises:

First obtains unit 1, and for being positioned at the parameter information of the described operating body before described display screen based on described image acquisition device, described parameter information is for building first digital picture corresponding with being positioned at the described operating body before described display screen;

Second obtains unit 2, for calculating according to pre-defined algorithm based on described parameter information, obtain described first digital picture, wherein, described first digital picture is for determining the input operation of described operating body, and described first digital picture is mated with described first virtual image;

Determining unit 3, for when described operating body carries out the first input operation, determine by described first digital picture the first instruction that described first input operation is corresponding, and present by described first virtual image action that described operating body carries out described first input operation.

Further, electronic equipment also comprises:

Display unit, for described carry out the first input operation when described operating body time, the first instruction that described first input operation is corresponding is determined by described first digital picture, and present after described operating body carries out the action of described first input operation, at described display screen display first displaying contents by described first virtual image; Respond described first instruction, and control based on described first instruction the second displaying contents that the display of described display screen is different from described first displaying contents.

Further, electronic equipment also comprises:

First judging unit, for described carry out the first input operation when described operating body time, the first instruction that described first input operation is corresponding is determined by described first digital picture, and present by described first virtual image action that described operating body carries out described first input operation, or described first instruction of described response, and based on described first instruction control described display screen display be different from the second displaying contents of described first displaying contents after, judge that whether described first input operation meets first pre-conditioned, obtain the first judged result;

Control module, for when described first is judged as YES, controls the Part I of described first digital picture of described display screen display.

In the embodiment of the present application, the second acquisition unit 2 specifically comprises:

First obtains module, for based on described parameter information, obtains displaying contents at least one first coordinate in human eye coordinate system of described display screen;

Second obtains module, for based on described parameter information, obtains the primary importance information of user's eyes;

3rd obtains module, for based on described primary importance information and at least one first coordinate described, carries out the first calculating, obtains described first digital picture.

Wherein, the 3rd obtain module specifically for:

Based on primary importance information, build the homography matrix that described human eye coordinate is tied to the display plane coordinate system of described display screen;

According at least one first coordinate described and described homography matrix, obtain described displaying contents at least one second coordinate in described display plane coordinate system;

Based at least one second coordinate described, obtain described first digital picture.

Embodiment two and embodiment one, based on same total inventive concept, have just repeated no longer one by one so repeat part.

Above-mentioned one or more technical scheme in the embodiment of the present application, at least has one or more technique effects following:

1, in the technical scheme of the application, first the parameter information of the described operating body before described display screen is positioned at based on described image acquisition device, described parameter information is for building first digital picture corresponding with being positioned at the described operating body before described display screen, then calculate according to pre-defined algorithm based on described parameter information, obtain described first digital picture, described first digital picture is for determining the input operation of described operating body, and described first digital picture is mated with described first virtual image, so, when described operating body carries out the first input operation, the first instruction that described first input operation is corresponding is determined by described first digital picture, and present by described first virtual image action that described operating body carries out described first input operation, solve the electronic equipment that prior art comprises minute surface display screen and cannot realize the technical matters mutual at a distance with user, after achieving image acquisition units acquisition parameter information, first input operation of user is determined by building the first digital picture, thus make user can carry out technique effect mutual at a distance with electronic equipment.

Those skilled in the art should understand, embodiments of the invention can be provided as method, system or computer program.Therefore, the present invention can adopt the form of complete hardware embodiment, completely software implementation or the embodiment in conjunction with software and hardware aspect.And the present invention can adopt in one or more form wherein including the upper computer program implemented of computer-usable storage medium (including but not limited to magnetic disk memory, CD-ROM, optical memory etc.) of computer usable program code.

The present invention describes with reference to according to the process flow diagram of the method for the embodiment of the present invention, equipment (system) and computer program and/or block scheme.Should understand can by the combination of the flow process in each flow process in computer program instructions realization flow figure and/or block scheme and/or square frame and process flow diagram and/or block scheme and/or square frame.These computer program instructions can being provided to the processor of multi-purpose computer, special purpose computer, Embedded Processor or other programmable data processing device to produce a machine, making the instruction performed by the processor of computing machine or other programmable data processing device produce device for realizing the function of specifying in process flow diagram flow process or multiple flow process and/or block scheme square frame or multiple square frame.

These computer program instructions also can be stored in can in the computer-readable memory that works in a specific way of vectoring computer or other programmable data processing device, the instruction making to be stored in this computer-readable memory produces the manufacture comprising command device, and this command device realizes the function of specifying in process flow diagram flow process or multiple flow process and/or block scheme square frame or multiple square frame.

These computer program instructions also can be loaded in computing machine or other programmable data processing device, make on computing machine or other programmable devices, to perform sequence of operations step to produce computer implemented process, thus the instruction performed on computing machine or other programmable devices is provided for the step realizing the function of specifying in process flow diagram flow process or multiple flow process and/or block scheme square frame or multiple square frame.

Specifically, the computer program instructions that two kinds of information processing methods in the embodiment of the present application are corresponding can be stored in CD, hard disk, on the storage mediums such as USB flash disk, when the computer program instructions corresponding with the first information processing method in storage medium is read by an electronic equipment or be performed, comprise the steps:

Be positioned at the parameter information of the described operating body before described display screen based on described image acquisition device, described parameter information is for building first digital picture corresponding with being positioned at the described operating body before described display screen;

Calculate according to pre-defined algorithm based on described parameter information, obtain described first digital picture, wherein, described first digital picture is for determining the input operation of described operating body, and described first digital picture is mated with described first virtual image;

When described operating body carries out the first input operation, determine by described first digital picture the first instruction that described first input operation is corresponding, and present by described first virtual image action that described operating body carries out described first input operation.

Optionally, other computer instruction is also stored in described storage medium, these computer instructions with step: when carrying out the first input operation when described operating body, the first instruction that described first input operation is corresponding is determined by described first digital picture, and presented after described operating body carries out the action of described first input operation by described first virtual image and be performed, comprise the steps: when being performed

At described display screen display first displaying contents;

Respond described first instruction, and control based on described first instruction the second displaying contents that the display of described display screen is different from described first displaying contents.

Optionally, other computer instruction is also stored in described storage medium, these computer instructions with step: when carrying out the first input operation when described operating body, the first instruction that described first input operation is corresponding is determined by described first digital picture, and present by described first virtual image action that described operating body carries out described first input operation, or respond described first instruction, and control to be performed after the display of described display screen is different from the second displaying contents of described first displaying contents based on described first instruction, comprise the steps: when being performed

Judge that whether described first input operation meets first pre-conditioned, obtain the first judged result;

When described first is judged as YES, control the Part I of described first digital picture of described display screen display.

Optionally, what store in described storage medium calculates according to pre-defined algorithm based on described parameter information with step, obtains described first digital picture, and corresponding computer instruction, being specifically performed in process, specifically comprises the steps:

Based on described parameter information, obtain displaying contents at least one first coordinate in human eye coordinate system of described display screen;

Based on described parameter information, obtain the primary importance information of user's eyes;

Based on described primary importance information and at least one first coordinate described, carry out the first calculating, obtain described first digital picture.

Optionally, store in described storage medium with step based on described primary importance information and at least one first coordinate described, carry out the first calculating, obtain described first digital picture, corresponding computer instruction, being specifically performed in process, specifically comprises the steps:

Based on primary importance information, build the homography matrix that described human eye coordinate is tied to the display plane coordinate system of described display screen;

According at least one first coordinate described and described homography matrix, obtain described displaying contents at least one second coordinate in described display plane coordinate system;

Based at least one second coordinate described, obtain described first digital picture.

Obviously, those skilled in the art can carry out various change and modification to the present invention and not depart from the spirit and scope of the present invention.Like this, if these amendments of the present invention and modification belong within the scope of the claims in the present invention and equivalent technologies thereof, then the present invention is also intended to comprise these change and modification.

Claims (10)

1. an information processing method, be applied to an electronic equipment, described electronic equipment comprises display screen and the image collecting device that has mirror effect, present first virtual image symmetrical with being positioned at the described operating body before described display screen when the operating body of described electronic equipment is positioned at before described display screen by the mirror effect of described display screen, described method comprises:

Be positioned at the parameter information of the described operating body before described display screen based on described image acquisition device, described parameter information is for building first digital picture corresponding with being positioned at the described operating body before described display screen;

Calculate according to pre-defined algorithm based on described parameter information, obtain described first digital picture, wherein, described first digital picture is for determining the input operation of described operating body, and described first digital picture is mated with described first virtual image;

When described operating body carries out the first input operation, determine by described first digital picture the first instruction that described first input operation is corresponding, and present by described first virtual image action that described operating body carries out described first input operation.

2. the method for claim 1, it is characterized in that, described carry out the first input operation when described operating body time, the first instruction that described first input operation is corresponding is determined by described first digital picture, and present after described operating body carries out the action of described first input operation by described first virtual image, described method also comprises:

At described display screen display first displaying contents;

Respond described first instruction, and control based on described first instruction the second displaying contents that the display of described display screen is different from described first displaying contents.

3. the method as described in claim as arbitrary in claim 1 or 2, it is characterized in that, described carry out the first input operation when described operating body time, the first instruction that described first input operation is corresponding is determined by described first digital picture, and present by described first virtual image action that described operating body carries out described first input operation, or described first instruction of described response, and based on described first instruction control described display screen display be different from the second displaying contents of described first displaying contents after, described method also comprises:

Judge that whether described first input operation meets first pre-conditioned, obtain the first judged result;

When described first is judged as YES, control the Part I of described first digital picture of described display screen display.

4. method as claimed in claim 3, is characterized in that, describedly calculates according to pre-defined algorithm based on described parameter information, obtains described first digital picture, is specially:

Based on described parameter information, obtain displaying contents at least one first coordinate in human eye coordinate system of described display screen;

Based on described parameter information, obtain the primary importance information of user's eyes;

Based on described primary importance information and at least one first coordinate described, carry out the first calculating, obtain described first digital picture.

5. method as claimed in claim 4, is characterized in that, described based on described primary importance information and at least one first coordinate described, carries out the first calculating, obtains described first digital picture, be specially:

Based on primary importance information, build the homography matrix that described human eye coordinate is tied to the display plane coordinate system of described display screen;

According at least one first coordinate described and described homography matrix, obtain described displaying contents at least one second coordinate in described display plane coordinate system;

Based at least one second coordinate described, obtain described first digital picture.

6. an electronic equipment, comprise display screen and image collecting device that one has mirror effect, present first virtual image symmetrical with being positioned at the described operating body before described display screen when the operating body of described electronic equipment is positioned at before described display screen by the mirror effect of described display screen, described electronic equipment also comprises:

First obtains unit, and for being positioned at the parameter information of the described operating body before described display screen based on described image acquisition device, described parameter information is for building first digital picture corresponding with being positioned at the described operating body before described display screen;

Second obtains unit, for calculating according to pre-defined algorithm based on described parameter information, obtain described first digital picture, wherein, described first digital picture is for determining the input operation of described operating body, and described first digital picture is mated with described first virtual image;

Determining unit, for when described operating body carries out the first input operation, determines by described first digital picture the first instruction that described first input operation is corresponding, and presents by described first virtual image action that described operating body carries out described first input operation.

7. electronic equipment as claimed in claim 6, it is characterized in that, described electronic equipment also comprises:

Display unit, for described carry out the first input operation when described operating body time, the first instruction that described first input operation is corresponding is determined by described first digital picture, and present after described operating body carries out the action of described first input operation, at described display screen display first displaying contents by described first virtual image; Respond described first instruction, and control based on described first instruction the second displaying contents that the display of described display screen is different from described first displaying contents.

8. electronic equipment as claimed in claims 6 or 7, it is characterized in that, described electronic equipment also comprises:

First judging unit, for described carry out the first input operation when described operating body time, the first instruction that described first input operation is corresponding is determined by described first digital picture, and present by described first virtual image action that described operating body carries out described first input operation, or described first instruction of described response, and based on described first instruction control described display screen display be different from the second displaying contents of described first displaying contents after, judge that whether described first input operation meets first pre-conditioned, obtain the first judged result;

Control module, for when described first is judged as YES, controls the Part I of described first digital picture of described display screen display.

9. electronic equipment as claimed in claim 8, is characterized in that, described second obtains unit specifically comprises:

First obtains module, for based on described parameter information, obtains displaying contents at least one first coordinate in human eye coordinate system of described display screen;

Second obtains module, for based on described parameter information, obtains the primary importance information of user's eyes;

3rd obtains module, for based on described primary importance information and at least one first coordinate described, carries out the first calculating, obtains described first digital picture.

10. electronic equipment as claimed in claim 9, is characterized in that, the described 3rd obtain module specifically for:

Based on primary importance information, build the homography matrix that described human eye coordinate is tied to the display plane coordinate system of described display screen;

According at least one first coordinate described and described homography matrix, obtain described displaying contents at least one second coordinate in described display plane coordinate system;

Based at least one second coordinate described, obtain described first digital picture.