CN103634632B - The processing method of pictorial information, Apparatus and system - Google Patents

Abstract

The present invention relates to the processing method of a kind of pictorial information, device and system, described method includes: receive user's input information or action message that terminal sends；If described input information or action message are predefined control information of checking, then obtain the pictorial information of photo current；The picture related information relevant to photo current is obtained according to described pictorial information；Pictorial information and/or the picture related information of described photo current are generated display information, in order to described display information to be shown.The processing method of pictorial information, device and the system that the present invention provides, the relevant information of picture can be shown conveniently and efficiently, and automatically obtain the related information with shown picture, so that user carries out interaction and shares, simple and fast, improve the efficiency of acquisition information, strengthen the Consumer's Experience of multi-screen interactive.

Description

The processing method of pictorial information, Apparatus and system

Technical field

The present invention relates to network communication technology field, particularly relate to the processing method of a kind of pictorial information, Apparatus and system.

Background technology

Along with the development of intellectualized technology, the Information Communication of the mankind has come into the 5th developmental stage---and interactive communication period, mobile device, TV and Set Top Box have begun to access in many ways internet content.And the multi-screen interactive of TV, computer and mobile phone is the application advantage highlighted greatly in the intelligence epoch one, it it is following developing direction.

Multi-screen interactive is to be connected by the wireless network such as WIFI or bluetooth, in different multimedia terminal, as between mobile phone and internet television, multimedia (audio frequency, video can be carried out, picture) transmission of content, the sequence of operations such as parsing, shows, control, can share on different platform equipment simultaneously show content, the multimedia life of abundant user.By multi-screen interactive technology, smart mobile phone body variable intelligent remote controller and replace traditional infrared remote controller, intelligent control software by intelligent terminal realizes outside the various ways controls such as the keyboard to TV, mouse, voice, TV large-size screen monitors are with content interaction sufficient between the smaller screen of intelligent terminal, it is achieved intelligent human-machine interaction.Photo on mobile phone or computer, music, file, it is not necessary to access any holding wire, just can directly browse on internet television, play, be particularly suitable under home environment carrying out multi-screen interactive and check the content of multimedia such as picture.

Along with popularizing of the equipment such as digital camera, high image quality shooting mobile phone, the mode of production of photo gets more and more, go out tourism, friend party or be exactly at will to pat, take pictures and be increasingly becoming people and record the mode of life, and quite a few built-in GPS module of these cameras, mobile phone, geographical location information and commutative pictorial information EXIF information etc. can be added to photo.People are often desirable to again checking picture when help to look back fine moment by these interesting information, and when household or friend check picture, it is also desirable to obtain the relevant information of corresponding picture, in order to picture is had further understanding.

But, the picture of existing internet television checks that mode is mainly still limited to graphic image itself, the satellite information to picture, the information such as including the social content that EXIF information, geographical location information and the picture such as picture is relevant, does not provide display.People need just can be found these information of picture by complex means, it is impossible to providing the display service of fast and convenient information, impact carries out interaction and the speed shared, poor user experience.

Summary of the invention

It is an object of the invention to provide the processing method of a kind of pictorial information, Apparatus and system, the relevant information of picture can be shown conveniently and efficiently, and automatically obtain the related information with shown picture, so that user carries out interaction and shares, simple and fast, improve user and obtain the efficiency of information, strengthen the Consumer's Experience of multi-screen interactive.

For achieving the above object, the invention provides the processing method of a kind of pictorial information, described method includes:

Receive user's input information or action message that terminal sends；

If described input information or action message are predefined control information of checking, then obtain the pictorial information of photo current；

The picture related information relevant to photo current is obtained according to described pictorial information；

Pictorial information and/or the picture related information of described photo current are generated display information, in order to described display information to be shown.

Another aspect, present invention also offers the processing method of a kind of pictorial information, and described method includes:

Receive the input information of user or sense the action message of terminal described in user operation；

If described input information or action message are predefined control information of checking, then send described in check control information, in order to Set Top Box according to described in check that control information obtains the pictorial information of photo current and picture related information generation display information.

Another aspect, present invention also offers a kind of digital television receiving apparatus, and described digital television receiving apparatus includes:

Communications reception unit, for receiving user's input information or the action message that terminal sends；

First trigger element, is used for judging that whether described input information or action message be predefined to check control information, if it is, trigger message acquiring unit；

Information acquisition unit, for after the triggering by described first trigger element, obtains the pictorial information of photo current, and obtains the picture related information relevant to photo current according to described pictorial information；

Content generation unit, for generating display information, in order to described display information to be shown by the pictorial information of described photo current and/or picture related information.

Another aspect, present invention also offers a kind of remote controller, and described remote controller includes:

Interactive unit, for receiving the input information of user；

Sensor unit, for sensing the action message of remote controller described in user operation；

3rd trigger element, is used for judging that whether described input information or action message be predefined to check control information, if it is, trigger communication unit send described in check control information；

Communication unit, for checking that control information is sent to Set Top Box by described, in order to digital television receiving apparatus according to described in check that control information obtains pictorial information and the picture related information generation display information of photo current.

Another aspect, present invention also offers the processing system of a kind of pictorial information, and described system includes: remote controller, Set Top Box and the display that the embodiment of the present invention provides；It is connected by communication between described remote controller and digital television receiving apparatus；It is connected by wired mode between described digital television receiving apparatus and display.

The processing method of pictorial information of present invention offer, Apparatus and system, the relevant information of picture can be shown conveniently and efficiently, utilize touch screen remote terminal, the preview picture of control telescreen and broadcasting, and utilize the operating control signal of the sensor sensing user such as gyroscope, gravity sensor, and can automatically acquire more related information, so that user carries out interaction and shares, simple and fast, improves user and obtains the efficiency of information, strengthen the Consumer's Experience of multi-screen interactive.

Accompanying drawing explanation

The schematic diagram of the processing system that the processing method of the pictorial information that Fig. 1 provides for a kind of embodiment of the present invention is based on；

The process flow figure of the pictorial information that Fig. 2 provides for the embodiment of the present invention one；

The process flow figure of the pictorial information that Fig. 3 provides for the embodiment of the present invention two；

The process flow figure of the pictorial information that Fig. 4 provides for the embodiment of the present invention three；

The processing system schematic diagram of the pictorial information that Fig. 5 provides for the embodiment of the present invention four；

The device schematic diagram of the remote controller that Fig. 6 provides for the embodiment of the present invention five；

The digital television receiving apparatus schematic diagram that Fig. 7 provides for the embodiment of the present invention five.

Detailed description of the invention

Below by drawings and Examples, technical scheme is described in further detail.

Multi-screen interactive can be in different operating system (such as iOS, Android, Win7, windowsXP, VISTA etc.), and compatible leap operates between different terminal units (such as smart mobile phone, Intelligent flat, computer, TV etc.), it is general by the way of wireless network connects, realize the transmission of digital multimedia (video, audio frequency, picture) content, the display content of different screen can be synchronized, and the sequence of operations such as control equipment can be realized by intelligent terminal, it is particularly suitable for building home intelligent center, brings good Consumer's Experience to user.Such as, when user browses the photo of out on tours shooting, then can pass large-size screen monitors by Multi-screen interaction system smaller screen, allow mobile phone, TV, computer realize interactive sharing comprehensively, picture in mobile phone, video resource are transmitted wirelessly directly in TV play, it is achieved freely share.

The processing method of the pictorial information that the embodiment of the present invention provides, device and system, can be applicable to the scene of browsing pictures in intelligent terminal or Multi-screen interaction system, picture is only provided to check for existing internet television, and the display of the related contents such as the EXIF information of picture cannot be provided, the present invention is on the basis of display checked by existing picture, a kind of method that can check the information relevant to picture conveniently and efficiently is provided, device and system, make user can obtain relevant information rapidly, sharing and interactive between multi-user can be strengthened, meet the picture viewing experience of user.For utilizing Multi-screen interaction system to carry out the inspection method of graphic image itself, the present invention is not any limitation as, and can realize the display of picture in a conventional manner.

Fig. 1 is the schematic diagram of the processing system that the processing method of pictorial information that a kind of embodiment of the present invention provides is based on, as it is shown in figure 1, this processing system includes Set Top Box T1, smart mobile phone T2 and television set T4.Set Top Box T1 is for the control instruction according to user, by bit stream datas such as the digital television programs received, it is demodulated to video, audio frequency, picture or electric program menu information etc., processing means in order to output display, in the processing system that the inventive method is based on, it would however also be possible to employ other digital television receiving apparatus.One of ordinary skill in the art should be appreciated that the present invention illustrates as a example by Set Top Box, but does not limit the present invention with this.Television set T4 provides large screen display, naturally it is also possible to use other display devices.Television set T4 is connected to Set Top Box T1 by high-definition multimedia transmission line (HDMI wire).User is by being provided with the terminals such as the smart mobile phone T2 of remote control applications program (APP), computer T3 or the Intelligent flat (not shown) controller as Set Top Box T1, it is connected by the way of WLAN W1 uses radio communication between smart mobile phone T2 with Set Top Box T1, whole WLAN W1 can be connected with the Internet, it is achieved internet television.Set Top Box T1, after receiving the control instruction that smart mobile phone T2 sends, after processing accordingly, presents on television set T4 and shows content accordingly.

Embodiment one

Fig. 2 is the process flow figure of the pictorial information that the present embodiment provides, as in figure 2 it is shown, the treating method comprises:

Step S201, Set Top Box receive user's input information or the action message that terminal sends.

When terminal receives the action message of user's input information or user operation terminal, received user's input information or action message are transmitted to set-top box processes.Described user's input information is inputted by keyboard or touch screen, described action message is sensed by the sensor of terminal built-in, in order to detect the action of user operation terminal, when user's rotation or mobile terminal, rotational angle or the translation displacements etc. of terminal can be detected.These input information or action message are sent to Set Top Box by the communication such as WIFI or bluetooth by described terminal, after Set Top Box receives described input information or the action message of terminal transmission, enter step S202.

Step S202, Set Top Box judge that whether described input information or action message be predefined to check control information, if it is, enter step S203, otherwise enter step S206.

If described input information be described information inspection pattern corresponding button or gesture, or, acceleration signature value, velocity characteristic value or angle character value in described action message is more than predetermined threshold value, then it is assumed that be predefined control information of checking, enters step S203.

Step S203, Set Top Box obtain the pictorial information of photo current.

Set Top Box obtains the title of photo current, the shooting time of picture, the EXIF information of picture or the geographical location information of picture.Described pictorial information and picture are collectively stored in own memory device or the external storage equipment of Set Top Box.Similar with reading picture, when entering display mode information, the pictorial information of storage is read by Set Top Box.

Step S204, Set Top Box obtain the picture related information relevant to photo current according to described pictorial information.

Set Top Box utilizes title or the geographical location information of picture, can acquire relevant picture related information, the information such as including panorama sketch, social network sites information or encyclopaedia information from server or network.

Specifically, Set Top Box according to the coordinate position in the geographical location information of described picture, obtains identical with described coordinate position or that distance with described coordinate position is within predeterminable range threshold value panorama sketch, social network sites information or encyclopaedia information from server or network.Or, Set Top Box first calculates the title of panorama sketch in the title of described picture and server or network, text degree of association between the text message of social network sites or the text message of encyclopaedia website, and described text degree of association meets the panorama sketch being defined as matching with described title, social network sites information or the encyclopaedia information of preset requirement.

Pictorial information and/or the picture related information of described photo current are generated display information, in order to described display information to be shown by step S205, Set Top Box.

Pictorial information or the picture related information of photo current are generated display information by Set Top Box, it is provided that to external display, showing information described in the big screen display of display.

Step S206, Set Top Box generate display content according to normal mode, in order to described display content to be shown.

When user carry out picture check time, whole photo library use traditional list presentation mode, when user selects single picture, selected picture is amplified to full screen display.When user horizontally slips on the touch screen of controller, on large-size screen monitors, picture switches to one or next is opened.

Embodiment two

Fig. 3 is the process flow figure of the pictorial information that the present embodiment provides, as it is shown on figure 3, the treating method comprises:

Step S301, terminal receive the input information of user or sense the action message of terminal described in user operation.

Terminal receives user's input information or the action message of user operation terminal.Described user's input information is inputted by keyboard or touch screen, described action message is sensed by the sensor of terminal built-in, in order to detect the action of user operation terminal, when user's rotation or mobile terminal, rotational angle or the translation displacements etc. of terminal can be detected.

Whether be predefined check control information, if it is, enter step S303, otherwise enter step S304 if described in step S302, terminal judges, inputting information or action message.

If described input information be described information inspection pattern corresponding button or gesture, or, acceleration signature value, velocity characteristic value or angle character value in described action message is more than predetermined threshold value, then it is assumed that be predefined control information of checking, enters step S303.

Step S303, terminal send described in check control information to Set Top Box, in order to Set Top Box according to described in check that control information obtains pictorial information and the picture related information generation display information of photo current.

Step S304, terminal send other control information to Set Top Box according to described input information or action message, generate display content in order to Set Top Box according to described control information, in order to described display content to be shown.

Such as, when being judged as the picture display mode of routine, then process according to picture display mode, picture is shown to user.

Embodiment three

Fig. 4 is the process flow figure of the pictorial information that the present embodiment provides, and as shown in Figure 4, the processing method of the pictorial information of the present invention includes:

Step S401, terminal receive the input information of user or sense the action message of terminal described in user operation.

The input of user includes the information such as button and the keystroke sequence that user inputs, or the gesture of input.Generally user by remote controller or passes through the intelligent terminal equipped with corresponding remote control applications program as controller, the display checking picture is controlled, by the different pages or piecemeal that select inputting on keyboard to present on button or intelligent terminal, determine the input information of user.The input information of user includes the information such as button and the keystroke sequence that user inputs, the gesture of user's input.

The action message of user operation terminal is sensed by the sensor of terminal built-in.Built-in sensor can be, but not limited to include the sensors such as gyroscope, accelerometer, gravity sensor or sonic transducer.Utilize these sensors, the action of detection user operation terminal, when user's rotation or mobile terminal, rotational angle or the translation displacements etc. of terminal can be detected.

Step S402, judge that whether described input information or action message be predefined to check control information, if it is, trigger the information inspection pattern entering picture, enter step S403, otherwise, enter step S406.

Specifically, it is judged that whether the input information of user is button corresponding to described information inspection pattern or gesture, if it is, confirm that the input of described user is described information inspection pattern.

Wherein, button or the gesture of correspondence that described information inspection pattern is corresponding are all to use predefined mode, such as, may be set in and full frame check that again inputting carriage return button under pattern is the button that information inspection pattern is corresponding, the mode using multiple key combination can also be set as button corresponding to information inspection pattern, or, it is also possible to set gesture that user slides up and down as gesture corresponding to information inspection pattern.

Or, utilize remote controller or the upper built-in sensor of intelligent terminal, the eigenvalues such as acceleration signature value, velocity characteristic value or the angle character value of detection user operation terminal (i.e. controller), judge that whether acceleration signature value, velocity characteristic value or angle character value are more than predetermined threshold value, if it is, confirm that described user input is for described information inspection pattern.

Wherein, gyroscope can detect terminal angle character value on X-axis, Y-axis, three directions of Z axis, and thus gyroscope can detect the rotational angle of terminal.Accelerometer can detect terminal acceleration signature value on X-axis, Y-axis, three directions of Z axis and velocity characteristic value, and degree of thereby speeding up meter can detect the translation displacements of terminal.Gravity sensor can detect the terminal angle character value relative to level ground, and thus gyroscope can detect the rotational angle of terminal.Sonic transducer can detect the acoustic pressure eigenvalue of terminal peripheral environment, and thus sonic transducer can detect the sound variation that terminal receives.

When rotational angle terminal being detected is more than predetermined angle threshold value, or, when the translational speed of controller or acceleration are more than pre-set velocity or acceleration rate threshold, then it are judged as the input signal of predefined information inspection pattern, trigger and enter information inspection pattern.Such as, when user overturns terminal, the rotational angle that gyroscope detects has exceeded predetermined angle threshold value, then trigger and enter information inspection pattern, obtain relevant pictorial information and picture related information thereof, be shown to user in large-size screen monitors.

It should be noted that this step both can be arranged in Set Top Box, now, described input information or action message are first sent to Set Top Box by terminal, and Set Top Box judges whether described input information that terminal sends or action message trigger predefined pattern.Or, this step can also be arranged in remote controller terminal, and remote controller terminal, after receiving described input information or action message, first judges whether to trigger predefined pattern, if it is, send the control information of associative mode to Set Top Box.

Step S403, Set Top Box obtain the pictorial information of photo current.

Described pictorial information includes: the title of picture, the shooting time of picture, the EXIF information of picture or the geographical location information of picture.

The photo that the equipment such as existing digital camera or shooting mobile phone are taken would generally be with shooting time and exchangeable image file EXIF information; the parameter value such as including camera model, shutter, aperture, focal length, light sensitivitys, white balance, it might even be possible to global positioning information (GPS information).The title of picture can be created by user or revise, it is simple to the relevant information of recordable picture.

These pictorial informations can be, but not limited to use the form of array linked list or index slide fastener to be stored in the memory element of Set Top Box, external memory card or set-top-box server.For example, it is possible to picture, picture name, EXIF information and geography information etc. are stored with the form of data link table, then the numbering or title with picture sets up index slide fastener.Similar with reading picture, when entering display mode information, these pictorial informations of storage are read by Set Top Box.

Step S404, Set Top Box, according to described pictorial information, obtain the picture related information relevant to photo current.

Set Top Box utilizes title or the geographical location information of picture, can acquire relevant picture related information, the information such as including panorama sketch, social network sites information or encyclopaedia information from server or network.Such as, Set Top Box can get relevant microblogging, comment etc. from network, in order to provide other users the comment etc. to photo current related content, makes convenient the participation rapidly of user share interaction.Alternatively, Set Top Box can also obtain relevant encyclopaedia information from network, such as, the spot for photography of picture is YiHeYuan,BeiJing, when selecting entrance to check encyclopaedia information, then utilize picture shooting location information can search for from network and obtain the recommended information that the Summer Palace is corresponding, it is simple to viewer understands the recommended information relevant to this place, position, convenient and swift.

Specifically, Set Top Box according to the coordinate position in the geographical location information of described picture, obtains identical with described coordinate position or that distance with described coordinate position is within predeterminable range threshold value panorama sketch, social network sites information or encyclopaedia information from server or network.

Giving an example, the picture that user currently checks is one and shoots in the photo of certain place A, and when shooting, the geographical location information of record is coordinate (X1, Y1).When triggering entrance display mode information, Set Top Box is similar with the photo reading storage, read out the geographical position coordinates (X1 of the place A of storage, Y1), and mate in set-top-box server, by that calculation server preserves or from network distance between the coordinate of the panorama sketch that pre-search obtains Yu this geographical position coordinates (X1, Y1), can obtain and place A distance panorama sketch within predeterminable range threshold value, choose these panorama sketch picture related information as coupling.

Or, Set Top Box first calculates the title of panorama sketch in the title of described picture and server or network, text degree of association between the text message of social network sites or the text message of encyclopaedia website, and described text degree of association meets the panorama sketch being defined as matching with described title, social network sites information or the encyclopaedia information of preset requirement.

For the picture with Word message or terrestrial reference landscape class etc., Set Top Box can also characteristic information corresponding to image content or Word Input further, the characteristic information extracted is mated with existing feature database, automatically identify the interior perhaps title in picture, acquire relevant picture related information the most again.

Pictorial information and/or the picture related information of described photo current are generated display information, in order to described display information to be shown by step S405, Set Top Box.

When user carry out picture check time, whole photo library use traditional list presentation mode, when user selects single picture, selected picture is amplified to full screen display.When user horizontally slips on the touch screen of controller, on large-size screen monitors, picture switches to one or next is opened.

When the triggering signal of information inspection pattern being detected, trigger and enter information inspection pattern.From server, obtain the pictorial information of photo current, and utilize pictorial information to obtain the picture related information that photo current is relevant.

Pictorial information or the picture related information of photo current are generated display content, in big screen display.Preferably, after entering information inspection pattern, picture in big screen display inverts, can be, but not limited to use the animation effect of simulation entity photo upset, such as, picture diagonally overturns from the lower left corner, in the information of the back displays picture of picture, including EXIF information, geographical location information etc., can be with default tile title, shooting time, shooting diaphragm shutter value.When showing geographical location information, map can be shown, indicate this camera site with eye-catching position icon.Meanwhile, may be provided for other related informations such as panorama sketch and microblogging on the display page checks that button selects for user.When entering panorama sketch and checking, user can use double charge panorama sketch processed to zoom in and out and check；Zoom in and out check time, after narrowing down to acquiescence minimum display, continue to zoom out and i.e. exit panorama sketch and check, the most also support the withdrawing mode of acquiescence.

Certainly, it will be understood by those of skill in the art that concrete presentation mode is not the emphasis of the present invention, can need to generate the display content of different-style according to different actual application.

Step S406, judge whether described input information or action message are other predefined control information, if it is, carry out step S407, otherwise carry out step S408, and Set Top Box does not carry out action.

Other predefined control information described include that the control information in pattern, the pictorial information amendment various pattern such as pattern, the mode of secession checked by picture.Such as, when checking picture, receive the control information of double-click and can carry out picture Zoom display, when receiving the control information slided to the left or to the right, the picture of display is switched to upper one or next etc..

It should be noted that the sequencing of step S406 and step S402 has no effect on final judged result, in actual scene, generally step S406 and step S402 are combined into a step.

Step S407, Set Top Box generate display content according to described predefined control information, in order to described display content to be shown, such as, when being judged as the picture display mode of routine, then process according to picture display mode, picture is shown to user.

In a preferred embodiment, after the picture related information of photo current being generated display content and is shown to user, user operation terminal moves or rotates, built-in sensor can continue to detect the acceleration signature value of terminal, velocity characteristic value and angle character value, utilizes these eigenvalues to determine moving direction and the translational speed of terminal.Followed by described moving direction move with the speed that described translational speed is suitable thus according to this moving direction and the described display content of translational speed control.

Such as, when user turns left terminal, gyroscope detects rotational angle and the velocity of rotation of left direction, then the picture shown in large-size screen monitors is also moved to the left with suitable velocity of rotation, so, user can adjust viewing angle, the viewing visual angle that simulation is actual easily, especially when checking panorama sketch, bring good Consumer's Experience.

Specifically, when user selects to check panorama sketch, enter panorama and check pattern, utilize the geographical location information of picture, the panorama sketch of position near obtaining, the disclosed panorama sketch data such as such as SOSO streetscape, Microsoft Photosynth, at these panorama sketch of big screen display, simultaneously can be at the geographical location information of wicket display picture.After entrance panorama checks pattern, using the movement of gyroscope induction controller, thus control panorama sketch accordingly, operation picture moves up and down.When user operation remote controller is moved to the left, the visual angle of picture is the most and then moved to the left.

The display packing of the pictorial information that the present invention provides is easy to check the relevant informations such as the EXIF information of picture, shooting time, geographical position, and geographical position is comprehensively analyzed, obtaining and pushing needs to expand the content (panorama sketch etc. that such as photo geographical position is relevant) presented, for presenting on large-size screen monitors after being switched to check pattern accordingly, and by controller, the display page is carried out relevant control.

It is above the detailed description that the processing method of pictorial information provided by the present invention is carried out, below the processing means of the pictorial information that the present invention provides is described in detail.

Embodiment four

Fig. 5 is the processing system schematic diagram of the pictorial information that the present embodiment provides, as it is shown in figure 5, the processing system of the pictorial information of the present invention includes: remote controller 31, Set Top Box 32 and display 33.It is the relation being sequentially connected with between remote controller 31, Set Top Box 32 and display 33.It is connected by communication between Set Top Box 32 with remote controller 31, including bluetooth, WIFI or infrared etc..It is connected by wired mode between Set Top Box 32 with display 33.

Remote controller 31 can be equipped with the intelligent terminal of corresponding remote control applications program, as being loaded with specific software client on the smart mobile phone of touch, during open state, smart mobile phone is opened multi-screen interactive function, setting mates annexation with Set Top Box 32, after successful connection, can be communicated by wireless signal between Set Top Box 32 and remote controller 31.Display 33 can use HDTV, uses HDMI or common audio frequency and video line (AV line) to be connected with Set Top Box 32.

Remote controller 31 includes touch screen 311, sensor 312, transducer 313 and wireless communication unit 314.Touch screen 311 is for providing the interactive interface with user, and the gesture of the input information of sensing user and user's input is as the input signal of user.Sensor 312 is for detecting acceleration signature value or the angle character value of described user operation remote controller, as the input signal of user.The input signal of the transducer 313 described user for touch screen 311 and sensor 312 being sensed changes into corresponding signal and is supplied to wireless communication unit 314.Wireless communication unit 314 is for sending the output signal of transducer 313 to Set Top Box 32.

Remote controller 31 receives or senses the input of user, and judges that whether the input of described user is the input signal of predefined information inspection pattern.

Specifically, the input signal of predefined information inspection pattern can be, but not limited to include: 1) user selects the button that information inspection pattern is corresponding, such as input enter key or other Macintosh on the touch screen 311 of remote controller 31；2) gesture that user inputs on the touch screen 311 of remote controller 31 is the gesture that information inspection pattern is corresponding, and such as, user slides up and down on touch screen 311；3) the acceleration signature value of described user operation remote controller 31, velocity characteristic value, angle character value or sound pressure level are detected more than predetermined threshold value by the sensor 312 that remote controller 31 is built-in.

Sensor 312 can include the sensors such as gyroscope, accelerometer, gravity sensor or sonic transducer.Utilize these sensors, the action of detection user operation remote controller 31, when user's rotation or mobile remote control device 31, rotational angle or the translation displacements etc. of remote controller 31 can be detected.

Wherein, gyroscope can detect the remote controller 31 angle character value on X-axis, Y-axis, three directions of Z axis, and thus gyroscope can detect the rotational angle of remote controller 31.Accelerometer can detect the remote controller 31 acceleration signature value on X-axis, Y-axis, three directions of Z axis and velocity characteristic value, and degree of thereby speeding up meter can detect the translation displacements of remote controller 31.Gravity sensor can detect the remote controller 31 angle character value relative to level ground, and thus gyroscope can detect the rotational angle of remote controller 31.Sonic transducer can detect the acoustic pressure eigenvalue of remote controller 31 peripheral environment, and thus sonic transducer can detect the sound variation that remote controller 31 receives, and can directly use the mike of mobile phone as sonic transducer.So, the smart mobile phone as remote controller 31 " is shaken " by user, " blowing ", can trigger entrance information inspection pattern.

Give an example, under pattern checked by picture, the display 33 of the external large-size screen monitors of Set Top Box 32, and carry out individual and full frame check.When remote controller 31 rotates to an angle for axle with the center line that long limit is parallel, and sensor 312 can sense the change of angle character value, when rotational angle exceedes a certain threshold value (such as 45 °), trigger and enter predefined information inspection pattern.

When the input that remote controller 31 detects described user is predefined information inspection pattern, send the triggering signal of information inspection pattern to Set Top Box 32.

If remote controller 31 detects when the input of user is other input signals, then send picture check mode signal to Set Top Box 32, thus Set Top Box 32 controls display 33 in a conventional manner and shows picture.

The picture shown over the display can be the photo that Set Top Box imports from SD card, or the cell phone pictures shared by wireless wifi, it is also possible to be the photo got from the Internet, such as good friend space photo etc..

Set Top Box 32, after the triggering signal receiving information inspection pattern, obtains the pictorial information of photo current, including: the title of picture, the shooting time of picture, the EXIF information of picture or the geographical location information of picture.

Further, Set Top Box 32 is utilized title or the geography information of picture, obtains the picture related information relevant to described pictorial information, including the panorama sketch being correlated with, social network sites information or encyclopaedia information etc..

Specifically, Set Top Box 32 according to the coordinate position in the geographical location information of described picture, obtains identical with described coordinate position or that distance with described coordinate position is within predeterminable range threshold value panorama sketch, social network sites information or encyclopaedia information from server or network.

Or, Set Top Box 32 calculates the title of panorama sketch in the title of described picture and server or network, text degree of association between the text message of social network sites or the text message of encyclopaedia website, and described text degree of association meets the panorama sketch being defined as matching with described title, social network sites information or the encyclopaedia information of preset requirement.

Then, pictorial information or the picture related information of described photo current are generated display content by Set Top Box 32, it is provided that to display 33, the display content of generation is shown to user by display 33.

Alternatively, the picture of display 33 display inverts, and can be, but not limited to use the animation effect of simulation entity photo upset, in the information of the back displays picture of picture, including EXIF information, geographical location information etc., can be with default tile title, shooting time, shooting diaphragm shutter value.When showing geographical location information, map can be shown, indicate this camera site with eye-catching position icon.At the same time it can also be display the page on may be provided for other related informations such as panorama sketch and microblogging check button for user select.

Additionally, remote controller 31 is after the picture related information generation display content of photo current is shown to user by display 33, judge whether user produces action that is mobile or that rotate described remote controller also by built-in sensor 312, if, then determine moving direction and the translational speed of described controller according to described velocity characteristic value or angle character value, and send to Set Top Box 32.Set Top Box 32 followed by described moving direction and moves with the speed that described translational speed is suitable according to described moving direction and speed, the display content of control display 33, carry out synchronous manipulation.

Embodiment five

Fig. 6 is the device schematic diagram of the remote controller that the present embodiment provides, and as shown in Figure 6, the remote controller 10 of the present invention includes interactive unit 101, sensor unit the 102, first processing unit 103 and communication unit 104.

Interactive unit 101, for interacting with user, receives the input information of user.

Generally user by remote controller or passes through the intelligent terminal equipped with corresponding remote control applications program as controller, the display checking picture is controlled, thus, the input information of user typically by keyboard for remote control or intelligent terminal touch screen or keyboard, by the different pages or piecemeal that select inputting on keyboard to present on button or intelligent terminal, determine the input information of user.The input information of user includes the information such as button and the keystroke sequence that user inputs, the gesture of user's input.

Sensor unit 102 is for sensing the action message of remote controller described in user operation.

Sensor unit 102 is built in remote controller 10, in order to detect the acceleration signature value of user operation remote controller, velocity characteristic value or angle character value etc..

Sensor unit 102 can be, but not limited to use the sensors such as gyroscope, accelerometer, gravity sensor or sonic transducer.Utilize these sensors, the action of detection user operation remote controller, when user's rotation or mobile remote control device, rotational angle or the translation displacements etc. of remote controller can be detected.

Wherein, gyroscope can detect remote controller angle character value on X-axis, Y-axis, three directions of Z axis, and thus gyroscope can detect the rotational angle of remote controller.Accelerometer can detect remote controller acceleration signature value on X-axis, Y-axis, three directions of Z axis and velocity characteristic value, and degree of thereby speeding up meter can detect the translation displacements of remote controller.Gravity sensor can detect the remote controller angle character value relative to level ground, and thus gyroscope can detect the rotational angle of remote controller.Sonic transducer can detect the acoustic pressure eigenvalue of remote controller peripheral environment, and thus sonic transducer can detect the sound variation that remote control arrives.

First processing unit 103, for described input information or action message carry out conversion process, generates corresponding control information, and described control information is sent to Set Top Box 20 through communication unit 104.

Communication unit 104, for the control information of the first processing unit 103 is sent to Set Top Box 20, generates corresponding display information in order to Set Top Box 20 according to described control information.

The conversion process of the first processing unit 103 includes that button, gesture information or action message by user inputs carry out code conversion, is converted into the corresponding informance that Set Top Box 20 can identify.First processing unit 103 is when carrying out code conversion, and the triggering that can not carry out concrete control model judges, is sent to Set Top Box 20 after only user's input information and action message being changed.

It should be noted that the triggering of concrete control model judges can also be arranged in remote controller 10, judged by the first processing unit 103.Specifically, the first processing unit 103 can include the 3rd trigger element (not shown) and the 4th trigger element (not shown).

3rd trigger element is used for judging that whether described input information or action message be predefined to check control information, if, then trigger communication unit 104 send described in check according to described, control information to Set Top Box 20, checks that control information obtains the pictorial information of photo current and picture related information generates display information in order to Set Top Box 20.

4th trigger element is for judging whether the action message that described sensor unit senses is predefined display control action, if, then trigger communication unit 104 and send display control information to Set Top Box 20, control, according to described display control information, the action message that described display information followed by described terminal in order to Set Top Box 20 and move.

Fig. 7 is the digital television receiving apparatus schematic diagram that the present embodiment provides, as it is shown in fig. 7, the digital television receiving apparatus 20 of the present invention includes: include communications reception unit the 201, first trigger element 202, information acquisition unit 203, content generation unit the 204, second trigger element 205 and display control unit 206.

Communications reception unit 201 is for receiving user's input information or the action message of remote controller 10 transmission.

First trigger element 202 is used for judging that whether described input information or action message be predefined to check control information, if, then trigger message acquiring unit 203 enters the information inspection pattern of picture, otherwise, it is directly entered content generation unit 204, process according to picture display mode, picture is shown to user.

Specifically, the first trigger element 202 judges that whether the input information of the user that remote controller 10 received be button corresponding to described information inspection pattern or gesture, if it is, confirm that the input of described user is described information inspection pattern.

Button or the gesture of correspondence that described information inspection pattern is corresponding are all to use predefined mode, such as, may be set in and full frame check that again inputting carriage return button under pattern is the button that information inspection pattern is corresponding, the mode using multiple key combination can also be set as button corresponding to information inspection pattern, or, it is also possible to set gesture that user slides up and down as gesture corresponding to information inspection pattern.

Or, the first trigger element 202 judges whether the acceleration signature value of user operation controller, velocity characteristic value or angle character value that remote controller 10 detects are more than predetermined threshold value, if it is, confirm that described user input is described information inspection pattern.

When rotational angle controller being detected is more than predetermined angle threshold value, or, when the translational speed of controller or acceleration are more than pre-set velocity or acceleration rate threshold, then it are judged as the input signal of predefined information inspection pattern, trigger and enter information inspection pattern.Such as, when user overturns controller, the rotational angle that gyroscope detects has exceeded predetermined angle threshold value, then trigger and enter information inspection pattern, obtain relevant pictorial information and picture related information thereof, be shown to user in large-size screen monitors.

When information acquisition unit 203 enters information inspection pattern for being triggered by the first trigger element 202, obtain the pictorial information of photo current, and obtain the picture related information relevant to described pictorial information.

Specifically, information acquisition unit 203, when being triggered entrance information inspection pattern by the first trigger element 202, first obtains the pictorial information of photo current, including: the title of picture, the shooting time of picture, the EXIF information of picture or the geographical location information of picture.These pictorial informations can be, but not limited to be stored in the memory element of Set Top Box, external memory card or set-top-box server.

The photo that the equipment such as existing digital camera or shooting mobile phone are taken would generally be with shooting time and exchangeable image file EXIF information; the parameter value such as including camera model, shutter, aperture, focal length, light sensitivitys, white balance, it might even be possible to global positioning information (GPS information).The title of picture can be created by user or revise, it is simple to the relevant information of recordable picture.

Then, information acquisition unit 203, further according to described pictorial information, obtains the picture related information relevant to photo current.

Information acquisition unit 203 utilizes the geographical location information of acquired picture, and from server or network, search obtains panorama sketch, social network sites information or the encyclopaedia information close with described status positional information.Information acquisition unit 203 according to the coordinate position in the geographical location information of described picture, obtains identical with described coordinate position or that distance with described coordinate position is within predeterminable range threshold value panorama sketch, social network sites information or encyclopaedia information from server or network.

Or, information acquisition unit 203 utilizes the title of acquired picture, and from server or network, search obtains panorama sketch, social network sites information or the encyclopaedia information matched with described title.Specifically, information acquisition unit 203 calculates the title of panorama sketch in the title of described picture and server or network, text degree of association between the text message of social network sites or the text message of encyclopaedia website, and described text degree of association meets the panorama sketch being defined as matching with described title, social network sites information or the encyclopaedia information of preset requirement.

Such as, information acquisition unit 203, according to the title of picture or geographical location information, can get relevant social network sites content from network, such as, microblogging, comment etc., check that interaction is shared in other users comment to photo current related content, convenient participation rapidly.Alternatively, it is also possible to from network, obtain relevant encyclopaedia information, such as, the spot for photography of picture is YiHeYuan,BeiJing, when selecting entrance to check encyclopaedia information, then can obtain the recommended information that the Summer Palace is corresponding, it is easy to viewer and understands the recommended information relevant to this place, position, convenient and swift.

For the picture with Word message or terrestrial reference landscape class etc., information acquisition unit 203 characteristic information corresponding to image content or Word Input further, the characteristic information extracted is mated with existing feature database, automatically identify the interior perhaps title in picture, acquire relevant picture related information the most again.

Described display information, for picture, the pictorial information of picture or picture related information are generated display information, is shown by content generation unit 204 in order to display 30.

When user carry out picture check time, whole photo library use traditional list presentation mode, when user selects single picture, selected picture is amplified to full frame in order to show by content generation unit 204.When user horizontally slips on the touch screen of remote controller, content generation unit 204 picture is switched to upper one or next.

When the first trigger element 202 detects the triggering signal of information inspection pattern, trigger and enter information inspection pattern.Information acquisition unit 203 obtains the pictorial information of photo current from server, and after utilizing pictorial information to obtain the picture related information that photo current is relevant, pictorial information or the picture related information of photo current are generated display content, in order at display 30(large-size screen monitors by content generation unit 204) upper display.Preferably, after entering information inspection pattern, picture in big screen display inverts, can be, but not limited to use the animation effect of simulation entity photo upset, such as, picture diagonally overturns from the lower left corner, in the information of the back displays picture of picture, including EXIF information, geographical location information etc., can be with default tile title, shooting time, shooting diaphragm shutter value.When showing geographical location information, map can be shown, indicate this camera site with eye-catching position icon.At the same time it can also be display the page on may be provided for other related informations such as panorama sketch and microblogging check button for user select.

When entering panorama sketch and checking, user can use double charge panorama sketch processed to zoom in and out and check；Zoom in and out check time, after narrowing down to acquiescence minimum display, continue to zoom out and i.e. exit panorama sketch and check, the most also support the withdrawing mode of acquiescence.

Second trigger element 205 is for judging whether the action message that communications reception unit 201 receives is predefined display control action, if it is, generate display control information, triggers display control unit 206.

Display control unit 206 is for after the triggering by the second trigger element 205, according to described display control information, controls the action message that described display information followed by terminal and moves.

Velocity characteristic value, velocity characteristic value or the angle character value that second trigger element 205 detects according to remote controller 10, judge whether user moves or rotate described remote controller, if, then trigger display control unit 206 and determine that according to described velocity characteristic value or angle character value moving direction and the translational speed of described remote controller, the display content that thus control content generation unit 204 generates followed by described moving direction and move with the speed that described translational speed is suitable.

After the picture related information generation display content of photo current is shown to user by content generation unit 204, when user moves or rotates remote controller, sensor built-in in remote controller can continue to detect the acceleration signature value of remote controller, velocity characteristic value and angle character value, and display control unit 206 utilizes these eigenvalues to determine moving direction and the translational speed of remote controller.Thus, display control unit 206 followed by described moving direction move with the speed that described translational speed is suitable according to this moving direction and the described display content of translational speed control.

Such as, when user turns left remote controller, gyroscope detects rotational angle and the velocity of rotation of left direction, then the picture shown in large-size screen monitors is also moved to the left with suitable velocity of rotation, user can adjust viewing angle easily, the viewing visual angle that simulation is actual, especially when checking panorama sketch, brings good Consumer's Experience.

Specifically, when user selects to check panorama sketch, enter panorama and check pattern, utilize the geographical location information of picture, the panorama sketch of position near obtaining, the disclosed panorama sketch data such as such as SOSO streetscape, Microsoft Photosynth, at these panorama sketch of big screen display, simultaneously can be at the geographical location information of wicket display picture.After entrance panorama checks pattern, using the movement of gyroscope induction controller, thus control panorama sketch accordingly, operation picture moves up and down.When user operation remote controller is moved to the left, the visual angle of picture is the most and then moved to the left.

The display packing of the pictorial information that the present invention provides, device and system, the display of picture relevant information can be provided, utilize touch screen remote terminal, it is achieved independently of the preview picture of telescreen, play and control, and utilize gyroscope, the operating control signal of the sensor sensing users such as gravity sensor, the information relevant to picture can be checked conveniently and efficiently, such as EXIF information, geographical position, neighbouring microblogging and panorama sketch (the SOSO streetscape near such as) etc., user is allowed to check picture relevant information of geographical position on giant-screen, panorama sketch and the mode of more online friend interaction, strengthen multi-screen interactive under home environment and check the Consumer's Experience of picture.

Professional should further appreciate that, the unit of each example described in conjunction with the embodiments described herein and algorithm steps, can be with electronic hardware, computer software or the two be implemented in combination in, in order to clearly demonstrate the interchangeability of hardware and software, the most generally describe composition and the step of each example according to function.These functions perform with hardware or software mode actually, depend on application-specific and the design constraint of technical scheme.Professional and technical personnel can use different methods to realize described function to each specifically should being used for, but this realization is it is not considered that beyond the scope of this invention.

The method described in conjunction with the embodiments described herein or the step of algorithm can use the software module that hardware, processor perform, or the combination of the two is implemented.In any other form of storage medium that software module is known in can being placed in random access memory (RAM), internal memory, read only memory (ROM), electrically programmable ROM, electrically erasable ROM, depositor, hard disk, moveable magnetic disc, CD-ROM or technical field.

Above-described detailed description of the invention; the purpose of the present invention, technical scheme and beneficial effect are further described; it is it should be understood that; the foregoing is only the detailed description of the invention of the present invention; the protection domain being not intended to limit the present invention; all within the spirit and principles in the present invention, any modification, equivalent substitution and improvement etc. done, should be included within the scope of the present invention.

Claims (21)

1. the processing method of a pictorial information, it is characterised in that described method includes:

When showing picture, receive user's input information or action message that terminal sends；

If described input information or action message are predefined control information of checking, then obtain the pictorial information of photo current；

The picture related information relevant to photo current is obtained according to described pictorial information；

Pictorial information and/or the picture related information of described photo current are generated display information, in order to described display information to be shown.

The processing method of pictorial information the most according to claim 1, it is characterised in that described predefined check that control information specifically includes:

Button corresponding to control information or gesture is checked described in predefined；Or

The acceleration signature value of the described terminal that the sensor utilizing described terminal detects, velocity characteristic value or angle character value are more than the action of predetermined threshold value.

The processing method of pictorial information the most according to claim 1, it is characterised in that pictorial information and/or the picture related information of described photo current are being generated display information, after described display information is shown, is also including:

Receive the action message of the user that described terminal sends, if described action message is predefined display control action, then generate display control information；

According to described display control information, control the action message that described display information followed by described terminal and move.

The processing method of pictorial information the most according to claim 1, it is characterised in that described pictorial information includes: the title of picture, the shooting time of picture, the exchangeable image file EXIF information of picture or the geographical location information of picture；

Described picture related information includes: panorama sketch, social network sites information or the encyclopaedia information relevant to described picture.

The processing method of pictorial information the most according to claim 4, it is characterised in that the picture related information that described acquisition is relevant to described pictorial information, specifically includes:

Utilizing the geographical location information of described picture, from server or network, search obtains panorama sketch, social network sites information or the encyclopaedia information close with described status positional information；Or

Utilizing the title of described picture, from server or network, search obtains panorama sketch, social network sites information or the encyclopaedia information matched with described title.

The processing method of pictorial information the most according to claim 5, it is characterized in that, the described geographical location information utilizing picture, from server or network, search obtains panorama sketch, social network sites information or the encyclopaedia information close with described status positional information, particularly as follows:

The coordinate position in geographical location information according to described picture, obtains identical with described coordinate position or that distance with described coordinate position is within predeterminable range threshold value panorama sketch, social network sites information or encyclopaedia information from server or network；

The described title utilizing picture, from server or network, search obtains panorama sketch, social network sites information or the encyclopaedia information matched with described title, particularly as follows:

Calculate the title of panorama sketch in the title of described picture and server or network, text degree of association between the text message of social network sites or the text message of encyclopaedia website, described text degree of association is met the panorama sketch being defined as matching with described title, social network sites information or the encyclopaedia information of preset requirement.

7. the processing method of a pictorial information, it is characterised in that described method includes:

When showing picture, receive the input information of user or sense the action message of terminal described in user operation；

If described input information or action message are predefined control information of checking, then send described in check control information, in order to Set Top Box according to described in check that control information obtains the pictorial information of photo current and picture related information generation display information.

The processing method of pictorial information the most according to claim 7, it is characterised in that described predefined check that control information specifically includes:

Button corresponding to control information or gesture is checked described in predefined；Or

The acceleration signature value of the described terminal that the sensor utilizing described terminal detects, velocity characteristic value or angle character value are more than the action of predetermined threshold value.

The processing method of pictorial information the most according to claim 7, it is characterised in that after the described input information receiving user or the action message sensing described terminal, also include:

If described action message is predefined display control information, then send described display control information, control, according to described display control information, the action message that described display information followed by described terminal in order to Set Top Box and move.

The processing method of pictorial information the most according to claim 7, it is characterised in that described pictorial information includes: the title of picture, the shooting time of picture, the exchangeable image file EXIF information of picture or the geographical location information of picture；

Described picture related information includes: panorama sketch, social network sites information or the encyclopaedia information relevant to described picture.

11. 1 kinds of digital television receiving apparatus, it is characterised in that described digital television receiving apparatus includes:

Communications reception unit, for receiving user's input information or the action message that terminal sends；

First trigger element, is used for judging that whether described input information or action message be predefined to check control information, if it is, trigger message acquiring unit；

Information acquisition unit, for after the triggering by described first trigger element, obtains the pictorial information of photo current, and obtains the picture related information relevant to photo current according to described pictorial information；

Content generation unit, for generating display information, in order to described display information to be shown by the pictorial information of described photo current and/or picture related information.

12. digital television receiving apparatus according to claim 11, it is characterised in that described predefined check that control information specifically includes:

Button corresponding to control information or gesture is checked described in predefined；Or

The acceleration signature value of the described remote controller that the sensor utilizing described remote controller detects, velocity characteristic value or angle character value are more than the action of predetermined threshold value.

13. digital television receiving apparatus according to claim 11, it is characterised in that described digital television receiving apparatus also includes:

Second trigger element, for judging whether the action message that described communications reception unit receives is predefined display control action, if it is, generate display control information, triggers display control unit；

Display control unit, for after the triggering by described second trigger element, according to described display control information, controls the action message that described display information followed by described terminal and moves.

14. digital television receiving apparatus according to claim 11, it is characterised in that described pictorial information includes: the title of picture, the shooting time of picture, the exchangeable image file EXIF information of picture or the geographical location information of picture；

Described picture related information includes: panorama sketch, social network sites information or the encyclopaedia information relevant to described picture.

15. digital television receiving apparatus according to claim 14, it is characterized in that, described information acquisition unit utilizes the geographical location information of described picture, and from server or network, search obtains panorama sketch, social network sites information or the encyclopaedia information close with described status positional information；Or

Described information acquisition unit utilizes the title of described picture, and from server or network, search obtains panorama sketch, social network sites information or the encyclopaedia information matched with described title.

16. digital television receiving apparatus according to claim 15, it is characterized in that, described information acquisition unit according to the coordinate position in the geographical location information of described picture, obtains identical with described coordinate position or that distance with described coordinate position is within predeterminable range threshold value panorama sketch, social network sites information or encyclopaedia information from described server or network；Or

Described information acquisition unit calculates the title of panorama sketch in the title of described picture and described server or network, text degree of association between the text message of social network sites or the text message of encyclopaedia website, and described text degree of association meets the panorama sketch being defined as matching with described title, social network sites information or the encyclopaedia information of preset requirement.

17. 1 kinds of remote controllers, it is characterised in that described remote controller includes:

Interactive unit, for when showing picture, receives the input information of user；

Sensor unit, for sensing the action message of remote controller described in user operation；

3rd trigger element, is used for judging that whether described input information or action message be predefined to check control information, if it is, trigger communication unit send described in check control information；

Communication unit, for checking that control information is sent to digital television receiving apparatus by described, in order to described digital television receiving apparatus according to described in check that control information obtains pictorial information and the picture related information generation display information of photo current.

18. remote controllers according to claim 17, it is characterised in that described predefined check that control information specifically includes:

Button corresponding to control information or gesture is checked described in predefined；Or

The acceleration signature value of the described terminal that the sensor utilizing described terminal detects, velocity characteristic value or angle character value are more than the action of predetermined threshold value.

19. remote controllers according to claim 17, it is characterised in that described remote controller also includes:

4th trigger element, whether it is predefined display control action for judging the action message that described sensor unit senses, if, then trigger described communication unit and send display control information, control, according to described display control information, the action message that described display information followed by described terminal in order to described digital television receiving apparatus and move.

20. remote controllers according to claim 17, it is characterised in that described sensor unit is particularly as follows: gyroscope, accelerometer, gravity sensor or sonic transducer.

The processing system of 21. 1 kinds of pictorial informations, it is characterised in that described system includes: the remote controller as described in claim as arbitrary in claim 17 to 20, the digital television receiving apparatus as described in claim as arbitrary in claim 11 to 16 and display；

It is connected by communication between described remote controller and digital television receiving apparatus；It is connected by wired mode between described digital television receiving apparatus and display.