CN106203300A - Content item display packing and device - Google Patents
Content item display packing and device Download PDFInfo
- Publication number
- CN106203300A CN106203300A CN201610511598.XA CN201610511598A CN106203300A CN 106203300 A CN106203300 A CN 106203300A CN 201610511598 A CN201610511598 A CN 201610511598A CN 106203300 A CN106203300 A CN 106203300A
- Authority
- CN
- China
- Prior art keywords
- content item
- video image
- characteristic point
- display
- human face
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/46—Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The disclosure discloses a kind of content item display packing and device, belongs to Internet technical field.Described content item display packing includes: be identified characteristic point predetermined in video image；Determine the characteristic point identified position in described video image；The content item received is superimposed upon on described position and shows.By identifying the characteristic point in video image, the position that the content item of reception is superimposed upon characteristic point is shown, solve the interaction forms in correlation technique and be only by the displaying of machinery, cause the problem that interaction forms is the most single, reach the position according to the characteristic point in video image and determine the display position of content item, content item is associated with video image, enriches the effect of interaction forms.
Description
Technical field
It relates to Internet technical field, particularly to a kind of content item display packing and device.
Background technology
Along with the development of science and technology, people can carry out video calling or net cast by some application programs.
In net cast, the people of recorded video is referred to as main broadcaster, and the people of viewing video is referred to as spectators, and spectators are in viewing
During video, can and main broadcaster between figurate interaction, it may be possible on the interface of application program show static state
Picture, it is also possible to send the animation moved according to desired trajectory, such as send dynamic expression or throw away flower, throw away and airkiss
Deng.
These interaction formses are generally only the displaying carrying out machinery, and interaction forms is the most single.
Summary of the invention
The disclosure provides a kind of content item display packing and device.Described technical scheme is as follows:
First aspect according to disclosure embodiment, it is provided that a kind of content item display packing, described method includes: to video
Characteristic point predetermined in image is identified；Determine the characteristic point identified position in described video image；To receive
Content item be superimposed upon on described position and show.By identifying the position of the characteristic point in video image, utilize characteristic point
Position determine the position that show of content item, solve in correlation technique and cause interaction forms list owing to only carrying out mechanical displaying
The technical problem of one, has reached to associate content item with video image, the effect of abundant interaction forms.
Optionally, described being superimposed upon on described position by the content item received shows, including: when described characteristic point
Change in location time, mobile described content item, the specified point at described content item overlaps with the position after the change of described characteristic point
Rear stopping moves described content item.By when the change in location of characteristic point, the specified point of mobile content item is until and characteristic point
Position overlaps so that content item can keep consistent with the position of the characteristic point of video, and real-time is adjusted.
Optionally, described method also includes: obtain the gravity direction of the terminal unit playing described video image in real time；Root
The display direction of described content item is determined in real time so that the display direction of described content item meets described heavy according to described gravity direction
Force direction.By obtaining the gravity direction of terminal unit in real time, according to the display direction of this gravity direction Suitable content item, at end
When end equipment rotates, video image also can rotate accordingly so that content item is also carried out corresponding direction and adjusts, it is possible to
Show in video image according to desired effects.
Optionally, described characteristic point predetermined in video image is identified, including: identify in described video image
Human face region；Identifying predetermined characteristic point in described human face region, described predetermined characteristic point includes human face region
Central point.By identifying the central point of the human face region in video image so that when showing content item by human face region
Heart point is as characteristic point.
Optionally, described method also includes: obtain the size of described human face region in real time；Size according to human face region with
Predetermined ratio between content item size, adjusts in real time described content item size so that the size of described human face region with
Described content item size after adjustment meets described predetermined ratio.By the size according to human face region and content item size
Predetermined ratio Suitable content item size so that when the size of human face region changes, Suitable content item size with
The size of coupling human face region.
Optionally, described method also includes: the display duration of cumulative described content item；Display duration at described content item
When reaching scheduled duration threshold value, remove the described content item of display.By setting the duration that each content item shows, removing reaches
The content item of scheduled duration a so that content item will not be the most continuously display, it is possible to allow other content item also
Have an opportunity to show.
Second aspect according to disclosure embodiment, it is provided that a kind of content item display device, described device includes: identify mould
Block, is configured to be identified characteristic point predetermined in video image；First determines module, is configured to determine that described identification
The characteristic point that module identifies position in described video image；Display module, is configured to fold the content item received
It is added in described first to determine and show on the described position that module is determined.
Optionally, described display module, it is additionally configured to when the change in location of described characteristic point, mobile described content
, the position after the specified point of described content item changes with described characteristic point stops mobile described content item after overlapping.
Optionally, described device also includes: the first acquisition module, is configured to obtain in real time and plays described video image
The gravity direction of terminal unit；Second determines module, is configured to the described gravity got according to described first acquisition module
Direction determines the display direction of described content item in real time so that the display direction of described content item meets described gravity direction.
Optionally, described identification module, including: first identifies submodule, is configured to identify in described video image
Human face region；Second identifies submodule, is configured to identify in the described human face region that submodule recognizes described first
Identifying predetermined characteristic point, described predetermined characteristic point includes the central point of human face region.
Optionally, described device also includes: the second acquisition module, is configured to obtain the big of described human face region in real time
Little；Adjusting module, is configured to the predetermined ratio between the size according to human face region and content item size, adjusts institute in real time
State content item size so that the described content item size after the size of described human face region and adjustment meets described pre-definite proportion
Value.
Optionally, described device also includes: accumulator module, is configured to the display duration of cumulative described content item；Remove
Module, is configured to, when the display duration of the described content item that described accumulator module adds up reaches scheduled duration threshold value, remove
The described content item of display.
The third aspect according to disclosure embodiment, it is provided that a kind of content item display device, described device includes: process
Device；For storing the memorizer of described processor executable；Wherein, described processor is configured to: in video image
Predetermined characteristic point is identified；Determine the characteristic point identified position in described video image；The content that will receive
Item is superimposed upon on described position and shows.
It should be appreciated that it is only exemplary that above general description and details hereinafter describe, can not be limited this
Open.
Accompanying drawing explanation
Accompanying drawing herein is merged in description and constitutes the part of this specification, it is shown that meet the enforcement of the disclosure
Example, and for explaining the principle of the disclosure together with description.
Fig. 1 is the flow chart according to a kind of content item display packing shown in an exemplary embodiment；
Fig. 2 A is the flow chart according to a kind of content item display packing shown in another exemplary embodiment；
Fig. 2 B is according to the stream being identified characteristic point predetermined in video image provided in an exemplary embodiment
Cheng Tu；
Fig. 2 C is the signal of the gravity direction according to the terminal unit vertical display position shown in an exemplary embodiment
Figure；
Fig. 2 D is by the weight after the 90-degree rotation of vertical display position according to the terminal unit shown in an exemplary embodiment
The schematic diagram of force direction；
Fig. 3 is the block diagram according to a kind of content item display device shown in an exemplary embodiment；
Fig. 4 is the block diagram according to a kind of content item display device shown in another exemplary embodiment；
Fig. 5 is the block diagram according to a kind of device for showing content item shown in an exemplary embodiment；
Fig. 6 is the block diagram according to a kind of device for showing content item shown in another exemplary embodiment.
Detailed description of the invention
Here will illustrate exemplary embodiment in detail, its example represents in the accompanying drawings.Explained below relates to
During accompanying drawing, unless otherwise indicated, the same numbers in different accompanying drawings represents same or analogous key element.Following exemplary embodiment
Described in embodiment do not represent all embodiments consistent with the disclosure.On the contrary, they are only with the most appended
The example of the apparatus and method that some aspects that described in detail in claims, the disclosure are consistent.
Fig. 1 is the flow chart according to a kind of content item display packing shown in an exemplary embodiment, and this content item shows
Method can be applied in the terminal unit producing video image, it is also possible to applies in the terminal unit receiving video image,
Can be applied in server.Here the terminal unit said includes smart mobile phone, panel computer, multimedia play equipment
Deng.Here the server said can be a station server, it is also possible to for the set of multiple servers, believe between multiple servers
Breath can be shared.As it is shown in figure 1, this content item display packing can include following several step.
In step 110, characteristic point predetermined in video image is identified.
In the step 120, the characteristic point identified position in video image is determined.
In step 130, the content item received is superimposed upon on this position shows.
Optionally, when this content item display packing is applied in the terminal unit receiving video image, at terminal unit
Upper reception also plays one section of video image, determines the characteristic point in video image, it would be desirable to the content item of display is added to feature
The position display of point.
Optionally, when this content item display packing is applied in the terminal unit producing video image, user has recorded
One section of video image, it is desirable to increase some effects for video image, can select to be added to content item in video image carry out
Overlapping display.
Optionally, when this content item display packing is applied in the server, server by obtain video image with
Content item is overlapped in the method, and the video image after superposition is sent to the terminal unit needing to play.
In a kind of possible implementation, the vedio data of multiple stage terminal unit shared server transmission, permissible
Selected to need the content item of display by a terminal unit, ask to send to server, server root by the display of this content item
According to display request, content item is overlapped in the method with video image, the video image after superposition is sent to each
Terminal unit plays out display.
In sum, the content item display packing that disclosure embodiment provides, by identifying the characteristic point in video image
Position, utilize the position of characteristic point to determine the position that show of content item, it is mechanical owing to only carrying out to solve in correlation technique
Show and cause the technical problem that interaction forms is single, reached to associate content item with video image, the effect of abundant interaction forms
Really.
Fig. 2 A is the flow chart according to a kind of content item display packing shown in another exemplary embodiment, and this content item shows
Show that method can be applied in the terminal unit producing video image, it is also possible to apply at the terminal unit receiving video image
In, it is also possible to application is in the server.Here the terminal unit said includes that smart mobile phone, panel computer, multimedia set
Standby etc..Here the server said can be a station server, it is also possible to for the set of multiple servers, between multiple servers
Information can be shared.As shown in Figure 2 A, this content item display packing may comprise steps of.
In step 201, characteristic point predetermined in video image is identified.
In a kind of possible implementation, video image here is probably on live class application program or directly
Broadcasting the video image play on website, this kind of video image is recorded by a terminal unit and is synchronized to the direct broadcasting room set up, record
The user making this video image is commonly referred to as main broadcaster, as long as spectators enter direct broadcasting room, it is possible to synchronize viewing live video, spectators
Interaction can be carried out by forms such as word, picture, animations with main broadcaster.
In alternatively possible implementation, the video image said here is it is also possible that at least both sides carry out video and lead to
Video image during words, and both call sides can also carry out interaction by the form such as picture and animation.
Here the characteristic point said can be the central point of human face region, it is also possible to be that the physiology such as eyes, face, nose are special
Levy a little, it is also possible to be collar, pocket or other characteristic points conformed to a predetermined condition.
In actual applications, it is typically when carrying out interaction to carry out interaction between men, therefore when reality is applied, generally
Face may be identified, increase the interest of interaction.As shown in Figure 2 B, characteristic point predetermined in video image is identified
Time, may comprise steps of.
In step 201a, identify the human face region in video image.
The identification of human face region belongs to the face recognition technology that those skilled in the art can realize, and such as passes through face
Detection technique, for the image that any one width is given, uses and includes artificial intelligence, Digital Image Processing, computer graphics, life
The method in the fields such as Neo-Confucianism scans for, and determining whether to comprise face, if comprising, returning position and the size of face
Etc. information；Pre-build the model of face for another example, by the figure in video image is compared with model, if coupling
Degree reaches a predetermined value, then it is assumed that comprise face in video image, returns position and the size etc. of face in video image
Information.In actual applications, it is also possible to use other technologies to carry out the identification of face, the most just repeat no more.
In step 201b, human face region identifies predetermined characteristic point.
Here the predetermined characteristic point said can be the central point of human face region, it is also possible to be eyes, face, nose etc.
Physiological feature point.
As a example by human face region, in general, when face is just to photographic head, the face district in the video image collected
Territory is usually symmetric figure, and the central point of human face region can choose the midpoint of the line of distance in human face region farthest 2
Position.
As a example by the identification of eyes, the model of eyes can be set up by training, when identifying image, by entering with model
Row comparison, it is judged that the wherein position of human eye.
For the identification of the characteristic point such as face or eyes, those skilled in the art can also use other method,
The most just repeat no more.
In step 202., the characteristic point identified position in video image is determined.
Owing to video image is dynamically change during video playback, therefore the characteristic point in video image is not
The same position in frame of video may be different, therefore for every frame video image, can first determine that the characteristic point identified exists
Position in video image.
In step 203, when the change in location of characteristic point, mobile content item, in specified point and this feature of content item
Position after some change stops this content item mobile after overlapping.
Here the content item said can be the virtual item pictures according to reservation shape design, can be such as glasses
Picture, can be used to display eye position of main broadcaster in video image, it is also possible to be beard picture, shows the face main broadcaster
Position, it is also possible to be badge picture, display is in the collar position of main broadcaster.
Content item can also is that other kinds of label information, such as refers to the text message of name, micro-video etc..
In order to make the position of content item overlap with the position of characteristic point all the time, when the change in location of characteristic point, also want phase
The position of the Suitable content item answered, until the position of content item overlaps with the position of characteristic point.
In step 204, the gravity direction of the terminal unit playing video image is obtained in real time.
Play video image terminal unit typically can automatically Rotation screen to adapt to user's viewing terminal device screen
Direction.It is to say, when the placing direction of terminal unit changes, gravity direction also can change, corresponding, according to weight
Force direction also can change when showing video image.
As shown in Figure 2 C, terminal unit would generally possess horizontal frame 22 and longitudinal frame 21, the length of longitudinal frame 21
It is typically larger than the length of horizontal frame 22.When terminal unit is vertical display, then the gravity direction G of terminal unit be vertically to
Under, gravity direction G now is parallel with longitudinal frame 21 of terminal unit.When terminal unit through the rotation of 90 degree become as
Horizontal disposing way shown in Fig. 2 D, gravity direction G ' now is still that straight down, but for terminal unit,
Gravity direction G ' is but perpendicular to longitudinal frame 21 of terminal unit.Wherein, content item 23 is after terminal unit rotates, also
Have adjusted display direction accordingly, with the change of the display direction of adaptive video image.
In step 205, the display direction of content item is determined in real time according to gravity direction so that the display direction of content item
Meet gravity direction.
So that user is when terminaloriented equipment viewing video image, watch the video figure of a forward all the time
Picture, the video image play in terminal unit also can be automatically regulated to be the placing direction with terminal unit and keep consistent.At this moment, for
Make content item match with the content of video image, the direction of content item also can be adjusted accordingly.
When reality is applied, if face occurs in video image, can cause along with the distance of face distance photographic head
The size of the human face region in video image changes, in order to make big at content item and the human face region of human face region of display
Little match, the size of human face region and the predetermined ratio of content item size typically can be set, when the size of human face region changes
During change, in order to keep stablizing of predetermined ratio, content item size can be adjusted, refer to following to step 206 to step
The description of rapid 208.
In step 206, the size of human face region is obtained in real time.
Want to determine the size of human face region, closed figures can be drawn accordingly according to the human face region identified, meter
Calculate the area of this closed figures, it is also possible to calculate the quantity of the pixel of the human face region identified, according to the quantity of pixel
How many sizes judging human face region.
In step 207, according to the predetermined ratio between size and the content item size of human face region, in adjusting in real time
Hold item size so that the content item size after the size of human face region and adjustment meets predetermined ratio.
Need to set a predetermined ratio between size and the content item size of human face region so that content item can be with
The size coupling of human face region.Such as, when content item is a mask picture, then the size of human face region and mask picture is big
Little for 1:1 time, it appears that just as having put on a mask to face.The size of human face region is due to the distance of people's distance photographic head
When changing, according to predetermined ratio Suitable content item, content item size just can be made to match with the size of human face region.
In a step 208, the content item received is superimposed upon on this position shows.
After the adjustment completing the position above with respect to content item, direction and size, content item is superimposed upon video figure
As upper display.During display, according to the change of the content of video image, in addition it is also necessary to content item is adjusted in real time.
It should be noted that in the present embodiment, step 204 to step 207 performed before step 208.Optional
, step 204 to step 207 can also perform after step 208.Optionally, step 204 and step 207 can also be with steps
Rapid 208 executed in parallel.
In actual applications, such as in live scene, more than spectators may be had to send the display request of content item,
Therefore each content item is just removed after showing a period of time, in order to meet the interactive demand of more spectators, and it is the most right to refer to
Step 209 and the description of step 210.
In step 209, the display duration of cumulative content item.
In step 210, when the display duration of content item reaches scheduled duration threshold value, remove the content item of display.
In general, after content item is displayed at characteristic point position, can arrange an intervalometer for content item, this is fixed
Time device duration be set to scheduled duration threshold value.When this intervalometer terminates, then show that the display duration of this content item reaches predetermined
Duration threshold value, the most then remove the content item of display.
Optionally, it is also possible to content item is carried out timing, when the display duration that timing obtains reaches scheduled duration threshold value,
Then remove the content item of display.
In order to keep the picture tidiness of video image, it is ensured that the viewing effect of video image, disclosure item is permissible
Being set to forbid showing, therefore a content item could show next content item after being eliminated simultaneously.
Optionally, it is also possible to be set to show the content item of predetermined quantity, for the viewing effect of video image simultaneously, can
To arrange the corresponding different characteristic point position of the content item shown simultaneously.
In sum, the content item display packing provided in disclosure embodiment, by identifying the feature in video image
The position of point, utilizes the position of characteristic point to determine the position that content item shows, solves in correlation technique owing to only carrying out machinery
Displaying cause the technical problem that interaction forms is single, reached to associate content item with video image, abundant interaction forms
Effect.
It addition, by when the change in location of characteristic point, the specified point of mobile content item until overlapping with characteristic point position,
Making content item can keep consistent with the position of the characteristic point of video, real-time is adjusted.
It addition, by the gravity direction obtaining terminal unit in real time, according to the display side of this gravity direction Suitable content item
To, when terminal unit rotates, video image also can rotate accordingly so that content item is also carried out corresponding direction and adjusts
Whole, it is possible to show in video image according to desired effects.
It addition, by the central point identifying the human face region in video image so that when showing content item by face district
The central point in territory is as characteristic point.
It addition, by the size according to human face region and the predetermined ratio Suitable content item size of content item size,
Making when the size of human face region changes, Suitable content item size is to mate the size of human face region.
It addition, by setting the duration that each content item shows, remove the content item reaching scheduled duration so that in one
Holding item will not be the most continuously display, it is possible to allow other content item also have an opportunity to show.
Following for disclosure device embodiment, may be used for performing method of disclosure embodiment.Real for disclosure device
Execute the details not disclosed in example, refer to method of disclosure embodiment.
Fig. 3 is the block diagram according to a kind of content item display device shown in an exemplary embodiment, this content item display dress
Put and can apply in the terminal unit producing video image, it is also possible to apply in the terminal unit receiving video image, also
Can apply in the server.Here the terminal unit said includes smart mobile phone, panel computer, multimedia play equipment etc..
Here the server said can be a station server, it is also possible to for the set of multiple servers, information between multiple servers
Can share.As it is shown on figure 3, this content item display device includes but not limited to: identification module 310, first determine module 320 and
Display module 330.
Identification module 310, is configured to be identified characteristic point predetermined in video image.
First determines module 320, is configured to determine that characteristic point that identification module 310 the identifies position in video image
Put.
Display module 330, is configured to that the content item received is superimposed upon first and determines the position that module 320 is determined
On show.
In sum, the content item display device provided in disclosure embodiment, by identifying the feature in video image
The position of point, utilizes the position of characteristic point to determine the position that content item shows, solves in correlation technique owing to only carrying out machinery
Displaying cause the technical problem that interaction forms is single, reached to associate content item with video image, abundant interaction forms
Effect.
Fig. 4 is the block diagram according to a kind of content item display device shown in another exemplary embodiment, and this content item shows
Device can be applied in the terminal unit producing video image, it is also possible to applies in the terminal unit receiving video image,
Can be applied in server.Here the terminal unit said includes smart mobile phone, panel computer, multimedia play equipment
Deng.Here the server said can be a station server, it is also possible to for the set of multiple servers, believe between multiple servers
Breath can be shared.As shown in Figure 4, this content item display device includes but not limited to: identification module 410, first determine module 420
With display module 430.
Identification module 410, is configured to be identified characteristic point predetermined in video image.
Here the characteristic point said can be the central point of human face region, it is also possible to be that the physiology such as eyes, face, nose are special
Levy a little, it is also possible to be collar, pocket or other characteristic points conformed to a predetermined condition.
First determines module 420, is configured to determine that characteristic point that identification module 410 the identifies position in video image
Put.
Owing to video image is dynamically change during video playback, therefore the characteristic point in video image is not
The same position in frame of video may be different, therefore for every frame video image, can first determine that the characteristic point identified exists
Position in video image.
Display module 430, is configured to that the content item received is superimposed upon first and determines the position that module 420 is determined
On show.
Here the content item said can be the virtual item pictures according to reservation shape design, it is also possible to be other classes
The label information of type.
In actual applications, it is typically when carrying out interaction to carry out interaction between men, therefore when reality is applied, generally
Face may be identified, increase the interest of interaction.In this case, identification module 410 may include that the first identification submodule
Block 411 and second identifies submodule 412.
First identifies submodule 411, is configured to the human face region identifying in video image.
Second identifies submodule 412, is configured to identify in the human face region that submodule 411 recognizes first and identifies
Predetermined characteristic point.
Here the predetermined characteristic point said can be the central point of human face region, it is also possible to be eyes, face, nose etc.
Physiological feature point.
Optionally, display module 430 is additionally configured to when the change in location of characteristic point, and mobile content item, at content item
Specified point and characteristic point change after position overlaps after stop this content item of movement.
In order to make the position of content item overlap with the position of characteristic point all the time, when the change in location of characteristic point, also want phase
The position of the Suitable content item answered, until the position of content item overlaps with the position of characteristic point.
Play video image terminal unit typically can automatically Rotation screen to adapt to user's viewing terminal device screen
Direction.It is to say, when the placing direction of terminal unit changes, gravity direction also can change, corresponding, according to weight
Force direction also can change when showing video image.
Corresponding, this content item display device can also include: the first acquisition module 440 and second determines module 450.
First acquisition module 440, is configured to obtain in real time the gravity direction of the terminal unit playing video image.
So that user is when terminaloriented equipment viewing video image, watch the video figure of a forward all the time
Picture, the video image play in terminal unit also can be automatically regulated to be the placing direction with terminal unit and keep consistent.At this moment, for
Make content item match with the content of video image, the direction of content item also can be adjusted accordingly.
Second determines module 450, in being configured to determine in real time according to the gravity direction that the first acquisition module 440 gets
Hold the display direction of item so that the display direction of this content item meets gravity direction.
When reality is applied, if face occurs in video image, can cause along with the distance of face distance photographic head
The size of the human face region in video image changes, in order to make big at content item and the human face region of human face region of display
Little match, the size of human face region and the predetermined ratio of content item size typically can be set, when the size of human face region changes
During change, in order to keep stablizing of predetermined ratio, content item size can be adjusted.Corresponding, this content item display device
Can also include: the second acquisition module 460 and adjusting module 470.
Second acquisition module 460, is configured to obtain in real time the size of human face region.
Want to determine the size of human face region, closed figures can be drawn accordingly according to the human face region identified, meter
Calculate the area of this closed figures, it is also possible to calculate the quantity of the pixel of the human face region identified, according to the quantity of pixel
How many sizes judging human face region.
Adjusting module 470, is configured to the predetermined ratio between the size according to human face region and content item size, real
Time Suitable content item size so that the size of human face region with adjust after content item size meet predetermined ratio.
Need to set a predetermined ratio between size and the content item size of human face region so that content item can be with
The size coupling of human face region.The size of human face region is owing to people is when the distance of photographic head changes, according to pre-definite proportion
Value Suitable content item, just can make content item size match with the size of human face region.
In actual applications, such as in live scene, more than spectators may be had to send the display request of content item,
Therefore each content item is just removed after showing a period of time, in order to meet the interactive demand of more spectators.In this case,
This content item display device can also include: accumulator module 480 and removing module 490.
Accumulator module 480, is configured to the display duration of cumulative content item.
Remove module 490, be configured to the display duration at the cumulative content item of accumulator module 480 and reach scheduled duration threshold
During value, remove the content item of display.
In general, after content item is displayed at characteristic point position, can arrange an intervalometer for content item, this is fixed
Time device duration be set to scheduled duration threshold value.When this intervalometer terminates, then show that the display duration of this content item reaches predetermined
Duration threshold value, the most then remove the content item of display.
Optionally, it is also possible to content item is carried out timing, when the display duration that timing obtains reaches scheduled duration threshold value,
Then remove the content item of display.
In order to keep the picture tidiness of video image, it is ensured that the viewing effect of video image, disclosure item is permissible
Being set to forbid showing, therefore a content item could show next content item after being eliminated simultaneously.
Optionally, it is also possible to be set to show the content item of predetermined quantity, for the viewing effect of video image simultaneously, can
To arrange the corresponding different characteristic point position of the content item shown simultaneously.
In sum, the content item display device provided in disclosure embodiment, by identifying the feature in video image
The position of point, utilizes the position of characteristic point to determine the position that content item shows, solves in correlation technique owing to only carrying out machinery
Displaying cause the technical problem that interaction forms is single, reached to associate content item with video image, abundant interaction forms
Effect.
It addition, by when the change in location of characteristic point, the specified point of mobile content item until overlapping with characteristic point position,
Making content item can keep consistent with the position of the characteristic point of video, real-time is adjusted.
It addition, by the gravity direction obtaining terminal unit in real time, according to the display side of this gravity direction Suitable content item
To, when terminal unit rotates, video image also can rotate accordingly so that content item is also carried out corresponding direction and adjusts
Whole, it is possible to show in video image according to desired effects.
It addition, by the central point identifying the human face region in video image so that when showing content item by face district
The central point in territory is as characteristic point.
It addition, by the size according to human face region and the predetermined ratio Suitable content item size of content item size,
Making when the size of human face region changes, Suitable content item size is to mate the size of human face region.
It addition, by setting the duration that each content item shows, remove the content item reaching scheduled duration so that in one
Holding item will not be the most continuously display, it is possible to allow other content item also have an opportunity to show.
The disclosure one exemplary embodiment provides a kind of content item display device, it is possible to realize the content that the disclosure provides
Display packing, this content item display device includes: processor, for storing the memorizer of processor executable；
Wherein, processor is configured to:
Characteristic point predetermined in video image is identified；
Determine the characteristic point identified position in video image；
The content item received is superimposed upon on this position and shows.
Fig. 5 is the block diagram according to a kind of device for showing content item shown in an exemplary embodiment.Such as, device
500 can be mobile phone, computer, digital broadcast terminal, messaging devices, game console, and tablet device, medical treatment sets
Standby, body-building equipment, personal digital assistant etc..
With reference to Fig. 5, device 500 can include following one or more assembly: processes assembly 502, memorizer 504, power supply
Assembly 506, multimedia groupware 508, audio-frequency assembly 510, input/output (I/O) interface 512, sensor cluster 514, Yi Jitong
Letter assembly 516.
Process assembly 502 and generally control the integrated operation of device 500, such as with display, call, data communication, phase
The operation that machine operation and record operation are associated.Process assembly 502 and can include that one or more processor 518 performs to refer to
Order, to complete all or part of step of above-mentioned method.Additionally, process assembly 502 can include one or more module, just
Mutual in process between assembly 502 and other assemblies.Such as, process assembly 502 and can include multi-media module, many to facilitate
Media component 508 and process between assembly 502 mutual.
Memorizer 504 is configured to store various types of data to support the operation at device 500.Showing of these data
Example includes any application program for operating on device 500 or the instruction of method, contact data, telephone book data, disappears
Breath, picture, video etc..Memorizer 504 can be by any kind of volatibility or non-volatile memory device or their group
Close and realize, such as static RAM (SRAM), Electrically Erasable Read Only Memory (EEPROM), erasable compile
Journey read only memory (EPROM), programmable read only memory (PROM), read only memory (ROM), magnetic memory, flash
Device, disk or CD.
The various assemblies that power supply module 506 is device 500 provide electric power.Power supply module 506 can include power management system
System, one or more power supplys, and other generate, manage and distribute, with for device 500, the assembly that electric power is associated.
The screen of one output interface of offer that multimedia groupware 508 is included between device 500 and user.Real at some
Executing in example, screen can include liquid crystal display (LCD) and touch panel (TP).If screen includes touch panel, screen can
To be implemented as touch screen, to receive the input signal from user.Touch panel include one or more touch sensor with
Gesture on sensing touch, slip and touch panel.Touch sensor can not only sense touch or the border of sliding action, and
And also detect and touch or persistent period that slide is relevant and pressure.In certain embodiments, multimedia groupware 508 includes
One front-facing camera and/or post-positioned pick-up head.When device 500 is in operator scheme, during such as screening-mode or video mode, front
Put photographic head and/or post-positioned pick-up head can receive outside multi-medium data.Each front-facing camera and post-positioned pick-up head can
To be a fixing optical lens system or there is focal length and optical zoom ability.
Audio-frequency assembly 510 is configured to output and/or input audio signal.Such as, audio-frequency assembly 510 includes a Mike
Wind (MIC), when device 500 is in operator scheme, during such as call model, logging mode and speech recognition mode, mike is joined
It is set to receive external audio signal.The audio signal received can be further stored at memorizer 504 or via communication set
Part 516 sends.In certain embodiments, audio-frequency assembly 510 also includes a speaker, is used for exporting audio signal.
I/O interface 512 provides interface for processing between assembly 502 and peripheral interface module, above-mentioned peripheral interface module can
To be keyboard, put striking wheel, button etc..These buttons may include but be not limited to: home button, volume button, start button and lock
Set button.
Sensor cluster 514 includes one or more sensor, for providing the state of various aspects to comment for device 500
Estimate.Such as, what sensor cluster 514 can detect device 500 opens/closed mode, the relative localization of assembly, such as assembly
For display and the keypad of device 500, sensor cluster 514 can also detect device 500 or the position of 500 1 assemblies of device
Put change, the presence or absence that user contacts, device 500 orientation or acceleration/deceleration and the temperature of device 500 with device 500
Change.Sensor cluster 514 can include proximity transducer, is configured to when not having any physical contact near detection
The existence of object.Sensor cluster 514 can also include optical sensor, and such as CMOS or ccd image sensor, being used for should in imaging
Use middle use.In certain embodiments, this sensor cluster 514 can also include acceleration transducer, gyro sensor, magnetic
Sensor, pressure transducer or temperature sensor.
Communications component 516 is configured to facilitate the communication of wired or wireless mode between device 500 and other equipment.Device
500 can access wireless network based on communication standard, such as Wi-Fi, 2G or 3G, or combinations thereof.An exemplary reality
Executing in example, communications component 516 receives the broadcast singal from external broadcasting management system or the relevant letter of broadcast via broadcast channel
Breath.In one exemplary embodiment, communications component 516 also includes near-field communication (NFC) module, to promote junction service.Example
As, can be based on RF identification (RFID) technology in NFC module, Infrared Data Association (IrDA) technology, ultra broadband (UWB) technology,
Bluetooth (BT) technology and other technologies realize.
In the exemplary embodiment, device 500 can be by one or more application specific integrated circuits (ASIC), numeral letter
Number processor (DSP), digital signal processing appts (DSPD), PLD (PLD), field programmable gate array
(FPGA), controller, microcontroller, microprocessor or other electronic components realize, be used for performing foregoing item display packing.
In the exemplary embodiment, a kind of non-transitory computer-readable recording medium including instruction, example are additionally provided
As included the memorizer 504 of instruction, above-mentioned instruction can have been performed foregoing item by the processor 518 of device 500 and show
Method.Such as, non-transitory computer-readable recording medium can be ROM, random access memory (RAM), CD-ROM, magnetic
Band, floppy disk and optical data storage devices etc..
Fig. 6 is the block diagram according to a kind of device for showing content item shown in another exemplary embodiment.Such as, dress
Put 600 and may be provided in a network equipment.With reference to Fig. 6, device 600 includes processing assembly 602, and it farther includes one
Or multiple processor, and by the memory resource representated by memorizer 604, can be by the execution processing assembly 602 for storage
Instruction, such as application program.In memorizer 604, the application program of storage can include that one or more each is right
The module of Ying Yuyi group instruction.It is configured to perform instruction, to perform foregoing item display packing additionally, process assembly 602.
Device 600 can also include that a power supply module 606 is configured to perform the power management of device 600, and one has
Line or radio network interface 608 are configured to be connected to device 600 network, and input and output (I/O) interface 610.Dress
Put 600 and can operate based on the operating system being stored in memorizer 604, such as Windows ServerTM, Mac OS XTM,
UnixTM, LinuxTM, FreeBSDTM or similar.
Those skilled in the art, after considering description and putting into practice invention disclosed herein, will readily occur to its of the disclosure
Its embodiment.The application is intended to any modification, purposes or the adaptations of the disclosure, these modification, purposes or
Person's adaptations is followed the general principle of the disclosure and includes the undocumented common knowledge in the art of the disclosure
Or conventional techniques means.Description and embodiments is considered only as exemplary, and the true scope of the disclosure and spirit are by following
Claim is pointed out.
It should be appreciated that the disclosure is not limited to precision architecture described above and illustrated in the accompanying drawings, and
And various modifications and changes can carried out without departing from the scope.The scope of the present disclosure is only limited by appended claim.
Claims (13)
1. a content item display packing, it is characterised in that described method includes:
Characteristic point predetermined in video image is identified；
Determine the characteristic point identified position in described video image；
The content item received is superimposed upon on described position and shows.
Method the most according to claim 1, it is characterised in that described the content item received is superimposed upon on described position
Show, including:
When the change in location of described characteristic point, mobile described content item, in specified point and the described characteristic point of described content item
Position after change stops mobile described content item after overlapping.
Method the most according to claim 1, it is characterised in that described method also includes:
Obtain the gravity direction of the terminal unit playing described video image in real time；
The display direction of described content item is determined in real time so that the display direction of described content item meets according to described gravity direction
Described gravity direction.
Method the most according to claim 1, it is characterised in that described characteristic point predetermined in video image is known
Not, including:
Identify the human face region in described video image；
Identifying predetermined characteristic point in described human face region, described predetermined characteristic point includes the central point of human face region.
Method the most according to claim 4, it is characterised in that described method also includes:
Obtain the size of described human face region in real time；
The predetermined ratio between size and content item size according to human face region, adjusts described content item size in real time,
Described content item size after making the size of described human face region and adjusting meets described predetermined ratio.
6. according to described method arbitrary in claim 1 to 5, it is characterised in that described method also includes:
The display duration of cumulative described content item；
When the display duration of described content item reaches scheduled duration threshold value, remove the described content item of display.
7. a content item display device, it is characterised in that described device includes:
Identification module, is configured to be identified characteristic point predetermined in video image；
First determines module, is configured to determine that characteristic point that described identification module the identifies position in described video image
Put；
Display module, is configured to that the content item received is superimposed upon described first and determines on the described position that module is determined
Show.
Device the most according to claim 7, it is characterised in that described display module, is additionally configured to when described characteristic point
Change in location time, mobile described content item, the specified point at described content item overlaps with the position after the change of described characteristic point
Rear stopping moves described content item.
Device the most according to claim 7, it is characterised in that described device also includes:
First acquisition module, is configured to obtain in real time the gravity direction of the terminal unit playing described video image；
Second determines module, is configured to determine in real time according to the described gravity direction that described first acquisition module gets described
The display direction of content item so that the display direction of described content item meets described gravity direction.
Device the most according to claim 7, it is characterised in that described identification module, including:
First identifies submodule, is configured to identify the human face region in described video image；
Second identifies submodule, be configured to described first identify the described human face region that recognizes of submodule identifies pre-
Fixed characteristic point, described predetermined characteristic point includes the central point of human face region.
11. devices according to claim 10, it is characterised in that described device also includes:
Second acquisition module, is configured to obtain in real time the size of described human face region；
Adjusting module, is configured to the predetermined ratio between the size according to human face region and content item size, adjusts in real time
Described content item size so that the described content item size after the size of described human face region and adjustment meets described predetermined
Ratio.
12. according to described device arbitrary in claim 7 to 11, it is characterised in that described device also includes:
Accumulator module, is configured to the display duration of cumulative described content item；
Remove module, be configured to the display duration at the cumulative described content item of described accumulator module and reach scheduled duration threshold value
Time, remove the described content item of display.
13. 1 kinds of content item display devices, it is characterised in that described device includes:
Processor；
For storing the memorizer of described processor executable；
Wherein, described processor is configured to:
Characteristic point predetermined in video image is identified；
Determine the characteristic point identified position in described video image；
The content item received is superimposed upon on described position and shows.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610511598.XA CN106203300A (en) | 2016-06-30 | 2016-06-30 | Content item display packing and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610511598.XA CN106203300A (en) | 2016-06-30 | 2016-06-30 | Content item display packing and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106203300A true CN106203300A (en) | 2016-12-07 |
Family
ID=57464210
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610511598.XA Pending CN106203300A (en) | 2016-06-30 | 2016-06-30 | Content item display packing and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106203300A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107454433A (en) * | 2017-08-09 | 2017-12-08 | 广州视源电子科技股份有限公司 | Live broadcasting annotation method and device, terminal and live broadcasting system |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1866292A (en) * | 2005-05-19 | 2006-11-22 | 上海凌锐信息技术有限公司 | Dynamic glasses try-on method |
| CN101354789A (en) * | 2008-08-22 | 2009-01-28 | 北京中星微电子有限公司 | Method and device for implementing image face mask specific effect |
| CN102055912A (en) * | 2009-10-29 | 2011-05-11 | 北京中星微电子有限公司 | Video application system, video special effect processing system and method |
| CN102262788A (en) * | 2010-05-24 | 2011-11-30 | 上海一格信息科技有限公司 | Method and device for processing interactive makeup information data of personal three-dimensional (3D) image |
| CN103236066A (en) * | 2013-05-10 | 2013-08-07 | 苏州华漫信息服务有限公司 | Virtual trial make-up method based on human face feature analysis |
| CN104077024A (en) * | 2013-03-29 | 2014-10-01 | 索尼公司 | Information processing apparatus, information processing method, and recording medium |
| CN104217350A (en) * | 2014-06-17 | 2014-12-17 | 北京京东尚科信息技术有限公司 | Virtual try-on realization method and device |
| CN104780458A (en) * | 2015-04-16 | 2015-07-15 | 美国掌赢信息科技有限公司 | Method and electronic equipment for loading effects in instant video |
| CN104809638A (en) * | 2015-05-20 | 2015-07-29 | 成都通甲优博科技有限责任公司 | Virtual glasses trying method and system based on mobile terminal |
| CN105096241A (en) * | 2015-07-28 | 2015-11-25 | 努比亚技术有限公司 | Face image beautifying device and method |
| CN105334963A (en) * | 2015-10-29 | 2016-02-17 | 广州华多网络科技有限公司 | Method and system for displaying virtual article |
-
2016
- 2016-06-30 CN CN201610511598.XA patent/CN106203300A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1866292A (en) * | 2005-05-19 | 2006-11-22 | 上海凌锐信息技术有限公司 | Dynamic glasses try-on method |
| CN101354789A (en) * | 2008-08-22 | 2009-01-28 | 北京中星微电子有限公司 | Method and device for implementing image face mask specific effect |
| CN102055912A (en) * | 2009-10-29 | 2011-05-11 | 北京中星微电子有限公司 | Video application system, video special effect processing system and method |
| CN102262788A (en) * | 2010-05-24 | 2011-11-30 | 上海一格信息科技有限公司 | Method and device for processing interactive makeup information data of personal three-dimensional (3D) image |
| CN104077024A (en) * | 2013-03-29 | 2014-10-01 | 索尼公司 | Information processing apparatus, information processing method, and recording medium |
| CN103236066A (en) * | 2013-05-10 | 2013-08-07 | 苏州华漫信息服务有限公司 | Virtual trial make-up method based on human face feature analysis |
| CN104217350A (en) * | 2014-06-17 | 2014-12-17 | 北京京东尚科信息技术有限公司 | Virtual try-on realization method and device |
| CN104780458A (en) * | 2015-04-16 | 2015-07-15 | 美国掌赢信息科技有限公司 | Method and electronic equipment for loading effects in instant video |
| CN104809638A (en) * | 2015-05-20 | 2015-07-29 | 成都通甲优博科技有限责任公司 | Virtual glasses trying method and system based on mobile terminal |
| CN105096241A (en) * | 2015-07-28 | 2015-11-25 | 努比亚技术有限公司 | Face image beautifying device and method |
| CN105334963A (en) * | 2015-10-29 | 2016-02-17 | 广州华多网络科技有限公司 | Method and system for displaying virtual article |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107454433A (en) * | 2017-08-09 | 2017-12-08 | 广州视源电子科技股份有限公司 | Live broadcasting annotation method and device, terminal and live broadcasting system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109637518B (en) | Virtual anchor implementation method and device | |
| CN110662083B (en) | Data processing method and device, electronic equipment and storage medium | |
| US20170304735A1 (en) | Method and Apparatus for Performing Live Broadcast on Game | |
| US10217487B2 (en) | Method and device for controlling playback | |
| EP3179408A2 (en) | Picture processing method and apparatus, computer program and recording medium | |
| CN106791893A (en) | Net cast method and device | |
| CN106165430A (en) | Net cast method and device | |
| CN106331761A (en) | Live broadcast list display method and apparatuses | |
| CN109729372B (en) | Live broadcast room switching method, device, terminal, server and storage medium | |
| CN108712603B (en) | Image processing method and mobile terminal | |
| US11641493B2 (en) | Method and electronic device for displaying bullet screens | |
| CN107018333A (en) | Shoot template and recommend method, device and capture apparatus | |
| CN110300274B (en) | Video file recording method, device and storage medium | |
| CN107515669B (en) | Display method and device | |
| CN109151546A (en) | A kind of method for processing video frequency, terminal and computer readable storage medium | |
| EP3113071A1 (en) | Method and device for acquiring iris image | |
| CN106507178A (en) | Video broadcasting method and device | |
| CN107832746A (en) | Expression recognition method and device | |
| CN108108671A (en) | Description of product information acquisition method and device | |
| CN112261481A (en) | Interactive video creating method, device and equipment and readable storage medium | |
| CN106954093B (en) | Panoramic video processing method, device and system | |
| CN107170048A (en) | Information displaying method and device | |
| CN108040280A (en) | Content item display methods and device, storage medium | |
| CN106572397A (en) | Interaction method and device for live video application | |
| CN105635573B (en) | Camera visual angle regulating method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20161207 |