[go: up one dir, main page]

CN104994314B - Pass through the method and system of gesture control PIP video on mobile terminals - Google Patents

Pass through the method and system of gesture control PIP video on mobile terminals Download PDF

Info

Publication number
CN104994314B
CN104994314B CN201510486906.3A CN201510486906A CN104994314B CN 104994314 B CN104994314 B CN 104994314B CN 201510486906 A CN201510486906 A CN 201510486906A CN 104994314 B CN104994314 B CN 104994314B
Authority
CN
China
Prior art keywords
video player
picture
mobile terminal
pip
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201510486906.3A
Other languages
Chinese (zh)
Other versions
CN104994314A (en
Inventor
王伟
李庆燕
顾思斌
潘柏宇
王冀
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba China Co Ltd
Original Assignee
Youku Network Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Youku Network Technology Beijing Co Ltd filed Critical Youku Network Technology Beijing Co Ltd
Priority to CN201510486906.3A priority Critical patent/CN104994314B/en
Publication of CN104994314A publication Critical patent/CN104994314A/en
Application granted granted Critical
Publication of CN104994314B publication Critical patent/CN104994314B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

This application discloses the methods for passing through gesture control PIP video on mobile terminals, it include: when mobile terminal while to open main video player and PIP video player plays video, and the video display area in PIP video player is when having touch-control, when the touch-control is that multi-point touch has dilatory movement, the farthest point of distance between two points is the distance that initial position records the mobile variation of this two o'clock from multi-point touch, pass through the value for becoming larger or becoming smaller apart from size, the display scale value of corresponding adjustment PIP video player, simultaneously when the mobile terminal monitors that the display scale value of the display area of the PIP video player meets or exceeds certain default value of display scale value of the display area of main video player, exchange the content of main video player and PIP video player plays.The present invention is convenient for users to operate by gesture control mobile terminal PIP video, provides better PIP video interactive experience.

Description

Method and system for controlling picture-in-picture video through gestures on mobile terminal
Technical Field
The present application relates to the field of mobile video playing, and in particular, to a method and system for controlling a picture-in-picture video on a mobile terminal through a gesture.
Background
At present, the application of video on demand and live broadcast from internet multimedia by mobile terminals is more and more extensive, the mobile network speed is greatly improved along with the continuous development of the mobile internet technology, people use more and more mobile video scenes, and the mobile video is more and more popular with people due to the characteristics of convenience and quickness. Especially, people watch video on demand/live broadcast content in leisure time, even fragmented time of going on and off duty, so that interesting video programs can be watched by fully utilizing trivial time.
Picture-in-Picture video, also known as Picture-in-Picture (PiP) technology, simultaneously presents two video signals by using a superposition of two video pictures, one large and one small. And simultaneously broadcasting one video on a small area of a picture while broadcasting the other video on the full screen. Commonly found in televisions and monitoring equipment. The sources of the picture-in-picture video may be different television channels, video players, surveillance cameras, etc.
Picture-in-picture is the display of two sets of programs on the same screen using digital techniques. I.e., on a normally viewed main picture, while inserting one or more compressed sub-pictures, so as to watch other channels while enjoying the main picture.
The pip video technology was first implemented on a tv set, and the pip video function of the tv set is that a pip video signal processing and controlling circuit is added on the basis of the earlier color tv set circuit. The picture-in-picture video playing is divided into a video playing video area and a display space, and the sub-picture signal has two sources: one of them is that the sub-picture signal source only has external video input signals, such as video signals output by video cameras, video recorders, video disc players, etc. Such a picture-in-picture television set which only processes externally input video sub-picture signals is usually called a video picture-in-picture television set. The other source is a sprite signal source which has both a video signal from an external video input and a video signal from a sprite-specific video channel (tuner, mid-amplifier, video detector) output. Such a picture-in-picture color television set, in which the sub-picture signal source has both an external input video signal and a high frequency television signal, is often referred to as a radio frequency picture-in-picture color television set. The radio frequency picture-in-picture television is provided with double tuner, double intermediate amplifier and double decoding double-channel signal channels, wherein one channel of signal is used as a small picture signal source, and the other channel of signal is used as a large picture signal source.
The mobile video picture-in-picture sends an instruction to the server, receives a picture-in-picture playing mode, sets the size of a playing window according to the parameters, and can perform playback of live video and the like.
At present, in the technical field of playing picture-in-picture videos by mobile terminals, there is no picture-in-picture video technology for realizing interactive operation between the mobile terminals and a server and generating commercial value by delivering videos according to mobile terminal group information in a classified manner in order to meet the requirement of playing videos in multiple scenes by the mobile terminals.
With the popularization of intelligent mobile terminals, how to facilitate user operations, thereby improving user experience becomes a research focus in the field. In the prior art, no technology for controlling picture-in-picture video playing through gestures and controlling the picture-in-picture video playing according to the preference of a user exists in a mobile terminal.
Disclosure of Invention
In order to solve the problems in the prior art, an object of the present invention is to provide a method and a system for controlling a pip video on a mobile terminal through a gesture, so as to solve the problem that there is no technology for controlling the pip video play on the mobile terminal through a gesture and controlling the pip video play according to the preference of a user in the prior art.
The invention provides a method for controlling picture-in-picture video on a mobile terminal through gestures, which comprises the following steps:
when the mobile terminal simultaneously starts a main video player and a picture-in-picture video player to play videos and detects that a video display area in the picture-in-picture video player has touch control, the mobile terminal judges whether the touch control is multi-point touch control or single-point touch control and whether dragging movement exists or not;
when the mobile terminal judges that the touch control is single-point touch control dragging movement, the mobile terminal moves the current position of the picture-in-picture video player from a single-point touch control starting position to a position where the dragging movement stops;
when the mobile terminal detects that the touch is multi-point touch with dragging movement, the mobile terminal records the movement change distance of two points from the point with the farthest distance between the two points in the multi-point touch as an initial position, correspondingly adjusts the display proportion value of the PIP video player according to the increasing or decreasing value of the distance size, and simultaneously, when the mobile terminal monitors that the display proportion value of the display area of the PIP video player reaches or exceeds a certain preset value of the display proportion value of the display area of the main video player, the contents of videos played by the main video player and the PIP video player are exchanged.
Wherein, further still include:
when the mobile terminal detects that the video display area in the PIP video player has single-point touch and does not move in a dragging mode, and simultaneously detects that the single-point touch time exceeds a certain time length, a display setting interface of the PIP video player pops up in the video display area.
Wherein, further, include:
and setting the size of a touch area of the PIP video player and the duration of single-point touch for popping up a display setting interface of the PIP video player.
Further, when the mobile terminal monitors that the display scale value of the display area of the pip video player reaches or exceeds a certain preset value of the display scale value of the display area of the main video player, the content of the video played by the main video player and the pip video player is exchanged, and the method further comprises the following steps:
and when the mobile terminal monitors that the display scale value of the display area of the PIP video player reaches or exceeds one half of the display scale value of the display area of the main video player, the contents of the videos played by the main video player and the PIP video player are exchanged.
Wherein, further, when the mobile terminal monitors that the display scale value of the display area of the pip video player reaches or exceeds a certain preset value of the display scale value of the display area of the main video player, the method further includes the following steps:
when the mobile terminal monitors that the display scale value of the display area of the PIP video player reaches or exceeds a certain preset value of the display scale value of the display area of the main video player, a prompt box is popped up in the display area of the mobile terminal to prompt whether to execute the content of playing videos for the main video player and the PIP video player.
A system for controlling picture-in-picture video through gestures on a mobile terminal, comprising: a monitoring module, a judging module and a playing module, wherein,
the playing module is used for starting the main video player and the picture-in-picture video player by the mobile terminal to play videos;
the monitoring module is used for detecting that a video display area in the picture-in-picture video player has touch control when the mobile terminal simultaneously starts a main video player and the picture-in-picture video player to play videos, generating touch control instruction information and sending the touch control instruction information to the judging module;
the judging module is used for judging whether the touch instruction information is multi-point touch or single-point touch and whether dragging movement exists or not, wherein,
when the touch is detected to be single-point touch with dragging movement, the current position of the PIP video player is moved from a single-point touch starting position to a position where the dragging movement is stopped;
when the mobile terminal detects that the touch is multi-point touch with dragging movement, the mobile terminal records the movement change distance of two points from the point with the farthest distance between the two points in the multi-point touch as the starting position, correspondingly adjusts the display proportion value of the PIP video player according to the increasing or decreasing value of the distance size, and simultaneously, when the mobile terminal monitors that the display proportion value of the display area of the PIP video player reaches or exceeds a certain preset value of the display proportion value of the display area of the main video player, the contents of videos played by the main video player and the PIP video player are exchanged.
Wherein, further, the judging module further includes:
and the display setting interface is used for popping up the PIP video player in the video display area when detecting that the video display area in the PIP video player has single-point touch and no dragging movement and detecting that the single-point touch time exceeds a certain length.
Wherein, further, the judging module further includes:
the display setting interface is used for setting the size of the touch area of the PIP video player and the duration of single-point touch for popping up the display setting interface of the PIP video player.
Wherein, further, the judging module further includes:
and when the display scale value of the display area of the PIP video player is monitored to reach or exceed one-half of the display scale value of the display area of the main video player, the contents of the videos are played by the main video player and the PIP video player.
Wherein, further, the judging module further includes:
and when it is monitored that the display scale value of the display area of the pip video player reaches or exceeds a certain preset value of the display scale value of the display area of the main video player, popping up a prompt box in the display area of the mobile terminal to prompt whether to execute the content of playing the video for the main video player and the pip video player.
Compared with the prior art, the method and the system for controlling the picture-in-picture video through the gesture on the mobile terminal have the following advantages:
(1) according to the invention, the server interacts with the mobile terminal, the picture-in-picture video playing is specifically realized on the mobile terminal, and the server interacts with the mobile terminal and controls the picture-in-picture video of the mobile terminal through gestures, so that the functions of reducing or amplifying the playing video area and the display space in the picture-in-picture video and automatically switching the playing video area and the display space are realized, a user can conveniently watch the picture-in-picture video according to the preference of the user, and the user experience of the mobile terminal is further improved.
(2) According to the invention, the picture-in-picture video of the mobile terminal is controlled by the gesture of the user terminal, so that the requirement of setting the position of a video playing region/display space in the picture-in-picture video by the user according to the requirement can be met, the operation of the user is facilitated, and better picture-in-picture video interaction experience is provided for the user.
(3) According to the invention, the picture-in-picture video of the mobile terminal is controlled by the gesture, so that the size of the picture-in-picture video display space is set according to the preference of the user, the size of the picture-in-picture video display space is conveniently set by different users according to the preference of the users, and the experience of watching the picture-in-picture video of the users is improved.
(4) According to the invention, the picture-in-picture video of the mobile terminal is controlled through the gesture, so that the closing of the picture-in-picture video display space and the selection of the playing video content of the display space are realized, more selectivity is provided for users, and the user experience of the mobile terminal is further improved.
Of course, it is not necessary for any one product to achieve all of the above-described technical effects simultaneously.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a flowchart illustrating a method for controlling pip video by gesture on a mobile terminal according to embodiment 1 of the present invention;
fig. 2 is a flowchart illustrating a method for controlling a pip video on a mobile terminal through a gesture according to embodiment 2 of the present invention;
fig. 3 is a flowchart illustrating a method for controlling pip video by gesture on a mobile terminal according to embodiment 3 of the present invention;
fig. 4 is a schematic structural diagram of a system for controlling pip video through gestures on a mobile terminal according to the present invention.
Detailed Description
As used in the specification and in the claims, certain terms are used to refer to particular components. As one skilled in the art will appreciate, manufacturers may refer to a component by different names. This specification and claims do not intend to distinguish between components that differ in name but not function. In the following description and in the claims, the terms "include" and "comprise" are used in an open-ended fashion, and thus should be interpreted to mean "include, but not limited to. "substantially" means within an acceptable error range, and a person skilled in the art can solve the technical problem within a certain error range to substantially achieve the technical effect. Furthermore, the term "coupled" is intended to encompass any direct or indirect electrical coupling. Thus, if a first device couples to a second device, that connection may be through a direct electrical coupling or through an indirect electrical coupling via other devices and couplings. The description which follows is a preferred embodiment of the present application, but is made for the purpose of illustrating the general principles of the application and not for the purpose of limiting the scope of the application. The protection scope of the present application shall be subject to the definitions of the appended claims.
The present application will be described in further detail below with reference to the accompanying drawings, but the present application is not limited thereto.
Example 1:
as shown in fig. 1, a method for controlling a pip video on a mobile terminal through a gesture according to embodiment 1 of the present invention is characterized by comprising:
step 101, when the mobile terminal simultaneously starts a main video player and a pip video player to play videos, and the mobile terminal detects that a video display area in the pip video player has touch, the mobile terminal determines whether the touch instruction information is multi-point touch or single-point touch, and whether dragging movement exists.
The step 101 is actually a step process of forming a pip video playing on the mobile terminal through such an interactive manner between the mobile terminal and the server, and determining the content in the form of the touch instruction information when a touch caused by a gesture operation is detected in a video display area in the pip video player.
And 102, when the mobile terminal judges that the touch control is single-point touch control with dragging movement, the mobile terminal moves the current position of the picture-in-picture video player from a single-point touch control starting position as a central point to a position where the dragging movement is stopped.
Preferably, when the mobile terminal determines that the position movement instruction information of the picture-in-picture video playing display area caused by gesture touch in the main video playing area of the display screen is the single-point touch position movement instruction information, the mobile terminal controls the picture-in-picture video playing display area to move to any position of the playing video area. More preferably, the user can move the display space to the upper left side, the lower left side, the upper right side, the lower right side, the middle right side and the like of the main video playing area according to the preference of the user.
Therefore, the mobile terminal user can freely move and set the position of the playing area of the picture-in-picture video according to the favorite self, and the experience of watching the picture-in-picture video of the user is improved.
Step 103, when the mobile terminal detects that the touch is a multi-point touch with dragging movement, the mobile terminal records a distance of movement change of two points from a point with the farthest distance between the two points in the multi-point touch as an initial position, correspondingly adjusts the display scale value of the pip video player according to an increasing or decreasing value of the distance, and simultaneously, when the mobile terminal monitors that the display scale value of the display area of the pip video player reaches or exceeds a certain preset value of the display scale value of the display area of the main video player, preferably, when the preset value is one half, the contents of videos played by the main video player and the pip video player are exchanged.
The display space of the picture-in-picture video is controlled to be enlarged or reduced through the touch instruction information of the user in the display screen area of the mobile terminal, the operation is simple and convenient, and better picture-in-picture video watching experience is provided for the user.
Further, when the user enlarges the display area of the pip video player to reach or exceed one-half of the display area of the played video, which indicates that the current user is interested in the currently played pip video, the mobile device controls the display area of the pip video player to be switched with the display area of the main video player, so that the current pip video is better presented to the user, and the experience of the user watching the pip video is improved.
Example 2:
as shown in fig. 2, on the basis of embodiment 1, the method for controlling picture-in-picture video on a mobile terminal through gestures according to the present invention includes:
step 201, when the mobile terminal simultaneously starts a main video player and a pip video player to play videos, and the mobile terminal detects that a video display area in the pip video player has touch, the mobile terminal determines whether the touch instruction information is multi-point touch or single-point touch, and whether dragging movement exists.
Step 202, when the mobile terminal judges that the touch control is single-point touch control and dragging movement exists, the mobile terminal moves the current position of the picture-in-picture video player from a single-point touch control starting position to a position where the dragging movement stops;
when the mobile terminal detects that the video display area in the PIP video player has single-point touch and does not move in a dragging mode, and simultaneously detects that the single-point touch time exceeds a certain time length, a display setting interface of the PIP video player pops up in the video display area.
Preferably, when the initial setting mobile terminal detects that the single-point touch time exceeds 3 seconds, a display setting interface of the pip video player pops up in the video display area. Further, the mobile terminal is configured to: the user can set the single-point touch time of the display setting interface for popping up the picture-in-picture video player according to the requirement of the user.
More preferably, a selecting touch button with common single-point touch time is preset in the video display area, and when the mobile terminal detects that the display area of the pip video playing has touch, the selecting touch button with the common single-point touch time is displayed in the video display area; and when the mobile terminal detects that the selected touch button of the common single-point touch time is touched, the common single-point touch time is displayed in the video display area, and the user can set the single-point touch time for popping up the display setting interface of the PIP video player through the corresponding touch time.
Through the setting of the mode, the quick setting mode of the common single-point touch time is preset in the mobile terminal, so that convenience is brought to a user to quickly set the single-point touch time for popping up the display setting interface of the picture-in-picture video player, and the user experience is improved.
Furthermore, the size of the picture-in-picture video playing display area is set by the mobile terminal according to the instruction information for setting the size of the picture-in-picture video playing display area according to the requirements of the user, so that the experience of watching the picture-in-picture video by the user is improved.
Preferably, a touch button of the size of the pip video playing display area is arranged in the pip video playing display area, when the mobile terminal detects and judges that the button is triggered by gesture touch, a size setting frame of the pip video playing display area is popped up, and a user can set the size of the pip video playing display area according to own preference. The experience of watching the picture-in-picture video is improved.
Further, step 202 further comprises:
when the mobile terminal detects that the picture-in-picture video playing area has touch control, a picture-in-picture video volume control button, a picture-in-picture video playing progress control bar, a picture-in-picture video setting button and a picture-in-picture video searching button are displayed in the video playing area, and when the mobile terminal does not detect any touch control operation within a certain time, the picture-in-picture video volume control button, the picture-in-picture video playing progress control bar, the picture-in-picture video setting button and the picture-in-picture video searching button are automatically hidden.
Preferably, when the mobile terminal does not detect any touch operation within 5s, the pip video volume control button, the pip video play progress control bar, and the pip video setting button are automatically hidden. So set up, can guarantee the user and carry out the demand that sets up to picture in picture video, do not influence again and watch.
Step 203, when the mobile terminal detects that the touch is a multi-point touch with dragging movement, the mobile terminal records the distance of movement change of two points from the point with the farthest distance between the two points in the multi-point touch as an initial position, correspondingly adjusts the display scale value of the pip video player according to the value of the distance, and simultaneously, when the mobile terminal monitors that the display scale value of the display area of the pip video player reaches or exceeds one half of the display scale value of the display area of the main video player, the main video player and the pip video player are exchanged to play video content.
Specifically, when the mobile terminal determines touch instruction information of enlarging or reducing of the pip video playing area caused by increasing or decreasing of the distance between two points with the farthest multi-point gesture touch distance, the pip video playing area is controlled to be enlarged or reduced according to the increasing or decreasing distance between the two touch points and a preset ratio.
Example 3:
as shown in fig. 3, a method for controlling a pip video on a mobile terminal through a gesture according to an embodiment of the present invention includes:
step 301, when the mobile terminal simultaneously starts a main video player and a pip video player to play videos, and the mobile terminal detects that a video display area in the pip video player has touch, the mobile terminal determines whether the touch instruction information is multi-point touch or single-point touch, and whether dragging movement occurs.
Step 302, when the mobile terminal judges that the touch control is single-point touch control with dragging movement, the mobile terminal moves the current position of the picture-in-picture video player from a single-point touch control starting position as a central point to a position where the dragging movement stops;
when the mobile terminal detects that the video display area in the PIP video player has single-point touch and does not move in a dragging mode, and simultaneously detects that the single-point touch time exceeds 3 seconds, a display setting interface of the PIP video player pops up in the video display area.
Preferably, the display setting interface of the pip video player further includes setting a size setting touch area size of the pip video player and a time length of a single touch for ejecting the display setting interface of the pip video player.
Step 303, when the mobile terminal detects that the touch is a multi-point touch with dragging movement, the mobile terminal records a distance of movement change of two points from a point with the farthest distance between the two points in the multi-point touch as an initial position, correspondingly adjusts the display scale value of the pip video player according to an increasing or decreasing value of the distance, and simultaneously, when the mobile terminal monitors that the display scale value of the display area of the pip video player reaches or exceeds one half of the display scale value of the display area of the main video player, the mobile terminal switches the main video player and the pip video player to play video content.
In step 301, the method further includes:
when the mobile terminal monitors that the display scale value of the display area of the pip video player reaches or exceeds a certain preset value of the display scale value of the display area of the main video player, preferably, when the display scale value of the display area of the pip video player reaches or exceeds one half of the display scale value of the display area of the main video player, a prompt box is popped up in the display area of the mobile terminal to prompt whether to execute video content playing for the main video player and the pip video player.
In the step 302, the method further includes:
and when the mobile terminal judges that the display space closing instruction information caused by gesture touch control exists in the playing video area of the display screen, the mobile terminal closes the display space.
Preferably, after the mobile terminal determines that there is instruction information of a display space caused by gesture touch in a playing video region of the display screen, a closing touch button is displayed in the display space, and a user clicks the closing touch button to close the display space.
In the step 303, the method further includes:
the mobile terminal forwards instruction information for replacing the picture-in-picture video caused by gesture touch in a picture-in-picture playing video area of the display screen to the server after judging that the instruction information is generated;
and the mobile terminal receives the replaced picture-in-picture video returned after sending the picture-in-picture video replacing instruction information to the server, and plays the picture-in-picture video in the picture-in-picture video playing display area.
Preferably, the mobile terminal determines that the instruction information of the current user contains member information, and after determining that the instruction information of the pip video is replaced caused by gesture touch in the pip video playing video area of the display screen, pops up a pip video selection interface in the pip video display area of the mobile terminal, so that the user can select the pip video to play in the pip video playing display area according to self preference.
More preferably, the mobile terminal determines that the instruction information of the current user includes member information, and when the mobile terminal detects that the pip video playing area has touch control, displays a pip video playing progress control bar and a pip video search button in the video playing area, and when the mobile terminal does not detect any touch control operation within a certain time, automatically hides the pip video playing progress control bar and the pip video search button. The user can search the favorite picture-in-picture video for playing through the picture-in-picture video searching button. And the setting of the automatic hiding function not only meets the requirements of a user for controlling video playing and searching video, but also does not influence the normal video watching of the video.
Example 4:
as shown in fig. 4, a system for controlling a pip video through a gesture on a mobile terminal is characterized in that the system includes: the device comprises a monitoring module 1, a judging module 2 and a playing module 3; wherein,
the monitoring module 1 is coupled to the judging module 2, and configured to detect that a video display area in the pip video player has a touch control when the mobile terminal simultaneously starts a main video player and the pip video player to play videos, generate touch control instruction information, and send the touch control instruction information to the judging module.
The determining module 2 is coupled to the monitoring module 1 and the playing module 3, and is configured to determine whether the touch instruction information is multi-point touch or single-point touch, and whether there is dragging movement, wherein,
when the touch is detected to be single-point touch with dragging movement, the current position of the PIP video player is moved from a single-point touch starting position to a position where the dragging movement is stopped;
through the mode, the mobile terminal can control the display area of the picture-in-picture video player to move to any position of the display area of the main video player through the gesture touch instruction information of the user. Preferably, the user can move the display area of the pip video player to the upper left, lower left, upper right, lower right, and centered right positions of the display area of the main video player according to his/her preference.
When the mobile terminal detects that the touch is multi-point touch with dragging movement, the mobile terminal records the movement change distance of two points from the point with the farthest distance between the two points in the multi-point touch as the starting position, correspondingly adjusts the display proportion value of the PIP video player according to the increasing or decreasing value of the distance size, and simultaneously, when the mobile terminal monitors that the display proportion value of the display area of the PIP video player reaches or exceeds a certain preset value of the display proportion value of the display area of the main video player, the contents of videos played by the main video player and the PIP video player are exchanged.
The playing module 3 is coupled to the judging module 2, and is configured to start the main video player and the pip video player by the mobile terminal to play the video.
Preferably, the mobile terminal divides a display area of a quarter of the pip video player within a main video playing area of a display screen thereof for simultaneously playing the pip video. More preferably, the display area of the pip video player may be further configured as a square display frame with a length of 6.3cm and a width of 4cm, and the pip video is played within the square display frame.
Wherein the processing module 2 is further configured to:
when it is detected that the video display area in the pip video player has a single touch and no dragging movement, and it is detected that the single touch time exceeds a certain time length, preferably, when it is detected that the single touch time exceeds 3 seconds, a display setting interface of the pip video player pops up in the video display area.
When the touch control is detected in the picture-in-picture video playing area, a picture-in-picture video volume control button, a picture-in-picture video playing progress control bar, a picture-in-picture video setting button and a picture-in-picture video searching button are displayed in the video playing area, and when the mobile terminal does not detect any touch control operation within a certain time, the picture-in-picture video volume control button, the picture-in-picture video playing progress control bar, the picture-in-picture video setting button and the picture-in-picture video searching button are automatically hidden.
Preferably, when no touch operation is detected within 5s, the pip video volume control button, the pip video play progress control bar, and the pip video setting button are automatically hidden. So set up, can guarantee the user and carry out the demand that sets up to picture in picture video, do not influence again and watch.
The processing module 2 is further configured to:
setting the display size of a picture-in-picture video player in the setting interface to set the size of a touch area and the duration of single-point touch of the display setting interface for popping up the picture-in-picture video player.
The processing module 2 is further configured to,
and when the display scale value of the display area of the PIP video player is monitored to reach or exceed one-half of the display scale value of the display area of the main video player, the main video player and the PIP video player are exchanged to play the video content.
Preferably, the processing module 2 is further configured to pop up a prompt box in the display area of the mobile terminal to prompt whether to execute content for playing video to the main video player and the pip video player when it is monitored that the display scale value of the display area of the pip video player reaches or exceeds a certain preset value of the display scale value of the display area of the main video player.
The prompt box is popped out through controlling the picture-in-picture video display interface by gesture touch, so that a mobile terminal user can control whether to continue playing the picture-in-picture video or not according to the requirements of the mobile terminal user and select the playing content of the picture-in-picture video. Preferably, when the current user is detected to be a member, the mobile terminal user may select the playing content of the pip video through a pop-up prompt box.
Compared with the prior art, the method and the system for controlling the picture-in-picture video through the gesture on the mobile terminal have the following advantages:
(1) according to the invention, the server interacts with the mobile terminal, the picture-in-picture video playing is specifically realized on the mobile terminal, and the server interacts with the mobile terminal and controls the picture-in-picture video of the mobile terminal through gestures, so that the functions of reducing or amplifying the playing video area and the display space in the picture-in-picture video and automatically switching the playing video area and the display space are realized, a user can conveniently watch the picture-in-picture video according to the preference of the user, and the user experience of the mobile terminal is further improved.
(2) According to the invention, the picture-in-picture video of the mobile terminal is controlled by the gesture of the user terminal, so that the requirement of setting the position of a video playing region/display space in the picture-in-picture video by the user according to the requirement can be met, the operation of the user is facilitated, and better picture-in-picture video interaction experience is provided for the user.
(3) According to the invention, the picture-in-picture video of the mobile terminal is controlled by the gesture, so that the size of the picture-in-picture video display space is set according to the preference of the user, the size of the picture-in-picture video display space is conveniently set by different users according to the preference of the users, and the experience of watching the picture-in-picture video of the users is improved.
(4) According to the invention, the picture-in-picture video of the mobile terminal is controlled through the gesture, so that the closing of the picture-in-picture video display space and the selection of the playing video content of the display space are realized, more selectivity is provided for users, and the user experience of the mobile terminal is further improved.
The foregoing description shows and describes several preferred embodiments of the present application, but as aforementioned, it is to be understood that the application is not limited to the forms disclosed herein, but is not to be construed as excluding other embodiments and is capable of use in various other combinations, modifications, and environments and is capable of changes within the scope of the application as described herein, commensurate with the above teachings, or the skill or knowledge of the relevant art. And that modifications and variations may be effected by those skilled in the art without departing from the spirit and scope of the application, which is to be protected by the claims appended hereto.

Claims (10)

1. A method for controlling picture-in-picture video through gestures on a mobile terminal, comprising:
when the mobile terminal simultaneously starts a main video player and a picture-in-picture video player to play videos and detects that a video display area in the picture-in-picture video player has touch control, the mobile terminal judges whether the touch control is multi-point touch control or single-point touch control and whether dragging movement exists or not;
when the mobile terminal judges that the touch control is single-point touch control dragging movement, the mobile terminal moves the current position of the picture-in-picture video player from a single-point touch control starting position to a position where the dragging movement stops;
when the mobile terminal detects that the touch is multi-point touch with dragging movement, the mobile terminal records the movement change distance of two points from the point with the farthest distance between the two points in the multi-point touch as an initial position, correspondingly adjusts the display proportion value of the PIP video player according to the increasing or decreasing value of the distance size, and simultaneously, when the mobile terminal monitors that the display proportion value of the display area of the PIP video player reaches or exceeds a certain preset value of the display proportion value of the display area of the main video player, the contents of videos played by the main video player and the PIP video player are exchanged.
2. The method for controlling picture-in-picture video by gesture on a mobile terminal according to claim 1, further comprising:
when the mobile terminal detects that the video display area in the PIP video player has single-point touch and does not move in a dragging mode, and simultaneously detects that the single-point touch time exceeds a certain time length, a display setting interface of the PIP video player pops up in the video display area.
3. The method for controlling picture-in-picture video through gestures on a mobile terminal according to claim 2, wherein the display setting interface of the picture-in-picture video player further comprises:
and setting the size of a touch area of the PIP video player and the duration of single-point touch for popping up a display setting interface of the PIP video player.
4. The method according to claim 2, wherein when the mobile terminal monitors that the display scale value of the display area of the pip video player reaches or exceeds a preset value of the display scale value of the display area of the main video player, the method further comprises:
and when the mobile terminal monitors that the display scale value of the display area of the PIP video player reaches or exceeds one half of the display scale value of the display area of the main video player, the contents of the videos played by the main video player and the PIP video player are exchanged.
5. The method as claimed in claim 1, wherein when the mobile terminal monitors that the display scale value of the display area of the pip video player reaches or exceeds a preset value of the display scale value of the display area of the main video player, the method for controlling the pip video on the mobile terminal by gesture is further configured to change the contents of the video played by the main video player and the pip video player, and further comprising:
when the mobile terminal monitors that the display scale value of the display area of the PIP video player reaches or exceeds a certain preset value of the display scale value of the display area of the main video player, a prompt box is popped up in the display area of the mobile terminal to prompt whether to execute the content of playing videos for the main video player and the PIP video player.
6. A system for controlling picture-in-picture video via gestures on a mobile terminal, comprising: a monitoring module, a judging module and a playing module, wherein,
the playing module is used for starting the main video player and the picture-in-picture video player by the mobile terminal to play videos;
the monitoring module is used for detecting that a video display area in the picture-in-picture video player has touch control when the mobile terminal simultaneously starts a main video player and the picture-in-picture video player to play videos, generating touch control instruction information and sending the touch control instruction information to the judging module;
the judging module is used for judging whether the touch instruction information is multi-point touch or single-point touch and whether dragging movement exists or not, wherein,
when the touch is detected to be single-point touch with dragging movement, the current position of the PIP video player is moved from a single-point touch starting position to a position where the dragging movement is stopped;
when the mobile terminal detects that the touch is multi-point touch with dragging movement, the mobile terminal records the movement change distance of two points from the point with the farthest distance between the two points in the multi-point touch as the starting position, correspondingly adjusts the display proportion value of the PIP video player according to the increasing or decreasing value of the distance size, and simultaneously, when the mobile terminal monitors that the display proportion value of the display area of the PIP video player reaches or exceeds a certain preset value of the display proportion value of the display area of the main video player, the contents of videos played by the main video player and the PIP video player are exchanged.
7. The system according to claim 6, wherein the determining module further comprises:
and the display setting interface is used for popping up the PIP video player in the video display area when detecting that the video display area in the PIP video player has single-point touch and no dragging movement and detecting that the single-point touch time exceeds a certain length.
8. The system according to claim 7, wherein the determining module further comprises:
the display setting interface is used for setting the size of the touch area of the PIP video player and the duration of single-point touch for popping up the display setting interface of the PIP video player.
9. The system according to claim 7, wherein the determining module further comprises:
and when the display scale value of the display area of the PIP video player is monitored to reach or exceed one-half of the display scale value of the display area of the main video player, the contents of the videos are played by the main video player and the PIP video player.
10. The system according to claim 6, wherein the determining module further comprises:
and when it is monitored that the display scale value of the display area of the pip video player reaches or exceeds a certain preset value of the display scale value of the display area of the main video player, popping up a prompt box in the display area of the mobile terminal to prompt whether to execute the content of playing the video for the main video player and the pip video player.
CN201510486906.3A 2015-08-10 2015-08-10 Pass through the method and system of gesture control PIP video on mobile terminals Expired - Fee Related CN104994314B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510486906.3A CN104994314B (en) 2015-08-10 2015-08-10 Pass through the method and system of gesture control PIP video on mobile terminals

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510486906.3A CN104994314B (en) 2015-08-10 2015-08-10 Pass through the method and system of gesture control PIP video on mobile terminals

Publications (2)

Publication Number Publication Date
CN104994314A CN104994314A (en) 2015-10-21
CN104994314B true CN104994314B (en) 2019-04-09

Family

ID=54306064

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510486906.3A Expired - Fee Related CN104994314B (en) 2015-08-10 2015-08-10 Pass through the method and system of gesture control PIP video on mobile terminals

Country Status (1)

Country Link
CN (1) CN104994314B (en)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105979329A (en) * 2016-06-27 2016-09-28 乐视控股(北京)有限公司 Method and device for adjusting main and secondary windows of television as well as terminal equipment and television
US11295706B2 (en) * 2016-06-30 2022-04-05 Microsoft Technology Licensing, Llc Customizable compact overlay window
CN106534939B (en) * 2016-10-09 2019-07-05 北京金山安全软件有限公司 Multi-video preview method and device and electronic equipment
CN106802759A (en) * 2016-12-21 2017-06-06 华为技术有限公司 The method and terminal device of video playback
CN109218253A (en) * 2017-06-29 2019-01-15 武汉矽感科技有限公司 Multi-medium play method plays background server and mobile terminal
CN107888984B (en) * 2017-11-15 2021-03-09 北京小米移动软件有限公司 Short video playing method and device
CN108012182A (en) * 2017-12-26 2018-05-08 珠海格力电器股份有限公司 Video display method and terminal equipment
CN108271056B (en) * 2018-02-02 2020-11-03 阿里巴巴(中国)有限公司 Video interaction method, user client, server and storage medium
CN108900911A (en) * 2018-06-29 2018-11-27 青岛海信宽带多媒体技术有限公司 Realize the video broadcasting method, device and display equipment of picture-in-picture function
CN109085974B (en) * 2018-07-17 2021-02-19 广州视源电子科技股份有限公司 Screen control method, system and terminal equipment
CN108989691B (en) * 2018-10-19 2021-04-06 北京微播视界科技有限公司 Video shooting method and device, electronic equipment and computer readable storage medium
CN108989692A (en) * 2018-10-19 2018-12-11 北京微播视界科技有限公司 Video capture method, apparatus, electronic equipment and computer readable storage medium
CN109614065A (en) * 2018-12-14 2019-04-12 北京向上心科技有限公司 The picture-in-picture display methods and display device of stock
CN110784774A (en) * 2019-09-23 2020-02-11 视联动力信息技术股份有限公司 Video window moving method and device and computer readable storage medium
CN110941378B (en) * 2019-11-12 2022-03-01 北京达佳互联信息技术有限公司 Video content display method and electronic equipment
CN111522497B (en) * 2020-04-16 2022-09-13 深圳市颍创科技有限公司 Method for touch control of size and position of sub-picture of display device in PIP mode
CN112017576A (en) * 2020-08-26 2020-12-01 北京字节跳动网络技术有限公司 Display control method, device, terminal and storage medium
CN116708696B (en) * 2022-11-22 2024-05-14 荣耀终端有限公司 Video processing method and electronic device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101155281A (en) * 2006-09-25 2008-04-02 三星电子株式会社 Mobile terminal having digital broadcast reception capability and pip display control method
CN102165403A (en) * 2008-09-25 2011-08-24 微软公司 User interface having zoom functionality
CN103164142A (en) * 2011-12-16 2013-06-19 联想(北京)有限公司 Method of adjusting screen touch point position of picture-in-picture interface and electronic equipment
CN103425431A (en) * 2013-08-07 2013-12-04 福州瑞芯微电子有限公司 Mobile terminal and method for achieving multi-window operation
CN103984492A (en) * 2013-02-07 2014-08-13 高德软件有限公司 Method and device for scaling display picture of mobile terminal and mobile terminal

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030001908A1 (en) * 2001-06-29 2003-01-02 Koninklijke Philips Electronics N.V. Picture-in-picture repositioning and/or resizing based on speech and gesture control
JP2008072279A (en) * 2006-09-13 2008-03-27 Sony Corp Video image information processing apparatus, video image information processing method, and computer/program
JP4927155B2 (en) * 2009-11-12 2012-05-09 株式会社エヌ・ティ・ティ・ドコモ Program generating apparatus and program
US9116594B2 (en) * 2010-01-19 2015-08-25 Lg Electronics Inc. Mobile terminal and control method thereof
CN102215217B (en) * 2010-04-07 2014-09-17 苹果公司 Establishing a video conference during a phone call
KR101699739B1 (en) * 2010-05-14 2017-01-25 엘지전자 주식회사 Mobile terminal and operating method thereof
CN104503682A (en) * 2014-11-07 2015-04-08 联发科技(新加坡)私人有限公司 Method for processing screen display window and mobile terminal

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101155281A (en) * 2006-09-25 2008-04-02 三星电子株式会社 Mobile terminal having digital broadcast reception capability and pip display control method
CN102165403A (en) * 2008-09-25 2011-08-24 微软公司 User interface having zoom functionality
CN103164142A (en) * 2011-12-16 2013-06-19 联想(北京)有限公司 Method of adjusting screen touch point position of picture-in-picture interface and electronic equipment
CN103984492A (en) * 2013-02-07 2014-08-13 高德软件有限公司 Method and device for scaling display picture of mobile terminal and mobile terminal
CN103425431A (en) * 2013-08-07 2013-12-04 福州瑞芯微电子有限公司 Mobile terminal and method for achieving multi-window operation

Also Published As

Publication number Publication date
CN104994314A (en) 2015-10-21

Similar Documents

Publication Publication Date Title
CN104994314B (en) Pass through the method and system of gesture control PIP video on mobile terminals
TWI401952B (en) Systems and methods for graphical control of user interface features in a television receiver
US7400364B2 (en) Sub-program avoidance redirection for broadcast receivers
KR102023609B1 (en) Content shareing method and display apparatus thereof
WO2017181594A1 (en) Video display method and apparatus
JP2018029382A (en) System and method for providing media guidance application functionality by using radio communication device
CN102917270A (en) Multi-video dynamic-previewing method, device and system
US8730405B2 (en) Display apparatus, remote controller, display control method, and control method
JP2008227677A (en) Television broadcast signal receiver
US20160255406A1 (en) Broadcast receiving apparatus and method for controlling the same
KR20120080985A (en) Method for displaying a image and broadcast receiving apparatus applying the same
EP2775702A1 (en) Trick play techniques for a picture-in-picture window rendered by a video services receiver
TW201304536A (en) Method for switching channel for video content
US7818766B2 (en) Last channel button functionality
CN104902319A (en) Method and device for pushing associated program
CN103813206B (en) Multi-screen interactive information processing method and device
US11589113B2 (en) Smart start-up of television
WO2017181595A1 (en) Method and device for video display
WO2017181603A1 (en) Video display method and device
JP2007013725A (en) Video display device and video display method
WO2014186655A1 (en) User interface for video delivery system with program guide overlay
CN113597756A (en) Information processing terminal, information processing method, and program
US20130208192A1 (en) Remote controller and method for generating control signal
KR20160029626A (en) Settop box, method and computer program for providing service using the same
US20170118437A1 (en) Methods and devices for switching between different tv program accompanying sounds

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 100080 A 5 C, block A, China International Steel Plaza, 8 Haidian Avenue, Haidian District, Beijing.

Applicant after: Youku network technology (Beijing) Co., Ltd.

Address before: 100080 A 5 C, block A, China International Steel Plaza, 8 Haidian Avenue, Haidian District, Beijing.

Applicant before: 1Verge Inc.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20200709

Address after: 310052 room 508, floor 5, building 4, No. 699, Wangshang Road, Changhe street, Binjiang District, Hangzhou City, Zhejiang Province

Patentee after: Alibaba (China) Co.,Ltd.

Address before: 100080 Beijing Haidian District city Haidian street A Sinosteel International Plaza No. 8 block 5 layer A, C

Patentee before: Youku network technology (Beijing) Co.,Ltd.

TR01 Transfer of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20190409

Termination date: 20200810

CF01 Termination of patent right due to non-payment of annual fee