Summary of the invention
The embodiment of the present invention is designed to provide a kind of multimedia data playing method, system and device, more to reduce
The resources occupation rate of media device.
Specific technical solution is as follows:
The embodiment of the invention provides a kind of multimedia data playing methods, applied in multimedia data play system
Second equipment, the multimedia system further include the first equipment, and first equipment and second equipment are located at same local
In net, which comprises
Obtain the first multi-medium data that first equipment is launched by screen mirror image function;Wherein, more than described first
It include the record screen data of first equipment in media data;
The second multi-medium data that first multi-medium data and second equipment acquire is subjected to mixed processing, is obtained
To hybrid multimedia data;
At least one of processing is carried out to the hybrid multimedia data: being played, is saved, plug-flow.
Optionally, second multi-medium data that first multi-medium data and second equipment are acquired carries out
Mixed processing obtains hybrid multimedia data, comprising:
First multi-medium data is decoded, decoded first multi-medium data is obtained;
The second media data that decoded first multi-medium data and second equipment acquire is mixed
Processing, obtains hybrid multimedia data.
It optionally, include: the first video data and/or the first audio data in second multi-medium data.
Optionally, in the case where include first video data in second multi-medium data, it is described will be described
First multi-medium data and the second media data of second equipment acquisition carry out mixed processing, comprising:
Data are shielded into the record and first video data carries out map overlay and/or splicing.
Optionally, first multi-medium data further includes the corresponding audio data of the record screen data;Described second
It is described to set first multi-medium data and described second in the case where including first audio data in multi-medium data
Second multi-medium data of standby acquisition carries out mixed processing, comprising:
The corresponding audio data of data is shielded into the record and first audio data carries out audio mixing and/or splicing.
Optionally, first multi-medium data for obtaining first equipment and being launched by screen mirror image function, comprising:
Construct screen mirror image recipient;
By the screen mirror image recipient, more than first matchmaker that first equipment is launched by screen mirror image function is received
Volume data.
The embodiment of the invention also provides a kind of multi-medium data playing devices, are applied in multimedia data play system
The second equipment, the multimedia system further includes the first equipment, and first equipment and second equipment are located at same office
In the net of domain, described device includes:
Obtain module, the first multi-medium data launched for obtaining first equipment by screen mirror image function;Its
In, it include the record screen data of first equipment in first multi-medium data;
Mixing module, for by first multi-medium data and second equipment acquisition the second multi-medium data into
Row mixed processing obtains hybrid multimedia data;
Processing module, for carrying out at least one of processing to hybrid multimedia data: playing, save, plug-flow.
Optionally, the mixing module is also used to be decoded first multi-medium data, obtains decoded
One multi-medium data;The second media data that decoded first multi-medium data and second equipment acquire is carried out
Mixed processing obtains hybrid multimedia data.
It optionally, include: the first video data and/or the first audio data in second multi-medium data.
Optionally, in the case where in second multi-medium data including the first video data, the mixing module, tool
Body is used for:
Data are shielded into the record and first video data carries out map overlay and/or splicing.
Optionally, first multi-medium data further includes the corresponding audio data of the record screen data;Described second
In the case where including the first audio data in multi-medium data, the mixing module is specifically used for:
The corresponding audio data of data is shielded into the record and first audio data carries out audio mixing and/or splicing.
Optionally, the acquisition module is specifically used for construction screen mirror image recipient;It is received by the screen mirror image
Side receives the first multi-medium data that first equipment is launched by screen mirror image function.
The embodiment of the invention also provides a kind of multimedia data play system, the system comprises: the first equipment and
Two equipment;First equipment and second equipment are located in same local area network, in which:
First equipment obtains record screen data for carrying out record screen to itself, and generating includes the of the record screen data
First multi-medium data is sent to second equipment by screen mirror image function by one multi-medium data;
Second equipment, the first multimedia number launched for obtaining first equipment by screen mirror image function
According to;The second multi-medium data that first multi-medium data and second equipment acquire is subjected to mixed processing, is mixed
Close multi-medium data;At least one of processing is carried out to hybrid multimedia data: being played, is saved, plug-flow.
The embodiment of the invention also provides a kind of electronic equipment, including processor, communication interface, memory and communication are total
Line, wherein processor, communication interface, memory complete mutual communication by communication bus;
Memory, for storing computer program;
Processor when for executing the program stored on memory, realizes that any of the above-described multi-medium data is broadcast
Put method.
The embodiment of the invention also provides a kind of computer program products comprising instruction, when it runs on computers
When, so that computer executes any of the above-described multimedia data playing method.
Present invention implementation additionally provides a kind of computer readable storage medium, stores in the computer readable storage medium
There is instruction, when run on a computer, so that computer executes any of the above-described multimedia data playing method.
The embodiment of the invention also provides a kind of computer program products comprising instruction, when it runs on computers
When, so that computer executes any of the above-described multimedia data playing method.
Multimedia data playing method, system and device provided in an embodiment of the present invention, being generated by the first equipment includes it
First multi-medium data of record screen data, and the first multi-medium data is thrown to by the second equipment by screen mirror image function;The
Two equipment obtain the first multi-medium data, and the first multi-medium data is carried out mixing place with the second multi-medium data that itself is acquired
Reason obtains hybrid multimedia data, and carries out at least one of processing to hybrid multimedia data: playing, saves, plug-flow;
As it can be seen that in the present solution, executing the equipment of record screen operation and playing out and/or save to multi-medium data and/or plug-flow is set
Standby is not same equipment, and in other words, same equipment does not need not only to execute record screen operation, but also plays out to multi-medium data
And/or save and/or plug-flow, to reduce the resources occupation rate of equipment.Certainly, it implements any of the products of the present invention or method
It does not necessarily require achieving all the advantages described above at the same time.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
In order to solve in the prior art, multi-medium data playback equipment need carry out record screen while, acquire voice or
Video data, and mixed processing and broadcasting are carried out to record screen data, collected voice or video data, so as to cause more matchmakers
The very high problem of the resources occupation rate of body equipment, the invention proposes a kind of multimedia data playing method, system and devices.
Multimedia data playing method provided in an embodiment of the present invention is illustrated on the whole below.
In a kind of implementation of the invention, above-mentioned multimedia data playing method is applied to multimedia data play system
In the second equipment, wherein multimedia system further includes the first equipment, and first equipment and second equipment are located at same
In local area network, this method comprises:
Obtain the first multi-medium data that first equipment is launched by screen mirror image function;Wherein, more than described first
It include the record screen data of first equipment in media data;
The second multi-medium data that first multi-medium data and second equipment acquire is subjected to mixed processing, is obtained
To hybrid multimedia data;
At least one of processing is carried out to hybrid multimedia data: being played, is saved, plug-flow.
As seen from the above, using multimedia data playing method provided in an embodiment of the present invention, setting for record screen operation is executed
It is standby with multi-medium data is played out and/or is saved and/or the equipment of plug-flow is not same equipment, in other words, same
Equipment does not need not only to execute record screen operation, but also plays out and/or save to multi-medium data and/or plug-flow, to reduce
The resources occupation rate of equipment.
Multimedia data playing method provided in an embodiment of the present invention will be carried out detailed by specific embodiment below
Description.
As shown in Figure 1, be a kind of flow diagram of multimedia data playing method provided in an embodiment of the present invention, including
Following steps:
S101: the first multi-medium data that the first equipment is launched by screen mirror image function is obtained;Wherein, the first multimedia
It include the record screen data of the first equipment in data.
This programme is applied to the second equipment in multimedia data play system, also wraps in the multimedia data play system
The first equipment is included, the first equipment is the equipment for installing IOS system, can be generated by Airplay (screen mirror image) function
Include record screen data the first multi-medium data be thrown to the second equipment.
For example, it is possible, firstly, to construct the recipient of an Airplay at the second equipment, is then turned on first and sets
Standby Airplay function selects reception of the Airplay recipient constructed at the second equipment as the first multi-medium data
Side, in this way, the first multi-medium data can be sent to constructed Airplay recipient, also by Airplay agreement
It is to say, the second equipment can get the first multi-medium data of the first equipment dispensing.
Wherein, the record screen data in the first multi-medium data refer to: the first equipment is when executing some business, to current screen
Image content (i.e. screen content) shown by curtain carries out recording obtained video data, which can be game service,
Content i.e. in record screen data can be game picture content;But it is not limited to this.
In addition, can also include the corresponding audio data of record screen data in the first multi-medium data, which can be with
It is the sound that the first equipment generates when doing business, such as audio, the background music of game, is also possible to the acquisition of the first equipment
The sound arrived, such as explanation etc. of the user to game.
In one implementation, it can show and prompt to user before the first equipment generates the first multi-medium data
Whether information is selected by users, determine comprising the corresponding audio data of record screen data in the first multi-medium data, alternatively,
The first equipment can also be configured by user in advance, whether include the corresponding audio of record screen data in the first multi-medium data
Data.
S102: the second multi-medium data that the first multi-medium data and the second equipment acquire is subjected to mixed processing, is obtained
Hybrid multimedia data.
Wherein, the step of the second multi-medium data of the second equipment acquisition can carry out simultaneously with S101, can also first carry out
S101, receives the first multi-medium data of the first equipment, then acquires the second multi-medium data, can also first acquire the second multimedia
Data, then S101 is executed, the first multi-medium data of the first equipment is received, it is not limited in the embodiment of the present invention.
In the second multi-medium data, the first video data and/or second including the camera acquisition by the second equipment
First audio data of the microphone acquisition of equipment.In the present embodiment, for the convenience of description, the camera of the second equipment is acquired
Video data be known as the first video data, the audio data that the microphone of the second equipment acquires is known as the first audio data.
For example, the first video data of acquisition or the first audio data can be determined, also according to the instruction of user
It is both to acquire.For example, analysis identification is carried out to acquired acquisition instructions it is possible, firstly, to obtain the acquisition instructions of user,
If acquisition instructions are video acquisition instruction, the camera of the second equipment is utilized, acquires the first video data, if acquisition refers to
Enabling is frequency acquisition instructions, then utilizes the microphone of the second equipment, acquires the first audio data.
After collecting the second multi-medium data, so that it may carry out the first multi-medium data and the second multi-medium data
Mixed processing obtains hybrid multimedia data.
It for example, can be according to the difference of the first multi-medium data and the second multi-medium data, using different mixing
Processing strategie, for example, in the case where including the first video data in the second multi-medium data, it can will be by the first multimedia number
Record screen data and the first video data in carry out map overlay and/or splicing;Further include in the first multi-medium data
The corresponding audio data of record screen data, and including that record can be shielded in the case where the first audio data in the second multi-medium data
The corresponding audio data of data and the first audio data carry out audio mixing and/or splicing, etc..
Alternatively, can also determine mixed processing strategy according to the mixed instruction of user, targetedly only handle video data
Or only handle audio data.For example, judging that acquired mixed instruction is video it is possible, firstly, to obtain the mixed instruction of user
Mixed instruction or audio mix instruction or audio-video mixed instruction in turn can be according to different mixed instructions, to the
One multi-medium data and audio and/or video data progress mixed processing in the second multi-medium data.
In a kind of implementation, the first multi-medium data that the first equipment is thrown in the second equipment is by encrypting and compiling
Data after translating, in this case, the second equipment needs are first decoded the first multi-medium data received, obtain
Then decoded first multi-medium data just can be mixed processing, obtain hybrid multimedia data.
It wherein, include mixed video data in hybrid multimedia data, mixed video data can be record screen data, can also
To be that record screen data and the first video data carry out the data obtained after mixed processing, mixed video data can be yuv format
Data or rgb format data etc..
For example, mixed video data can be obtained by the first video data overlay to the picture upper right corner of record screen data;Or
Person can splice the first video data and record screen data, and picture top is divided into the first video data, and picture lower part is divided into
Record screen data, obtain mixed video data, etc..
In addition, can also include mixing audio data in hybrid multimedia data, mixing audio data can be record screen number
According to corresponding audio data, it is also possible to second audio data, can also be the corresponding audio data of record screen data and the second sound
For frequency according to the data obtain after mixed processing, mixing audio data can be for based on PCM (Pulse Code
Modulation, pulse code modulation) WAV data, WMA (Windows Media Audio, windows media audio) data etc.
Deng.
For example, the first audio data audio data corresponding with record screen data can be carried out audio mixing, by two audio numbers
According to being mixed into each audio data;Alternatively, being sheared to the first audio data audio data corresponding with record screen data
And splicing, audio data required for only retaining in mixing audio data, etc..
In a kind of situation, mixed video data and mixing audio data can be packaged, to obtain mixing more matchmakers
Volume data, hybrid multimedia data can be FLV (FLASH VIDEO, stream media format) data, AVI (Audio Video
Interleaved, Audio Video Interleaved format) data etc..
Further, in addition to the first multi-medium data and the second multi-medium data, in addition the second equipment can also receive one
A or multiple third multi-medium datas, and can be by the first multi-medium data, the second multi-medium data and one or more the
Three multi-medium datas carry out mixed processing, obtain hybrid multimedia data.
In this way, can make multimedia data play system can be applied to it is more complicated in the case where, obtain richer
Multi-medium data result of broadcast.
S103: at least one of processing is carried out to hybrid multimedia data: being played, is saved, plug-flow.
For example, it can be and hybrid multimedia data be directly broadcast live by the second equipment, for example, passing through RTMP (Real
Time Messaging Protocol, real-time messages transport protocol) it is broadcast live;Alternatively, can also be first to hybrid multimedia number
According to being stored, the play instruction of user is waited, after receiving play instruction, then plays hybrid multimedia data;Alternatively, also
Can by hybrid multimedia data plug-flow in the other equipment into multimedia data play system, then by other equipment play to
Play multi-medium data;It is not limited in the embodiment of the present invention.
As seen from the above, using multimedia data playing method provided in an embodiment of the present invention, setting for record screen operation is executed
It is standby with multi-medium data is played out and/or is saved and/or the equipment of plug-flow is not same equipment, in other words, same
Equipment does not need not only to execute record screen operation, but also plays out and/or save to multi-medium data and/or plug-flow, to reduce
The resources occupation rate of equipment.
For example, in existing some schemes, operating system is the multi-medium data playback equipment of IOS system, is needed
The recipient that Airplay is constructed in equipment itself, during carrying out record screen, the conduct simultaneously of multi-medium data playback equipment
Sender, the recipient of Airplay, resources occupation rate are very high.For example, multi-medium data broadcasting is set when carrying out game live streaming
It is standby to need while carry out game, send Airplay data, receive Airplay data, acquisition multi-medium data, multimedia
The multiple functions such as data mixing broadcasting.
And multimedia data playing method provided in an embodiment of the present invention is applied, it can be constructed in the second equipment
The recipient of Airplay executes it by the second equipment in this way, the first equipment can only carry out game, send Airplay data
His step, to further reduce the resources occupation rate of the equipment in multimedia data play system.
As shown in Fig. 2, for a kind of another process signal of multimedia data playing method provided in an embodiment of the present invention
Figure, includes the following steps:
S201: the first multi-medium data that the first equipment is launched by screen mirror image function is obtained;Wherein, the first multimedia
It include the record screen data of the first equipment in data.
This programme is applied to the second equipment in multimedia data play system, also wraps in the multimedia data play system
The first equipment is included, the first equipment is the equipment for installing IOS system, can be generated by Airplay (screen mirror image) function
Include record screen data the first multi-medium data be thrown to the second equipment.
For example, it is possible, firstly, to construct the recipient of an Airplay at the second equipment, is then turned on first and sets
Standby Airplay function selects reception of the Airplay recipient constructed at the second equipment as the first multi-medium data
Side, in this way, the first multi-medium data can be sent to constructed Airplay recipient, also by Airplay agreement
It is to say, the second equipment can get the first multi-medium data of the first equipment dispensing.
Wherein, the record screen data in the first multi-medium data refer to: the first equipment is when executing some business, to current screen
Image content (i.e. screen content) shown by curtain carries out recording obtained video data, which can be game service,
Content i.e. in record screen data can be game picture content.
In addition, can also include the corresponding audio data of record screen data in the first multi-medium data, which can be with
It is the sound that the first equipment generates when doing business, such as audio, the background music of game, is also possible to the acquisition of the first equipment
The sound arrived, such as explanation etc. of the user to game.
In one implementation, it can show and prompt to user before the first equipment generates the first multi-medium data
Whether information is selected by users, determine comprising the corresponding audio data of record screen data in the first multi-medium data, alternatively,
The first equipment can also be configured by user in advance, whether include the corresponding audio of record screen data in the first multi-medium data
Data.
S202: the second multi-medium data of acquisition, wherein include: the first audio data and/or the in the second multi-medium data
One video data.
The step can carry out simultaneously with S201, can also first carry out S201, receive the first multimedia number of the first equipment
According to, then the second multi-medium data is acquired, the second multi-medium data can also be first acquired, then execute S201, receive the first equipment
First multi-medium data, it is not limited in the embodiment of the present invention.
For example, the first video data of acquisition or the first audio data can be determined, also according to the instruction of user
It is both to acquire.For example, analysis identification is carried out to acquired acquisition instructions it is possible, firstly, to obtain the acquisition instructions of user,
If acquisition instructions are video acquisition instruction, the camera of the second equipment is utilized, acquires the first video data, if acquisition refers to
Enabling is frequency acquisition instructions, then utilizes the microphone of the second equipment, acquires the first audio data.
S203:, will record screen data and the first video in the case where in the second multi-medium data including the first video data
Data carry out map overlay and/or splicing;Alternatively, further including the corresponding audio number of record screen data in the first multi-medium data
According to, and including in the case where the first audio data, the corresponding audio data of data and first are shielded in record in the second multi-medium data
Audio data carries out audio mixing and/or splicing.
In a kind of implementation, the first multi-medium data that the first equipment is thrown in the second equipment is by encrypting and compiling
Data after translating, in this case, the second equipment needs are first decoded the first multi-medium data received, obtain
Then decoded first multi-medium data just can be mixed processing, obtain hybrid multimedia data.
It wherein, include mixed video data in hybrid multimedia data, mixed video data can be record screen data, can also
To be that record screen data and the first video data carry out the data obtained after mixed processing, mixed video data can be yuv format
Data or rgb format data etc..
For example, mixed video data can be obtained by the first video data overlay to the picture upper right corner of record screen data;Or
Person can splice the first video data and record screen data, and picture top is divided into the first video data, and picture lower part is divided into
Record screen data, obtain mixed video data, etc..
In addition, can also include mixing audio data in hybrid multimedia data, mixing audio data can be record screen number
According to corresponding audio data, it is also possible to second audio data, can also be the corresponding audio data of record screen data and the second sound
For frequency according to the data obtain after mixed processing, mixing audio data can be for based on PCM (Pulse Code
Modulation, pulse code modulation) WAV data, WMA (Windows Media Audio, windows media audio) data etc.
Deng.
For example, the first audio data audio data corresponding with record screen data can be carried out audio mixing, by two audio numbers
According to being mixed into each audio data;Alternatively, being sheared to the first audio data audio data corresponding with record screen data
And splicing, audio data required for only retaining in mixing audio data, etc..
In a kind of situation, mixed video data and mixing audio data can be packaged, to obtain mixing more matchmakers
Volume data, hybrid multimedia data can be FLV (FLASH VIDEO, stream media format) data, AVI (Audio Video
Interleaved, Audio Video Interleaved format) data etc..
Further, in addition to the first multi-medium data and the second multi-medium data, in addition the second equipment can also receive one
A or multiple third multi-medium datas, and can be by the first multi-medium data, the second multi-medium data and one or more the
Three multi-medium datas carry out mixed processing, obtain hybrid multimedia data.
In this way, can make multimedia data play system can be applied to it is more complicated in the case where, obtain richer
Multi-medium data result of broadcast.
S204: at least one of processing is carried out to hybrid multimedia data: being played, is saved, plug-flow.
For example, it can be and hybrid multimedia data be directly broadcast live by the second equipment, for example, passing through RTMP (Real
Time Messaging Protocol, real-time messages transport protocol) it is broadcast live;Alternatively, can also be first to hybrid multimedia number
According to being stored, the play instruction of user is waited, after receiving play instruction, then plays hybrid multimedia data;Alternatively, also
Can by hybrid multimedia data plug-flow in the other equipment into multimedia data play system, then by other equipment play to
Play multi-medium data;It is not limited in the embodiment of the present invention.
As seen from the above, using multimedia data playing method provided in an embodiment of the present invention, setting for record screen operation is executed
It is standby with multi-medium data is played out and/or is saved and/or the equipment of plug-flow is not same equipment, in other words, same
Equipment does not need not only to execute record screen operation, but also plays out and/or save to multi-medium data and/or plug-flow, to reduce
The resources occupation rate of equipment.
As shown in figure 3, be a kind of specific implementation of multimedia data playing method provided in an embodiment of the present invention
Schematic diagram.
Firstly, realizing the first multi-medium data for receiving the first equipment by Airplay (screen mirror image) function.Specifically
, it is possible, firstly, to construct the recipient of an Airplay at the second equipment, it is then turned on the Airplay function of the first equipment
Can, recipient of the Airplay recipient constructed at the second equipment as the first multi-medium data is selected, in this way, passing through
First multi-medium data can be sent to constructed Airplay recipient, that is to say, that the second equipment by Airplay agreement
The first multi-medium data of the first equipment dispensing can be got.
Then, the second equipment acquires the first video data by camera, acquires the first audio data by microphone, will
Record screen data and the first video data carry out map overlay, obtain mixed video data, by the corresponding audio data of record screen data
Audio mixing is carried out with the first audio data, mixing audio data is obtained, mixed video data and mixing audio data is packaged,
To obtain hybrid multimedia data.
Then, hybrid multimedia data are transmitted to by server by RTMP agreement, in this way, other equipment can lead to
It crosses server and obtains hybrid multimedia data, to realize the live streaming to hybrid multimedia data.
As shown in figure 4, being a kind of structural schematic diagram of multi-medium data playing device provided in an embodiment of the present invention, the dress
The second equipment being applied in multimedia data play system is set, the multimedia system further includes the first equipment, and described first
Equipment and second equipment are located in same local area network, which includes:
Obtain module 410, the first multi-medium data launched for obtaining first equipment by screen mirror image function;
It wherein, include the record screen data of first equipment in first multi-medium data;
Mixing module 420, the second multimedia number for acquiring first multi-medium data and second equipment
According to mixed processing is carried out, hybrid multimedia data are obtained;
Processing module 430, for carrying out at least one of processing to hybrid multimedia data: playing, save, plug-flow.
In a kind of implementation, the mixing module 420 is also used to be decoded first multi-medium data, obtain
To decoded first multi-medium data;Second that decoded first multi-medium data and second equipment are acquired
Media data carries out mixed processing, obtains hybrid multimedia data.
It include: the first video data and/or the first audio number in second multi-medium data in a kind of implementation
According to.
It is described mixed in the case where in second multi-medium data including the first video data in a kind of implementation
Block 420 is molded, is specifically used for:
Data are shielded into the record and first video data carries out map overlay and/or splicing.
In a kind of implementation, first multi-medium data further includes the corresponding audio data of the record screen data;?
In the case where including the first audio data in second multi-medium data, the mixing module 420 is specifically used for:
The corresponding audio data of data is shielded into the record and first audio data carries out audio mixing and/or splicing.
In a kind of implementation, the acquisition module 410 is specifically used for construction screen mirror image recipient;Pass through the screen
Curtain mirror image recipient receives the first multi-medium data that first equipment is launched by screen mirror image function.
As seen from the above, using multi-medium data playing device provided in an embodiment of the present invention, setting for record screen operation is executed
It is standby with multi-medium data is played out and/or is saved and/or the equipment of plug-flow is not same equipment, in other words, same
Equipment does not need not only to execute record screen operation, but also plays out and/or save to multi-medium data and/or plug-flow, to reduce
The resources occupation rate of equipment.
The embodiment of the invention also provides a kind of multimedia data play system, which includes: the first equipment and second
Equipment, first equipment and second equipment are located in same local area network.As shown in figure 5, being provided for the embodiment of the present invention
Multimedia data play system play multi-medium data a kind of flow diagram, include the following steps:
S501: the first equipment carries out record screen to itself, obtains record screen data, and generating includes more than the first of the record screen data
Media data.
Wherein, the record screen data in the first multi-medium data refer to: the first equipment is when executing some business, to current screen
Image content (i.e. screen content) shown by curtain carries out recording obtained video data, which can be game service,
Content i.e. in record screen data can be game picture content.
In addition, can also include the corresponding audio data of record screen data in the first multi-medium data, which can be with
It is the sound that the first equipment generates when doing business, such as audio, the background music of game, is also possible to the acquisition of the first equipment
The sound arrived, such as explanation etc. of the user to game.
In one implementation, it can show and prompt to user before the first equipment generates the first multi-medium data
Whether information is selected by users, determine comprising the corresponding audio data of record screen data in the first multi-medium data, alternatively,
The first equipment can also be configured by user in advance, whether include the corresponding audio of record screen data in the first multi-medium data
Data.
First multi-medium data is sent to second equipment by screen mirror image function by the S502: the first equipment.
For example, it is possible, firstly, to construct the recipient of an Airplay at the second equipment, is then turned on first and sets
Standby Airplay function selects reception of the Airplay recipient constructed at the second equipment as the first multi-medium data
Side, in this way, the first multi-medium data can be sent to constructed Airplay recipient, also by Airplay agreement
It is to say, the second equipment can get the first multi-medium data of the first equipment dispensing.
S503: the second equipment obtains the first multi-medium data that first equipment is launched by screen mirror image function.
S504: the second multi-medium data that first multi-medium data and second equipment acquire is carried out at mixing
Reason, obtains hybrid multimedia data.
Wherein, the step of the second multi-medium data of the second equipment acquisition can carry out simultaneously with S503, can also first carry out
S503, receives the first multi-medium data of the first equipment, then acquires the second multi-medium data, can also first acquire the second multimedia
Data, then S503 is executed, the first multi-medium data of the first equipment is received, it is not limited in the embodiment of the present invention.
In the second multi-medium data, the first video data and/or second including the camera acquisition by the second equipment
First audio data of the microphone acquisition of equipment.In the present embodiment, for the convenience of description, the camera of the second equipment is acquired
Video data be known as the first video data, the audio data that the microphone of the second equipment acquires is known as the first audio data.
For example, the first video data of acquisition or the first audio data can be determined, also according to the instruction of user
It is both to acquire.For example, analysis identification is carried out to acquired acquisition instructions it is possible, firstly, to obtain the acquisition instructions of user,
If acquisition instructions are video acquisition instruction, the camera of the second equipment is utilized, acquires the first video data, if acquisition refers to
Enabling is frequency acquisition instructions, then utilizes the microphone of the second equipment, acquires the first audio data.
After collecting the second multi-medium data, so that it may carry out the first multi-medium data and the second multi-medium data
Mixed processing obtains hybrid multimedia data.
It for example, can be according to the difference of the first multi-medium data and the second multi-medium data, using different mixing
Processing strategie, for example, in the case where including the first video data in the second multi-medium data, it can will be by the first multimedia number
Record screen data and the first video data in carry out map overlay and/or splicing;Further include in the first multi-medium data
The corresponding audio data of record screen data, and including that record can be shielded in the case where the first audio data in the second multi-medium data
The corresponding audio data of data and the first audio data carry out audio mixing and/or splicing, etc..
Alternatively, can also determine mixed processing strategy according to the mixed instruction of user, targetedly only handle video data
Or only handle audio data.For example, judging that acquired mixed instruction is video it is possible, firstly, to obtain the mixed instruction of user
Mixed instruction or audio mix instruction or audio-video mixed instruction in turn can be according to different mixed instructions, to the
One multi-medium data and audio and/or video data progress mixed processing in the second multi-medium data.
In a kind of implementation, the first multi-medium data that the first equipment is thrown in the second equipment is by encrypting and compiling
Data after translating, in this case, the second equipment needs are first decoded the first multi-medium data received, obtain
Then decoded first multi-medium data just can be mixed processing, obtain hybrid multimedia data.
It wherein, include mixed video data in hybrid multimedia data, mixed video data can be record screen data, can also
To be that record screen data and the first video data carry out the data obtained after mixed processing, mixed video data can be yuv format
Data or rgb format data etc..
For example, mixed video data can be obtained by the first video data overlay to the picture upper right corner of record screen data;Or
Person can splice the first video data and record screen data, and picture top is divided into the first video data, and picture lower part is divided into
Record screen data, obtain mixed video data, etc..
In addition, can also include mixing audio data in hybrid multimedia data, mixing audio data can be record screen number
According to corresponding audio data, it is also possible to second audio data, can also be the corresponding audio data of record screen data and the second sound
For frequency according to the data obtain after mixed processing, mixing audio data can be for based on PCM (Pulse Code
Modulation, pulse code modulation) WAV data, WMA (Windows Media Audio, windows media audio) data etc.
Deng.
For example, the first audio data audio data corresponding with record screen data can be carried out audio mixing, by two audio numbers
According to being mixed into each audio data;Alternatively, being sheared to the first audio data audio data corresponding with record screen data
And splicing, audio data required for only retaining in mixing audio data, etc..
In a kind of situation, mixed video data and mixing audio data can be packaged, to obtain mixing more matchmakers
Volume data, hybrid multimedia data can be FLV (FLASH VIDEO, stream media format) data, AVI (Audio Video
Interleaved, Audio Video Interleaved format) data etc..
Further, in addition to the first multi-medium data and the second multi-medium data, in addition the second equipment can also receive one
A or multiple third multi-medium datas, and can be by the first multi-medium data, the second multi-medium data and one or more the
Three multi-medium datas carry out mixed processing, obtain hybrid multimedia data.
In this way, can make multimedia data play system can be applied to it is more complicated in the case where, obtain richer
Multi-medium data result of broadcast.
S505: the second equipment carries out at least one of processing to hybrid multimedia data: playing, saves, plug-flow.
For example, it can be and hybrid multimedia data be directly broadcast live by the second equipment, for example, passing through RTMP (Real
Time Messaging Protocol, real-time messages transport protocol) it is broadcast live;Alternatively, can also be first to hybrid multimedia number
According to being stored, the play instruction of user is waited, after receiving play instruction, then plays hybrid multimedia data;Alternatively, also
Can by hybrid multimedia data plug-flow in the other equipment into multimedia data play system, then by other equipment play to
Play multi-medium data;It is not limited in the embodiment of the present invention.
As seen from the above, using multimedia data playing method provided in an embodiment of the present invention, setting for record screen operation is executed
It is standby with multi-medium data is played out and/or is saved and/or the equipment of plug-flow is not same equipment, in other words, same
Equipment does not need not only to execute record screen operation, but also plays out and/or save to multi-medium data and/or plug-flow, to reduce
The resources occupation rate of equipment.
The embodiment of the invention also provides a kind of electronic equipment, as shown in fig. 6, include processor 601, communication interface 602,
Memory 603 and communication bus 604, wherein processor 601, communication interface 602, memory 603 are complete by communication bus 604
At mutual communication,
Memory 603, for storing computer program;
Processor 601 when for executing the program stored on memory 603, is realized any described in above-described embodiment
Multimedia data playing method;
In an embodiment of the invention, following steps may be implemented:
Obtain the first multi-medium data that first equipment is launched by screen mirror image function;Wherein, more than described first
It include the record screen data of first equipment in media data;
The second multi-medium data that first multi-medium data and second equipment acquire is subjected to mixed processing, is obtained
To hybrid multimedia data;
At least one of processing is carried out to hybrid multimedia data: being played, is saved, plug-flow.
The communication bus that above-mentioned electronic equipment is mentioned can be Peripheral Component Interconnect standard (Peripheral Component
Interconnect, PCI) bus or expanding the industrial standard structure (Extended Industry Standard
Architecture, EISA) bus etc..The communication bus can be divided into address bus, data/address bus, control bus etc..For just
It is only indicated with a thick line in expression, figure, it is not intended that an only bus or a type of bus.
Communication interface is for the communication between above-mentioned electronic equipment and other equipment.
Memory may include random access memory (Random Access Memory, RAM), also may include non-easy
The property lost memory (Non-Volatile Memory, NVM), for example, at least a magnetic disk storage.Optionally, memory may be used also
To be storage device that at least one is located remotely from aforementioned processor.
Above-mentioned processor can be general processor, including central processing unit (Central Processing Unit,
CPU), network processing unit (Network Processor, NP) etc.;It can also be digital signal processor (Digital Signal
Processing, DSP), it is specific integrated circuit (Application Specific Integrated Circuit, ASIC), existing
It is field programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic device, discrete
Door or transistor logic, discrete hardware components.
As seen from the above, using multi-medium data playing device provided in an embodiment of the present invention, setting for record screen operation is executed
It is standby with multi-medium data is played out and/or is saved and/or the equipment of plug-flow is not same equipment, in other words, same
Equipment does not need not only to execute record screen operation, but also plays out and/or save to multi-medium data and/or plug-flow, to reduce
The resources occupation rate of equipment.
In another embodiment provided by the invention, a kind of computer readable storage medium is additionally provided, which can
It reads to be stored with instruction in storage medium, when run on a computer, so that computer executes any institute in above-described embodiment
The multimedia data playing method stated.
In another embodiment provided by the invention, a kind of computer program product comprising instruction is additionally provided, when it
When running on computers, so that computer executes any multimedia data playing method in above-described embodiment.
In the above-described embodiments, can come wholly or partly by software, hardware, firmware or any combination thereof real
It is existing.When implemented in software, it can entirely or partly realize in the form of a computer program product.The computer program
Product includes one or more computer instructions.When loading on computers and executing the computer program instructions, all or
It partly generates according to process or function described in the embodiment of the present invention.The computer can be general purpose computer, dedicated meter
Calculation machine, computer network or other programmable devices.The computer instruction can store in computer readable storage medium
In, or from a computer readable storage medium to the transmission of another computer readable storage medium, for example, the computer
Instruction can pass through wired (such as coaxial cable, optical fiber, number from a web-site, computer, server or data center
User's line (DSL)) or wireless (such as infrared, wireless, microwave etc.) mode to another web-site, computer, server or
Data center is transmitted.The computer readable storage medium can be any usable medium that computer can access or
It is comprising data storage devices such as one or more usable mediums integrated server, data centers.The usable medium can be with
It is magnetic medium, (for example, floppy disk, hard disk, tape), optical medium (for example, DVD) or semiconductor medium (such as solid state hard disk
SolidState Disk (SSD)) etc..
It should be noted that, in this document, relational terms such as first and second and the like are used merely to a reality
Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation
In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to
Non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those
Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
There is also other identical elements in process, method, article or equipment including the element.
Each embodiment in this specification is all made of relevant mode and describes, same and similar portion between each embodiment
Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for device reality
For applying example, system embodiment, electronic equipment embodiment and storage medium embodiment, implement since it is substantially similar to method
Example, so being described relatively simple, the relevent part can refer to the partial explaination of embodiments of method.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all
Any modification, equivalent replacement, improvement and so within the spirit and principles in the present invention, are all contained in protection scope of the present invention
It is interior.