CN105142008B - A method of playing second terminal data using first terminal - Google Patents

Abstract

The present invention proposes a method for using a first terminal to play data of a second terminal, including: the first terminal including the first operating system publishes an Air Play service through the multicast domain name system; the service also includes a port number. The second terminal including the second operating system performs an Air Play connection with the first terminal through the service published by the first terminal. When the second terminal performs the Air Play connection, the first terminal receives and plays the data transmitted through the Air Play connection through the port specified by the port number. A multicast domain name system broadcast is sent by the first terminal. Thus, the second terminal can discover the service released by the first terminal and connect with the first terminal. Thus, the multi-screen interaction between the first terminal and the second terminal is realized, and the real-time sharing of data such as pictures, audio, video, and mirroring is realized between the first terminal and the second terminal.

Description

A method of using a first terminal to play data from a second terminal

technical field

The present invention relates to the technical field of wireless transmission methods, in particular to a method for using a first terminal to play data from a second terminal.

Background technique

Everyone in modern life has a mobile terminal device, and these mobile devices may come from different mobile manufacturers, such as Apple's iOS device, Samsung's Android (Android) device and so on. How to achieve multi-screen interaction between iOS devices and Android devices, how to transfer related content between different devices and call the services provided by the devices, and how to realize the sharing of media files between devices are the main purposes of the research.

Since 2011, Apple has launched a function to allow users to share multimedia files such as pictures, audio and video content on devices such as iPhone (Apple mobile phone) and iPad (Apple tablet computer) to Apple TV for users to watch, providing a good user experience. viewing experience. However, because Apple TV is a high-end electronic product in the market, it has a relatively high price threshold, which deters a large number of consumers. The Android smart TV with relatively high cost performance has been favored by a large number of smart TV users. However, in the mobile terminal, a large number of Apple users cannot share the pictures, audio and video data of their mobile phones to the Android smart TV (big screen), so as to realize the sharing and interaction between the big screen and the small screen.

AirPlay is a communication protocol based on wireless technology proposed by Apple. Using the AirPlay protocol, users can simply wirelessly transmit data on iOS devices, including pictures, audio, video, and mirror images, to devices that support the protocol through WiFi (wireless network). The functions of AirPlay and DLNA are similar, both are based on wireless screen transmission. But AirPlay also has a mirror function, which is similar to the Miracast function supported by Android 4.2, that is, it can directly project the mirror image of one device to another device for display, which is not available in DLNA. The mirroring function of AirPlay can wirelessly transmit the screens on iPhone, iPad and other devices to other devices. In other words, what is displayed on the shared device is what is displayed on the shared device, not just pictures and videos. Users can also hold the iOS device as a steering wheel for racing games, and then watch the game on the big screen. However, AirPlay mirroring has relatively high requirements on hardware devices.

Contents of the invention

In order to solve the problem of multi-screen interaction between the first terminal and the second terminal in the prior art, the present invention provides a method for playing data of the second terminal by using the first terminal. Thus, the second terminal can be connected with the first terminal, and the content of the second terminal can be projected onto the first terminal.

In the first aspect, in order to achieve the above object, the present invention provides a method for using the first terminal to play the data of the second terminal, including:

The first terminal including the first operating system publishes the Air Play service through the multicast domain name system; the service also includes a port number;

The second terminal including the second operating system performs an AirPlay connection with the first terminal through the service published by the first terminal;

When the second terminal performs the Air Play connection, the first terminal receives and plays the data transmitted through the Air Play connection through the port specified by the port number.

In a first possible implementation manner of the first aspect, the data played by the first terminal is one or more of audio, video, and image.

In a second possible implementation manner of the first aspect, the parameters of the Air Play service released by the first terminal include parameters of the Air Tunes service Apple music service and Air Play service Apple video service parameters.

In combination with the third possible implementation of the first aspect, in the fourth possible implementation, the two published Air Play services need to be named before publishing the service; the names of the two services must be same.

In a fifth possible implementation manner of the first aspect, the port numbers include 3; the 3 port numbers include 1 fixed port number and 2 arbitrary port numbers.

In combination with the fifth possible implementation of the first aspect, in the sixth possible implementation, the fixed port number is the 7100 port number used for mirroring transmission, and the two arbitrary port numbers are respectively used for video and the port number for audio transmission.

In the seventh possible implementation manner of the first aspect, the data played by the Air Play connection is audio, and the audio playing step includes:

The first terminal obtains audio information;

The first terminal establishes a server for transmission, and establishes a channel for dialogue with the second terminal in the server;

The first terminal receives the audio data and decodes it through the established server.

In the eighth possible implementation manner of the first aspect, the data played by the Air Play connection is a video, and the steps of playing the video include:

The first terminal receives a video play request sent by the second terminal, and the request includes information about the corresponding video;

The first terminal sends related information of the first terminal, where the related information includes a network card address;

The first terminal receives and plays corresponding video data.

In the ninth possible implementation manner of the first aspect, the data played by the Air Play connection is a picture, and the step of playing the picture includes:

The first terminal receives the request sent by the second terminal, where the request includes information about the corresponding picture;

The first terminal receives the picture data, and uses the information of the picture to decode the picture data.

In the tenth possible implementation manner of the first aspect, the data played by the Air Play connection is a mirror image, and the mirror playback step includes:

The first terminal receives the encrypted information sent by the second terminal;

The first terminal decrypts the encrypted information, and sends the decrypted information to the second terminal;

The first terminal sends relevant information of the first terminal device to the second terminal;

The first terminal receives and plays the image data sent by the second terminal.

The invention provides a method for playing data of a second terminal by using a first terminal. A multicast domain name system broadcast is sent by using the first terminal, and the broadcast includes service parameters and ports. The published services include AirTunes service and Air Play Service. Thus, the second terminal can discover the service published by the first terminal and connect with the first terminal. In the service released by the first terminal, the port number is also included. Thus, the multi-screen interaction between the first terminal and the second terminal is realized, and the Air Play protocol is used as a tool for real-time transmission and sharing of data such as pictures, audio, video, and mirror images between the first terminal and the second terminal.

Description of drawings

Fig. 1 is a kind of connection method diagram of Android client and iOS device of the specific embodiment of the present invention;

Fig. 2 is a schematic diagram of a connection method of different services between an iOS device and an Android client according to a specific embodiment of the present invention;

Fig. 3 is a kind of flowchart of playing method of iOS device based on Android client according to the specific embodiment of the present invention.

Detailed ways

The technical solutions of the present invention will be described in further detail below with reference to the accompanying drawings and embodiments.

In a specific embodiment of the present invention, the first terminal is a device with an Android operating system, referred to as an Android client for short. The second terminal is a device with an iOS operating system, referred to as an iOS device for short. The present invention is based on the problem in the prior art that the iOS device (the second terminal) and the Android client (the first terminal) cannot interact with each other on multiple screens. A method is proposed to enable the content of iOS devices to be shared on Android clients, thereby realizing the multi-screen interaction between iOS devices and Android clients. On the iOS device (the second terminal) of the present invention, the iOS system (the second operating system) is set, and on the Android client (the first terminal), the Android system (the first operating system) is set.

Below the part English that enumerates in the specific embodiment of the present invention is explained:

jmDNS: adopts the multicast domain name system described by java;

AirTunes service: Apple music service;

AirPlay service: Apple video service;

AirPlay: Apple wireless connection technology;

iOS: Apple (iOS) operating system;

Fair Play: an encryption algorithm;

Netty: a network protocol;

mDNS: Multicast Domain Name System.

FIG. 1 is a connection method between an Android client and an iOS device in a specific embodiment of the present invention. A kind of connection method figure of Android client and iOS device of specific embodiment as shown in Figure 1, comprises the steps:

The Android client publishes Air Play services; the services include Air Tunes service and Air Playservice.

The Android client release service specifically also includes connecting the Android client to a WiFi environment. When the Android client opens the application, the Android client will issue an instruction to send an mDNS (Multicast Domain Name System) broadcast to devices in the LAN. Broadcast distribution is performed by using jmDNS. The service it publishes is Air Play, which includes two services, Air Tunes service and Air Play service, and specific parameters and ports are also included in the two services. For the AirTunesservice service, the parameters included are shown in Table 1. For the AirPlay service, the parameters included are shown in Table 2.

The specific embodiments of the present invention are not limited to the contents of Table 1 and Table 2. In Table 1, the pw item can be filled with false or true, where false means no password is used, and true means password is used. The item am is the device name of the client, which can be filled in AppleTV1 (Apple TV 1) or AppleTV2 (Apple TV 2), and AppleTV1 or AppleTV2 can be filled in arbitrarily. The tp item is the adopted network transmission protocol, including TCP protocol or UDP protocol. Although the UDP protocol is selected in the specific embodiment of the present invention, the TCP protocol is also applicable here. In Table 2, deviceid is the address of the network card, so that the iOS device and the Android client can realize network transmission.

Before issuing commands through jmDNS, it is necessary to name the two Air Play services to be published. The two published service names must be the same. At the same time, the format must also be: MAC address+@+others. That is to say, the beginning of the name must be the address of the network card, and the suffix after it can be arbitrary. Use "@" to separate the address of the network card and the suffix.

Table 1 Air Tunes service

Table 2 AirPlay service

The iOS device is connected to the Android client through the service published by the Android client.

When the Air Play function is enabled on an iOS device, the iOS device can search for services published by the Android client. Through the published Air Play service parameters, the iOS device will verify and set the parameters. In this way, the iOS device is connected with the Android client, and corresponding data transmission is performed.

When the iOS device is connected to the Android client, it also includes connecting one of the three ports, and the three ports correspond to mirroring, audio and video respectively. When transferring and playing video files between the iOS device and the Android client, the connection is the video port. When image files are transmitted and played between the iOS device and the Android client, the connected port is a video port. When audio files are transmitted and played between the iOS device and the Android client, the connected port is an audio port. When the mirror file is transmitted and played between the iOS device and the Android client, the port connected is the mirror port

When the iOS device is connected with AirPlay, it transmits data with the Android client through the bound port.

The two published services correspond to different ports. In a specific embodiment of the present invention, the port number corresponding to the AirTunes service is 5000, and the port number corresponding to the AirPlay Service is 7000. The third port is a fixed port, and the fixed port is 7100. When the transmitted content is audio, the connected port is 5000. When the transmitted content is video, the connection port is 7000. When the transmitted content is a mirror image, the connection port is 7100. The port corresponding to the AirTunes service is an audio transmission port, the port corresponding to the AirPlay Service is a video transmission port, and the port corresponding to the fixed port is a mirroring transmission port. Use Netty to monitor the port, so that the content sent by the iOS device can be played to the Android client in real time. Netty is a Java open source framework protocol for rapid development of high-performance, high-reliability web server and client programs.

Fig. 2 is a schematic diagram of a connection method of different playback types between an iOS device and an Android client according to a specific embodiment of the present invention. As shown in Figure 2, a connection method diagram of different playback types in the transmission process between an iOS device and an Android client in a specific embodiment of the present invention, when the connection between the iOS device and the Android client is completed, the corresponding data transmission and connection are performed. play. The iOS device and the Android client are connected through the Air Play protocol to transmit audio, video and image files. And play audio, video and image files on the Android client.

A kind of Android client and iOS device playing method of the specific embodiment of the present invention as shown in Figure 3, comprise the playing of audio frequency, the playing of video and the playing of mirror image. In this way, the audio, video and image files on the iOS device can be displayed or played on the iOS client, so as to obtain a better user experience.

Music player

When the connection between the iOS device and the Android client is completed, it also includes connecting to the corresponding port. When playing audio, the connected port number is 5000.

When the Android client receives the audio playback signal sent by the iOS device, the Android client will establish a streaming media server. And obtain various attribute information of the audio from the iOS device. The streaming server is an RTSP server.

When the Android client completes the above steps, the Android client will return a signal to the iOS device, and the returned signal is:

"RTSP/1.0 200 OK

Server: AirTunes/130.14

CSeq: 27”

After the iOS device receives the return signal from the Android client, the iOS device will order the Android client to establish a channel (record session ion) to talk to the iOS in the streaming media (RTSP) server.

The dialog channel transmits the audio information about it at the same time, and according to the obtained audio information, a decoder is established to decode the audio data transmitted subsequently.

When the Android client completes the above instructions, it will return a signal to the iOS device, and the returned signal is:

"RTSP/1.0 200 OK

Transport:

RTP/AVP/UDP; unicast; mode=record; server_port=53561; control_port=63379; timing_

port=50607

Session: 1

Audio-Jack-Status: connected

Server: AirTunes/130.14

CSeq: 4”

After the transmission of the above signals is completed, the iOS device will start to transmit audio data, and the Android client will receive the corresponding data, and decode and play it through the established server.

When the iOS device starts to transmit audio data, the Android client starts to receive the corresponding data. The received audio data is decoded by the decoder, and the audio data can also be played by the player. In the process of audio data transmission and playback, the dialogue channel in the server is also constantly carrying out signal back and forth with iOS, thereby confirming that the iOS device is still connected with the Android client. The round trip signals are:

"RTSP/1.0 200 OK

Audio-Latency: 2205

Server: AirTunes/130.14

CSeq: 5”

During the audio transmission process, various manipulation information and other audio information are also included. Various manipulation information and other information of the audio are transmitted through the dialog channel. Audio manipulation information includes pause, stop and start of playback, and volume adjustment. Other audio information includes information such as audio track title, artist name, album name, cover picture, and playback progress. Therefore, the transmission of information such as audio control and playback is more convenient.

When there is encryption in the transmission data of the audio, the iOS device uses Fair Play to send encrypted information. The FairPlay password is a replacement password. The Android client decrypts the encrypted information and returns the corresponding data to the iOS device. When the iOS device receives the return information sent by the Android client and confirms that the information is correct, the iOS device sends the encrypted information again, and the Android client decrypts the encrypted information again. And return the decrypted information to the iOS device again. When the two decryptions are completely correct, the iOS device starts to transmit audio data, and the Android device receives corresponding data.

Picture playback:

When the iOS device pushes the picture, the Android client will receive the request sent by the iOS device, and the request includes the information of the corresponding picture. The request is an HTTP request, and the Android client will respond to the request. When playing pictures, the connected port number is 7000.

The corresponding response information is returned between the Android clients. The response information is:

"HTTP/1.1101 Switching Protocols

Date:Thu,23Feb 2012 17:33:41 GMT

Upgrade: PTTH/1.0

Connection: Upgrade"

After the iOS device and the Android client complete the above responses, the Android client will receive the information about the picture to be transmitted sent by the iOS device.

The picture data is received, and the picture data is analyzed by using the information of the picture.

After completing the information transmission of the corresponding picture, the iOS device will transmit the picture. The picture will be transmitted in binary format. After the transmission is completed, the Bitmap (bitmap file) will be used for analysis, so that the picture can be displayed better.

During the process of image transmission, the Android client and iOS device will continue to respond.

The response information is:

"HTTP/1.1 200 OK

Date:Thu,23Feb 2012 17:33:42GMT

Content-Length: 0"

Video playback:

The Android client receives the video playback request sent by the iOS device, and the request includes the information of the corresponding video. The request is an HTTP request, and the Android client will receive the information about the corresponding video sent by the iOS device. When playing video, the connected port number is 7000.

The Android client will respond to the request. The response information is:

"HTTP/1.1 101 Switching Protocols

Date:Thu,23Feb 2012 17:33:41GMT

Upgrade: PTTH/1.0

Connection: Upgrade"

After the iOS device and the Android client complete the above responses, the iOS device will obtain the corresponding information of the Android client and the address of the network card. In this way, the Android client and the iOS device can transmit network data. The corresponding information of the Android client is transmitted through the response, and the content of the response uses the plist file format dedicated to iOS, and the data needs to be converted into the plist binary format before transmission.

The response information is:

"HTTP/1.1 200 OK

Date:Thu,23Feb 2012 17:33:41GMT

Content-Type: text/x-apple-plist+xml

Content-Length: 427

<? xml version="1.0" encoding="UTF-8"? >

<! DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN"

"http://www.apple.com/DTDs/PropertyList-1.0.dtd">

<plist version="1.0">

<dict>

<key>deviceid</key>

<string>58:55:CA:1A:E2:88</string>

<key>features</key>

<integer>14839</integer>

<key>model</key>

<string>AppleTV2,1</string>

<key>protovers</key>

<string>1.0</string>

<key>srcvers</key>

<string>120.2</string>

</dict>

</plist>"

The Android client obtains video information from the iOS device and plays it.

The Android client will obtain the address of the corresponding video on the iOS device, so that the Android client can play the corresponding video according to the corresponding video address and network connection. The existence of video includes two forms, namely local files and network files. When playing a local file, its file format is http. When playing network files, the file format is m3u8.

In the process of video transmission, other information such as various manipulation information and video playback status are also included. Various manipulation information and video playback status are transmitted through the dialog channel. The video manipulation information includes playback pause, fast forward, fast rewind, stop and start, and volume adjustment. The playback status of the video includes information such as total duration, buffer duration, playback position, and playback progress. Therefore, the transmission of information such as video control and playback is more convenient.

Mirror playback:

The iOS device will send an encrypted request message to the Android client. The request is an HTTP request, and the Android client will respond to the request. When performing mirror playback, the connected port number is 7000.

iOS devices use Fair Play to send encrypted messages when there is encryption in the mirrored video file transfer. The Android client decrypts the encrypted information and returns the parsed information to the iOS device. When the iOS device receives the corresponding decryption information, it will verify the correctness of the returned data. When it is determined that the returned data is correct, the iOS device will send the encrypted information again, and the Android client will decrypt the encrypted information again and send the decrypted information back to the iOS device again. When the two decryptions are completely correct, the iOS device starts to transmit audio data, and the Android device receives corresponding data.

The Android client side decrypts the information, and sends the decrypted information to the iOS device.

The response information is:

"HTTP/1.0 200 OK

Server: AirTunes/130.14

Content-Type: application/octet-stream

Content-Lenth: 32

CSeq: 27

<Content>"

When the iOS device obtains the response information of the Android client, the iOS device will send a request for obtaining relevant information of the Android client. The Android client will receive the request from the iOS device and send relevant information through the response message. The response information is:

"HTTP/1.1 200 OK

Date:Mon,08Mar 2012 15:30:27GMT

Content-Type: text/x-apple-plist+xml

Content-Length: 411

<? xml version="1.0" encoding="UTF-8"? >

<! DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN"

"http://www.apple.com/DTDs/PropertyList-1.0.dtd">

<plist version="1.0">

<dict>

<key>height</key>

<integer>720</integer>

<key>overscanned</key>

<true/>

<key>refreshRate</key>

<real>0.016666666666666666</real>

<key>version</key>

<string>130.14</string>

<key>width</key>

<integer>1280</integer>

</dict>

</plist>"

After iOS receives the above response information, it transmits the image data to the Android client.

The Android client performs corresponding playback according to the corresponding data acquired by the image.

Professionals should further realize that the units and algorithm steps described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the relationship between hardware and software Interchangeability. In the above description, the composition and steps of each example have been generally described according to their functions. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present invention.

The steps of the methods or algorithms described in connection with the embodiments disclosed herein may be implemented by hardware, software modules executed by a processor, or a combination of both. Software modules can be placed in random access memory (RAM), internal memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other Any other known storage medium.

The specific embodiments described above have further described the purpose, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above descriptions are only specific embodiments of the present invention and are not intended to limit the scope of the present invention. Protection scope, within the spirit and principles of the present invention, any modification, equivalent replacement, improvement, etc., shall be included in the protection scope of the present invention.

Claims (4)

1. a kind of method playing second terminal data using first terminal, which is characterized in that the method includes：

First terminal including the first operating system issues Air Play services by multicast domain name system；First terminal is issued The parameter of Air Play services includes the parameter and Air Play service apples of Air Tunes service apple music services The parameter of fruit Video service；The service further includes port numbers；Two Air also needed to before issuing service to publication Play services are named；The titles of described two services must be identical, the name formats of two services be MAC Address+@+its He；

The service that second terminal including the second operating system is issued by first terminal carries out Air Play companies with first terminal It connects；

When second terminal carries out Air Play connections, first terminal is received by the port that port numbers are specified and plays Air The data of Play connections transmission；When the Air Play connections play data be mirror image when, mirror image play the step of include：

First terminal receives the encryption information that second terminal is sent out using Fair Play；

Encryption information is decrypted in first terminal, and the information after decryption is sent to second terminal；When second terminal receives The correctness of returned data will be verified after corresponding solution confidential information, after it is correct to determine returned data, second terminal will again Send out encryption information；

First terminal is again decrypted encrypted information and will decrypt information back again to second terminal, when solution twice It is close it is completely correct after, second terminal starts to transmit audio data；

First terminal receives the mirror image data that second terminal is sent and broadcasting；

The data that the first terminal plays are one or more of audio, video, mirror image；

The port numbers include 3；In 3 port numbers, including 1 fixing end slogan and 2 arbitrary end slogans；

The fixing end slogan is 7100 port numbers for being used for transmission mirror image, and 2 arbitrary end slogans are to be respectively used to Air 7000 port numbers of Play Service transmission of video and 5000 port numbers for Air Tunes Service audio transmissions.

2. a kind of method playing second terminal data using first terminal according to claim 1, it is characterised in that：Institute State Air Play connections broadcasting data be audio, audio play the step of be：

First terminal obtains the information of audio；

First terminal establishes the server of transmission, and a channel talked with second terminal is established in server；

First terminal receives audio data, and is decoded by the server of foundation.

3. a kind of method playing second terminal data using first terminal according to claim 1, it is characterised in that：Institute The data for stating Air Play connections broadcasting are video, and the step of video playing includes：

First terminal receives the video playing request that second terminal is sent, and the request includes the information of corresponding video；

First terminal sends the relevant information of first terminal, and the relevant information includes NIC address；

First terminal receives corresponding video data and plays.

4. a kind of method playing second terminal data using first terminal according to claim 1, it is characterised in that：Institute The data for stating Air Play connections broadcasting are picture, and the step of picture playing includes：

First terminal receives the request that second terminal is sent, and the request includes the information of corresponding picture；

First terminal receives image data, and is decoded to image data using the information of the picture.