Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
  • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
  • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
  • H04N21/25808—Management of client data
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
  • H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
  • H04N21/26258—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/41—Structure of client; Structure of client peripherals
  • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
  • H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
  • H04N21/65—Transmission of management data between client and server
  • H04N21/658—Transmission by the client directed to the server
  • H04N21/6581—Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
  • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
  • H04N21/845—Structuring of content, e.g. decomposing content into time segments
  • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04W—WIRELESS COMMUNICATION NETWORKS
  • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
  • H04W4/18—Information format or content conversion, e.g. adaptation by the network of the transmitted or received information for the purpose of wireless delivery to users or terminals

Definitions

• the invention generally relates to mobile networks, and more specifically to an expansion of a stream set and transcoding of Hypertext Transfer Protocol (HTTP) adaptive streaming videos in a mobile network.
• HTTP Hypertext Transfer Protocol
• a video server divides a video program into segments, encodes each segment, and transmits the encoded segments via a network to a client device.
• the client device receives the encoded segments, decodes the segments, and presents the decoded segments in an appropriate sequence to produce a video presentation.
• progressive download refers to video delivered by a regular HTTP web server rather than a streaming server.
• video delivered using this technique is stored on a viewer's hard drive as it's received, and then it's played from the hard drive.
• streaming video is usually not stored (also called cached) locally, so if the viewer can't retrieve and play it in real time, he or she cannot play it smoothly at all.
• the present invention provides methods and apparatus, including computer program products, for expansion of stream set and transcoding of Hypertext Transfer Protocol (HTTP) adaptive streaming videos in a mobile network.
• the invention features a method including, in a mobile content delivery network (CDN) server residing in a mobile network, maintaining a database of mobile subscriber information for mobile subscribers derived from the mobile network, receiving a mobile client request to download a video stream, ingesting a manifest file from a server in the network originating the requested video, deriving characteristics of a mobile device of the mobile client from mobile subscriber information derived from the database of mobile subscriber information for mobile subscribers derived from the mobile network, expanding a set of streams in the manifest file depending on the derived characteristics of the mobile device, transcoding the set of streams from the server in the network originating the requested video into alternate bit rates suitable for a current mobile network condition, and delivering the set of streams to the mobile client.
• CDN mobile content delivery network
• the invention features a mobile content delivery network (CDN) server including a processor, a storage device and a memory, the memory including an operating system, a cache and a transcoding process, the transcoding process including maintaining a database of mobile subscriber information for mobile subscribers derived from the mobile network, receiving a mobile client request to download a video stream, ingesting a manifest file from a server in the network originating the requested video, deriving characteristics of a mobile device of the mobile client from mobile subscriber information derived from the database of mobile subscriber information for mobile subscribers derived from the mobile network, expanding a set of streams in the manifest file depending on the derived characteristics of the mobile device, transcoding the set of streams from the server in the network originating the requested video into alternate bit rates suitable for a current mobile network condition, and delivering the set of streams to the mobile client.
• CDN mobile content delivery network
• FIG. 1 is a block diagram of an exemplary network.
• FIG. 2 is a block diagram of an exemplary network.
• FIG. 3 is a block diagram of a mobile content delivery network server.
• FIG. 4 is a flow diagram.
• a component can be, but is not limited to being, a process running on a processor, a processor, an object, an executable, a thread of execution, a program, and/or a computer.
• a component may be, but is not limited to being, a process running on a processor, a processor, an object, an executable, a thread of execution, a program, and/or a computer.
• an application running on a server and the server can be a component.
• One or more components may reside within a process and/or thread of execution and a component may be localized on one computer and/or distributed between two or more computers.
• these components can execute from various computer readable media having various data structures stored thereon.
• the components may communicate via local and/or remote processes such as in accordance with a signal having one or more data packets (e.g., data from one component interacting with another component in a local system, distributed system, and/or across a network such as the Internet with other systems via the signal).
• terms like "user equipment,” “mobile station,” “mobile,” “subscriber station,” “communication device,” “access terminal,” “terminal,” “handset,” and similar terminology refer to a wireless device (e.g., cellular phone, smart phone, computer, personal digital assistant (PDA), set-top box, Internet Protocol Television (IPTV), electronic gaming device, printer, etc.) utilized by a subscriber or user of a wireless communication service to receive or convey data, control, voice, video, sound, gaming, or substantially any data-stream or signaling-stream.
• PDA personal digital assistant
• IPTV Internet Protocol Television
• access point refers to a wireless network component or appliance that serves and receives data, control, voice, video, sound, gaming, or substantially any data-stream or signaling-stream from a set of subscriber stations.
• Data and signaling streams can be packetized or frame -based flows.
• the present invention relates to mobile content delivery that radically improves a speed of delivery, a quality of delivery, a time of delivery, and a billing of the content.
• the present invention enables a mobile carrier to apply a differentiated billing model for delivery of the content.
• the present invention facilitates either a mobile subscriber being charged for the content, a content provider being charged, both parties being charged, or free delivery of the content based upon promotional or advertising agreements between a content originator and the mobile carrier.
• an exemplary mobile network 10 includes a wireless mobile device 12, a mobile access network infrastructure 14 setup by a mobile service
• mobile CDN mobile content delivery network
• the wireless mobile device 12 is coupled to mobile access network infrastructure 14, which is coupled to mobile CDN server 16, which is coupled to content database 18.
• Wireless mobile device 12 can support existing and future wireless technologies supporting wireless mobile communication, including, without limitation, cell phones (mobile phones), Personal Data Assistants (PDAs), personal computers (PCs) such as laptops, palmtops, and tablet PCs, and general purpose mobile computing devices.
• the wireless mobile device 12 supports wireless communication with mobile operator infrastructure 14 via a wireless link 20.
• Such wireless communication, characteristics of wireless link 20, and the manner in which wireless link 20 is implemented and maintained can be governed by one or more applicable wireless communication protocols and/or one or more applicable signaling and network protocols.
• wireless mobile device 12 is configured to support Wireless GSM/GPRS/3G/CDMA W-CDMA connectivity in compliance with established European Telecommunications Standards Institute (ETSI) standards, International Telecommunication Union (ITU) standards and Third Generation Partnership Project (3GPP) standards, International Telecommunication Union (ITU) standards and the like.
• ETSI European Telecommunications Standards Institute
• ITU International Telecommunication Union
• 3GPP Third Generation Partnership Project
• ITU International Telecommunication Union
• wireless mobile device 12 may be configured to support alternate or additional wireless data communication protocols, including variations of 3G such as 3.9G or 4G.
• Wireless mobile device 12 can also utilize other technologies, such as, for example, Bluetooth, IEEE 802.1 la/b/g (WLANs), IEEE 802.16 (WiMAX), IEEE 802.20, and so forth.
• Mobile access network infrastructure 14 is generally deployed and managed by mobile network operators, such as Verizon and AT&T, who provide mobile services to users based on a subscription model in which mobile users pay for voice, data and other supplementary services.
• the mobile CDN server 16 is an intermediary between the mobile access network infrastructure 14 and the content domain where content is stored in the content database 18.
• the content residing at content database 18 can be stored locally in the mobile CDN server 16, or in multiple mobile CDNs, and transmitted over the mobile network operator infrastructure 14 to the end mobile subscriber 12.
• the mobile CDN server 16 enhances the delivery of Internet or mobile based content by coupling mobile subscriber information derived from the mobile network 14, the subscriber device 12, the subscribers mobile charging and subscription plans, to the originator of the content, and the type of content being delivered to the mobile subscriber.
• the content is enhanced by applying these mobile specific characteristics during delivery of the content.
• the mobile CDN server 16 improves the speed of delivery, the quality of delivery, the time of delivery, and the billing of the content.
• the mobile CDN server 16 enables the mobile carrier to apply a differentiated billing model for delivery of the content.
• the mobile CDN server 16 facilitates either the mobile subscriber being charged for the content, the content provider being charged, both parties being charged, or free delivery of the content based upon promotional or advertising agreements between the content originator and the mobile carrier.
• an exemplary network 100 illustrates a mobile CDN server 102 interfacing with GSM/GPRS/CDMA 3G mobile access network. It should be noted that the network 100 may include additional components and functions that are unrelated to the mobile content delivery techniques described herein.
• a mobile device (GSM/GPRS capable) 104 and a mobile device (3G capable) 106 subscribe to mobile operator services and communicate over a wireless link 108 and 110 respectively.
• the mobile device 104 can send or receive data or voice over the communication link 108 in the GSM/GPRS environment and the mobile device 106 over the communication link 110 in the 3G environment.
• the mobile device 104 transmits/receives data and voice traffic to the Base
• the BTS 112 is coupled with the Base Station Controller (BSC) 114 over a communication link 116.
• BSC Base Station Controller
• the BSC 114 is coupled with a Mobile Switching Center (MSC) 118 over a communication link 120.
• MSC Mobile Switching Center
• the MSC 118 is linked various Mobile operator databases 122, such as a Home Location Register (HLR), Visitor Location Register (VLR), Authentication Center (AUC), Equipment Identity Register (EIR), and forth, over a communication link 124 .
• the MSC 118 is also linked to a Short Message Service Center (SMSC) 126 and Serving GRPS Support Node (SGSN) 128 over communication links 130 and 132 respectively. SMSC 126 and SGSN 128 are coupled with a link 127.
• SMSC Short Message Service Center
• SGSN Serving GRPS Support Node
• the mobile device 106 sends and receives data and voice traffic to NODE-B 134 over the communication link 110.
• the NODE-B 134 is coupled with Radio Network Controller (RNC) 136 over a communication link 138.
• R C 136 is coupled with the 3G-Serving GPRS Support Node (3G-SGSN) 140 over a communication link 142.
• the 3G-SGSN 140 is coupled with Gateway GPRS Support Node (GGSN) 144 over a communication link 146.
• the GSM/GPRS network and the 3G network are coupled over a communication link 148.
• the GGSN 144 exposes the mobile world to the Internet 150 using a communication link 152.
• a Multimedia Messaging Service Center (MMSC) 154 and a Wireless Application Protocol Gateway (WAP-GW) 156 are coupled with the GGSN 144 over communication links 158 and 160, respectively.
• MMSC Multimedia Messaging Service Center
• WAP-GW Wireless Application Protocol Gateway
• the mobile CDN server 102 is coupled with the Mobile Operator Databases 122 using a communication link 162.
• the manner in which the communication channel is established and maintained over communication link 162 may be governed by one or more applicable communication protocols and/or signaling protocols, such as the ETSI GSM MAP protocol specification, for example.
• the mobile CDN server 102 is coupled with the SMSC 126 to send and receive SMS messages over the mobile network infrastructure using a communication link 164.
• the manner in which communication is established and maintained over communication link 164 may be governed by one or more applicable communication protocols and/or one or more applicable network protocols, such as SMPP, CIMD2, and so forth.
• the mobile CDN server 102 is coupled with the Internet 150 using a communication link 166, which can include various standard data communication protocols such as TCP/IP, IEEE 802.3, and so forth. Using the link 166 the mobile CDN 102 can send or receive any content to the mobile world using the Internet 150.
• the mobile CN server 102 is coupled with the MMSC 154 using a communication link 168 to send and receive MMS messages. The manner in which communication is established and maintained over communication link 168 may be governed by one or more applicable communication protocols and/or one or more applicable network protocols such as the MM7 protocol.
• the mobile CDN 102 is coupled with the WAP-GW 156 using a communication link 170 to transfer WAP pages and related content. The manner in which communication is established and maintained over communication link 170 may be governed by one or more applicable communication protocols and/or one or more applicable network protocols.
• the mobile CDN server 102 is coupled with a content database 172 using a communication link.
• the mobile CDN server 102 communicates with the content database 172 to retrieve and store, e.g., cache, content data to fulfill requests by a user. Using subscriber information obtained from the databases 122, content is formatted by the mobile CDN server 102 for presentation at the wireless mobile device 104 in the GSM/GRPS world or mobile device 106 in the 3G world.
• content database 172 there may be content managed by the mobile CDN server 102 that does not exist in the content database 172 and which is not tracked as individual content assets but as classes of content. In the case where content is not managed as individual assets, content is handled and tracked with respect to a policy associated with the class of content rather than the particular asset.
• the mobile CDN server 102 may or may not store (e.g., cache) the content, but act as a pass-through.
• the mobile CDN server 102 is coupled with a mobile operator billing systems 176 using a communication link 178.
• the mobile CDN 102 can generate log files containing transaction details for specific transactions made by the mobile user while accessing certain content which need to be billed to the end mobile user. Such billing events are submitted through this interface to the mobile operator billing system 176 through the communication link 178.
• the mobile CDN server 102 uses a combination of Mobile and Internet Deep Packet Inspection, Mobile Subscriber Database Queries, Mobile Subscriber Policy Queries, Mobile Network conditions, as well as Mobile Device characteristics to apply delivery and billing/charging decisions to either enhance, degrade, store, reformat, deliver, or some combination of each of these capabilities prior to delivering the content to the mobile subscriber, or between mobile subscribers.
• the mobile CDN server 102 obtains information on the mobile subscribers service subscriptions, the mobile subscribers device characteristics, and the context of the content originator, such as billing relationship with the mobile carrier and the type of content being transmitted, to apply routing and delivery decisions on a per subscriber and per content originator basis. Additionally, mobile network characteristics, such as bandwidth available, network latency, and roamed to network, are used in the decision and routing analysis.
• the mobile CDN server 102 mediates the delivery and billing of value-added content between the content source provider and the mobile subscriber.
• the coupling of information obtained from the content source to the subscribers content billing and delivery preferences enhances the overall mobile users quality of experience, and the billing/charging experience of content to mobile subscribers.
• Mobile carriers can leverage the mobile CDN server 102 to grow their revenue base by extending subscriptions to what has typically been Internet-based services, such as Netflix®, Apple®, Pandora® and other paid video and audio delivery platforms.
• the mobile CDN server 102 includes a processor 200, a memory 202 and a storage device 204.
• Memory 202 includes an operating system (OS) 206, such as Linux® or Windows®, and a content aware manager 208 that includes a transcoding process 500.
• OS operating system
• Memory 202 may also include a database management system to manage data stored in the storage device 204.
• Data includes content downloaded from one or more web servers residing in the Internet 150 and data downloaded from the databases 122 that represent information about individual subscribers. More particularly, data represents information on the mobile subscribers' service subscriptions, the mobile subscribers' device characteristics, and the context of the content originator, such as billing relationship with the mobile carrier and the type of content being transmitted to apply routing and delivery decisions on a per subscriber and per content originator basis. Additionally, data may include mobile network characteristics such as bandwidth available, network latency, and roamed to network that is used in the decision and routing analysis.
• the content aware manager 208 intercepts mobile subscriber requests for services and the transcoding process 500 facilitates Hypertext Transfer Protocol (HTTP) adaptive streaming of video and/or audio.
• HTTP Hypertext Transfer Protocol
• adaptive streaming is a hybrid approach, combining the concept of streaming with HTTP progressive download.
• a video or audio segment is cut into smaller segments called “chunks” and encoded to the desired format.
• Each chunk may be 2-4 seconds long and fall between Group of Pictures (GOP) boundaries.
• GOP Group of Pictures
• the "adaptive" part of this approach lies in the encoding of each segment at multiple bit rates.
• a client can choose between chunks of different sizes. Depending on the network bandwidth, the client can choose larger or smaller chunks ahead of time.
• an adaptive bit-rate streaming server chooses a couple of formats based on a population of end devices in the manifest file. Typically, this is either High Definition (HD) or Secured Digital (SD) format for wired networks. However, this is not suitable for mobile devices in mobile networks and radio networks. Depending on the mobile device and a mobile network condition, these formats tend to be "more than the required" bit-rates, resulting in high consumption of radio bandwidth.
• HD High Definition
• SD Secured Digital
• a client device may download from a video server, or otherwise access, the manifest file containing information concerning the desired video, and identify the sequence of video segments associated with the video.
• Process 500 enables a dynamic expansion of the set of streams in the manifest file depending on characteristics of the mobile device from mobile subscriber information derived from the mobile network.
• Process 500 provides transcoded streams of alternate bit rates suitable for the current mobile network conditions.
• the set of streams are carefully chosen to suit the mobile network compared to the generic streams used by the servers of origin.
• Process 500 ingests (either proactively or reactively) the original manifest file and changes it to include "mobile-network friendly" bit-rates and streams for the video. Each segment received from the server of origin is transcoded (or transrated) to the bit- rate/ re s o lutio n of the streams added in the manifest file.
• process 500 delivers the modified manifest file, enabling the client to request the streams that are created dynamically by the mobile CDN server 102.
• process 500 includes, in a server residing in a mobile network, receiving (502) a mobile client request to download a video stream.
• Process 500 ingests (504) a manifest file from server originating the requested video stream.
• Process 500 derives (506) characteristics of a mobile device of the mobile client from mobile subscriber information derived from the mobile network. [0044] Process 500 expands (508) a set of streams in the manifest file depending on the derived characteristics of the mobile device.
• Process 500 transcodes (510) the set of streams into alternate bit rates suitable for a current mobile network condition.
• Process 500 delivers (512) the set of streams to the mobile client.
• implementations can include implementation in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.
• a programmable processor which may be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.
• the systems and techniques described here can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the computer.
• a display device e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor
• a keyboard and a pointing device e.g., a mouse or a trackball
• Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback), and input from the user can be received in any form, including acoustic, speech, or tactile input.
• the systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g.,
• middleware component e.g., an application server
• front-end component e.g., a client computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here
• back-end component e.g., a client computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here
• back-end component e.g., middleware, or front-end components.
• front-end component e.g., a client computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here
• back-end e.g., middleware, or front-end components.
• the components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (“LAN”), a wide area network (“WAN”), and the Internet.
• LAN local area network
• the computing system can include clients and servers.
• a client and server are generally remote from each other and typically interact through a communication network.
• the relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.

Landscapes

• Engineering & Computer Science (AREA)
• Signal Processing (AREA)
• Multimedia (AREA)
• Databases & Information Systems (AREA)
• Computer Networks & Wireless Communication (AREA)
• Computer Graphics (AREA)
• General Engineering & Computer Science (AREA)
• Mobile Radio Communication Systems (AREA)

Priority Applications (1)

Applications Claiming Priority (1)

Publications (1)

Family

ID=50477739

Family Applications (1)

Country Status (1)

Cited By (3)

Citations (6)

• 2012
  • 2012-10-11 WO PCT/US2012/059784 patent/WO2014058431A1/fr not_active Ceased

Patent Citations (9)

Non-Patent Citations (4)

Similar Documents

Legal Events