[go: up one dir, main page]

CN104918065A - RTSP-based system and method for realizing mobile audio and video live broadcast - Google Patents

RTSP-based system and method for realizing mobile audio and video live broadcast Download PDF

Info

Publication number
CN104918065A
CN104918065A CN201510269468.5A CN201510269468A CN104918065A CN 104918065 A CN104918065 A CN 104918065A CN 201510269468 A CN201510269468 A CN 201510269468A CN 104918065 A CN104918065 A CN 104918065A
Authority
CN
China
Prior art keywords
terminal
visiting
audio
video
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510269468.5A
Other languages
Chinese (zh)
Inventor
张祖昶
李晓飞
张川南
邵远之
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Post and Telecommunication University
Original Assignee
Nanjing Post and Telecommunication University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Post and Telecommunication University filed Critical Nanjing Post and Telecommunication University
Priority to CN201510269468.5A priority Critical patent/CN104918065A/en
Publication of CN104918065A publication Critical patent/CN104918065A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2408Monitoring of the upstream path of the transmission network, e.g. client requests
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808Management of client data
    • H04N21/25816Management of client data involving client authentication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643Communication protocols
    • H04N21/6437Real-time Transport Protocol [RTP]

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Graphics (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明公开一种基于RTSP实现移动音视频直播的系统,包括源终端和若干来访终端,源终端包括多媒体流服务模块和访问调度模块,所述来访终端包括多媒体流转发模块;基于RTSP实现移动音视频直播的方法,多媒体流服务模块确认来访移动终端的身份,然后访问调度模块根据设置的规则进行调度,选择最优的音视频源提供者。本发明很好的实现了单个手机同时支持大用户量并发直播访问,具有很强的实用和推广价值。

The invention discloses a system for realizing mobile audio and video live broadcast based on RTSP, which includes a source terminal and several visiting terminals. The source terminal includes a multimedia stream service module and an access scheduling module, and the visiting terminal includes a multimedia stream forwarding module. In the live video method, the multimedia streaming service module confirms the identity of the visiting mobile terminal, and then the access scheduling module schedules according to the set rules and selects the optimal audio and video source provider. The invention well realizes that a single mobile phone simultaneously supports a large number of users for concurrent live access, and has strong practical and popularization value.

Description

基于RTSP实现移动音视频直播的系统及方法System and method for realizing mobile audio and video live broadcast based on RTSP

技术领域 technical field

本发明涉及通讯技术领域,具体是一种基于RTSP(Real Time Streaming Protocol,实时流媒体协议)的实现移动音视频直播的系统和方法。 The present invention relates to the field of communication technology, in particular to a system and method for realizing mobile audio and video live broadcast based on RTSP (Real Time Streaming Protocol, real-time streaming media protocol).

背景技术 Background technique

移动直播是移动终端通过无线移动网络将现场音视频数据进行采集、处理后传送。一般移动终端需要完成实时拍摄和录音,实时上传,通过服务端进行视频直播、录制和流媒体分发。由于移动终端资源不足,当大量用户同时并发访问时,移动终端无法支持。 Mobile live broadcasting is a mobile terminal that collects live audio and video data through a wireless mobile network, processes them and then transmits them. Generally, mobile terminals need to complete real-time shooting and recording, upload in real time, and perform video live broadcast, recording and streaming media distribution through the server. Due to insufficient resources of the mobile terminal, the mobile terminal cannot support when a large number of users access concurrently at the same time.

发明内容 Contents of the invention

本发明目的在于提供一种基于RTSP实现移动音视频直播的系统和方法,以实现单个移动终端同时支持大用户量并发直播访问。 The purpose of the present invention is to provide a system and method for realizing mobile audio and video live broadcast based on RTSP, so as to realize that a single mobile terminal can simultaneously support a large number of users for concurrent live broadcast access.

基于RTSP实现移动音视频直播的系统,包括源终端和若干来访终端,所述源终端包括多媒体流服务模块和访问调度模块,所述来访终端包括多媒体流转发模块; The system for realizing mobile audio and video live broadcast based on RTSP includes a source terminal and several visiting terminals, the source terminal includes a multimedia streaming service module and an access scheduling module, and the visiting terminal includes a multimedia streaming forwarding module;

多媒体流服务模块用于监听和确认来访终端的身份,将该来访终端的身份信息告知访问调度模块,并定时向访问调度模块报告移动终端状态; The multimedia stream service module is used to monitor and confirm the identity of the visiting terminal, inform the access scheduling module of the identity information of the visiting terminal, and regularly report the status of the mobile terminal to the access scheduling module;

访问调度模块,用于为来访终端分配音视频源,保证系统负载均衡; Access scheduling module, used to allocate audio and video sources for visiting terminals to ensure system load balance;

多媒体流转发模块用于在来访终端之间通过RTSP转发音视频数据。当源终端负载量过大或其他性能指标不佳时,当前的来访终端在其他在先来访终端中选择性能较优的作为音视频源,此时来访终端之间通过多媒体流转发模块进行音视频数据传播。 The multimedia stream forwarding module is used to forward audio and video data through RTSP between visiting terminals. When the load of the source terminal is too large or other performance indicators are not good, the current visiting terminal selects the one with better performance among other previous visiting terminals as the audio and video source. data dissemination.

所述源终端和来访终端均为移动终端。 Both the source terminal and the visitor terminal are mobile terminals.

一种基于RTSP实现移动音视频直播的方法,包括以下步骤: A method for realizing mobile audio and video live broadcast based on RTSP, comprising the following steps:

A1、多媒体流服务模块确认来访移动终端的身份,并将来访者的IP地址、端口、登录用户名和请求信息转给访问调度模块; A1, the multimedia streaming service module confirms the identity of the visiting mobile terminal, and transfers the visitor's IP address, port, login user name and request information to the access scheduling module;

A2、访问调度模块根据设置的规则进行调度: A2. The access scheduling module schedules according to the set rules:

A21、来访终端是首个来访者时,访问调度模块将位于源终端的音视频源传输参数通过多媒体流服务模块发送到来访的移动终端; A21. When the visiting terminal is the first visitor, the visit scheduling module sends the audio and video source transmission parameters located in the source terminal to the visiting mobile terminal through the multimedia streaming service module;

A22、来访终端不是首个来访者时,访问调度模块以负载量、网速、吞吐量为性能指标从源终端和在先来访终端中选择最优的音视频源分配给来访终端,然后将所分配的音视频源的传输参数发送到该来访终端,同时限制源终端和各在先来访终端的最大负载量; A22. When the visiting terminal is not the first visitor, the access scheduling module selects the optimal audio and video source from the source terminal and the previous visiting terminal and assigns it to the visiting terminal based on the load, network speed, and throughput as performance indicators, and then distributes all The transmission parameters of the allocated audio and video sources are sent to the visiting terminal, while limiting the maximum load of the source terminal and each previous visiting terminal;

A3、来访终端接收相应音视频源的音视频数据,将其存储在音视频数据缓存区,同时建立起基于RTSP协议的多媒体流转发模块,并将音视频源的传输参数发送给多媒体流服务模块存储,同时通知访问调度模块。 A3. The visiting terminal receives the audio and video data of the corresponding audio and video source, stores it in the audio and video data buffer area, and at the same time establishes a multimedia stream forwarding module based on the RTSP protocol, and sends the transmission parameters of the audio and video source to the multimedia streaming service module storage, while notifying the access scheduling module.

A3后还可以包括步骤A4、来访终端定时向多媒体流服务模块报告当前状态,多媒体流服务模块告知访问调度模块,访问调度模块将状态报告超时的来访终端移除。 After A3, step A4 may also be included, the visiting terminal regularly reports the current status to the multimedia streaming service module, the multimedia streaming service module notifies the access scheduling module, and the access scheduling module removes the visiting terminal whose status report times out.

本发明的有益效果:很好的实现单个手机同时支持大用户量并发直播访问,具有很强的实用和推广价值;有效扩展了手机的多媒体应用功能,应用于任何基于RTSP协议的设备和类似的体系结构或协议。 Beneficial effects of the present invention: a single mobile phone can well support a large number of users concurrent live access at the same time, which has strong practical and promotional value; effectively expands the multimedia application function of the mobile phone, and can be applied to any RTSP protocol-based equipment and similar architecture or protocol.

附图说明 Description of drawings

图1为本发明基于RTSP实现移动音视频直播的系统原理结构图; Fig. 1 is the system principle structural diagram that the present invention realizes mobile audio and video live broadcast based on RTSP;

图2为本发明基于RTSP实现移动音视频直播的方法流程图。 Fig. 2 is the flow chart of the method for realizing mobile audio and video live broadcast based on RTSP in the present invention.

具体实施方式 Detailed ways

为了使本发明的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。 In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

如图1所示,基于RTSP实现移动音视频直播的系统包括源终端和若干来访终端,作为原始多媒体数据的提供者,源终端包括多媒体流服务模块和访问调度模块,多媒体流服务模块主要功能是监听、确认来访者,将其信息告知访问调度模块,访问调度模块进行调度后,多媒体流服务模块将音视频源传输参数返回给来访者,并定时向访问调度模块报告来访者的状态;访问调度模块的功能是,为来访者分配可提供最优质量的音视频源,并保证系统负载均衡。 As shown in Figure 1, the system for implementing mobile audio and video live broadcast based on RTSP includes a source terminal and several visiting terminals. As the provider of original multimedia data, the source terminal includes a multimedia streaming service module and an access scheduling module. The main functions of the multimedia streaming service module are Monitor and confirm visitors, and inform the access scheduling module of their information. After the access scheduling module schedules, the multimedia streaming service module returns the audio and video source transmission parameters to the visitor, and regularly reports the status of the visitor to the access scheduling module; access scheduling The function of the module is to allocate audio and video sources with the best quality to visitors and ensure system load balance.

来访终端包括多媒体流转发模块,根据访问调度模块的调度规则,当在先的来访终端作为多媒体数据的提供者为新来的来访终端提供音视频源时,多媒体流转发模块确认来访者身份,将其信息告知访问调度模块,访问调度模块进行调度后,多媒体流转发模块将音视频源传输参数返回给来访者,并定时向访问调度模块报告来访者的状态。 The visiting terminal includes a multimedia stream forwarding module. According to the scheduling rules of the access scheduling module, when the prior visiting terminal provides audio and video sources for the new visiting terminal as a provider of multimedia data, the multimedia stream forwarding module confirms the identity of the visitor and sends The information informs the access scheduling module. After the access scheduling module schedules, the multimedia stream forwarding module returns the audio and video source transmission parameters to the visitor, and regularly reports the status of the visitor to the access scheduling module.

基于RTSP实现移动音视频直播的方法如图2所示。当来访终端1访问源终端时,多媒体流服务模块确认来访移动终端的身份,并将来访者的IP地址、端口、登录用户名和请求信息转给访问调度模块,因为来访终端1是首个来访者,访问调度模块将位于源终端的音视频源传输参数通过多媒体流服务模块发送到来访终端1;来访终端1向源终端发起音视频流数据请求消息,然后接收来自源终端的音视频数据,将其存储在音视频数据缓存区,同时建立起基于RTSP协议的多媒体流转发模块,并将音视频源的传输参数返回给多媒体流服务模块存储,同时通知访问调度模块,来访终端1可以提供转发功能,能作为音视频流数据的提供者进行调度。 The method of implementing mobile audio and video live broadcast based on RTSP is shown in Figure 2. When the visiting terminal 1 visits the source terminal, the multimedia streaming service module confirms the identity of the visiting mobile terminal, and transfers the visitor's IP address, port, login user name and request information to the access scheduling module, because the visiting terminal 1 is the first visitor , the access scheduling module sends the audio and video source transmission parameters located at the source terminal to the visitor terminal 1 through the multimedia stream service module; the visitor terminal 1 initiates an audio and video stream data request message to the source terminal, then receives the audio and video data from the source terminal, and sends It is stored in the audio and video data buffer area, and at the same time establishes a multimedia stream forwarding module based on the RTSP protocol, and returns the transmission parameters of the audio and video source to the multimedia stream service module for storage, and at the same time notifies the access scheduling module that the visiting terminal 1 can provide the forwarding function , can be scheduled as a provider of audio and video stream data.

当来访终端2访问本系统请求直播音视频数据时,访问调度模块根据负载量、网速、吞吐量等参数对源终端和来访终端1进行比较,选择参数较优的终端(此处假定为来访终端1)作为音视频数据的提供者,并将位于来访终端1的音视频源传输参数通过来访终端1的多媒体流转发模块发送到来访终端2,来访终端2向来访终端1发起音视频流数据请求消息,然后接收来自来访终端1的音视频数据,将其存储在音视频数据缓存区,同时建立起基于RTSP协议的多媒体流转发模块,并将音视频源的传输参数返回给多媒体流服务模块存储,同时通知访问调度模块,来访终端2可以提供转发功能,能作为音视频流数据的提供者进行调度。 When the visiting terminal 2 visits the system to request live audio and video data, the access scheduling module compares the source terminal with the visiting terminal 1 according to parameters such as load, network speed, and throughput, and selects the terminal with better parameters (here, it is assumed to be the visiting terminal 1). Terminal 1) serves as the provider of audio and video data, and sends the transmission parameters of the audio and video source located in the visiting terminal 1 to the visiting terminal 2 through the multimedia stream forwarding module of the visiting terminal 1, and the visiting terminal 2 sends the audio and video stream data to the visiting terminal 1 Request message, then receive the audio and video data from the visiting terminal 1, store it in the audio and video data buffer area, and simultaneously establish a multimedia stream forwarding module based on the RTSP protocol, and return the transmission parameters of the audio and video source to the multimedia stream service module store, and notify the access scheduling module at the same time, the visiting terminal 2 can provide a forwarding function, and can be scheduled as a provider of audio and video stream data.

后续进入系统的来访终端均可按照上述步骤所述的规则进行处理。 Subsequent visiting terminals entering the system can be processed according to the rules described in the above steps.

Claims (4)

1. realize the live system of mobile audio-video based on RTSP, comprise source terminal and some visiting terminals, it is characterized in that, described source terminal comprises multimedia streaming service module and access scheduling module, and described visiting terminal comprises media stream forwarding module,
The identity information of this visiting terminal, for monitoring and confirm the identity of visiting terminal, is informed access scheduling module by multimedia streaming service module, and timing is to access scheduling module report mobile terminal state;
Access scheduling module, for being visiting terminal distribution audio-video source, ensures system load balancing;
Media stream forwarding module is used for forwarding audio, video data by RTSP between visiting terminal.
2. according to claim 1ly realize the live system of mobile audio-video based on RTSP, it is characterized in that, described source terminal and visiting terminal are mobile terminal.
3. utilize the system described in claim 1 to carry out the live method of audio frequency and video at mobile terminal, it is characterized in that, comprise the following steps:
A1, multimedia streaming service module confirm the identity of visiting mobile terminals, and the IP address of visitor, port, login username and solicited message are given to access scheduling module;
A2, access scheduling module are dispatched according to the rule arranged:
When A21, visiting terminal are first visitors, the audio-video source transformation parameter being positioned at source terminal is sent to visiting mobile terminal by multimedia streaming service module by access scheduling module;
When A22, visiting terminal are not first visitors, access scheduling module selects optimum audio-video source to distribute to visiting terminal from source terminal with formerly visiting terminal with load capacity, network speed, throughput for performance index, then the transformation parameter of distributed audio-video source is sent to this visiting terminal, with the ultimate load of limit source terminal with each formerly visiting terminal;
A3, visiting terminal receive the audio, video data of corresponding audio-video source, be stored in audio, video data buffer area, set up the media stream forwarding module based on RTSP agreement simultaneously, and send to multimedia streaming service module to store the transformation parameter of audio-video source, notify access scheduling module simultaneously.
4. according to claim 3ly realize the live method of mobile audio-video based on RTSP, it is characterized in that, A4, visiting terminal timing is also comprised to multimedia streaming service module report current state after A3, multimedia streaming service module informs access scheduling module, and the visiting terminal of status report time-out removes by access scheduling module.
CN201510269468.5A 2015-05-25 2015-05-25 RTSP-based system and method for realizing mobile audio and video live broadcast Pending CN104918065A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510269468.5A CN104918065A (en) 2015-05-25 2015-05-25 RTSP-based system and method for realizing mobile audio and video live broadcast

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510269468.5A CN104918065A (en) 2015-05-25 2015-05-25 RTSP-based system and method for realizing mobile audio and video live broadcast

Publications (1)

Publication Number Publication Date
CN104918065A true CN104918065A (en) 2015-09-16

Family

ID=54086709

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510269468.5A Pending CN104918065A (en) 2015-05-25 2015-05-25 RTSP-based system and method for realizing mobile audio and video live broadcast

Country Status (1)

Country Link
CN (1) CN104918065A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106529333A (en) * 2016-10-31 2017-03-22 天脉聚源(北京)科技有限公司 Method and device for processing user access

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1604569A (en) * 2004-10-29 2005-04-06 清华大学 A Robust Peer-to-Peer Stream Scheduling Method
CN101267383A (en) * 2007-03-14 2008-09-17 中国移动通信集团公司 Data transmission method and system
CN101697552A (en) * 2009-10-16 2010-04-21 中国电信股份有限公司 Method and system for scheduling P2P
CN201928397U (en) * 2010-12-03 2011-08-10 厦门拓能信息科技有限公司 Audio-video transmission system based on real time streaming protocol (RTSP) and compatible with various video coding terminals access
US20120117605A1 (en) * 2010-11-04 2012-05-10 Industrial Technology Research Institute System and method for peer-to-peer live streaming

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1604569A (en) * 2004-10-29 2005-04-06 清华大学 A Robust Peer-to-Peer Stream Scheduling Method
CN101267383A (en) * 2007-03-14 2008-09-17 中国移动通信集团公司 Data transmission method and system
CN101697552A (en) * 2009-10-16 2010-04-21 中国电信股份有限公司 Method and system for scheduling P2P
US20120117605A1 (en) * 2010-11-04 2012-05-10 Industrial Technology Research Institute System and method for peer-to-peer live streaming
CN201928397U (en) * 2010-12-03 2011-08-10 厦门拓能信息科技有限公司 Audio-video transmission system based on real time streaming protocol (RTSP) and compatible with various video coding terminals access

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106529333A (en) * 2016-10-31 2017-03-22 天脉聚源(北京)科技有限公司 Method and device for processing user access

Similar Documents

Publication Publication Date Title
CN111602452B (en) Method and system for multicast-broadcast session release and modification
EP3595325B1 (en) Method for realizing multicast and relevant network device
WO2019084972A1 (en) Streaming media live broadcast method and system
US8203989B2 (en) Distributing content in a communication network
JP2015515170A (en) Method and apparatus for managing network resources used by multimedia streams in a virtual pipe
CN112585922B (en) Auxiliary method, information providing method, stream transmission method and device
CN109964467A (en) The control based on node type for auxiliary data flow transmission
US10972778B2 (en) Stream control system for use in a network
CN104580016A (en) Node distribution method, device and system
WO2017070838A1 (en) Resource scheduling method, base station, scheduler, program server and system
CN112153419A (en) Network resource configuration adjusting method, device, server and storage medium
CN116938907A (en) Data transmission method and system of real-time audio and video transmission network
JP7116196B2 (en) Network-controlled Uplink Media Transport for Collaborative Media Production in Limited Network Capacity Scenarios
CN103428638A (en) Spectrum applying method, device and system
CN110138730B (en) A subscription method, device and storage medium for protocol conversion equipment
KR20140024553A (en) Contents delivery service method for live streaming contents, and apparatus therefor
US10587569B2 (en) Streaming service providing method and device
JP2019506098A (en) Content related information providing method and apparatus for multimedia service
CN104918065A (en) RTSP-based system and method for realizing mobile audio and video live broadcast
CN107172652A (en) A kind of base-station scheduling method and device based on high-level business information
CN112585979B (en) Method and system for network controlled media upload of stored content
CN104780591A (en) Service interoperation implementation method between terminal equipment, device, system and related equipment
WO2014117508A1 (en) Content delivery network and content management method in content delivery network
CN102333095A (en) Media business system and implementation method
US20240137731A1 (en) Systems and methods for providing dynamic edge-based multicast and broadcast service for content providers

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20150916

RJ01 Rejection of invention patent application after publication