[go: up one dir, main page]

CN101677388A - Visual communication system, terminal gateway, video gateway and visual communication method - Google Patents

Visual communication system, terminal gateway, video gateway and visual communication method Download PDF

Info

Publication number
CN101677388A
CN101677388A CN200810222483A CN200810222483A CN101677388A CN 101677388 A CN101677388 A CN 101677388A CN 200810222483 A CN200810222483 A CN 200810222483A CN 200810222483 A CN200810222483 A CN 200810222483A CN 101677388 A CN101677388 A CN 101677388A
Authority
CN
China
Prior art keywords
video
gateway
terminal
data packet
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN200810222483A
Other languages
Chinese (zh)
Inventor
陈心昕
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
Original Assignee
China Mobile Communications Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd filed Critical China Mobile Communications Group Co Ltd
Priority to CN201310054211.9A priority Critical patent/CN103179373B/en
Priority to CN200810222483A priority patent/CN101677388A/en
Publication of CN101677388A publication Critical patent/CN101677388A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Mobile Radio Communication Systems (AREA)
  • Telephonic Communication Services (AREA)

Abstract

本发明涉及可视电话系统，尤其涉及通过无线通信系统实现可视通信的技术。一种可视通信方法，包括：终端网关接收移动终端发送的视频信息；所述终端网关将接收的视频信息承载于满足显示终端显示要求的显示信号，并将所述显示信号发送到显示终端进行视频显示。本发明还提供了一种可视通信系统、视频网关和终端网关。由于在移动终端拨打或接听视频电话时，移动终端将视频信号发送给终端网关，并由终端网关将视频信号显示到显示终端，用户可以通过显示终端方便的观看到通话视频，从而更为方便用户进行可视通信。

Figure 200810222483

The invention relates to a videophone system, in particular to a technology for realizing video communication through a wireless communication system. A visual communication method, comprising: a terminal gateway receiving video information sent by a mobile terminal; the terminal gateway carrying the received video information in a display signal that meets the display requirements of the display terminal, and sending the display signal to the display terminal for display The video shows. The invention also provides a visual communication system, a video gateway and a terminal gateway. When the mobile terminal makes or receives a video call, the mobile terminal sends the video signal to the terminal gateway, and the terminal gateway displays the video signal to the display terminal, and the user can conveniently watch the call video through the display terminal, which is more convenient for users Communicate visually.

Figure 200810222483

Description

Visual communication system, terminating gateway, video gateway and face-to-face communication method
Technical field
The present invention relates to video-phone system, relate in particular to the technology that realizes face-to-face communication based on wireless communication system.
Background technology
Video-phone system also can be described as video-telephone system, for people the traditional communication mode that is different from is provided, based on the novel communication mode of multimedia.By video-phone system, two different local individuals or colony can mutual transaudient sounds, image information, reach instant and interactive communication, thereby satisfy the demand of the multi-faceted information interchange of people.
At present, the video-phone system of prior art generally has two kinds:
A kind of IP (Internet Protocol that is based on, Internet protocol) video-phone system of network, it has disposed special-purpose radio phone terminal, (the Voice over InternetProtocol based on VoIP for example has been installed, the IP based network agreement to transmit speech sound) the PC terminal of the video telephone client software of technology perhaps is equipped with the dedicated fixed phone based on the hardware of voip technology, support video telephone function.This special-purpose radio phone terminal is gathered user's sound, video information, and transmits sound, video information by IP network; Perhaps receive sound, video information that the other side transmits, and by the loudspeaker plays audio-frequency information, by display display video information.
Another kind is based on the video-phone system of cordless communication network: have that the voice channel (being circuit domain) by 64K transmits sound, vision signal between the portable terminal of camera, thereby realize that portable terminal carries out the video-phone system of face-to-face communication based on cordless communication network.
The present inventor finds first kind of method that realizes face-to-face communication, does not have mobility easily; And second kind of face-to-face communication method, though have mobility, the display screen of portable terminal is subject to its screen size, resolution sizes etc., therefore the demonstration for video information has big limitation.Therefore, the video-phone system of prior art can not provide more convenient visual (video) communication for the user.
Summary of the invention
The embodiment of the invention provides a kind of visual communication system, method and terminating gateway, with thinking that the user provides more convenient face-to-face communication.
A kind of face-to-face communication method comprises:
The video information that the terminating gateway mobile terminal receive sends;
Described terminating gateway is carried on the shows signal that satisfies the display terminal display requirement with the video information that receives, and described shows signal is sent to display terminal carries out video and show.
A kind of visual communication system comprises:
Portable terminal be used for from video communication opposite end receiver, video information and output, or output is to the video information of video communication opposite end transmission;
Terminating gateway is used to receive the video information that described portable terminal is exported, and video information is carried on shows signal, and exports described shows signal;
Display terminal is used to receive and carries out video behind the described signal and show.
A kind of terminating gateway comprises:
The video data receiver module is used for the video data that mobile terminal receive sends;
Decoder module is used for the video data decoding that described video data receiver module receives is obtained frame of video;
Modular converter is used for the frame of video that described decoder module obtains is converted to the frame of video that satisfies the display terminal display requirement;
Coding module is used for the frame of video of described modular converter conversion is encoded to the receivable shows signal of described display terminal;
The shows signal output module is used for described shows signal is outputed to described display terminal.
The embodiment of the invention is because when portable terminal is dialed or answered visual telephone, portable terminal sends to terminating gateway with vision signal, and by terminating gateway vision signal is converted to the displayable signal of display terminal (as TV) and shows, the user can watch the conversation video easily by display terminal, communicates by letter thereby more convenient user carries out visual (video).
The embodiment of the invention provides another visual communication system, video gateway, terminating gateway, with thinking that the user provides more convenient face-to-face communication.
A kind of visual communication system comprises: portable terminal, Session initiation protocol SIP server also comprise:
Moving exchanging center MSC is used to receive the signaling that described portable terminal sends, and when determining that the signaling that receives is the video calling signaling, the signaling that receives is carried out route;
Video gateway, be used for after the signaling that receives described MSC route, for described portable terminal distributes SIP unified resource sign URI, and the signaling that sends according to the described portable terminal that the portable terminal SIP URI that distributes will receive is converted to corresponding Internet protocol IP packet; By described sip server the IP packet of conversion is transmitted;
Correspondent Node is used to receive IP packet and the demonstration that described sip server is transmitted.
A kind of video gateway comprises:
The signaling receiver module is used to receive signaling;
The sign distribution module is used to the portable terminal that sends described signaling to distribute SIP URI sign;
Signaling transfer module is used for the signaling that described signaling receiver module receives is converted to corresponding IP packet; Including described sign distribution module in the described IP packet is the SIPURI sign that described portable terminal distributes;
IP packet sending module is used for the IP packet with the conversion of described signaling transfer module, carries out routing forwarding according to the recipient's who comprises in the described signaling SIP URI.
A kind of terminating gateway comprises:
IP-based voice transfer VoIP client modules is used for the IP packet that the received communication opposite end sends, and obtains sound, video data from the IP packet that receives;
The audio signal output module is used for that the voice data that described VoIP client modules obtains is converted to audio signal output and carries out voice output to stereo set;
The vision signal output module is used for that the video audio data that described VoIP client modules obtains is converted to shows signal and outputs to display terminal and carry out video and show.
Because video gateway is converted to corresponding IP packet with signaling, according to the sign of the SIP URI in the signaling IP packet is sent to terminating gateway via sip server, and the receiving terminal gateway is via the IP packet of sip server transmission, send to portable terminal after the IP packet that receives is converted to signaling, thereby realize that portable terminal and the terminating gateway with VoIP client carry out video communication, and terminating gateway is shown to vision signal on the display terminal, and more convenient user carries out video communication; Also can realize and the video communication of portable terminal by terminating gateway like this, improve the convenience of user video communication.
The embodiment of the invention provides another visual communication system, with thinking that the user provides more convenient face-to-face communication.
A kind of visual communication system comprises:
Portable terminal, described portable terminal are used for initiating voip call by the VoIP client, and the IP packet of video information is carried in transmission;
Sip server is used for receiving described voip call by the radio communication core net, and after setting up the communication logic link channel according to described voip call, the IP packet that described portable terminal sends is transmitted;
Terminating gateway is used to receive the IP packet that described sip server is transmitted.
Because portable terminal has the VoIP client, can directly initiate voip call by the radio communication core net to sip server, and set up communication logic link channel between portable terminal and the terminal called gateway by sip server, thereby realize that the portable terminal with VoIP client carries out video communication with the terminating gateway with voip client end, and terminating gateway is shown to vision signal on the display terminal, and more convenient user carries out video communication; Also can realize and the video communication of portable terminal by terminating gateway like this, improve the convenience of user video communication.
The embodiment of the invention provides another visual communication system, terminating gateway, with thinking that the user provides more convenient face-to-face communication.
A kind of visual communication system comprises:
First landline telephone is used to call out the concurrent sending voice information of second landline telephone;
First video collector is used to gather video information;
First terminating gateway is used to obtain the telephone number that described first landline telephone is dialed; And, determine the SIP URI of this telephone number correspondence according to the corresponding relation of telephone number that sets in advance and SIP URI; And obtain the voice messaging that described first landline telephone sends, the video information that described first video collector is gathered, send according to the SIP URI that determines and comprise the voice of acquisition, the IP packet of video information;
Sip server is used to receive the IP packet that described first terminating gateway sends, and transmits the IP packet that receives;
Second terminating gateway is used to receive the IP packet that described sip server is transmitted, and obtains voice messaging from the IP packet that receives, and is converted to voice signal and output; From the IP packet that receives, obtain video information, be converted to shows signal and output;
Second landline telephone is used for go forward side by side lang sound output of received speech signal;
First display terminal is used to receive described shows signal and carries out the video demonstration.
A kind of terminating gateway comprises:
The corresponding relation memory module is used to store the corresponding relation of the SIP URI of the terminating gateway that the telephone number of landline telephone links to each other with this landline telephone;
Search module, be used for searching described corresponding relation memory module stored relation, determine the SIP URI corresponding with described telephone number according to telephone number from the landline telephone acquisition;
Audio-frequency information obtains module, is used for obtaining audio-frequency information from described landline telephone and sends to described VoIP client modules;
The VoIP client modules is used to generate the IP packet that comprises from the audio-frequency information of described audio-frequency information acquisition module reception, and sends the IP packet that generates to Correspondent Node according to the described definite SIP URI of module that searches.
Terminating gateway is because can be according to the corresponding relation of telephone number and terminating gateway SIP URI, when dialing fixed telephone number, the user finds the SIP URI of the terminating gateway that links to each other with this landline telephone, and set up video communication, thereby make and when dialing landline telephone, can realize video communication by terminating gateway according to SIP URI and this terminating gateway of the terminating gateway that finds.
Description of drawings
Fig. 1 is the schematic diagram of the visual communication system of the embodiment of the invention one;
Fig. 2 is the portable terminal of the embodiment of the invention one is realized face-to-face communication by terminating gateway a method flow diagram;
Fig. 3 is the terminating gateway internal structure block diagram of the embodiment of the invention one;
Fig. 4 a, Fig. 4 b are the schematic diagram of the visual communication system of the embodiment of the invention two;
Fig. 5 is the schematic flow sheet of the face-to-face communication method of the embodiment of the invention two;
Fig. 6 is the video gateway internal structure block diagram of the embodiment of the invention two;
Fig. 7 is the terminating gateway internal structure block diagram of the embodiment of the invention two;
Fig. 8 a, Fig. 8 b are the schematic diagram of the visual communication system of the embodiment of the invention three;
Fig. 9 is the schematic flow sheet of the face-to-face communication method of the embodiment of the invention three;
Figure 10 a, Figure 10 b are the schematic diagram of the visual communication system of the embodiment of the invention four;
Figure 11 is the schematic diagram of the another kind of visual communication system of the embodiment of the invention four;
Figure 12 is the terminating gateway internal structure block diagram of the embodiment of the invention four.
Embodiment
The present inventor find TV be the one family share video frequency program the most frequently used present one of terminal, if TV combines with video telephone, then can better bring into play the video signal call function of video telephone, satisfy the possibility that the many people of kinsfolk's (or office, conference member) participate in.The invention provides a kind of terminating gateway, when the user dials by portable terminal at home or receives calls, the video information that this portable terminal will send or receive (for example video media stream) sends to this terminating gateway, and terminating gateway presents the video information that the user will send or receive on TV after changing; Perhaps, the terminating gateway that provides can also have video communication function, and the user can directly dial terminating gateway and carry out video communication, and the vision signal that terminating gateway will send or receive presents after changing on TV.
Be elaborated with specific embodiment below in conjunction with accompanying drawing.
The terminating gateway that the embodiment of the invention one provides obtains the video information that portable terminal sends or receives, and the video information that obtains is shown to TV or other display terminal, thereby realizes more convenient face-to-face communication; Embodiment two provide a kind of can terminating gateway directly that dialed, that have video communication function, and provide corresponding call controlled function and equipment for this terminating gateway at network side; Embodiment three provides a kind of mobile phone terminal directly to initiate voip call and terminating gateway is receiving the technical scheme of carrying out video communication after this calling; Embodiment four provides the scheme that realizes video communication between a kind of terminating gateway and the terminating gateway.
Embodiment one
In the system of as shown in Figure 1 realization face-to-face communication, portable terminal A101 dials visual telephone to portable terminal B102.Portable terminal A101 and the portable terminal B102 circuit domain by cordless communication network transmits mutually and looks, audio-frequency information.
User side portable terminal A101 will send to portable terminal B102's or send to terminating gateway A103 from the video information that portable terminal B102 receives, terminating gateway A103 presents the video information that obtains on TV or other display terminal; Perhaps portable terminal B102 also can send to portable terminal A103's or the portable terminal A103's that receives video information and send to terminating gateway B104, and terminating gateway B104 presents the video information that obtains on TV or other display terminal.
The video information that will send or receive with portable terminal B102 sends to terminating gateway B104, and vision signal is presented to TV to terminating gateway B104 or other display terminal is that example describes, and idiographic flow comprises the steps: as shown in Figure 2
S200: terminating gateway searches the portable terminal in its signal cover.
The method that terminating gateway detects portable terminal also can have several different methods, for example, terminating gateway and portable terminal are all supported (the Hyper Text Transfer Protocol based on HTTP, HTML (Hypertext Markup Language)) the mutual discovery more than the layer and the agreement of registration, need all be composed of number with portable terminal or other wireless device that terminating gateway is set up wireless connections at each of family, register and authentication mutually just in portable terminal enters into terminating gateway wireless signal coverage, send interoperability test message then, thereby portable terminal just and terminating gateway set up communication link in logic, can carry out various message, the intercommunication of data flow.This kind detection method and bottom bearer independent, portable terminal and terminating gateway can be based on wired or wireless connected modes.
The video information that terminating gateway can send by multiple wireless or wired access way mobile terminal receive, ADSL (Asymmetric Digital Subscriber Line for example, Asymmetrical Digital Subscriber Line) inserts, Ethernet inserts, optical fiber inserts, Wi-Fi (Wireless Fidelity, adopting wireless fidelity technology) inserts, WiMAX (World Interoperability for Microwave Access, global interoperability inserting of microwave) inserts, 2G (the 2nd generation cordless communication network) data insert, 3G (the 3rd generation cordless communication network) data access etc.
S201: the vision signal that portable terminal will send or receive sends to terminating gateway.
Portable terminal is when dialing or answer visual telephone, and the vision signal that will send or receive sends to terminating gateway by wired or wireless mode.The video information that portable terminal sends to terminating gateway can be multiple coded system, for example MPEG (Moving Pictures Experts Group, dynamic image expert group)-2, MPEG-4, H.264 wait coded format.This vision signal can be carried on the IP packet---and this concrete interface protocol on terminating gateway is decided; If based on the IP agreement, then portable terminal sends the IP packet that includes video information to terminating gateway.
S202: the video information that the terminating gateway mobile terminal receive sends is converted to the displayable TV signal of TV.
Concrete, terminating gateway is decoded after the data flow (such as the IP packet) that receives the portable terminal transmission, obtains video information (for example frame of video), and it is a digital signal.Because decoded frame of video is based on the frame of video of portable terminal display requirement, the resolution of its every frame not necessarily can satisfy the display requirement of TV or other display terminal, and mobile phone is also different with the frame number that TV or other display terminal per second can show; Therefore, decoded frame of video need be converted to the Media Stream that meets display requirement.TV for example, mainly be to carry out the conversion of digital video signal to analog video signal, be converted to the displayable standard of TV, as Phase Alternation Line system, TSC-system, the TV of China is generally supported Phase Alternation Line system, in Phase Alternation Line system, stipulated for 25 frame/seconds, every frame pixel is 720*576, and every frame level 625 scan lines (divide odd-numbered line, even number line, two of promptly strange, idols are because of adopting interlace mode).Digital signal is transformed in the Phase Alternation Line system shows signal process, need at first unpack the RTP bag, and the video compression coding mode of selecting is decoded, as the H.264 decoding of encoding compression mode, carry out the conversion of digital signal then to analog signal, according to the video flowing of decompress(ion) is to support CIF (Catch in Focus) 352*288, or 720*480 or other, carries out the conversion with the analog signal of Phase Alternation Line system or TSC-system.At present TV is simulated television substantially, but also will carry out the processing such as enhancing, convergent-divergent of image; Terminating gateway is not necessarily the same with the displayable frame number of mobile phone according to network capacity and the displayable minimum frame number of TV simultaneously, needs the certain video information of buffer memory, plays according to display requirement again.If other display terminal, as the equipment of home gateway by external similar projecting apparatus, directly projection, then home gateway need support to connect VGA interface (Video Graphic Array) or other interface of projecting apparatus, digital signal becomes analog signal through analog-modulated, outputs to the projecting apparatus projection through the VGA interface.
S203: TV signal is sent to TV by the TV access interface, show by TV.
TV signal via the general access interface of TV, is linked into TV as AV (Audio Vidio, sound, video) port or S-Video ports such as (Separate Video, two component vide interfaces), shows by TV.When showing, can utilize the remote controller of TV or other button to carry out the switching that television channel is shown to the AV demonstration.
Certainly, except TV, terminating gateway also can be carried on the video information that obtains the displayable signal of other display terminal (as projecting apparatus etc.) and be shown to display terminal.The method of concrete conversion is well known to those skilled in the art, and can be to change according to the signal format of concrete display terminal requirement, repeats no more herein.
Further, portable terminal can also send to audio-frequency information this terminating gateway, and terminating gateway is carried on audio-frequency information in the receivable signal of TV, outputs to TV.
A kind of concrete structure of above-mentioned terminating gateway comprises as shown in Figure 3: video data receiver module 301, decoder module 302, modular converter 303, coding module 304, shows signal output module 305.
If terminating gateway and portable terminal adopt communication, then terminating gateway can also comprise:
Connect and set up module, be used to search for the portable terminal in its wireless signal coverage, and when searching portable terminal, set up radio communication with this portable terminal and be connected.After radio communication connects foundation, the vision signal that video data receiver module 301 mobile terminal receives send.
Video data receiver module 301 is used for receiving video data.Obviously, the video data that this terminating gateway receives is not limited to the video data that portable terminal sends, and the video data for miscellaneous equipment sends also can receive, handles and show.The video data receiver module specifically can adopt plurality of access modes to come receiving video signals, for example ADSL access, Ethernet access, optical fiber access, WiFi access, WiMAX access, the access of 2G data, the access of 3G data etc.
Decoder module 302 is used for the video data decoding that video data receiver module 301 receives is obtained frame of video.Concrete, decode after the data flow (such as the IP packet) of decoder module 302 with the portable terminal transmission, obtain video information (for example frame of video), it is a digital signal.
Modular converter 303 is used for the frame of video that decoder module 302 obtains is converted to the frame of video that satisfies the display terminal display requirement.Because decoded frame of video is based on the frame of video of mobile terminal display screen, the frame number that the resolution of its every frame and per second can show not necessarily can satisfy the display requirement of TV or other display terminal; Therefore, decoded frame of video need be converted to the frame of video (Media Stream) that meets the display terminal display requirement.
Coding module 304 is used for the frame of video of modular converter 303 conversions is encoded to the receivable shows signal of display terminal.Display terminal can comprise TV, projecting apparatus, LCDs etc.For example, for TV, the frame of video of modular converter 303 conversion is converted to analog signal after, be encoded to the displayable standard of TV again, as Phase Alternation Line system or TSC-system.
Shows signal output module 305 is used for shows signal is outputed to display terminal.The shows signal output module outputs to display terminal by the interface of display terminal with shows signal.
This terminating gateway is presented to the function on the display terminal except realizing the vision signal that will receive, can also integrated many other functions or business; Can also comprise the service logic control module like this, manage as a whole and dispatch in order to multiple business and function to terminating gateway.
The technology that above-mentioned portable terminal A101 and portable terminal B102 carry out video communication by circuit domain is same as the prior art, is well known to those skilled in the art, and repeats no more herein.
The embodiment of the invention is because when portable terminal is dialed or answered visual telephone, portable terminal sends to terminating gateway with vision signal, and by terminating gateway vision signal is converted to the displayable signal of display terminal (as TV) and shows, the user can watch the conversation video easily by display terminal, thereby more convenient user carries out video communication.
Embodiment two
The embodiment of the invention two provides a kind of technical scheme that directly realizes face-to-face communication by the terminating gateway that the VoIP client software is housed.Shown in Fig. 4 a, portable terminal 401 can directly be dialed the terminating gateway 402 that the VoIP client software is housed, and terminating gateway 402 is equipped with camera, Mike, loud speaker and display terminal (as TV etc.), can realize video communications with portable terminal 401.The idiographic flow of communication comprises the steps: as shown in Figure 5
S501: the video call that portable terminal 401 is initiated terminating gateway 402.
Because terminating gateway 402 has the VoIP client software, has SIP (Session Initiation Protocol corresponding to the terminating gateway 402 of supporting voip technology, conversation initialized protocol) address, be SIP URI (Uniform Resource Identifier, the unified resource sign), in the video call that portable terminal 401 is initiated, includes the SIP URI of this terminating gateway 402 in order to marking terminal gateway 402.
S502:MSC (Mobile Switching Center, mobile switching centre) 403 after definite type of call is video call, routes the call to video gateway 404 after receiving the calling of portable terminal 401 initiations.
Portable terminal 401 sends video call, based on 3GPP (the 3rd Generation PartnerProject, third generation partner program) H.324M agreement, modulate (modulation system of supporting among existing 2G, the 3G) in the wireless-modulated mode, video, audio-frequency information are carried on the 64K voice channel, through the wireless base station, to core net (MSC403 etc.).
After MSC403 receives calling, judge that this calling is ordinary call or video call, if video call then routes the call to video gateway 404.
S503: video gateway 404 carries out the IP conversion according to the relevant signaling of the video call that receives, and the IP packet of conversion is routed to sip server 405.
After video gateway 404 receives the video call information of carrying with signaling method, the packet into IP is repacked in the conversion of unpacking, and determine the SIP URI of terminating gateway according to the number of the Correspondent Node (callee) of the video call that obtains: each has the terminating gateway of SIP URI sign also corresponding to a termination number, video gateway 404 is searched this corresponding relation according to the termination number in the video call, obtains corresponding SIP URI.Video gateway 404 sends to the IP packet of conversion according to the SIP URI that finds the sip server 405 of correspondence.Video gateway is also supported Session Initiation Protocol, and communication control processor is a Session Initiation Protocol by protocol conversion H.324M.Video gateway 404 is returned portable terminal 401 interim SIP URI of distribution, in order to sign portable terminal 401 in the video communication service of current portable terminal 401 and terminating gateway 402.
In addition, video gateway 404 can also be supported fixed telephone number PSTN (Public SwitchedTelephone Network, public switch telephone network), mobile terminal number MSISDN (Mobile StationISDN, the mobile ISDN) mapping to SIPURI.
S504:SIP server 405 is set up the communication logic link channel according to the content of the IP packet that receives with terminating gateway 402.
Sip server 405 carries out route according to SIP URI, shakes hands, sets up according to Session Initiation Protocol with terminating gateway 402 and call out and the communication logic link channel.
S505: terminating gateway 402 carries out video communication with portable terminal 401 by the communication logic link channel.
Concrete, terminating gateway 402 is packaged into the IP data packet transmission with audio-video frequency media stream and gives sip server 405, sip server 405 is given video gateway 404 with IP packet route, video gateway 404 is converted to corresponding signaling after the IP packet is unpacked, promptly with the audio/video flow of signaling method carrying, control messages etc., and the SIPURI route of distributing to portable terminal 401 of carrying in the IP packet that returns by terminating gateway 402 sends signaling to portable terminal 401;
Portable terminal 401 sends with audio/video flow, the control messages of signaling method carrying and waits until MSC403, when MSC403 determines that the signaling that receives is the video calling signaling, signalling route is arrived video gateway 404, video gateway 404 is converted to corresponding IP packet with signaling, and the IP packet routed to sip server, sip server sends to terminating gateway 402 with the IP packet.
S506: terminating gateway 402 in carrying out the video communication process, the vision signal that receives or will send to the other side is converted to the displayable shows signal of television terminal after, the output shows signal is carried out the video demonstration to television terminal.
Further, between sip server 405 and terminating gateway 402, can also increase operator's gateway device 406 (shown in Fig. 4 b), can realize terminating gateway 402 IP-based communications by operator's gateway device 406, promptly sip server 405 is set up IP-based wireless data passage by operator's gateway device 406 and terminating gateway 402.Sip server 405 is routed to operator's gateway device 406 with the IP packet, and operator's gateway device 406 is set up IP-based wireless data passage according to SIP URI in the IP packet and terminating gateway 402.Operator's gateway device 406 can be WAP (WirelessApplication Protocol, WAP (wireless application protocol)) gateway or Short Message Service Gateway etc.
The IP-based wireless data passage of terminating gateway 402 by setting up carries out video communication by operator's gateway device 406, sip server 405 and video gateway 404 with portable terminal 401.
In the video-phone system shown in Fig. 4 b, medium processing/control and management server can carry out some processing to the Media Stream through sip server, as coding and decoding, and the perhaps conversion between the different coding, can also support multiple business, these business are planned as a whole control and management.
In the system of above-mentioned Fig. 4 a, with terminating gateway as the opposite end of carrying out video communication with portable terminal; Obviously have the terminal of VoIP client for other, also can realize portable terminal by the method in the present embodiment and have video communication between the terminal of VoIP client.
A kind of concrete structure of video gateway 404 comprises as shown in Figure 6: signaling receiver module 601, signaling transfer module 602, IP packet sending module 603, IP packet receiver module 604, IP packet modular converter 605, signaling sending module 606.
Signaling receiver module 601 is used to receive signaling;
Sign distribution module 607 is used to the portable terminal that sends described signaling to distribute SIP URI sign;
Signaling transfer module 602 is used for the signaling that signaling receiver module 601 receives is converted to corresponding IP packet; In the IP packet of conversion, include the SIPURI sign that sign distribution module 607 is distributed for portable terminal.
IP packet sending module 603 is used for the IP packet with the conversion of described signaling transfer module, carries out routing forwarding according to the recipient's who comprises in the described signaling SIP URI.
IP packet receiver module 604 is used to receive the IP packet;
IP packet modular converter 605 is used for the IP packet that IP packet receiver module 604 receives is converted to signaling;
Signaling sending module 606 is used for the signaling with the conversion of described IP packet modular converter, carries out routing forwarding according to the SIP URI of the described portable terminal that comprises in the described IP packet.
In terminating gateway, have the VoIP client software, make terminating gateway can pass through IP network transmission tone, vision signal.A kind of concrete structure of terminating gateway comprises as shown in Figure 7: VoIP client modules 701, video information obtain module 705, audio-frequency information obtains module 706, vision signal output module 702, audio signal output module 707.
Video information obtains module 705, is used for obtaining video information from video collector (first-class as making a video recording), and the video information that obtains is sent to VoIP client modules 701.Concrete, encode after the vision signal that video information acquisition module 705 acquisition video collector send, and the video information of coding is sent to VoIP client modules 701.Can be MPEG-2, MPEG-4 with video information coding, H.264 wait coded format.
Audio-frequency information obtains module 706, is used for obtaining audio-frequency information from audio collection device (as Mike), and the audio-frequency information that obtains is sent to VoIP client modules 701.Concrete, encode after the audio signal that audio-frequency information acquisition module 706 acquisition audio collection devices send, and the audio-frequency information of coding is sent to VoIP client modules 701.Can be with coded audio information for G.711, G.723 waiting coded format.
VoIP client modules 701 is used for sending obtaining the vision signal of module 705 receptions from video information and being packaged into the IP packet from the audio signal that audio-frequency information acquisition module 706 receives; Receive the IP packet from Correspondent Node, from the IP packet that receives, obtain sound, video data, and voice data is outputed to audio signal output module 707 carry out voice output, video data is outputed to vision signal output module 702.Thus, VoIP client modules 701 can be realized IP-based video communication.
Audio signal output module 707 is converted to simulated audio signal with voice data and outputs to stereo sets such as loud speaker, realizes voice output.Concrete, be converted to simulated audio signal after audio signal output module 707 is decoded voice data and output to stereo sets such as loud speaker, realize voice output.
Vision signal output module 702 is converted to the shows signal that meets the display terminal display requirement with video data, outputs to display terminal, carries out video and shows.Concrete, vision signal output module 702 is converted to the video display signal that meets the display terminal display requirement after video data is decoded again, outputs to display terminal, carries out video and shows.
Vision signal output module 702 can comprise with lower unit:
Video data obtains the unit, is used to obtain the video data that voip client end module 701 sends.This video data can be MPEG-2, MPEG-4, H.264 wait coded format.
Signal conversion unit after being used for video information obtained video data that module 705 obtains and decode, is converted to the shows signal that meets the display terminal display requirement.This display terminal can comprise TV, projecting apparatus etc.
The shows signal output unit is used for the shows signal of signal conversion unit conversion is outputed to display terminal.The shows signal output module outputs to display terminal by the interface of display terminal with shows signal.
VoIP client modules 701 both can adopt wired IP-based communication mode, also can adopt wireless IP-based communication mode.
Certainly, in the terminating gateway of this enforcement, can also comprise each functional module of the terminating gateway among the embodiment one, also can realize the function that obtains the local mobile terminal vision signal and show simultaneously.
The embodiment of the invention is because video gateway is converted to corresponding IP packet with signaling, according to the sign of the SIP URI in the signaling IP packet is sent to terminating gateway via sip server, and the receiving terminal gateway is via the IP packet of sip server transmission, send to portable terminal after the IP packet that receives is converted to signaling, thereby realize that portable terminal and the terminating gateway with VoIP client carry out video communication, and terminating gateway is shown to vision signal on the display terminal, and more convenient user carries out video communication; Also can realize and the video communication of portable terminal by terminating gateway like this, improve the convenience of user video communication.
Embodiment three
The VoIP client software is housed in the portable terminal of the embodiment of the invention three, can directly initiates voip call by base station, RNC to sip server, sip server is realized communicating to connect of calling mobile terminal and callee according to this voip call.
Shown in Fig. 8 a, portable terminal 801 is initiated voip call by base station, RNC to sip server, carries out route by sip server 803, and the video communication flow process of realization callee terminating gateway 802 and portable terminal 801 comprises the steps: as shown in Figure 9
The voip call that S901:SIP server 803 mobile terminal receives 801 are initiated.
Portable terminal 801 with VoIP client is initiated voip call, and sip server 803 receives this voip call by the radio communication core net.The SIP URI that includes callee's terminating gateway 802 in this voip call.Though this voip call sends to sip server with wireless mode, the information that sends is the IP packet based on Session Initiation Protocol.
S902:SIP server 803 is set up the communication logic link channel according to the callee SIP URI in calling out with terminating gateway 802.
S903: carry out video communication with portable terminal 801 by sip server 803 and radio communication core net terminating gateway 802, and after the vision signal that will receive or will send to the other side was converted to the displayable shows signal of television terminal, the output shows signal was carried out the video demonstration to television terminal.
After the communication logic link channel was set up, portable terminal 801 can carry out video communication by sip server 803 mutual transmission bearers in sound, the video media stream of IP with terminating gateway 802.
Certainly, also can utilize operator's gateway device 804 to realize terminating gateway 802 IP-based communications (shown in Fig. 8 b), described in concrete grammar such as the embodiment two, not repeat them here.
The concrete structure of terminating gateway is identical with terminating gateway concrete structure among the embodiment two in the present embodiment, repeats no more herein.
The embodiment of the invention is because portable terminal has the VoIP client, can directly initiate voip call by the radio communication core net to sip server, and set up communication logic link channel between portable terminal and the terminal called gateway by sip server, thereby realize that the portable terminal with VoIP client carries out video communication with the terminating gateway with voip client end, and terminating gateway is shown to vision signal on the display terminal, and more convenient user carries out video communication; Also can realize and the video communication of portable terminal by terminating gateway like this, improve the convenience of user video communication.
Embodiment four
Be equipped with between the terminating gateway of VoIP client and also can carry out video communication.Shown in Figure 10 a, terminating gateway A1001 has the VoIP client, also has sip address, i.e. SIP URI sign; Terminating gateway B1002 also has VoIP client, SIP URI sign.Can set up logical communications links by sip server 1003 at terminating gateway A1001 and terminating gateway B1002, thereby transmission is based on sound, the video media stream of IP carrying.Terminating gateway A1001 can be connected audio collection device (Mike), video collector (camera) separately with terminating gateway B1002, obtains user's voice (audio frequency), video information; Show the video information that receives or will send by the display terminal that connects separately; By loud speaker output voice (audio frequency) information that connects separately.Concrete grammar is introduced in the aforementioned embodiment, does not repeat them here.
Can also realize the IP-based radio communication of terminating gateway (shown in Figure 10 b) by operator's gateway device in terminating gateway and the sip server.Operator's gateway device can be WAP gateway or Short Message Service Gateway etc.
Can also realize the video communication between landline telephone and the landline telephone on this basis, as shown in figure 11.For a long time, people are accustomed to adopting landline telephone to dial the other side's number communicating.With the video communication that landline telephone combines with terminating gateway and realizes, can meet people's use habit more.As long as the number of dialing the other side on landline telephone can be realized the video communication with the other side:
Landline telephone A1101 is connected with terminating gateway A1102, and terminating gateway A1102 has the VoIP client; Landline telephone B1105 is connected with terminating gateway B1104, and terminating gateway B1104 has the VoIP client.
When dialing the number of landline telephone B1105 by landline telephone A1101, terminating gateway A obtains the number that landline telephone A1101 dials, and searches the mapping table of telephone number and SIP URI, determines the SIP URI of telephone number correspondence.This mapping table has been preserved the corresponding relation of the SIP URI of the terminating gateway that the telephone number of landline telephone links to each other with this landline telephone, wherein also comprises the corresponding relation of the SIP URI of the telephone number of landline telephone B1105 and terminating gateway B1104.
Terminating gateway A1102 connects with terminating gateway B1104 by sip server 1103 according to the SIP URI of the telephone number correspondence of dialing, and terminating gateway B1104 carries out ring to landline telephone B1105; After the user answers landline telephone B1105, set up the communication logic link channel.Can carry out video communication by the communication logic link channel of setting up.
The process of specifically carrying out video communication is: terminating gateway A1102 obtains the voice messaging of connected landline telephone A1101, and the video information of connected video collector (camera), sound, the video information that obtains is packaged as the IP packet sends to terminating gateway B1104 by sip server; Obtain wherein sound, video information behind the terminating gateway B1104 reception IP packet, terminating gateway B1104 outputs to landline telephone B1105 with audio-frequency information, video information is outputed to display terminal show.Equally, terminating gateway B1104 obtains the voice messaging of connected landline telephone B1105, and the video information of connected video collector is packaged as the IP packet with sound, the video information that obtains and sends to terminating gateway A1102 by sip server; Terminating gateway A1102 outputs to landline telephone A1101 with audio-frequency information, video information is outputed to display terminal show.
The mapping table of preserving among the terminating gateway A1102 both can be that the user imports voluntarily, also can be that regular business service platform from network side obtains.This business service platform is safeguarded the corresponding relation of the SIP URI of the terminating gateway that the telephone number of each landline telephone links to each other with this landline telephone.
A kind of concrete structure of terminating gateway A1102 or terminating gateway B1104 comprises as shown in figure 12: corresponding relation memory module 1201, search module 1202, audio-frequency information and obtain module 1203, audio signal output module 1204, VoIP client modules 1205.
Preserved the corresponding relation of the SIPURI of the telephone number of landline telephone and terminating gateway in the corresponding relation memory module 1201.
Search module 1202, be used to obtain the other side's telephone number that landline telephone is dialed, and, obtain the SIP URI of corresponding terminating gateway according to the corresponding relation that this other side's telephone number searching is preserved.
Audio-frequency information obtains module 1203, is used to obtain the audio-frequency information of landline telephone.Concrete, audio-frequency information obtains module 1203 and obtains the analog voice signal of landline telephone, and encodes after being converted to digital audio and video signals, and the audio-frequency information behind the coding is sent to VoIP client modules 1205.
VoIP client modules 1205, be used for SIP URI according to the counterpart terminal gateway of searching module 1202 acquisitions, establish a communications link with this counterpart terminal gateway: VoIP client modules 1205 obtains audio-frequency information that module 1203 obtains with audio-frequency information and is packaged as the IP packet and sends to the counterpart terminal gateway, and receive the IP packet that the counterpart terminal gateway sends, from the IP packet that receives, obtain voice data.
Audio signal output module 1204 after being used for VoIP client modules 1205 obtained voice data and decode from the IP packet that receives, is converted to analog voice signal and outputs to landline telephone, by the receiver output voice of landline telephone.
Terminating gateway further comprises: vision signal obtains module 1206, vision signal output module 1207.
Vision signal obtains module 1206, is used for from the first-class acquisition video information of making a video recording.
VoIP client modules 1205 is used for that also video information is bundled to the IP packet and sends to described counterpart terminal gateway, and obtains video data from the IP packet that the counterpart terminal gateway that receives sends.
Vision signal output module 1207 is used for obtaining video data from VoIP client modules 1205, and this video data both can be the video data that receives from the counterpart terminal gateway, also can be the video data that sends to the counterpart terminal gateway.And outputing to display terminal with being converted to the displayable shows signal of display terminal behind this video data decoding, display terminal carries out video and shows.
Obviously, for system as shown in figure 11, the landline telephone A that is connected with terminating gateway A1102 can be replaced with portable terminal A, also the landline telephone B that terminating gateway B1104 can be connected replaces with portable terminal B; Perhaps further, replace landline telephone A and the camera that is connected with terminating gateway A1102 with portable terminal A with camera, replace landline telephone B and the camera that is connected with terminating gateway B1104 with portable terminal B with camera.Those skilled in the art can be repeated no more with the scheme of the alternative landline telephone of portable terminal according to the system of the disclosed Figure 11 of the embodiment of the invention herein in easy realization.
Certainly, as a kind of method of more optimizing, when landline telephone does not need to dial visual telephone, and be common voice call, then terminating gateway can be connected to this landline telephone the PSTN net, carries out common voice call.The switching of visual telephone and voice call can have several different methods, for example, if visual telephone is then dialed the other side's number and is added feature key (as: *, # key) on landline telephone, terminating gateway carries out video communication by sip server after being defined as visual telephone according to this feature key; If the normal speech phone, do not add the feature key after then dialing the other side's number, terminating gateway is connected to the PSTN net with phone, carries out common voice call.
The terminating gateway of the embodiment of the invention is because can be according to the corresponding relation of telephone number and terminating gateway SIP URI, when dialing fixed telephone number, the user finds the SIP URI of the terminating gateway that links to each other with this landline telephone, and set up video communication, thereby make and when dialing landline telephone, can realize video communication by terminating gateway according to SIP URI and this terminating gateway of the terminating gateway that finds.
One of ordinary skill in the art will appreciate that all or part of step that realizes in the foregoing description method is to instruct relevant hardware to finish by program, this program can be stored in the computer read/write memory medium, as: ROM/RAM, magnetic disc, CD etc.
The above only is a preferred implementation of the present invention; should be pointed out that for those skilled in the art, under the prerequisite that does not break away from the principle of the invention; can also make some improvements and modifications, these improvements and modifications also should be considered as protection scope of the present invention.

Claims (35)

1、一种可视通信方法，其特征在于，包括：1. A visual communication method, characterized in that it comprises: 终端网关接收移动终端发送的视频信息；The terminal gateway receives the video information sent by the mobile terminal; 所述终端网关将接收的视频信息承载于满足显示终端显示要求的显示信号，并将所述显示信号发送到显示终端进行视频显示。The terminal gateway carries the received video information in a display signal meeting the display requirements of the display terminal, and sends the display signal to the display terminal for video display. 2、如权利要求1所述的方法，其特征在于，所述终端网关接收移动终端发送的视频信息，具体包括：2. The method according to claim 1, wherein the terminal gateway receives the video information sent by the mobile terminal, specifically comprising: 所述终端网关通过有线通信方式或无线通信方式接收移动终端发送的视频信息。The terminal gateway receives the video information sent by the mobile terminal through wired communication or wireless communication. 3、一种可视通信系统，其特征在于，包括：3. A visual communication system, characterized in that it comprises: 移动终端，用于从视频通信对端接收视频信息并输出，或输出向视频通信对端发送的视频信息；The mobile terminal is used for receiving and outputting video information from the video communication peer, or outputting video information sent to the video communication peer; 终端网关，用于接收所述移动终端输出的视频信息，将视频信息承载于显示信号，并输出所述显示信号；The terminal gateway is used to receive the video information output by the mobile terminal, carry the video information in the display signal, and output the display signal; 显示终端，用于接收所述信号后进行视频显示。The display terminal is used for performing video display after receiving the signal. 4、如权利要求3所述的系统，其特征在于，所述终端网关和移动终端之间通过无线通信方式或有线通信方式通信连接。4. The system according to claim 3, wherein the terminal gateway and the mobile terminal are connected through wireless communication or wired communication. 5、如权利要求3或4所述的系统，其特征在于，所述显示终端包括：电视、投影仪。5. The system according to claim 3 or 4, wherein the display terminal comprises: a television and a projector. 6、一种终端网关，其特征在于，包括：6. A terminal gateway, characterized in that it comprises: 视频数据接收模块，用于接收移动终端发送的视频数据；The video data receiving module is used to receive the video data sent by the mobile terminal; 解码模块，用于将所述视频数据接收模块接收的视频数据解码得到视频帧；A decoding module, configured to decode the video data received by the video data receiving module to obtain video frames; 转换模块，用于将所述解码模块得到的视频帧转换为满足显示终端显示要求的视频帧；A conversion module, configured to convert the video frame obtained by the decoding module into a video frame that meets the display requirements of the display terminal; 编码模块，用于将所述转换模块转换的视频帧编码为所述显示终端可接收的显示信号；An encoding module, configured to encode the video frame converted by the conversion module into a display signal receivable by the display terminal; 显示信号输出模块，用于将所述显示信号输出到所述显示终端。a display signal output module, configured to output the display signal to the display terminal. 7、如权利要求6所述的终端网关，其特征在于，还包括：7. The terminal gateway according to claim 6, further comprising: 无线通信模块，用于搜索到所述终端网关无线信号覆盖范围内的所述移动终端时，与所述移动终端建立无线通信连接。The wireless communication module is configured to establish a wireless communication connection with the mobile terminal when the mobile terminal within the wireless signal coverage of the terminal gateway is found. 8、一种可视通信系统，包括：移动终端、会话初始化协议SIP服务器，其特征在于，还包括：8. A visual communication system, comprising: a mobile terminal, a Session Initiation Protocol SIP server, characterized in that it also includes: 移动交换中心MSC，用于接收所述移动终端发送的信令，确定接收的信令为视频通话信令时，将接收的信令进行路由；The mobile switching center MSC is used to receive the signaling sent by the mobile terminal, and when determining that the received signaling is a video call signaling, route the received signaling; 视频网关，用于在接收所述MSC路由的信令后，为所述移动终端分配一SIP统一资源标识URI，并根据分配的移动终端SIP URI将接收的所述移动终端发送的信令转换为相应的互联网协议IP数据包；通过所述SIP服务器将转换的IP数据包进行转发；The video gateway is used to distribute a SIP uniform resource identifier URI for the mobile terminal after receiving the signaling of the MSC route, and convert the received signaling sent by the mobile terminal according to the distributed mobile terminal SIP URI into Corresponding Internet protocol IP data packets; the IP data packets converted by the SIP server are forwarded; 通信对端，用于接收所述SIP服务器转发的IP数据包并显示。The communication peer is used to receive and display the IP data packet forwarded by the SIP server. 9、如权利要求8所述的系统，其特征在于，9. The system of claim 8, wherein: 所述通信对端还用于向所述移动终端返回IP数据包；The communication peer is also used to return IP data packets to the mobile terminal; 所述视频网关还用于通过所述SIP服务器接收所述通信对端返回的IP数据包；并将所述返回的IP数据包转换为相应信令后，根据所述返回的IP数据包包含的所述移动终端的SIP URI，通过所述MSC将转换的信令发送到所述移动终端。The video gateway is also used to receive the IP data packet returned by the communication peer through the SIP server; and after converting the returned IP data packet into corresponding signaling, according to the IP data packet contained in the returned IP data packet The SIP URI of the mobile terminal sends the converted signaling to the mobile terminal through the MSC. 10、如权利要求9所述的系统，其特征在于，还包括：10. The system of claim 9, further comprising: 运营商网关设备，用于与所述通信对端建立基于IP的无线数据通道；以及An operator gateway device, configured to establish an IP-based wireless data channel with the communication peer; and 所述SIP服务器通过所述运营商网关设备将所述IP数据包转发至所述通信对端、或者接收通信对端返回的IP数据包。The SIP server forwards the IP data packet to the communication peer through the operator gateway device, or receives the IP data packet returned by the communication peer. 11、如权利要求10所述的系统，其特征在于，所述运营商网关设备为WAP网关、或短信网关。11. The system according to claim 10, wherein the carrier gateway device is a WAP gateway or a short message gateway. 12、如权利要求8-11任一所述的系统，其特征在于，所述通信对端包括：12. The system according to any one of claims 8-11, wherein the communication peer includes: 终端网关，用于接收所述SIP服务器转发的IP数据包，将IP数据包中的视频数据转换为显示信号，并输出所述显示信号；The terminal gateway is used to receive the IP data packet forwarded by the SIP server, convert the video data in the IP data packet into a display signal, and output the display signal; 显示终端，用于接收所述显示信号并进行视频显示。The display terminal is used for receiving the display signal and performing video display. 13、如权利要求12所述的系统，其特征在于，还包括：13. The system of claim 12, further comprising: 视频采集器，与所述终端网关相连，用于采集视频信息；A video collector connected to the terminal gateway for collecting video information; 音频采集器，与所述终端网关相连，用于采集音频信息；以及an audio collector, connected to the terminal gateway, for collecting audio information; and 所述终端网关还用于生成包含有所述视频采集器采集的视频信息、以及所述音频采集器采集的音频信息的IP数据包，并向所述移动终端返回生成的IP数据包。The terminal gateway is further configured to generate an IP data packet containing the video information collected by the video collector and the audio information collected by the audio collector, and return the generated IP data packet to the mobile terminal. 14、一种视频网关，其特征在于，包括：14. A video gateway, characterized by comprising: 信令接收模块，用于接收信令；A signaling receiving module, configured to receive signaling; 标识分配模块，用于为发送所述信令的移动终端分配一SIP URI标识；An identifier distribution module, configured to distribute a SIP URI identifier for the mobile terminal sending the signaling; 信令转换模块，用于将所述信令接收模块接收的信令转换为相应的IP数据包；所述IP数据包中包含有所述标识分配模块为所述移动终端分配的SIPURI标识；A signaling conversion module, configured to convert the signaling received by the signaling receiving module into a corresponding IP data packet; the IP data packet contains the SIPURI identifier assigned by the identification assignment module to the mobile terminal; IP数据包发送模块，用于将所述信令转换模块转换的IP数据包，根据所述信令中包含的接收方的SIP URI进行路由转发。The IP packet sending module is used to route and forward the IP packet converted by the signaling conversion module according to the SIP URI of the receiver contained in the signaling. 15、如权利要求14所述的视频网关，其特征在于，还包括：15. The video gateway according to claim 14, further comprising: IP数据包接收模块，用于接收IP数据包；IP data packet receiving module, is used for receiving IP data packet; IP数据包转换模块，用于将所述IP数据包接收模块接收的IP数据包转换为信令；An IP data packet conversion module, configured to convert the IP data packet received by the IP data packet receiving module into signaling; 信令发送模块，用于将所述IP数据包转换模块转换的信令，根据所述IP数据包中包含的所述移动终端的SIP URI进行路由转发。The signaling sending module is used to route and forward the signaling converted by the IP data packet conversion module according to the SIP URI of the mobile terminal contained in the IP data packet. 16、一种终端网关，其特征在于，包括：16. A terminal gateway, characterized by comprising: 基于IP的语音传输VoIP客户端模块，用于接收通信对端发送的IP数据包，并从接收的IP数据包中获得音、视频数据；IP-based voice transmission VoIP client module, used to receive the IP data packet sent by the communication peer, and obtain audio and video data from the received IP data packet; 音频信号输出模块，用于将所述VoIP客户端模块获得的音频数据转换为音频信号输出到音响设备进行语音输出；The audio signal output module is used to convert the audio data obtained by the VoIP client module into an audio signal output to audio equipment for voice output; 视频信号输出模块，用于将所述VoIP客户端模块获得的视频频数据转换为显示信号输出到显示终端进行视频显示。The video signal output module is used to convert the video data obtained by the VoIP client module into a display signal and output it to the display terminal for video display. 17、如权利要求16所述的终端网关，其特征在于，还包括：17. The terminal gateway according to claim 16, further comprising: 视频信息获得模块，用于从视频采集器获得视频信息；The video information obtaining module is used to obtain video information from the video collector; 音频信息获得模块，用于从音频采集器获得音频信息；以及An audio information obtaining module, configured to obtain audio information from an audio collector; and 所述VoIP客户端模块还用于生成包含采集的音、视频信息的IP数据包，并将生成的IP数据包向所述通信对端发送。The VoIP client module is also used to generate IP data packets containing collected audio and video information, and send the generated IP data packets to the communication peer. 18、一种可视通信系统，包括：18. A visual communication system comprising: 移动终端，所述移动终端用于通过VoIP客户端发起VoIP呼叫，并发送携带视频信息的IP数据包；A mobile terminal, the mobile terminal is used to initiate a VoIP call through a VoIP client, and send an IP data packet carrying video information; SIP服务器，用于通过无线通信核心网接收所述VoIP呼叫，并根据所述VoIP呼叫建立通信逻辑链路通道后，将所述移动终端发送的IP数据包进行转发；The SIP server is used to receive the VoIP call through the wireless communication core network, and after establishing a communication logic link channel according to the VoIP call, forward the IP data packet sent by the mobile terminal; 终端网关，用于接收所述SIP服务器转发的IP数据包。The terminal gateway is used to receive the IP data packet forwarded by the SIP server. 19、如权利要求18所述的系统，其特征在于，还包括：显示终端；以及19. The system according to claim 18, further comprising: a display terminal; and 所述终端网关还用于从接收的IP数据包中获得视频信息显示到所述显示终端。The terminal gateway is also used to obtain video information from the received IP data packet and display it to the display terminal. 20、如权利要求19所述的系统，其特征在于，20. The system of claim 19, wherein: 所述终端网关还用于向所述移动终端返回IP数据包；The terminal gateway is also used to return IP data packets to the mobile terminal; 所述SIP服务器还用于接收所述终端网关返回的IP数据包，并将接收的所述终端网关返回的IP数据包向所述移动终端转发；The SIP server is also used to receive the IP data packet returned by the terminal gateway, and forward the received IP data packet returned by the terminal gateway to the mobile terminal; 所述移动终端用于通过所述VoIP客户端接收所述SIP服务器转发的所述返回的IP数据包。The mobile terminal is configured to receive the returned IP data packet forwarded by the SIP server through the VoIP client. 21、如权利要求20所述的系统，其特征在于，还包括：21. The system of claim 20, further comprising: 运营商网关设备，用于与所述终端网关建立基于IP的无线数据通道；以及An operator gateway device, configured to establish an IP-based wireless data channel with the terminal gateway; and 所述SIP服务器还用于通过所述运营商网关设备将所述移动终端发送的IP数据包向所述终端网关转发，或者将接收的终端网关返回的IP数据包向所述移动终端转发。The SIP server is further configured to forward the IP data packet sent by the mobile terminal to the terminal gateway through the operator gateway device, or forward the received IP data packet returned by the terminal gateway to the mobile terminal. 22、如权利要求21所述的系统，其特征在于，所述运营商网关设备为WAP网关、或短信网关。22. The system according to claim 21, wherein the operator gateway device is a WAP gateway or a short message gateway. 23、一种可视通信系统，包括：23. A visual communication system comprising: 第一固定电话，用于呼叫第二固定电话并发送语音信息；The first fixed phone is used to call the second fixed phone and send voice information; 第一视频采集器，用于采集视频信息；a first video collector, configured to collect video information; 第一终端网关，用于获得所述第一固定电话拨打的电话号码；并根据预先设置的电话号码与SIP URI的对应关系，确定该电话号码对应的SIP URI；并获得所述第一固定电话发送的语音信息、所述第一视频采集器采集的视频信息，根据确定的SIP URI发送包含获得的语音、视频信息的IP数据包；The first terminal gateway is used to obtain the telephone number dialed by the first fixed telephone; and according to the correspondence between the preset telephone number and the SIP URI, determine the SIP URI corresponding to the telephone number; and obtain the first fixed telephone The voice information that sends, the video information that described first video collector gathers, send the IP packet that comprises the voice of obtaining, video information according to determined SIP URI; SIP服务器，用于接收所述第一终端网关发送的IP数据包，并转发接收的IP数据包；The SIP server is configured to receive the IP data packet sent by the first terminal gateway, and forward the received IP data packet; 第二终端网关，用于接收所述SIP服务器转发的IP数据包，从接收的IP数据包中获得语音信息，转换为语音信号并输出；从接收的IP数据包中获得视频信息，转换为显示信号并输出；The second terminal gateway is used to receive the IP data packet forwarded by the SIP server, obtain voice information from the received IP data packet, convert it into a voice signal and output it; obtain video information from the received IP data packet, and convert it into a display signal and output; 第二固定电话，用于接收语音信号并进行语音输出；The second fixed telephone is used for receiving voice signals and performing voice output; 第一显示终端，用于接收所述显示信号并进行视频显示。The first display terminal is configured to receive the display signal and perform video display. 24、如权利要求23所述的系统，其特征在于，24. The system of claim 23, wherein: 所述第二终端网关还用于获得所述第二固定电话的语音信息，生成包含第二固定电话语音信息的IP数据包、并向所述第一终端网关返回生成的IP数据包；The second terminal gateway is also used to obtain the voice information of the second fixed phone, generate an IP data packet containing the voice information of the second fixed phone, and return the generated IP data packet to the first terminal gateway; 所述SIP服务器还用于接收所述第二终端网关返回的IP数据包并向所述第一终端网关转发；The SIP server is also used to receive the IP data packet returned by the second terminal gateway and forward it to the first terminal gateway; 所述第一终端网关还用于接收所述SIP服务器转发的第二终端网关返回的IP数据包，并从所述返回的IP数据包中获得语音信息输出到所述第一固定电话。The first terminal gateway is further configured to receive the IP data packet returned by the second terminal gateway forwarded by the SIP server, and obtain voice information from the returned IP data packet to output to the first fixed phone. 25、如权利要求24所述的系统，其特征在于，还包括：第二视频采集器、第二显示终端；25. The system according to claim 24, further comprising: a second video collector and a second display terminal; 所述第二终端网关还用于获得所述第二视频采集器采集的视频信息，生成包含第二视频采集器采集的视频信息的IP数据包、并向所述第一终端网关返回包含第二视频采集器采集的视频信息的IP数据包；The second terminal gateway is also used to obtain the video information collected by the second video collector, generate an IP packet containing the video information collected by the second video collector, and return the IP data packet containing the second video information to the first terminal gateway. The IP packet of the video information collected by the video collector; 所述SIP服务器，用于接收所述第二终端网关返回的IP数据包，并向所述第一终端网关转发；The SIP server is configured to receive the IP data packet returned by the second terminal gateway and forward it to the first terminal gateway; 所述第一终端网关接收所述SIP服务器转发的包含第二视频采集器采集的视频信息的IP数据包，从接收的该IP数据包中获得视频信息输出到所述第二显示终端。The first terminal gateway receives the IP data packet forwarded by the SIP server and includes the video information collected by the second video collector, obtains the video information from the received IP data packet and outputs it to the second display terminal. 26、如权利要求23-25任一所述的系统，其特征在于，还包括：26. The system according to any one of claims 23-25, further comprising: 业务平台，用于维护所述对应关系；以及A business platform, configured to maintain the corresponding relationship; and 所述第一终端网关还用于从所述业务平台获得所述对应关系。The first terminal gateway is further configured to obtain the corresponding relationship from the service platform. 27、如权利要求23-25任一所述的系统，其特征在于，还包括：27. The system according to any one of claims 23-25, further comprising: 第一运营商网关设备，用于与所述第一终端网关建立基于IP的无线数据通道；以及The first operator gateway device is configured to establish an IP-based wireless data channel with the first terminal gateway; and 所述SIP服务器还用于通过所述第一运营商网关设备将所述IP数据包转发至所述第一终端网关，并接收第一终端网关发送的IP数据包。The SIP server is further configured to forward the IP data packet to the first terminal gateway through the first operator gateway device, and receive the IP data packet sent by the first terminal gateway. 28、如权利要求27所述的系统，其特征在于，所述第一运营商网关设备为无线应用协议WAP网关、或短信网关。28. The system according to claim 27, wherein the first operator gateway device is a WAP gateway or a short message gateway. 29、如权利要求27所述的系统，其特征在于，还包括：29. The system of claim 27, further comprising: 第二运营商网关设备，用于与所述第二终端网关建立基于IP的无线数据通道；以及The second operator gateway device is configured to establish an IP-based wireless data channel with the second terminal gateway; and 所述SIP服务器还用于通过所述第二运营商网关设备将所述IP数据包转发至所述第二终端网关或者接收第二终端网关发送的IP数据包。The SIP server is further configured to forward the IP data packet to the second terminal gateway or receive the IP data packet sent by the second terminal gateway through the second operator gateway device. 30、如权利要求29所述的系统，其特征在于，所述第二运营商网关设备为WAP网关、或短信网关。30. The system according to claim 29, wherein the second operator gateway device is a WAP gateway or a short message gateway. 31、如权利要求23所述的系统，其特征在于，31. The system of claim 23, wherein: 所述第一固定电话可替换为第一移动终端；和/或，The first fixed telephone may be replaced by a first mobile terminal; and/or, 所述第二固定电话可替换为第二移动终端。The second fixed phone can be replaced by a second mobile terminal. 32、一种终端网关，其特征在于，包括：32. A terminal gateway, characterized by comprising: 对应关系存储模块，用于存储固定电话的电话号码与该固定电话相连的终端网关的SIP URI的对应关系；Correspondence storage module, is used for storing the corresponding relation of the SIP URI of the terminal gateway that the telephone number of fixed telephone is connected with this fixed telephone; 查找模块，用于根据从固定电话获得的电话号码，查找所述对应关系存储模块存储的对应关系，确定与所述电话号码对应的SIP URI；The search module is used to search the corresponding relationship stored in the corresponding relationship storage module according to the telephone number obtained from the fixed telephone, and determine the SIP URI corresponding to the telephone number; 音频信息获得模块，用于从所述固定电话获得音频信息发送给所述VoIP客户端模块；An audio information obtaining module, configured to obtain audio information from the fixed phone and send it to the VoIP client module; VoIP客户端模块，用于生成包含从所述音频信息获得模块接收的音频信息的IP数据包，并根据所述查找模块确定的SIP URI向通信对端发送生成的IP数据包。The VoIP client module is used to generate the IP packet that contains the audio information received from the audio information acquisition module, and sends the generated IP packet to the communication peer according to the SIP URI determined by the search module. 33、如权利要求32所述的终端网关，其特征在于，33. The terminating gateway of claim 32, wherein: 所述VoIP客户端模块还用于从所述通信对端接收的IP数据包中获得音频信息；以及所述终端网关还包括：The VoIP client module is also used to obtain audio information from the IP packet received by the communication peer; and the terminal gateway also includes: 音频信号输出模块，用于将所述VoIP客户端模块从所述通信对端接收的IP数据包中获得的音频信息输出到所述固定电话。The audio signal output module is used to output the audio information obtained by the VoIP client module from the IP data packet received by the communication peer to the fixed phone. 34、如权利要求33所述的终端网关，其特征在于，还包括：34. The terminal gateway according to claim 33, further comprising: 视频信息获得模块，用于从视频采集器获得视频信息发送给所述VoIP客户端模块；以及A video information obtaining module, configured to obtain video information from the video collector and send it to the VoIP client module; and 所述VoIP客户端模块还用于生成包含从所述视频信息获得模块接收的视频信息的IP数据包。The VoIP client module is also used to generate an IP data packet containing the video information received from the video information obtaining module. 35、如权利要求34所述的终端网关，其特征在于，35. The terminating gateway of claim 34, wherein: 所述VoIP客户端模块还用于从所述通信对端接收的IP数据包中获得视频信息；以及所述终端网关还包括：The VoIP client module is also used to obtain video information from the IP packet received by the communication peer; and the terminal gateway also includes: 视频信号输出模块，用于将所述VoIP客户端模块从所述通信对端接收的IP数据包中获得的视频信息输出到显示终端进行视频显示。The video signal output module is used to output the video information obtained by the VoIP client module from the IP data packet received by the communication peer to the display terminal for video display.
CN200810222483A 2008-09-17 2008-09-17 Visual communication system, terminal gateway, video gateway and visual communication method Pending CN101677388A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201310054211.9A CN103179373B (en) 2008-09-17 2008-09-17 Visual communication system, terminating gateway, video gateway and visual communication method
CN200810222483A CN101677388A (en) 2008-09-17 2008-09-17 Visual communication system, terminal gateway, video gateway and visual communication method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN200810222483A CN101677388A (en) 2008-09-17 2008-09-17 Visual communication system, terminal gateway, video gateway and visual communication method

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN201310054211.9A Division CN103179373B (en) 2008-09-17 2008-09-17 Visual communication system, terminating gateway, video gateway and visual communication method

Publications (1)

Publication Number Publication Date
CN101677388A true CN101677388A (en) 2010-03-24

Family

ID=42029770

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201310054211.9A Active CN103179373B (en) 2008-09-17 2008-09-17 Visual communication system, terminating gateway, video gateway and visual communication method
CN200810222483A Pending CN101677388A (en) 2008-09-17 2008-09-17 Visual communication system, terminal gateway, video gateway and visual communication method

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN201310054211.9A Active CN103179373B (en) 2008-09-17 2008-09-17 Visual communication system, terminating gateway, video gateway and visual communication method

Country Status (1)

Country Link
CN (2) CN103179373B (en)

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101877891A (en) * 2010-06-18 2010-11-03 中兴通讯股份有限公司 Method, system and device for acquiring data information by gateway
CN101969540A (en) * 2010-10-15 2011-02-09 深圳市同洲电子股份有限公司 Implementation method, device and system of video call
WO2012083612A1 (en) * 2010-12-22 2012-06-28 深圳市同洲软件有限公司 Video telephony switch method, mobile terminal and system
CN102957891A (en) * 2011-08-24 2013-03-06 中国电信股份有限公司 Method and system for displaying video content, videophone terminal and display terminal
CN103139527A (en) * 2011-12-05 2013-06-05 中国电信股份有限公司 Parameter negotiation method in video communication, device and video communication terminal
CN103345204A (en) * 2013-05-10 2013-10-09 上海斐讯数据通信技术有限公司 Home control system
CN103402072A (en) * 2013-08-08 2013-11-20 上海昭赫信息技术有限公司 Videophone communication system and method
CN104154439A (en) * 2014-07-29 2014-11-19 浙江生辉照明有限公司 Intelligent LED lighting device and remote video chat system based on same
CN104184982A (en) * 2013-05-28 2014-12-03 华为技术有限公司 Audio and video communication method and system, terminal device, and audio and video communication service center
CN104581085A (en) * 2015-01-30 2015-04-29 成都华迈通信技术有限公司 Bidirectional real-time monitoring method
CN105163299A (en) * 2015-06-30 2015-12-16 北京奇虎科技有限公司 Communication method for mobile terminal, and mobile terminal
CN106453552A (en) * 2016-10-11 2017-02-22 合肥思盟信息科技有限公司 Wap page management system based on internet technology
CN106550242A (en) * 2016-12-08 2017-03-29 北京数码视讯科技股份有限公司 The conversion method and device of IP real-time media streams
CN107295419A (en) * 2017-07-25 2017-10-24 湖南克拉视通科技有限公司 Set-top box video call implementing method
CN108259439A (en) * 2016-12-29 2018-07-06 大唐移动通信设备有限公司 A kind of video session method for building up and gateway device
CN108632560A (en) * 2018-05-14 2018-10-09 聚好看科技股份有限公司 Video call method, device and terminal device
CN109714560A (en) * 2018-12-29 2019-05-03 上海欣方智能系统有限公司 A kind of mobile terminal video conference system and its implementation
CN111083683A (en) * 2019-12-19 2020-04-28 展讯通信（上海）有限公司 Call display control method and device

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104427290A (en) * 2013-09-11 2015-03-18 航天信息股份有限公司 Processing method and processing system for audio/video data
CN104702567B (en) * 2013-12-05 2018-06-05 航天信息股份有限公司 The method and system of xenogenesis voice resource intercommunication based on IP scheduling switch
TW201702974A (en) * 2015-07-01 2017-01-16 美林聯網股份有限公司 System and method of distributed communication and information management for medical usage
CN106060447B (en) * 2016-05-17 2022-09-30 国网山西省电力公司 Monitoring method and monitoring system based on mobile communication terminal and video telephone
CN108683820B (en) * 2018-04-26 2021-10-15 贵阳朗玛信息技术股份有限公司 Mobile internet voice platform system fusing public switched telephone network PSTN and application method thereof
CN112671773A (en) * 2020-12-24 2021-04-16 厦门亿联网络技术股份有限公司 Method, device, equipment and storage medium for integrating multiple terminals in VOIP equipment

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005076615A1 (en) * 2004-02-06 2005-08-18 Softbank Bb Corp. Videophone system, self-support base station device, set top box, and videophone method
GB0503437D0 (en) * 2005-02-18 2005-03-30 Nokia Corp Video traffic in a communications system
CN100384160C (en) * 2005-07-14 2008-04-23 华为技术有限公司 Method and device for monitoring video calls
CN1988575A (en) * 2005-12-20 2007-06-27 国富通信息技术发展有限公司 Method and system for checking real name by using radio terminal
CN100544443C (en) * 2007-07-27 2009-09-23 中兴通讯股份有限公司 A kind of set-top-box system and method that realizes the IP communication

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101877891A (en) * 2010-06-18 2010-11-03 中兴通讯股份有限公司 Method, system and device for acquiring data information by gateway
CN101969540A (en) * 2010-10-15 2011-02-09 深圳市同洲电子股份有限公司 Implementation method, device and system of video call
CN102572365B (en) * 2010-12-22 2015-05-27 深圳市同洲软件有限公司 Video call switching method, mobile terminal and system
WO2012083612A1 (en) * 2010-12-22 2012-06-28 深圳市同洲软件有限公司 Video telephony switch method, mobile terminal and system
CN102572365A (en) * 2010-12-22 2012-07-11 深圳市同洲软件有限公司 Video call switching method, mobile terminal and system
CN102957891A (en) * 2011-08-24 2013-03-06 中国电信股份有限公司 Method and system for displaying video content, videophone terminal and display terminal
CN102957891B (en) * 2011-08-24 2016-05-18 中国电信股份有限公司 Video content rendering method, system, radio phone terminal and present terminal
CN103139527A (en) * 2011-12-05 2013-06-05 中国电信股份有限公司 Parameter negotiation method in video communication, device and video communication terminal
CN103139527B (en) * 2011-12-05 2016-03-23 中国电信股份有限公司 Parameter consultation method in video communication, device and video communication terminal
CN103345204A (en) * 2013-05-10 2013-10-09 上海斐讯数据通信技术有限公司 Home control system
CN104184982B (en) * 2013-05-28 2018-04-10 华为技术有限公司 Audio/video communication method, system, terminal device and voice and video telephone service centre
CN104184982A (en) * 2013-05-28 2014-12-03 华为技术有限公司 Audio and video communication method and system, terminal device, and audio and video communication service center
CN103402072A (en) * 2013-08-08 2013-11-20 上海昭赫信息技术有限公司 Videophone communication system and method
CN104154439A (en) * 2014-07-29 2014-11-19 浙江生辉照明有限公司 Intelligent LED lighting device and remote video chat system based on same
CN104581085A (en) * 2015-01-30 2015-04-29 成都华迈通信技术有限公司 Bidirectional real-time monitoring method
CN105163299A (en) * 2015-06-30 2015-12-16 北京奇虎科技有限公司 Communication method for mobile terminal, and mobile terminal
CN105163299B (en) * 2015-06-30 2019-05-31 北京奇虎科技有限公司 A kind of call method and mobile terminal applied to mobile terminal
CN106453552A (en) * 2016-10-11 2017-02-22 合肥思盟信息科技有限公司 Wap page management system based on internet technology
CN106550242B (en) * 2016-12-08 2020-03-24 北京数码视讯科技股份有限公司 Method and device for converting IP real-time media stream
CN106550242A (en) * 2016-12-08 2017-03-29 北京数码视讯科技股份有限公司 The conversion method and device of IP real-time media streams
CN108259439A (en) * 2016-12-29 2018-07-06 大唐移动通信设备有限公司 A kind of video session method for building up and gateway device
CN108259439B (en) * 2016-12-29 2021-02-02 大唐移动通信设备有限公司 Video session establishing method and gateway equipment
CN107295419A (en) * 2017-07-25 2017-10-24 湖南克拉视通科技有限公司 Set-top box video call implementing method
CN108632560A (en) * 2018-05-14 2018-10-09 聚好看科技股份有限公司 Video call method, device and terminal device
CN109714560A (en) * 2018-12-29 2019-05-03 上海欣方智能系统有限公司 A kind of mobile terminal video conference system and its implementation
CN111083683A (en) * 2019-12-19 2020-04-28 展讯通信（上海）有限公司 Call display control method and device
CN111083683B (en) * 2019-12-19 2023-04-07 展讯通信（上海）有限公司 Call display control method and device

Also Published As

Publication number Publication date
CN103179373B (en) 2016-03-30
CN103179373A (en) 2013-06-26

Similar Documents

Publication Publication Date Title
CN101677388A (en) Visual communication system, terminal gateway, video gateway and visual communication method
CN108055496B (en) Live broadcasting method and system for video conference
EP1346557B1 (en) Method and system for establishing a multimedia connection by negotiating capability in an outband control channel
CA2592809C (en) Pseudo-rich hybrid phone/browser
US7715872B2 (en) Video calling method capable of providing video through third display
CN101668162B (en) Implementation method of video conference and video conference system
CN110536028B (en) Video color ring realization method, color ring platform, terminal and storage medium
CN101909192B (en) Television terminal and communication method thereof
JP2005192207A (en) Image/voice communication system of ip base, and active call conversion/active call pickup method using it
CN101554051A (en) Digital communications adaptor
US20120075406A1 (en) Method And System For Handling A Multi-Media Call Setup Request
CN103096022B (en) Video conference system and video conference method
KR20120035100A (en) Method and apparatus for providing emotion analysys to the opposite party in real time during video call using smart devices
US8908853B2 (en) Method and device for displaying information
CN100403794C (en) A video terminal and method for realizing streaming media service
CN100486367C (en) System and method for realizing color image service
KR101585871B1 (en) Apparatus and method for providing whiteboard service in mobile communication system
WO2011120368A1 (en) Method, server and system for providing real-time video service in telecommunication network
CN101951491B (en) Method and system for playing video service
US20080040754A1 (en) Pseudo-rich hybrid phone/browser
CN101686288A (en) Receiver apparatus and method, and sending and receiving system
KR20050067913A (en) System and its method for multimedia ring back service using session initiation protocol
JP2006140973A (en) Home gateway, two-way video communication apparatus, and two-way video communication system
CN1976376B (en) Method for calling session, IP telephone system and IP telephone terminal
JP5163750B2 (en) Multimedia service

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20100324