CN117714701A

CN117714701A - Video ring tone processing method, device, system and electronic equipment

Info

Publication number: CN117714701A
Application number: CN202311708965.1A
Authority: CN
Inventors: 孙井权; 崔兴宇; 张闯; 冯生浩
Original assignee: China Mobile Communications Group Co Ltd; MIGU Culture Technology Co Ltd
Current assignee: China Mobile Communications Group Co Ltd; MIGU Culture Technology Co Ltd
Priority date: 2023-12-13
Filing date: 2023-12-13
Publication date: 2024-03-15

Abstract

The invention discloses a video color ring processing method, device and system and electronic equipment, and relates to the technical field of virtual reality. The video color ring processing method is applied to first encoding equipment, and comprises the following steps: acquiring path information of a target video color ring in first file management equipment; reading the target video color ring in the first file management equipment according to the path information; and sending the target video color ring to media resource processing equipment, wherein the media resource processing equipment is used for sending the target video color ring to a session border controller SBC. The invention reduces the problems of network IO, single-point limitation, high concurrency performance and the like, improves the system stability, and further improves the playing effect of the video color ring.

Description

Video color ring processing method, device, system and electronic equipment

Technical Field

The present invention relates to the field of virtual reality technologies, and in particular, to a method, an apparatus, a system, and an electronic device for processing a video color ring.

Background

Because the file system of the color ring video playing platform has the characteristic limitations of small file, high time delay requirement (millisecond level), relatively large total storage capacity and the like, the file system of the color ring video playing platform generally uses a file system based on a network file system (Network File System, NFS).

However, NFS naturally has the disadvantages of high Input Output (IO), single point limitation, high concurrency efficiency, high concurrency performance and the like, so that if NFS has the problems of network jitter, network failure, NFS crash (crash) and the like in the process of playing video color ring, the video color ring playing platform can be influenced to push media streams to a user terminal, so that the phenomena of blocking, screen pattern, screen black and the like can possibly occur, even the normal voice call of the user can be influenced, and extremely unfriendly video color ring playing experience is caused for the user.

Disclosure of Invention

The embodiment of the invention provides a video color ring processing method, a device, a system and electronic equipment, which are used for solving the problems of poor system stability and poor playing effect of a video color ring playing method in the prior art.

In a first aspect, the present invention provides a video color ring processing method, applied to a first encoding device, where the method includes:

acquiring path information of a target video color ring in first file management equipment;

reading the target video color ring in the first file management equipment according to the path information;

and sending the target video color ring to media resource processing equipment, wherein the media resource processing equipment is used for sending the target video color ring to a session border controller SBC.

Optionally, obtaining path information of the target video color ring in the first file management device includes:

transmitting the audio identification of the target video color ring to the first file management equipment according to the audio identification of the target video color ring, and receiving the path information of the target video color ring transmitted by the first file management equipment according to the audio identification; the audio identification of the target video color ring is sent to the first coding device by the media resource control device; the first encoding device and the first file management device belong to the same target host;

or alternatively, the first and second heat exchangers may be,

and acquiring the path information of the target video color ring in the first file management equipment through a second coding equipment.

Optionally, obtaining, by the second encoding device, path information of the target video color ring in the first file management device includes:

receiving path information of the target video color ring in the first file management equipment sent by the second coding equipment;

the first encoding device is determined by the second encoding device according to the path information of the target video color ring and the load of the encoding device belonging to the same host as the first file management device; the second encoding device and the first file management device belong to the same host;

The path information of the target video color ring is obtained by the first file management equipment according to the audio identification of the target video color ring sent by the second coding equipment and is sent to the second coding equipment; the audio identification of the target video color ring is sent to the second encoding device by the media resource control device.

In a second aspect, an embodiment of the present invention further provides a video color ring processing method, applied to a first file management device, where the method includes:

and sending path information of the target video color ring to a first coding device, so that the first coding device reads the target video color ring in the first file management device according to the path information and sends the target video color ring to a media resource processing device, wherein the media resource processing device is used for sending the target video color ring to a session border controller SBC.

Optionally, before sending the path information of the target video color ring to the first encoding device, the method further includes:

acquiring an audio identifier of the target video color ring sent by the proxy equipment through a target naming module;

determining a target main node written by the target video color ring in the first file management equipment according to the audio identification of the target video color ring through a target naming module;

Writing the target video color ring back tone into the target main node through a data module;

wherein the target master node is the master node in the data module.

In a third aspect, an embodiment of the present invention further provides a video color ring processing apparatus, where the apparatus includes:

the first acquisition module is used for acquiring path information of the target video color ring in the first file management equipment;

the reading module is used for reading the target video color ring in the first file management equipment according to the path information;

the first sending module is used for sending the target video color ring back tone to media resource processing equipment, and the media resource processing equipment is used for sending the target video color ring back tone to a session border controller SBC.

In a fourth aspect, an embodiment of the present invention further provides a video color ring processing apparatus, where the apparatus includes:

the second sending module is used for sending the path information of the target video color ring to the first coding equipment, so that the first coding equipment reads the target video color ring in the first file management equipment according to the path information and sends the target video color ring to the media resource processing equipment, wherein the media resource processing equipment is used for sending the target video color ring to the session border controller SBC.

In a fifth aspect, an embodiment of the present invention further provides a video color ring processing system, including a first encoding device and a first file management device;

the first encoding device is configured to perform the steps in the video color ring processing method according to any one of the first aspect;

the first file management apparatus is configured to perform the steps in the video color ring processing method according to any one of the second aspects.

In a sixth aspect, an embodiment of the present invention further provides an electronic device, including: a transceiver, a memory, a processor, and a computer program stored on the memory and executable on the processor; the processor is configured to read a program in the memory to implement the steps in the video color ring processing method according to any one of the first aspect, or implement the steps in the video color ring processing method according to any one of the second aspect.

In a seventh aspect, an embodiment of the present invention further provides a computer readable storage medium, configured to store a computer program, where the computer program when executed by a processor implements the steps in the video color ring processing method according to any one of the first aspect, or implements the steps in the video color ring processing method according to any one of the second aspect.

In the scheme of the invention, the path information of the target video color ring in the first file management equipment is acquired through the first coding equipment, the target video color ring is read in the first file management equipment according to the path information, and the target video color ring is sent to the media resource processing equipment, so that the media resource processing sends the target video color ring to the session border controller SBC, the push flow of the target video color ring to the SBC is realized, and then the SBC controls the playing of the target color ring.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the description of the embodiments of the present invention will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort to a person of ordinary skill in the art.

Fig. 1 is a flowchart of interaction between a video color ring platform and user signaling provided by the invention;

fig. 2 is a flowchart of a video color ring processing method applied to a first encoding device according to an embodiment of the present invention;

FIG. 3 is an overall architecture diagram of an MRF provided by an embodiment of the present invention;

fig. 4 is a flowchart of a video color ring processing method applied to a first file management device according to an embodiment of the present invention;

fig. 5 is a specific flowchart of a video color ring processing method provided by an embodiment of the present invention;

FIG. 6 is an architecture diagram of an MRF-DFS provided by an embodiment of the present invention;

fig. 7 is a specific flowchart of writing video color ring provided in an embodiment of the present invention;

fig. 8 is a schematic structural diagram of a video color ring processing system according to an embodiment of the present invention;

fig. 9 is a schematic structural diagram of a video color ring processing apparatus according to an embodiment of the present invention;

fig. 10 is a second schematic structural diagram of a video color ring processing apparatus according to an embodiment of the present invention;

fig. 11 is a schematic structural diagram of a first encoding apparatus according to an embodiment of the present invention.

Detailed Description

The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

Before proceeding with the description of the specific embodiments of the present invention, the following description is first made:

technical shortcoming of NFS file system:

the NFS file system has high network IO, and particularly when video color ring scenes are played for massive users, video color ring files are frequently read, media data frame data are unpacked, and a large amount of network bandwidth is occupied.

NFS file systems have a single point of limitation, and when the NFS system is down, the entire file system is not available, and in a distributed system is a feature that has to be considered first.

The NFS file system has high concurrency efficiency and limited performance, and the disk IO performance of randomly reading files is reduced more under the condition of massive request due to the limitation of the disk IO performance of a single-point host.

NFS file system has poor lateral expansion capability, and is easy to cause limited storage capacity

The NFS file system caches the video color ring content without hot spots, and the video color ring file decapsulated data needs to be read every time. Although the disk also has the page cache function, the cache hit rate is too low and is not easy to manage in a massive random reading scene.

As shown in fig. 1, the flow of interaction and negotiation between the video color ring platform and the user signaling is as follows:

step 1-step 6: the calling domain sends out initial INVITE, the called domain IP multimedia system (IP Multimedia Subsystem, IMS) provincial color bell platform (autonomous system (autonomous system, AS)) receives the INVITE message, the color bell AS transmits the calling and called messages, and the reservation of the calling and called resources is completed.

Step 7-step 8: the called party returns to 180 to reach the called party home domain CRBT AS.

Step 9: the method comprises the steps that a color ring AS updates (update) a session description protocol (session description protocol, SDP) of color ring to a calling domain, at this time, the color ring AS needs to judge (1) whether a communication (contact) header domain in a calling initial INVITE message contains an image (video) tag or the SDP carries video media lines, if so, a video color ring media update request is initiated (a ring tone in a called user video ring tone library is played for a calling after a subsequent negotiation is successful), and a color ring platform AS is required to carry a local inter-network interconnection protocol (Internet Protocol, IP) and a port of a multimedia resource processor (Multimedia Resource Function Processor, MRFP) for selecting external convection, which are different from the traditional monomer architecture mode; if not, an audio color ring media update request is initiated (after the subsequent negotiation is successful, the ring in the called user audio ring library is played for the calling party). A switch (a video color ring negotiation judging switch) is required to be arranged for the judging platform, the switch is turned on by default, and when the switch is turned off, the platform initiates a video color ring media update request no matter whether a contact header field carries a video tag or is a video calling when the calling is called; (2) If the initial media negotiation of the calling party and the called party is video call (the media negotiation result in the step 6 is the right), a=sendrecv needs to be carried in the video media line, and a=sendrecv needs to be carried in the audio media line; if the initial media negotiation of the calling party and the called party is an audio call (the media negotiation result in step 6 is the right), a=sendonly needs to be carried in the video media line, and a=sendrecv needs to be carried in the audio media line. The media update message needs to carry a support: precondition, conf, and precondition negotiation of the required relevant parameters, not portable required: preconditioning.

Step 10: and the calling terminal replies 200 updates according to the self-capacity and the state, and if the calling terminal does not support the precondition, the precondition parameter in the updated message of the CRBT platform is ignored, and the CRBT platform supports correct processing of the response.

Step 11-step 12, optional step, if the video resource of the calling terminal is not reserved successfully in step 10, after the video resource is reserved, the calling terminal sends the resource confirmation message of step 11, and the CRBT AS responds. If the calling terminal can return the color ring media (the negotiation is video color ring or audio color ring) of the confirmed resources in the step 10, the steps 11 and 12 are omitted. The color ring AS side needs to set a timer, when the timer is overtime and the resource confirmation message of the terminal is not received, the color ring platform gives up to play the color ring, directly sends 180 messages, carries PEM (personal mobile) and plays the common ring back tone. The timer is set to 3 seconds by default and can be configured.

Step 13: the color ring AS plays audio or video color ring according to the media capability of the calling response (if the video media line attribute of the calling in the message of step 10 or step 11 is sendrecv, the color ring AS plays video color ring; if the video media line attribute of the calling in the message of step 10 or step 11 is inactive or set to 0, the color ring AS plays audio color ring), and forwards 180 the message, carrying PEM: sendrecv.

Step 14-step 17: the called UE replies 200OK after picking up the phone, the color bell AS stops playing the color bell, and replies ACK.

Step 18-step 19: the CRBT AS sends a re-INVITE request to the called UE, and does not carry SDP information.

Step 20-step 21: the called UE responds to the re-INVITE message. The terminal judges that the network switching or the video telephone audio off-hook does not occur locally, and the terminal replies the same media capability as the initial negotiation of the calling party or directly replies the full media capability. And (3) another note: the terminal may also reply with 200OK or 183, and the polyphonic ringtone platform should perform corresponding processing according to the SIP protocol. The present flowchart is described by taking a 200OK response as an example.

Step 22: and the color ring platform takes the media capability of the called party responding to the re-INVITE message as SDP offer to update the media to the calling party. Here, the color ring platform should match the media line type of the called SDP with the current call type of the calling side, and then send the media line type to the calling side. That is, if the SDP media line returned by the called party includes both audio and video, and the calling side call type is audio at this time, the polyphonic ringtone platform needs to place 0 on the video media line in the called SDP, and then send the called SDP to the calling party. If the media line type contained in the called SDP is matched with the media capability finally negotiated by the calling party in the initial media negotiation process, the media update is directly transmitted to the calling party without any modification.

Step 23: the calling party responds to the media update and returns 200OK.

Step 24-step 25: in the step 23 of judging the response of the calling party to the media update message, if the local state of the calling party has reached the expected state, the CRBT platform forwards called off-hook 200OK to the calling party; if the local state of the calling party does not reach the expected state, the CRBT platform decides whether to wait for the calling party to confirm resources and then forward the called party to take off hook 200OK according to the precondition parameter requirement; if the calling party answers in a non-preconditioning mode, the color ring platform directly forwards the called off-hook 200OK without judging.

Step 26-step 27: the polyphonic ringtone platform returns re-INVITE ACK to the called party, carrying SDP information of the calling party responding to the media update message in step 22. After receiving the message, if the terminal finds that the video media line port becomes 0, the terminal needs to prompt the called user: the caller has network switch and the video call will fall back to voice call.

It should be noted that: the black dots in fig. 1 and the subsequent flowcharts represent the corresponding network elements through which the respective messages pass.

Referring to fig. 2, fig. 2 is a flowchart of a video color ring processing method applied to a first encoding device according to an embodiment of the present invention, as shown in fig. 2, including the following steps:

Step 201: and acquiring path information of the target video color ring in the first file management equipment.

It should be noted that, the embodiment of the present invention provides a media resource function (Media Resource Function, MRF) based on a local file, and the overall architecture diagram of the MRF is shown in fig. 3.

The MRF main functional module comprises:

media resource function controller (Multimedia Resource Function Controller): providing a function of media resource control;

media resource function processor (Multimedia Resource Function Processor, MRFP): providing a media resource processing function;

encoding a working node (Codec Worker Node): media resource function encoder (Media Resource Function-Codec, MRF-Codec): providing a data frame, a coding and decoding conversion function for reading the media file; media resource function with distributed file system (Media Resource Function-Distributed File System, MRF-DFS): providing the functions of management, storage, file caching and the like of media resource files;

the main interfaces are as follows:

a Cr/Mr' interface between AS and MRF, transmitting session initiation protocol (Session initialization Protocol, SIP);

an Mb interface between a Media Gateway (MGW), a session border controller (Session Border Controller, SBC) and the MRF pushes Real-time transport protocols (Real-time Transport Protocol, RTP).

The embodiment of the invention realizes the process of selecting the local IP and port of the MRFP of the external convection carried by the CRBT platform AS in the step 9.

In this embodiment, the encoding device is MRF-Codec, and the file management device is MRF-DFS.

In this step, the first encoding device MRF-Codec obtains path information of the target video color ring file in the first file management device MRF-DFS, where the target video color ring is a color ring to be played.

Step 202: and reading the target video color ring in the first file management equipment according to the path information.

In the step, a first encoding device MRF-Codec reads target video color ring in a first file management device according to path information.

Step 203: and sending the target video color ring to media resource processing equipment, wherein the media resource processing equipment is used for sending the target video color ring to a session border controller SBC.

It should be noted that, the media resource processing device is an MRFP, the first encoding device MRF-Codec sends the target video color ring to the MRFP, the MRFP obtains a data frame of the target video color ring, and the data frame is processed by the RTP H264 packet to obtain an RTP media stream, and the RTP media stream is pushed to a next network element SBC, where the SBC is used to control playing of the target video color ring.

Optionally, in the case that the target video color ring is cached in the first file management device MRF-DFS, the path information includes a host address of the first host cached by the target video color ring and a query key of the target video color ring in the first file management device;

and/or the number of the groups of groups,

under the condition that the target video color ring is not cached in the first file management equipment MRF-DFS, the path information comprises a host address of a second host in a master node (master node) and a slave node (slave node) where the target video color ring is located and a file path of a file where the target video is located in the first file management equipment.

In an optional embodiment, obtaining path information of a target video color ring in a first file management device includes implementing one or two embodiments;

embodiment one: transmitting the audio identifier (toneId) of the target video color ring to the first file management equipment according to the audio identifier (toneId) of the target video color ring, and receiving the path information of the target video color ring, which is transmitted by the first file management equipment according to the audio identifier; the audio identification of the target video color ring is sent to the first coding device by the media resource control device; the first encoding device and the first file management device belong to the same target host.

Specifically, in this embodiment, the MRFC initiates a video color ring playing request of the target video color ring to the first encoding device MRF-Codec, where the video color ring playing request includes an audio identifier (toneId) of the target video color ring, and the first encoding device MRF-Codec sends a query request to the first file management device MRF-DFS according to the toneId, where the query request includes the toneId, and queries path information of the target video color ring file in the first file management device MRF-DFS. And a naming module (naming) in the first file management device MRF-DFS determines whether the target video color ring is cached according to the toneId, and returns the path information to the first encoding device MRF-Codec.

Embodiment two: and acquiring the path information of the target video color ring in the first file management equipment through a second coding equipment.

In this embodiment, the second encoding device MRF-Codec acquires path information of the target video color ring in the first file management device MRF-DFS, and sends the path information to the first encoding device MRF-Codec.

Further, in the second embodiment, obtaining, by a second encoding device, path information of the target video color ring in the first file management device includes:

Specifically, the MRFC initiates a video color ring playing request of the target video color ring to the second encoding device MRF-Codec, wherein the video color ring playing request comprises an audio identifier (toneId) of the target video color ring, the second encoding device MRF-Codec sends a query request to the first file management device MRF-DFS according to the toneId, the query request comprises the toneId, and the first file management device MRF-DFS queries path information of the target video color ring file. And a naming module (naming) in the first file management device MRF-DFS determines whether the target video color ring is cached according to the toneId, and returns the path information to the second encoding device MRF-Codec. And the second encoding device MRF-Codec determines a first encoding device MRF-Codec according to the path information of the target video color ring and the load of the encoding device belonging to the same host as the first file management device, namely selects a proper working node, and after determining the first encoding device MRF-Codec, the second encoding device MRF-Codec forwards the path information to the first encoding device MRF-Codec.

Further, a specific procedure of the second encoding apparatus determining the first encoding apparatus is specifically described:

the second encoding device is determined according to the path information and the load of the encoding device belonging to the same host as the first file management device.

And under the condition that the loads of the encoding devices belonging to the same host as the first file management device are higher than preset loads, namely, the loads of the encoding devices belonging to the same host as the first file management device are very high, determining a remote encoding node in the encoding device not belonging to the same host as the first file management device, specifically, determining the first encoding device in the encoding device not belonging to the same host as the first file management device according to the host address of the first host in the path information and the host address of the second host in the path information by the second encoding device according to the principle of closest address, wherein the first encoding device is the most suitable encoding device working node (MRF-code), and under the condition that the determined first encoding device is the remote encoding node, the first encoding device needs to read the target video color bell through network bandwidth IO.

And under the condition that the load of a third encoding device (one or more) is lower than or equal to a preset load in the encoding devices belonging to the same host as the first file management device, the second encoding device determines the first encoding device according to the host address of the first host in the path information, the second host address in the path information and the third encoding device, namely the second encoding device determines the first encoding device in the third encoding device according to the principle of the latest host address.

It should be noted that, the process of determining the first encoding device by the second encoding device may also be understood that the second encoding device obtains the path information, and determines that the first encoding device is the second encoding device according to the above-mentioned procedure, and then the embodiment of the present invention is implemented according to the first embodiment of the present invention.

In an optional embodiment, reading the target video color ring in the first file management device according to the path information includes:

under the condition that the first encoding equipment and the first file management equipment belong to the same host and the first file management equipment caches the target video color ring, the first encoding equipment reads the target video color ring in the first host according to the query key, namely, the first encoding equipment reads a local target video color ring file based on the query key in the path information, and traverses the local color ring file to obtain a data frame of the target video color ring;

Under the condition that the first coding equipment and the first file management equipment belong to the same host and the target video color ring is not cached in the first file management equipment, the first coding equipment reads the target video color ring according to the file path, namely, the first coding equipment reads a local target video color ring file based on the file path in the path information, and traverses the local color ring file to obtain a data frame of the target video color ring;

and under the condition that the first coding equipment and the first file management equipment do not belong to the same host, the first coding equipment reads the target video color ring in the first file management equipment according to the host address of the second host.

Further, according to the host address of the second host, reading the target video color ring in the first file management device includes:

and determining the host address of the target host in the host address of the second host by utilizing a preset random algorithm, and reading the target video color ring according to the host address of the target host.

Specifically, the first encoding device uses a random algorithm to host addresses of a master node and a second host of a slave node in the path information, determines a host address of a target host, initiates a read request to the target host, and reads the target video color ring.

In an alternative embodiment, the target video coloring ring back tone is sent to a media resource processing device, and before the media resource processing is used to send the target video coloring ring back tone to a session border controller SBC, the method further includes:

acquiring a real-time transmission protocol RTP data format corresponding to the target color ring video, specifically, in the optional embodiment, AS sends video color ring playing parameters to MRFC, wherein the video color ring playing parameters comprise RTP data format, MRFC sends video color ring playing parameters to first encoding equipment or second encoding equipment, and the second encoding equipment forwards the video color ring playing parameters to the first encoding equipment under the condition that MRFC sends the video color ring playing parameters to the second encoding equipment;

the first encoding device compares the RTP data format with the data format of the target video color ring to obtain a comparison result, the comparison result is used for indicating whether the data frame picture of the target video color ring needs to be processed, when the comparison result indicates that the RTP data format is inconsistent with the data format of the target video color ring, the target video color ring is subjected to superposition processing and/or transcoding processing to obtain processed target video data, and then the first encoding device sends the processed target video data to media resource processing equipment MRFP so that the MRFP obtains the processed target video data, and the RTP media stream is pushed to a next network element SBC after RTP H264 package.

Referring to fig. 4, fig. 4 is a flowchart of a video color ring processing method applied to a first file management device according to an embodiment of the present invention, as shown in fig. 4, including the following steps:

step 401: and sending path information of the target video color ring to a first coding device, so that the first coding device reads the target video color ring in the first file management device according to the path information and sends the target video color ring to a media resource processing device, wherein the media resource processing device is used for sending the target video color ring to a session border controller SBC.

In this step, the first file management device MRF-DFS sends the path information of the target video color ring to the first encoding device MRF-Codec, so that the first encoding device MRF-Codec obtains the path information of the target video color ring. The target video color ring is the color ring to be played.

In an optional embodiment, the first file management apparatus sends path information of the target video color ring to the first encoding apparatus, including an implementation three or an implementation four;

and a real-time mode III: and receiving the audio identification of the target video color ring sent by the first coding equipment, and sending the path information of the target video color ring to the first coding equipment according to the audio identification. Specifically, in this embodiment, the MRFC initiates a video color ring playing request of the target video color ring to the first encoding device MRF-Codec, where the video color ring playing request includes an audio identifier (toneId) of the target video color ring, and the first encoding device MRF-Codec sends a query request to the first file management device MRF-DFS according to the toneId, where the query request includes the toneId, and queries path information of the target video color ring file in the first file management device MRF-DFS. And a naming module (naming) in the first file management device MRF-DFS determines whether the target video color ring is cached according to the toneId, and returns the path information to the first encoding device MRF-Codec.

Embodiment four: and transmitting the path information of the target video color ring to the first coding equipment through the second coding equipment.

Further, in the fourth embodiment, the sending, by the second encoding device, the path information of the target video color ring to the first encoding device includes:

receiving an audio identifier of the target video color ring sent by the second coding equipment;

transmitting the path information of the target video color ring to the second coding equipment according to the audio identification, wherein the second coding equipment is used for transmitting the path information of the target video color ring to the first coding equipment;

the first encoding device is determined by the second encoding device according to the path information of the target video color ring and the load of the encoding devices of the first file management device belonging to the same host; the second encoding device and the first file management device belong to the same host.

The following describes a specific flow of the video color ring processing method provided by the embodiment of the present invention with a specific embodiment, as shown in fig. 5:

step 1: the MRFC randomly initiates a video color ring playing request to a second encoding device MRF-Codec, and obtains video color ring playing parameters sent by the AS, wherein the video color ring playing parameters comprise RTP data formats;

step 2: the second encoding device MRF-Codec sends a query request to the first file management device MRF-DFS, wherein the query request comprises an audio identifier toneId of the target video color ring;

step 3: the first file management device MRF-DFS returns the path information of the target video color ring to the second coding device MRF-Codec according to the toneId;

step 4: the second encoding device MRF-Codec determines the most suitable first encoding device MRF-Codec (work) according to the path information;

step 5: the second encoding device MRF-Codec forwards the path information and the video color ring playing parameters to the first encoding device MRF-Codec (work);

step 6: the first coding device MRF-Codec (work) reads the target video color ring according to the path information;

step 7: the first coding device MRF-Codec (work) compares the RTP data format with the file data format of the target video color ring to obtain a comparison result;

Step 8: superposing and/or transcoding the target video color ring according to the comparison result;

step 9: the first coding device MRF-Codec (work) sends the processed target video color ring back tone to MRFP;

step 10: MRFP obtains the processed target video color ring, and pushes RTP media flow to the next network element SBC through RTP H264 package.

It should also be noted that the embodiment of the invention also provides a video color ring writing method.

An architecture diagram of the first file management apparatus MRF-DFS is shown in FIG. 6.

The main functional modules of the first file management device MRF-DFS include:

naming module: metadata management of video color ring files, slot position relation management of a host and a virtual slot, master-slave node relation management of the virtual slot, cluster management and fault discovery and management;

data (Storage) module: managing the reading, writing and deleting operations of the video color ring;

and the Cache module is used for: for frequently read video color ring files, the whole file content can be loaded into a memory, so that the reading speed is increased, and the IO (input/output) expense of a disk is reduced;

Admin/User control module: an operation console for an administrator and an ordinary person;

rest API module: is respectively connected with a Write agent device (Write Client) and a Read agent device (Read Client); the Write agent device (Write Client) may be a first encoding device.

The MRF-DFS also includes an MRF-DFS core module, etc.

In an optional embodiment of the present invention, before sending the path information of the target video color ring to the first encoding device, the method further includes:

acquiring an audio identifier of the target video color ring sent by a proxy device (namely a Write Client) through a target Naming module Namine, specifically, the proxy device (namely the Write Client) initiates a search request to Namine of a first file management device MRF-DFS, wherein the search request comprises an audio identifier toneId of the target video color ring; determining a target master node (master node) written by the target video color ring in the first file management device according to the audio identification of the target video color ring by a target Naming module Naming, wherein the target master node is a master node in the Data module, a proxy device (namely a Write Client) initiates a Write request to the Data module (Data (Storage)), the first file management device writes the target video color ring into the target master node through the Data module (Data (Storage)) according to the Write request, after the Write is successful, the target master node returns a successful ack message, and if the Write is failed, returns a failed ack message.

Further, determining, by a target naming module, a target host node written by the target video color ring in the first file management device according to the audio identifier of the target video color ring, including:

And carrying out hash operation according to the audio identifier of the target video color ring through a target Naming module to obtain a virtual departure slot where the target video color ring is located, specifically, carrying out hash operation on the toneId of the color ring by using a CRC16 hash algorithm by using Naming to obtain a hash value, acquiring a corresponding departure slot according to the hash value, determining a main node where the virtual departure slot is located as the target main node through the target Naming module, and returning the target main node to the proxy equipment.

In an alternative embodiment, writing the target video color ring to the target host node through a data module includes:

the method comprises the steps that a writing request sent by proxy equipment is received through a Data module, the target video color ring is written into a target main node through the Data module according to the writing request, specifically, the proxy equipment (namely a Write Client) initiates a writing request to the Data module (Data (Storage)), and the first file management equipment writes the target video color ring into the target main node through the Data module (Data (Storage)) according to the writing request.

In an alternative embodiment, the method further comprises:

and synchronizing the target video color ring to the slave node corresponding to the target master node through the target master node, namely after the target video color ring file is written into the target master node, asynchronously initiating synchronization of all the slave nodes by the target master node. It should be noted that, the above flow is an asynchronous flow, and does not affect the writing flow of the proxy device or the return of the ack message.

The slave node corresponding to the target master node refers to a node belonging to the same MRF-DFS cluster as the target master node.

Further, the method further comprises:

sending indication information to proxy equipment through the target main node, wherein the indication information is ack information indicating successful writing or ack information indicating failed writing; and the proxy equipment encapsulates the indication information and then sends the indication information to a target Naming module Naming, the indication information sent by the proxy equipment is received through the target Naming module, and if the ack information in the indication information is the indication writing success, the target Naming module sends the indication information to Naming nodes except the target Naming module in the first file management equipment or writes the indication information into a database for persistence processing.

The indication information is used for indicating the target video color ring to be written into the target main node.

The following specifically describes a specific procedure of writing video color ring in with reference to fig. 7:

step 1: the agent equipment (Client) initiates an addressing request (address) to a Namine, a target Naming module Namine uses a CRC16 hash algorithm to operate on the toneId of the CRBT, the Namine obtains a virtual departure slot and a target main node of the slot according to the hash value, and a result is returned to the Client;

Step 2: the Client initiates a write request (write) to a Data module (Data), after the write is successful, the Data returns an ack message, and if the Data fails, the Data returns a failed ack message;

step 3: the target master node asynchronously initiates synchronization of all slave nodes;

step 4: and after packaging the ack message, the Client sends the ack message to a target Naming module Namine, and if the ack is a successful result, the target Naming module Namine synchronizes the detailed information of the file to other Namine nodes according to a consistency protocol or writes the detailed information into a database for persistence.

In summary, in the embodiment of the invention, the video color ring file management scheme is as follows:

the color ring file still exists as a separate storage file, which is the smallest unit of storage;

the method comprises the steps that a CRC16 hash algorithm is used by Namine to carry out hash operation on the toneId of the CRBT, virtual off slots are obtained according to the calculated hash result, 16384 virtual slots are fixed, and compared with other technologies, the virtual slot technology is selected, so that file addition, deletion and migration among clusters are easier;

the primary directory of the MRF-DFS file system is a virtual slot value, the secondary directory is a file type, and the file types can be divided into: video (Video), audio (Audio), picture (Picture) and Document (Document), and a directory is sequentially formed by every 6 digits according to the 18-bit color ring tone toneId, and is used as a three-level, four-level and five-level directory of a file system.

Namine manages metadata of all files, including complete file name, file size, creation time, file type, etc.;

at least one file is stored in a master node of the MRF-DFS, and if a plurality of slave nodes exist, the MRF-DFS is required to provide a master-slave synchronization mechanism guarantee;

the MRF-DFS writes the color ring file, and the color ring file is successfully written only by writing the master node, so that attention to a slave node is not required;

MRF-DFS reads the CRBT file, master and slave nodes can read and operate, the limit of the disk reading performance of a single machine is broken through, and the reading performance and high concurrency capacity of the whole system are improved.

The embodiment of the invention solves the problems of network IO, single-point limitation, high concurrency performance and the like encountered in the MRF media resource playing platform based on the NFS file system by constructing the MRF-DFS of the distributed video color ring file system based on the local file. Meanwhile, the traditional MRF system is vertically split into three service modules, namely a media resource control MRFC, a media coding and decoding MRF-Codec and a media resource processing MRFP, from the service level, and the split enables each system of the MRF system to meet a single responsibility principle more clearly in terms of the architecture level, so that the running stability of the system is improved; for the whole service layer, because the media signaling negotiation between the CRBT AS and the user terminal needs to push the media RTP stream source address and port, the MRF-DFS file system is easier to integrate with the whole MRF system, the media signaling negotiation only needs to consider MRFP nodes, MRF-Codec only needs to address a master and a slave nodes where the CRBT file is located, the MRF single-architecture signaling negotiation source host is not the same with the host where the video CRBT file is located, and the data frame of the read CRBT file does not pass through the network.

The embodiment of the invention constructs a distributed CRBT file system based on a local file, and simultaneously constructs and optimizes a traditional MRF media resource playing platform, so that the system is more convenient to integrate with a newly added distributed CRBT file system, the defects and performance problems based on an NFS file system are solved, the running stability of the system is improved, and the video CRBT playing experience of a user is improved.

As shown in fig. 8, the embodiment of the present invention further provides a video color ring processing system, which includes a first encoding device 801 and a first file management device 802;

the first encoding device 801 is configured to perform steps in the video color ring processing method shown in fig. 1;

the first file management apparatus 802 is configured to perform steps in the video color ring processing method as shown in fig. 2.

Specifically, the first encoding apparatus 801 is configured to:

Optionally, the first encoding device 801 is specifically configured to:

or alternatively, the first and second heat exchangers may be,

Optionally, the first encoding device 801 is specifically configured to:

Specifically, the first file management apparatus 802 is configured to:

and sending the path information of the target video color ring to the first coding equipment.

Optionally, the first file management apparatus 802 is further configured to:

wherein the target master node is the master node in the data module.

It should be noted that, the video color ring processing system provided by the embodiment of the present invention is capable of executing the steps of the video color ring processing method, so all embodiments of the video color ring processing method are applicable to the system, and the same or similar technical effects can be achieved.

As shown in fig. 9, an embodiment of the present invention further provides a video color ring processing apparatus, where the apparatus includes:

the first obtaining module 901 is configured to obtain path information of a target video color ring in the first file management device;

a reading module 902, configured to read the target video color ring in the first file management device according to the path information;

a first sending module 903, configured to send the target video coloring ring back tone to a media resource processing device, where the media resource processing device is configured to send the target video coloring ring back tone to a session border controller SBC.

Optionally, the first obtaining module 901 includes: a first processing unit;

the first processing unit is used for:

Or alternatively, the first and second heat exchangers may be,

Optionally, the first processing unit is specifically configured to:

It should be noted that, the video color ring processing apparatus provided by the embodiment of the present invention is an apparatus capable of executing the video color ring playing method applied to the first encoding device, so all embodiments of the video color ring playing method applied to the first encoding device are applicable to the apparatus, and the same or similar technical effects can be achieved, and the implementation principle and the technical effects are similar, and are not repeated here.

As shown in fig. 10, an embodiment of the present invention further provides a video color ring processing apparatus, where the apparatus includes:

the second sending module 1001 is configured to send path information of a target video color ring to a first encoding device, so that the first encoding device reads the target video color ring in the first file management device according to the path information, and sends the target video color ring to a media resource processing device, where the media resource processing device is configured to send the target video color ring to a session border controller SBC.

Optionally, the apparatus further comprises:

the second acquisition module is used for acquiring the audio identification of the target video color ring sent by the proxy equipment through the target naming module;

the first processing module is used for determining a target main node written in the first file management device by the target video color ring through the target naming module according to the audio identification of the target video color ring;

the writing module is used for writing the target video color ring back tone into the target main node through the data module;

wherein the target master node is the master node in the data module.

It should be noted that, the video color ring processing apparatus provided by the embodiment of the present invention applied to the first file management device is an apparatus capable of executing the video color ring processing method applied to the first file management device, so all embodiments of the video color ring processing method applied to the first file management device are applicable to the apparatus, and the same or similar technical effects can be achieved, and the implementation principle and the technical effects are similar, which are not repeated herein.

As shown in fig. 11, an embodiment of the present invention provides an electronic device, which is a first encoding device, including: a transceiver 1110, a memory 1120, a bus interface, a processor 1100, and a computer program stored on the memory 1120 and executable on the processor 1100; a processor 1100 for reading the program in the memory 1120, a transceiver 1110 for receiving and transmitting data under the control of the processor 1100.

The processor 1100 performs the following process:

Optionally, the transceiver 1110 is configured to:

Or alternatively, the first and second heat exchangers may be,

the processor 1100 is configured to:

Optionally, the transceiver 1110 is specifically configured to:

Wherein in fig. 11, a bus architecture may comprise any number of interconnected buses and bridges, and in particular one or more processors represented by processor 1100 and various circuits of memory represented by memory 1120, linked together. The bus architecture may also link together various other circuits such as peripheral devices, voltage regulators, power management circuits, etc., which are well known in the art and, therefore, will not be described further herein. The bus interface provides a user interface 1130. The transceiver 1110 may be a number of elements, including a transmitter and a transceiver, providing a means for communicating with various other apparatus over a transmission medium. The processor 1100 is responsible for managing the bus architecture and general processing, and the memory 1120 may store data used by the processor 1100 in performing operations.

The processor 1100 is responsible for managing the bus architecture and general processing, and the memory 1120 may store data used by the processor 1100 in performing operations.

The embodiment of the invention also provides an electronic device, which is a first file management device, comprising: a transceiver, a memory, a bus interface, a processor, and a computer program stored on the memory and executable on the processor; a processor for reading the program in the memory, a transceiver for receiving and transmitting data under the control of the processor.

The structure of the first file management apparatus provided in the embodiment of the present invention is similar to that of the first encoding apparatus shown in fig. 11, and will not be described herein.

The transceiver performs the following process:

Optionally, the processor is further configured to:

wherein the target master node is the master node in the data module.

Those skilled in the art will appreciate that all or part of the steps of implementing the above-described embodiments may be implemented by hardware, or may be implemented by instructing the relevant hardware by a computer program comprising instructions for performing some or all of the steps of the above-described methods; and the computer program may be stored in a readable storage medium, which may be any form of storage medium.

In addition, the specific embodiment of the present invention further provides a computer readable storage medium, on which a computer program is stored, where the program when executed by a processor implements the steps in the video color ring processing method, and the same technical effects can be achieved, so that repetition is avoided, and no further description is given here.

In the several embodiments provided in this application, it should be understood that the disclosed methods and apparatus may be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may be physically included separately, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in hardware plus software functional units.

The integrated units implemented in the form of software functional units described above may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium, and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform part of the steps of the transceiving method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

While the foregoing is directed to the preferred embodiments of the present invention, it will be appreciated by those skilled in the art that various modifications and adaptations can be made without departing from the principles of the present invention, and such modifications and adaptations are intended to be comprehended within the scope of the present invention.

Claims

1. A method for processing a video color ring, which is applied to a first encoding device, the method comprising:

2. The method for processing video color ring back tone according to claim 1, wherein obtaining path information of a target video color ring back tone in the first file management apparatus comprises:

Or alternatively, the first and second heat exchangers may be,

3. The method for processing video color ring back tone according to claim 2, wherein obtaining path information of the target video color ring back tone in the first file management apparatus by a second encoding apparatus comprises:

4. A method for processing a video color ring, which is applied to a first file management device, the method comprising:

5. The method for processing video color ring according to claim 4, wherein before transmitting the path information of the target video color ring to the first encoding device, the method further comprises:

wherein the target master node is the master node in the data module.

6. A video color ring processing apparatus, the apparatus comprising:

7. A video color ring processing apparatus, the apparatus comprising:

8. The video color ring processing system is characterized by comprising a first encoding device and a first file management device;

the first encoding device is configured to perform the steps in the video color ring processing method according to any one of claims 1 to 3;

the first file management apparatus is configured to perform the steps in the video color ring processing method as set forth in claim 4 or 5.

9. An electronic device, comprising: a transceiver, a memory, a processor, and a computer program stored on the memory and executable on the processor; the method is characterized in that the processor is used for reading a program in a memory to realize the steps in the video color ring processing method according to any one of claims 1 to 3 or realize the steps in the video color ring processing method according to claim 4 or 5.

10. A computer readable storage medium storing a computer program, wherein the computer program when executed by a processor implements the steps of the video color ring processing method according to any one of claims 1 to 3, or the steps of the video color ring processing method according to claim 4 or 5.