CN110717137B - Message distribution processing method and message system - Google Patents
Message distribution processing method and message system Download PDFInfo
- Publication number
- CN110717137B CN110717137B CN201910957067.7A CN201910957067A CN110717137B CN 110717137 B CN110717137 B CN 110717137B CN 201910957067 A CN201910957067 A CN 201910957067A CN 110717137 B CN110717137 B CN 110717137B
- Authority
- CN
- China
- Prior art keywords
- message
- distributed
- messages
- different
- platform
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24553—Query execution of query operations
- G06F16/24554—Unary operations; Data partitioning operations
- G06F16/24556—Aggregation; Duplicate elimination
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9535—Search customisation based on user profiles and personalisation
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The application provides a message distribution processing method and a message system. The message distribution processing method comprises the following steps: obtaining a plurality of messages transmitted by different message sources; wherein each of the messages has a corresponding message tag; according to the message labels, performing aggregation processing on the plurality of messages to generate a message set to be distributed, wherein the message set to be distributed comprises messages to be distributed which respectively correspond to different message labels; and distributing the message to be distributed. In the application, after obtaining a plurality of messages transmitted by different message sources, the obtained messages are aggregated based on the message labels of each message, and a to-be-distributed message set including the message labels respectively corresponding to the different message labels is generated. And then the message to be distributed is distributed. Compared with the prior art, the message distribution processing method can classify the obtained message and distribute the message to be distributed according to the classification result, so that the situations of message mistransmission and missed transmission are reduced.
Description
Technical Field
The present application relates to the field of data processing, and in particular, to a method and a system for distributing and processing a message.
Background
How to distribute the criminal information results of all platforms to all the case handling departments through the message platform becomes a crucial part for breaking cases. The existing message platform simply transmits the obtained message, does not manage the message, and often causes the situations of error transmission and missing transmission.
Disclosure of Invention
An object of the embodiments of the present application is to provide a method and a system for distributing and processing a message, so as to solve the problem that an existing message platform simply transmits a message after acquiring the message, does not manage the message, and often causes a situation of misdelivery and missed delivery.
The invention is realized by the following steps:
in a first aspect, an embodiment of the present application provides a method for distributing and processing a message, where the method includes: obtaining a plurality of messages transmitted by different message sources; wherein each of the messages has a corresponding message tag; according to the message labels, performing aggregation processing on the plurality of messages to generate a message set to be distributed, wherein the message set to be distributed comprises messages to be distributed which respectively correspond to different message labels; and distributing the message to be distributed.
In the application, after obtaining a plurality of messages transmitted by different message sources, the obtained messages are aggregated based on the message labels of each message, and a to-be-distributed message set including the message labels respectively corresponding to the different message labels is generated. And then the message to be distributed is distributed. Compared with the prior art, the message distribution processing method provided by the embodiment of the application can classify the obtained message and distribute the message to be distributed according to the classification result, so that the situations of message mistransmission and missed transmission are reduced.
With reference to the technical solution provided by the first aspect, in some possible implementation manners, the message tag includes a message type and a message generation time, and the aggregating, according to the message tag, the multiple messages to generate a to-be-distributed message set including to-be-distributed messages respectively corresponding to different message tags includes: according to the message type, aggregating the plurality of messages to generate the message to be distributed; and sequencing the messages to be distributed with the same message type according to the message generation time, and forming the message set to be distributed by respectively corresponding to the messages to be distributed with different message types.
According to the message distribution method and device, the messages to be distributed with the same message types are sequenced according to the message generation time, so that the messages to be distributed can be conveniently distributed by the subsequent message platform based on the message generation time, the message distribution timeliness can be improved, and the situation that the messages are not distributed in time when being obtained very early due to the message random distribution mode is avoided.
With reference to the technical solution provided by the first aspect, in some possible implementation manners, before the distributing the message to be distributed, the method further includes: and performing semantic intervention on the content of the message to be distributed.
In the application, semantic intervention is performed in the content of the message to be distributed, so that the content of the distributed message is in accordance with the specification and/or is easily identified to personnel in the industry.
With reference to the technical solution provided by the first aspect, in some possible implementation manners, the performing semantic intervention on the content of the message to be distributed includes acquiring sensitive words in the content of the message to be distributed; and replacing the sensitive words with preset characters.
In the method and the device, sensitive words in the content of the message to be distributed are obtained, and then the sensitive words are replaced by preset characters, so that the message distributed subsequently is in accordance with the regulations.
With reference to the technical solution provided by the first aspect, in some possible implementation manners, the performing semantic intervention on the content of the message to be distributed includes acquiring a keyword in the content of the message to be distributed; and replacing the keywords with preset words.
In the method and the device, the keywords in the content of the message to be distributed are obtained, and then the keywords are replaced by the preset words, so that the identification of personnel in the industry is facilitated.
With reference to the technical solution provided by the first aspect, in some possible implementations, the message platform includes a search engine; correspondingly, before the distributing the message to be distributed, the method further includes: and storing the set of messages to be distributed in the search engine.
In the application, the message set to be distributed is stored in the search engine, so that the management of the message to be distributed is realized, and the control of the process is enhanced.
With reference to the technical solution provided by the first aspect, in some possible implementation manners, the obtaining multiple messages transmitted by different message sources includes: and actively acquiring the plurality of messages transmitted by the different message sources according to the protocol interfaces corresponding to the different message sources.
In the application, different protocol interfaces are set to actively acquire the messages in each message source. The problems that some message sources cannot transmit messages to the message platform in time after acquiring related messages, so that the messages acquired by the message platform are incomplete, information channels acquired by the message platform are incomplete and the like are solved.
With reference to the technical solution provided by the first aspect, in some possible implementation manners, after the actively acquiring the multiple messages transmitted by the different message sources, the method further includes: acquiring response time of actively acquiring each message transmitted by different message sources; judging whether the response time is greater than a preset threshold value or not; if yes, an early warning is sent out.
According to the method and the device, the response time for actively acquiring each message transmitted by different message sources is judged by setting the preset threshold, so that the performance of actively acquiring data by a message platform is detected, and the optimization of a subsequent message platform is facilitated.
With reference to the technical solution provided by the first aspect, in some possible implementation manners, the message tag further includes a message delivery manner, and correspondingly, the distributing the message to be distributed includes: and distributing the message to be distributed according to the message transmission mode of the message to be distributed.
In the application, the message to be distributed is distributed according to the message transmission mode of the message to be distributed, so that the message can be conveniently consulted.
In a second aspect, an embodiment of the present application provides a message system, which includes a message platform and multiple message sources, where the message platform is communicatively connected to the multiple message sources, and the message platform is configured to execute a method as provided in the foregoing first aspect and/or in combination with some possible implementations of the foregoing first aspect.
In a third aspect, an embodiment of the present application provides a server, including: a processor and a memory, the processor and the memory connected; the memory is used for storing programs; the processor is configured to invoke a program stored in the memory to perform a method as provided in the above-described first aspect embodiment and/or in combination with some possible implementations of the above-described first aspect embodiment.
In a fourth aspect, embodiments of the present application provide a storage medium, on which a computer program is stored, where the computer program, when executed by a processor, performs the method as provided in the foregoing first aspect embodiment and/or in connection with some possible implementations of the foregoing first aspect embodiment.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
Fig. 1 is a schematic structural diagram of a message system according to an embodiment of the present application.
Fig. 2 is a schematic structural diagram of a server according to an embodiment of the present application.
Fig. 3 is a flowchart illustrating steps of a method for distributing and processing a message according to an embodiment of the present application.
Fig. 4 is a flowchart illustrating steps of another message distribution processing method according to an embodiment of the present application.
Icon: 100-a message system; 10-a message platform; 20-a message source; 101-a server; 111-a processor; 112-a memory; 113-communication bus.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. It is to be understood that the embodiments described are only a few embodiments of the present application and not all embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations.
The applicant found that: the existing message platform simply transmits the obtained message, does not manage the message, and often causes the situations of error transmission and missing transmission.
In view of the above problems, the applicant has conducted research and research to propose the following embodiments to solve the above problems.
Referring to fig. 1, a messaging system 100 is provided in an embodiment of the present application. The messaging system 100 includes a messaging platform 10 and a plurality of message sources 20. The message platform 10 is connected to the plurality of message sources 20 in a communication manner, that is, the message platform 10 and the plurality of message sources 20 implement data interaction through a network. It is understood that the data interaction between the message platform 10 and the message source 20 may be the message platform 10 actively acquiring the information of the message source 20, or the message platform 10 passively receiving the information transmitted by the message source 20, which is not limited in this application.
It should be noted that the message source 20 is some information platforms, such as police logistics platform, smart city, poison prohibition platform, robbery platform, police cloud platform, and so on. It should be explained that the smart city originates from the media field, which means that various information technologies or innovative concepts are utilized to make the system and service of the city open and integrated, so as to improve the efficiency of resource utilization, optimize the city management and service, and improve the quality of life of citizens. The smart city is a city informatization advanced form which fully applies a new generation of information technology to various industries in the city and is based on the innovation of the next generation of knowledge society, and the informatization, industrialization and urbanization deep fusion are realized.
The information platform includes various different types of data information, and the data information includes logistics messages, mail messages, short message messages, and the like. The message platform 10 is used to obtain messages from the various message sources 20. And then identifying the message, and sending the message containing the criminal information to a case handling department through a message platform.
It should be noted that the message platform 10 is formed by a server 101, and referring to fig. 2, the server 101 includes at least one processor 111, at least one memory 112, and at least one communication bus 113. Wherein the communication bus 113 is used for realizing direct connection communication of these components. The Memory 112 may be a high-speed RAM Memory, a non-volatile Memory (non-volatile Memory) or an Erasable Read-Only Memory (EPROM), and for example, the Memory 112 may be at least one disk Memory. The memory 112 has stored therein computer readable instructions. The processor 111 is used to execute executable modules stored in the memory 112. For example, the processor 111 is configured to obtain a plurality of messages transmitted by different message sources; wherein each of the messages has a corresponding message tag. The processor 111 is further configured to perform aggregation processing on the multiple messages according to the message tags, and generate a to-be-distributed message set including to-be-distributed messages respectively corresponding to different message tags. The processor 111 is further configured to distribute the message to be distributed.
The processor 111 may be an integrated circuit chip having signal processing capabilities. For example, the Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components. The various methods, steps, and logic blocks disclosed in the embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
Referring to fig. 3, an embodiment of the present application provides a method for distributing and processing a message, which is applied to the message platform 10 in the message system 100. The method comprises the following steps: step S101-step S103.
Step S101: a plurality of messages transmitted by different message sources is obtained.
In the above description, it is stated that the message source is some information platform, such as police logistics platform, smart city, poison banning platform, robbery platform, police cloud platform, etc., and the information platform includes various different types of data information, and the data information includes logistics message, mail message, short message, etc. Therefore, first, the message platform will get the messages in each message source. Wherein the messages in each message source have a corresponding message tag. Such as the source of the message (the source indicates from which information platform the obtained message was obtained), the type of the message (such as a wanted message, a peace message, a fraud message, etc.), the moment of generation of the message, the distribution point of the message (the office where the message needs to be distributed), etc.
Step S102: and according to the message labels, performing aggregation processing on the plurality of messages to generate a message set to be distributed, which comprises messages to be distributed corresponding to different message labels respectively.
After a plurality of messages transmitted by different message sources are acquired, the messages are aggregated according to the message labels of each message, and a message set to be distributed, which comprises messages to be distributed corresponding to different message labels, is generated.
It can be understood that, according to the message tag, the aggregation processing is performed on the multiple messages, and may be to classify the multiple messages according to the message tag, or combine the messages classified into the same class after classifying the multiple messages according to the message tag, which is not limited in this application.
For example, when classifying a plurality of messages according to the message tags, the generated message set to be distributed includes a plurality of message subsets to be distributed, and the messages of each message subset to be distributed have the same message tag.
The message tag may be a message type, a message source, a message destination, and the like.
Taking the example that the aggregation processing of the plurality of messages according to the message tags is classified according to the message tags as an example, when the message tags are of the message type, the aggregation processing of the plurality of messages according to the message type is performed, and a message set to be distributed, which comprises message subsets to be distributed and respectively corresponds to different message types, is generated. The messages in each generated message subset to be distributed in the message set to be distributed have the same message type, for example, the messages in a certain message subset to be distributed are both wanted-virus messages, and for example, the messages in a certain message subset to be distributed are both public security messages.
Taking the example that the aggregation processing of the plurality of messages according to the message tags is to classify the plurality of messages according to the message tags, when the message tags are message sources, the aggregation processing of the plurality of messages according to the message sources is performed, and a message set to be distributed, which includes message subsets to be distributed corresponding to the sources of different messages respectively, is generated. Each message in each message to be distributed subset in the generated message to be distributed set has the same source of the message, for example, the message in a certain message to be distributed subset is from the police logistics platform, and for example, the message in a certain message to be distributed subset is from the smart city.
Step S103: and distributing the message to be distributed.
After the message set to be distributed is generated, the message subset to be distributed generated according to the classification of the message labels in the message set to be distributed or the message to be distributed generated after the message set to be distributed is classified according to the message labels and the messages classified into the same class are combined are distributed. To distribute the message to the office. Such as distributing a messages to police departments, distributing B messages to scientific institutions, and so on.
In the above embodiment, after obtaining a plurality of messages transmitted by different message sources, the obtained messages are aggregated based on the message tag of each message, and a to-be-distributed message set including to-be-distributed messages (to-be-distributed message subsets) respectively corresponding to different message tags is generated. And then the message to be distributed (the subset of the message to be distributed) is distributed. Compared with the prior art, the message distribution processing method provided by the embodiment of the application can classify the obtained message and distribute the message to be distributed according to the classification result, so that the situations of message mistransmission and missed transmission are reduced.
In practical research, the applicant also finds that after the message platform is built, when the message platform is in butt joint with a message source, the message needs to be transmitted by operation and maintenance personnel behind the message sources. For example, police logistics platforms, smart cities and poison prevention platforms all have operation and maintenance teams to perform operation and maintenance in real time, and after the platforms acquire messages, the messages are sent to the message platforms through operation and maintenance personnel. And the robbery platform and the police service cloud platform may not have an operation and maintenance team to carry out real-time operation and maintenance. Therefore, after the robbery platform and the police cloud platform acquire the related messages, the messages cannot be transmitted to the message platform in time. Therefore, the problems that the information acquired by the information platform is incomplete, the information channel acquired by the information platform is incomplete and the like are caused.
Therefore, as an optional implementation manner, the step S101 may include: and actively acquiring the plurality of messages transmitted by the different message sources according to the protocol interfaces corresponding to the different message sources.
Namely, different protocol interfaces are set to actively acquire the messages in each message source. The embodiment of the application provides protocol interfaces such as HTTP, MQ (Kafka, RabbitMQ and the like), SQL (Mysql, Oracle, Pgsql and the like), Socket, Netty and the like.
The following explains the important words.
HTTP is a simple request-response Protocol that typically runs on top of the Transmission Control Protocol (TCP). It specifies what messages the client may send to the server and what responses to get.
MQ is a method of application-to-application communication. Applications communicate by writing and retrieving queued data (messages) for the application without requiring a dedicated connection to link them. Message passing refers to the communication between programs by sending data in a message, rather than communicating with each other through direct calls, which are often used for techniques such as remote procedure calls. Queuing refers to the application communicating through a queue. The use of queues removes the requirement that the receiving and sending applications execute simultaneously.
SQL (Structured Query Language), a special purpose programming Language, is a database Query and programming Language for accessing data and querying, updating, and managing relational database systems.
socket is an abstraction layer through which an application can send or receive data, and can perform operations such as opening, reading, writing, and closing on the application like a file. Sockets allow applications to plug I/O into the network and communicate with other applications in the network. A network socket is a combination of an IP address and a port.
Netty is a java (computer programming language) open source framework. Netty provides an asynchronous, event-driven web application framework and tools for the rapid development of high-performance, high-reliability web servers and client programs.
In the embodiment of the application, different protocol interfaces are set to actively acquire the messages in each message source. The problems that some message sources cannot transmit messages to the message platform in time after acquiring related messages, so that the messages acquired by the message platform are incomplete, information channels acquired by the message platform are incomplete and the like are solved.
In addition, when the message platform actively acquires the message of the message source, the corresponding protocol can be flexibly selected for docking according to different message sources. For example, the message in the message source a is stored in the form of a log, the message platform may collect the content of the log line by line in a flash (log collection system) manner, and further actively acquire the message of the message source a. Compared with other protocols for docking, the method of collecting the log content line by line in a flash (log collection system) mode can reduce the load pressure of the server of the A message source. For another example, the message in the B message source is stored in a big data form, and the message platform may obtain the message according to the way of the timed task, and link the hbase (a high-reliability, high-performance, column-oriented, scalable distributed storage system) or the hive (data warehouse tool) with the B message source.
Optionally, in order to detect the performance of actively acquiring data by the message platform and facilitate subsequent optimization of the message platform, after actively acquiring a plurality of messages transmitted by different message sources according to the protocol interfaces corresponding to the different message sources, the method further includes: and acquiring the response time of each message actively transmitted by different message sources, and then judging whether the corresponding time is greater than a preset threshold value. If yes, an early warning is sent out.
That is, in the embodiment of the present application, the response time of the message platform for actively acquiring the message is detected, for example, a preset threshold of the response time of the message platform for acquiring the message is set to 50 milliseconds, and if it is detected that the response time of the message platform for acquiring the message is 120 milliseconds in the actual data acquisition process, an early warning is issued. If the response time of the message platform for acquiring the message is detected to be 40 milliseconds in the actual data acquisition process, no early warning is sent, and the response time of the message platform for acquiring the message is normal.
It should be noted that the preset threshold may be set according to actual situations, for example, in other embodiments, the preset threshold may be 50 milliseconds, 60 milliseconds, or 100 milliseconds.
Of course, the message platform may also adopt a passive message acquisition mode, that is, the message source sends data to the message platform. The message platform supports a flash tool of log and file contents, file pulling on the Ftp server and data acquisition of the Cloud system.
Optionally, in other embodiments, the manner of actively acquiring messages is combined with the manner of passively acquiring messages, so that the message platform can cover all message sources, that is, actively or passively acquiring messages of all information platforms.
Referring to fig. 4, in an exemplary embodiment, a message tag of each message includes a message type and a message generation time, and correspondingly, in step S102, according to the message tag, the aggregating is performed on the multiple messages, and the generating of a to-be-distributed message set that respectively corresponds to different message tags may further include the following steps: step S201-step S202.
Step S201: and according to the message type, aggregating the plurality of messages to generate the message to be distributed.
The message types comprise catch-up messages, public security messages, fraud messages and the like, and the acquired messages can be aggregated according to different message types.
After a plurality of messages transmitted by different message sources are acquired, according to the message type in the message label in each message, the messages are subjected to aggregation processing, and a message set to be distributed, which comprises messages to be distributed (message subsets to be distributed) respectively corresponding to different message types, is generated. That is, the generated message set to be distributed includes a plurality of message subsets to be distributed, and the messages of each message subset to be distributed have the same message type. For example, the messages in a certain subset of messages to be distributed are both wanted-virus messages, and for example, the messages in a certain subset of messages to be distributed are both public security messages.
Step S202: and sequencing the messages to be distributed with the same message type according to the message generation time, and forming the message set to be distributed by respectively corresponding to the messages to be distributed with different message types.
After aggregating the plurality of messages according to the message types and generating the message to be distributed, the messages with the same message type may be further sorted according to the message generation time. Note that the message generation time is a time when the message is acquired. The message to be distributed with the same message type is sorted according to the message generation time, namely, the earlier the message generation time is, the earlier the message is acquired, the earlier the message is. For example, the message generation time of the message to be distributed is 2019-9-2510: 55:28, and the message generation time of the message to be distributed is 2019-9-2510: 55:33, so that the message to be distributed is arranged in front of the message to be distributed. All messages of the same message type are then ordered.
In the embodiment of the application, the messages to be distributed with the same message type are sequenced according to the message generation time, so that the subsequent message platform can distribute the messages to be distributed based on the message generation time conveniently, the message distribution timeliness can be improved, and the situation that the messages are not distributed in time when being obtained very early due to the message random distribution mode is avoided.
Certainly in other embodiments, in step S102, according to the message tag, the multiple messages are aggregated, and a to-be-distributed message set including to-be-distributed messages (to-be-distributed message subsets) respectively corresponding to different message tags is generated, or the multiple messages are aggregated according to a source of the message, so as to generate the to-be-distributed messages (to-be-distributed message subsets); and then, according to the message generation time, sequencing the messages to be distributed with the same message source, and forming the message set to be distributed by the messages to be distributed (message subsets to be distributed) corresponding to different message sources respectively. The messages can also be aggregated according to the distribution point of the messages (namely, the message destination), so as to generate the messages to be distributed (the message subset to be distributed); and then, according to the message generation time, sequencing the messages to be distributed with the same message destinations, and forming the message set to be distributed by respectively corresponding to the messages to be distributed (message subsets to be distributed) with different message destinations.
Of course, in other embodiments, the ordering of the messages to be distributed having the same message type according to the message generation time is performed according to the order of the message generation time, and the ordering according to the order of the message generation time may also be performed such that the earlier the message generation time is, the later the ordering is, that is, the earlier the time the message is acquired is, the later the ordering is. The present application is not limited to this.
In an exemplary embodiment, before step S103, that is, before the message to be distributed is distributed, the method further includes: and performing semantic intervention on the content of the message to be distributed.
Before the message to be distributed is distributed, semantic intervention is executed on the message to be distributed, whether the content of the message to be distributed meets the semantic intervention condition is judged, namely whether words needing to be interfered exist in the content of the message to be distributed is judged, and the related formula is as follows:
oldMessage.indexOf(key)？oldMessage.replace(key，value):oldMessage
wherein, key represents the vocabulary needing intervention, and value represents the replaced vocabulary.
The semantic intervention refers to performing semantic audit adjustment on the content of the message to be distributed so that the content of the distributed message meets the specification and/or is easily identified by personnel in the industry.
Optionally, as a method for performing semantic intervention, performing semantic intervention on the content of the message to be distributed includes acquiring a sensitive word in the content of the message to be distributed; and replacing the sensitive words with preset characters.
That is, in the obtained content of the message to be distributed, whether sensitive words exist in the content of the message to be distributed is searched word by word, and if yes, the sensitive words are replaced by preset characters.
It should be noted that the sensitive words include words with political tendencies and unhealthy colors, or special words set by the message platform according to actual situations (such as part of network popular words). The preset characters can be "+" or "#", or numbers, such as number 2, number 1, or english letters, such as letter C, letter Q. The present application is not limited thereto.
In the embodiment of the application, sensitive words in the content of the message to be distributed are obtained, and then the sensitive words are replaced by preset characters, so that the message distributed subsequently is in accordance with the specification.
Optionally, as another method for semantic intervention, performing semantic intervention on the content of the message to be distributed includes acquiring a keyword in the content of the message to be distributed; and replacing the keywords with preset words.
That is, in the obtained content of the message to be distributed, whether the content of the message to be distributed is related to the key words is searched word by word, and if so, the key words are replaced by preset words.
It should be noted that the keywords include some spoken words, and the preset words are proprietary words of persons in the industry, for example, the keyword "test" is replaced with "criminal investigation"; "find" is replaced with "reconnaissance" and so on.
In the embodiment of the application, the keywords in the content of the message to be distributed are obtained, and then the keywords are replaced by the preset words, so that the identification of personnel in the industry is facilitated.
Optionally, in order to search and manage the message to be distributed subsequently, after the message to be distributed is generated, an archiving operation is performed on the message to be distributed. Correspondingly, the message platform also comprises a search engine. The method further comprises the following steps: storing the set of messages to be distributed in the search engine. After the message is stored in the search engine, a related index is also required to be created to improve the hit rate of the search. For example, the message header of the message to be distributed, the type of the message to be distributed, etc., and the application is not limited thereto.
Optionally, the search engine is es (elastic search) elastic search is a Lucene (full text search engine toolkit) based search server. It provides a distributed multi-user capability full-text search engine. The ES supports Chinese split-word analysis, and therefore, the ES also supports Chinese search operations.
Of course, in other embodiments, the search engine may also optionally use SOLR. The present application is also not limited.
In the embodiment of the application, the message set to be distributed is stored in the search engine, so that the management of the message to be distributed is realized, and the control of the process is enhanced.
Optionally, when the message tag further includes a message delivery method, the step S103 may include: and distributing the message to be distributed according to the message transmission mode of the message to be distributed.
The message transmission mode includes a short message mode, a mailbox mode or a webpage mode and the like. And the message platform distributes the messages to be distributed in the same message transmission mode according to the message transmission mode of the messages to be distributed.
The Message platform may include http, Email, im (Intelligent man-machine system), sms (Short Message Service), websocket (a protocol for performing full duplex communication on a single TCP connection), and other Message distribution methods.
For example, the message to be distributed is a message in a mailbox mode, the message to be distributed needs to be distributed to the a dispatch office, the message platform obtains the mailbox address of the a dispatch office, and then distributes the message to be distributed to the mailbox address of the a dispatch office in a mail mode.
In the embodiment of the application, the message to be distributed is distributed according to the message transmission mode of the message to be distributed, so that the message can be referred conveniently.
Based on the same inventive concept, the present application further provides a storage medium, on which a computer program is stored, and when the computer program is executed, the computer program performs the method provided in the foregoing embodiments.
The storage medium may be any available medium that can be accessed by a computer or a data storage device including one or more integrated servers, data centers, and the like. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
In addition, units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
Furthermore, the functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
In this document, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (9)
1. A message distribution processing method is applied to a message platform and comprises the following steps:
obtaining a plurality of messages transmitted by different message sources; wherein each of the messages has a corresponding message tag;
according to the message labels, performing aggregation processing on the plurality of messages to generate a message set to be distributed, wherein the message set to be distributed comprises messages to be distributed which respectively correspond to different message labels;
distributing the message to be distributed so as to send the message to be distributed to different departments;
wherein the obtaining of the plurality of messages transmitted by the different message sources comprises:
actively acquiring the plurality of messages transmitted by the different message sources according to the protocol interfaces corresponding to the different message sources;
passively acquiring the message; the message platform supports a flash tool of log and file contents, file pulling on an Ftp server and data acquisition of a Cloud system.
2. The method according to claim 1, wherein the message tag includes a message type and a message generation time, and the aggregating the plurality of messages according to the message tag to generate a to-be-distributed message set including to-be-distributed messages respectively corresponding to different message tags includes:
according to the message type, aggregating the plurality of messages to generate the message to be distributed;
and sequencing the messages to be distributed with the same message type according to the message generation time, and forming the message set to be distributed by respectively corresponding to the messages to be distributed with different message types.
3. The method of claim 1, wherein before the distributing the message to be distributed, the method further comprises:
and performing semantic intervention on the content of the message to be distributed.
4. The method according to claim 3, wherein the semantic intervention in the content of the message to be distributed comprises:
acquiring sensitive words in the content of the message to be distributed;
and replacing the sensitive words with preset characters.
5. The method according to claim 3, wherein the semantic intervention in the content of the message to be distributed comprises:
acquiring keywords in the content of the message to be distributed;
and replacing the keywords with preset words.
6. The method of claim 1, wherein the message platform comprises a search engine; correspondingly, before the distributing the message to be distributed, the method further includes:
and storing the set of messages to be distributed in the search engine.
7. The method of claim 1, wherein after the actively acquiring the plurality of messages transmitted by the different message sources, the method further comprises:
acquiring response time of actively acquiring each message transmitted by different message sources;
judging whether the response time is greater than a preset threshold value or not;
if yes, an early warning is sent out.
8. The method of claim 1, wherein the message label further comprises a message delivery mode, and accordingly, the distributing the message to be distributed comprises:
and distributing the message to be distributed according to the message transmission mode of the message to be distributed.
9. A messaging system comprising a messaging platform and a plurality of message sources, the messaging platform communicatively coupled to the plurality of message sources, the messaging platform configured to perform the method of any of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910957067.7A CN110717137B (en) | 2019-10-09 | 2019-10-09 | Message distribution processing method and message system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910957067.7A CN110717137B (en) | 2019-10-09 | 2019-10-09 | Message distribution processing method and message system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110717137A CN110717137A (en) | 2020-01-21 |
| CN110717137B true CN110717137B (en) | 2022-08-09 |
Family
ID=69212406
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910957067.7A Active CN110717137B (en) | 2019-10-09 | 2019-10-09 | Message distribution processing method and message system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110717137B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117424908A (en) * | 2023-10-19 | 2024-01-19 | 天翼电子商务有限公司 | Message transmission method, device and electronic equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101833561A (en) * | 2010-02-12 | 2010-09-15 | 西安电子科技大学 | Semantic Web Service Intelligent Agent for Natural Language Processing |
| CN102209292A (en) * | 2010-03-29 | 2011-10-05 | 索尼公司 | Wireless communication device, information distribution system and program |
| CN103020159A (en) * | 2012-11-26 | 2013-04-03 | 百度在线网络技术（北京）有限公司 | Method and device for news presentation facing events |
| WO2015065383A1 (en) * | 2013-10-30 | 2015-05-07 | Intel Corporation | Processing of messages using theme and modality criteria |
| CN106897424A (en) * | 2017-02-24 | 2017-06-27 | 北京时间股份有限公司 | Information labeling system and method |
| CN109614529A (en) * | 2018-11-30 | 2019-04-12 | 武汉推杰网络科技有限公司 | A kind of multi-layer data processing method based on company information |
-
2019
- 2019-10-09 CN CN201910957067.7A patent/CN110717137B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101833561A (en) * | 2010-02-12 | 2010-09-15 | 西安电子科技大学 | Semantic Web Service Intelligent Agent for Natural Language Processing |
| CN102209292A (en) * | 2010-03-29 | 2011-10-05 | 索尼公司 | Wireless communication device, information distribution system and program |
| CN103020159A (en) * | 2012-11-26 | 2013-04-03 | 百度在线网络技术（北京）有限公司 | Method and device for news presentation facing events |
| WO2015065383A1 (en) * | 2013-10-30 | 2015-05-07 | Intel Corporation | Processing of messages using theme and modality criteria |
| CN106897424A (en) * | 2017-02-24 | 2017-06-27 | 北京时间股份有限公司 | Information labeling system and method |
| CN109614529A (en) * | 2018-11-30 | 2019-04-12 | 武汉推杰网络科技有限公司 | A kind of multi-layer data processing method based on company information |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110717137A (en) | 2020-01-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11586972B2 (en) | Tool-specific alerting rules based on abnormal and normal patterns obtained from history logs | |
| CN111859384B (en) | Abnormal event monitoring method, device, computer equipment and storage medium | |
| US12225049B2 (en) | System and methods for integrating datasets and automating transformation workflows using a distributed computational graph | |
| US10613719B2 (en) | Generating a form response interface in an online application | |
| CN109254982A (en) | A kind of stream data processing method, system, device and computer readable storage medium | |
| US11042525B2 (en) | Extracting and labeling custom information from log messages | |
| US11886229B1 (en) | System and method for generating a global dictionary and performing similarity search queries in a network | |
| US10031901B2 (en) | Narrative generation using pattern recognition | |
| US11411871B2 (en) | Augmenting functionality in distributed systems with payload headers | |
| CN112162965A (en) | Log data processing method and device, computer equipment and storage medium | |
| US10171481B2 (en) | System and method for enhanced display-screen security and privacy | |
| CN119095757A (en) | Automated positive train control event data extraction and analysis engine and method | |
| US20250337781A1 (en) | Using Neural Networks to Process Forensics and Generate Threat Intelligence Information | |
| US11057331B2 (en) | Construction of global internet message threads | |
| US9922116B2 (en) | Managing big data for services | |
| US10225357B2 (en) | Compact data structures for push notifications | |
| CN111753070A (en) | System and method for server monitoring log processing | |
| CN110717137B (en) | Message distribution processing method and message system | |
| CN117472995A (en) | Log data processing method, device and electronic equipment | |
| US20130145289A1 (en) | Real-time duplication of a chat transcript between a person of interest and a correspondent of the person of interest for use by a law enforcement agent | |
| JP6078485B2 (en) | Operation history analysis apparatus, method, and program | |
| Girish et al. | Extreme event detection and management using twitter data analysis | |
| US11835989B1 (en) | FPGA search in a cloud compute node | |
| CN118885971A (en) | A heterogeneous data fusion method, device, equipment and storage medium | |
| US10387474B2 (en) | System and method for cross-cloud identification of topics |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |