CN104022943A - Method, device and system for processing interactive type massages - Google Patents

Abstract

The invention provides an interactive message processing method, device and system. Wherein, the method includes: extracting picture feature information from a to-be-sent message carrying a picture, wherein the picture feature information includes picture content elements and/or picture attributes; obtaining additional information related to the picture feature information; A method is set up to combine the additional information with the picture in the message to be sent to generate a combined message and send it. By adopting the technical scheme of the present invention, additional information related to the picture feature information of the picture can be added to the message to be sent carrying the picture, the added additional information can enrich the content of the information, and add richer forms and connotations to the expression of the information. The user's emotions can be reflected in the information, not just the information of the picture itself, so that the picture has interactive content, and the form of communication between users is more diverse and interesting.

Description

Interactive message processing method, device and system

technical field

The invention relates to the field of Internet applications, in particular to a method, device and system for processing interactive messages.

Background technique

With the development of technology, the application of instant messaging (Instant Messenger, IM) software tools is becoming more and more common. IM has been accepted by most users and has become an indispensable part of users' daily life and work. Text, pictures, voice or video, etc., can realize exchanges and communication with friends, colleagues and classmates.

In related technologies, when a user sends a message with a picture through IM software, the user at the receiving end can only obtain the information of the picture itself.

Contents of the invention

In view of the above problems, the present invention is proposed to provide an interactive message processing method, device and corresponding system that overcome the above problems or at least partially solve the above problems.

According to one aspect of the present invention, a method for processing an interactive message is provided, including: extracting picture characteristic information from a to-be-sent message carrying a picture, wherein the picture characteristic information includes picture content elements and/or picture attributes; Acquiring additional information related to the feature information of the picture; combining the additional information with the picture in the message to be sent in a preset manner, generating a combined message, and sending it.

Optionally, the additional information includes at least one of the following: static information, including at least one of text, pictures, audio, and video related to the picture feature information, and/or, information related to the picture feature information . A display template for arranging text or pictures; dynamic information, including processing information for the content elements of the picture.

Optionally, obtaining additional information related to the picture feature information includes: if the additional information is the static information, matching the picture feature information in an additional information database to obtain the additional information; or Obtaining the additional information selected by the user for the image area corresponding to the image content element; if the additional information is the dynamic information, receiving a processing instruction from the user to obtain the additional information.

Optionally, combining the additional information with the picture in the message to be sent in a preset manner includes: if the additional information is at least One, embedding the additional information into the picture in the message to be sent; or, storing the additional information corresponding to the picture area corresponding to the content element of the picture, so as to display it when a trigger operation is performed on the picture area The additional information; if the additional information is a display template for arranging text or pictures related to the picture feature information, arranging the pictures in the message to be sent according to the relevant display template; If the additional information is the dynamic information, apply the processing information for the picture content element to the picture content element.

Optionally, when the picture feature information is the picture content element, embedding the additional information into the picture in the message to be sent includes: determining the picture area corresponding to the picture content element; Information is embedded in the determined said picture area.

Correspondingly, a method for processing an interactive message is provided, including: receiving a combined message from a sender, wherein the combined message includes a picture combined with additional information, and performing the combination of the picture and the additional information In a preset way, the additional information is related to the picture feature information of the original picture before combination, and the picture feature information includes picture content elements and/or picture attributes; and the content of the combined message is displayed according to the preset way.

Optionally, the additional information includes at least one of the following: static information, including at least one of text, pictures, audio, and video related to the picture feature information, and/or, information related to the picture feature information . A display template for arranging text or pictures; dynamic information, including processing information for the content elements of the picture.

Optionally, displaying the content of the combined message according to the preset method includes: if the additional information is at least one of text, picture, audio, and video related to the picture feature information, displaying the embedded information a picture of the above additional information; or, receiving a trigger operation from the user on the picture area corresponding to the picture content element to display the additional information; if the additional information is related to the picture feature information and used for A display template for arranging text or pictures, displaying the contents of the pictures arranged according to the relevant display templates; if the additional information is the dynamic information, displaying that the processing information for the content elements of the pictures is applied to all Describes the content of the image content element.

Optionally, when the picture characteristic information is the picture content element, displaying the picture embedded with the additional information includes: displaying the picture embedded with the additional information in a picture area corresponding to the picture content element.

According to another aspect of the present invention, an interactive message processing device is also provided, which is applied to the sending end, including:

An extracting module configured to extract picture feature information from a to-be-sent message carrying a picture, wherein the picture feature information includes picture content elements and/or picture attributes;

An acquisition module configured to acquire additional information related to the feature information of the picture;

The combination module is configured to combine the additional information with the picture in the message to be sent in a preset manner, generate a combined message, and send it.

Optionally, the additional information includes at least one of the following: static information, including at least one of text, pictures, audio, and video related to the picture feature information, and/or, information related to the picture feature information . A display template for arranging text or pictures; dynamic information, including processing information for the content elements of the picture.

Optionally, the obtaining module is further configured to: if the additional information is the static information, match the picture feature information in the additional information database to obtain the additional information; The additional information selected by the image area corresponding to the image content element; if the additional information is the dynamic information, receive a processing instruction from the user to obtain the additional information.

Optionally, the combination module is further configured to: if the additional information is at least one of text, pictures, audio, and video related to the picture feature information, embed the additional information into the message to be sent or, store the additional information corresponding to the image area corresponding to the image content element, so as to display the additional information when a trigger operation is performed on the image area; if the additional information is related to the image A display template related to feature information for arranging text or pictures, arranges the pictures in the message to be sent according to the relevant display template; if the additional information is the dynamic information, it will target the The processing information of the picture content element is applied to the picture content element.

Optionally, when the picture feature information is the picture content element, the combining module is further configured to: determine a picture area corresponding to the picture content element; embed the additional information into the determined picture area.

Correspondingly, an interactive message processing device is also provided, which is applied to the receiving end, including:

The receiving module is configured to receive a combination message from the sender, wherein the combination message includes a picture combined with additional information, and a preset way of combining the picture with the additional information, and the combination of the additional information and the combination The picture feature information of the previous original picture is related, and the picture feature information includes picture content elements and/or picture attributes;

A display module configured to display the content of the combined message according to the preset method.

Optionally, the additional information includes at least one of the following: static information, including at least one of text, pictures, audio, and video related to the picture feature information, and/or, information related to the picture feature information . A display template for arranging text or pictures; dynamic information, including processing information for the content elements of the picture.

Optionally, the display module is further configured to: if the additional information is at least one of text, pictures, audio, and video related to the picture feature information, display the picture embedded with the additional information; or, receiving a trigger operation from the user on the image area corresponding to the image content element, and displaying the additional information; if the additional information is related to the image feature information and used for arranging text or images A display template, displaying the content of the picture arranged according to the relevant display template; if the additional information is the dynamic information, displaying the content of the processing information for the picture content element applied to the picture content element.

Optionally, when the picture feature information is the picture content element, the display module is further configured to: display the picture in which the additional information is embedded in the picture area corresponding to the picture content element.

According to the third aspect of the present invention, there is also provided an interactive message processing system, including the above-mentioned sending end and the above-mentioned receiving end, wherein,

The sending end is configured to extract picture feature information from a to-be-sent message carrying a picture, wherein the picture feature information includes picture content elements and/or picture attributes; acquire additional information related to the picture feature information; Combine the additional information with the picture in the message to be sent in a preset manner to generate a combined message and send it;

The receiving end is configured to receive a combined message from the sending end, wherein the combined message includes a picture combined with additional information, and a preset method for combining the picture with the additional information, and the additional information It is related to the picture feature information of the original picture before combination, the picture feature information includes picture content elements and/or picture attributes; and the content of the combined message is displayed according to the preset method.

According to the technical solution of the present invention, additional information related to the picture feature information of the picture can be added to the message to be sent carrying the picture, and the additional information can include text, pictures, audio, video, and picture feature information related to the picture feature information. Relevant display templates for arranging text or pictures, and processing information for picture content elements in picture feature information. The added additional information can enrich the content of the information, add richer forms and connotations to the expression of information, and can reflect the user's emotions in the information, not just the information of the picture itself, making the picture interactive content, and the form of communication between users is more diversified and interesting.

The above description is only an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention, it can be implemented according to the contents of the description, and in order to make the above and other purposes, features and advantages of the present invention more obvious and understandable , the specific embodiments of the present invention are enumerated below.

Those skilled in the art will be more aware of the above and other objects, advantages and features of the present invention according to the following detailed description of specific embodiments of the present invention in conjunction with the accompanying drawings.

Description of drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiment. The drawings are only for the purpose of illustrating a preferred embodiment and are not to be considered as limiting the invention. Also throughout the drawings, the same reference numerals are used to designate the same components. In the attached picture:

FIG. 1 shows a flowchart of a method for processing an interactive message at a sender according to an embodiment of the present invention;

FIG. 2 shows a flowchart of a method for processing an interactive message at a receiving end according to an embodiment of the present invention;

FIG. 3 shows a flow chart of a method for processing interactive messages combined with a sending-end mobile phone 1 and a receiving-end mobile phone 2 according to an embodiment of the present invention;

FIG. 4 shows a schematic structural diagram of a device for processing interactive messages at the sending end according to an embodiment of the present invention;

FIG. 5 shows a schematic structural diagram of an apparatus for processing interactive messages at a receiving end according to an embodiment of the present invention; and

Fig. 6 shows a schematic structural diagram of an interactive message processing system according to an embodiment of the present invention.

Detailed ways

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

It is mentioned in related technologies that when a user sends a message with a picture through IM software, the user at the receiving end can only obtain the information of the picture itself. The information obtained is in a single form and contains a small amount of information. Interaction and communication needs.

In order to solve the above technical problem, an embodiment of the present invention provides an interactive message processing method. Fig. 1 shows a flowchart of a method for processing an interactive message at a sender according to an embodiment of the present invention. As shown in FIG. 1 , the sending end may be a mobile phone, a computer, a tablet computer, etc., and the method at least includes the following steps S102 to S106.

Step S102, extracting picture feature information from the to-be-sent message carrying the picture, wherein the picture feature information includes picture content elements and/or picture attributes.

Step S104, acquiring additional information related to the feature information of the picture.

Step S106: Combine the additional information with the picture in the message to be sent in a preset manner, generate a combined message, and send it.

According to the technical solution of the present invention, additional information related to the picture feature information of the picture can be added to the message to be sent carrying the picture, and the additional information can include text, pictures, audio, video, and picture feature information related to the picture feature information. Relevant display templates for arranging text or pictures, and processing information for picture content elements in picture feature information. The added additional information can enrich the content of the information, add richer forms and connotations to the expression of information, and can reflect the user's emotions in the information, not just the information of the picture itself, making the picture interactive content, and the form of communication between users is more diversified and interesting.

In step S102, the picture content element is an element that reflects the content of the picture itself. For example, when the picture is a character image, the picture content element can be the facial features of the face or character in the picture; when the picture is a scene image, the picture content element can be It is a scene in a picture and so on. The picture attribute may be the picture name, author, creation time, storage path, format, size, dimension, geographic location, etc., and the present invention is not limited thereto.

After step S102 extracts the picture feature information of the picture in the message to be sent, step S104 further acquires additional information related to the picture feature information, where the additional information may be static information or dynamic information. Static information means that the additional information itself is non-dynamic information such as text and pictures. For example, static information may include at least one of text, pictures, audio, and video related to picture feature information, and/or, related to picture feature information Associated display templates for arranging text or images. For example, the picture in the message to be sent is a family portrait of Xiaoming's family. In the family portrait, there are Xiaoming's father, mother, sister, and Xiaoming. This family portrait was taken in Beihai. You can extract Xiaoming's father's profile picture, And Beihai is used as the picture characteristic information of the picture. Further, a piece of voice spoken by Xiaoming's father can be used as the additional information of Xiaoming's father's avatar, Xiaoming's nickname can be used as the additional information of Xiaoming's avatar, and the landscape picture of Beihai can be used as the Beihai additional information for . For another example, the picture in the message to be sent is a group photo of two friends, and the group photo is taken when the weather is fine, and the head portrait of friend 1, the head portrait of friend 2, and the background of the group photo can be extracted from the group photo as The picture feature information of the group photo can further include the basic information (name, nickname, etc.) of friend 1 and a section of voice spoken by friend 1 as the additional information of friend 1's avatar, and the basic information of friend 2 (name, nickname, etc.) nickname, etc.), and a section of voice spoken by friend 2 as the additional information of the profile picture of friend 2, and this background taken in hazy weather is used as the additional information of the background of the group photo. It should be noted that all the picture content elements in the picture can also be used as the additional information of the picture, for example, if the picture is the image of the plant water pine, the image of the plant water pine can be used as the additional information of the picture. In addition, the additional information can also be dynamic information. The dynamic information here does not mean that the information itself is dynamic, but that the operation involved in the additional information itself is a dynamic operation that can be changed, such as actions and steps. For example, for image content elements The processing information is used to perform subsequent processing operations based on the processing information. For example, the picture in the message to be sent is divided into two picture areas, and the two picture areas correspond to different picture content elements. The picture content elements in one of the picture areas are filtered, and the picture content elements in the other picture area are added Hyperlinks, so that when the content of the combined message is displayed, the user can trigger the image area to link to the corresponding content.

Further, when the additional information is different, the implementation of step S104 is different. Specifically, if the additional information is static information, step S104 can be implemented to match the picture feature information in the additional information database to obtain additional information, wherein the additional information database pre-stores text, pictures, audio, video and other information materials , the source of these information materials can be collected or customized by the user, or can be automatically configured or acquired by the additional information library, and the data in the additional information library can be local data or provided by the cloud. If the additional information is static information, step S104 may also be implemented as acquiring additional information selected by the user for the image area corresponding to the image content element. A two-dimensional Cartesian coordinate system can be established on the picture, and the picture area corresponding to the content element of the picture can be determined according to the coordinate points, so that when the user performs a trigger operation on a certain area on the picture, the corresponding trigger operation can be determined according to the coordinates of the trigger point The picture area, and then display the content of the picture area corresponding to the trigger operation. Secondly, if the additional information is dynamic information, step S104 can be implemented as receiving a processing instruction from the user to obtain additional information, for example, the picture in the message to be sent is divided into two picture areas, and the two picture areas correspond to different picture contents element, received from the user to filter the picture content elements in one of the picture areas, and received from the user to add hyperlinks to the picture content elements of the other picture area, so that when the content of the combined message is displayed, the user The picture area can be triggered to be linked to the corresponding content.

Similar to the above description, when the additional information is different, the implementation of step S106 is not completely the same. Specifically, if the additional information is at least one of text, pictures, audio, and video related to the feature information of the picture, the above step S106 can be implemented as embedding the additional information into the picture in the message to be sent, for example, the additional information is the picture The additional information of the image content element can embed the additional information into the image area corresponding to the image content element. Secondly, if the additional information is a display template for arranging text or pictures related to the feature information of the picture, the above step S106 can be specifically implemented as arranging the pictures in the message to be sent according to the relevant display template, for example, Picture 1 in the message to be sent matches the additional information picture 2 and the display template related to picture 1, and picture 1 and picture 2 can be arranged according to the display template. In addition, if the additional information is dynamic information, the above step S106 may be specifically implemented as applying the processing information for the picture content element to the picture content element.

Correspondingly, FIG. 2 shows a flowchart of a method for processing an interactive message at a receiving end according to an embodiment of the present invention. As shown in FIG. 2, the receiving end may be a mobile phone, a computer, a tablet computer, etc., and the method at least includes the following steps S202 to S204.

Step S202, receiving a combination message from the sender, wherein the combination message includes a picture combined with additional information, and a preset way of combining the picture and the additional information, the additional information is related to the picture feature information of the original picture before combination, and the picture feature information Include image content elements and/or image attributes.

Step S204, displaying the content of the combined message according to a preset manner.

Specifically, for the detailed introduction of the picture content elements and picture attributes mentioned in step S202, please refer to the content of step S102 above, and will not be repeated here. The additional information mentioned in step S202 may be static information or dynamic information. Static information means that the additional information itself is non-dynamic information such as text and pictures. For example, static information may include at least one of text, pictures, audio, and video related to picture feature information, and/or, related to picture feature information Associated display templates for arranging text or images. In addition, the additional information can also be dynamic information. The dynamic information here does not mean that the information itself is dynamic, but that the operation involved in the additional information itself is a dynamic operation that can be changed, such as actions and steps. For example, for image content elements The processing information is used to perform subsequent processing operations based on the processing information. For example, the picture in the message to be sent is divided into two picture areas, and the two picture areas correspond to different picture content elements. The picture content elements in one of the picture areas are filtered, and the picture content elements in the other picture area are added Hyperlinks, so that when the content of the combined message is displayed, the user can trigger the picture area to link to the corresponding content; or, enlarge the picture content element in one of the picture areas, so that when the content of the combined message is displayed, the user can Trigger the image area to enlarge the corresponding image content element, and shrink the image content element in another image area, so that when the content of the combined message is displayed, the user can trigger the image area to reduce the corresponding image content element.

Further, when the additional information is different, the implementation of step S204 is different. Specifically, if the additional information is at least one of text, pictures, audio, and video related to the feature information of the picture, step S204 can be implemented as displaying the picture embedded with the additional information, for example, the additional information is the image content element of the picture Additional information, display the image with additional information embedded in the image area corresponding to the image content element. For example, the picture in the message to be sent is divided into two picture areas, the two picture areas correspond to different picture content elements, the additional information of the picture content element corresponding to one picture area is text 1, and the picture content corresponding to the other picture area If the additional information of the element is text 2, then embed text 1 in one of the image areas for display, and embed text 2 in another image area for display. Secondly, if the additional information is a display template for arranging text or pictures related to the feature information of the picture, step S204 can be specifically implemented as displaying the content of the pictures arranged according to the relevant display template. For example, picture 1 in the message to be sent matches the additional information picture 2 and the display template related to picture 1, and the contents of picture 1 and picture 2 arranged according to the display template can be displayed. Furthermore, if the additional information is dynamic information, step S204 may be specifically implemented as displaying the content of the image content element that the processing information for the image content element is applied to. For example, the picture in the message to be sent is divided into two picture areas, and the two picture areas correspond to different picture content elements. The picture content elements in one picture area are filtered and displayed, and the other picture area The image content element is added with a hyperlink, and the user can trigger the image area to be linked to the corresponding content; or, the image content element in one of the image areas is enlarged and the enlarged content is displayed (the user can also trigger the image area to enlarge corresponding to image content element), the image content element of another image area is reduced and the reduced content is displayed (the user can also trigger the image area to shrink the corresponding image content element).

In addition, after receiving the combined message from the sending end, the receiving end can directly display the content of the combined message according to the preset method, or can display the content of the combined message according to the preset method after receiving a trigger display instruction from the user. For example, after the receiving end receives the combined message from the sending end, a virtual button is displayed on the interface of the receiving end, and the user can trigger the virtual button, and then the receiving end displays the content of the combined message according to a preset method. Wherein, the virtual key may be in the shape of a circle, an ellipse, a triangle, an arrow, etc., and the present invention is not limited thereto.

Various implementation modes of each link in the embodiment shown in FIG. 1 and FIG. 2 have been introduced above, and the interactive message processing method provided by the embodiment of the present invention will be further described below through specific embodiments.

In order to describe this preferred embodiment more concisely, in this preferred embodiment, mobile phone 1 and mobile phone 2 chat through IM software, assume that mobile phone 1 is the sending end, mobile phone 2 is the receiving end, mobile phone 1 sends a message to mobile phone 2, mobile phone 2 Receive a message from phone 1. The application scenario can be: the user of mobile phone 1 needs to send the group photo taken (the group photo is a group photo of the user of mobile phone 1, the user of mobile phone 2 and one of their friends) to the user of mobile phone 2, when sending, add Added additional information related to group photos, thereby adding richer forms and connotations to the expression of information, enabling interactive content for pictures, and more diverse and interesting forms of communication between users.

Fig. 3 shows a flow chart of a method for processing interactive messages combined with the mobile phone 1 at the sending end and the mobile phone 2 at the receiving end according to an embodiment of the present invention. As shown in Fig. 3, the method includes the following steps S302 to S312.

Step S302 , the mobile phone 1 extracts picture feature information from the to-be-sent message carrying the group photo, wherein the picture feature information includes picture content elements and/or picture attributes.

In this step, the mobile phone 1 extracts the user's avatar 1 of the mobile phone 1, the user's avatar 2 of the mobile phone 2, the avatar 3 of one of their friends, the name of the group photo "good buddy" from the message to be sent carrying the group photo, and the The geographical location of the group photo is "South Gate of Mount Tai".

In step S304, the mobile phone 1 acquires additional information related to the feature information of the picture.

In this step, mobile phone 1 acquires the nickname, voice and another life photo selected for the picture area corresponding to head portrait 1; obtains the nickname, voice and another life picture selected for the picture area corresponding to head portrait 2; obtains the nickname for head portrait 3 Nickname, voice and another life photo selected in the corresponding picture area; obtain the display template for arranging the photos; match the related songs "My Good Brother" in the additional information library to "good buddies", "Friends"; related photos of "Taishan Nantianmen" were matched in the additional information database; filter processing was performed on the head portrait 3; the annotation of "shooting at sunrise" was made for the background of the group photo, etc.

Step S306, the mobile phone 1 combines the additional information with the picture in the message to be sent in a preset manner to generate a combined message.

In this step, mobile phone 1 embeds the nickname into the picture area corresponding to each avatar; stores the voice corresponding to the picture area corresponding to each avatar, so as to play the voice when the receiving end performs a trigger operation on the picture area; The photos are arranged according to the display template; the related songs "My Good Brother" and "Friends" of "Good Buddies" are stored correspondingly with the group photos, so that these songs will be played when the group photos are displayed at the receiving end; "Taishan Nantianmen" The relevant photos of the group photo are arranged according to the display template; the head portrait 3 is processed with a filter; the annotation "taken at sunrise" is embedded in the group photo for the background of the group photo, and so on.

Step S308, mobile phone 1 sends the combined message to mobile phone 2.

Step S310, mobile phone 2 receives a combined message from mobile phone 1, wherein the combined message includes a picture combined with additional information, and a preset way of combining the picture with the additional information, and the additional information is related to the picture feature information of the original picture before combination, The picture feature information includes picture content elements and/or picture attributes.

Step S312, the mobile phone 2 displays the content of the combined message according to a preset method.

In this step, the mobile phone 2 displays a group photo with a nickname embedded in the picture area corresponding to each avatar; plays a voice when the trigger operation is performed on the picture area; displays the content of another life photo of the three arranged according to the display template ; Play the songs "My Good Brother" and "Friend" related to "Good Buddies"; display the content of the related photos of "Taishan Nantianmen" arranged according to the display template; display the content after the filter processing of the head portrait 3 ; The group photo also shows the annotation description embedded with "Shooting at Sunrise" and so on.

Of course, mobile phone 2 can also be the sending end, mobile phone 1 can be the receiving end, mobile phone 2 sends messages to mobile phone 1, and mobile phone 1 receives messages from mobile phone 2, and the method flow shown in FIG. 3 can be used to realize interactive message processing.

It should be noted that, in practical applications, all the above optional implementation manners may be combined in any way to form optional embodiments of the present invention, which will not be repeated here.

Based on the same inventive concept, an embodiment of the present invention also provides an interactive message processing device, so as to implement the above interactive message processing method.

Fig. 4 shows a schematic structural diagram of an apparatus for processing an interactive message at a sending end according to an embodiment of the present invention. Referring to FIG. 4 , the device at least includes: an extraction module 410 , an acquisition module 420 and a combination module 430 .

The functions of each component or device of the interactive message processing device at the sending end of the embodiment of the present invention and the connection relationship between each part are introduced now:

The extracting module 410 is configured to extract picture feature information from the to-be-sent message carrying the picture, wherein the picture feature information includes picture content elements and/or picture attributes;

The acquiring module 420, coupled with the extracting module 410, is configured to acquire additional information related to the feature information of the picture;

The combination module 430, coupled with the acquisition module 420, is configured to combine the additional information with the picture in the message to be sent in a preset manner, generate a combined message, and send it.

In one embodiment, the additional information includes at least one of the following: static information, including at least one of text, pictures, audio, and video related to the picture feature information, and/or, related to the picture feature information, used to A display template for arranging text or pictures; dynamic information, including processing information for picture content elements.

In one embodiment, the acquisition module 420 is further configured to: if the additional information is static information, match the picture feature information in the additional information database to obtain the additional information; Additional information; if the additional information is dynamic information, receive a processing instruction from the user to obtain the additional information.

In one embodiment, the combining module 430 is further configured to: if the additional information is at least one of text, pictures, audio, and video related to the feature information of the picture, embed the additional information into the picture in the message to be sent; The information is stored corresponding to the image area corresponding to the image content element, and is used to display additional information when triggering operations on the image area; if the additional information is a display template related to image feature information and used to arrange text or images, it will be The pictures in the message to be sent are arranged according to the relevant display template; if the additional information is dynamic information, the processing information for the picture content element is applied to the picture content element.

In one embodiment, when the picture feature information is a picture content element, the combination module 430 is further configured to: determine the picture area corresponding to the picture content element; embed additional information into the determined picture area.

Correspondingly, FIG. 5 shows a schematic structural diagram of an apparatus for processing an interactive message at a receiving end according to an embodiment of the present invention. Referring to FIG. 5 , the device at least includes: a receiving module 510 and a display module 520 .

Now introduce the functions of each component or device of the interactive message processing device at the receiving end of the embodiment of the present invention and the connection relationship between each part:

The receiving module 510 is configured to receive a combination message from the sender, wherein the combination message includes a picture combined with additional information, and a preset way of combining the picture with the additional information, and the additional information is related to the picture feature information of the original picture before combination, Image feature information includes image content elements and/or image attributes;

The display module 520, coupled with the receiving module 510, is configured to display the content of the combined message according to a preset method.

In one embodiment, the additional information includes at least one of the following: static information, including at least one of text, pictures, audio, and video related to the picture feature information, and/or, related to the picture feature information, used to A display template for arranging text or pictures; dynamic information, including processing information for picture content elements.

In one embodiment, the display module 520 is further configured to: if the additional information is at least one of text, pictures, audio, and video related to the feature information of the picture, display the picture embedded with the additional information; The trigger operation of the image area corresponding to the image content element displays additional information; if the additional information is a display template related to image feature information and used to arrange text or images, the displayed image is arranged according to the relevant display template content; if the additional information is dynamic information, display the content of the processing information for the image content element applied to the image content element.

In one embodiment, when the picture feature information is a picture content element, the display module 520 is further configured to: display a picture with additional information embedded in the picture area corresponding to the picture content element.

Based on the interactive message processing method and device provided by the above embodiments, and based on the same inventive concept, the embodiment of the present invention also provides an interactive message processing system, as shown in FIG. 6, the system at least includes: The sending end 610 described above (as shown in FIG. 4 ) and the receiving end 620 described above (as shown in FIG. 5 ).

Now introduce the functions of each device or component of the interactive message processing system of the embodiment of the present invention and the connection relationship between each part:

The sending end 610 is configured to extract picture feature information from the message to be sent carrying the picture, wherein the picture feature information includes picture content elements and/or picture attributes; obtain additional information related to the picture feature information; add the additional information in a preset manner Combine the information with the picture in the message to be sent to generate a combined message and send it;

The receiving end 620 is coupled with the sending end 610 and is configured to receive a combined message from the sending end, wherein the combined message includes a picture combined with additional information, and a preset way of combining the picture with the additional information, and the additional information is combined with the original The picture feature information of the picture is related, and the picture feature information includes picture content elements and/or picture attributes; the content of the combined message is displayed according to a preset method.

According to any one of the above preferred embodiments or a combination of multiple preferred embodiments, the embodiments of the present invention can achieve the following beneficial effects:

According to the technical solution of the present invention, additional information related to the picture feature information of the picture can be added to the message to be sent carrying the picture, and the additional information can include text, pictures, audio, video, and picture feature information related to the picture feature information. Relevant display templates for arranging text or pictures, and processing information for picture content elements in picture feature information. The added additional information can enrich the content of the information, add richer forms and connotations to the expression of information, and can reflect the user's emotions in the information, not just the information of the picture itself, making the picture interactive content, and the form of communication between users is more diversified and interesting.

In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure the understanding of this description.

Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, in order to streamline this disclosure and to facilitate an understanding of one or more of the various inventive aspects, various features of the invention are sometimes grouped together in a single embodiment, figure, or its description. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed invention requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the Detailed Description are hereby expressly incorporated into this Detailed Description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art can understand that the modules in the device in the embodiment can be adaptively changed and arranged in one or more devices different from the embodiment. Modules or units or components in the embodiments may be combined into one module or unit or component, and furthermore may be divided into a plurality of sub-modules or sub-units or sub-assemblies. All features disclosed in this specification (including accompanying claims, abstract and drawings) and any method or method so disclosed may be used in any combination, except that at least some of such features and/or processes or units are mutually exclusive. All processes or units of equipment are combined. Each feature disclosed in this specification (including accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will understand that although some embodiments described herein include some features included in other embodiments but not others, combinations of features from different embodiments are meant to be within the scope of the invention. and form different embodiments. For example, in the claims, any one of the claimed embodiments can be used in any combination.

The various component embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art should understand that a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all of some or all of the interactive message processing device and system according to the embodiment of the present invention Function. The present invention can also be implemented as an apparatus or an apparatus program (for example, a computer program and a computer program product) for performing a part or all of the methods described herein. Such a program for realizing the present invention may be stored on a computer-readable medium, or may be in the form of one or more signals. Such a signal may be downloaded from an Internet site, or provided on a carrier signal, or provided in any other form.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means can be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. does not indicate any order. These words can be interpreted as names.

So far, those skilled in the art should appreciate that, although a number of exemplary embodiments of the present invention have been shown and described in detail herein, without departing from the spirit and scope of the present invention, the disclosed embodiments of the present invention can still be used. Many other variations or modifications consistent with the principles of the invention are directly identified or derived from the content. Accordingly, the scope of the present invention should be understood and deemed to cover all such other variations or modifications.

The present invention also discloses A1, a method for processing interactive messages, including:

extracting picture feature information from a to-be-sent message carrying a picture, wherein the picture feature information includes picture content elements and/or picture attributes;

Acquiring additional information related to the feature information of the picture;

Combine the additional information with the picture in the message to be sent in a preset manner to generate a combined message and send it.

A2. The method according to A1, wherein the additional information includes at least one of the following:

Static information, including at least one of text, pictures, audio, and video related to the picture feature information, and/or, a display template for arranging text or pictures related to the picture feature information;

Dynamic information includes processing information for the image content element.

A3. The method according to A2, wherein obtaining additional information related to the picture feature information includes:

If the additional information is the static information, match the picture feature information in the additional information database to obtain the additional information; or, obtain the additional information selected by the user for the picture area corresponding to the picture content element information;

If the additional information is the dynamic information, receive a processing instruction from the user to acquire the additional information.

A4. The method according to A2 or A3, wherein combining the additional information with the picture in the message to be sent in a preset manner includes:

If the additional information is at least one of text, pictures, audio, and video related to the picture feature information, embedding the additional information into the picture in the message to be sent; or combining the additional information with the The image area corresponding to the image content element is correspondingly stored, so as to display the additional information when a trigger operation is performed on the image area;

If the additional information is a display template for arranging text or pictures related to the picture feature information, arranging the pictures in the message to be sent according to the relevant display template;

If the additional information is the dynamic information, apply the processing information for the picture content element to the picture content element.

A5. The method according to A4, wherein, when the picture feature information is the picture content element, embedding the additional information into the picture in the message to be sent includes:

determining the image area corresponding to the image content element;

Embedding the additional information into the determined picture area.

A6, a method for processing interactive messages, including:

receiving a combination message from the sender, wherein the combination message includes a picture combined with additional information, and a preset method for combining the picture with the additional information, and the picture of the original picture before the combination of the additional information Feature information is related, and the picture feature information includes picture content elements and/or picture attributes;

Displaying the content of the combined message according to the preset manner.

A7. The method according to A6, wherein the additional information includes at least one of the following:

Static information, including at least one of text, pictures, audio, and video related to the picture feature information, and/or, a display template for arranging text or pictures related to the picture feature information;

Dynamic information includes processing information for the image content element.

A8. The method according to A7, wherein displaying the content of the combined message according to the preset method includes:

If the additional information is at least one of text, pictures, audio, and video related to the feature information of the picture, display the picture embedded with the additional information; or receive a message from the user corresponding to the content element of the picture A trigger operation performed in the image area to display the additional information;

If the additional information is a display template for arranging text or pictures related to the feature information of the picture, displaying the content of the picture arranged according to the relevant display template;

If the additional information is the dynamic information, display the content that the processing information for the image content element is applied to the image content element.

A9. The method according to A8, wherein, when the picture feature information is the picture content element, displaying the picture embedded with the additional information includes:

A picture with the additional information embedded in the picture area corresponding to the picture content element is displayed.

B10, a processing device for interactive messages, applied to the sending end, including:

An extracting module configured to extract picture feature information from a to-be-sent message carrying a picture, wherein the picture feature information includes picture content elements and/or picture attributes;

An acquisition module configured to acquire additional information related to the feature information of the picture;

The combination module is configured to combine the additional information with the picture in the message to be sent in a preset manner, generate a combined message, and send it.

B11. The device according to B10, wherein the additional information includes at least one of the following:

Static information, including at least one of text, pictures, audio, and video related to the picture feature information, and/or, a display template for arranging text or pictures related to the picture feature information;

Dynamic information includes processing information for the image content element.

B12. The device according to B11, wherein the acquisition module is further configured as:

If the additional information is the static information, match the picture feature information in the additional information database to obtain the additional information; or, obtain the additional information selected by the user for the picture area corresponding to the picture content element information;

If the additional information is the dynamic information, receive a processing instruction from the user to acquire the additional information.

B13. The device according to B11 or B12, wherein the combination module is further configured as:

If the additional information is at least one of text, pictures, audio, and video related to the picture feature information, embedding the additional information into the picture in the message to be sent; or combining the additional information with the The image area corresponding to the image content element is correspondingly stored, so as to display the additional information when a trigger operation is performed on the image area;

If the additional information is a display template for arranging text or pictures related to the picture feature information, arranging the pictures in the message to be sent according to the relevant display template;

If the additional information is the dynamic information, apply the processing information for the picture content element to the picture content element.

B14. The device according to B13, wherein, when the picture feature information is the picture content element, the combination module is further configured to: determine the picture area corresponding to the picture content element; embed the additional information Determine the image area.

B15, a processing device for interactive messages, applied to the receiving end, including:

The receiving module is configured to receive a combination message from the sender, wherein the combination message includes a picture combined with additional information, and a preset way of combining the picture with the additional information, and the combination of the additional information and the combination The picture feature information of the previous original picture is related, and the picture feature information includes picture content elements and/or picture attributes;

A display module configured to display the content of the combined message according to the preset method.

B16. The device according to B15, wherein the additional information includes at least one of the following:

Static information, including at least one of text, pictures, audio, and video related to the picture feature information, and/or, a display template for arranging text or pictures related to the picture feature information;

Dynamic information includes processing information for the image content element.

B17. The device according to B16, wherein the display module is further configured as:

If the additional information is at least one of text, pictures, audio, and video related to the feature information of the picture, display the picture embedded with the additional information; or receive a message from the user corresponding to the content element of the picture A trigger operation performed in the image area to display the additional information;

If the additional information is a display template for arranging text or pictures related to the feature information of the picture, displaying the content of the picture arranged according to the relevant display template;

If the additional information is the dynamic information, display the content that the processing information for the image content element is applied to the image content element.

B18. The device according to B17, wherein, when the picture feature information is the picture content element, the display module is further configured to: display that the additional information is embedded in the picture area corresponding to the picture content element picture of.

B19. An interactive message processing system, including the sending end described in any one of B10 to B14 and the receiving end described in any one of B15 to B18, wherein,

The sending end is configured to extract picture feature information from a to-be-sent message carrying a picture, wherein the picture feature information includes picture content elements and/or picture attributes; acquire additional information related to the picture feature information; Combine the additional information with the picture in the message to be sent in a preset manner to generate a combined message and send it;

The receiving end is configured to receive a combined message from the sending end, wherein the combined message includes a picture combined with additional information, and a preset method for combining the picture with the additional information, and the additional information It is related to the picture feature information of the original picture before combination, the picture feature information includes picture content elements and/or picture attributes; and the content of the combined message is displayed according to the preset method.

Claims (10)

1. a processing method for interactive message, comprising:

From carry the message to be sent of picture, extract picture feature information, wherein, described picture feature information comprises image content element and/or picture attribute;

Obtain the additional information relevant to described picture feature information;

With predetermined manner, the picture in described additional information and described message to be sent is combined, generate combined message, and send.

2. method according to claim 1, wherein, described additional information comprise following one of at least:

Static information, one of comprises in the text relevant to described picture feature information, picture, audio frequency, video at least, and/or, indicating template relevant to described picture feature information, for text or picture are arranged;

Multidate information, comprises the process information for described image content element.

3. method according to claim 2, wherein, obtains the additional information relevant to described picture feature information, comprising:

If described additional information is described static information, described picture feature information is mated in additional information storehouse, obtain described additional information; Or, obtain the described additional information that user selects for picture region corresponding to described image content element;

If described additional information is described multidate information, receive the processing instruction from user, obtain described additional information.

4. according to the method in claim 2 or 3, wherein, with predetermined manner, the picture in described additional information and described message to be sent is combined, comprising:

If described additional information be in the text relevant to described picture feature information, picture, audio frequency, video one of at least, described additional information is embedded to the picture in described message to be sent; Or, by the described additional information picture region corresponding stored corresponding with described image content element, show described additional information when carrying out trigger action for described picture region;

If described additional information is indicating template relevant to described picture feature information, for text or picture are arranged, the picture in described message to be sent is arranged according to relevant indicating template;

If described additional information is described multidate information, described image content element will be applied to for the process information of described image content element.

5. method according to claim 4, wherein, in the time that described picture feature information is described image content element, embeds the picture in described message to be sent by described additional information, comprising:

Determine picture region corresponding to described image content element;

Described additional information is embedded to the described picture region of determining.

6. a processing method for interactive message, comprising:

Receive the combined message from transmitting terminal, wherein, described combined message comprises the predetermined manner that combination has the picture of additional information and described picture and described additional information to carry out described combination, described additional information is relevant to the picture feature information of original image before combination, and described picture feature information comprises image content element and/or picture attribute;

Show the content of described combined message according to described predetermined manner.

7. method according to claim 6, wherein, described additional information comprise following one of at least:

Static information, one of comprises in the text relevant to described picture feature information, picture, audio frequency, video at least, and/or, indicating template relevant to described picture feature information, for text or picture are arranged;

Multidate information, comprises the process information for described image content element.

8. a processing unit for interactive message, is applied to transmitting terminal, comprising:

Extraction module, is configured to extract picture feature information the message to be sent from carrying picture, and wherein, described picture feature information comprises image content element and/or picture attribute;

Acquisition module, is configured to obtain the additional information relevant to described picture feature information;

Composite module, is configured to predetermined manner, the picture in described additional information and described message to be sent be combined, and generates combined message, and sends.

9. a processing unit for interactive message, is applied to receiving terminal, comprising:

Receiver module, be configured to receive the combined message from transmitting terminal, wherein, described combined message comprises the predetermined manner that combination has the picture of additional information and described picture and described additional information to carry out described combination, described additional information is relevant to the picture feature information of original image before combination, and described picture feature information comprises image content element and/or picture attribute;

Display module, is configured to show according to described predetermined manner the content of described combined message.

10. a treatment system for interactive message, comprises transmitting terminal as claimed in claim 8 and receiving terminal claimed in claim 9, wherein,

Described transmitting terminal, is configured to extract picture feature information the message to be sent from carrying picture, and wherein, described picture feature information comprises image content element and/or picture attribute; Obtain the additional information relevant to described picture feature information; With predetermined manner, the picture in described additional information and described message to be sent is combined, generate combined message, and send;

Described receiving terminal, be configured to receive the combined message from transmitting terminal, wherein, described combined message comprises the predetermined manner that combination has the picture of additional information and described picture and described additional information to carry out described combination, described additional information is relevant to the picture feature information of original image before combination, and described picture feature information comprises image content element and/or picture attribute; Show the content of described combined message according to described predetermined manner.