[go: up one dir, main page]

CN102830977B - Instant messaging adds the method for insert type data, client and system in recording - Google Patents

Instant messaging adds the method for insert type data, client and system in recording Download PDF

Info

Publication number
CN102830977B
CN102830977B CN201210299493.4A CN201210299493A CN102830977B CN 102830977 B CN102830977 B CN 102830977B CN 201210299493 A CN201210299493 A CN 201210299493A CN 102830977 B CN102830977 B CN 102830977B
Authority
CN
China
Prior art keywords
insert type
recording
type data
data
interaction frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201210299493.4A
Other languages
Chinese (zh)
Other versions
CN102830977A (en
Inventor
马宇尘
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Liangming Technology Development Co Ltd
Original Assignee
Shanghai Liangming Technology Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Liangming Technology Development Co Ltd filed Critical Shanghai Liangming Technology Development Co Ltd
Priority to CN201210299493.4A priority Critical patent/CN102830977B/en
Publication of CN102830977A publication Critical patent/CN102830977A/en
Application granted granted Critical
Publication of CN102830977B publication Critical patent/CN102830977B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The invention provides during a kind of instant messaging is recorded and add the method for insert type data, client and system, belong to communication, software technology field.Described method includes: gather the triggering message of recording operation in instant communication interaction, enters in order to recording audio and/or the recording state of video data;After triggering insert type control in recording process, it is loaded into insert type data;In the stream media interaction frame formed by recording audio and/or video data, correspond to aforementioned recording process is added the position of insert type data, add all or part of insert type data, or add the insertion mark in order to export insert type data after triggering;Between initiator and recipient, transmit and export the aforementioned stream media interaction frame with insert type data.Utilize the present invention, it is possible to record in the stream media interaction frame realized at instant messaging with audio frequency and/or video data, advantageously add insert type data, such as emotion icons etc..

Description

Instant messaging adds the method for insert type data, client and system in recording
Technical field
The invention belongs to communication, software technology field.
Technical background
JICQ is the communication tool that people apply widely, utilizes JICQ advantageously to enter The interactive operation of the multiple data forms such as style of writing basis, picture, voice, video, multimedia, and the transmission behaviour to existing document Make.
In current conventional JICQ, the voice of section type or video information is utilized to interact operation Form application is more prevalent.Such as, in Chinese market, the rice having been widely used is chatted and the JICQ such as wechat, logical The mode crossing one section of sound of recording interacts operation.Alternatively, it is also possible to interact operation by the way of recorded video.
During carrying out the recording operation of voice or video, typical mode of operation is: correspond to initiator and connects The instant messaging interactive interface having been switched between debit, is pressed the record in the interactive interface of place by a wherein side by touch screen Control processed, or utilize cursor to click on recording control so that it is after entering into recording state, record audio frequency and/or the video counts of user According to, and then stopping recording in the case of control carries out recording and trigger, by the audio frequency recorded and/or video content to flow matchmaker The form of body interaction frame is transmitted operation to the other side.
Under current technical conditions, if instant communication users wishes to add emotion icons, or caption information, Or if transmission picture, need independent of aforesaid stream media interaction frame, again with the form of a new instant communication message It is loaded into data, individually carries out push operation.Outside stream media interaction frame, carry out the mode of data insertion at present, not only operate numerous Trivial, and data cannot be inserted in stream media interaction frame.
Summary of the invention
It is an object of the invention to, it is provided that a kind of instant messaging adds the method for insert type data in recording, and supporting Client and system, utilize the present invention, it is possible to record the Streaming Media realized with audio frequency and/or video data at instant messaging In interaction frame, advantageously add insert type data, such as emotion icons etc..
A kind of instant messaging provided by the present invention adds the method for insert type data in recording, comprise the following steps that
Step 1, gathers the triggering message of recording operation in instant communication interaction, enters in order to recording audio and/or regards The recording state of frequency evidence;
Step 2, after triggering insert type control, is loaded into insert type data in recording process;
Step 3, is re-introduced into recording state, until recording proceeds to next step after terminating,
Or, it is re-introduced into recording state, repeats aforesaid step 2 and step 3, until recording proceeds to next after terminating Step,
Or, directly proceed to next step;
Step 4, in the stream media interaction frame formed by recording audio and/or video data, correspond to aforementioned record Process processed is added the position of insert type data, adds all or part of insert type data, or add in order to output after triggering slotting Enter the insertion mark of type data;
Step 5, between initiator and recipient, transmits and exports the aforementioned Streaming Media with insert type data mutual Frame.
Further, described insert type data, for emotion icons, and/or picture, and/or text, and/or audio frequency, and/ Or video, and/or multimedia, and/or animation, and/or existing document.
Further, adding the position of insert type data in described recording process, calculation is:
Obtain the lasting overall amount of time of institute's data recording in whole stream media interaction frame;
Obtain the time period of data recording when triggering insert type control;
Obtain the ratio between aforesaid time period and aforesaid overall amount of time;
The ratio obtained according to previous step, and in order to represent the total chi of the stream media interaction frame of streaming media playing time quantum Degree is multiplied, and takes correspondence position according to the yardstick obtained in stream medium data, as the position adding insert type control.
Further, during for partial content in aforesaid interpolation insert type data, at the Streaming Media triggering place After interaction frame or insert type data, the full content of output insert type data.
Further, correspond to be added with the stream media interaction frame of insert type data, with this stream media interaction frame close position It is provided with to export the output window of insert type data, this output window insert type data from described stream media interaction frame Position is drawn.
Further, the position of the insert type data in described stream media interaction frame, entered by the station location marker of bar shaped Row is expressed.
Further, after triggering stream media interaction frame or insert type data, generate output window, by this output window Mouth output insert type data.
Further, described insert type data are the view data that size is more than place stream media interaction frame permission size In the case of, obtain the thumbnail of this view data, be limited in stream media interaction frame and be inserted into.
Further, in the case of stream media interaction frame is in broadcast state, after broadcasting process to insert type data, suspend Play operation, after output insert type data, proceeds play operation.
Further, the output function of described insert type data, if if insert type data are image or character content, if Put the output time threshold value of these insert type data, after exceeding this threshold value, continue play stream media data.
Further, described insert type data, in stream media interaction frame, are only play to insert type data at Streaming Media During correspondence position in interaction frame, just export.
Further, described insert type control is the expression control inserting emotion icons, correspond to record control and arranges.
Further, described recording control and expression control, by recording control or expression control are carried out position and move, Realize the conversion between both controls.
Further, by the way of recording control or expression control being carried out in chute position and moves, expression control is triggered Part and recording control are changed between the two.
Further, correspond to described recording control and expression control, by by record in the case of keeping the state that presses The mode that control processed is outwards stirred, generates expression control.
Further, correspond to generated expression control, in the case of keeping the state that presses, clawback is to recording control institute Position, recover to record control trigger action.
Further, correspond to express one's feelings control keep press state in the case of, gather obtain to except record control it After outer position carries out stirring the message of operation, generate the expression window with expression item.
Further, in the case of keeping pressing state to expression control, gather and obtain touch point in target expression item position Putting the stop message at place, the emotion icons corresponding to item of target being expressed one's feelings is acquired operation.
Further, when the expression window that there is expression item by triggering expression control to generate, generate and close on expression window, Use record to close on expression item in order to export to close on, and generate window of comprehensively expressing one's feelings, in order to export the item of respectively expressing one's feelings prestored.
Further, carried out changing to the triggering state of insert type control by the triggering state recording control gathering to obtain During operation information, stop recording control to audio frequency and/or the recording operation of video data.
The present invention also provides for adding during a kind of instant messaging is recorded the client of insert type data, and this client includes:
Record trigger element, in order to gather the triggering message of recording operation in instant communication interaction, enter in order to record Audio frequency and/or the recording state of video data;
Data interpolating unit, after triggering insert type control in recording process, is loaded into insert type data;
Interaction frame inserts unit, in order in the stream media interaction frame formed by recording audio and/or video data, Correspond to aforementioned recording process is added the position of insert type data, add all or part of insert type data, or add in order to The insertion mark of insert type data is exported after triggering;
Interaction frame output unit, in order between initiator and recipient, transmits and exports and aforementioned have insert type data Stream media interaction frame.
The present invention also provides for adding during a kind of instant messaging is recorded the system of insert type data, and this system includes:
Initiator's client, it includes,
Record trigger element, gather touching of recording operation in order to the instant messaging between initiator and recipient is middle alternately Messaging, enters in order to recording audio and/or the recording state of video data;
Data interpolating unit, after triggering insert type control in the recording process of initiator, is loaded into insert type data;
Interaction frame inserts unit, in order in the stream media interaction frame formed by recording audio and/or video data, Correspond to aforementioned recording process is added the position of insert type data, add all or part of insert type data, or add in order to The insertion mark of insert type data is exported after triggering;
Interaction frame push unit, pushes to down in order to the data content of the stream media interaction frame by being added with insert type data The recipient's client stated;
Initiator's interaction frame output unit, in order in the instant messaging interactive interface corresponding with recipient initiator, defeated Go out the aforementioned stream media interaction frame with insert type data, and export insert type data therein according to output condition;
Recipient's client, it includes,
Interaction frame receives unit, in order to receive the Streaming Media with insert type data that aforementioned initiator's client is sent Interaction frame;
Recipient interaction frame output unit, in order to receive the stream matchmaker with insert type data that unit is received by interaction frame Body interaction frame exports, and exports insert type data therein according to output condition.
Accompanying drawing explanation
Fig. 1 is the flow chart of the method adding insert type data during instant messaging of the present invention is recorded, for embodiment 1.
Fig. 1 a is the schematic diagram of a kind of example of the present invention.
Fig. 2 is the flow chart of the method adding insert type data during instant messaging of the present invention is recorded, for embodiment 2.
Fig. 3 is the flow chart of the method adding insert type data during instant messaging of the present invention is recorded, for embodiment 3.
Fig. 4 is the structured flowchart of the client adding insert type data during instant messaging of the present invention is recorded, for implementing Example 4.
Fig. 5 is the structured flowchart of the system adding insert type data during instant messaging of the present invention is recorded, for embodiment 5。
Detailed description of the invention
Embodiment 1
The present invention can insert other data letter during the stream medium data of the form such as recording audio or video Breath, does not limits the type of this data message.For realizing this function, shown in ginseng Fig. 1, the one that the present embodiment is provided is i.e. Shi Tongxin adds the method for insert type data in recording, comprise the steps:
Step S110, gathers the triggering message of recording operation in instant communication interaction, enter in order to recording audio and/or The recording state of video data;
Step S120, after triggering insert type control, is loaded into insert type data in recording process;
Step S130, is re-introduced into recording state, until recording proceeds to next step after terminating,
Or, it is re-introduced into recording state, repeats aforesaid step S120 and step S130, until recording turns after terminating Enter next step,
Or, directly proceed to next step;
Step S140, in the stream media interaction frame formed by recording audio and/or video data, correspond to aforementioned Recording process is added the position of insert type data, adds all or part of insert type data, or add in order to export after triggering The insertion mark of insert type data;
Step S150, between initiator and recipient, transmits and exports the aforementioned Streaming Media with insert type data and hand over Frame mutually.
Instant messaging described here is mutual, and referring to can be by recording independent audio frequency and/or the shape of video data Formula interacts, and the data of recording is represented by the form of stream media interaction frame.
In the present embodiment, user, by triggering audio frequency or the recording operation of video data, such as triggers and records control, Enter into the recording state to audio frequency and/or video data.During recording, user there may be insertion other data letter The demand of breath.In the present invention, the type of inserted data message is not do any restriction.As common embodiment, use Family is likely to wish to insert emotion icons.In instant messaging, the information representation form that emotion icons right and wrong are usually shown in, can be by Various common expressions, images of items, landscape image etc. are expressed with small-sized icon.These icons can express use The happiness, anger, grief and joy at family, or other implication.This kind of form of icons, for convenience of description, is referred to as emotion icons.
Such as, during user's recording audio data, if it is desired to if adding emotion icons, then can directly touch Hair is to add the expression control of icon operation.After triggering expression control, it is possible to suspend the recording to voice data Operation, until emotion icons adds complete;Or, it is also possible to it is always maintained at the recording operation to voice data, and during this period Complete the operation of the interpolation to emotion icons.
After the interpolation completing emotion icons operates, the recording operation of this stream medium data can be terminated;Certainly, Can continue to the state returning to record stream medium data, as an example, recording audio data can be continued.Further, exist During recording audio data, it is also possible to be again loaded into other insert type data.Grasp in the insertion completing insert type data Make and after the recording operation of stream medium data, it is possible to generate in order to the stream media interaction frame representing stream medium data.Should Stream media interaction frame, common form is bar shaped, it should be pointed out that can also use other various profiles.No matter which The stream media interaction frame of type, all has corresponding yardstick.Then, it is possible to using this length dimension as total length, then Judge to add insert type data position in this total length, corresponding data are inserted in the stream media interaction frame at place.
When it is pointed out that in the stream media interaction frame inserting data into correspondence, for the insertion that length is shorter For type data, such as emotion icons, the space directly increasing relevant position is the most permissible;For longer data, such as one Long section character, or larger-size picture, etc., then can generate insert type data output window, and this window at close position Mouth correspond on position and is labeled.
Shown in ginseng Fig. 1 a, in the instant messaging interactive interface 10 that this figure is shown, use between user A and user B and record The mode of audio frequency and/or video interacts communication.The stream medium data recorded, is entered by the form of stream media interaction frame 20 Row presents.Described stream media interaction frame 20 is strip structure.Correspond to user A sent below a Streaming Media mutual Frame 20, wherein has the insert type data 40 that user A is added during recording stream medium data, and these insert type data 40 are one Individual smiling face's icon.
Correspond to, in the stream media interaction frame 20 that user B is sent, be also equipped with insert type data 40.Insert type at this Data 40 individually export by the way of output window 30, and its content is a photos.Correspond to this output window 30, if It is equipped with window and extends tip format, represent the implication of specific extraction from place stream media interaction frame 20.Further, also set up There is the station location marker 31 of bar shaped, draw at this station location marker 31 in order to identify described output window 30.
The terminal unit of the application present invention, is to install JICQ, and can carry out audio frequency or video The terminal unit of data recording.Typical terminal unit is PC, smart mobile phone, personal digital assistant etc., the most not Limit.
The recording trigger action of streaming media data, and the trigger action to insert type data, its concrete triggering shape Formula does not limits.As common way of realization, it is that corresponding trigger control is set, such as, recording control and insertion are set Type control, by triggering the recording function recording control startup stream medium data, triggers insert type by triggering insert type control The update of data.Alternatively, it is also possible to realize aforesaid Trigger Function by arranging corresponding shortcut, or pass through voice Know and trigger otherwise, or trigger by the way of action recognition, do not limit.It addition, it is the most normal Terminal in, be much provided with touch screen.When triggering aforementioned controls, it is convenient for carrying out operation by touch screen 's;It is of course also possible to operated by cursor of mouse, etc..
Insert type data described in the invention, can be various data modes, not limit.As typical real Execute example, described insert type data, for emotion icons, and/or picture, and/or text, and/or audio frequency, and/or video, and/ Or multimedia, and/or animation, and/or existing document.Wherein, carry out instant messaging mutual during, emotion icons is For common insert type data.Next also can pass through specific embodiment, describe the emotion icons reality as insert type data Existing mode.
Further, it is that size is more than place stream media interaction frame and allows the view data of size in described insert type data In the case of, such as, the stream media interaction frame at place is strip structure, and the distance between upper and lower side frame is 40 pixels, and required Image pixel to be inserted is 400*600, and the size of this image is significantly greater than the size of the stream media interaction frame needing insertion.In It is, it is possible to obtain the thumbnail of this view data so that thumbnail is sized to completely be limited in stream media interaction frame In size range, and insert according to the correspondence position adding insert type data in recording process.
Further, for every kind of data mode of insert type data, it is also possible to be respectively provided with and be loaded into control accordingly.Described Loading control, can be in order to upload existing data, the most existing icon, picture, video data, voice data, text Data, animation data, etc.;Furthermore it is also possible to outside independent of aforesaid recording control, arrange special recording insert type data Control structure, to record the text data that user is sent, or image data, or voice data, or video data etc. is various Data.
After user completes the recording process of stream medium data, it is possible to the insert type data obtained are added to In corresponding stream media interaction frame.In the present invention, it is in the Streaming Media recording process that insert type data are added to correspondence.For In stream media interaction frame, obtain suitable point of addition, can implement as follows:
Obtain the lasting overall amount of time of institute's data recording in whole stream media interaction frame;
Obtain the time period of data recording when triggering insert type control;
Obtain the ratio between aforesaid time period and aforesaid overall amount of time;
The ratio obtained according to previous step, and in order to represent the total chi of the stream media interaction frame of streaming media playing time quantum Degree is multiplied, and takes correspondence position according to the yardstick obtained in stream medium data, as the position adding insert type control.
As an example, the data recorded in aforementioned stream media interaction frame are taken as voice data, lasting total time It it is 10 seconds.During carrying out voice data recording, user inserts an emotion icons representing smiling face.This smiling face's table The recording operation of feelings icon, is by triggering the expression control realization in order to add emotion icons.Wherein, this expression control is triggered In the moment of part, correspond to the 3.5th second into recording process.It addition, the time after triggering emotion icons is until again carrying out audio frequency The time period of data recording, suspend the recording operation carrying out voice data.Utilize the mode of this time-out, user can be allowed to have abundance Time carries out the selection operation of emotion icons, and does not carry out the recording operation of voice data in not worrying this time period.
Aforesaid 3.5 seconds were compared with 10 seconds, it is thus achieved that time ratios is 35%.Take in the stream media interaction frame at place in order to The region overall size representing voice data playout length is L.Then, it is possible at the 35%L length of this size, one is increased Space, utilizes this space to insert aforesaid smiling face's emotion icons.
If if the simple data that insert type data are emotion icons one class, directly stream media interaction frame is vacated a small amount of sky Lattice, then it is the most permissible to carry out insertion.If the insert type data the added character that to be length shorter, it is also possible to similar Form, in stream media interaction frame, slot milling carries out update;And for the data that length is bigger, such as data If amount reaches 500 characters, it is also possible to only show a part of character data therein, such as, show front 5 characters, and its Its character, in the region triggering insert type data place, or after triggering the stream media interaction frame at place, generates and inserts Enter the output window of type data, by the character content that the output of this output window is complete.
The most such as, if if loaded data are a PDF document, it is also possible to expressed by other form, Such as, insertion mark is set.As an example, this insertion mark is the icon including " PDF " these three character.Described insertion Mark, and sets up between corresponding insert type data have linking relationship in advance, after triggering this insertion mark, the most adjustable Take the insert type data of correspondence, output it after generating output window.
Further, it is also possible to the output function of insert type data and the broadcast state of stream media interaction frame are mapped. This is because have temporal corresponding relation between described insert type data and streaming media playing process.It is being embodied as Time, gather the time course that the stream medium data corresponding to stream media interaction frame is play, it is determined that corresponding time course is whether Arrive the moment that insert type data are added, if arriving this moment, then can suspend broadcasting process, exporting insert type number According to.When carrying out the output function of insert type data, both can export in stream media interaction frame, this mode is suitable for chi Very little less insert type data, it is also possible to generate the output window of insert type data, carry out data output in this output window. Described output function, if insert type data are simple image or character content, can arrange output time threshold Value, such as 3 seconds, after meeting or exceeding this threshold value, it is possible to continue play stream media data;If it addition, insert type If data are the stream medium data such as audio frequency or video, then need after insert type data playback is complete, be further continued for playing Original streaming medium content, it is of course also possible to gather user's message that insert type data playback is stopped, former in order to continue to play Some streaming medium contents.
Correspond to embodiment above, it is also possible to the insert type data that will be arranged in stream media interaction frame, only broadcast Just exporting when putting to insert type data correspondence position in stream media interaction frame, other situation does not exports.
Insert type data described in the invention, are particularly suited for the update to emotion icons.Triggering expression figure During target update, may correspond to instant messaging interactive interface, insert type control is set to control of expressing one's feelings, this expression control Part correspond to record the recording control of stream medium data and is configured.
User can be by easy operation, to recording control and expressing one's feelings control between the two in the process of recording operation State convert.As an example, can be by described recording control and expression control, by recording control or expression control Position move operation, it is achieved the conversion between both controls.When carrying out position and moving, as an example, may correspond to Record control and expression control arranges chute, when recording control and moving to the opposite side of chute, just start to expression control The conversion operation of part, when moving to the position preset, is just changed into the behaviour of expression control by the mode of operation recording control Make state.
Further, it is also possible to gather and will record the operation information that control is stirred to any direction around or dragged, it is pre- It is set to trigger the operation format of expression control.When collecting this kind of operation information, expression control can be started.Further, also Can be under triggering state at expression control, by the initial bit by the position clawback again of expression control to recording control Put, trigger the recovery operation recording control duty.
The foregoing operation information such as operation, or drag operation of stirring, are especially suitable for being operated by touch screen; Certainly, the operation instrument by cursor of mouse one class is the most permissible.
When control of expressing one's feelings is toggled, generate the expression window with expression item.As preferred embodiment, Described expression item is expressed by each icon with image, and these expression item composition array formats select for user. After user triggers corresponding expression item, it is possible to by the form of call back function, transferring, place expression item is corresponding After iconic content, add among the process that Streaming Media is recorded.As an example, when utilizing touch screen to carry out touch operation, Touch time of staying threshold value when selecting target expression item is set, gathers user in this specific objective expression item position Stop message, it is determined that whether the time of staying has reached predetermined threshold value, in the case of reaching, then enters the expression item triggered Row gathers.
Further, for the convenience selected, it is also possible at the expression window by triggering expression control generation with expression item During mouth, generate and close on expression window, use record to close on expression item in order to export to have to close on;And generate window of comprehensively expressing one's feelings Mouthful, in order to export the various expression items prestored.
In order to preferably describe the exemplary embodiments of these insert type data of emotion icons, will be in ensuing embodiment 2 It is described further with in embodiment 3.
Embodiment 2
In the present embodiment, insert type data are taken as emotion icons.For convenience of description, access of instant communicating is set The terminal of instrument has touch screen, and the recording operation to Content of Communication is to realize via the approach of touch screen.That is recorded is logical Letter content is the voice messaging of initiator.
Specifically, shown in ginseng Fig. 2, a kind of instant messaging that the present embodiment is provided adds insert type data in recording Method, implementation step is as follows:
Step S210, in the instant messaging interactive operation of initiator and recipient, gathers initiator by touch screen and touches Press the triggering message recording control in order to realize sound-recording function, wherein this recording control is supporting is provided with sliding groove structure, pass through Sliding position triggers the expression control in order to add emotion icons, or recovers recording control by returning to the position slided Trigger;
Step S220, the initiator's client corresponding to initiator enters into the recording state of speech data, records and initiates The voice messaging of side;
Step S230, in the case of keeping pressing state to recording control by touch screen, will record control to place The opposite side of sliding groove structure drags, and aforementioned recording control transfers in dragging process expression control, and records gathering to obtain Control stops recording operation in the case of dragging message;
Step S240, in the case of recording control transfers expression control to, triggers expression control output and includes expression item Expression window, this expression window is divided into the expression region of the left and right sides, and wherein expression region in left side is for closing on expression window, the right side Expression region, side is window of comprehensively expressing one's feelings;
Step S250, in the case of keeping pressing state to place touch screen, gathers touch point to closing on expression window Or the stop message of item position of expressing one's feelings in comprehensive expression window;
Step S260, in the case of aforesaid stop message reaches activation threshold value, selects the expression item of institute stop place, The emotion icons of its correspondence is loaded into the stall position of recording process;
Step S270, in the case of keeping pressing state to expression control, drags expression control by aforesaid chute Move to the initial position recording control, in the case of moving to initial position, be changed into recording control, continue to gather user Voice messaging;
Or, when collection acquisition touch point moves apart the message of place touch screen from recording control, it is judged to record Carry out the triggering message of recorded content transmission after completing, the emotion icons of the voice messaging recorded and collection is connect to corresponding Debit is transmitted;
Or, complete emotion icons in recording process loading operation after, gather obtain touch point from place screen from The message opened, is transmitted operation by voice messaging and the emotion icons of recording to corresponding contact object;
Step S280, in initiator's client and/or recipient's client, by the voice data of aforementioned recording by stream matchmaker Body interaction frame exports, and corresponding for emotion icons aforementioned stream media interaction frame is loaded at the stall position of recording process.
Embodiment 3
In the present embodiment, insert type data are taken as emotion icons equally.For convenience of description, login is set instant The terminal of means of communication has touch screen, and the recording operation to Content of Communication is to realize via the approach of touch screen.Recorded Content of Communication be the voice messaging of initiator.
Specifically, shown in ginseng Fig. 3, a kind of instant messaging that the present embodiment is provided adds insert type data in recording Method, implementation step is as follows:
Step S310, by touch screen collection to pressing message in order to realize that sound-recording function records control;
Step S320, in the case of keeping aforementioned recording control is pressed state, enters the recording state of speech data, Record the voice messaging of initiator;
Step S330, in the case of keeping aforementioned recording control is pressed state, gathers and obtains and will record touching of control Pressure point position carries out the message stirred to periphery, suspends the recording operation to voice messaging, and is transferred to next step;
Step S340, generates three expression controls, is static expression control, dynamic expression control and popular expression control respectively Part;
Step S350, gathers the triggering message to one of them control of expressing one's feelings, and generates and corresponding to this expression control Static icon window or dynamic icon window or popular icon window;
Step S360, obtains the selection message to the special icon item in special icon window, by selected icon item institute Corresponding icon is inconjunction with speech data and generates the stream media interaction frame with emotion icons content, and is carried by selected icon Enter to the aforementioned recording process location carried out when operation is stirred in position, touch point;
Step S370, is sent to the visitor at contact object place by the data content corresponding to aforesaid stream media interaction frame Family end;
Step S380, in initiator's client and/or recipient's client, by the voice data of aforementioned recording by stream matchmaker Body interaction frame exports, at recording process when position, touch point in corresponding for emotion icons aforementioned stream media interaction frame is stirred operation It is configured.
Embodiment 4
Shown in ginseng Fig. 4, the present invention also provides for adding during a kind of instant messaging is recorded the client 100 of insert type data, should Client 100 is a kind of instant communication client, it is possible to completes the various preset functions relevant with instant messaging, particularly can By recording audio and/or the form of video data, generate stream media interaction frame, after triggering this stream media interaction frame, energy The audio frequency of enough played pre-recorded and/or video information, in instant communication interaction interface as interactive information form carry out in Existing.This stream media interaction frame is usually bar mount structure, does not limits.
Further, described client 100 can also add insert type data, this insert type in stream media interaction frame Data can be various data mode, does not the most limit.For realizing this purpose, described client 100 also includes:
Record trigger element 110, in order to gather the triggering message of recording operation in instant communication interaction, enter in order to record Audio frequency processed and/or the recording state of video data;
Data interpolating unit 120, after triggering insert type control in recording process, is loaded into insert type data;
Interaction frame inserts unit 130, in order in the stream media interaction frame formed by recording audio and/or video data In, correspond to aforementioned recording process is added the position of insert type data, add all or part of insert type data, or add use To export the insertion mark of insert type data after triggering;
Interaction frame output unit 140, in order between initiator and recipient, transmits and exports and aforementioned have insert type number According to stream media interaction frame.
It is under starting state in described client 100, by recording trigger element 110, initiator and recipient Between instant messaging interactive operation in, it is possible to start the audio frequency in place terminal and/or the recording structure of video data, thus Gather initiator or the audio frequency of recipient and/or video data, by the data of collection in instant communication interaction interface, by stream The form of media interaction frame presents.Initiator or recipient can transmit stream media interaction frame each other.By this Plant stream media interaction frame and directly interact the form of operation, be the principal mode of this kind of instant messaging interactive operation.
Further, when initiator or recipient record stream medium data, it is also possible to by number described in the invention According to inserting unit 120, trigger the insert type control in order to realize adding insert type data.After starting this insert type control, Can suspend or proceed the recording operation of stream medium data according to default condition.Correspond to the insert type needing to add Data, the insert type control corresponding to different data types is respectively had any different.Such as, it is possible in order to add emotion icons, this In the case of Zhong, it is the most permissible that expression control is set;When in order to add content of text, it is also possible to corresponding control is set, etc..When So, it is also possible to the interface that can open comprehensive insert type data recording instrument is set, in order to be added various needs Insert type data, according to initiator or the needs of recipient, select or upload existing data, or record new number According to content.
After the recording operation of the stream medium data completed including audio frequency and/or video data, and complete After the interpolation operation of insert type data, it is possible to insert unit 130 by interaction frame, according to the stream medium data recorded Form stream media interaction frame, and according to the insert type data added position in stream medium data recording process, carry out Add operation.The insert type data added, shorter in data or in the case of being inserted easily into stream media interaction frame, permissible Corresponding stream media interaction frame is added, when data length is bigger, can only add partial insertion type data, triggering This partial insertion type data or trigger correspondence stream media interaction frame after, then export the data content of other parts; Or, if insert type data corresponding be individual document if, it is also possible to the form identified by insertion represents particular document, After triggering this insertion mark, transfer corresponding document and be transformed into opening.
It is pointed out that and can also generate independent output window output insert type data.This insert type data institute is right The output window answered, preferably adjoining with corresponding stream media interaction frame, and it is appropriate to labelling, representing this output window is Correspond to what position corresponding with broadcasting process in stream media interaction frame carried out inserting.
After obtaining the stream media interaction frame with insert type data, it is possible to by interaction frame output unit 140, Transmit and export this stream media interaction frame with insert type data between initiator and recipient.Utilize such stream matchmaker Body interaction frame, can allow initiator or recipient insert more easily and include emotion icons or other type of data letter Breath, is more conducive to carry out information representation.
Embodiment 5
Shown in ginseng Fig. 5, the present invention also provides for adding during a kind of instant messaging is recorded the system 200 of insert type data, and this is System 200 includes initiator's client 210, recipient's client 220, and system server.Initiator visitor described in utilization Family end 210 and recipient's client 220, be combined with system server, it is possible to completes the various preset functions of instant messaging.Especially It is to pass through recording audio and/or the form of video data, raw by initiator's client 210 or recipient's client 220 Become stream media interaction frame.After triggering this stream media interaction frame, it is possible to the audio frequency of played pre-recorded and/or video information, Instant communication interaction interface presents as interactive information form.This stream media interaction frame is usually bar mount structure, when So do not limit.
Further, by aforesaid initiator's client 210 or recipient's client 220, additionally it is possible to recorded In stream media interaction frame, adding insert type data, these insert type data can be various data mode, does not the most limit.For Realizing this purpose, described system 200 also includes:
Initiator's client 210, it includes,
Record trigger element 211, gather recording operation in order to the instant messaging between initiator and recipient is middle alternately Triggering message, enter in order to recording audio and/or the recording state of video data;
Data interpolating unit 212, after triggering insert type control in the recording process of initiator, is loaded into insert type number According to;
Interaction frame inserts unit 213, in order in the stream media interaction frame formed by recording audio and/or video data In, correspond to aforementioned recording process is added the position of insert type data, add all or part of insert type data, or add use To export the insertion mark of insert type data after triggering;
Interaction frame push unit 214, pushes in order to the data content of the stream media interaction frame by being added with insert type data To following recipient's client 220;
Initiator's interaction frame output unit 215, in order in the instant messaging interactive interface corresponding with recipient initiator, Export the aforementioned stream media interaction frame with insert type data, and export insert type data therein according to output condition;
Recipient's client 220, it includes,
Interaction frame receives unit 221, has insert type data in order to receive that aforementioned initiator's client 210 sent Stream media interaction frame;
Recipient interaction frame output unit 222, has insert type data in order to what interaction frame received unit 221 received Stream media interaction frame output, and according to output condition export insert type data therein.
In the specific implementation, by the recording trigger element 211 in initiator's client 210, initiator and recipient Between interact communication during, gather initiator and record stream media information including audio frequency and/or video data Triggering message, enter into the recording state of streaming media data.In this case, as an example, initiator can give an oral account This section of words are carried out recording operation by one section of word.
Described data interpolating unit 212, in initiator carries out the recording operation process of stream medium data, starts and inserts Type control, selects the data message needing to insert, or again records the data message needing to insert, complete insert type data Add operation.Such as, during initiator gives an oral account one section of word, initiator the interpolation triggering emotion icons operates, according to The selection of initiator, inserts smiling face's expression.
After initiator completes the recording process of stream medium data, and complete the interpolation operation of insert type data Afterwards, it is possible to insert unit 213 by aforesaid interaction frame, it is mutual that stream medium data user recorded forms Streaming Media Frame, and process when correspond to add insert type data in this stream media interaction frame, select in stream media interaction frame with should The position that process is corresponding, adds insert type data, and the insert type data added, can be the full contents of data, it is possible to To be the partial content of data, or add insertion mark.Wherein, in the case of adding partial insertion type data, trigger After the stream media interaction frame at place or insert type data, other data division can be exported;And insert mark adding In the case of knowledge, after triggering insertion mark, transfer the data message corresponding with this insertion mark and export.
After the generation completing the stream media interaction frame with insert type data operates, can be by corresponding data By interaction frame push unit 214, the data content being added with the stream media interaction frame of insert type data is pushed to aforesaid Recipient's client 220.Meanwhile, by initiator's interaction frame output unit 215, instant with corresponding to recipient of initiator In communication interaction interface, export the stream media interaction frame with insert type data noted earlier.Insert type data therein are permissible Directly correspond to stream media interaction frame export, be included in stream media interaction frame and export, it is also possible to generate output window Mouthful, adjacent to stream media interaction frame and export;Furthermore it is also possible to arrange output condition, such as, at the insert type triggering place In the case of the region of data or triggering stream media interaction frame, then export.
The stream media interaction frame with insert type data pushed by initiator's client 210, by recipient client Interaction frame in end 220 receives unit 221 and is received, and then goes to recipient interaction frame output unit 222, and output has slotting Enter the stream media interaction frame of type data, and the Streaming Media with insert type data that above initiator's client 210 is exported is handed over The mode of frame is similar to mutually, it is possible to directly insert type data be correspond to stream media interaction frame and exports, or arranges output bars Part, such as, this output condition can be the triggering message to insert type data region, or mutual to place Streaming Media The triggering message of frame, in the case of obtaining this triggering message, then exports default insert type data.Or triggering stream matchmaker After the play operation of body interaction frame, in the case of the process play arrives the moment adding insert type data, then output is pre- If insert type data.
Being above the description of this invention and non-limiting, other embodiments based on inventive concept, the most all in the present invention Protection domain among.

Claims (22)

1. the method that an instant messaging adds insert type data in recording, it is characterised in that the method comprises the following steps that
Step 1, gathers the triggering message of recording operation in instant communication interaction, enters in order to recording audio and/or video counts According to recording state;
Step 2, after triggering insert type control, is loaded into insert type data in recording process;
Step 3, is re-introduced into recording state, until recording proceeds to next step after terminating,
Or, it is re-introduced into recording state, repeats aforesaid step 2 and step 3, until recording proceeds to next step after terminating Suddenly,
Or, directly proceed to next step;
Step 4, in the stream media interaction frame formed by recording audio and/or video data, correspond to aforementioned record into Journey is added the position of insert type data, adds all or part of insert type data, or add in order to export insert type after triggering The insertion mark of data;
Step 5, between initiator and recipient, transmits and exports the stream media interaction frame with insert type data, described Insert type data or insertion mark are limited in stream media interaction frame and are inserted into.
A kind of instant messaging the most according to claim 1 adds the method for insert type data in recording, it is characterised in that: institute The insert type data stated, for emotion icons, and/or picture, and/or text, and/or audio frequency, and/or video, and/or many matchmakers Body, and/or animation, and/or existing document.
A kind of instant messaging the most according to claim 1 adds the method for insert type data in recording, it is characterised in that: institute Stating the position adding insert type data in recording process, calculation is,
Obtain the lasting overall amount of time of institute's data recording in whole stream media interaction frame;
Obtain the time period of data recording when triggering insert type control;
Obtain the ratio between aforesaid time period and aforesaid overall amount of time;
The ratio obtained according to previous step, with the stream media interaction frame out to out phase in order to represent streaming media playing time quantum Take advantage of, in stream medium data, take correspondence position according to the yardstick obtained, as the position adding insert type control.
A kind of instant messaging the most according to claim 1 adds the method for insert type data in recording, it is characterised in that: right The situation of the partial content in aforesaid interpolation insert type data, is triggering stream media interaction frame or the insert type data at place After, the full content of output insert type data.
A kind of instant messaging the most according to claim 1 adds the method for insert type data in recording, it is characterised in that: right Answer the stream media interaction frame being added with insert type data, be provided with to export insertion with this stream media interaction frame close position The output window of type data, this output window insert type data position from described stream media interaction frame is drawn.
A kind of instant messaging the most according to claim 5 adds the method for insert type data in recording, it is characterised in that: institute State the position of insert type data in stream media interaction frame, expressed by the station location marker of bar shaped.
A kind of instant messaging the most according to claim 1 adds the method for insert type data in recording, it is characterised in that: After triggering stream media interaction frame or insert type data, generate output window, export insert type data by this output window.
A kind of instant messaging the most according to claim 1 adds the method for insert type data in recording, it is characterised in that: institute The insert type data stated are, in the case of size is more than the view data that place stream media interaction frame allows size, to obtain this image The thumbnail of data, is limited in stream media interaction frame and is inserted into.
A kind of instant messaging the most according to claim 1 adds the method for insert type data in recording, it is characterised in that: In the case of stream media interaction frame is in broadcast state, after broadcasting process to insert type data, suspending play operation, output is inserted After type data, proceed play operation.
A kind of instant messaging the most according to claim 1 adds the method for insert type data in recording, it is characterised in that: The output function of described insert type data, if if insert type data are image or character content, arranges this insert type data Output time threshold value, after exceeding this threshold value, continue play stream media data.
11. a kind of instant messagings according to claim 1 add the method for insert type data in recording, it is characterised in that: Described insert type data, in stream media interaction frame, are only play to the insert type data corresponding position in stream media interaction frame When putting, just export.
12. a kind of instant messagings according to claim 1 add the method for insert type data in recording, it is characterised in that: Described insert type control is the expression control inserting emotion icons, correspond to record control and arranges.
13. a kind of instant messagings according to claim 12 add the method for insert type data in recording, it is characterised in that: Described recording control and expression control, by carrying out position move recording control or expression control, it is achieved both controls Between conversion.
14. a kind of instant messagings according to claim 13 add the method for insert type data in recording, it is characterised in that: By the way of recording control or expression control being carried out in chute position and moves, trigger expression control and record control Between change.
15. a kind of instant messagings according to claim 13 add the method for insert type data in recording, it is characterised in that: Correspond to described recording control and expression control, by recording what control was outwards stirred in the case of keeping the state that presses Mode, generates expression control.
16. a kind of instant messagings according to claim 15 add the method for insert type data in recording, it is characterised in that: Correspond to generated expression control, in the case of keeping the state that presses, clawback is to the position at recording control place, recovers right Record the trigger action of control.
17. a kind of instant messagings according to claim 16 add the method for insert type data in recording, it is characterised in that: The control that correspond to express one's feelings, in the case of keeping pressing state, gathers and obtains to stirring except recording the position in addition to control After the message of operation, generate the expression window with expression item.
18. a kind of instant messagings according to claim 17 add the method for insert type data in recording, it is characterised in that: In the case of keeping pressing state to expression control, gather the stop message obtaining touch point in target expression item position, The emotion icons corresponding to item of target being expressed one's feelings is acquired operation.
19. a kind of instant messagings according to claim 17 add the method for insert type data in recording, it is characterised in that: When the expression window that there is expression item by triggering expression control to generate, generate and close on expression window, make in order to export to close on Close on expression item with record, and generate window of comprehensively expressing one's feelings, in order to export the item of respectively expressing one's feelings prestored.
20. a kind of instant messagings according to claim 1 add the method for insert type data in recording, it is characterised in that: When collection acquisition is carried out, to the triggering state of insert type control, the operation information changed by the triggering state recording control, stop Record control to audio frequency and/or the recording operation of video data.
21. 1 kinds of instant messagings implementing method described in claim 1 add the client of insert type data, its feature in recording It is that this client includes:
Record trigger element, in order to gather the triggering message of recording operation in instant communication interaction, enter in order to recording audio And/or the recording state of video data;
Data interpolating unit, after triggering insert type control in recording process, is loaded into insert type data;
Interaction frame inserts unit, in order in the stream media interaction frame formed by recording audio and/or video data, corresponding The position adding insert type data in aforementioned recording process, add all or part of insert type data, or add in order to trigger The insertion mark of rear output insert type data;
Interaction frame output unit, in order between initiator and recipient, transmits and exports the aforementioned stream with insert type data Media interaction frame.
22. 1 kinds of instant messagings implementing method described in claim 1 add the system of insert type data in recording, its feature exists Include in this system:
Initiator's client, it includes,
Record trigger element, disappear in order to the middle triggering gathering recording operation alternately of the instant messaging between initiator and recipient Breath, enters in order to recording audio and/or the recording state of video data;
Data interpolating unit, after triggering insert type control in the recording process of initiator, is loaded into insert type data;
Interaction frame inserts unit, in order in the stream media interaction frame formed by recording audio and/or video data, corresponding The position adding insert type data in aforementioned recording process, add all or part of insert type data, or add in order to trigger The insertion mark of rear output insert type data;
Interaction frame push unit, pushes to following in order to the data content of the stream media interaction frame by being added with insert type data Recipient's client;
Initiator's interaction frame output unit, in order in the instant messaging interactive interface corresponding with recipient initiator, before output State the stream media interaction frame with insert type data, and export insert type data therein according to output condition;
Recipient's client, it includes,
Interaction frame receives unit, mutual in order to receive the Streaming Media with insert type data that aforementioned initiator's client sent Frame;
Recipient interaction frame output unit, the Streaming Media with insert type data received in order to interaction frame to receive unit is handed over Frame output mutually, and export insert type data therein according to output condition.
CN201210299493.4A 2012-08-21 2012-08-21 Instant messaging adds the method for insert type data, client and system in recording Active CN102830977B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210299493.4A CN102830977B (en) 2012-08-21 2012-08-21 Instant messaging adds the method for insert type data, client and system in recording

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210299493.4A CN102830977B (en) 2012-08-21 2012-08-21 Instant messaging adds the method for insert type data, client and system in recording

Publications (2)

Publication Number Publication Date
CN102830977A CN102830977A (en) 2012-12-19
CN102830977B true CN102830977B (en) 2016-12-21

Family

ID=47334127

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210299493.4A Active CN102830977B (en) 2012-08-21 2012-08-21 Instant messaging adds the method for insert type data, client and system in recording

Country Status (1)

Country Link
CN (1) CN102830977B (en)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014140117A1 (en) * 2013-03-12 2014-09-18 Roche Diagnostics Gmbh Method for transmitting a glucose measure, method for displaying status during a wireless transmission of a glucose measure and handheld glucose meter
CN103400592A (en) * 2013-07-30 2013-11-20 北京小米科技有限责任公司 Recording method, playing method, device, terminal and system
CN103777891A (en) * 2014-02-26 2014-05-07 全蕊 Method for sending message by inserting an emoticon in message ending
AU2015242255B2 (en) * 2014-04-02 2016-05-12 Fabtale Productions Pty Ltd Enhanced messaging stickers
CN104182170B (en) * 2014-07-30 2019-06-04 广州三星通信技术研究有限公司 The method, apparatus and terminal that voice messaging is recorded
CN106155470B (en) * 2015-04-21 2019-09-17 阿里巴巴集团控股有限公司 A kind of audio file generation method and device
CN105049318B (en) 2015-05-22 2019-01-08 腾讯科技(深圳)有限公司 Message method and device, message treatment method and device
US10574726B2 (en) * 2015-10-16 2020-02-25 Google Llc Techniques for attaching media captured by a mobile computing device to an electronic document
CN106604112B (en) * 2016-11-18 2019-08-09 深圳市邦华电子有限公司 A kind of screen recording method, multi-medium play method and device
CN111722764B (en) * 2019-03-18 2024-07-12 钉钉(中国)信息技术有限公司 Message input and display method and device, electronic equipment and readable storage medium
CN110311858B (en) * 2019-07-23 2022-06-07 上海盛付通电子支付服务有限公司 Method and equipment for sending session message
CN110417641B (en) * 2019-07-23 2022-05-17 上海盛付通电子支付服务有限公司 Method and equipment for sending session message
CN111833917A (en) * 2020-06-30 2020-10-27 北京印象笔记科技有限公司 Information interaction method, readable storage medium and electronic device
CN112019912A (en) * 2020-08-24 2020-12-01 珠海格力电器股份有限公司 Screen recording method, device, equipment and medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1482787A (en) * 2002-09-10 2004-03-17 腾讯科技(深圳)有限公司 Method for implementing multimedia short message intercommunion between instant communication tool and mobile phone
US20080177835A1 (en) * 2005-04-29 2008-07-24 International Business Machines Corporation Methods and Apparatus for Managing and Distinguishing Instant Messaging Sessions and Threads

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1482787A (en) * 2002-09-10 2004-03-17 腾讯科技(深圳)有限公司 Method for implementing multimedia short message intercommunion between instant communication tool and mobile phone
US20080177835A1 (en) * 2005-04-29 2008-07-24 International Business Machines Corporation Methods and Apparatus for Managing and Distinguishing Instant Messaging Sessions and Threads

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
微信2.0 for Android(语音版)全新发布;腾讯科技;《http://weixin.qq.com/cgi-bin/readtemplate?uin=&stype=&promote=&fr=&lang=zh_CN&ADTAG=&check=false&nav=faq&t=weixin_faq_android_20》;20110518;第1-2页 *
微信3.6forAndroid全新发布;腾讯科技;《http://weixin.qq.com/cgi-bin/readtemplate?uin=&stype=&promote=&fr=&lang=zh_CN&ADTAG=&check=false&nav=faq&t=weixin_faq_android_36》;20120119;第1-2页 *

Also Published As

Publication number Publication date
CN102830977A (en) 2012-12-19

Similar Documents

Publication Publication Date Title
CN102830977B (en) Instant messaging adds the method for insert type data, client and system in recording
CN103916536B (en) For the user interface method and system in mobile terminal
CN102831912B (en) Show the method for audio message playing progress rate, client and system
TWI571868B (en) Method and apparatus for sequencing content
US10735361B2 (en) Scripted digital media message generation
KR101167765B1 (en) Apparatus and method for playing handwriting message using handwriting data
CN101286952B (en) Method and system for displaying information of file
CN102904799B (en) In instant messaging, icon triggers method and the client that stream medium data is recorded
WO2017079056A1 (en) Streaming data associated with cells in spreadsheets
US10320794B2 (en) System for sharing selectively ephemeral content
CN104618808B (en) Multimedia information processing method, client and server
CN108762862A (en) Equipment, method and graphic user interface for messaging
TW201537943A (en) Stop recording and send using a single action
TW201537979A (en) Automatic camera selection
US20120166560A1 (en) Information processing unit, content providing server, communication relay server, information processing method, content providing method and communication relay method
CN106415431A (en) Transition from use of one device to another
CN102799389B (en) JICQ realizes the method for drawing pad, client and system
CN106888155A (en) Information gathering and shared method, client and system
CN102780646B (en) The implementation method of the sound's icon, client and system in instant messaging
CN101207774A (en) System for converting SWF format file into video file and implementation method thereof
CN102780649A (en) Method, client and system for filling instant image in instant communication message
CN102799388B (en) JICQ realizes collecting the method for drawing pad, client and system
CN103095685A (en) Instant messaging composite icon recording method, client terminal and system
CN102811182A (en) Method, client and system for playing audio message in instant messaging
TW200825881A (en) Method and apparatus for selecting digital items

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant