Summary of the invention
Main purpose of the present invention is to provide a kind of conference communication device and system, to solve the problem of the real three-dimensional sound field of reaction that sound field that in prior art, conference communication terminal is transmitted can not be true to nature.
To achieve these goals, according to an aspect of the present invention, provide a kind of conference communication device, having comprised: multichannel sound field collecting unit, has been arranged in meeting-place, for gathering the three-dimensional audio signal in meeting-place; And communication unit, be connected with multichannel sound field collecting unit, for by the audio signal transmission in meeting-place to extraneous communication network.
Further, multichannel sound field collecting unit comprises: the emulation number of people, has left ear and auris dextra; The first microphone, is arranged on Zuo Erchu, and is connected with communication unit; And second microphone, be arranged on auris dextra place, and be connected with communication unit, wherein, by the first microphone and second microphone, gather the three-dimensional audio signal in meeting-place.
Further, conference communication device also comprises: the first camera, is arranged in the left eye nest of the emulation number of people, and is connected with communication unit; And second camera, be arranged in the right eye nest of the emulation number of people, and be connected with communication unit, wherein, by the first camera and second camera, gather the 3D vision signal in meeting-place, communication unit also for by the 3D video signal transmission in meeting-place to communication network.
Further, multichannel sound field collecting unit comprises: left earphone body; Right earphone body; The first microphone, is arranged on left earphone body, and is connected with communication unit; And second microphone, be arranged on right earphone body, and be connected with communication unit, wherein, by the first microphone and second microphone, gather the three-dimensional audio signal in meeting-place.
Further, multichannel sound field collecting unit comprises: the polynary sound field microphone of plane, is connected with communication unit; Or stereophonic field microphone, be connected with communication unit.
Further, conference communication device also comprises: the first camera, is arranged in meeting-place, and is connected with communication unit; And second camera, be arranged in meeting-place, and be connected with communication unit, wherein, by the first camera and second camera, gather the 3D vision signal in meeting-place, communication unit also for by the 3D video signal transmission in meeting-place to communication network.
Further, communication unit comprises: audio coding module, is connected respectively with communication network with multichannel sound field collecting unit, for transferring to communication network after the three-dimensional audio Signal coding in meeting-place; Audio decoder module, is connected with communication network, for transferring to meeting-place after the three-dimensional audio signal decoding to from communication network; Sound field rendering module, is connected with audio decoder module; Video encoding module, is connected respectively with the first camera, second camera and communication network, for transferring to communication network after the 3D Video signal encoding in meeting-place; And video decode module, be connected with communication network, for transferring to meeting-place after the 3D vision signal decoding to from communication network, conference communication device also comprises: audio playing unit, be arranged in meeting-place, be connected with sound field rendering module, for playing the three-dimensional audio signal from communication network; And video display unit, be arranged in meeting-place, and be connected with video decode module, for showing the 3D vision signal from communication network.
Further, audio playing unit comprises: a plurality of loud speakers or headphones playback module.
Further, conference communication device also comprises: echo cancellation module, and input is connected with multichannel sound field collecting unit, and output is connected with audio coding module.
To achieve these goals, according to a further aspect in the invention, provide a kind of conference communication system, comprise: the first conference communication device, be arranged in the first meeting-place, wherein, any conference communication device that the first conference communication device provides for foregoing of the present invention; The second conference communication device, is arranged in the second meeting-place, wherein, and any conference communication device that the second conference communication device provides for foregoing of the present invention; And communication network, be connected respectively with the second conference communication device with the first conference communication device.
By the present invention, adopt the conference communication device that comprises following structure: multichannel sound field collecting unit, is arranged in meeting-place, for gathering the three-dimensional audio signal in meeting-place; And communication unit, be connected with multichannel sound field collecting unit, for by the audio signal transmission in meeting-place to extraneous communication network.By multichannel sound field collecting unit is set in meeting-place, the principle of utilizing multichannel sound field collecting unit to carry out multi pass acquisition to sound field gathers the three-dimensional audio signal in meeting-place, thereby realize, three-dimensionally react real three-dimensional sound field, and transmitted by communication unit, solve the problem of the reaction real three-dimensional sound field that the sound field that in prior art, conference communication terminal is transmitted can not be true to nature, and then reached the effect that realizes three-dimensional audio communication.
Embodiment
It should be noted that, in the situation that not conflicting, embodiment and the feature in embodiment in the application can combine mutually.Describe below with reference to the accompanying drawings and in conjunction with the embodiments the present invention in detail.
The embodiment of the present invention provides a kind of conference communication device, and this conference communication device comprises multichannel sound field collecting unit and communication unit, and wherein, multichannel sound field collecting unit is arranged in meeting-place, for gathering the three-dimensional audio signal in meeting-place; Communication unit, is connected with multichannel sound field collecting unit, for by the audio signal transmission in meeting-place to extraneous communication network.
By multichannel sound field collecting unit is set in meeting-place, the principle of utilizing multichannel sound field collecting unit to carry out multi pass acquisition to sound field gathers the three-dimensional audio signal in meeting-place, thereby realize, three-dimensionally react real three-dimensional sound field, and transmitted by communication unit, solve the problem of the reaction real three-dimensional sound field that the sound field that in prior art, conference communication terminal is transmitted can not be true to nature, and then reached the effect that realizes three-dimensional audio communication.
Wherein, communication unit comprises audio coding module, for transferring to described communication network after the three-dimensional audio Signal coding in meeting-place; The specific embodiment that the concrete composition of multichannel sound field collecting unit provides with reference to each accompanying drawing describes in detail:
Fig. 3 a and Fig. 3 b are according to front view and the perspective view of the multichannel sound field collecting unit of the conference communication device of first embodiment of the invention, as shown in Figure 3, in this embodiment, multichannel sound field collecting unit comprises the emulation number of people, the first microphone 31 and second microphone 32.
Particularly, the conference communication device of first embodiment of the invention can be applied in the audio-frequency information in a meeting-place is carried out to online live transmission, when carrying out online live transmission, the emulation number of people with left ear 33 and auris dextra 34 is arranged on to position suitable in meeting-place, and at left ear 33 places of the emulation number of people, the first microphone 31 is set, auris dextra 34 places at the emulation number of people arrange second microphone 32, the first microphone 31 and second microphone 32 are all for gathering the audio signal in meeting-place, by being arranged on the common collection effect of two microphones at ear place, emulation number of people left and right, obtain reacting the audio signal of immersion three-dimensional sound field in meeting-place, wherein, left ear 33 and auris dextra 34 include auricle, duct and inner ear, the first microphone 31 and second microphone 32 all can be arranged on auricle place, also all can be arranged in duct, communication unit is connected respectively with second microphone 32 with the first microphone 31, for by the audio signal transmission in meeting-place to extraneous communication network.
By the ear place, left and right at the emulation number of people, microphone is set respectively, utilize the ears microphone on the emulation number of people to gather the audio signal in meeting-place, two ears of having realized simulation people carry out acoustic field signal collection to the apperceive characteristic of sound, not only reach the effect of reacting realistically real three-dimensional sound field, also realized the perception of people's ear stereophonic field.
Wherein, the emulation number of people comprises: human simulation skull frame, human simulation scalp cover and filler, particularly, human simulation skull frame is for building according to the regional average man's head model of a state of this emulation number of people of application the hard number of people skeleton pattern forming, this human simulation skull frame can adopt polyvinyl chloride (polyvinylchloride, be called for short PVC) etc. hard material make, and the outer surface of the auricle position of this human simulation skull frame is plane, just in left and right auricle position perforate, (perforate hereinafter referred to as left auricle place is the first perforate, the perforate at the wide place of auris dextra is the second perforate), human simulation scalp cover is the number of people leather sheath matching with above-mentioned human simulation skull frame, this human simulation scalp cover can adopt silica gel material to form by building or carving, human simulation scalp cover is set on human simulation skull frame, and there is left ear and right ear, wherein, the left duct of left ear extends in the first perforate, and the right ear canal of right ear is extended in the second perforate, it is inner that filler is filled in human simulation skull frame.
By adopting human simulation skull frame to carry out the inner hard bone of the bionical number of people, adopt human simulation scalp cover to carry out bionical people's scalp, adopt the material of the bionical number of people of filler inside, and the transmitting effect of the bionical number of people surface skin of employing auricle duct to sound wave, realized the emulation that improves the emulation number of people, reduce outside sound source through the distortion level of the emulation number of people, and then reduced the three-dimensional sound field that sends out while adopting this conference communication device to carry out audio conferencing and the difference between the sound field of true man institute perception, further improved the authenticity of three-dimensional sound field.
Wherein, in the emulation number of people, governor motion can also be set, when the first microphone 31 is arranged in left duct, second microphone 32 is while being arranged in right ear canal, governor motion is for regulating the degree of depth of the first microphone 31 in left duct, and regulates the degree of depth of second microphone 32 in right ear canal.Wherein, governor motion can be adjusting knob etc., two microphones can be cylinder, also can be is the structural feature that the profile of appearance profile and left and right duct matches, the first microphone 31 can be both left duct mouth place at the particular location of Zuo Erchu, also can be left duct depths, correspondingly, the particular location of second microphone 32 at auris dextra place can be both place, auris dextra road junction, also can be right ear canal depths, in the conference communication device of first embodiment of the invention, the depth design of the left and right duct of the emulation number of people can be become to 2.5cm-3.5cm, the first microphone 31 can be arranged in the left duct distance dark place of left auricle 0-3.5cm, second microphone 32 can be arranged on right ear canal apart from the dark place of the wide 0-3.5cm of auris dextra, when practical application, the degree of depth of two microphones positional distance auricle in corresponding duct can specifically regulate by adjustment structure.
By being arranged on the governor motion of human simulation skull frame inside, control the depth of microphone in duct to apply the needs of various scenes, reached the applicability that improves conference communication device.
Fig. 4 is according to the schematic diagram of the multichannel sound field collecting unit of the conference communication device of second embodiment of the invention, in this embodiment, multichannel sound field collecting unit comprises left earphone body 41, right earphone body 42, the first microphone 31 and second microphone 32, wherein, left earphone body 41 and right earphone body 42 both can be designed to In-Ear Headphones body, can also be designed to headphone body, the In-Ear Headphones body of take in Fig. 4 is specifically described the conference communication device of second embodiment of the invention as example, as shown in Figure 4, the first microphone 31 is arranged on left earphone body 41, and be connected with communication unit, second microphone 32 is arranged on right earphone body 42, and is connected with communication unit.
The conference communication device of second embodiment of the invention can be applied in single participant and outwards carry out the situation of audio frequency output, also can be applied in a plurality of participants and outwards carry out the situation of audio frequency output, the single participant of take outwards carries out online live transmission and illustrates the conference communication device of second embodiment of the invention as example, particularly, when carrying out online live transmission, rely on true man's number of people of this participant as support, carry out binaural sound field collection (, by participant, wearing earphone realizes multichannel sound field and gathers), obtain reacting the audio signal of immersion three-dimensional sound field in meeting-place, then by communication unit, the three-dimensional audio signal in meeting-place is transferred to extraneous communication network.
The conference communication device of second embodiment of the invention, by being designed to the sound field collecting unit of In-Ear Headphones or headphone, has reached the effect identical with the conference communication device of first embodiment of the invention.
Fig. 5 a to Fig. 5 c is respectively according to the schematic diagram of the multichannel sound field collecting unit of the conference communication device of third embodiment of the invention.
As shown in Figure 5 a, multichannel sound field collecting unit is plane ternary sound field microphone; As shown in Figure 5 b, multichannel sound field collecting unit is planar four-element sound field microphone; As shown in Figure 5 c, multichannel sound field collecting unit is single order stereophonic field microphone, particularly, and in Fig. 5 c, schematically shown the single order Ambisonic sound field microphone of positive tetrahedron structure, this multichannel sound field collecting unit can also be second order high-order stereophonic field microphone even.
When carrying out online live transmission, the conference communication device that third embodiment of the invention is provided is arranged on position suitable in meeting-place, by the polynary sound field microphone of plane or stereophonic field microphone, carry out the collection of immersion three-dimensional sound field, the identical effect of conference communication device providing with first embodiment of the invention has been provided equally.
Further, the conference communication device that each embodiment of the invention described above provides also comprises camera unit, correspondingly, communication unit comprises the video encoding module being connected with the signal output of camera, for transferring to communication network after the 3D Video signal encoding in meeting-place.For the conference communication device providing for first embodiment of the invention, can comprise the first camera that is arranged on emulation number of people left eye nest place and the second camera that is arranged on emulation number of people right eye nest place, and these two cameras are all connected with video encoding module; For the conference communication device that second embodiment of the invention and the 3rd embodiment provide, also can comprise the camera being all connected with video encoding module.Wherein, the conference communication device of each embodiment of the present invention, by the common collection effect of two cameras, obtains reacting the vision signal of 3D video scene in meeting-place.
By binocular camera shooting head is set on conference communication device, realized and the immersion three-dimensional sound field in meeting-place can either have been transferred to the external world, the 3D video scene in meeting-place can also be transferred to the external world, reached and carried out the effect of audio video transmission simultaneously.
Further, the conference communication device that each embodiment of the invention described above provides also includes voice reproducing end and video display unit, for the conference communication device of first embodiment of the invention and the 3rd embodiment, playback end can be comprised of a plurality of loud speakers; For the conference communication device of second embodiment of the invention, playback end can be headphones playback module, particularly, relative the first microphone and second microphone, the first microphone is arranged on the relative outer position of left and right earphone body with second microphone, and headphones playback module can be arranged on the relatively inner position of earphone body, left and right,, the first microphone and second microphone are arranged on the outside of left and right earphone body, and headphones playback module can be arranged on the inner side of left and right earphone body.
By voice reproducing end and video display unit are set on conference communication device, the conference communication application of installation that each embodiment of the invention described above can be provided is in two-way conference system, realized and the three-dimensional sound field in meeting-place and 3D transmission of video can either have been arrived to the external world, can also receive three-dimensional sound field and the 3D video in another meeting-place.The conference communication application of installation that take is below provided first embodiment of the invention is illustrated the conference communication system of the conference communication device of the application embodiment of the present invention in two-way conference system as example:
Wherein, utilize the conference communication device of ears microphone to carry out the communication system of two way audio meeting shown in Figure 6, as shown in Figure 6, in the communication system of meeting-place A and meeting-place B, communication unit mainly comprises by audio coding module, audio decoder module and sound field rendering module, particularly, audio coding module is stereo or dual track coding module, its input is all connected with second microphone with the first microphone, output is connected to communication network, for being sent to communication network after the coding audio signal in meeting-place; Accordingly, audio decoder module is stereo or dual track decoding submodule, its input is connected with communication network, output is connected with the input that sound channel is played up submodule, the output of sound field rendering module is connected with the audio playing unit of meeting communicator, sound field rendering module is three-dimensional sound field multi-loudspeaker rendering module, audio decoder module is sent to sound field rendering module after decoding from the audio signal of communication network, and after the playing up of sound field rendering module, is sent to audio playing unit and plays.Wherein, audio playing unit is a plurality of speaker systems.
By audio playing unit is set, and communication unit is set to transmit audio signal in meeting-place to communication network, can transmit again the audio signal of communication network to the audio playing unit in meeting-place, realized and utilized conference communication device to carry out two way audio transmission, having reached can either be by the three-dimensional audio communication in meeting-place to communication network, the effect that the three-dimensional audio information from communication network can also be play in meeting-place.
Audio transmission module can also comprise the echo cancellation module being connected between ears microphone and audio coding module, in the conference communication device of two way audio transmission, audio coding submodule not only can receive the audio signal in meeting-place, also can receive the audio signal from communication network of being play by loud speaker, so need echo to eliminate submodule, the audio signal from communication network is filtered, to avoid the audio signal that the external world receives to have echo noise.
Wherein, utilize the conference communication device of binocular camera shooting head to carry out the communication system of two-way video meeting shown in Figure 7, as shown in Figure 7, in the communication system of meeting-place A and meeting-place B, communication unit mainly comprises video encoding module and video decode module, particularly, video encoding module is 3D Video coding submodule, its input is all connected with second camera with the first camera, output is connected to communication network, for the vision signal in meeting-place is carried out being sent to communication network after 3D coding; Accordingly, video decode module is 3D video decode submodule, its input is connected with communication network, and output is connected with the video display unit of meeting communicator, for showing being sent to video display unit after the decoding video signal from communication network.Wherein, the display unit that video display unit both can carry for conference communication device, can be also existing video display unit in meeting-place.
By video display unit is set, and communication unit is set to transmit vision signal in meeting-place to communication network, can transmit again the vision signal of communication network to the video display unit in meeting-place, realized and utilized conference communication device to carry out two-way 3D transmission of video, reached and can either, by the 3 D video communication in meeting-place to communication network, the 3 D video information from communication network can also have been carried out to the effect of stereo display in meeting-place.
It should be noted that, when carrying out bidirectional audio-video meeting, ears microphone in the conference communication device that both can provide based on first embodiment of the invention carries out sound field collection, binocular camera shooting head carries out video acquisition to carry out the audio/video conference communication of full 3D, and this kind of conference communication system is shown in Figure 8; Ears microphone in the conference communication device that can also provide based on first embodiment of the invention carries out sound field collection, utilizes conventional video camera technique to carry out audio/video conference communication simultaneously, and this kind of conference communication system is shown in Figure 9; Binocular camera shooting head in the conference communication device that can also provide based on first embodiment of the invention carries out video acquisition, utilizes conventional audio acquisition technique to carry out audio/video conference communication simultaneously, and this kind of conference communication system illustrates at Figure 10.
Correspondingly, when the conference communication device that utilizes second embodiment of the invention or the 3rd embodiment to provide carries out two-way meeting, three-dimensional sound field collecting unit in the conference communication system that only above-described embodiment need be provided replaces with the three-dimensional sound field collecting unit of the conference communication device that second embodiment of the invention or the 3rd embodiment provide, and the 3D video acquisition unit in the conference communication system that above-described embodiment is provided replaces with the 3D video acquisition unit of the conference communication device that second embodiment of the invention or the 3rd embodiment provide.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any modification of doing, be equal to replacement, improvement etc., within all should being included in protection scope of the present invention.