The utility model content
Main purpose of the present utility model is to provide a kind of conference communication device and system, to solve the problem of the real three-dimensional sound field of reaction that the conference communication terminal is transmitted in the prior art sound field can not be true to nature.
To achieve these goals, according to an aspect of the present utility model, provide a kind of conference communication device, having comprised: multichannel sound field collecting unit, be arranged in the meeting-place, be used for gathering the three-dimensional audio signal in meeting-place; And communication unit, be connected with multichannel sound field collecting unit, be used for audio signal transmission with the meeting-place to extraneous communication network.
Further, multichannel sound field collecting unit comprises: the emulation number of people has left ear and auris dextra; The first microphone is arranged on Zuo Erchu, and is connected with communication unit; And second microphone, be arranged on the auris dextra place, and be connected with communication unit, wherein, gather the three-dimensional audio signal in meeting-place by the first microphone and second microphone.
Further, the conference communication device also comprises: the first camera is arranged in the left eye nest of the emulation number of people, and is connected with communication unit; And second camera, be arranged in the right eye nest of the emulation number of people, and be connected with communication unit, wherein, gather the 3D vision signal in meeting-place by the first camera and second camera, communication unit also is used for 3D video signal transmission with the meeting-place to communication network.
Further, multichannel sound field collecting unit comprises: left earphone body; The right earphone body; The first microphone is arranged on the left earphone body, and is connected with communication unit; And second microphone, be arranged on the right earphone body, and be connected with communication unit, wherein, gather the three-dimensional audio signal in meeting-place by the first microphone and second microphone.
Further, multichannel sound field collecting unit comprises: the polynary sound field microphone in plane is connected with communication unit; Or the stereophonic field microphone, be connected with communication unit.
Further, the conference communication device also comprises: the first camera is arranged in the meeting-place, and is connected with communication unit; And second camera, be arranged in the meeting-place, and be connected with communication unit, wherein, gather the 3D vision signal in meeting-place by the first camera and second camera, communication unit also is used for 3D video signal transmission with the meeting-place to communication network.
Further, communication unit comprises: the audio coding module, be connected respectively with communication network with multichannel sound field collecting unit, and be used for transferring to communication network behind the three-dimensional audio Signal coding with the meeting-place; The audio decoder module is connected with communication network, is used for transferring to the meeting-place behind the three-dimensional audio signal decoding from communication network; The sound field rendering module is connected with the audio decoder module; Video encoding module is connected respectively with the first camera, second camera and communication network, is used for transferring to communication network behind the 3D Video signal encoding with the meeting-place; And video decode module, be connected with communication network, be used for transferring to the meeting-place after the 3D vision signal decoding from communication network, the conference communication device also comprises: audio playing unit, be arranged in the meeting-place, be connected with the sound field rendering module, be used for playing the three-dimensional audio signal from communication network; And video display unit, be arranged in the meeting-place, and be connected with the video decode module, be used for showing the 3D vision signal from communication network.
Further, audio playing unit comprises: a plurality of loud speakers or headphones playback module.
Further, the conference communication device also comprises: echo cancellation module, and input is connected with multichannel sound field collecting unit, and output is connected with the audio coding module.
To achieve these goals, according on the other hand of the present utility model, provide a kind of conference communication system, comprise: the first conference communication device, be arranged in the first meeting-place, wherein, any conference communication device that the first conference communication device provides for the utility model foregoing; The second conference communication device is arranged in the second meeting-place, wherein, and any conference communication device that the second conference communication device provides for the utility model foregoing; And communication network, be connected respectively with the second conference communication device with the first conference communication device.
By the utility model, adopt the conference communication device that comprises following structure: multichannel sound field collecting unit, be arranged in the meeting-place, be used for gathering the three-dimensional audio signal in meeting-place; And communication unit, be connected with multichannel sound field collecting unit, be used for audio signal transmission with the meeting-place to extraneous communication network.By multichannel sound field collecting unit is set in the meeting-place, utilize multichannel sound field collecting unit can the principle that sound field is carried out multi pass acquisition be gathered the three-dimensional audio signal in the meeting-place, thereby realize three-dimensionally reacting real three-dimensional sound field, and transmitted by communication unit, solve the problem of the reaction real three-dimensional sound field that the sound field that the conference communication terminal is transmitted in the prior art can not be true to nature, and then reached the effect that realizes three-dimensional audio communication.
Embodiment
Need to prove that in the situation of not conflicting, embodiment and the feature among the embodiment among the application can make up mutually.Describe below with reference to the accompanying drawings and in conjunction with the embodiments the utility model in detail.
The utility model embodiment provides a kind of conference communication device, and this conference communication device comprises multichannel sound field collecting unit and communication unit, and wherein, multichannel sound field collecting unit is arranged in the meeting-place, is used for gathering the three-dimensional audio signal in meeting-place; Communication unit is connected with multichannel sound field collecting unit, is used for audio signal transmission with the meeting-place to extraneous communication network.
By multichannel sound field collecting unit is set in the meeting-place, utilize multichannel sound field collecting unit can the principle that sound field is carried out multi pass acquisition be gathered the three-dimensional audio signal in the meeting-place, thereby realize three-dimensionally reacting real three-dimensional sound field, and transmitted by communication unit, solve the problem of the reaction real three-dimensional sound field that the sound field that the conference communication terminal is transmitted in the prior art can not be true to nature, and then reached the effect that realizes three-dimensional audio communication.
Wherein, communication unit comprises the audio coding module, is used for transferring to described communication network behind the three-dimensional audio Signal coding with the meeting-place; The concrete composition of multichannel sound field collecting unit describes in detail with reference to the specific embodiment that each accompanying drawing provides:
Fig. 3 a and Fig. 3 b are front view and the perspective views according to the multichannel sound field collecting unit of the conference communication device of the utility model the first embodiment, as shown in Figure 3, in this embodiment, multichannel sound field collecting unit comprises the emulation number of people, the first microphone 31 and second microphone 32.
Particularly, the audio-frequency information that the conference communication device of the utility model the first embodiment can be applied in a meeting-place carries out online live transmission, when carrying out online live transmission, the emulation number of people that will have left ear 33 and auris dextra 34 is arranged on position suitable in the meeting-place, and at left ear 33 places of the emulation number of people the first microphone 31 is set, auris dextra 34 places at the emulation number of people arrange second microphone 32, the first microphone 31 and second microphone 32 are all for the audio signal that gathers the meeting-place, the common collection effect of two microphones by being arranged on ear place, the emulation number of people left and right sides, obtain to react the audio signal of immersion three-dimensional sound field in the meeting-place, wherein, left ear 33 and auris dextra 34 include auricle, duct and inner ear, the first microphone 31 and second microphone 32 all can be arranged on the auricle place, also all can be arranged in the duct; Communication unit is connected respectively with second microphone 32 with the first microphone 31, is used for audio signal transmission with the meeting-place to extraneous communication network.
By at ear place, the left and right sides of the emulation number of people microphone being set respectively, utilize the ears microphone on the emulation number of people that the audio signal in the meeting-place is gathered, two ears of having realized the simulation people carry out the acoustic field signal collection to the apperceive characteristic of sound, not only reach the effect of reacting realistically real three-dimensional sound field, also realized the perception of people's ear stereophonic field.
Wherein, the emulation number of people comprises: human simulation skull frame, human simulation scalp cover and filler, particularly, human simulation skull frame is for building the hard number of people skeleton pattern that forms according to a state area average man's head model of using this emulation number of people, this human simulation skull frame can adopt polyvinyl chloride (polyvinylchloride, be called for short PVC) etc. hard material make, and the outer surface of the auricle position of this human simulation skull frame is the plane, just left and right sides auricle position perforate (perforate hereinafter referred to as left auricle place is the first perforate, and the perforate at the wide place of auris dextra is the second perforate); Human simulation scalp cover is the number of people leather sheath that is complementary with above-mentioned human simulation skull frame, this human simulation scalp cover can adopt silica gel material to form by building or carving, human simulation scalp cover is set on the human simulation skull frame, and have left ear and a right ear, wherein, the left duct of left ear extends in the first perforate, and the right ear canal of right ear is extended in the second perforate; It is inner that filler is filled in human simulation skull frame.
By adopting human simulation skull frame to come the inner hard bone of the bionical number of people, adopt human simulation scalp cover to come bionical people's scalp, adopt the material of the bionical number of people of filler inside, and adopt the bionical number of people surface skin of auricle duct to the emission effect of sound wave, realized improving the emulation of the emulation number of people, reduce outside sound source through the distortion level of the emulation number of people, and then reduced difference between the sound field of the three-dimensional sound field of sending out when adopting this conference communication device to carry out audio conferencing and the perception of true man institute, further improved the authenticity of three-dimensional sound field.
Wherein, in the emulation number of people, governor motion can also be set, when the first microphone 31 be arranged in the left duct, when second microphone 32 is arranged in the right ear canal, governor motion be used for to be regulated the degree of depth of the first microphone 31 in left duct, and regulates the degree of depth of second microphone 32 in right ear canal.Wherein, governor motion can be adjusting knob etc., two microphones can be cylinder, also can be is the structural feature that the profile of appearance profile and left and right sides duct is complementary, the first microphone 31 both can be left duct mouth place at the particular location of Zuo Erchu, it also can be left duct depths, correspondingly, the particular location of second microphone 32 at the auris dextra place both can be place, auris dextra road junction, it also can be the right ear canal depths, in the conference communication device of the utility model the first embodiment, the depth design of the left and right sides duct of the emulation number of people can be become 2.5cm-3.5cm, then the first microphone 31 can be arranged in the dark place of the left duct left auricle 0-3.5cm of distance, second microphone 32 can be arranged on right ear canal apart from the dark place of the wide 0-3.5cm of auris dextra, when practical application, the degree of depth of the positional distance auricle of two microphones in corresponding duct can specifically be regulated by adjustment structure.
Control the depth of microphone in duct in order to use the needs of various scenes by the governor motion that is arranged on human simulation skull frame inside, reached the applicability that improves the conference communication device.
Fig. 4 is the schematic diagram according to the multichannel sound field collecting unit of the conference communication device of the utility model the second embodiment, in this embodiment, multichannel sound field collecting unit comprises left earphone body 41, right earphone body 42, the first microphone 31 and second microphone 32, wherein, left earphone body 41 and right earphone body 42 both can be designed to the In-Ear Headphones body, can also be designed to the headphone body, in Fig. 4, be specifically described the conference communication device of the utility model the second embodiment as an example of the In-Ear Headphones body example, as shown in Figure 4, the first microphone 31 is arranged on the left earphone body 41, and is connected with communication unit; Second microphone 32 is arranged on the right earphone body 42, and is connected with communication unit.
The conference communication device of the utility model the second embodiment can be applied in the situation that single participant outwards carries out audio frequency output, also can be applied in the situation that a plurality of participants outwards carry out audio frequency output, outwards carry out online live transmission specifies the utility model the second embodiment as example conference communication device take single participant, particularly, when carrying out online live transmission, rely on true man's number of people of this participant as support, carry out the binaural sound field collection (namely, wear earphone by the participant and realize the collection of multichannel sound field), obtain reacting the audio signal of immersion three-dimensional sound field in the meeting-place; Then by communication unit the three-dimensional audio signal in meeting-place is transferred to extraneous communication network.
The conference communication device of the utility model the second embodiment has reached the effect identical with the conference communication device of the utility model the first embodiment by being designed to the sound field collecting unit of In-Ear Headphones or headphone.
Fig. 5 a to Fig. 5 c is respectively the schematic diagram according to the multichannel sound field collecting unit of the conference communication device of the utility model the 3rd embodiment.
Shown in Fig. 5 a, multichannel sound field collecting unit is plane ternary sound field microphone; Shown in Fig. 5 b, multichannel sound field collecting unit is planar four-element sound field microphone; Shown in Fig. 5 c, multichannel sound field collecting unit is single order stereophonic field microphone, particularly, and in Fig. 5 c, schematically shown the single order Ambisonic sound field microphone of positive tetrahedron structure, this multichannel sound field collecting unit can also be second order even high-order stereophonic field microphone.
When carrying out online live transmission, the conference communication device that the utility model the 3rd embodiment is provided is arranged on position suitable in the meeting-place, carry out the collection of immersion three-dimensional sound field by the polynary sound field microphone in plane or stereophonic field microphone, the identical effect of conference communication device that provides with the utility model the first embodiment has been provided equally.
Further, the conference communication device that each embodiment of above-mentioned the utility model provides also comprises the camera unit, correspondingly, communication unit comprises the video encoding module that is connected with the signal output of camera, is used for transferring to communication network behind the 3D Video signal encoding with the meeting-place.For the conference communication device that the utility model the first embodiment provides, can comprise the first camera that is arranged on emulation number of people left eye nest place and the second camera that is arranged on emulation number of people right eye nest place, and these two cameras are connected with video encoding module all; For the conference communication device that the utility model the second embodiment and the 3rd embodiment provide, also can comprise the camera that all is connected with video encoding module.Wherein, the conference communication device of each embodiment of the utility model obtains reacting the vision signal of 3D video scene in the meeting-place by the common collection effect of two cameras.
By at the conference communication device binocular camera shooting head being set, realized and the immersion three-dimensional sound field in the meeting-place can either have been transferred to the external world, the 3D video scene in the meeting-place can also be transferred to the external world, reached the effect of carrying out simultaneously audio video transmission.
Further, the conference communication device that each embodiment of above-mentioned the utility model provides also includes voice reproducing end and video display unit, for the conference communication device of the utility model the first embodiment and the 3rd embodiment, the playback end can be comprised of a plurality of loud speakers; For the conference communication device of the utility model the second embodiment, the playback end can be the headphones playback module, particularly, relative the first microphone and second microphone, the first microphone is arranged on the relative outer position of left and right sides earphone body with second microphone, the headphones playback module can be arranged on the relatively inner position of earphone body, the left and right sides, namely, the first microphone and second microphone are arranged on the outside of left and right sides earphone body, and the headphones playback module can be arranged on the inboard of left and right sides earphone body.
By at the conference communication device voice reproducing end and video display unit being set, the conference communication application of installation that each embodiment of above-mentioned the utility model can be provided is in two-way conference system, realized and the three-dimensional sound field in the meeting-place and 3D transmission of video can either have been arrived the external world, can also receive three-dimensional sound field and the 3D video in another meeting-place.Below in two-way conference system, be illustrated the conference communication system of the conference communication device of using the utility model embodiment as example take conference communication application of installation that the utility model the first embodiment is provided:
Wherein, it is shown in Figure 6 to utilize the conference communication device of ears microphone to carry out the communication system of two way audio meeting, as shown in Figure 6, in the communication system of meeting-place A and meeting-place B, communication unit mainly comprises by audio coding module, audio decoder module and sound field rendering module, particularly, the audio coding module is stereo or the dual track coding module, its input all is connected with second microphone with the first microphone, output is connected to communication network, is used for being sent to communication network behind the coding audio signal in the meeting-place; Accordingly, the audio decoder module is stereo or dual track decoding submodule, its input is connected with communication network, output is connected with the input that sound channel is played up submodule, the output of sound field rendering module is connected with the audio playing unit of meeting communicator, the sound field rendering module is three-dimensional sound field multi-loudspeaker rendering module, the audio decoder module will be sent to the sound field rendering module after will decoding from the audio signal of communication network, and be sent to audio playing unit play after the playing up of sound field rendering module.Wherein, audio playing unit is a plurality of speaker systems.
By audio playing unit is set, and communication unit is set to transmit audio signal in the meeting-place to communication network, can transmit again the audio signal of communication network to the audio playing unit in meeting-place, realized utilizing the conference communication device to carry out the two way audio transmission, having reached can either be with the three-dimensional audio communication in the meeting-place to communication network, can also be with the effect of playing in the meeting-place from the three-dimensional audio information of communication network.
Audio transmission module can also comprise the echo cancellation module that is connected between ears microphone and the audio coding module, in the conference communication device of two way audio transmission, the audio coding submodule not only can receive the audio signal in the meeting-place, also can receive the audio signal from communication network of being play by loud speaker, so need echo to eliminate submodule the audio signal from communication network is filtered, have the echo noise with the audio signal of avoiding the external world to receive.
Wherein, it is shown in Figure 7 to utilize the conference communication device of binocular camera shooting head to carry out the communication system of two-way video meeting, as shown in Figure 7, in the communication system of meeting-place A and meeting-place B, communication unit mainly comprises video encoding module and video decode module, particularly, video encoding module is 3D Video coding submodule, its input all is connected with second camera with the first camera, output is connected to communication network, is used for the vision signal in the meeting-place is carried out being sent to communication network behind the 3D coding; Accordingly, the video decode module is 3D video decode submodule, its input is connected with communication network, and output is connected with the video display unit of meeting communicator, is used for being sent to video display unit after will the decoding video signal from communication network and shows.Wherein, the display unit that video display unit both can carry for the conference communication device also can be existing video display unit in the meeting-place.
By video display unit is set, and communication unit is set to transmit vision signal in the meeting-place to communication network, can transmit again the vision signal of communication network to the video display unit in meeting-place, realized utilizing the conference communication device to carry out two-way 3D transmission of video, reached and with the 3 D video communication in the meeting-place to communication network, can also will in the meeting-place, carry out the effect of stereo display from the 3 D video information of communication network.
Need to prove, when carrying out the bidirectional audio-video meeting, ears microphone in the conference communication device that both can provide based on the utility model the first embodiment carries out the sound field collection, the binocular camera shooting head carries out video acquisition to carry out the audio/video conference communication of full 3D, and this kind conference communication system is shown in Figure 8; Ears microphone in the conference communication device that can also provide based on the utility model the first embodiment carries out the sound field collection, utilizes simultaneously the conventional video camera technique to carry out audio/video conference communication, and this kind conference communication system is shown in Figure 9; Binocular camera shooting head in the conference communication device that can also provide based on the utility model the first embodiment carries out video acquisition, utilizes simultaneously the conventional audio acquisition technique to carry out audio/video conference communication, and this kind conference communication system illustrates at Figure 10.
Correspondingly, when the conference communication device that utilizes the utility model the second embodiment or the 3rd embodiment to provide carries out two-way meeting, three-dimensional sound field collecting unit in the conference communication system that only needs above-described embodiment is provided replaces with the three-dimensional sound field collecting unit of the conference communication device that the utility model the second embodiment or the 3rd embodiment provide, and the 3D video acquisition unit in the conference communication system that above-described embodiment is provided replaces with the 3D video acquisition unit of the conference communication device that the utility model the second embodiment or the 3rd embodiment provide.
The above is preferred embodiment of the present utility model only, is not limited to the utility model, and for a person skilled in the art, the utility model can have various modifications and variations.All within spirit of the present utility model and principle, any modification of doing, be equal to replacement, improvement etc., all should be included within the protection range of the present utility model.