WO2022121390A1

WO2022121390A1 - Integrated audio/video apparatus

Info

Publication number: WO2022121390A1
Application number: PCT/CN2021/116280
Authority: WO
Inventors: 陈文明; 张世明; 吕周谨; 倪世坤; 邓高锋
Original assignee: 深圳壹秘科技有限公司
Priority date: 2020-12-11
Filing date: 2021-09-02
Publication date: 2022-06-16
Also published as: CN112616034A

Abstract

An integrated audio/video apparatus, comprising a video module configured to acquire image information and send the image information to a master control module; a microphone module configured to acquire audio information and send the audio information to the master control module; a playback module configured to receive an audio digital signal from the master control module, process the audio digital signal into a sound, and output the sound to the outside; and the master control module configured to receive the image information acquired by the video module and the audio information acquired by the microphone module, perform analysis, generate an audio/video signal, and output the audio/video signal to an external device, and to receive an audio digital signal from the external device, and send the audio digital signal to the playback module. The master control module is communicationally connected to the external device by means of a USB transmission line; and the video module, the microphone module, and the playback module are all integrated on the master control module, and all the information from/to the video module, the microphone module, and the playback module is received/sent by the master control module.

Description

An integrated audio and video device

This application claims the priority of the Chinese patent application with application number 202011441938.9 filed on December 11, 2020, the entire contents of which are incorporated herein by reference.

technical field

The present application relates to the field of audio and video call products, in particular to an integrated audio and video device.

Background technique

In the field of conference audio and video call products, there has been no great breakthrough in product form for more than ten years. Traditional audio and video conferencing systems require a combination of multiple devices, including cameras, microphones, call systems, and switches. Traditional audio and video conferencing systems have numerous and expensive equipment, cumbersome shapes, troublesome connections, and complicated operations. They can usually only be used in fixed conference rooms, and often require professional personnel to operate and maintain. With the rapid development of science and technology, conference system equipment is also developing in the direction of portability and easy operation, so various portable devices suitable for audio and video calls have also been born.

Portable audio and video conferencing equipment in the prior art is mainly implemented in the following 3 ways: 1. use PC notebook camera and microphone+speaker equipment in combination; 2. use portable separate microphone+speaker speaker equipment and camera equipment in combination ; ③ Use a portable microphone + speaker + camera integrated device.

There are the following problems in the above-mentioned prior art, type 1. The method is limited by the sound pickup distance of the microphone and the clarity and angle of the video, often the camera that comes with the PC is not clear and the angle is small, and the pickup distance of the microphone is short and the speaker is short. The playback sound is small and can only be used by a single person at close range, which is not suitable for a work meeting of more than 3 people; although the method of type ② is portable and the clarity of the camera is sufficient, the sound pickup of the microphone is not enough, but audio equipment and video are required. The combined use of equipment increases the complexity of line connection and product connection; moreover, the two products are often not from the same manufacturer or the same solution, and the problem of audio and video out-of-sync is prone to occur during the audio and video passing process; type ③ At the same time, a USB-enabled audio chip and another USB-enabled video chip are built into the product, and then converted to a USB port for output through the USB adapter chip; this method is actually a derivative of method ②. ; Put the solutions of the two devices into one device; in this way, the current of the solutions of the two devices will be relatively large, and because the chips of the solutions are different, there is also the problem of asynchronous audio and video.

technical problem

In order to overcome the defects of the prior art, the technical problem to be solved by this application is to propose an integrated audio and video device. By integrating the video module, microphone module and playback module on the main control main module, the main control module is unified By sending and receiving information, the overall device can be better synchronized and the current consumption can be reduced.

technical solutions

For this purpose, the application adopts the following technical solutions:

The application provides an integrated audio and video device, comprising: a video module configured to collect image information and send the image information to a main control module; a microphone module configured to collect audio information and send the audio information to the main control module; the playback module is configured to receive the audio digital signal from the main control module, process it as sound and output it to the outside world; the main control module is configured to receive the image information and audio collected by the video module and the microphone module information, analyze and process and generate audio and video signals, output audio and video signals to external devices, receive audio digital signals from external devices, and send audio digital signals to the playback module; the output terminals of the video module and the microphone module are connected to the main The input end of the control module is electrically connected, the output end of the main control module is electrically connected with the input end of the playback module, and the main control module and the external device are connected through a USB transmission line for communication.

In one embodiment, the video module includes a video chip and a camera; the camera is electrically connected to the video chip, and the video chip is electrically connected to the main control module; the camera is configured to collect images in the environment, and transmit the images to the video chip, and the video chip It is configured to receive the image, process the image to generate image information, and send the image information to the main control module.

In one embodiment, the playback module includes a power amplifier circuit and a speaker; the input end of the power amplifier circuit is electrically connected to the main control module, and the output end of the power amplifier circuit is electrically connected to the speaker; the power amplifier circuit is configured to receive the audio digital signal of the main control module, After amplifying the audio digital signal, an amplified signal is generated, and the amplified signal is transmitted to the speaker; the speaker is configured to output sound after receiving the amplified signal.

In one embodiment, the main control module is configured to, after receiving the image information of the video module, first perform image quality processing on the image information, then encode and compress the image information to convert the image information into a USB signal, and finally send it to an external device through a USB transmission line. .

In one embodiment, the audio information of the microphone module includes environmental audio information and speech audio information, and the main control module is configured to, after receiving the audio information of the microphone module, first perform echo cancellation processing on the audio information to eliminate the environmental audio information, Then, the audio information is subjected to noise reduction processing, and finally sent to an external device through a USB transmission line.

In one embodiment, the power amplifier circuit includes a power amplifier chip, the power amplifier chip is electrically connected to the main control module, the power amplifier chip receives the audio digital signal and performs equalization processing, and after enhancing or attenuating the specific audio amplitude of the audio digital signal, it is sent to the speaker, Sound is output from the speaker.

In one embodiment, the main control module is further configured to perform synchronous processing on the image information and the audio information after receiving the image information collected by the video module and the audio information collected by the microphone module, so as to realize the synchronization of the image information and the audio information. output.

In one embodiment, the main control module includes a main control chip, the output ends of the video module and the microphone module are both electrically connected to the input end of the main control chip, and the output end of the main control chip is electrically connected to the input end of the playback module. The main control chip is provided with MIPI, MIC, CODEC and other interfaces.

In one embodiment, the power amplifier circuit includes a power amplifier chip, the VOP and VON pins of the power amplifier chip are connected to the same connector after being connected in series with an inductor, and two capacitors are connected in parallel between the inductor and the connector and then grounded.

In one embodiment, the CN1 pin of the power amplifier chip is electrically connected to the CP1 pin of the power amplifier chip after being connected in series with the first capacitor, and the CN2 pin of the power amplifier chip is electrically connected to the CP2 pin of the power amplifier chip after being connected to the second capacitor in series.

In one embodiment, the CVDD pin of the power amplifier chip is electrically connected to the AVDD pin of the power amplifier chip, the two capacitors are connected in parallel between the CVDD pin and the AVDD pin, and the AVDD pin of the power amplifier chip is connected in series with the third capacitor. ground after the capacitor.

In one embodiment, the video module and the main control chip are electrically connected through a MIPI interface, and data is transmitted to the main control chip through the MIPI structure.

In one embodiment, the microphone module is electrically connected to the main control chip through a MIC interface. In one embodiment, the microphone module is a microphone matrix.

In one embodiment, the video chip is a Sensor chip.

In one embodiment, the video chip transmits data to the main control module through the MIPI interface.

beneficial effect

An integrated audio and video device provided by this application, by integrating the video module, the microphone module and the playback module on the main control main module, the main control module sends and receives information uniformly, solves the problem of the traditional audio and video conferencing system equipment heavy, It can solve the problems of complicated operation, difficult maintenance and high cost. It can also solve the computer connection problem and the asynchronous audio, video and video problems of the new single camera product and the combined use of the microphone and the speaker. Because the main control module communicates with external devices through USB, so Only 1 USB cable is needed to connect the computer to realize audio and video calls. At the same time, it also reduces the power consumption of the product, improves the operation convenience of the product, and realizes the effect of better synchronization of the overall device and reduction of current power consumption, which improves the use of the product. user experience.

Description of drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application, and for those of ordinary skill in the art, other drawings can also be obtained from these drawings without any creative effort.

Fig. 1 is a schematic block diagram provided in the specific implementation manner of this application;

FIG. 2 is a schematic diagram of a main control chip provided in the specific embodiment of the present application;

3 is a schematic diagram of a video chip provided in the specific embodiment of the present application;

4 is a schematic diagram of a microphone module provided in a specific embodiment of the present application;

FIG. 5 is a schematic diagram of a power amplifier circuit provided in a specific embodiment of the present application.

Figure identification: 1 main control module; 2 video module; 3 microphone module; 4 playback module; 5 external equipment.

Embodiments of the present invention

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

The technical solutions of the present application will be further described below with reference to the accompanying drawings and through specific embodiments.

As shown in Figures 1-5, an integrated audio and video device provided in this embodiment includes: a video module 2, which is configured to collect image information and send the image information to the main control module 1; a microphone module 3 , is configured to collect audio information and send the audio information to the main control module 1; the playback module 4 is configured to receive the audio digital signal from the main control module 1, process it as sound and output it to the outside world; the main control module 1, is configured to receive the image information and audio information collected by the video module 2 and the microphone module 3, analyze and process and generate audio and video signals, output the audio and video signals to the external device 5 at the same time, and receive the audio digital signal of the external device 5 , send the audio digital signal to the playback module 4; the output ends of the video module 2 and the microphone module 3 are electrically connected to the input end of the main control module 1, and the output end of the main control module 1 is electrically connected to the input end of the playback module 4, The main control module 1 and the external device 5 are connected through a USB transmission line for communication. Specifically, the main control module 1 includes a main control chip, which is electrically connected to the video module 2, the microphone module 3, and the playback module 4. The main control chip also communicates with the external device 5 through a USB transmission line, wherein the external device 5 can be It is a computer, smart box, tablet, smart TV and other equipment; since the audio and video processing is all on the main control chip, it is ultimately only connected to an external computer through a USB device, and a main control module 1 circuit is used for overall integration. Data interaction first simplifies the complexity of product design, and secondly, the circuit composed of multiple control chips also reduces the overall working current of the product, and the control of a main control chip is based on the same reference clock. It is convenient to deal with the problem of video and audio synchronization.

In one embodiment, the video module 2 includes a video chip and a camera; the camera is electrically connected to the video chip, and the video chip is electrically connected to the main control module 1; the camera is configured to collect images in the environment, and transmit the images to the video chip, After receiving the image, the video chip processes the image to generate image information, and sends the image information to the main control module 1 .

In one embodiment, after receiving the image information of the video module 2 , the main control module 1 first performs image quality processing on the image information, then encodes and compresses the image information to convert the image information into a USB signal, and finally sends the image information to the external device 5 through a USB device.

In one embodiment, the main control module 1 includes a main control chip, the output ends of the video module 2 and the microphone module 3 are both electrically connected to the input end of the main control chip, and the output end of the main control chip is electrically connected to the input end of the playback module. .

In one embodiment, the video module 2 communicates with the main control chip through a mobile industry processor interface (Mobile Industry Processor Interface, MIPI interface) is electrically connected to transmit data to the main control chip through the MIPI structure.

In one embodiment, the microphone module 3 uses a microphone interface (Microphone interface, MIC interface) is electrically connected with the main control chip. In one embodiment, the microphone module 3 is a microphone matrix.

In one embodiment, the video chip is a Sensor chip. Specifically, the video chip is a Sensor chip, and a camera and a Sensor chip with an appropriate resolution and angle can be selected as required.

In one embodiment, the video chip transmits data to the main control module 1 through the MIPI interface. Specifically, the video module 2 is composed of a Sensor chip and a camera. The camera and Sensor chip with appropriate resolution and angle can be selected according to the needs. This module is mainly configured for video reception and signal conversion, and the captured scene enters from the camera. In the Sensor chip, the received optical signal is converted into an electrical signal in the Sensor chip, and then sent to the main control chip for processing through MIPI and other interfaces. The image quality processing performed by the main control chip on the video signal includes: Saturation, white balance, brightness processing, contrast, distortion correction and other related processing, and then encoding and compression and signal conversion into USB signals, and finally sent to the computer through a USB device.

In one embodiment, the playback module 4 includes a power amplifier circuit and a speaker; the input end of the power amplifier circuit is electrically connected to the main control module 1 , and the output end of the power amplifier circuit is electrically connected to the speaker; the power amplifier circuit is configured to receive audio from the main control module 1 . Digital signal, the audio digital signal of the power amplifier circuit is amplified to generate an amplified signal, the power amplifier circuit transmits the amplified signal to the speaker, and the speaker outputs the audio after receiving the amplified signal. Specifically, the power amplifier circuit includes a power amplifier chip, the power amplifier chip is electrically connected to the main control module 1 and communicates with the main control module 1 , and the power amplifier chip amplifies the audio digital signal of the main control module 1 .

In one embodiment, the power amplifier circuit includes a power amplifier chip, the power amplifier chip is electrically connected to the main control module 1, the power amplifier chip receives the audio digital signal and performs equalization processing, and after enhancing or attenuating some audio amplitudes of the audio digital signal, it is sent to the speaker. , the sound is emitted from the speaker. Specifically, the playback module 4 is mainly configured to output the voice of the third party during the audio and video call. During the audio and video call, the voice of the other party is processed by the main control chip and then output to the power amplifier chip. Then, the small signal is amplified by the power amplifier chip and transmitted to the speaker, and finally the speaker outputs the sound; after reaching the power amplifier chip through the USB transmission line, the main control chip performs equalization processing, that is, the audio amplitude of some frequency bands in the audio digital signal is enhanced. After the audio amplitude of other frequency bands is attenuated, it is transmitted to the speaker, and the sound is emitted by the speaker.

In one embodiment, the power amplifier circuit includes a power amplifier chip, the VOP and VON pins of the power amplifier chip are connected to the same connector after being connected in series with an inductor, and two capacitors are connected in parallel between the inductor and the connector and then grounded. Specifically, the connector is configured to be electrically connected to the speaker, the VOP and VON pins of the power amplifier chip are used as output pins, and the output signal is sent to the speaker through the connector for playback.

In one embodiment, the CVDD pin of the power amplifier chip is electrically connected to the AVDD pin of the power amplifier chip, the two capacitors are connected in parallel between the CVDD pin and the AVDD pin, and the AVDD pin of the power amplifier chip is connected in series with the third capacitor. ground after the capacitor. Specifically, one end of the two capacitors connected in series between the CVDD and AVDD pins is also connected to a 5V input voltage in a circuit.

The INP pin of the power amplifier chip is connected with the inductor and capacitor in series and then grounded; the INN hardware of the power amplifier chip is connected with the inductor and capacitor in series as the output interface HPOUT; the PVDD pin of the power amplifier chip is electrically connected to the power supply PVDD, and the capacitor is also connected in series. ground.

In one embodiment, after the main control module 1 receives the audio information of the microphone module 3, the audio information includes environmental audio information and speech audio information. The information is subjected to noise reduction processing, and finally sent to the external device 5 via the USB device.

In one embodiment, the main control module 1 receives the image information and the audio information collected by the video module 2 and the microphone module 3, and processes the image information and the audio information in synchronization, so as to realize the synchronized output of the image information and the audio information.

In one embodiment, the microphone module 3 is a microphone matrix. Specifically, the microphone array is a multi-mic product, which can be multiple microphones such as 4-mic, 6-mic, etc. The multi-microphone design can achieve the effect of sound pickup at a distance of 3m to 5m, which solves the problem of short pickup distance and avoids The problem that multiple people are crowded together to speak to the microphone, and the other party can only hear it. For example, when a 4-mic array is used, the microphone adopts an omnidirectional PDM (Pulse Density Modulation) microphone, which greatly improves the anti-interference ability of the microphone. The sound signal is transmitted through the 4 microphones. After receiving it, it is converted into an electrical signal, and then transmitted to the main control chip in PDM format for processing; during the video call, the voice of one's own voice is transmitted to the main control chip by the microphone array, and the main control chip performs NS, AEC and other processing inside. Afterwards, eliminating unnecessary ambient noise, etc., can allow the other party to hear the local voice more clearly. The sound picked up by the microphone array includes two parts, one part is the voice of the other party emitted by the speakers in the conference, and the other part is the equipment in the conference. For the sound of the person speaking at the end, the audio processing module needs to use the echo cancellation algorithm for the two parts of the sound, that is, to eliminate the sound of the other party, and then transmit it to the computer through the USB transmission line.

When used specifically, in the meeting, the camera transmits the current scene to the main control chip through the video chip. At the same time, the sound in the meeting is picked up by the microphone array, and then transmitted to the main control chip. After the video and audio are processed, it is converted into a USB signal and transmitted to the computer, and the computer of the other party in the meeting is transmitted to the main control chip through the USB transmission line, and the main control chip is transmitted to the power amplifier, and finally the sound of the other party is played through the speaker.

The integrated audio and video device provided by the present application solves the problem of traditional audio and video by integrating the video module 2, the microphone module 3 and the playback module 4 on the main control module 1, and the main control module 1 sends and receives information in a unified manner. The conference system has heavy equipment, complicated operation, difficult maintenance and high cost. It also solves the computer connection problem and the audio, video and video synchronization problems of the new single camera product and the combined use of the microphone and the speaker. Because the main control module 1 communicates with the External device 5 communication connection, so only 1 USB cable is needed to connect the computer to realize audio and video calls, while reducing the power consumption of the product, improving the ease of operation of the product, and realizing the better synchronization of the overall device and reducing the current function. The effect of consumption is improved, and the user experience effect is improved.

The above descriptions are only preferred embodiments of the present application, and are not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application shall be included in the scope of the present application. within the scope of protection.

Claims

An integrated audio and video device, comprising:

a video module, configured to collect image information and send the image information to the main control module;

a microphone module, configured to collect audio information and send the audio information to the main control module;

The playback module is configured to receive the audio digital signal from the main control module, process it into sound and output it to the outside world;

The main control module is configured to receive the image information and audio information collected by the video module and the microphone module, perform analysis and processing, generate audio and video signals, output the audio and video signals to external devices, and receive audio digital signals from external devices. The audio digital signal is sent to the playback module;

The output terminals of the video module and the microphone module are both electrically connected to the input terminal of the main control module, the output terminal of the main control module is electrically connected to the input terminal of the playback module, and the main control module is electrically connected to the input terminal of the playback module. The external device realizes the communication connection through the USB transmission line.
The integrated audio-video device of claim 1, wherein the video module comprises a video chip and a camera;

The camera is electrically connected to the video chip, and the video chip is electrically connected to the main control module;

The camera is configured to capture an image in the environment and transmit the image to a video chip, and the video chip is configured to receive the image, process the image to generate image information, and send the image information to the main controller module.
The integrated audio and video device according to claim 1, wherein the playback module comprises a power amplifier circuit and a speaker;

The input end of the power amplifier circuit is electrically connected to the main control module, and the output end of the power amplifier circuit is electrically connected to the speaker;

The power amplifier circuit is configured to receive the audio digital signal of the main control module, amplify the audio digital signal to generate an amplified signal, and transmit the amplified signal to the speaker; and

The speaker is configured to output sound after receiving the amplified signal.
The integrated audio and video device according to claim 1, wherein the main control module is configured to first perform image quality processing on the image information after receiving the image information of the video module, and then perform encoding and compression to convert the image The information is converted into a USB signal, and finally sent to an external device through a USB transmission line.
The integrated audio and video device according to claim 1, wherein the audio information of the microphone module includes environmental audio information and speech audio information, and the main control module is configured to receive the audio information of the microphone module after receiving the audio information. , first perform echo cancellation processing on the audio information to eliminate the environmental audio information, then perform noise reduction processing on the audio information, and finally send it to an external device through a USB transmission line.
The integrated audio and video device according to claim 3, wherein the power amplifier circuit comprises a power amplifier chip, the power amplifier chip is electrically connected to the main control module, and the power amplifier chip performs equalization processing after receiving the audio digital signal, After the specific audio amplitude of the audio digital signal is enhanced or attenuated, it is sent to the speaker, and the speaker outputs sound.
The integrated audio and video device according to claim 1, wherein the main control module is further configured to, after receiving the image information collected by the video module and the audio information collected by the microphone module, perform an update on the image information and the audio information. Synchronous processing is performed to realize the synchronous output of image information and audio information.
The integrated audio and video device according to claim 3, wherein the power amplifier circuit comprises a power amplifier chip, and the VOP and VON pins of the power amplifier chip are connected to the same connector after being connected in series with an inductor, and the inductor and the connector are connected to the same connector. Connect two capacitors in parallel and then connect to ground.
The integrated audio and video device according to claim 8, wherein the CN1 pin of the power amplifier chip is electrically connected to the CP1 pin of the power amplifier chip after being connected in series with the first capacitor, and the CN2 pin of the power amplifier chip After the second capacitor is connected in series, it is electrically connected to the CP2 pin of the power amplifier chip.
The integrated audio and video device according to claim 8, wherein the CVDD pin of the power amplifier chip is electrically connected to the AVDD pin of the power amplifier chip, and the two capacitors are connected in series to the CVDD pin and the AVDD pin after being connected in parallel. Between the pins, the AVDD pin of the power amplifier chip is connected in series with a third capacitor and then grounded.