CN108924469B - Display picture switching transmission system, intelligent interactive panel and method - Google Patents
Display picture switching transmission system, intelligent interactive panel and method Download PDFInfo
- Publication number
- CN108924469B CN108924469B CN201810869098.2A CN201810869098A CN108924469B CN 108924469 B CN108924469 B CN 108924469B CN 201810869098 A CN201810869098 A CN 201810869098A CN 108924469 B CN108924469 B CN 108924469B
- Authority
- CN
- China
- Prior art keywords
- display picture
- display
- camera
- picture data
- control unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a display picture switching transmission system, an intelligent interactive panel and a display picture switching transmission method, wherein the display picture switching transmission system comprises a first camera, a second camera, a control unit, a sound source scanning processing module and at least two sound wave detection modules arranged at different positions; the sound signals are detected through the at least two sound wave detection modules, the direction information of the sound source to which the sound signals belong is judged through the sound source scanner, and the control unit realizes automatic switching of the first display picture data acquired by the first camera and the second display picture data acquired by the second camera according to the direction information of the sound source, so that a speaker and a listener have a face-to-face communication effect, and the video conference efficiency is improved.
Description
Technical Field
The invention relates to the field of video conferences, in particular to a display picture switching transmission system, an intelligent interactive panel and a display picture switching transmission method.
Background
Video conferencing refers to a conference in which people at two or more locations have a face-to-face conversation via a communication device and a network. Nowadays, video conference technology develops to present diversified characteristics, and by using a video conference system, participants can hear the sound of other meeting places, see the image, action and expression of other meeting place on-site participants, and can also send electronic demonstration content, so that the participants have a feeling of being personally on the scene.
In the process of implementing the invention, the inventor finds that at least the following problems exist in the prior art:
the existing video conference system is generally provided with one or more cameras for shooting the whole conference scene, all participants in a conference are brought into the whole conference scene in the shooting process, the participants occupy a certain share of a video picture, when a participant speaks in the conference, the video display picture of the speaking participant is limited, the speaking effect is influenced to a certain extent, and the other party of the video conference receives influence due to the limited picture of the speaker when receiving information, and the information to be expressed by the speaker cannot be completely received.
Disclosure of Invention
In view of the above problems, an object of the present invention is to provide a display screen switching transmission system, an intelligent interactive panel and a display screen switching transmission method, which enable a speaker and a listener to have a face-to-face communication effect and improve video conference efficiency.
In a first aspect, an embodiment of the present invention provides a display screen switching transmission system, including a first camera, a second camera, a control unit, a sound source scanning processing module, and at least two sound wave detection modules disposed at different positions; each sound wave detection module is provided with an identifier corresponding to the position of the sound wave detection module;
the first camera is connected with the control unit and used for collecting first display picture data in the current visual field range and transmitting the first display picture data to the control unit;
the second camera is connected with the control unit and used for collecting second display picture data in the current visual field range and transmitting the second display picture data to the control unit;
the at least two sound wave detection modules are connected with the sound source scanning processing module and used for converting the sound waves into sound signals when the sound waves are detected;
the sound source scanning processing module is connected with the control unit and used for scanning each sound wave detection module, calculating direction information of a sound source emitting sound waves according to the scanned identification of the sound wave detection module when a sound signal exists in any one of the sound wave detection modules in the first scanning process, and transmitting the direction information of the sound source to the control unit;
the control unit is used for receiving the first display picture data, the second display picture data and the direction information of the sound source, and outputting the first display picture or the second display picture to associated equipment according to the direction information of the sound source.
In a first implementation form of the first aspect,
the control unit is specifically configured to receive the first display picture data, the second display picture data, and the direction information of the sound source; when the direction of the sound source is detected to be the direction close to the first camera according to the direction information of the sound source, and the display picture data output to the associated equipment at present is second display picture data, sending a first switching instruction to the first camera and the second camera, and switching and outputting the first display picture data to the associated equipment; when the direction of the sound source is detected to be the direction close to the second camera according to the direction information of the sound source, and the display picture data output to the associated equipment at present is first display picture data, sending a second switching instruction to the first camera and the second camera, and switching and outputting the second display picture data to the associated equipment;
the first camera is further configured to receive the first switching instruction, and output a first display picture with a preset first resolution to the control unit according to the first switching instruction; and
receiving the second switching instruction, and outputting a first display picture with preset second resolution to the control unit according to the second switching instruction; wherein the first resolution is greater than the second resolution;
the second camera is further configured to receive the first switching instruction, and output a second display picture with a preset second resolution to the control unit according to the first switching instruction; and
and receiving the second switching instruction, and outputting a second display picture with preset first resolution to the control unit according to the second switching instruction.
In a second implementation form of the first aspect,
the sound source scanning processing module is further configured to perform a delay cycle operation when a sound signal exists in any one of the sound wave detection modules during first scanning, so as to stop scanning each of the sound wave detection modules during the delay cycle.
In a third implementation form of the first aspect,
the sound wave detection module comprises a sound wave receiver and a sound wave processor;
the sound wave receiver is connected with the sound wave processor and used for receiving sound waves emitted from a sound source direction and transmitting the sound waves to the sound wave processor;
and the sound wave processor is used for receiving the sound wave and converting the sound wave into a sound signal.
According to a third implementation manner of the first aspect, in a fourth implementation manner of the first aspect, the system further includes a third camera;
the third camera is used for being connected with the control unit, collecting third display picture data in the current visual field range and transmitting the third display picture data to the control unit;
the control unit is further configured to receive the third display image data and output the third display image data to the associated device, so that the associated device generates a first video image according to the received first display image data and the third display image data, or generates a second video image according to the received second display image data and the third display image data; the first video picture comprises a first display picture generated according to the first display picture data and a third display picture generated according to the third display picture data, and the first display picture is displayed on the third display picture in a superposed mode according to a preset proportion of the third display picture; the second video picture comprises a second display picture generated according to the second display picture data and a third display picture generated according to the third display picture data, and the second display picture is overlapped and displayed on the third display picture according to the preset proportion of the third display picture.
According to a fourth implementation form of the first aspect, in a fifth implementation form of the first aspect, the mobile terminal further comprises a touch screen display;
the control unit is further configured to receive fourth display picture data and fifth display picture data transmitted by the associated device, and generate a third video picture according to the received fourth display picture data and fifth display picture data; the third video picture comprises a fourth display picture generated according to the fourth display picture data and a fifth display picture generated according to the fifth display picture data, and the fifth display picture is displayed on the fourth display picture in a superposed manner according to a preset proportion of the fourth display picture;
and the touch screen display is connected with the control unit and used for displaying the third video picture.
According to a fifth implementation form of the first aspect, in a sixth implementation form of the first aspect, the first camera and the second camera are rotatable cameras;
the control unit is further configured to adjust a lens angle of the first camera or the second camera according to the direction information of the sound source.
In a second aspect, an embodiment of the present invention provides an intelligent interactive tablet, including a frame, a motherboard, and the display screen switching transmission system described in any one of the above; the main board is connected with a control unit of the display picture switching transmission system; the first camera and the second camera are respectively arranged at the left side and the right side of the frame.
In a first implementation manner of the second aspect, the display screen switching transmission system further includes a third camera, and the third camera is installed at a position above the frame;
the number of the sound wave detection modules is 4, and the sound wave detection modules are respectively arranged in the upper direction, the lower direction, the left direction and the right direction of the frame.
In a third aspect, an embodiment of the present invention provides a method for switching and transmitting a display screen of an intelligent interactive tablet based on any implementation manner of the second aspect, including the following steps:
receiving first display picture data in a current visual field range of a first camera;
receiving second display picture data in the current visual field range of the second camera, wherein the second display picture data are acquired by the second camera;
receiving direction information of the sound source acquired by the sound source scanning processing module; the direction information of the sound source is obtained by the sound source scanning processing module through calculation according to the first scanned identification of the sound wave detection module with the sound signal; the number of the acoustic detection modules is at least two and the acoustic detection modules are arranged at different positions; each sound wave detection module is provided with a mark corresponding to the position of the sound wave detection module;
and outputting the first display picture data or the second display picture data to associated equipment according to the direction information of the sound source.
In a first implementation manner of the third aspect, the outputting the first display screen data or the second display screen data to a related device according to the direction information of the sound source specifically includes:
receiving the first display picture data, the second display picture data and the direction information of the sound source;
when the direction of the sound source is detected to be the direction close to the first camera according to the direction information of the sound source, and the display picture data output to the associated equipment at present is second display picture data, sending a first switching instruction to the first camera and the second camera, and switching and outputting the first display picture data to the associated equipment; the first switching instruction is used for triggering the first camera to output a first display picture with preset first resolution to the control unit according to the first switching instruction, and triggering the second camera to output a second display picture with preset second resolution to the control unit according to the first switching instruction; the first resolution is greater than the second resolution;
when the direction of the sound source is detected to be the direction close to the second camera according to the direction information of the sound source, and the display picture data output to the associated equipment at present is first display picture data, sending a second switching instruction to the first camera and the second camera, and switching and outputting the second display picture data to the associated equipment; the second switching instruction is used for triggering the first camera to output a first display picture with a preset second resolution to the control unit according to the second switching instruction, and triggering the second camera to output a second display picture with a preset first resolution to the control unit according to the second switching instruction.
In a second implementation manner of the third aspect, the method further includes:
receiving third display picture data in the current visual field range of the third camera;
outputting the third display picture data to the associated equipment to enable the associated equipment to generate a first video picture according to the received first display picture data and the third display picture data, or to generate a second video picture according to the received second display picture data and the third display picture data; the first video picture comprises a first display picture generated according to the first display picture data and a third display picture generated according to the third display picture data, and the first display picture is displayed on the third display picture in a superposed mode according to a preset proportion of the third display picture; the second video picture comprises a second display picture generated according to the second display picture data and a third display picture generated according to the third display picture data, and the second display picture is overlapped and displayed on the third display picture according to the preset proportion of the third display picture.
According to the second implementation manner of the third aspect, in a third implementation manner of the third aspect, the method further includes:
receiving fourth display picture data and fifth display picture data transmitted by the associated equipment, and generating a third video picture according to the received fourth display picture data and fifth display picture data; the third video picture comprises a fourth display picture generated according to the fourth display picture data and a fifth display picture generated according to the fifth display picture data, and the fifth display picture is displayed on the fourth display picture in a superposed manner according to a preset proportion of the fourth display picture;
and sending the third video picture to a touch screen display so that the touch screen display displays the third video picture.
The above embodiment has the following beneficial effects:
the sound signals are detected through the at least two sound wave detection modules, the direction information of the sound source to which the sound signals belong is judged through the sound source scanner, the control unit realizes automatic switching of the first display picture data collected by the first camera and the second display picture data collected by the second camera according to the direction information of the sound source, shooting of the display picture from the position where the sound source direction is located is realized, the output picture proportion of a speaker in a video conference scene is increased, the speaker and a listener have a face-to-face communication effect, the problem that the speaking effect of the video conference is influenced due to the fact that the speaker occupies a small proportion in the display picture is avoided, two parties of the video conference can pay attention to the speaking content of the speaker when the speaker speaks, and the conference efficiency of the video conference is improved.
Drawings
In order to more clearly illustrate the technical solution of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a display screen switching transmission system according to a first embodiment of the present invention.
Fig. 2 is a schematic diagram of a sound source scanning processing module and an acoustic wave detection module according to a first embodiment of the present invention.
Fig. 3 is a schematic diagram of connection between a control unit and a motherboard in an intelligent tablet according to a second embodiment of the present invention.
Fig. 4 is a flowchart illustrating a display screen switching transmission method according to a third embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a first embodiment of the present invention provides a display screen switching transmission system, where the display screen switching transmission system is installed in an intelligent interactive panel, and the intelligent interactive panel may be an integrated device that controls content displayed on the display panel and implements human-computer interaction operation through a touch technology, and integrates one or more functions of a projector, an electronic whiteboard, a curtain, a sound, a television, a video conference terminal, and the like.
In an embodiment of the present invention, the smart interactive tablet may establish a data connection with at least one external device. Among these, external devices include, but are not limited to: a stylus, a mouse, an intelligent interactive tablet, a mobile terminal, etc. The following embodiments exemplarily describe the present invention in a scenario of performing a remote video conference between two intelligent interactive tablets by using a communication method such as a USB connection, an internet, a local area network, a bluetooth, a Wi-Fi, or a ZigBee protocol (ZigBee), and it should be noted that both the two intelligent interactive tablets have a video conference function and are equipped with the display screen switching transmission system.
Referring to fig. 1, a first embodiment of the present invention provides a display screen switching transmission system, which includes a first camera 11, a second camera 12, a control unit 15, a sound source scanning processing module 14, and at least two sound wave detection modules 13 disposed at different positions; wherein, each acoustic wave detection module 13 has an identifier corresponding to its own position.
The first camera 11 is connected to the control unit 15, and is configured to collect first display image data in a current field of view, and transmit the first display image data to the control unit 15.
The second camera 12 is connected to the control unit 15, and is configured to collect second display image data in a current field of view, and transmit the second display image data to the control unit 15.
In an embodiment of the present invention, for example, the display screen switching transmission system may be applied to an intelligent interactive flat panel (although other terminal devices may be used as well, the present invention is not particularly limited), where the intelligent interactive flat panel including the display screen switching transmission system has a frame, so that the first camera 11 and the second camera 12 of the display screen switching transmission system can be respectively installed at positions on the left and right sides of the frame, preferably, the first camera 11 and the second camera 12 are respectively installed at two thirds of the left and right sides of the frame so as to be flush with human eyes, and can achieve the effects of normal communication and face-to-face communication during a video conference, the first camera 11 and the second camera 12 respectively shoot pictures within the visual field range of their own positions to respectively collect first display screen data and second display screen data, the first display image data and the second display image data are transmitted to the control unit 15, it should be noted that the first camera 11 and the second camera 12 may be fixed cameras or rotatable cameras, which is not limited in this respect.
The at least two sound wave detection modules 13 are connected to the sound source scanning processing module 14, and configured to convert the sound waves into sound signals when sound waves are detected.
In the embodiment of the present invention, the acoustic wave detection module 13 includes an acoustic wave receiver and an acoustic wave processor; the sound wave receiver is connected with the sound wave processor and used for receiving sound waves emitted from a sound source direction and transmitting the sound waves to the sound wave processor; the sound wave processor is used for receiving the sound wave and converting the sound wave into a sound signal, the number of the acoustic wave detection modules 13 is preferably 4, and the acoustic wave detection modules 13 are respectively arranged in 4 different directions, for example, the sound wave sensor is arranged in 4 different directions, namely, the upper direction, the lower direction, the left direction and the right direction, of the frame of the intelligent interaction tablet so as to acquire sound waves in all directions, therefore, the sound wave detection module 13 is an LM386 processing circuit, the LM386 is a variety of power amplifier integrated circuits of national semiconductor company series in America, and the sound wave detection module is widely applied to communication equipment, recorders and various playback equipment due to the advantages of low power consumption, wide range of working power supply voltage, simple and convenient adjustment of peripheral elements and devices and the like, preferably, an adjustable resistor can be added to the LM386 processing circuit to adjust the sensitivity of the acoustic detection module 13, so as to better receive and process the acoustic wave propagating from the direction of the sound source.
The sound source scanning processing module 14 is connected to the control unit 15, and configured to scan each of the sound wave detection modules 13, when any one of the sound wave detection modules 13 is scanned for the first time, calculate, according to the scanned identifier of the sound wave detection module 13, direction information of a sound source emitting the sound wave, and transmit the direction information of the sound source to the control unit 15.
In the embodiment of the present invention, please refer to fig. 2, the sound source scanning processing module 14 scans the sound wave detection modules 13 connected thereto at a high speed, when it is first scanned that any one of the sound wave detection modules 13 has a sound signal, the sound source scanning processing module 14 performs a delay loop operation to stop scanning each sound wave detection module 13 during a delay loop period, then calculates direction information of a sound source emitting the sound wave according to an identifier of the scanned sound wave detection module 13, the identifier of the sound wave detection module 13 is related to a position where the sound wave detection module is located, according to the identifier of the sound wave detection module 13, the sound source scanning processing module 14 can obtain the direction information of the sound source to which the sound wave belongs, then transmits the direction information of the sound source to the control unit 15, and when the delay loop is ended, the sound source scanning processing module 14 repeats a next high-speed scanning process, until it is found that there is a sound signal in any one of the sound wave detection modules 13 in the next scanning, it should be noted that the sound source scanning processing module 14 may be an AT89C2051 chip, and the AT89C2051 chip is a low-voltage, high-performance 8-bit CMOS microprocessor with a 2K byte flash programmable read only memory (EEPROM), which is manufactured by using the high-density nonvolatile memory technology of ATMEL and is compatible with the industry standard MCS-51 instruction set and pin structure, and by combining a common CPLI and flash memory on a single chip, a highly flexible and low-cost solution is provided for many embedded control applications.
The control unit 15 is configured to receive the first display image data, the second display image data, and the direction information of the sound source, and output the first display image or the second display image to an associated device according to the direction information of the sound source.
In an embodiment of the present invention, the control Unit 15 may be a Micro Control Unit (MCU) specifically configured to receive the first display image data, the second display image data, and the direction information of the sound source, send a first switching instruction to the first camera 11 and the second camera 12 and switch and output the first display image data to the associated device when detecting that the direction of the sound source is a direction close to the first camera 11 and the display image data currently output to the associated device is the second display image data according to the direction information of the sound source, send a second switching instruction to the first camera 11 and the second camera 12 when detecting that the direction of the sound source is a direction close to the second camera 12 and the display image data currently output to the associated device is the first display image data according to the direction information of the sound source, switching and outputting the second display picture data to the associated equipment; the first camera 11 is further configured to receive the first switching instruction, and output a first display picture with a preset first resolution to the control unit 15 according to the first switching instruction; receiving the second switching instruction, and outputting a first display picture with a preset second resolution to the control unit 15 according to the second switching instruction; wherein the first resolution is greater than the second resolution; the second camera 12 is further configured to receive the first switching instruction, and output a second display picture with a preset second resolution to the control unit 15 according to the first switching instruction; and receiving the second switching instruction, outputting a second display picture with a preset first resolution to the control unit 15 according to the second switching instruction, where it is to be noted that the associated device is another intelligent interactive panel including a display picture switching transmission system, a video conference function is implemented between the two intelligent interactive panels, the control unit 15 receives the first display picture data and the second display picture data simultaneously, so as to achieve rapidness and convenience of switching output of the display picture data, avoid the situation that the switching output needs to wait for a switching time due to the fact that the first display picture data and the second display picture data are not received simultaneously, and cause poor connection of video pictures, which affects user experience, when the control unit 15 receives the first display picture data and the second display picture data simultaneously, for example, when the control unit 15 switches to transmit the first display image data to the associated device, the control unit 15 sends the first switching instruction to the first camera 11 and the second camera 12, so that the first camera 11 outputs the first display image data with a resolution of 1080p to the control unit 15, and the second camera 12 outputs the second display image data with a resolution of 360p to the control unit 15, so as to achieve the purposes of saving bandwidth and conveniently switching display image data as a whole.
In the embodiment of the present invention, when the video conference software on the smart tablet starts to be used, the sound source scanning processing module 14 transmits the direction information of the sound source to the control unit 15 after acquiring the direction information of the sound source, the control unit 15 automatically turns on a camera close to the direction of the sound source to collect display image data after receiving the direction information of the sound source, and a switching process is completed after 2 to 3 seconds, so as to avoid a phenomenon of misoperation caused by turning on the first camera 11 and the second camera 12 at the same time.
To sum up, the first embodiment of the present invention provides a display screen switching transmission system, in which at least two sound wave detection modules 13 detect sound signals, the sound source scanner determines direction information of a sound source to which the sound signals belong, and the control unit 15 implements automatic switching between first display screen data collected by the first camera 11 and second display screen data collected by the second camera 12 according to the direction information of the sound source, implements shooting of a display screen from a position where the sound source is located, increases an output screen ratio of a speaker in a video conference scene, enables the speaker and a listener to have a face-to-face communication effect, avoids influencing an effect of the video conference due to a small ratio of the speaker in the display screen, enables both parties of the video conference to concentrate on speech content of the speaker when the speaker speaks, the conference efficiency of the video conference is improved.
In another embodiment of the present invention, the display screen switching transmission system further includes a third camera 16.
The third camera 16 is configured to be connected to the control unit 15, and configured to collect third display image data in a current field of view, and transmit the third display image data to the control unit 15.
In an embodiment of the present invention, the third camera 16 is installed above a frame of the smart tablet, so as to facilitate collecting third display image data of the whole conference panorama, and the third camera 16 may be a fixed camera or a rotary camera, which is not limited in this respect.
The control unit 15 is further configured to receive the third display image data, and output the third display image data to the associated device, so that the associated device generates a first video image according to the received first display image data and the third display image data, or generates a second video image according to the received second display image data and the third display image data; the first video picture comprises a first display picture generated according to the first display picture data and a third display picture generated according to the third display picture data, and the first display picture is displayed on the third display picture in a superposed mode according to a preset proportion of the third display picture; the second video picture comprises a second display picture generated according to the second display picture data and a third display picture generated according to the third display picture data, and the second display picture is overlapped and displayed on the third display picture according to the preset proportion of the third display picture.
In this embodiment of the present invention, after receiving the third display image data, the control unit 15 outputs the third display image data to the associated device, and adds the first display image data and the second display image data for switching output, so that the associated device receives the first display image data and the third display image data, generates a first display image according to the first display image data and a third display image according to the third display image data, and then displays the third display image and the first display image in a picture-in-picture display manner in which the third display image is a main display image and the first display image is an auxiliary display image; or receiving the second display image data and the third display image data, displaying the third display image and the second display image in a picture-in-picture display mode in which the third display image is used as a main image and the second display image is used as an auxiliary image, the picture-in-picture is a video content presentation mode, which means that when one video is played in a full screen mode, the other video is played on a small area of the image simultaneously, two video signals are presented simultaneously in a mode of overlapping a large video image and a small video image, the picture-in-picture is widely used for televisions, video recording, monitoring and demonstrating equipment, the first display image and the second display image are displayed in a preset proportion of the third display image, and the invention needs to be explained without any limitation on the preset proportion, for example, it may be one fourth, one sixth, etc.
In another embodiment of the present invention, the display screen switching transmission system further includes a touch screen display 17.
The control unit 15 is further configured to receive fourth display image data and fifth display image data transmitted by the associated device, and generate a third video image according to the received fourth display image data and fifth display image data; the third video picture comprises a fourth display picture generated according to the fourth display picture data and a fifth display picture generated according to the fifth display picture data, and the fifth display picture is displayed on the fourth display picture in a superimposed manner according to a preset proportion of the fourth display picture.
The touch screen display 17 is connected to the control unit 15, and is configured to display the third video picture.
In the embodiment of the present invention, while the first display image data and the third display image data, or the second display image data and the third display image data are transmitted to the associated device, in the process of performing a video conference, the control unit 15 also receives two display signals transmitted by the associated device at the same time, that is, two display image data, one display image data (fourth display image data) is used to display a conference panorama of a party where the associated device is located, and the other display image data (fifth display image data) is used to switch and display a speech image of a speaker of the party where the associated device is located.
In another embodiment of the present invention, when the first camera 11 and the second camera 12 are rotatable cameras, the control unit 15 is further configured to adjust a lens angle of the first camera 11 or the second camera 12 according to the direction information of the sound source, so as to flexibly and accurately acquire a display picture in the direction of the sound source.
Referring to fig. 3, a second embodiment of the present invention provides an intelligent interactive tablet, which includes a frame, a main board 21, and the display switching transmission system according to any one of the above embodiments; the main board 21 is connected with the control unit 15 of the display picture switching transmission system; the first camera 11 and the second camera 12 are respectively installed at the left and right sides of the frame.
In the embodiment of the present invention, the display screen switching transmission system further includes a third camera 16, where the third camera 16 is installed at a position above the frame; the number of the sound wave detection modules 13 is 4, and the sound wave detection modules 13 are respectively arranged in the upper, lower, left and right directions of the frame, it should be noted that the intelligent interactive tablet can include, but is not limited to, a main board 21 and the display screen switching transmission system. It will be understood by those skilled in the art that the schematic diagram is merely an example of the smart interactive tablet, and does not constitute a limitation on the smart interactive tablet, and may include more or less components than those shown in the drawings, or some components in combination, or different components, for example, the smart interactive tablet may further include an input/output device, a network access device, a memory, etc., the motherboard 21, the touch screen display 17, and the display screen switching transmission system may be connected by a bus or other means, and in fig. 4, the motherboard 21 may be a Central Processing Unit (CPU), other general purpose Processor, Digital Signal Processor (DSP), Application Specific Integrated Circuit (ASIC), Field Programmable Gate Array (FPGA) or other Programmable logic device, Discrete gate or transistor logic devices, discrete hardware components, and the like. The general purpose processor may be a microprocessor or the processor may be any conventional processor, etc., the processor is the control center of the smart interactive tablet and connects the various parts of the whole smart interactive tablet by various interfaces and lines.
Referring to fig. 4, a third embodiment of the present invention provides a display screen switching transmission method for an intelligent interactive tablet based on a fourth embodiment, including the following steps:
and S11, receiving the first display picture data in the current visual field of the camera acquired by the first camera.
And S12, receiving second display picture data in the current visual field of the second camera acquired by the second camera.
S13, receiving the direction information of the sound source obtained by the sound source scanning processing module; the direction information of the sound source is obtained by the sound source scanning processing module through calculation according to the first scanned identification of the sound wave detection module with the sound signal; the number of the acoustic detection modules is at least two and the acoustic detection modules are arranged at different positions; each sound wave detection module is provided with a mark corresponding to the position of the sound wave detection module.
And S14, outputting the first display picture data or the second display picture data to associated equipment according to the direction information of the sound source.
In a first implementation manner of the fifth embodiment, the S14 specifically includes:
and receiving the first display picture data, the second display picture data and the direction information of the sound source.
When the direction of the sound source is detected to be the direction close to the first camera according to the direction information of the sound source, and the display picture data output to the associated equipment at present is second display picture data, sending a first switching instruction to the first camera and the second camera, and switching and outputting the first display picture data to the associated equipment; the first switching instruction is used for triggering the first camera to output a first display picture with preset first resolution to the control unit according to the first switching instruction, and triggering the second camera to output a second display picture with preset second resolution to the control unit according to the first switching instruction; the first resolution is greater than the second resolution.
When the direction of the sound source is detected to be the direction close to the second camera according to the direction information of the sound source, and the display picture data output to the associated equipment at present is first display picture data, sending a second switching instruction to the first camera and the second camera, and switching and outputting the second display picture data to the associated equipment; the second switching instruction is used for triggering the first camera to output a first display picture with a preset second resolution to the control unit according to the second switching instruction, and triggering the second camera to output a second display picture with a preset first resolution to the control unit according to the second switching instruction.
In a second implementation manner of the fifth embodiment, the method further includes:
and receiving third display picture data in the current visual field range of the third camera.
Outputting the third display picture data to the associated equipment to enable the associated equipment to generate a first video picture according to the received first display picture data and the third display picture data, or to generate a second video picture according to the received second display picture data and the third display picture data; the first video picture comprises a first display picture generated according to the first display picture data and a third display picture generated according to the third display picture data, and the first display picture is displayed on the third display picture in a superposed mode according to a preset proportion of the third display picture; the second video picture comprises a second display picture generated according to the second display picture data and a third display picture generated according to the third display picture data, and the second display picture is overlapped and displayed on the third display picture according to the preset proportion of the third display picture.
According to the second implementation manner of the fifth embodiment, in the third implementation manner of the fifth embodiment, the method further includes:
receiving fourth display picture data and fifth display picture data transmitted by the associated equipment, and generating a third video picture according to the received fourth display picture data and fifth display picture data; the third video picture comprises a fourth display picture generated according to the fourth display picture data and a fifth display picture generated according to the fifth display picture data, and the fifth display picture is displayed on the fourth display picture in a superimposed manner according to a preset proportion of the fourth display picture.
And sending the third video picture to a touch screen display so that the touch screen display displays the third video picture.
It should be noted that the above-described device embodiments are merely illustrative, where the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. In addition, in the drawings of the embodiment of the apparatus provided by the present invention, the connection relationship between the modules indicates that there is a communication connection between them, and may be specifically implemented as one or more communication buses or signal lines. One of ordinary skill in the art can understand and implement it without inventive effort.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention.
Claims (9)
1. A display picture switching transmission system is characterized by comprising a first camera, a second camera, a control unit, a sound source scanning processing module and at least two sound wave detection modules arranged at different positions; each sound wave detection module is provided with an identifier corresponding to the position of the sound wave detection module;
the first camera is connected with the control unit and used for collecting first display picture data in the current visual field range and transmitting the first display picture data to the control unit;
the second camera is connected with the control unit and used for collecting second display picture data in the current visual field range and transmitting the second display picture data to the control unit;
the at least two sound wave detection modules are connected with the sound source scanning processing module and used for converting the sound waves into sound signals when the sound waves are detected;
the sound source scanning processing module is connected with the control unit and used for scanning each sound wave detection module, calculating direction information of a sound source emitting sound waves according to the scanned identification of the sound wave detection module when a sound signal exists in any one of the sound wave detection modules in the first scanning process, and transmitting the direction information of the sound source to the control unit;
the control unit is used for receiving the first display picture data, the second display picture data and the direction information of the sound source, and outputting the first display picture or the second display picture to associated equipment according to the direction information of the sound source.
The control unit is specifically configured to receive the first display picture data, the second display picture data, and the direction information of the sound source; when the direction of the sound source is detected to be the direction close to the first camera according to the direction information of the sound source, and the display picture data output to the associated equipment at present is second display picture data, sending a first switching instruction to the first camera and the second camera, and switching and outputting the first display picture data to the associated equipment; when the direction of the sound source is detected to be the direction close to the second camera according to the direction information of the sound source, and the display picture data output to the associated equipment at present is first display picture data, sending a second switching instruction to the first camera and the second camera, and switching and outputting the second display picture data to the associated equipment;
the first camera is further configured to receive the first switching instruction, and output a first display picture with a preset first resolution to the control unit according to the first switching instruction; and
receiving the second switching instruction, and outputting a first display picture with preset second resolution to the control unit according to the second switching instruction; wherein the first resolution is greater than the second resolution;
the second camera is further configured to receive the first switching instruction, and output a second display picture with a preset second resolution to the control unit according to the first switching instruction; and
and receiving the second switching instruction, and outputting a second display picture with preset first resolution to the control unit according to the second switching instruction.
2. The display screen switching transmission system according to claim 1,
the sound source scanning processing module is further configured to perform a delay cycle operation when a sound signal exists in any one of the sound wave detection modules during first scanning, so as to stop scanning each of the sound wave detection modules during the delay cycle.
3. The display screen switching transmission system according to claim 1,
the sound wave detection module comprises a sound wave receiver and a sound wave processor;
the sound wave receiver is connected with the sound wave processor and used for receiving sound waves emitted from a sound source direction and transmitting the sound waves to the sound wave processor;
and the sound wave processor is used for receiving the sound wave and converting the sound wave into a sound signal.
4. The display screen switching transmission system according to claim 3, further comprising a third camera;
the third camera is connected with the control unit and used for collecting third display picture data in the current visual field range and transmitting the third display picture data to the control unit;
the control unit is further configured to receive the third display image data and output the third display image data to the associated device, so that the associated device generates a first video image according to the received first display image data and the third display image data, or generates a second video image according to the received second display image data and the third display image data; the first video picture comprises a first display picture generated according to the first display picture data and a third display picture generated according to the third display picture data, and the first display picture is displayed on the third display picture in a superposed mode according to a preset proportion of the third display picture; the second video picture comprises a second display picture generated according to the second display picture data and a third display picture generated according to the third display picture data, and the second display picture is overlapped and displayed on the third display picture according to the preset proportion of the third display picture.
5. The display screen switching transmission system according to claim 4, further comprising a touch screen display;
the control unit is further configured to receive fourth display picture data and fifth display picture data transmitted by the associated device, and generate a third video picture according to the received fourth display picture data and fifth display picture data; the third video picture comprises a fourth display picture generated according to the fourth display picture data and a fifth display picture generated according to the fifth display picture data, and the fifth display picture is displayed on the fourth display picture in a superposed manner according to a preset proportion of the fourth display picture;
and the touch screen display is connected with the control unit and used for displaying the third video picture.
6. The display screen switching transmission system according to any one of claims 1 to 5, wherein the first camera and the second camera are rotatable cameras;
the control unit is further configured to adjust a lens angle of the first camera or the second camera according to the direction information of the sound source.
7. An intelligent interactive tablet comprising a frame, a main board and the display switching transmission system according to any one of claims 1 to 6; the main board is connected with a control unit of the display picture switching transmission system; the first camera and the second camera are respectively arranged at the left side and the right side of the frame.
8. The smart interactive tablet of claim 7, wherein the display switching transmission system further comprises a third camera mounted at a position above the bezel;
the number of the sound wave detection modules is 4, and the sound wave detection modules are respectively arranged in the upper direction, the lower direction, the left direction and the right direction of the frame.
9. The method for switching and transmitting the display screen of the intelligent interactive tablet based on the claim 7 or 8 is characterized by comprising the following steps:
receiving first display picture data in a current visual field range of a first camera;
receiving second display picture data in the current visual field range of the second camera, wherein the second display picture data are acquired by the second camera;
receiving direction information of the sound source acquired by the sound source scanning processing module; the direction information of the sound source is obtained by the sound source scanning processing module through calculation according to the first scanned identification of the sound wave detection module with the sound signal; the number of the acoustic detection modules is at least two and the acoustic detection modules are arranged at different positions; each sound wave detection module is provided with a mark corresponding to the position of the sound wave detection module;
and outputting the first display picture data or the second display picture data to associated equipment according to the direction information of the sound source.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810869098.2A CN108924469B (en) | 2018-08-01 | 2018-08-01 | Display picture switching transmission system, intelligent interactive panel and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810869098.2A CN108924469B (en) | 2018-08-01 | 2018-08-01 | Display picture switching transmission system, intelligent interactive panel and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108924469A CN108924469A (en) | 2018-11-30 |
| CN108924469B true CN108924469B (en) | 2020-11-10 |
Family
ID=64393970
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810869098.2A Active CN108924469B (en) | 2018-08-01 | 2018-08-01 | Display picture switching transmission system, intelligent interactive panel and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108924469B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110351515A (en) * | 2019-07-23 | 2019-10-18 | 广东以诺通讯有限公司 | A kind of intelligent video call method and system |
| CN111372003A (en) * | 2020-04-20 | 2020-07-03 | 惠州Tcl移动通信有限公司 | Camera switching method and device and terminal |
| CN111918127B (en) * | 2020-07-02 | 2023-04-07 | 影石创新科技股份有限公司 | Video clipping method and device, computer readable storage medium and camera |
| CN115963732A (en) * | 2021-10-13 | 2023-04-14 | 广州视源电子科技股份有限公司 | Management method and device of control authority, interactive intelligent panel and storage medium |
| CN114286114B (en) * | 2021-11-17 | 2024-02-09 | 上海东方传媒技术有限公司 | Intelligent video stream switching method and system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102244762A (en) * | 2011-06-03 | 2011-11-16 | 深圳市东微智能科技有限公司 | Camera tracking method and system used in conference system |
| CN102368816A (en) * | 2011-12-01 | 2012-03-07 | 中科芯集成电路股份有限公司 | Intelligent front end system of video conference |
| CN102707260A (en) * | 2012-02-23 | 2012-10-03 | 江苏三通仪器系统有限公司 | Sound positioning signal sensor |
| CN102843540A (en) * | 2011-06-20 | 2012-12-26 | 宝利通公司 | Automatic camera selection for videoconference |
| CN103595953A (en) * | 2013-11-14 | 2014-02-19 | 华为技术有限公司 | Method and device for controlling video shooting |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8395653B2 (en) * | 2010-05-18 | 2013-03-12 | Polycom, Inc. | Videoconferencing endpoint having multiple voice-tracking cameras |
| US9693017B2 (en) * | 2014-08-20 | 2017-06-27 | Cisco Technology, Inc. | Automatic switching between different cameras at a video conference endpoint based on audio |
-
2018
- 2018-08-01 CN CN201810869098.2A patent/CN108924469B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102244762A (en) * | 2011-06-03 | 2011-11-16 | 深圳市东微智能科技有限公司 | Camera tracking method and system used in conference system |
| CN102843540A (en) * | 2011-06-20 | 2012-12-26 | 宝利通公司 | Automatic camera selection for videoconference |
| CN102368816A (en) * | 2011-12-01 | 2012-03-07 | 中科芯集成电路股份有限公司 | Intelligent front end system of video conference |
| CN102707260A (en) * | 2012-02-23 | 2012-10-03 | 江苏三通仪器系统有限公司 | Sound positioning signal sensor |
| CN103595953A (en) * | 2013-11-14 | 2014-02-19 | 华为技术有限公司 | Method and device for controlling video shooting |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108924469A (en) | 2018-11-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108924469B (en) | Display picture switching transmission system, intelligent interactive panel and method | |
| EP1449369B1 (en) | A system and method for providing an awareness of remote people in the room during a videoconference | |
| WO2015192631A1 (en) | Video conferencing system and method | |
| CN108293104B (en) | Information processing system, wireless terminal, and information processing method | |
| US20110194488A1 (en) | Telephone System | |
| CN113132670A (en) | Video conference system | |
| JP2015188200A (en) | Information processing device, conference system, and program | |
| US20230283888A1 (en) | Processing method and electronic device | |
| CN102202206B (en) | Communication equipment | |
| JP2004180086A (en) | Apartment house intercom device | |
| CN112887653B (en) | Information processing method and information processing device | |
| US8421844B2 (en) | Apparatus for correcting gaze, a method of videoconferencing and a system therefor | |
| US5675512A (en) | Low-cost room-based video conferencing systems | |
| CN105898256A (en) | Action identified screen-free television | |
| CN203225845U (en) | Digital high-definition video-wall | |
| CN209861025U (en) | Video intercom microphone | |
| CN105744245A (en) | Non-screen television capable of projecting multiple pictures and multi-screen display control method | |
| CN215871615U (en) | LED screen control system | |
| JP2858554B2 (en) | Video conference system | |
| CN215734614U (en) | Live broadcast system | |
| CN115412702A (en) | Conference terminal and video wall integrated equipment and system | |
| CN210627185U (en) | Signal transmission circuit and interactive intelligent panel | |
| CN213213667U (en) | Interactive conference device based on visual and sound fusion | |
| CN220254553U (en) | Video switching station control circuit and control device | |
| CN213244224U (en) | Online learning terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |