CN112333416A - Intelligent video system and intelligent control terminal - Google Patents
Intelligent video system and intelligent control terminal Download PDFInfo
- Publication number
- CN112333416A CN112333416A CN202011233668.2A CN202011233668A CN112333416A CN 112333416 A CN112333416 A CN 112333416A CN 202011233668 A CN202011233668 A CN 202011233668A CN 112333416 A CN112333416 A CN 112333416A
- Authority
- CN
- China
- Prior art keywords
- terminal
- close
- display
- range image
- intelligent control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
Abstract
An embodiment of the present invention provides an intelligent video system, which is characterized in that the system includes: the system comprises a first terminal, a second terminal and a display; the second terminal comprises a long-range camera used for acquiring a long-range image; a display for displaying a distant view image; the first terminal comprises a close-range camera and is used for sending a control instruction to the second terminal; when a sound source is detected, acquiring a close-range image and sound for acquiring the direction of the sound source; sending a first switching instruction to the second terminal; and the display is also used for displaying the close-range image when the first terminal acquires the close-range image. The intelligent video system disclosed by the embodiment of the invention can solve the problem of single video picture in the prior art and improve the field experience of a user when holding a video conference.
Description
The application is a divisional application of a Chinese invention patent application with the application number of 201811107962.1 named as 'intelligent video system and intelligent control terminal' applied in 2018, 09, month and 21.
Technical Field
The embodiment of the invention relates to the technical field of computers, in particular to an intelligent video system and an intelligent control terminal.
Background
With the popularization of internet video technology, more and more conference rooms have deployed video conference systems, and users can use hardware video terminals to perform remote video conferences and other various video collaboration.
The current video conference terminals all adopt a single-terminal mode, namely, a set of audio and video acquisition equipment is configured, and the conference participation experience of a user completely depends on the configuration condition of the single terminal. For example, the fixed camera angle and focal length can only collect one path of video picture, and the user experience is not good.
Disclosure of Invention
The embodiment of the invention provides an intelligent video system and an intelligent control terminal, and aims to solve the problem that in the prior art, the experience of user participation is poor.
In a first aspect of embodiments of the present invention, there is provided an intelligent video system, comprising: the system comprises a first terminal, a second terminal and a display;
the second terminal comprises a long-range camera used for acquiring a long-range image;
a display for displaying a distant view image;
the first terminal comprises a close-range camera and is used for acquiring a close-range image in the direction of a sound source when the sound source is detected;
and the display is also used for displaying the close-range image when the first terminal acquires the close-range image.
Optionally, the first terminal is further configured to send a control instruction to the second terminal, where the control instruction is used to control the second terminal to obtain the distant view image;
and the display is used for displaying the long-range image.
Optionally, the second terminal is further configured to obtain a long-range image when the sound source is not detected within a set time;
and the display is used for displaying the long-range image.
Optionally, the first terminal is further configured to, when it is detected that the second terminal is abnormal, obtain a close-range image;
and the display is used for displaying the close-up image.
In a second aspect of the embodiments of the present invention, there is provided an intelligent control terminal, where the terminal includes: a communication unit, a microphone and a rotatable camera;
the microphone is used for detecting a sound source and acquiring the direction of the sound source;
the camera is used for collecting close-range images in the direction of the sound source;
and the communication unit is used for sending the close-range image to the display.
Optionally, the terminal further includes:
and the processor is used for sending a control instruction to the second terminal, and the control instruction is used for controlling the second terminal to acquire the long-range images.
Optionally, the processor is further configured to detect an operating state of the second terminal;
when the working state is abnormal, the camera is also used for acquiring a close-range image;
and the communication unit is also used for sending the close-range image to the display.
Optionally, the terminal further includes:
the display screen is used for receiving touch information;
the processor is used for generating a touch instruction according to the touch information, and the touch instruction is used for controlling the working state of the second terminal;
and the communication unit is also used for sending a touch instruction to the second terminal.
The intelligent video system disclosed by the embodiment of the invention can solve the problem of single video picture in the prior art and improve the field experience of a user when holding a video conference.
Drawings
The above and other objects, features and advantages of exemplary embodiments of the present invention will become readily apparent from the following detailed description read in conjunction with the accompanying drawings. Several embodiments of the invention are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which:
FIG. 1 schematically illustrates an intelligent video system according to an embodiment of the invention;
FIG. 2 schematically illustrates an intelligent video system according to another embodiment of the invention;
fig. 3 schematically shows an intelligent control terminal according to yet another embodiment of the present invention.
Detailed Description
The principles and spirit of the present invention will be described with reference to a number of exemplary embodiments. It is understood that these embodiments are given solely for the purpose of enabling those skilled in the art to better understand and to practice the invention, and are not intended to limit the scope of the invention in any way. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
As will be appreciated by one skilled in the art, embodiments of the present invention may be embodied as a system, apparatus, device, method, or computer program product. Accordingly, the present disclosure may be embodied in the form of: entirely hardware, entirely software (including firmware, resident software, micro-code, etc.), or a combination of hardware and software.
According to an embodiment of the present invention, an intelligent video system is provided, as shown in fig. 1, including: the system comprises a first terminal, a second terminal and a display;
the second terminal comprises a long-range camera used for acquiring a long-range image;
a display for displaying a distant view image;
the first terminal comprises a close-range camera and is used for acquiring a close-range image in the direction of a sound source when the sound source is detected;
and the display is also used for displaying the close-range image when the first terminal acquires the close-range image.
Illustratively, the first terminal can be an integrated terminal, is small and light, can be placed on a conference room desktop, and can be provided with a battery so as to be separated from a power supply to work independently.
The second terminal can be a split type terminal, is connected with the display and can be placed at the far end of the conference room.
In the intelligent video system, the first terminal and the second terminal may perform pairing operation, for example, a communication connection may be established between the first terminal and the second terminal for transmitting a message or performing control operation.
In the video conference process, the first terminal can perform real-time sound source positioning through a microphone array and the like to detect a local sound source. If the situation that a speaker starts speaking is detected, namely a sound source is detected, the position of the speaker can be subjected to sound source positioning through the microphone array, the direction of the sound source is determined, the camera of the first terminal is rotated, the camera is turned to the current speaking person, and therefore a close-range image of the direction of the sound source is obtained.
When the first terminal acquires the close-range image, the display can automatically switch the picture, and the near-range image of the speaker acquired by the first terminal replaces the long-range image of the conference room acquired by the second terminal, so that the far-end participant can see the close-range of the speaker. In addition, local sound collection can be switched to the first terminal, and sound obtained by the microphone array of the first terminal is transmitted to the conference, so that a far-end participant can hear the sound of a speaker more clearly.
Optionally, the first terminal may be further configured to send a control instruction to the second terminal, where the control instruction is used to control the second terminal to obtain the distant view image;
and the display is used for displaying the long-range image.
Specifically, the first terminal may be further configured to control the second terminal, so that the second terminal acquires the distant view image by sending an instruction and the like, and the display displays the distant view image acquired by the second terminal.
Optionally, the second terminal may be further configured to acquire a long-range image when the sound source is not detected within a set time;
and the display is used for displaying the long-range image.
When the speaker stops speaking and the set time is exceeded, the display can automatically switch the close-range image back to the distant-range image acquired by the second terminal, and further, the sound can be switched to the sound acquired by the microphone of the second terminal.
As shown in fig. 2, if there are other speakers beginning to speak locally, the first terminal may start positioning again through the microphone column, and start rotating the camera to turn to a new speaker position, during the rotation, the display may still display the long-range image acquired by the second terminal until positioning is completed, and after acquiring the short-range image of the new speaker, the system may automatically switch to displaying the short-range image and the sound acquired by the first terminal.
Optionally, the first terminal may be further configured to, when it is detected that the second terminal is abnormal, obtain a close-range image;
and the display is used for displaying the close-up image.
In a pairing state, the first terminal and the second terminal can jointly form a dual-computer hot standby system, when the second terminal is disconnected due to abnormal working state, such as power failure, network disconnection and the like, the first terminal can acquire close-range images and sound, and the display can display the close-range images and sound acquired by the first terminal.
Further, the first terminal may continuously detect the working state of the second terminal until the second terminal recovers to the normal working state.
Optionally, after the first terminal and the second terminal are paired, the first terminal may serve as a console of the second terminal, and a user may click on a display screen of the first terminal to generate touch information, where the touch information includes initiating a call, muting, turning off a camera, hanging up, recording, and the like. The user can conveniently click on the display screen for operation without using a remote controller for operation.
The intelligent video system disclosed by the embodiment of the invention can solve the problem of single video picture in the prior art and improve the field experience of a user when holding a video conference.
According to an embodiment of the present invention, there is provided an intelligent control terminal 30, as shown in fig. 3, including: a communication unit 301, a microphone 302, and a rotatable camera 303;
the microphone 302 is used for detecting a sound source and acquiring the direction of the sound source;
the camera 303 is used for acquiring a close-range image in the direction of the sound source;
a communication unit 301 for transmitting the close-up image to the display.
The communication unit 301 may adopt a cellular network communication mode, a wireless local area network communication mode, or another communication mode capable of stably transmitting data.
The microphone 302 may be a microphone array, and can not only acquire an audio signal, but also detect and acquire a direction of a sound source.
The camera 303 may be a rotatable camera, and can adjust the direction in which the camera is aligned according to the direction of the sound source, thereby accurately obtaining a close-range image of the speaker.
Optionally, the terminal 30 may further include:
the processor 304 may be configured to send a control instruction to the second terminal, where the control instruction is used to control the second terminal to acquire the distant view image.
Optionally, the processor 304 may be further configured to detect an operating state of the second terminal;
when the working state is abnormal, the camera 303 is further used for acquiring a close-range image;
the communication unit 301 may also be configured to send a close-up image to the display.
Optionally, the terminal 30 may further include:
a display screen 305, which may be used to receive touch information;
the processor 304 may be configured to generate a touch instruction according to the touch information, where the touch instruction is used to control a working state of the second terminal;
the communication unit 301 may be further configured to send a touch instruction to the second terminal.
The intelligent control terminal 30 may be used as a first terminal in the intelligent video system shown in fig. 1, and related contents are described above and will not be described herein again.
It should be noted that although in the above detailed description several units/modules or sub-units/modules of the intelligent video system and the intelligent control terminal are mentioned, such a division is merely exemplary and not mandatory. Indeed, the features and functionality of two or more of the units/modules described above may be embodied in one unit/module according to embodiments of the invention. Conversely, the features and functions of one unit/module described above may be further divided into embodiments by a plurality of units/modules.
Moreover, while the operations of the method of the invention are depicted in the drawings in a particular order, this does not require or imply that the operations must be performed in this particular order, or that all of the illustrated operations must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions.
While the spirit and principles of the invention have been described with reference to several particular embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, nor is the division of aspects, which is for convenience only as the features in such aspects may not be combined to benefit. The invention is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.
Claims (10)
1. An intelligent video system, the system comprising: the system comprises a first terminal, a second terminal and a display;
the second terminal is arranged at the far end of the conference room and connected with the display, and comprises a long-range camera which is used for acquiring a long-range image and transmitting the long-range image to the display for displaying;
the first terminal and the second terminal form a pairing relation, are arranged at the near end of a conference room, comprise close-range cameras and are used for acquiring close-range images in the direction of the sound source when the sound source is detected;
when the first terminal acquires the close-range image, the close-range image is sent to the display to be displayed;
and when receiving the close-range image sent by the first terminal, the display switches the displayed picture into the close-range image.
2. The system of claim 1, wherein the first terminal includes a display screen and acts as a console for the second terminal;
and when the display screen of the first terminal receives the touch control operation, generating touch control information and sending a control instruction to the second terminal.
3. The system of claim 1, wherein the second terminal acquires a distant view image when the sound source is not detected for a set time, and is switched to display the distant view image by the display.
4. The system of claim 1, wherein when the second terminal is abnormal, the first terminal acquires a close-up image and sends the close-up image to the display to switch to display the close-up image.
5. The system of claim 2, wherein the touch information is used to control initiating a call, muting, turning off a camera, hanging up, and/or recording;
the control instruction is used for controlling the second terminal to acquire the long-range image.
6. An intelligent control terminal, characterized in that, intelligent control terminal places in meeting room near-end, intelligent control includes: the system comprises a communication unit, a microphone and a camera, wherein the communication unit is paired with a second terminal arranged at the far end of a conference room and establishes communication connection with the second terminal;
the microphone is used for detecting a sound source and acquiring the direction of the sound source;
the camera is used for acquiring a close-range image in the direction of the sound source;
and the communication unit sends the close-range image collected by the camera to a display connected with the second terminal for displaying.
7. The intelligent control terminal according to claim 6, wherein the intelligent control terminal comprises a display screen as a console of the second terminal;
and when the display screen of the first terminal receives the touch control operation, generating touch control information and sending a control instruction to the second terminal.
8. The intelligent control terminal according to claim 6, wherein when the second terminal is detected to be abnormal, the intelligent control terminal acquires a close-range image and sends the close-range image to the display to switch and display the close-range image.
9. The intelligent control terminal according to claim 6, wherein in the pairing state, the intelligent control terminal and the second terminal may jointly form a dual-computer hot standby system, and when a situation that the second terminal drops and returns due to an abnormal working state occurs, the intelligent control terminal acquires a close-range image and sound and sends the close-range image and sound to a display connected to the second terminal so as to display the close-range image acquired by the intelligent control terminal and play the acquired sound;
10. the intelligent control terminal according to claim 9, wherein the intelligent control terminal continuously detects the operating state of the second terminal until the second terminal returns to the normal operating state.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011233668.2A CN112333416B (en) | 2018-09-21 | 2018-09-21 | Intelligent video system and intelligent control terminal |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011233668.2A CN112333416B (en) | 2018-09-21 | 2018-09-21 | Intelligent video system and intelligent control terminal |
| CN201811107962.1A CN109151370B (en) | 2018-09-21 | 2018-09-21 | Intelligent video system and intelligent control terminal |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811107962.1A Division CN109151370B (en) | 2018-09-21 | 2018-09-21 | Intelligent video system and intelligent control terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112333416A true CN112333416A (en) | 2021-02-05 |
| CN112333416B CN112333416B (en) | 2023-10-10 |
Family
ID=64823169
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011233668.2A Active CN112333416B (en) | 2018-09-21 | 2018-09-21 | Intelligent video system and intelligent control terminal |
| CN201811107962.1A Active CN109151370B (en) | 2018-09-21 | 2018-09-21 | Intelligent video system and intelligent control terminal |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811107962.1A Active CN109151370B (en) | 2018-09-21 | 2018-09-21 | Intelligent video system and intelligent control terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN112333416B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111586341A (en) * | 2020-05-20 | 2020-08-25 | 深圳随锐云网科技有限公司 | Shooting method and picture display method of video conference shooting device |
| CN112672099B (en) * | 2020-12-31 | 2023-11-17 | 深圳市潮流网络技术有限公司 | Subtitle data generating and presenting method, device, computing equipment and storage medium |
| CN115811595A (en) * | 2021-09-14 | 2023-03-17 | 中兴通讯股份有限公司 | Conference system |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102215375A (en) * | 2011-06-24 | 2011-10-12 | 中兴通讯股份有限公司 | Selection method and device for video source of sub-picture of multi-picture in multimedia conference |
| CN102256098A (en) * | 2010-05-18 | 2011-11-23 | 宝利通公司 | Videoconferencing endpoint having multiple voice-tracking cameras |
| CN102843540A (en) * | 2011-06-20 | 2012-12-26 | 宝利通公司 | Automatic camera selection for videoconference |
| US20130300820A1 (en) * | 2009-04-14 | 2013-11-14 | Huawei Device Co., Ltd. | Remote presenting system, device, and method |
| CN103595953A (en) * | 2013-11-14 | 2014-02-19 | 华为技术有限公司 | Method and device for controlling video shooting |
| CN103916723A (en) * | 2013-01-08 | 2014-07-09 | 联想(北京)有限公司 | Sound acquisition method and electronic equipment |
| CN107613243A (en) * | 2017-11-02 | 2018-01-19 | 深圳市裂石影音科技有限公司 | A kind of panoramic video recording arrangement and method for recording based on tone tracking |
| US20180098036A1 (en) * | 2016-10-04 | 2018-04-05 | Avaya Inc. | System and method for enhancing video conferencing experience via a moving camera |
| CN107948577A (en) * | 2017-12-26 | 2018-04-20 | 深圳市保千里电子有限公司 | A kind of method and its system of panorama video conference |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7612793B2 (en) * | 2005-09-07 | 2009-11-03 | Polycom, Inc. | Spatially correlated audio in multipoint videoconferencing |
| RS49875B (en) * | 2006-10-04 | 2008-08-07 | Micronasnit, | System and technique for hands-free voice communication using microphone array |
| US20150146078A1 (en) * | 2013-11-27 | 2015-05-28 | Cisco Technology, Inc. | Shift camera focus based on speaker position |
-
2018
- 2018-09-21 CN CN202011233668.2A patent/CN112333416B/en active Active
- 2018-09-21 CN CN201811107962.1A patent/CN109151370B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130300820A1 (en) * | 2009-04-14 | 2013-11-14 | Huawei Device Co., Ltd. | Remote presenting system, device, and method |
| CN102256098A (en) * | 2010-05-18 | 2011-11-23 | 宝利通公司 | Videoconferencing endpoint having multiple voice-tracking cameras |
| CN102843540A (en) * | 2011-06-20 | 2012-12-26 | 宝利通公司 | Automatic camera selection for videoconference |
| CN102215375A (en) * | 2011-06-24 | 2011-10-12 | 中兴通讯股份有限公司 | Selection method and device for video source of sub-picture of multi-picture in multimedia conference |
| CN103916723A (en) * | 2013-01-08 | 2014-07-09 | 联想(北京)有限公司 | Sound acquisition method and electronic equipment |
| CN103595953A (en) * | 2013-11-14 | 2014-02-19 | 华为技术有限公司 | Method and device for controlling video shooting |
| US20180098036A1 (en) * | 2016-10-04 | 2018-04-05 | Avaya Inc. | System and method for enhancing video conferencing experience via a moving camera |
| CN107613243A (en) * | 2017-11-02 | 2018-01-19 | 深圳市裂石影音科技有限公司 | A kind of panoramic video recording arrangement and method for recording based on tone tracking |
| CN107948577A (en) * | 2017-12-26 | 2018-04-20 | 深圳市保千里电子有限公司 | A kind of method and its system of panorama video conference |
Non-Patent Citations (1)
| Title |
|---|
| 王峰: "一种基于Cobranet技术的视频会议用声音采集和回放系统的设计", 《中国优秀硕士学位论文全文数据库》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112333416B (en) | 2023-10-10 |
| CN109151370B (en) | 2020-10-23 |
| CN109151370A (en) | 2019-01-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP1449369B1 (en) | A system and method for providing an awareness of remote people in the room during a videoconference | |
| US11641450B2 (en) | Apparatus for video communication | |
| JP6179834B1 (en) | Video conferencing equipment | |
| CN109151370B (en) | Intelligent video system and intelligent control terminal | |
| US20110216153A1 (en) | Digital conferencing for mobile devices | |
| AU2013236158A1 (en) | Teleconference system and teleconference terminal | |
| CN102131071B (en) | Method and device for video screen switching | |
| US10349008B2 (en) | Tool of mobile terminal and intelligent audio-video integration server | |
| US20140240446A1 (en) | Method for establishing video conference | |
| EP3223147A2 (en) | Method for accessing virtual desktop and mobile terminal | |
| JP6152961B1 (en) | Video conferencing equipment | |
| CN113630574A (en) | Video call method and terminal equipment | |
| CN105915521A (en) | Multi-party communication management method, device and terminal | |
| WO2017193805A1 (en) | Method and apparatus for realizing remote monitoring in conference television system | |
| JP2013243599A (en) | Television conference system | |
| GB2486457A (en) | System with two linked display devices | |
| CN113596382A (en) | Touch conference tablet computer with intelligent conference system | |
| US9485458B2 (en) | Data processing method and device | |
| CN214014372U (en) | Conference machine | |
| CN217546174U (en) | Intelligent conference system | |
| WO2023225869A1 (en) | Bluetooth device control method and apparatus, and device and storage medium | |
| US11363236B1 (en) | Projection-type video conference system | |
| CN109194918B (en) | Shooting system based on mobile carrier | |
| CN113507586A (en) | Intelligent conference system and information processing method for intelligent conference | |
| CN114938438A (en) | Method and system for remotely controlling switching of video conference client |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |