WO2017185486A1

WO2017185486A1 - Projector, conference system, and projector controlling method

Info

Publication number: WO2017185486A1
Application number: PCT/CN2016/085060
Authority: WO
Inventors: 张永亮
Original assignee: 中兴通讯股份有限公司
Priority date: 2016-04-29
Filing date: 2016-06-07
Publication date: 2017-11-02
Also published as: CN107333117A; CN107333117B

Abstract

A projector (902-1, 902-2), conference system, and projector controlling method. The projector (902-1, 902-2) comprises: a camera (102, 204) provided on a top portion of the projector (902-1, 902-2), for detecting a 360-degrees panoramic image within a visible range of the camera (102, 204); a communication component (104), connected to the camera (102, 204), for sending the image to a remote projector (902-2) and display sharing; and a main processor (106), connected to the camera (102, 204) and the communication component (104), for controlling an operation of the projector (902-1, 902-2). The invention addresses an issue in which the projector (902-1, 902-2) is unable to remotely share a displayed image content. The invention therefore allows sharing of the displayed image content of the projector (902-1, 902-2).

Description

Projection device, conference system, and projection device control method

The present application claims priority to Chinese Patent Application No. 201610284325.6, filed on Apr. 29, 2016, the entire disclosure of which is hereby incorporated by reference.

Technical field

The present invention relates to the field of communications, and in particular to a projection device, a conference system, and a projection device control method.

Background technique

In the existing conference room, a projection device is often provided, and the conference content (such as text, image and video) is projected and displayed by the projection device, so that the participants can intuitively share the conference content. However, at present, remote conferences mainly rely on remote videophones, but the screen content projected by the projection device cannot be shared.

Summary of the invention

The embodiment of the invention provides a projection device, a conference system and a projection device control method, so as to at least solve the problem that the screen content projected by the projection device cannot be shared in the related art.

According to an embodiment of the present invention, a projection apparatus includes: a camera disposed at a top of a projection device for detecting a 360-degree panoramic image within a field of view of the camera; and a communication component coupled to the camera for use in The above picture is sent to the remote projection device for shared display; the main processor is connected to the camera and the communication component for controlling the operation of the projection device.

Optionally, the distance between the position of the camera at the top of the projection device and the front end of the projection lens is less than or equal to a first predetermined threshold, wherein the lens of the camera protrudes, and the lens is higher than the plane of the top of the projection device. .

Optionally, the distance between the position of the camera at the top of the projection device and the front end of the projection lens is greater than or equal to a second predetermined threshold. The device further includes: a transmission device connected to the camera and disposed on the camera. The bottom of the lens is used to raise the height of the lens of the camera to the target height, wherein the target height is higher than the plane of the top of the projection device.

Optionally, the transmission device comprises at least one of: an ejection member for raising the height of the lens by ejection; and a rotating member for raising the height of the lens by the rotation.

Optionally, the device further includes: a gravity drape connected to the camera for detecting whether the camera is kept horizontal.

Optionally, the device further includes: a first audio collection component and a second audio collection component, configured to collect audio of an environment in which the projection device is located; a first sounding component and a second sounding component, where the projection device is located Play audio.

Optionally, the first sounding component is disposed on one side of the projection device; the second sounding component is disposed on the other side of the projection device; or the first sounding component and the second sounding component are disposed on the projection The same side of the device.

Optionally, a distance between the first audio collection component and the second audio collection component is not less than a third predetermined threshold; a distance between the first audio collection component and the first sounding component and the second sounding component The distance between the second audio collecting component and the first sounding component and the second sounding component is greater than the fourth predetermined threshold, respectively, wherein the third predetermined threshold is less than the fourth predetermined threshold. .

Optionally, the third predetermined threshold is 50 millimeters, and the fourth predetermined threshold is 14 centimeters.

According to another embodiment of the present invention, there is provided a conference system, comprising: a plurality of projection devices as described above, wherein a plurality of said projection devices include at least one proximal projection device and at least one remote projection device The plurality of pieces are less than a predetermined threshold.

Optionally, the method further includes: a remote controller for remotely controlling the projection device; and a display screen for displaying a screen projected by the projection device.

According to still another embodiment of the present invention, there is provided a projection apparatus control method comprising: acquiring a 360-degree panoramic picture detected by a camera disposed at a top of a projection apparatus in a field of view; transmitting the picture to a remote projection apparatus Make a shared display.

Optionally, the acquiring the 360-degree panoramic image detected by the camera disposed at the top of the projection device in the field of view includes: determining, by the first audio collection component and the second audio collection component, whether the audio of the environment of the projection device is collected; When the audio of the environment in which the projection device is located is collected, the position of the sound source that emits the audio is acquired; and the partial image in the panoramic picture is acquired according to the position of the sound source.

Optionally, the obtaining, according to the location of the sound source, the partial image in the panoramic image comprises: determining whether the duration of the audio output by the single sound source exceeds a predetermined duration when the sound source is a single sound source; and acquiring when the predetermined time duration is exceeded The position of the above-mentioned single sound source is a corresponding partial picture in the above-mentioned panoramic picture.

Optionally, the acquiring the partial image in the panoramic picture according to the position of the sound source includes: acquiring a position of the predetermined sound source when the sound source is a multi-sound source; and acquiring a partial screen corresponding to the position of the predetermined sound source in the panoramic screen.

Optionally, the obtaining the location of the predetermined sound source comprises at least one of: acquiring a location of a default sound source, wherein the default sound source is a sound source located in a default direction; and timing polling acquires a position of each of the plurality of sound sources.

Optionally, the acquiring the partial image in the panoramic image according to the position of the sound source includes: adjusting, when the camera is a rotating camera, adjusting the rotation of the rotating camera to align the sound source to obtain the partial image; or, in the camera In the case of the panoramic camera, the partial image acquired by the panoramic camera in the direction of the sound source is retrieved according to a predetermined algorithm.

Optionally, the acquiring the 360-degree panoramic image detected by the camera disposed at the top of the projection device in the field of view includes: sequentially acquiring each frame image in the panoramic image; or acquiring all the images in the panoramic image.

Optionally, the transmitting, by the foregoing, the sending, by the projection device, to the remote device, the sharing display comprises: receiving a control instruction; The above screen is sent to the remote projection device for shared display in response to the above control command.

Optionally, after determining, by the first audio collection component and the second audio collection component, whether the audio of the environment of the projection device is collected, the method further includes: determining, when the audio of the environment of the projection device is not collected, Whether the projection device of the end captures the audio of the environment; when the projection device of the remote device collects the audio of the environment, acquires the image detected by the camera on the remote projection device, and displays the above picture.

Optionally, after determining whether the remote projection device collects audio of the environment, the method further includes: displaying a default screen when the remote projection device does not collect audio of the environment; or, timing polling The pictures detected by the above-mentioned projection device and the camera on the remote projection device are respectively displayed.

According to still another embodiment of the present invention, a storage medium is also provided. The storage medium is configured to store program code for performing the steps of: acquiring a 360-degree panoramic view of the camera set at the top of the projection device within the field of view; transmitting the above-described screen to the remote projection device for shared display.

Optionally, the storage medium is further configured to store program code for performing the following steps: determining, by the first audio collection component and the second audio collection component, whether the audio of the environment where the projection device is located is collected; where the projection device is collected In the audio of the environment, the position of the sound source that emits the above audio is acquired; and the partial picture in the panoramic picture is acquired according to the position of the sound source.

According to the present invention, by providing a camera on the top of the projection device, a 360-degree panoramic image detected within the field of view of the camera is transmitted to the remote projection device through the communication component for shared display, thereby overcoming the prior art projection device. The screen content displayed by the projection cannot achieve the technical problem of sharing. Further, by using the camera and the communication component together, the sharing function is added for the smart projection device, and the operation steps of the remote conference can be simplified, and the conference can be established without complicated setup operations, thereby achieving the purpose of saving the conference time.

DRAWINGS

The drawings described herein are intended to provide a further understanding of the invention, and are intended to be a part of the invention. In the drawing:

1 is a schematic diagram of an alternative projection device in accordance with an embodiment of the present invention;

2 is a schematic diagram of another alternative projection device in accordance with an embodiment of the present invention;

3 is a schematic diagram of still another alternative projection device in accordance with an embodiment of the present invention;

4 is a schematic diagram of still another alternative projection device in accordance with an embodiment of the present invention;

FIG. 5 is a schematic diagram of still another alternative projection apparatus according to an embodiment of the present invention; FIG.

6 is a schematic diagram of still another alternative projection device in accordance with an embodiment of the present invention;

7 is a schematic diagram of still another alternative projection device in accordance with an embodiment of the present invention;

8 is a schematic diagram of still another alternative projection device in accordance with an embodiment of the present invention;

9 is a schematic diagram of an optional conference system in accordance with an embodiment of the present invention;

FIG. 10 is a flowchart of an optional projection device control method according to an embodiment of the present invention; FIG.

11 is a flow chart of another alternative projection device control method in accordance with an embodiment of the present invention.

detailed description

The invention will be described in detail below with reference to the drawings in conjunction with the embodiments. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.

It is to be understood that the terms "first", "second" and the like in the specification and claims of the present invention are used to distinguish similar objects, and are not necessarily used to describe a particular order or order.

Example 1

In this embodiment, a projection device is provided. FIG. 1 is a structural block diagram of a projection device according to an embodiment of the present invention. As shown in FIG. 1, the projection device includes:

1) a camera 102, disposed at the top of the projection device, for detecting a 360-degree panoramic image within the field of view of the camera;

2) a communication component 104, connected to the camera, for transmitting the screen to the remote projection device for shared display;

3) The main processor 106 is connected to the camera and the communication component for controlling the operation of the projection device.

Alternatively, in the present embodiment, the appearance of the above-described projection device may be, but is not limited to, the projection device 200 as shown in FIG. 2. Among them, the optomechanical lens 202 for projection is disposed at the front end of the projection device 200, and the camera 204 is disposed at the top of the projection device 200. The communication components may include, but are not limited to, a plurality of communication interfaces as shown in FIG. 2, such as video port 214, data port 216, headphone port 218, and charging port 220. In addition, the projection device 200 further includes a power on button 222 (provided at the back end opposite to the lens 202), an air inlet (the main air inlet 208 at the bottom, and a secondary air inlet 212 at the side), and an air outlet 206. And the speaker 210.

Optionally, in this embodiment, the main processor 106 may include, but is not limited to, a processing device of a microprocessor MCU or a programmable logic device (FPGA), etc., for controlling the rotation action and data collection of the camera 102, and also using Control communication components to implement communication functions. It will be understood by those skilled in the art that the structure shown in FIG. 2 is merely illustrative and does not limit the structure of the above electronic device.

Optionally, in the embodiment, the communication component 104 is configured to receive or transmit data via a network. Specific examples of the network described above may include a wired network, and may also include a wireless network. For example, it includes 2G (2nd generation, 2nd generation mobile communication), 3G (3rd generation, 3rd generation mobile communication), 4G LTE (4th Generation Long Term Evolution) radio frequency subsystem (LTE antenna) , RF power amplifier, RF transceiver), WIFI module (including antenna), Bluetooth module (including antenna). Specifically, the communication component 104 may include: a network interface controller (NIC) and different types of communication interfaces, wherein the network adapters may be connected to other network devices to communicate with the Internet.

It should be noted that, in this embodiment, the antenna receiving and transmitting high-frequency information of the wireless connection system (2G/3G/4G LTE radio frequency subsystem, WIFI module, and Bluetooth module) is down-converted/loaded high-frequency and demodulated/modulated. In/out processor.

Among them, the details are as follows:

1) 2G/3G/4G LTE radio frequency subsystem for transmitting and receiving 2G/3G and 4G LTE antenna information to realize wireless voice and high-speed data services, so that the projection device in this embodiment can access mobile at high speed in outdoor and outdoor situations. The interconnected system enables real-time voice calls, real-time sending and receiving of Internet information, and projection playback. Through the circuit board to access 2G, 3G, The RF subsystem of the 4G LTE wireless mobile communication network can only transmit and receive local information (although the Bluetooth module and the WIFI module can access the mobile Internet by means of a local router, which is still inherently limited by the need for local router switching) In the field of mobile communication applications, in the case of a high-brightness optomechanical module and a touch display interface, real-time remote voice and data interaction can be projected by means of a clearer and brighter projection display interface, which is more convenient and flexible to serve the user "intelligent". Various needs. Specifically, it is through the combination of optical projection and wireless voice and data functions to achieve indoor and outdoor areas, as well as business, family and other scenarios, portable, real-time access to mobile communication networks, mobile Internet, smart home networks, smart government enterprises. Net etc. and projection projection.

2) The WIFI module is used to access the WLAN (Wireless Local Area Networks) hotspot information, so that the projection device in this embodiment can quickly access the Internet in the indoor wireless router and the public wireless hotspot coverage area, and the projection is played in real time. Internet information.

3) The Bluetooth module is configured to receive the voice information of the projection device in this embodiment, so that the projection device in this embodiment can be used to listen to the corresponding audio with the Bluetooth headset when the individual views the streaming video. At the same time, the Bluetooth in this embodiment can also be used for wireless transmission of file usage.

Optionally, in the embodiment, the camera 102 can be, but is not limited to, a 360-degree panoramic camera capable of capturing a panoramic view of the conference room by acquiring a picture within the field of view of the camera. That is to say, the panoramic picture can be acquired through the above-mentioned camera on the projection device, and the partial picture in the panoramic picture can also be acquired. In the embodiment, when the camera captures the panoramic image, the camera may be, but is not limited to, directly acquiring the panoramic image, but may not be limited to obtaining the panoramic image by acquiring the partial image.

For example, the hemispherical camera rotation that can be rotated 360 degrees can be adjusted, or the fisheye bionic structure 360 degree panoramic camera can be adjusted to retrieve the corresponding partial picture and/or all pictures in the panoramic picture through system calculation. For example, according to the control instruction of the control device such as a remote controller, the hemispherical camera rotation that can be rotated 360 degrees can be adjusted, or the fisheye bionic structure can be adjusted. The 360-degree panoramic camera can calculate the corresponding partial image in the panoramic image through system calculation and/or All screens.

Optionally, in this embodiment, the foregoing camera includes at least one of the following:

1) A 360-degree hemispherical camera, a narrow-view camera fixed on a 360-degree convex hemispherical base, and 360-degree panoramic scanning detection through the rotation of the camera; the above cameras are not collected at the same time. All the picture information on the left and right, the panoramic picture is realized by multi-lens stitching and post-synthesis.

2) The 360-degree panoramic camera of the fisheye bionic structure can detect the 360-degree panoramic image without rotating, but it will capture the partial image capture of the fixed-point azimuth area according to the sound source and other detection conditions. All screen information before and after the one-time recording, no post-synthesis, and multi-lens stitching. The principle is based on bionics (fisheye structure) using physical optics spherical mirror transmission plus reflection principle to image 360 degrees horizontally and 180 degrees vertically, and then use corresponding software to pass orientation, resolution, field of view and distortion. The angle is converted and corrected, and the picture is presented in a manner that is familiar to the human eye. In addition, the 360-degree panoramic camera of the fisheye biomimetic structure uses a seamless stitching technique for the screen recording field subdivided according to the screen orientation value in the one-time recording of the screen information.

It should be noted that, in this embodiment, the above two types of cameras are micro-projection projector housings to ensure the overall industrial design fluency.

Optionally, in this embodiment, the location of the camera on the top of the projection device may include, but is not limited to, at least one of the following:

1) The distance between the position of the camera at the top of the projection device and the front end provided with the projection lens is less than or equal to a first predetermined threshold; that is, the top front position as shown in FIG. Here, the lens of the camera protrudes and the lens is higher than the plane of the top of the projection device. For example, a 360-degree panoramic camera provided with a fisheye bionic structure provided at the leading edge of the projection lens.

2) The distance between the position of the camera at the top of the projection device and the front end provided with the projection lens is greater than or equal to a second predetermined threshold. That is, as shown in Fig. 3, the top is at the center or at the rear end. Here, in order to ensure that the camera can detect the panoramic picture, it may be, but is not limited to, providing a transmission device connected to the camera for raising the height of the lens of the camera to the target height, wherein the target height is higher than the plane of the top of the projection device . For example, a rotating camera provided at the rear of the front end of the projection lens is provided.

It should be noted that, in this embodiment, the transmission device may include, but is not limited to, a plurality of different height adjustable devices, such as an ejection component that adjusts the height of the camera by using a spring force, and a rotating component that adjusts the height of the camera by using a spiral structure. .

Optionally, in this embodiment, the foregoing projection device may further include: but is not limited to: a first audio collection component and a second audio collection component, and a first sounding component and a second sounding component. The audio collecting component may be a microphone, and the sounding component may be a speaker.

Optionally, in this embodiment, the first sounding component and the second sounding component may be disposed on different sides of the projection device to achieve an enhanced stereo effect; or the same side of the projection device may be disposed to facilitate heat dissipation of the entire device. Effect. In addition, in the embodiment, the distance between the sound emitting component and the audio collecting component and the distance between the sounding component itself are optimized to achieve long-distance pickup, thereby improving the conference effect of the remote conference.

Specifically, in the example shown in FIG. 4 , the projection device in this embodiment is mainly composed of a optomechanical module 402 (Digital Micromirror Device), a circuit board 404, and a heat dissipation module 406 (including Separate heat sink metal fins), large-capacity battery 408, microphone 410 (Mic for Mic1 410-1 and Mic2 410-2, respectively) and speaker cabinet (includes two speakers, respectively speaker 210-1 and speaker 210) -2).

It should be noted that, in order to enable the battery to separately support the driving optical machine to play the projection for a long time, in the present embodiment, the large-capacity battery 408 is configured for the projection device.

Optionally, in this embodiment, the central processing unit, the optical processor, the audio plus decoder, the radio frequency module, the WIFI module/Bluetooth module, and various power management and signal switching devices are disposed on the circuit main board 404. The interfaces are also connected to the motherboard. However, it should be noted that some sub-boards will be added according to the layout, and some ports can also be placed on the sub-board. This embodiment does not limit this.

Among them, the audio part of the speaker and the microphone are placed in a variety of configurations, as shown in Figure 4, two speakers (speaker 210-1 and speaker 210-2) are placed together, located in the same speaker cabinet 210 (internal can be Separate two separate speakers); in addition, as shown in Figure 5, the two speakers (speaker 210-1 and speaker 210-2) can be placed at the front end of the projection device on both sides, at different positions Speaker speaker 210. What needs to be explained here is that The RF antenna required for the voice data service is placed on the speaker cabinet.

In order to further describe the organic connection between the above main modules, the internal hardware architecture of the projection device in this embodiment may be as shown in FIG. 6, and is composed of a main processor system, a wireless connection system, a optomechanical system, a video display system, an audio system, The power system and the external interface system are composed of:

1) The main processor system (main processor 106) includes a main processor and system program memory; wherein the main processor is in a core position, and each functional subsystem interacts with the processor in a data stream and a control information flow manner.

2) The wireless connection system includes 2G (2nd generation, 2nd generation mobile communication), 3G (3rd generation, 3rd generation mobile communication), 4G LTE (4th Generation Long Term Evolution) (LTE antenna, RF power amplifier, RF transceiver), WIFI module (including antenna), Bluetooth module (including antenna);

3) The optomechanical system is composed of a optomechanical module; wherein the optical system part of the optomechanical module is usually a DLP (Digital Lighting Processor) projection technology, and a laser or LED (light emitting diode) of a small size can be used. , light emitting diode) light source.

4) The video display system is composed of a video receiver and a video channel; wherein the video receiver respectively receives an internal streaming media information source from an external video port (may be, but not limited to, multiple channels) and a processor side, and has a main processor control The external video priority principle transforms the information source into image information that can be received by the optical machine, and is placed on the optical machine.

5) The audio system consists of an audio plus decoder, a speaker (two) and its speakers, a microphone (two) and a headphone channel;

6) The power system consists of a charging module, a power management module, a large-capacity battery, and a charging channel; wherein the power system is responsible for providing power supply and management of the entire system. The charging port receives the power of the external charging adapter, and charges the battery through the charging module. The optical power supply is directly powered by the charging adapter when the external charging adapter is connected, and is directly powered by the large-capacity battery when the external charging adapter is removed. The battery can also power the LTE RF power amplifier (via the charging module). The charging module also supplies power to the charging management module to step down a plurality of voltages to supply power to the entire system.

7) The external interface system (communication component 104) is composed of a video port and a data port, a charging port and a headphone port; wherein the data port is used for high-speed serial data interaction, and can be enhanced to have OTG (on the go, get rid of the original main From the limitations of the architecture, the end-to-end data transfer between devices is used to receive mouse, keyboard and mobile hard disk information.

Through the embodiment provided by the present application, by providing a camera on the top of the projection device, a 360-degree panoramic image detected within the field of view of the camera is transmitted to the remote projection device through the communication component for shared display, thereby overcoming the prior art. The technical problem of sharing the screen content displayed on the projection device cannot be realized. Further, by using the camera and the communication component together, the sharing function is added for the smart projection device, and the operation steps of the remote conference can be simplified, and the conference can be established without complicated setup operations, thereby achieving the purpose of saving the conference time.

As an alternative, the distance between the position of the camera on the top of the projection device and the front end provided with the projection lens is less than or equal to a first predetermined threshold, wherein the lens of the camera protrudes and the lens is higher than the plane of the top of the projection device.

Optionally, in this embodiment, a digital optical processor (DLP) projection technology, such as a laser or a light emitting diode (LED) that is miniaturized in size and size, may be used. The light source is projected onto the lens of the machine to obtain the projected image displayed.

Specifically, the following example will be described. For example, as shown in FIG. 7, the camera 204 is disposed at an edge position away from the front end of the optical lens 202. The lens surface of the camera 204 is slightly convex, but does not exceed the front plane of the entire projection device, and the lower portion of the camera 204 has a small natural inclination to a flat surface.

It should be noted that, in the embodiment, the camera 204 is preferably placed at the edge of the top of the projection device near the front end, so that the field of view of the camera caused by the tilting position when the projection device is working is blocked by the front edge.

With the embodiment provided by the present application, by setting the camera at a position where the distance between the top of the projection device and the front end provided with the projection lens is less than or equal to the first predetermined threshold, 360 degree surround recording of the conference environment by the camera is realized, Get a panoramic image of the conference environment.

As an alternative, the distance between the position of the camera on the top of the projection device and the front end of the projection lens is greater than or equal to a second predetermined threshold. The device further includes:

1) The transmission device is connected to the camera and is disposed at the bottom of the camera to raise the height of the lens of the camera to the target height, wherein the target height is higher than the plane of the top of the projection device.

It should be noted that, in this embodiment, the camera is placed at the middle or the back of the top of the projection device, and when the projection device is tilted, the camera can be ejected by the transmission device, thereby preventing the local field of view from being Covering effect.

Optionally, in the embodiment, the transmission device includes at least one of the following:

(1) an ejection member for raising the height of the lens by ejection;

(2) A rotating member for raising the height of the lens by rotation.

Specifically, the following example is used. For example, as shown in FIG. 8, the camera 204 raises the height of the lens of the camera to the target height through the transmission device 802, and the target height of the lens is higher than the plane of the top of the projection device.

For example, the transmission is exemplified by an ejection component. In this example, an ejection component can be disposed on the base of the camera 204 to automatically eject the ejection component at the beginning of the conference so that the camera 204 can be shielded from the edge of the projection device. Better record the conference site and get a panoramic view.

Through the embodiment provided by the present application, by providing a transmission device connected to the camera, the lens of the camera is prevented from being blocked by the edge of the projection device, affecting the field of view, thereby ensuring a panoramic image of the conference environment.

As an alternative, the device also includes:

1) Gravity overhang, connected to the camera, used to detect whether the camera is level.

Through the embodiment provided by the present application, by setting the gravity overhang connected with the camera, it is possible to detect whether the current camera is kept horizontal, so as to timely adjust the angle of the camera to ensure the accuracy of the detected image within the field of view of the camera. To avoid the distortion of the captured image.

As an alternative, the device also includes:

1) a first audio collection component and a second audio collection component, configured to collect audio of an environment in which the projection device is located;

2) The first sounding component and the second sounding component are used to play audio at the location of the projection device.

Optionally, in this embodiment, the first sounding component is disposed at one side of the projection device; the second sounding component is disposed at The other side of the projection device; or, the first sounding component and the second sounding component are disposed on the same side of the projection device. The audio collecting component may be a microphone, and the sounding component may be a speaker. Here, both speakers are in a sound chamber with a typical value of 30cc or more, and the speaker is driven with greater power and efficiency, which will achieve good conference sound effects.

Specifically, as shown in FIG. 4-5, as shown in FIG. 4, two speakers (speaker 210-1 and speaker 210-2) are placed in the same speaker cabinet 210 (the internal two separate speakers can be separated) )in. In addition, as shown in FIG. 5, two speakers (the speaker 210-1 and the speaker 210-2) may be placed at different positions on the both sides of the projection device, in the different speaker cabinets 210.

With the embodiment provided by the present application, the two speakers are disposed on the same side of the projection device, which will be more advantageous for the heat dissipation of the whole of the projection device; separating the two speakers on both sides will enhance the stereo effect to some extent.

As an optional solution, the distance between the first audio collection component and the second audio collection component meets a third predetermined threshold; the distance between the first audio collection component and the first sounding component and the second sounding component is greater than The fourth predetermined threshold, the distance between the second audio collecting component and the first sounding component and the second sounding component is greater than a fourth predetermined threshold, respectively; wherein the third predetermined threshold is less than the fourth predetermined threshold.

Optionally, in the embodiment, the third predetermined threshold is 50 mm and the fourth predetermined threshold is 14 cm.

Through the embodiment provided by the present application, the audio collecting component and the sounding component are configured according to the above distance, and the long-distance sound collecting function is realized, and the multi-person voice information within 10 meters can be clearly received, and in addition, the two sounding components can be effectively realized by setting two sounding components. Background noise cancellation.

It should be noted that each of the above modules may be implemented by software or hardware. For the latter, the foregoing may be implemented by, but not limited to, the foregoing modules are all located in the same processor; or, the above modules are in any combination. The forms are located in different processors.

Example 2

A conference system is provided in this embodiment. FIG. 9 is a structural block diagram of a conference system according to an embodiment of the present invention. As shown in FIG. 9, the conference system includes:

1) A plurality of projection devices, wherein the plurality of projection devices include at least one proximal projection device 902-1 and at least one remote projection device 902-2, the plurality being less than a predetermined threshold.

Optionally, in this embodiment, the foregoing conference system may be, but is not limited to, applied to a small conference system with fewer projection devices. When there are many projection devices, data processing for all projection devices can be implemented by, but not limited to, a peripheral server.

In addition, in the embodiment, by configuring a plurality of projection devices in the above embodiment in the conference system, the cameras in the field of view can be respectively acquired by the cameras capable of detecting the 360-degree panoramic view on the respective projection devices, thereby realizing the pair of images. Shared display of content.

For example, the near-end projection device 902-1 shares the detected image to the far-end projection device 902-2 through a camera capable of detecting a 360-degree panorama so that the far-end projection device can be synchronized with the near-end projection device. Display the same content, so that participants in different locations can visually see the content of the meeting and ensure the smooth progress of the meeting.

Optionally, in this embodiment, the method further includes:

1) Remote control for remotely controlling the projection device;

2) Display screen for displaying the projected image of the projection device.

It should be noted that, in this embodiment, the display screen may be, but is not limited to, a display screen for displaying the screen content projected by the projection device through the projection lens.

Through the embodiments provided by the present application, through the above plurality of projection devices, wherein each of the projection devices is provided with a camera capable of detecting a 360-degree panoramic view, thereby realizing shared display of the projected content in the conference system without performing complicated establishment. The conference process operates to simplify the operation of the conference. Further, sharing the screen content through the projection device will further improve the conference effect and achieve a good conference function.

Example 3

In this embodiment, a projection device control method is provided. FIG. 10 is a flowchart of a projection device control method according to an embodiment of the present invention. As shown in FIG. 10, the flow includes the following steps:

S1002: acquiring a 360-degree panoramic image detected by a camera disposed at a top of the projection device in a field of view;

S1004: Send the screen to the remote projection device for shared display.

Optionally, in the embodiment, the foregoing projection device control method may be, but is not limited to, the projection device 200 as shown in FIG. 2 . Among them, the optomechanical lens 202 for projection is disposed at the front end of the projection device 200, and the camera 204 is disposed at the top of the projection device 200. The communication components may include, but are not limited to, a plurality of communication interfaces as shown in FIG. 2, such as video port 214, data port 216, headphone port 218, and charging port 220. In addition, the projection device 200 further includes a power on button 222 (provided at the back end opposite to the lens 202), an air inlet (the main air inlet 208 at the bottom, and a secondary air inlet 212 at the side), and an air outlet 206. And the speaker 210.

2) The 360-degree panoramic camera of the fisheye bionic structure can detect the 360-degree panoramic image without rotation, but the local image image acquisition of the fixed-point azimuth area is called according to the sound source and other detection conditions. All screen information before and after the one-time recording, no post-synthesis, and multi-lens stitching. The principle is based on bionics (fisheye structure) using physical optics spherical mirror transmission plus reflection principle to image 360 degrees horizontally and 180 degrees vertically, and then use corresponding software to pass orientation, resolution, field of view and distortion. The angle is converted and corrected, and the picture is presented in a manner that is familiar to the human eye. In addition, the 360-degree panoramic camera of the fisheye bionic structure uses a seamless stitching technique for image capturing fields subdivided according to image orientation values in one-time recording of image information.

Optionally, in the embodiment, the camera 102 can be, but is not limited to, a camera capable of detecting a 360-degree panoramic view, and a panoramic view of the conference room is realized by acquiring a picture in a field of view of the camera. That is to say, the panoramic picture can be acquired through the above-mentioned camera on the projection device, and the partial picture in the panoramic picture can also be acquired. In the embodiment, when the camera captures the panoramic image, the camera may, but is not limited to, directly acquiring the panoramic image, but may It is not limited to splicing to obtain a panoramic picture by acquiring a partial picture.

2) The distance between the position of the camera at the top of the projection device and the front end provided with the projection lens is greater than or equal to a second predetermined threshold. That is, as shown in Fig. 3, the top is at the center or at the rear end. Here, in order to ensure that the camera can capture the panoramic picture, it may be, but is not limited to, providing a transmission device connected to the camera for raising the height of the lens of the camera to the target height, wherein the target height is higher than the plane of the top of the projection device . For example, a rotating camera provided at the rear of the front end of the projection lens is provided.

Specifically, it is described in conjunction with FIG. 11:

S1102. The near-end projection device initiates a conference call according to multiple remote conference room IP addresses.

S1104, the near-end projection device and the camera on each remote projection device simultaneously initiate a self-test;

S1106: report each other according to the self-checking structure, and remove the abnormality;

S1108, at the beginning of the meeting, each camera separately reports the picture in the field of view;

S1110, automatically captures a conference speaker for a certain period of time according to the setting, controls the camera to perform directional recording and upload and share;

S1112, the camera intervenes through the remote control, voice control or application interface to adjust the content of the recording at any time (including projection content, etc.)

As an alternative, obtaining a 360-degree panoramic view of the camera disposed at the top of the projection device within the field of view includes:

S1, determining, by the first audio collection component and the second audio collection component, whether the audio of the environment where the projection device is located is collected;

S2, when acquiring the audio of the environment where the projection device is located, acquiring the location of the sound source that emits the audio;

S3: Acquire a partial picture in the panoramic picture according to the position of the sound source.

It should be noted that, in this embodiment, for a projection device, the position of the sound source of the audio may be sent according to the audio position collected by the audio collection component, thereby controlling the lens of the camera set on the adjustment projection device to be aligned with the sound source, and acquiring Partial picture in the panorama.

In addition, in this embodiment, the conference system can determine the projection device that needs to share the image according to the audio collected by the audio collection component, so as to share the image detected by the camera on the projection device to other devices in the conference system.

Through the embodiment provided by the present application, the content to be shared is determined according to the location of the sound source that emits audio in the environment where the projection device is located, thereby realizing the panoramic sharing of the conference and improving the conference effect.

As an optional solution, obtaining a partial picture in the panoramic picture according to the location of the sound source includes:

S1, when the sound source is a single sound source, determining whether the duration of the audio output by the single sound source exceeds a predetermined time length;

S2. When the predetermined time duration is exceeded, the local image corresponding to the position of the single sound source in the panoramic picture is acquired.

It should be noted that, in this embodiment, in order to ensure the accuracy of the adjustment, a predetermined duration is set, and it is determined whether a fixed speaker is speaking by determining whether the length of the emitted audio exceeds a predetermined duration. That is to say, when the duration of the audio generation exceeds the predetermined length of time, it can be determined that the speaker is emitting a voice, and further, the lens of the camera can be adjusted (to accurately capture the speaker. That is, to control the rotatable 360-degree panoramic view) The camera rotates to achieve direct orientation of the speaker's directivity, or control the fisheye bionic structure 360 degree panoramic camera to retrieve partial images in the panoramic image through system calculation, and within the captured field of view Content is shared with other devices in the conferencing system.

Through the embodiment provided by the present application, it is ensured that the accuracy of the camera is adjusted to avoid erroneous operation by judging whether the duration of the audio output by the single sound source exceeds a predetermined length of time.

S1, when the sound source is a multi-sound source, acquiring a position of the predetermined sound source;

S2. Acquire a corresponding partial image of the position of the predetermined sound source in the panoramic picture.

Optionally, in this embodiment, acquiring the location of the predetermined sound source includes at least one of the following:

1) Get the location of the default source, where the default source is the source in the default direction;

2) Timed polling to obtain the position of each source in the multi-source.

Through the embodiment provided by the present application, when the projection device detects the multi-tone source, the position of the predetermined sound source can be acquired according to a predetermined rule, thereby ensuring that the projection device can display the corresponding content.

1) When the camera is a rotating camera, adjust the rotation camera to align the sound source to obtain a partial picture; or

For example, a hemispherical camera that can rotate 360 degrees. A narrow-view camera fixed to a rotatable 360-degree convex hemispherical undercarriage enables 360-degree panoramic scanning detection through the rotation of such a camera.

2) When the camera is a panoramic camera, the partial image acquired by the panoramic camera in the direction of the sound source is retrieved according to a predetermined algorithm.

For example, a 360-degree panoramic camera with a fisheye bionic structure can acquire a 360-degree panoramic image without rotation, but a local image capture of a fixed-point azimuth region is retrieved according to sound source and other detection conditions. All screen information before and after the one-time recording, no post-synthesis, and multi-lens stitching. The principle is based on bionics (fisheye structure) using physical optics spherical mirror transmission plus reflection principle to image 360 degrees horizontally and 180 degrees vertically, and then use corresponding software to pass orientation, resolution, field of view and distortion. The angle is converted and corrected, and the picture is presented in a manner that is familiar to the human eye.

1) sequentially acquiring each frame image in the panoramic picture; or

2) Get all the images in the panorama.

Optionally, in this embodiment, when the camera captures the panoramic image, the camera may be, but is not limited to, directly acquiring the panoramic image, and may be, but not limited to, acquiring the partial image to obtain the panoramic image. That is to say, when the panoramic image is acquired, the image of one frame and one frame may be acquired for sharing, and all the images may be acquired and shared. This is not limited in this embodiment.

As an alternative, sending the picture to the remote projection device for shared display includes:

S1, receiving a control instruction;

S2. The screen is sent to the remote projection device for shared display in response to the control command.

Through the embodiment provided by the present application, the control of the projection device may be corresponding to adjusting the camera after automatically detecting the position of the sound source (adjusting the rotation of the hemispherical camera that can rotate 360 degrees, or adjusting the fisheye bionic structure 360 degree panoramic camera through the system) Calculate the corresponding partial screen and/or all screens in the panoramic screen. You can also adjust the camera according to the control commands of the remote control and other control devices (adjust the rotation of the hemispherical camera that can rotate 360 degrees, or adjust the fisheye bionics) The structured 360 degree panoramic camera retrieves the corresponding partial picture and/or all pictures in the panoramic picture by system calculation. Further, control of sharing of picture content can also be implemented in response to control instructions.

As an optional solution, after determining whether the audio of the environment where the projection device is located is collected by the first audio collection component and the second audio collection component, the method further includes:

S1, when the audio of the environment where the projection device is located is not collected, determine whether the remote projection device collects audio of the environment;

S2: When the remote projection device collects the audio of the environment, acquires the image detected by the camera on the remote projection device, and shares the display screen.

It should be noted that, in this embodiment, the near-end projection device can be, but is not limited to, being a control center in the conference system, and sharing the multiple projection devices (including the near-end projection device and the remote projection device). control.

Through the embodiments provided by the present application, not only the near-end projection device can be shared to the remote projection device, but also the near-end projection device can control the sharing of the image detected by the remote projection device to the near-end projection device display. Thereby, the screen content collected by each projection device is shared in the conference system.

As an optional solution, after determining whether the remote projection device collects the audio of the environment, the method further includes:

S1: When the remote projection device does not collect the audio of the environment, the default screen is displayed; or, the timing polling respectively displays the images detected by the camera on the projection device and the remote projection device.

Through the embodiment provided by the present application, the near-end projection device can be used as a control center, and each of the projection devices can be controlled to display a default screen, and the detected images in the current field of view of each of the projection devices can be separately displayed by a timed polling manner. Flexible control of multiple projection devices in the conference system.

Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware, but in many cases, the former is A better implementation. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, The optical disc includes a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, or a network device, etc.) to perform the methods described in various embodiments of the present invention.

Example 4

Embodiments of the present invention also provide a storage medium. Optionally, in the embodiment, the foregoing storage medium may be configured to store program code for performing the following steps:

S1, acquiring a 360-degree panoramic image detected by the camera disposed at the top of the projection device in the field of view;

S2, the screen is sent to the remote projection device for shared display.

Optionally, the storage medium is further arranged to store program code for performing the following steps:

S2, when collecting the audio of the environment where the projection device is located, acquiring the location of the sound source that sends the audio;

S3. Acquire a partial picture in the panoramic picture according to the location of the sound source.

Optionally, in this embodiment, the foregoing storage medium may include, but not limited to, a USB flash drive, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, and a magnetic memory. A variety of media that can store program code, such as a disc or a disc.

For example, the specific examples in this embodiment may refer to the examples described in the foregoing embodiments and the optional embodiments, and details are not described herein again.

It will be apparent to those skilled in the art that the various modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein. The steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software.

The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Industrial applicability

The projection device, the conference system and the projection device control method of the present application realize a 360-degree panoramic image detected within a field of view of the camera by using a camera on the top of the projection device, and are transmitted to the remote projection device through the communication component for shared display. Further, the technical problem that the screen content projected and displayed on the projection device cannot be shared in the prior art is overcome. Further, by using the camera and the communication component together, the sharing function is added for the smart projection device, and the operation steps of the remote conference can be simplified, and the conference can be established without complicated setup operations, thereby achieving the purpose of saving the conference time.

Claims

A projection device, comprising:

a camera disposed on the top of the projection device for detecting a 360-degree panoramic image within the field of view of the camera;

a communication component, connected to the camera, for transmitting the picture to a remote projection device for shared display;

And a main processor connected to the camera and the communication component for controlling operation of the projection device.
The projection apparatus according to claim 1, wherein a distance between a position of the camera at a top of the projection device and a front end provided with a projection lens is equal to or less than a first predetermined threshold, wherein a lens protrusion of the camera, And the lens is higher than the plane of the top of the projection device.
The projection apparatus according to claim 1, wherein the distance between the position of the camera at the top of the projection device and the front end provided with the projection lens is greater than or equal to a second predetermined threshold, wherein the device further comprises:

And a transmission device connected to the camera and disposed at a bottom of the camera for raising a height of the lens of the camera to a target height, wherein the target height is higher than a plane of the top of the projection device.
The projection apparatus of claim 3, wherein the transmission comprises at least one of:

An ejection member for raising the height of the lens by ejection;

a rotating member for raising the height of the lens by rotation.
The projection device of claim 1, wherein the device further comprises:

A gravity drape is coupled to the camera for detecting whether the camera is level.
The projection device of claim 1, wherein the device further comprises:

a first audio collection component and a second audio collection component, configured to collect audio of an environment in which the projection device is located;

The first sounding component and the second sounding component are configured to play audio at a position of the projection device.
The projection apparatus according to claim 6, wherein

The first sounding component is disposed at one side of the projection device; the second sounding component is disposed at another side of the projection device; or

The first sounding component and the second sounding component are disposed on the same side of the projection device.
A projection apparatus according to claim 6 or 7, wherein

The distance between the first audio collection component and the second audio collection component is not less than a third predetermined threshold;

a distance between the first audio collecting component and the first sounding component and the second sounding component is greater than a fourth predetermined threshold, respectively, the second audio collecting component and the first sounding component and the first The distance between the second sounding components is greater than the fourth predetermined threshold, respectively;

The third predetermined threshold is less than the fourth predetermined threshold.
The projection apparatus according to claim 8, wherein said third predetermined threshold is 50 mm and said fourth predetermined threshold is 14 cm.
A conference system, comprising: a plurality of projection devices according to any one of claims 1 to 9, Wherein the plurality of projection devices include at least one proximal projection device and at least one remote projection device, the plurality of being less than a predetermined threshold.
The system of claim 10 further comprising:

a remote controller for remotely controlling the projection device;

a display screen for displaying a picture projected by the projection device.
A projection device control method, comprising:

Obtaining a 360-degree panoramic view of the camera set at the top of the projection device within the field of view;

The picture is sent to a remote projection device for shared display.
The method according to claim 12, wherein said acquiring a 360-degree panoramic picture detected by a camera disposed at a top of the projection device within a field of view comprises:

Determining whether the audio of the environment where the projection device is located is collected by the first audio collection component and the second audio collection component;

Obtaining a location of a sound source that issues the audio when acquiring audio of an environment in which the projection device is located;

And acquiring a partial picture in the panoramic picture according to the location of the sound source.
The method according to claim 13, wherein the obtaining a partial picture in the panoramic picture according to a location of the sound source comprises:

When the sound source is a single sound source, determining whether the duration of the audio output by the single sound source exceeds a predetermined duration;

When the predetermined length of time is exceeded, the position of the single sound source is acquired in a corresponding partial picture in the panoramic picture.
The method according to claim 13, wherein the obtaining a partial picture in the panoramic picture according to a location of the sound source comprises:

Acquiring the position of the predetermined sound source when the sound source is a multi-sound source;

Obtaining a partial partial picture corresponding to the location of the predetermined sound source in the panoramic picture.
The method of claim 15, wherein the obtaining the location of the predetermined sound source comprises at least one of the following:

Obtaining a location of a default sound source, wherein the default sound source is a sound source located in a default direction;

Timing polling acquires the position of each of the plurality of sound sources.
The method according to any one of claims 13 to 16, wherein the obtaining a partial picture in the panoramic picture according to a location of the sound source comprises:

Adjusting, when the camera is a rotating camera, rotating the rotating camera to align the sound source to obtain the partial image; or

When the camera is a panoramic camera, the partial image acquired by the panoramic camera in the direction of the sound source is retrieved according to a predetermined algorithm.
The method according to claim 12, wherein said acquiring a camera disposed at the top of the projection device is in view The 360-degree panoramic view of the wild range detection includes:

Acquiring each frame image in the panoramic picture in turn; or

All images in the panoramic picture are acquired.
The method of claim 13, wherein the transmitting the picture to the remote projection device for sharing display comprises:

Receiving a control command;

The screen is sent to the remote projection device for shared display in response to the control command.
The method according to claim 13, wherein after the determining, by the first audio collecting component and the second audio collecting component, whether the audio of the environment in which the projection device is located is collected, the method further comprises:

When the audio of the environment where the projection device is located is not collected, determining whether the remote projection device collects audio of the environment;

When the remote projection device collects the audio of the environment, the screen detected by the camera on the remote projection device is acquired, and the screen is shared and displayed.
The method of claim 20, wherein after the determining whether the remote projection device collects audio of the environment, the method further comprises:

When the projection device of the remote end does not collect audio of the environment, the default screen is displayed; or, the timing polling respectively displays the images detected by the camera on the projection device and the projection device on the remote end.