JP5178549B2 - Information notification method and program - Google Patents

Description

  The present invention relates to an information notification method in a video processing system that uses a projection apparatus and a photographing apparatus at the same time. In particular, the present invention relates to an information notification method in a video conference system that uses a projector and a network camera at the same time.

  In recent years, video conference systems that perform bidirectional video communication using a network have been commercialized. In a video conference system, not only a cathode ray tube display or a liquid crystal display but also a projector that is convenient to carry and can display on a large screen is used as a device for displaying an image. In addition, as a device for capturing video, not only a camera directly connected to a video conference device but also a network camera with a high degree of freedom of installation is used.

  In general, a plurality of network cameras are arranged on a local area network (LAN) for monitoring purposes in addition to video conference purposes. Therefore, it is necessary to perform pairing by selecting a camera to be used in this video conference system from a plurality of network cameras on the LAN. By this pairing, the network address information of the network camera used in the video conference system is notified to the video conference apparatus.

  On the other hand, in a video conference system, it is important for communication to perform a conference or the like by matching the line of sight while looking at each other's faces. For example, a system that realizes line-of-sight matching by arranging a camera in a projection area of a projector has been proposed. In such a system, since the projection light of the projector can be applied to the camera, pairing using light is possible by placing information on the projection light.

  As a pairing technique using light, as disclosed in Patent Document 1, the network camera reads the network setting information converted into a two-dimensional bar code, thereby pairing the network camera with the display device. There is technology. Further, as disclosed in Patent Document 2, there is a technique for pairing a portable terminal and a display device by combining broadcast on a network and directional short-range wireless (including infrared communication and visible light communication). .

JP 2005-244268 A JP 2007-259385 A

  In Patent Document 1, it is assumed that a complicated pattern such as a two-dimensional barcode is transmitted by light. However, in a video conference system using a projector and a network camera, since the projection light from the projector is directly input to the network camera, the projection light is only reflected as a point light source in an image taken by the camera. For this reason, information cannot be sent on a complicated image pattern such as a two-dimensional barcode. Therefore, in order to transmit the entire network address information with the projection light, it is necessary to put the information in the time axis direction, and there is a problem that the blinking time of the projection light is long and annoying.

  In Patent Document 2, a display device that has received a projection pattern for pairing from a mobile terminal returns a packet with a special flag when responding to a search broadcast by the wireless LAN from the mobile terminal that is subsequently performed. . Since the display device does not know when the projection pattern for pairing is transmitted, there is a problem that the projection pattern light and the normal photographing target light cannot be clearly distinguished.

  The present invention is an information notification method between a video processing device including a projection device and a communication device connected to the projection device, and a photographing device connected to the video processing device via a network. A step of notifying the imaging device of a projection pattern irradiation start notification to the processing device; a step of setting the imaging device to a projection pattern decoding mode in response to the irradiation start notification; and The present invention includes a step of irradiating the imaging device with the encoded projection pattern light, and a step of decoding the projection pattern light if the imaging device is in the projection pattern decoding mode.

According to the present invention, since the pairing is performed before the dark region is created, the pairing using the light can be performed by applying the projection light of the projector to the camera.
Further, according to the present invention, since it is not necessary to notify the entire network address information with the projection pattern light, the information to be notified is reduced, and the blinking time of the projection light which is annoying for the conference participants can be shortened.
Furthermore, according to the present invention, it is possible to know when the projection pattern light is emitted by the projection pattern start notification, and thus it is possible to clearly distinguish the projection pattern light from the normal photographing target light.

(First embodiment)
FIG. 1 shows the system configuration of this embodiment. In the present embodiment, a video processing apparatus 600 including the projection apparatus 400 and a communication apparatus 200 connected thereto via a communication line 300, and a plurality of photographing apparatuses 100 connected thereto via a LAN 500 are provided. Use. Note that the LAN 500 is connected to a wide area network (WAN), and an opposite system similar to the present system is connected to the LAN 500. Further, by incorporating the function of the communication device 200 into the projection device 400, an integrated video processing device may be used. In this case, since the function of the communication line 300 can be regarded as being replaced by wiring inside the video processing apparatus, detailed description is omitted.

  FIG. 2 shows a detailed configuration diagram of each device in the present embodiment. The photographing apparatus 100 includes a photographing unit 101 and a network IF 105. The network IF 105 is connected to the LAN 500. Video data shot by the shooting unit 101 is encoded and transmitted from the network IF 105 to various devices on the LAN 500. Inside the photographing apparatus 100 is a program storage area 104. Specifically, these storage areas can be realized using a hard disk or a flash memory, but it goes without saying that the present invention does not depend on a specific storage medium. The CPU 102 and the RAM 103 exist, and the CPU 102 interprets and executes a program read from the program storage area 104 into the RAM 103, thereby enabling various controls and calculations in the apparatus, and encoding and transmission processing of video data.

  The communication device 200 is connected to a UI device 201 that is a user interface. Specifically, a light emitting diode and a liquid crystal panel for displaying the state of the apparatus and processing contents, a remote controller for giving an operation instruction to the apparatus, and various buttons are connected. Further, it has a display unit 203 and displays various video data and character data. Further, the network IF 208 is connected to the LAN 500. A plurality of photographing apparatuses 100 and at least one communication apparatus 200 are connected to the LAN 500. The video data sent from the LAN 500 is decoded and displayed on the display unit 203 and simultaneously sent from the external IF 206 to the projection device 400 through the communication line 300. Examples of implementation of the communication line 300 include DVI (Digital Visual Interface) and HDMI (High-Definition Multimedia Interface), but it goes without saying that the present invention does not depend on a specific connection method.

  Inside the communication device 200 is a program storage area 207. Specifically, these storage areas can be realized using a hard disk or a flash memory, but it goes without saying that the present invention does not depend on a specific storage medium. Also, there are a CPU 204 and a RAM 205, and various controls and calculations in the apparatus, video data decoding, and transmission / reception processing are possible by the CPU 204 interpreting and executing a program read from the program storage area 207 to the RAM 205.

  The projection apparatus 400 includes a projection unit 401 and an external IF 402. The external IF 402 is connected to the communication line 300. Video data input from the communication line 300 through the external IF 402 is sent to the projection unit 401 and projected onto a screen or the like.

FIG. 3 shows a sequence diagram at the time of pairing in the present embodiment. FIG. 3 is a sequence diagram of information notification when information is transmitted and received between the video processing device and the imaging device.
When the pairing process is started by operating the UI device 201 or the like of the communication apparatus 200, the video processing apparatus 600 first has a different value between the video processing apparatuses in the same subnet at Si100. A unique ID is calculated. In this embodiment, an IP (Internet Protocol) address is used as a network address, and the host part of the IP address is used as a unique ID as shown in FIG. A projection pattern irradiation start notification is broadcast on the LAN 500 using the calculated unique ID and the network address of the image processing apparatus 600 as a payload.

  Each imaging apparatus 100 that has received this irradiation start notification enters the projection pattern decoding mode. Further, the network address and unique ID of the video processing device 600 included as the payload of the irradiation start notification are stored in the RAM 103. It is assumed that the duration of this decoding mode is stored in the imaging apparatus 100 or included in the payload of the irradiation start notification.

  Next, the video processing apparatus 600 encodes the unique ID of the video processing apparatus into a projection pattern in Si200. In the present embodiment, as shown in FIG. 4B, after the host part is expressed by a quaternary number as shown in FIG. 4B, the correspondence between the numerical value and the color shown in FIG. 4C is used. Encode into a projection pattern whose color changes over time. As an encoding method, a method of changing the light projection interval and intensity in addition to changing the frequency of light like color may be used. The projection pattern data including the encoded unique ID is sent to the projection apparatus 400 and irradiated toward the photographing apparatus 100 (1).

  When receiving the projection pattern light in the projection pattern decoding mode, the photographing apparatus 100 (1) decodes the projection pattern and extracts the unique ID. On the other hand, since the projection pattern light does not reach the photographing apparatus 100 (2), the decoding process is not performed and the projection pattern decoding mode is ended as it is. In Sc100, the imaging apparatus 100 (1) compares the unique ID obtained by decoding the projection pattern with that at the time of irradiation start notification, and if they match, the network address at the time of irradiation start notification is set to the network of the video processing apparatus. Set to the local device as an address.

Here, FIG. 5 shows a flowchart of unique ID comparison and network address setting processing performed in Sc100. In FIG. 5, the unique ID obtained by decoding the projection pattern among the inputs is Ep, the unique ID included in the irradiation start notification is Eb, and the network address included in the irradiation start notification is Ab. . Also, let Ai be the network address of the video processing apparatus that is the output.
In Sc101, the imaging apparatus 100 (1) reads Eb and Ab from the RAM 103.
In Sc102, the image capturing apparatus 100 (1) determines whether Ep and Eb match. If they match, the process proceeds to Sc103, and if they do not match, the process ends. In Sc103, the imaging device 100 (1) substitutes Ab for Ai. In Sc104, the imaging device 100 (1) stores the network address of the video processing device in the RAM 103 of the imaging device 100 (1).

Next, returning to the flowchart of FIG. 3, the imaging apparatus 100 (1) notifies the video processing apparatus 600 of the network address of the imaging apparatus 100 (1) itself using the network address of the video processing apparatus 600 obtained in Sc 100. To do.
Through the above processing, the video processing apparatus 600 recognizes the network address of the imaging apparatus 100 (1), and the imaging apparatus 100 (1) can also recognize the network address of the video processing apparatus 600, so that pairing is completed. Thereafter, the video processing apparatus 600 starts dark region arrangement control at Si300.

  Here, the dark region arrangement control is control for setting the dark region 800 in a part of the projected image as shown in FIG. 6B and converting it into the projected image as shown in FIG. 7B. As a result, when there is no dark area arrangement control, as shown in FIG. 6C, the projected image is difficult to see due to the reflected light from the projector. It will be easy to see the video.

  In this embodiment, the host part of the IP address is used as the unique ID. However, the host name, the entire IP address, or the hash value of each host part may be used. The calculation algorithm of the unique ID in this case is shown in the flowchart of FIG. In the case of a hash value, there is a possibility of colliding with the unique ID of another video processing apparatus in the subnet, so a confirmation process for checking whether or not there is a collision is included as shown in Si102 to Si104. In this embodiment, visible light is used as the projection pattern light, but directional electromagnetic waves such as infrared rays and millimeter waves may be used.

(Second Embodiment)
FIG. 9 shows the system configuration of this embodiment. In the present embodiment, an image processing device 600 including the image capturing device 100 and a communication device 200 connected to the image capturing device 100 via a communication line 300, and a plurality of projection devices 400 connected to the image processing device 600 via a LAN 500 are provided. Use. Note that the LAN 500 is connected to a wide area network (WAN), and an opposite system similar to the present system is connected to the LAN 500. Further, by incorporating the function of the communication device 200 into the photographing device 100, an integrated video processing device may be used. In this case, since the function of the communication line 300 can be regarded as being replaced by wiring inside the video processing apparatus, detailed description is omitted.

  FIG. 10 shows a detailed configuration diagram of each device in the present embodiment. The photographing apparatus 100 includes a photographing unit 101 and an external IF 102. The external IF 102 is connected to the communication line 300. As an implementation example of the communication line 300, there is USB (Universal Serial Bus), but it goes without saying that the present invention does not depend on a specific connection method. Video data photographed by the photographing unit 101 is sent from the external IF 102 to the communication device 200 through the communication line 300. Further, the auxiliary illumination unit 103 that can be controlled by control data transmitted from the communication device 200 through the communication line 300 is provided. An example of the auxiliary illumination unit 103 is an infrared light or a strobe, but it goes without saying that the present invention does not depend on a specific illumination device.

  The communication device 200 is connected to a UI device 201 that is a user interface. Specifically, a light emitting diode and a liquid crystal panel for displaying the state of the apparatus and processing contents, a remote controller for giving an operation instruction to the apparatus, and various buttons are connected. Further, it has a display unit 203 and displays various video data and character data. Further, the network IF 208 is connected to the LAN 500. A plurality of projection devices 400 and at least one communication device 200 are connected to the LAN 500. The video data sent from the LAN 500 is decoded and displayed on the display unit 203 and simultaneously sent from the network IF 208 to the projection device 400 through the LAN 500.

  Inside the communication device 200 is a program storage area 207. Specifically, these storage areas can be realized using a hard disk or a flash memory, but it goes without saying that the present invention does not depend on a specific storage medium. In addition, the CPU 204 and the RAM 205 exist, and the CPU 204 interprets and executes the program read from the program storage area 207 to the RAM 205, thereby enabling various controls and calculations in the apparatus, video data encoding / decoding, and transmission / reception processing. It is.

The projection apparatus 400 includes a projection unit 401 and a network IF 406. The network IF 406 is connected to the LAN 500. Video data input from the LAN 500 through the network IF 406 is sent to the projection unit 401 and projected onto a screen or the like. Further, it has an image calibration photographing unit 405 used for auto-focusing, automatic wall color correction and the like of the projected image, and can be controlled by the CPU 403. Inside the projection apparatus 400 is a program storage area 404. Specifically, these storage areas can be realized using a hard disk or a flash memory, but it goes without saying that the present invention does not depend on a specific storage medium. Also, there are a CPU 403 and a RAM 402, and various controls and calculations in the apparatus and video data reception processing can be performed by the CPU 403 interpreting and executing a program read from the program storage area 404 into the RAM 402.
In this embodiment, the projection unit 401 in FIG. 2 can be regarded as the auxiliary illumination unit 103 in FIG. 10 and the image capturing unit 101 in FIG. 2 is replaced with the image calibration image capturing unit 405 in FIG. To do.
Of course, the present invention is also realized by a program installed in a computer.

It is a system configuration figure concerning a 1st embodiment. It is a detailed block diagram of each apparatus which concerns on 1st Embodiment. It is a sequence diagram at the time of pairing which concerns on 1st Embodiment. It is a figure which shows an example of the projection pattern at the time of using a host part as unique ID. It is a flowchart of a unique ID comparison and network address setting process. It is a figure for demonstrating the case without dark area | region arrangement | positioning control. It is a figure for demonstrating the case with dark area arrangement | positioning control. It is a flowchart of the calculation process of unique ID. It is a system configuration figure concerning a 2nd embodiment. It is a detailed block diagram of each apparatus which concerns on 2nd Embodiment.

100 photographing device 101 photographing unit 102 CPU
103 RAM
104 Program storage area 105 Network IF
200 Communication Device 201 UI Device 202 UI Control Unit 203 Display Unit 204 CPU
205 RAM
206 External IF
207 Program storage area 208 Network 400 Projector 401 Projector 402 External IF
600 Video processing device

Claims (3)

An information notification method between a video processing device composed of a projection device and a communication device connected thereto, and a photographing device connected to the video processing device via a network,
The image processing device notifying the imaging device of a projection pattern irradiation start notification;
Setting the imaging device in a projection pattern decoding mode in response to the irradiation start notification;
The image processing device irradiating a photographing device with projection pattern light in which information of the device is encoded;
And a step of decoding projection pattern light if the photographing apparatus is in a projection pattern decoding mode.   The information notification method according to claim 1, wherein the projection pattern light is any one of visible light, infrared light, and millimeter wave, which are directional electromagnetic waves. A program for causing a computer to execute information notification processing between a video processing device including a projection device and a communication device connected to the projection device, and a photographing device connected to the video processing device via a network. There,
The image processing device notifying the imaging device of a projection pattern irradiation start notification;
Setting the imaging device in a projection pattern decoding mode in response to the irradiation start notification;
The image processing device irradiating a photographing device with projection pattern light in which information of the device is encoded;
And a step of decoding projection pattern light when the photographing apparatus is in a projection pattern decoding mode.

Images