WO2006011192A1

WO2006011192A1 - Conference system

Info

Publication number: WO2006011192A1
Application number: PCT/JP2004/010626
Authority: WO
Inventors: Yukio Yokoyama; Koichi Hiramatsu; Takashi Honda
Original assignee: Mitsubishi Denki Kabushiki Kaisha
Priority date: 2004-07-26
Filing date: 2004-07-26
Publication date: 2006-02-02

Abstract

A projector (10) includes communication means (3) for transmitting/receiving information to/from another projector (10) connected thereto by wire or wireless; white board imaging means (1) for imaging characters or graphics, written on a white board, to generate an image signal; encoding means (2) for converting the image signal as generated by the board imaging means (1) to digital data to be transmitted to the other projector (10) via the communication means (3); decoding means (4) for decoding digital data received from the other projector (10) via the communication means (3); combining means (5) for positioning image information, obtained from an image signal as decoded by the decoding means (4), with image information outputted from an external device to produce a combined image; and projecting means (6) for projecting the combined image as produced by the combining means (5) onto the white board.

Description

Specification

Conference system

Technical field

[0001] The present invention relates to a conference system that makes it possible to share a whiteboard used in each venue in a remote conference such as a telephone conference and a video conference.

Background art

[0002] In a remote conference, some systems that share a whiteboard used at each venue have already been commercialized. For example, there are systems that use a touch sensor on a whiteboard, and systems that use a special pen. Also, there are some that use software to capture characters and figures written on the whiteboard on a personal computer.

[0003] For example, Patent Document 1 discloses an interactive display system using a touch sensor type screen as shown in FIG. This system includes a touch sensor type screen 81, an electronic touch screen controller 83, a nano nano computer 85, an overhead projector 87, and an LCD projector panel 89.

The touch sensor screen 81 has an output terminal connected to an input terminal of the electronic touch screen controller 83 installed in the card slot of the personal computer 85. The overhead projector 87 is directed so that an image is projected onto the surface of the touch sensor screen 81. The projected image is generated by the LCD projector panel 89 connected to the graphic output terminal of the personal computer 85.

[0005] The personal computer 85 executes an application such as a word processor and also executes a graphic translation routine. The personal computer executes a graphic translation routine to receive touch-sensitive screen force coordinate or position information, and in response, a description queue that shows information from the touch-sensitive screen relative to the description queue for the currently running application. Interact with each other.

[0006] Accordingly, during operation, when the user selectively applies pressure to the surface of the touch sensor screen 81 in the form of a dot or script line, the information is displayed on the touch sensor screen 81. In response to this, the image projected by the LCD projector panel 89 and the overhead projector 87 is switched to an image including the user script, and the user description on the touch sensor screen 81 interacts. Such information is reproduced at a rate sufficient to become a mold. Alternatively, the personal computer 85 emulates the operation of a mouse, light pen, digital command, etc. to interpret the user's touch input and in response to convey information to the executing application program.

[0007] A personal computer using the interactive display system as described above at a plurality of locations.

If the 85 is connected via a network, users in multiple locations can view the display at the same time, and any user in any location can input information by touching the screen 81. The touched information is interpreted by the connected personal computer 85 and immediately transmitted to other places via a modem or other network device, so that the display and application at each place can be simultaneously performed. Updated

[0008] FIG. 9 shows a system for loading handwritten characters / graphics on a whiteboard commercialized by Yoko Uchida into a personal computer. As shown in the figure, this system includes an interactive unit 90, a special pen 91, a USB cable 92, and a personal computer 93.

The interactive unit 90 receives a wireless signal emitted from the special pen 91, identifies the relative position and contact degree on the white board, and sends data to the personal computer 93 via the USB cable 92. The personal computer 93 executes software that receives and processes this data, and reproduces the image drawn on the whiteboard on the display screen.

Patent Document 1: Japanese Patent Application Laid-Open No. 6-110608

[0011] A conventional interactive display system for a remote conference is configured as described above. In the invention described in Patent Document 1, it is necessary to retain a dedicated function on the whiteboard. There was a problem that it could only be operated in a conference room where a white board was installed in advance. In addition, since it is necessary to use a special pen, there is a problem that it is inconvenient in terms of management and maintenance.

[0012] The present invention has been made to solve the above-described problems. The purpose is to provide a conference system that allows handwritten characters and figures written on a commonly used whiteboard to be shared between the local location and the other location.

Disclosure of the invention

[0013] The conference system according to the present invention shoots a communication means for exchanging information with another projector connected by projector power S, wired or wireless, and characters or figures written on the board. A board photographing means for generating an image signal, an encoding means for converting the image signal generated by the board photographing means into digital data for transmission to another projector via the communication means, and a communication means. Decoding means for decoding the digital data received by other projectors, and combining means for generating a composite image by aligning image information based on the image signal decoded by the decoding means with image information output from an external device; Projection means for projecting the composite image generated by the synthesis means onto the board.

[0014] This makes it possible to have a remote conference with a sense of realism by combining and displaying handwritten characters-graphics written on the board installed at the local location and the other location, and images from external devices. There is an effect.

[0015] In the conference system according to the present invention, the projector notifies the board photographing unit of an instruction to shoot a board, and notifies the projection unit of an instruction to stop projection while photographing is being performed. The imaging | photography control means to perform is provided.

[0016] As a result, only characters and figures newly hand-written on the board are photographed, so that it is possible to prevent the same character 'same figure from being drawn on the board. .

[0017] The conference system according to the present invention includes a switch that accepts a shooting instruction from a projector power user and notifies the shooting control means of a shooting instruction and a projection stop instruction according to the instruction.

[0018] By this, there is an effect that it is possible to prevent transmission of an image that is not desired to be shown to the other party or an unnecessary image.

In the conference system according to the present invention, the imaging control unit notifies the board imaging unit and the projection unit, respectively, of an imaging instruction and a projection stop instruction at regular time intervals. [0020] By this, there is an effect that the characters and figures written on the board can be projected in the latest state.

[0021] A conference system according to the present invention includes a printer connector serving as a connection unit with a projector-power printer, a print processing unit that acquires a composite image generated by the combining unit, and converts it into a format that can be output to the printer. It is equipped with.

[0022] This makes it possible to output the composite image during the meeting as a snapshot to the printer, which has the effect of eliminating the trouble of creating minutes and taking notes.

[0023] The conference system according to the present invention acquires the composite image generated by the projector S, the external media connector serving as a connection portion with the external media, and the synthesizing means, and is obtained as digital image data on the external media. It includes image storage processing means for converting to a storable format.

[0024] This has the effect that the composite image during the meeting can be converted into a file format as a snapshot and stored in various recording media, improving the reusability of information.

[0025] In the conference system according to the present invention, the board photographing means includes a marker means for projecting a boundary symbol that clearly indicates a photographing range on the board.

[0026] This has the effect of facilitating alignment and the like when generating a composite image.

[0027] The conference system according to the present invention includes a person photographing unit that photographs a person lined up from the side to the back of the projector power, generates a person image signal, and supplies the person image signal to the encoding unit. The person image signal is converted into digital data and notified to the communication means, and the synthesizing means generates a synthesized image by synthesizing the person image signals received from other projectors together with the image signal acquired from the decoding means and the external device. , Projecting to the projection means.

[0028] This eliminates the need for a separate display monitor, and has the effect of realizing downsizing, portability, and cost reduction by mounting the necessary functions on the projector in a one-in-one manner.

Brief Description of Drawings FIG. 1 is a block diagram showing a configuration of a conference system according to Embodiment 1 of the present invention.

FIG. 2 is a diagram illustrating a composite image according to Embodiment 1 of the present invention.

FIG. 3 is a block diagram showing a configuration of a conference system according to Embodiment 2 of the present invention.

FIG. 4 is a block diagram showing a configuration of a conference system according to Embodiment 3 of the present invention.

FIG. 5 is a diagram for explaining projection and shooting areas on a whiteboard.

FIG. 6 is a block diagram showing a configuration of a conference system according to Embodiment 4 of the present invention.

FIG. 7 is a diagram illustrating a composite image according to Embodiment 4 of the present invention.

FIG. 8 is a diagram for explaining a conventional interactive display system.

FIG. 9 is a diagram for explaining a conventional interactive display system.

BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, in order to describe the present invention in more detail, the best mode for carrying out the present invention will be described with reference to the accompanying drawings.

Embodiment 1.

FIG. 1 is a block diagram showing a configuration of a conference system according to Embodiment 1 of the present invention. As shown in the figure, the conference system has a projector 10, which is a whiteboard photographing means 1, an encoding means 2, a communication means 3, a decoding means 4, a synthesizing means 5, a projection means 6, an external device interface. Means 7, microphone 8 and speaker 9 are provided.

[0031] The conference system is used for a remote conference and is installed together with the whiteboard 20 in each conference hall. The whiteboard 20 may be a commonly used one. The projectors 10 installed in each conference hall can communicate with each other by wire or wireless via the communication means 3. In addition, an external device capable of outputting an image, such as a personal computer 30, is installed in each conference hall, and the projector 10 is used to capture an image displayed on the personal computer 30 and project it on the whiteboard 20.

[0032] The whiteboard photographing means 1 photographs a character 'figure handwritten on the whiteboard 20 during the meeting, generates an image signal, and supplies it to the encoding means 2. The microphone 8 collects audio during the conference, generates an audio signal, and supplies it to the encoding means 2. The encoding means 2 encodes the image signal from the whiteboard photographing means 1 and the audio signal from the microphone 8, that is, converts them into digital data in an appropriate format for transmission via the communication means 3. To supply.

[0033] The communication means 3 exchanges the encoded image data and audio data with the communication means 3 of the projector 10 installed at the meeting partner location. The decoding unit 4 decodes the data encoded from the projector 10 at the counterpart location received via the communication unit 3 and extracts the image signal and the audio signal. The speaker 9 reproduces the audio signal extracted by the decoding means 4. The external device interface means 7 exchanges data with the personal computer 30.

The synthesizing unit 5 aligns and synthesizes the image signal of the counterpart location extracted by the decoding unit 4 and the image signal acquired from the personal computer 30, generates a synthesized image, and supplies the synthesized image to the projecting unit 6. . The projection means 6 projects the acquired composite image on the whiteboard 20.

Next, the operation will be described.

Assume that an image serving as conference material is output on the computer 30 by an application. The external device interface means 7 acquires image signals from the personal computer 30 input in various interface formats such as RGB and composite. In general, data is exchanged with the personal computer 30 in the RGB format.

The communication means 3 receives the encoded data transmitted from the counterpart location and supplies it to the decoding means 4. The decoding unit 4 decodes the acquired encoded data, extracts an image signal, and supplies it to the synthesizing unit 5. The synthesizing unit 5 superimposes the image signal of the counterpart location decoded by the decoding unit 4 and the image signal from the external device interface unit 7 and converts them into one image signal to generate a synthesized image. The generated composite image is supplied to the projection means 6. The projection means 6 is composed of optical components such as a small liquid crystal panel and a lamp Z lens, and projects the composite image obtained from the composition means 5 onto the whiteboard 20.

[0037] On the other hand, the whiteboard photographing means 1 is composed of a CCD camera or the like, and takes a whole image including handwritten characters and figures written with a general oil-based pen on the whiteboard 20 and captures it as an image signal. . The microphone 8 collects audio during the conference and captures it as an audio signal. The whiteboard photographing means 1 and the microphone 8 supply the acquired image signal and audio signal to the encoding means 2 respectively. The encoding means 2 encodes the image signal and the audio signal. For example, audio signals are converted to MPEG1 Audio (MPEG-I Audio Layer-x) format, and image signals are converted to JPEG (Joint Photographic Expert Group) open format. [0038] The encoding means 2 notifies the communication means 3 of the encoded image data and audio data. The communication means 3 converts image data and audio data into a format suitable for the communication network to be used. For example, when IP (Internet Protocol) is used, input / output is performed via an Ethernet (registered trademark) interface on a UDP (User Datagram Protocol) packet.

[0039] When the projector 10 at the other party receives the image data and the audio data via the communication unit 3, it is decoded by the decoding unit 4 as described above, and the combining unit 5 combines the image information from the personal computer 30. Then, the projection means 6 projects a composite image on the whiteboard 20.

[0040] By the above operation, three types of information, that is, an image including characters and figures written on the whiteboard 20 at its own location, an image captured from the personal computer 30 and an image transmitted from the other location are displayed on the whiteboard 20. It is synthesized and displayed above.

FIG. 2 is a diagram showing an example of an image displayed on the whiteboard 20. Suppose you are meeting at two locations, location A and location B. As shown in the figure, the image 21 displayed on the computer at location A, the handwritten character 22 on the whiteboard at location A, and the composite image 24 composed of the handwritten character 23 on the whiteboard at location B is the location. Appears on each whiteboard 20 in A and Place B.

[0042] As described above, according to the first embodiment, the whiteboard photographing means 1 shoots and transmits the characters and figures written on the whiteboard 20 to the other place and receives the white received from the other place. Since the image on the board 20 is combined with the image from the PC 30 and projected onto the whiteboard 20, the whiteboard 20 can be shared between the user's location and the other location using the commonly used whiteboard 20. As a result, it is possible to achieve a remote conference with a rich sense of reality.

[0043] Embodiment 2.

. As shown in the figure, the projector 10 according to the second embodiment includes a switch 13 and a shutter control means 14 in addition to the configuration of FIG.

[0044] In the first embodiment, the whiteboard photographing means 1 captures the entire image projected by the projection means 6 and transmits it to the other party's location. Therefore, the handwritten image written on the whiteboard at its own location. The image-character was projected at the other location, and it was shot and sent to the local location. Therefore, since the same image is transmitted and received many times like a phenomenon with a mirror, the image actually written on the whiteboard and the image received and projected from the other place Will be displayed on the whiteboard.

Therefore, in order to prevent such a display shift, the projector 10 is provided with the switch 13 and the shutter control means 14 in the second embodiment. The user of the projector 10 presses the switch 13 at the timing when the whiteboard 20 is photographed. When the shutter control means 14 senses that the switch 13 has been pressed, the shutter control means 14 instructs the projection means 6 to stop projection. The stop time may be the time required for the whiteboard photographing means 1 to shoot the whiteboard 20.

At the same time, the shutter control unit 14 issues a shooting instruction to the whiteboard shooting unit 1. The whiteboard photographing means 1 performs photographing according to the instruction. The user may instruct switch 13 using a remote control (not shown).

[0047] As described above, according to the second embodiment, the projection unit 6 stops projection while the whiteboard photographing unit 1 photographs the whiteboard 20. Since only the characters and figures that are manually written on the screen are photographed, the same character can be prevented from being drawn on the whiteboard 20 in a shifted manner.

[0048] In addition, since the user can control the shooting timing manually, the projector 10 and the whiteboard 20 can be used when the user does not want to show the other person, do not take a picture, or write characters or figures on the whiteboard 20. It is possible to suppress the transmission of unnecessary images to the other party, such as a human image entering between the two.

[0049] Further, the shutter control means 14 may output a projection stop instruction and a photographing instruction at regular intervals, for example, 5 seconds. In this case, there is an effect that the latest information can be projected on the whiteboard 20 at both the local location and the remote location. In addition, a mode for manually controlling the shooting timing and a mode for automatically controlling the timing may be provided so that the user can switch between the modes.

[0050] Embodiment 3.

FIG. 4 is a block diagram showing a configuration of a conference system according to Embodiment 3 of the present invention. . As shown in the figure, the projector 10 according to the third embodiment includes a printing processing means 15, a printer connector 16, an image storage processing means 17, and a memory card connector 18 in addition to the configuration shown in FIG.

[0051] The print processing means 15 performs processing for printing the composite image acquired from the composition means 5 in response to a print instruction from the user. That is, when a synthesized image signal is obtained from the synthesizing means 5, it is converted into data in a format that can be received by a printer (not shown). The printer connector 16 connects the projector 10 and the printer according to the connection specifications with a general printer such as Centronitas, USB, etc., and outputs the data supplied from the print processing means 15 to the printer.

[0052] The image storage processing means 17 converts the composite image acquired from the composite means 5 into an image data format such as JPEG, BMP, etc., and is connected to various recording media such as memory cards (see FIG. (Not shown). The image storage processing means 17 reads the image data recorded on the memory card via the memory card connector 18, generates a composite image using it instead of the image notified from the personal computer 30, and projects it. You may let them. Here, we use general PC interfaces such as S, PCMCIA (Personal Computer Memory Card International Association), U¾B (Universal Serial Bus), etc., which have shown that image data is stored using a memory card as a recording medium. It goes without saying that image data can also be stored externally.

[0053] Here, since projector 10 includes whiteboard photographing means 1 and projection means 6 as separate means, the character 'figure written on whiteboard 20 and the image projected by projection means 6 are different. It is necessary to adjust the position. To write and project at the correct position, it is necessary to match the area for capturing characters and figures on the whiteboard 20 with the area to project.

FIG. 5 is a diagram showing an example of the whiteboard 20 projected by the projector 10. Figure

Although not shown in FIG. 4, the whiteboard photographing means 1 may be provided with a marker means. The marker means projects markers 50a, 50b, 50c and 50d at the four corners of the whiteboard 20, as shown in FIG. Those who write letters and figures on the whiteboard 20 should write in the area surrounded by each marker. In addition, the whiteboard photographing means 1 has an image recognition function. Then, the position of each marker is identified by image recognition, and the adjustment is performed so that the imaging area coincides with the area surrounded by each marker.

[0055] As described above, according to the third embodiment, the projector 10 includes the print processing means 15. Therefore, the composite image during the meeting can be output to the printer as a snapshot, and the minutes are recorded. The effect of saving the trouble of making and taking notes can be obtained. In addition, since the image storage processing means 17 is provided, the composite image during the meeting can be converted into a file format as a snapshot and stored in various recording media, improving the reusability of information. An effect is obtained. In addition, when the writing on the whiteboard 20 becomes complicated, the image storage processing means 17 reads the image from the recording medium, so that the previous state can be easily returned and projected onto the whiteboard 20. can get.

[0056] Further, since the whiteboard photographing means 1 is provided with the marker means, it is possible to obtain an effect of easy alignment and the like when generating a composite image.

[0057] Embodiment 4.

FIG. 6 is a block diagram showing a configuration of a conference system according to Embodiment 4 of the present invention. As shown in the figure, the projector 10 according to the fourth embodiment includes a human body photographing means 19 in addition to the configuration of FIG.

[0058] In a general meeting format, it is assumed that attendees line up from the side of the projector 10 to the back. Therefore, in the fourth embodiment, the person photographing means 19 for photographing a direction different from the photographing direction of the whiteboard photographing means 1 is provided in order to photograph the attendee. When the person photographing means 19 photographs the attendee, the person photographing means 19 generates an image signal and supplies it to the encoding means 2. The encoding means 2 encodes the image signal from the person photographing means 19 together with the image signal from the whiteboard photographing means 1 and the audio signal from the microphone 8, and transmits the encoded image signal to the counterpart location via the communication means 3.

[0059] On the other side, based on the received image signal, the synthesizing unit 5 combines the photographed image of the whiteboard 20 and the photographed image of the attendee to generate a composite image. FIG. 7 shows an example of a composite image. As shown in the figure, the synthesizing means 5 provides a partner display area 70 in the synthesized image 24 and displays the attendee's image in this area.

As described above, in the fourth embodiment, the person photographing means 19 is provided and the composite image 24 is displayed on the other side. A display area 70 is provided to display attendees, so there is no need for a separate display monitor, and the necessary functions are all-in-one mounted on the projector, enabling downsizing, portability and cost reduction. There is an effect that can be done.

[0061] Although the person photographing means 19 is provided separately from the whiteboard photographing means 1 in the above, it is possible to stop the attendee's photographing when capturing the whiteboard photographed image. If so, the whiteboard photographing means 1 and the person photographing means 19 can be configured as one means. It is also possible that the person photographing means 19 supplies the image signal to the synthesizing means 5 so that the image of the attendee at his / her place is displayed in the partner display area 70.

Industrial applicability

[0062] As described above, the conference system according to the present invention, when performing a teleconference or the like, shoots characters and figures written on a general whiteboard used in each conference hall, and transmits and receives them. It is suitable for sharing a whiteboard.

Claims

The scope of the claims

[1] Power of external equipment that can output images A conference system in which projectors that acquire and project image information and boards used to write text or graphics are installed in multiple remote locations

^ Shiore,

The projector is

Communication means for exchanging information with other projectors connected by wire or wireless;

A board photographing means for photographing a character or a figure written on the board and generating an image signal;

Encoding means for converting the image signal generated by the board photographing means into digital data for transmission to another projector via the communication means;

Decoding means for decoding digital data received by another projector via the communication means;

Image information based on the image signal decoded by the decoding means is aligned with image information that is also output from the external device power;

And a projecting unit that projects the composite image generated by the synthesizing unit onto the board.

[2] The projector includes an imaging control unit that notifies the board imaging unit of an instruction to shoot the board and notifies the projection unit of an instruction to stop projection while the imaging is being performed. The conference system according to claim 1, wherein:

3. The conference system according to claim 2, wherein the projector is provided with a switch that accepts a photographing instruction with user power and notifies the photographing control means of a photographing instruction and a projection stop instruction according to the instruction.

4. The conference system according to claim 2, wherein the photographing control means notifies the board photographing means and the projection means, respectively, of a photographing instruction and a projection stop instruction at regular intervals.

[5] The projector

A connector for the printer to be connected to the printer;

Acquires the composite image generated by the compositing means and converts it into a format that can be output to the printer The conference system according to claim 1, further comprising: a print processing unit configured to perform printing.

[6] The projector

An external media connector to be connected to the external media;

2. The conference system according to claim 1, further comprising image storage processing means for acquiring a composite image generated by the composite means and converting the composite image into a format that can be stored as digital image data in the external medium.

7. The conference system according to claim 1, wherein the board photographing means includes marker means for projecting a boundary symbol that clearly indicates a photographing range on the board.

[8] The projector includes person photographing means for photographing persons lined up from the side to the back of the projector, generating a person image signal, and supplying the person image signal to the encoding means.

The encoding means converts the person image signal into digital data and notifies the communication means;

The composite means generates a composite image by combining a human image signal received from another projector together with an image signal acquired from the decoding means and an external device, and causes the projection means to project the composite image. The conference system described.