JP2006128951A - Remote drawing device and system and remote drawing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a remote drawing device which enables a user to share an image output of a brought information processor with a remote place and to write to the image output by only connecting the image output. <P>SOLUTION: A remote drawing device 100 at a point A includes; a display device 103 for displaying an image from a brought mobile terminal 102 in a display area C1; a drawing information conversion device 105 for converting drawing information acquired from a remote drawing device at a point B through a network, to such a form that it can be displayed on a drawn graphic display device 106; a drawn graphic display device 106 for displaying a prescribed image in the display area C1 on the basis of drawing information converted by the drawing information conversion device 105; a photographing device 107 for photographing the display area C1; and an image transmission device 108 for transmitting a video signal of an image photographed by the photographing device 107 to the remote drawing device at the point B through the network. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a remote drawing apparatus, a system, and a remote drawing method.

  2. Description of the Related Art Conventionally, there has been proposed a drawing apparatus capable of performing a conference or the like by connecting a carry-in terminal to a large screen display device. The following has been proposed as such a drawing apparatus.

  FIG. 1 is a diagram for explaining an outline of an electronic blackboard system described in Patent Document 1. In FIG. As shown in FIG. 1, the electronic blackboard system 1 includes a large screen display device 2, an electronic input device 3, and a personal computer (PC) 4. A signal from the electronic input device 3 is sent to the PC 4, The PC 4 converts it into a video signal, and the graphic written with the pen is displayed on the display device 2, so that the conference participants can see the graphic input from the electronic input device 3.

  FIG. 2 is a diagram for explaining an outline of an electronic blackboard system that can share information between remote locations described in Patent Document 2. As shown in FIG. 2, the electronic blackboard system 11 includes a remote drawing device 12A at a point A and a remote drawing device 12B at a point B. Each of the remote drawing devices 12A and 12B includes large-screen display devices 13A and 13B, electronic input devices 14A and 14B, and PCs 15A and 15B, and the graphic drawn at the point A is drawn on the screen at the point B. You can hold a meeting with a shared whiteboard.

JP 2001-142425 A JP 2003-131803 A

  However, in the electronic blackboard systems disclosed in Patent Documents 1 and 2, it is necessary to connect the PC to the electronic input device when the slide material stored in the PC is output to the screen or shared with a remote place. Therefore, it is necessary to install a dedicated device driver for the electronic input device on the PC. Further, in the electronic blackboard system described in Patent Document 2, in order to send a PC screen to another remote PC via a network, it is necessary to install dedicated screen transmission software on the PC. Since it takes time to install these software, there is a problem that it is impossible to display slide materials or send the screen to a remote place immediately after connecting the PC.

  Therefore, the present invention has been made in view of the above problems, and a remote drawing apparatus that can be shared and written with a remote place by simply connecting the video output of the information processing apparatus brought in, It is an object to provide a system and a remote drawing method.

  In order to solve the above problems, the present invention provides a first display means for displaying a video from an information processing device in a predetermined display area, and a predetermined video based on information acquired from outside via a network. A remote drawing apparatus comprising: second display means for displaying in the display area; photographing means for photographing the display area; and transmission means for transmitting a video signal of a video photographed by the photographing means to the outside via a network. It is. According to the present invention, information acquired from the outside is displayed on the display area, the display area is photographed by the photographing means, and the video photographed by the photographing means is transmitted to the outside. You can share and write with a remote location simply by connecting the.

  The present invention relates to a video signal acquired from an information processing device and a synthesizing unit that synthesizes information acquired from outside via a network, and a predetermined video is displayed in a predetermined display area based on the video signal synthesized by the synthesizing unit. A remote drawing apparatus comprising: a display means for displaying the image; a photographing means for photographing the display area; and a transmission means for transmitting a video signal of a video photographed by the photographing means to the outside via a network. According to the present invention, information acquired from the outside is synthesized with the video signal from the information processing apparatus, the synthesized video is displayed in a predetermined display area, and the display area of the first display means is photographed by the photographing means. Since the video is transmitted to the outside, it is possible to share and write to a remote place simply by connecting the video output of the information processing apparatus brought in.

  The present invention provides transmission means for transmitting drawing information input from a predetermined input means to the outside via a network, video information acquired from a predetermined information processing apparatus, information acquired from the outside via a network, and A remote drawing apparatus comprising: a combining unit that combines drawing information input from an input unit; and a display unit that displays a predetermined image based on a video signal combined by the combining unit. According to the present invention, the video signal acquired from the predetermined information processing apparatus is combined with the information acquired from the outside via the network and the drawing information input from the input means, and based on the combined video signal By displaying a predetermined video, it is possible to share and write with a remote place simply by connecting the video output of the information processing apparatus brought in.

  The remote drawing apparatus of the present invention further includes conversion means for converting the information acquired from the outside into a format that can be displayed. According to the present invention, by converting information acquired from the outside into a format that can be displayed on the display means, for example, a video image captured by a camera can be displayed from a projector.

  The remote drawing apparatus of the present invention further captures a video signal from the information processing apparatus, and displays black or uniform color when the information processing apparatus is not connected or when no video signal is output from the information processing apparatus. Acquisition means for outputting the video signal. According to the present invention, when an information processing apparatus is not connected or a video signal is not output from the information processing apparatus, a black or uniform color video signal is output, thereby clearing information acquired from the outside. Can be displayed.

  The remote drawing apparatus of the present invention further includes a transmission means for transmitting a video signal from the information processing apparatus to the outside. According to the present invention, by transmitting the video information from the information processing apparatus to the outside, a similar video can be displayed even on an external remote drawing apparatus.

  The transmission means transmits a message indicating that the video signal is not output to the outside or that there is no video signal when the information processing device is not connected or a video signal is not output from the information processing device. It is preferable to do this. According to the present invention, a remote drawing apparatus at a remote location can know that there is no video signal to be displayed.

  The remote drawing apparatus of the present invention further includes coordinate conversion means for converting the coordinates of information acquired from the outside via the network using the coordinates of the video imaged by the imaging means. According to the present invention, the coordinates of the information acquired from the outside via the network are converted using the coordinates of the image captured by the imaging means, so that the coordinates of the image captured by the imaging means are acquired from the outside. Since correspondence with the coordinates of information can be taken, information from the outside can be displayed at an appropriate position.

  The first display unit, the second display unit or the display unit is preferably a video projector.

  Each of the first display means, the second display means or the display means is preferably a rear projection type video projector.

  The photographing means is preferably a camera having at least one function of pan, tilt and zoom.

  Panning, tilting and zooming of the photographing means can be controlled via a network. According to the present invention, panning, tilting, and zooming of the photographing unit can be remotely controlled via a network.

  The photographing unit is configured to have a wide-angle camera capable of photographing the display area of the display unit and a field angle corresponding to the rectangle when a part of the image of the wide-angle camera is designated by a rectangle on a predetermined information processing apparatus. Preferably, the camera is controlled by panning, tilting or zooming. According to the present invention, when a part of a wide-angle camera image is designated by a rectangle on a terminal, pan, tilt, or zoom control can be performed so that the pan, tilt, or zoom camera has an angle of view corresponding to the rectangle. it can.

  Preferably, the conversion means outputs a black video signal when there is no drawing information to be converted. According to the present invention, when there is no information to be converted, the conversion means outputs a black image on one side, and displays the drawn figure portion in the designated color, thereby clearing the image from the display means. Can be projected.

  It is preferable that the coordinates of the respective pixels of the first display means or the second display means match. According to the present invention, since the first display means or the second display means is installed and adjusted so that the coordinates of the respective pixels coincide with each other, the graphic from the remote place is displayed on the video from the information processing apparatus. Can be accurately stacked. The first and second display means and the camera may be installed or zoom adjusted so that the display area of the first display means ≦ the shooting area of the camera ≦ the display area of the second display means.

  Preferably, the photographing means automatically adjusts the aperture, gain or shutter speed.

  The photographing unit preferably adjusts the shutter speed before the aperture or gain when the aperture, gain or shutter speed is automatically adjusted. Since the photographing means shoots a fixed object, there is no need to worry about blurring, so that the aperture or gain can be adjusted with priority.

  The remote drawing apparatus of the present invention further calculates a parameter of the aperture, gain, shutter speed, display brightness of the display means or display brightness of the remote drawing apparatus according to the brightness of the image displayed on the display means. And adjusting means for controlling and adjusting. The video signal of the information processing apparatus is preferably transmitted by a video cable or a radio signal.

  The remote drawing apparatus of the present invention further includes an input means for inputting coordinates by touching the display area. According to the present invention, it is possible to input coordinates by detecting that the pen or the hand is in contact with the display surface by the sensor installed in the display means.

  The display area is preferably a material that can be directly written or erased with a pen. According to the present invention, since the display area can be written with an ink pen, the user who is present can write intuitively.

  The display area is preferably made of metal to which a magnet can adhere. According to the present invention, it is possible to share the contents of a paper document that has been brought into the display area C1 of the whiteboard 101 and write it from a remote location.

  The display means displays a drawing method selection button. According to the present invention, since the display means displays the drawing method selection button, the drawing method can be selected by operating the input means.

  The remote drawing apparatus of the present invention further includes a selection button capable of selecting a drawing method. According to the present invention, the user can select a drawing method by the display device by depressing a drawing method selection button.

  Preferably, the transmission means transmits a video signal when a change occurs in the video to be transmitted.

  The present invention relates to the remote drawing device, a conversion means in a format capable of displaying a video signal transmitted from the remote drawing device, a display means for displaying a predetermined video based on the video signal converted by the conversion means, and a predetermined And a second remote drawing apparatus including transmission means for transmitting drawing information input from the input means to the remote drawing apparatus. ADVANTAGE OF THE INVENTION According to this invention, the system which can be shared and written with a remote place can be provided only by connecting the video output of the brought-in information processing apparatus.

  The display means preferably displays buttons for controlling pan, tilt, and zoom of the camera. According to the present invention, since the display means displays buttons for controlling pan, tilt, and zoom of the camera, it is possible to control the pan, tilt, and zoom of the camera by operating with the input device.

  The system of the present invention further comprises buttons for controlling camera pan, tilt and zoom. According to the present invention, the user can perform panning, tilting, and zooming control by pressing the camera.

  The present invention relates to the remote drawing device, first conversion means for visualizing a video signal transmitted from the remote drawing device, and transmission means for transmitting drawing information from a predetermined input means to the remote drawing device. Second conversion means for converting the drawing information acquired from the remote drawing apparatus into a format that can be displayed; the drawing information from the input means and the second conversion means into the video signal converted by the first conversion means; And a second remote drawing apparatus including a combining unit that combines the drawing information converted in step (b) and a display unit that displays a predetermined image based on the video signal combined by the combining unit. ADVANTAGE OF THE INVENTION According to this invention, the system which can be shared and written with a remote place can be provided only by connecting the video output of the brought-in information processing apparatus.

  Preferably, the first converting means outputs a white or uniform color video signal to the synthesizing means when receiving a message indicating that the video signal has not been transmitted or that there is no video signal.

  The system of the present invention further includes a server that relays transmission and reception of the video signal and the drawing information.

  The system of the present invention further includes a server that stores the video signal, the drawing information, and attribute information thereof, and transmits the stored data in response to a request.

  The system of the present invention includes a central server that manages a transmission source and a transmission destination of the video signal and the drawing information, and changes the transmission source and the transmission destination according to a request.

  The system of the present invention includes a server that synthesizes video signals sent from a plurality of points into one video. According to the present invention, the video signals sent from a plurality of points are combined into one video and transmitted to all the points, so that the video at a plurality of points can be viewed at a time.

  The present invention provides a first display step of displaying a video from the information processing device in a predetermined display area from the first display means, and a second video based on information acquired from the outside via a network. A second display step for displaying from the display means on the display area; a photographing step for photographing the display area; and a transmission step for transmitting the video signal of the video photographed in the photographing step to the outside via a network. Is a remote drawing method characterized by According to the present invention, information acquired from the outside is displayed on the display area, the display area is photographed by the photographing means, and the video photographed by the photographing means is transmitted to the outside. You can share and write with a remote location simply by connecting the.

  The present invention relates to a synthesis step of synthesizing information acquired from outside via a network with a video signal acquired from an information processing apparatus, and a predetermined video based on the video signal synthesized in the synthesis step. A remote drawing method including: a display step for displaying the image; a photographing step for photographing the display region; and a transmission step for transmitting a video signal of the video photographed in the photographing step to the outside via a network. According to the present invention, information acquired from the outside is synthesized with the video signal from the information processing apparatus, the synthesized video is displayed in a predetermined display area, and the display area of the first display means is photographed by the photographing means. Since the video is transmitted to the outside, it is possible to share and write to a remote place simply by connecting the video output of the information processing apparatus brought in.

  The present invention provides a transmission step of transmitting drawing information input from a predetermined input means to the outside via a network, a video signal acquired from a predetermined information processing apparatus, information acquired from the outside via a network, A remote drawing method including a combining step of combining drawing information input from an input unit and a display step of displaying a predetermined image based on the image signal combined in the combining step. According to the present invention, the video signal acquired from the predetermined information processing apparatus is combined with the information acquired from the outside via the network and the drawing information input from the input means, and based on the combined video signal By displaying a predetermined video, it is possible to share and write with a remote place simply by connecting the video output of the information processing apparatus brought in.

  According to the present invention, it is possible to provide a remote drawing apparatus, a system, and a remote drawing method that can be shared and written with a remote place simply by connecting the video output of the information processing apparatus brought in.

  Hereinafter, the best mode for carrying out the present invention will be described.

  [First Embodiment] FIG. 3 is a system configuration diagram according to the first embodiment. As shown in FIG. 3, the system 50 includes a remote drawing device 100 at a point A and a remote drawing device 200 at a point B, which are connected via a network N. FIG. 4 is a block diagram of the remote drawing apparatus 100 at the point A. FIG. 5 is a block diagram of the remote drawing apparatus 200 at the point B.

  As shown in FIG. 4, the remote drawing device 100 at the point A includes a whiteboard 101, a portable terminal 102, a display device 103, a coordinate conversion device 104, a drawing information conversion device 105, a drawing figure display device 106, and a photographing device 107. The video transmission device 108 and the adjustment device 109 are provided. As shown in FIG. 5, the remote drawing device 200 includes a display device 201, an input device 202, a drawing information transmission device 203, a video conversion device 204, and a button 205.

  The remote drawing device 100 at the point A shares video with the remote drawing device 200 at the point B. The display area C1 of the whiteboard 101 is made of, for example, metal so that a substance or a magnet that can be directly written and erased with an ink pen can be adsorbed. Thus, since the display area C1 of the whiteboard 101 can be written with an ink pen, the user who is present can intuitively write a figure or the like. Also, a paper document that has been brought in can be shared and written from a remote location simply by pasting it onto the display area C1 of the whiteboard 101 using a magnet.

  The carry-in portable terminal 102 is brought in by a user and is composed of, for example, a PC, a video, a mobile phone, and the like, and outputs a predetermined video signal D1 to the display device 103. Here, the video signal of the portable terminal 102 is transmitted to the display device 102 by a video cable or a radio signal. The display device 103 is configured by a video projector, for example, and displays a video signal from the portable terminal 102 on the display area C1 of the whiteboard 101. The display device 103 may be a rear projection type video projector.

The coordinate conversion device 104 converts the coordinates of the drawing information D2 acquired from the remote drawing device 200 at the point B via the network, using the coordinates of the video imaged by the imaging device 107. For example, the coordinate conversion device 104 converts the camera coordinates (X ₁ , Y ₁ ) to the projector coordinates (X ₂ , Y ₂ ). The drawing information conversion device 105 converts the drawing information acquired from the remote drawing device 200 at the point B into a format that can be displayed on the drawing graphic display device 106. Specifically, the drawing information conversion device 105 converts vector data composed of numerical data into data that can be displayed by a projector, for example.

  When drawing information is not sent from the remote drawing device 200 at the point B, the drawing information conversion device 105 outputs a black image signal for one side and outputs a video signal of the designated color for the portion of the drawing figure. The drawing graphic display device 106 is constituted by, for example, a video projector, and displays a predetermined image on the display area C1 based on information acquired from the remote drawing device 200 at the point B via the network. The drawing information conversion device 105 Is displayed on the display area C1 of the whiteboard. The drawing figure display device 106 may be, for example, a rear projection type video projector. The display device 103, the drawing graphic display device 106, and the photographing device 107 may be installed or zoom adjusted so that the display area of the display device 103 ≦ the shooting region of the photographing device 107 ≦ the display region of the drawing graphic display device 106.

  The imaging device 107 is configured by a camera capable of panning, tilting, and zooming, for example, and images the display area C1 of the whiteboard 101. Panning, tilting, and zooming of the photographing apparatus 107 can be remotely controlled from the remote drawing apparatus 200 at the point B over the network. The photographing device 107 is composed of two cameras, a wide-angle camera capable of photographing the entire display area C1 of the whiteboard 101 and a camera capable of panning, tilting, and zooming, and the wide-angle camera on the terminal of the remote drawing device 200 at the point B. When a part of the image is designated by a rectangle, pan, tilt, and zoom can be controlled so that the camera has an angle of view corresponding to the rectangle. The imaging device 107 can automatically adjust the aperture, gain, or shutter speed. In addition, the photographing apparatus 107 adjusts the shutter speed earlier than the aperture or gain when automatically adjusting the aperture, gain, or shutter speed.

  The video transmission device 108 transmits the video signal D3 of the video imaged by the imaging device 107 to the remote drawing device 200 at the point B via the network. The adjustment device 109 calculates and controls parameters of the aperture, gain, shutter speed of the photographing device 107, display brightness of the display device 103, and display brightness of the drawing figure display device 106 according to the brightness of the image displayed on the display device 103. To do. The coordinate conversion device 104, the drawing information conversion device 105, the video transmission device 108, and the adjustment device 109 are configured by one or more personal computers, and these are connected to a network.

  Next, the remote drawing apparatus 200 at the point B will be described. The remote drawing device 200 at the point B displays the video D3 sent from the remote drawing device 100 at the point A. The display device 201 is configured by a display, for example, and displays an image captured by the imaging device 107 of the remote drawing device 100 at the point A. The input device 202 is for inputting drawing information. The drawing information transmitting device 203 transmits the drawing information D2 input from the input device 202 to the remote drawing device 100 at the point A. Thereby, the drawing information D2 can be reproduced by the remote drawing apparatus 100 at the point A. The video conversion device 204 converts the video signal of the video D3 transmitted from the remote drawing device at the point A into a format that can be displayed on the display device 201 that is a display. Accordingly, a predetermined video can be displayed from the display device 201 based on the video signal converted by the video conversion device 204. The display device 201 displays buttons for controlling pan, tilt, and zoom of the camera of the remote drawing device at the point A. A button 205 is a button for controlling pan, tilt, and zoom of the camera at the point A. The camera at the point A can be controlled using these buttons. Note that the video transmission device 108 may transmit a video signal when a change occurs in the video to be transmitted. Similarly, the drawing information transmitting device 203 may transmit drawing data only when drawing is performed by the user.

  Next, the operation of the system according to the first embodiment will be described. FIG. 6 is an operation flowchart when displaying the video of the portable mobile terminal according to the first embodiment. FIG. 7 is an operation flowchart for displaying drawing data from a remote location. FIG. 8 is an operation flowchart for photographing with a camera, sending it to a remote place, and displaying it. When displaying the video of the portable portable terminal 102, the portable portable terminal 102 is brought in by the user and connected to the display device 103 in step S11 shown in FIG. In step S <b> 12, the display device 103 displays a predetermined video on the display area C <b> 1 of the whiteboard 101 based on the video signal D <b> 1 from the carry-in portable terminal 102.

  When displaying drawing data from a remote location, the drawing information transmitting device 203 of the remote drawing device 200 at the point B displays the drawing information D2 input from the input device 202 as the remote drawing at the point A in step S21 shown in FIG. Transmit to device 100. In step S <b> 22, the coordinate conversion device 104 converts the coordinates of the drawing information D <b> 2 acquired from the remote drawing device 200 at the point B via the network using the coordinates of the video imaged by the imaging device 107.

  In step S 23, the drawing information conversion device 105 converts the drawing information D 2 acquired from the remote drawing device 200 at the point B into a format that can be displayed on the drawing graphic display device 106. In step S24, the drawing figure display device 106 displays the video signal output from the drawing information conversion device 105 in the display area C1 of the whiteboard. As a result, at the point A, the drawing figure input by the remote drawing device 200 is projected onto the whiteboard 101 of FIG. 4, and this drawing figure can be viewed.

  When the image is captured by the camera, sent to a remote location, and displayed, the imaging device 107 captures the display area C1 of the whiteboard 101 in step S31 of FIG. In step S32, the video transmission device 108 transmits the video signal D3 of the video imaged by the imaging device 107 to the remote drawing device 200 at the point B via the network. The video conversion device 204 at the point B converts the video signal D3 of the video transmitted from the remote drawing device 100 at the point A into a format that can be displayed on the display device 201 that is a display. Accordingly, a predetermined video can be displayed from the display device 201 based on the video signal converted by the video conversion device 204.

  In this way, it is possible to draw on the video (carrying PC video + remote graphic drawing) sent from a remote location by the input device and reflect this on the remote display device. As a result, by simply connecting the video output of the portable terminal 102 to the display device 103, the video can be shared by the point A and the point B and can be written from a remote place.

  [Second Embodiment] Next, a second embodiment will be described. FIG. 9 is a block diagram of the remote drawing apparatus 300 at the point A according to the second embodiment. As shown in FIG. 9, the remote drawing device 300 includes a whiteboard 301, a portable terminal 302, a video acquisition device 303, a coordinate conversion device 304, a drawing information conversion device 305, a video composition device 306, a display device 307, a photographing device 308, A video transmission device 309 and an adjustment device 310 are provided. In addition, since the remote drawing apparatus of the point B is the same as 1st Embodiment here, description is abbreviate | omitted.

  The remote drawing device 300 at the point A shares video with the remote drawing device 200 at the point B. The carry-in portable terminal 302 is brought in by the user and is composed of, for example, a PC, a video, a mobile phone, and the like, and outputs a predetermined video signal D1 to the video acquisition device 303. The video signal of the portable terminal 302 is transmitted to the video acquisition device 303 by a video cable or a radio signal. The display area C2 of the whiteboard 301 is made of metal so that a substance or a magnet that can be directly written and erased with an ink pen can be adsorbed. Since the display area C2 of the whiteboard 301 can be written with an ink pen, the user who is present can write intuitively. In addition, a paper document that has been brought in can be shared and written from a remote location by simply pasting it onto the display area C2 of the whiteboard 301 using a magnet.

  The video acquisition device 303 captures video from the mobile terminal 302 that is brought in. The video acquisition device 303 outputs a black or uniform video signal when the portable mobile terminal 302 is not connected to the video acquisition device 303 or when the video signal is not output from the mobile mobile terminal 302.

  The coordinate conversion device 304 uses the coordinates of the video imaged by the imaging device 308 to convert the coordinates of the drawing information D2 acquired from the remote drawing device 200 at the point B via the network. The drawing information conversion device 305 converts the drawing information acquired from the remote drawing device 200 at the point B into a format that can be displayed on the display device 307. The video composition device 306 superimposes the video D2 output from the drawing information conversion device 305 on the video D1 acquired by the video acquisition device 303. The display device 307 is configured by a video projector, for example, and displays a predetermined video based on the video signal from the video synthesis device 306. Note that the display device 307 may be a rear projection type video projector.

  The imaging device 308 is configured by, for example, a camera capable of panning, tilting, and zooming, and captures the display area C2 of the whiteboard 301. Panning, tilting, and zooming of the image capturing device 308 can be remotely controlled from the remote drawing device 200 at the point B through the network. The photographing device 308 includes two cameras, a wide-angle camera capable of photographing the entire display area C2 of the whiteboard 301 and a camera capable of panning, tilting, and zooming. When a part of the image is designated by a rectangle, the pan, tilt, and zoom can be controlled so that the camera has an angle of view corresponding to the rectangle. The photographing device 308 automatically adjusts the aperture, gain, and shutter speed. For automatic adjustment of the aperture, gain, and shutter speed of the photographing apparatus 308, it is preferable to prioritize the aperture and gain and adjust the shutter speed first.

  The video transmission device 309 transmits the video signal D3 of the video imaged by the imaging device 308 to the remote drawing device 200 at the point B via the network. The adjusting device 310 calculates and controls parameters of the aperture, gain, shutter speed, and display brightness of the display device 307 according to the brightness of the image displayed on the display device 307. The drawing information conversion device 305, the coordinate conversion device 304, the video transmission device 309, and the adjustment device 310 are configured by one or more personal computers connected to a network, for example.

  Next, the operation of the system according to the second embodiment will be described. The portable terminal 302 is brought in by the user and connected to the video acquisition device 303. The video acquisition device 303 sends the video signal D 1 of the video from the carry-in portable terminal 302 to the video synthesis device 306. The drawing information transmission device 203 of the remote drawing device 200 at the point B transmits the drawing information D2 input from the input device 202 to the remote drawing device 300 at the point A. The coordinate conversion device 304 uses the coordinates of the video imaged by the imaging device 308 to convert the coordinates of the drawing information D2 acquired from the remote drawing device 200 at the point B via the network. The drawing information conversion device 305 converts the drawing information D2 acquired from the remote drawing device 200 at the point B into a format that can be displayed on the display device 307.

  The video composition device 306 superimposes the video D2 output from the drawing information conversion device 305 on the video D1 acquired by the video acquisition device 303. The display device 307 displays a predetermined video based on the video signal from the video synthesis device 306. Thereby, at the point A, an image displayed on the whiteboard 301 of FIG. 9 can be seen. The photographing device 308 photographs the display area C2 of the whiteboard 301. The video transmission device 309 transmits the video signal of the video D3 captured by the imaging device 308 to the remote drawing device 200 at the point B via the network. The video conversion device 204 at the point B converts the video signal of the video D3 transmitted from the remote drawing device 300 at the point A into a format that can be displayed on the display device 201 that is a display. Accordingly, a predetermined video can be displayed from the display device 201 based on the video signal converted by the video conversion device 204. As a result, by simply connecting the video output of the portable terminal 302 to the video acquisition device 303, the video can be shared by the points A and B and written from a remote place.

  [Third Embodiment] Next, a third embodiment will be described. FIG. 10 is a block diagram of the remote drawing apparatus 400 at the point A. As shown in FIG. 10, the remote drawing device 400 at the point A includes a display device 401, a portable terminal 402, a video acquisition device 403, a video transmission device 404, an input device 405, a drawing information transmission device 406, and a drawing information conversion device. 407, a video composition device 408, and a button 409.

  FIG. 11 is a block diagram of the remote drawing apparatus 500 at point B. As shown in FIG. 11, the remote drawing device 500 at the point B includes a display device 501, an input device 502, a drawing information transmission device 503, a video conversion device 504, a drawing information conversion device 505, and a video composition device 506.

  The remote drawing device 400 at the point A shares drawing information with the remote drawing device 500 at the point B. The display device 401 is composed of a display device, for example, and displays the video synthesized by the video synthesis device 408. The carry-in portable terminal 402 is brought in by the user. The video signal D1 of the video of the portable terminal 402 is transmitted to the video acquisition device 403 by a video cable or a wireless signal. The video acquisition device 403 is for capturing a video signal from the carry-in portable terminal 402. The video acquisition device 403 outputs a white or uniform color video signal to the video synthesis device 408 when the portable mobile terminal 402 is not connected or when no video signal is output from the portable mobile terminal 402.

  The video transmission device 404 transmits the video signal D1 acquired by the video acquisition device 403 to the remote drawing device 500 at the point B via the network. When the portable mobile terminal 402 is not connected to the video acquisition device 403 or when the video signal is not output from the mobile portable terminal 402, the video transmission device 404 does not output video data or there is no video data. Is transmitted to the remote drawing device 500 at the point B. The input device 405 can input coordinates by bringing a pen or a hand into contact with a display surface by a sensor installed on the display device 401. The drawing information transmitting device 406 transmits the drawing information D2 input from the input device 405 to the remote drawing device 500 at the point B via the network.

  The drawing information conversion device 407 receives the drawing information D4 drawn at the point B via the network and converts it into a format that can be displayed on the display device 401. Note that the coordinate conversion apparatus described in the above embodiment may be provided before the drawing information conversion apparatus 407. The video synthesizing device 408 synthesizes the drawing information D4 input from the drawing information conversion device 407 and the drawing information D2 input from the input device 405 with the video signal D1 acquired by the video acquisition device 403. As a result, the display device 401 displays a predetermined video based on the video signal synthesized by the video synthesis device 408. A button for selecting a drawing method is displayed on the display device 401, and a drawing method can be selected by operating the input device 405. The display device 401 displays a drawing method selection button on the screen. A button 409 is a button for selecting a drawing method. The user can select a drawing method on the display device 401 by using a drawing method selection button or a button 409 displayed on the display device 401. Note that the video acquisition device 403, the video transmission device 404, the drawing information transmission device 406, the drawing information conversion device 407, and the video composition device 408 are configured by one or more personal computers connected to a network.

  Next, the remote drawing apparatus 500 at the point B will be described. The display device 501 is constituted by a display device, for example, and displays the video synthesized by the video synthesis device 506. The input device 502 can input coordinates by bringing a pen or a hand into contact with a display surface by a sensor installed on the display device 501. The drawing information transmission device 503 transmits the drawing information D4 from the input device 502 to the remote drawing device 400 at the point A via the network. The video conversion device 504 receives the video signal D1 from the video transmission device 404 at the point A and converts it into a format that can be displayed on the display device 501. When the video conversion device 504 receives a message that no video signal is transmitted or no video signal, the video conversion device 504 outputs a white or uniform video signal to the video synthesis device 506.

  The drawing information conversion device 505 converts the drawing information acquired from the remote drawing device 400 at the point A into a format that allows the display device 501 to display D2. The video synthesis device 506 synthesizes the drawing information D4 from the input device 502 and the drawing information D2 from the drawing information conversion device 505 with the video signal D1 from the video conversion device 504. A predetermined video is displayed based on the video signal synthesized by the video synthesis device 506 from the display device 501.

  Next, the operation of the system according to the third embodiment will be described. When the portable mobile terminal 402 is connected to the video acquisition device 403, the video acquisition device 403 sends the video signal D1 to the video synthesis device 408 and the video transmission device 404. The video transmission device 404 sends the video signal D1 to the remote drawing device 500 at the point B. The drawing information D4 input from the input device 502 of the remote drawing device 500 at the point B is sent from the drawing information transmission device 503 to the remote drawing device 400 at the point A. The drawing information conversion device 407 converts the drawing information D4 from the remote drawing device 500 at the point B into a format that can be displayed on the display device 401. The drawing information D2 input from the input device 405 is sent to the video composition device 408 and the video information transmission device 406. The drawing information transmission device 406 sends the drawing information D2 to the remote drawing device 500 at the point B.

  The video synthesizing device 408 synthesizes the drawing information D2 from the input device 405 and the drawing information D4 from the drawing information conversion device 407 with the video signal D1 of the portable portable terminal 402 from the video acquisition device 403. The display device 401 displays a video as shown in FIG. 10 based on the video signal synthesized by the video synthesis device 408.

  On the other hand, the video conversion device 504 of the remote drawing device 500 at the point B converts the video signal D1 from the remote drawing device 400 at the point A into a format that can be displayed on the display device 501. The drawing information conversion device 505 converts the drawing information D2 into a format that can be displayed on the display device 501. The video synthesis device 506 synthesizes the video signal D1 from the video conversion device 504 with the drawing information D2 from the drawing information conversion device 505 and the drawing information D4 from the input device 502, and outputs them to the display device 501. The display device 501 displays an image as shown in FIG. As a result, the video used in the meeting or the like can be shared by the remote drawing device 400 at the point A and the remote drawing device 500 at the point B. Therefore, by simply connecting the video output of the portable terminal 402 to the video acquisition device 403, the video can be shared and written from a remote location.

  [Fourth Embodiment] Next, a fourth embodiment will be described. FIG. 12 is a diagram for explaining a system according to the fourth embodiment. Video information and drawing information from the remote drawing device 100 at the point A, the remote drawing device 200 at the point B, and the remote drawing device 200 at the point C are all transmitted and received via the central server 600. The remote drawing apparatuses 100 and 200 are the same as described above, and thus the description thereof is omitted. The central server 600 stores all video information, drawing information, and attribute information (time, location, etc.) and transmits them in response to a user request. This makes it possible to reproduce past video information and drawing information. The central server 600 manages the transmission source and transmission destination of video signals and drawing information handled by the remote drawing device 100 at the point A, the remote drawing device 200 at the point B, and the remote drawing device 200 at the point C, and responds to requests. To change the source and destination. Thereby, it is possible to control the transmission place and the reception place among a plurality of points. The central server 600 synthesizes video signals sent from a plurality of points into one video and transmits it to the remote drawing apparatuses 100 and 200.

  [Fifth Embodiment] Next, a fifth embodiment will be described. 13 and 14 are examples of transmission video signals of the drawing information conversion apparatus 105 according to the fifth embodiment. The present embodiment is an example of a video signal transmitted by the drawing information conversion apparatus 105 described in the first embodiment. When the drawing information conversion apparatus 105 sends the figure drawn at the point B to the drawing figure display apparatus 106 as a video signal, as shown in FIG. As shown in FIG. 5B, when the drawing at the point B is a character, the character portion is output with a background. Here, the shadow or background color is preferably a uniform color such as white. The color of the shadow or background may be automatically changed according to the drawing color. For example, when the drawing color is red, the shadow or background color is blue. As this color relationship, for example, the complementary color of the drawing color may be a shadow or background color.

  Thereby, for example, in the case of the first embodiment, when the display area C1 is displayed in an overlapping manner from the display device 103 and the drawing graphic display device 106, it is possible to make the figure and characters projected from the drawing graphic display device 106 stand out. it can. Similarly, in the output from the drawing information conversion apparatus 305 in FIG. 9, the output from the drawing information conversion apparatus 407 in FIG. 10, and the output from the input apparatus 502 in FIG. A signal may be output.

  According to each of the embodiments described above, a screen such as a slide document of a portable mobile terminal can be shared with a remote place by simply connecting the video output of the carry-in PC to a pre-installed device. Drawing is possible. As a result, there is no need to install special software on the portable terminal, so installation time and effort are not required. Further, since there is no need to transfer / copy information such as slide materials from a portable mobile terminal to another PC, there is no fear that the data itself will be stolen, so security is ensured and transfer / copying time and labor are not required.

  Also, not only slide materials but also those that can be displayed on a bring-in PC (Web pages, special files, etc.) can be displayed and shared as they are. It can be used as it is with the software settings of your PC and it is easy to operate. Video output from devices such as video cameras as well as PCs can be displayed and shared as is. It is not necessary to digitize the video data of the device and copy it to a PC, so that the time can be shortened and the video can be operated by normal device operation. In claim 1, the display device 103 corresponds to the first display means, the drawing figure display device 106 corresponds to the second display means, the photographing device 107 corresponds to the photographing means, and the video transmission device 108 corresponds to the transmitting means. . Further, in claim 2, the video composition device 306 corresponds to the composition means, the display device 307 corresponds to the display means, the photographing device 308 corresponds to the photographing means, and the video transmission device 309 corresponds to the transmission means. In claim 3, the drawing information transmission device 406 corresponds to the transmission means, the video composition device 408 corresponds to the composition means, and the display device 401 corresponds to the display means.

  Although the preferred embodiments of the present invention have been described in detail above, the present invention is not limited to the specific embodiments, and various modifications, within the scope of the gist of the present invention described in the claims, It can be changed.

It is a figure for demonstrating the outline | summary of the electronic blackboard system of patent document 1. FIG. It is a figure for demonstrating the outline | summary of the electronic blackboard system which can share information between the remote places of patent document 2. FIG. It is a system configuration figure concerning a 1st embodiment. It is a block diagram of the remote drawing apparatus of the point A which concerns on 1st Embodiment. It is a block diagram of the remote drawing apparatus of the point B which concerns on 1st Embodiment. It is an operation | movement flowchart at the time of displaying the portable terminal by 1st Embodiment. It is an operation | movement flowchart at the time of displaying the drawing data from the remote place by 1st Embodiment. It is an operation | movement flowchart at the time of imaging | photography with the camera by 1st Embodiment, sending to a remote place, and displaying. It is a block diagram of the remote drawing apparatus of the point A which concerns on 2nd Embodiment. It is a block diagram of the remote drawing apparatus of the point A which concerns on 3rd Embodiment. It is a block diagram of the remote drawing apparatus of the point B which concerns on 3rd Embodiment. It is a figure for demonstrating the system which concerns on 4th Embodiment. It is an example of the transmission video signal of the drawing information converter by 5th Embodiment. It is an example of the transmission video signal of the drawing information converter by 5th Embodiment.

Explanation of symbols

100, 300, 400 Remote drawing device at point A 101, 301 Whiteboard 102, 302, 402 Mobile terminal 103, 307, 401 Display device 104, 304 Coordinate conversion device 105, 305, 407, 505 Drawing information conversion device 106 Drawing device 107, 308 Imager 108, 309, 404 Video transmitter 109, 310 Adjustment device 200, 500 Remote drawing device 201 at point B 201, 501 Display device 202, 405, 502 Input device 203, 406, 503 Drawing information Transmission device 204, 504 Video conversion device 303, 403 Video acquisition device 306, 408, 506 Video composition device

Claims (37)

First display means for displaying video from the information processing device in a predetermined display area;
Second display means for displaying a predetermined video in the display area based on information acquired from outside via a network;
Photographing means for photographing the display area;
A remote drawing apparatus comprising: a transmission unit that transmits a video signal of a video captured by the imaging unit to the outside via a network. A synthesizing unit that synthesizes information acquired from the outside via a network with the video signal acquired from the information processing apparatus;
Display means for displaying a predetermined video in a predetermined display area based on the video signal synthesized by the synthesis means;
Photographing means for photographing the display area;
A remote drawing apparatus comprising: a transmission unit that transmits a video signal of a video captured by the imaging unit to the outside via a network. Transmitting means for transmitting drawing information input from a predetermined input means to the outside via a network;
A synthesizing unit that synthesizes information acquired from the outside via a network and drawing information input from the input unit with a video signal acquired from a predetermined information processing apparatus;
A remote drawing apparatus comprising: display means for displaying a predetermined video based on the video signal synthesized by the synthesizing means. The remote drawing apparatus according to any one of claims 1 to 3, further comprising conversion means for converting the information acquired from the outside into a format that can be displayed. The remote drawing device further captures a video signal from the information processing device and displays a black or uniform color image when the information processing device is not connected or when no video signal is output from the information processing device. The remote drawing apparatus according to any one of claims 1 to 3, further comprising an acquisition unit that outputs a signal. 4. The remote drawing apparatus according to claim 1, further comprising a transmission unit that transmits a video signal from the information processing apparatus to the outside. 5. The transmission means transmits a message indicating that the video signal is not output to the outside or that there is no video signal when the information processing device is not connected or a video signal is not output from the information processing device. The remote drawing apparatus according to claim 6, wherein: The remote drawing apparatus further comprises coordinate conversion means for converting coordinates of information acquired from the outside via a network using coordinates of an image photographed by the photographing means. The remote drawing apparatus according to claim 2. The remote drawing apparatus according to claim 1, wherein the first display unit, the second display unit, or the display unit is a video projector. 3. The remote drawing apparatus according to claim 1, wherein each of the first display means, the second display means, or the display means is a rear projection type video projector. The remote drawing apparatus according to claim 1, wherein the photographing unit is a camera having at least one function of pan, tilt, and zoom. 12. The remote drawing apparatus according to claim 11, wherein panning, tilting, and zooming of the photographing unit can be controlled via a network. The photographing unit is configured to have a wide-angle camera capable of photographing the display area of the display unit and a field angle corresponding to the rectangle when a part of the image of the wide-angle camera is designated by a rectangle on a predetermined information processing apparatus. 3. The remote drawing apparatus according to claim 1, further comprising a camera that is controlled to pan, tilt, or zoom. 5. The remote drawing apparatus according to claim 4, wherein the conversion means outputs a black video signal when there is no drawing information to be converted. The remote drawing apparatus according to claim 1, wherein the coordinates of the pixels of the first display unit or the second display unit coincide with each other. The remote drawing apparatus according to claim 1, wherein the photographing unit automatically adjusts an aperture, a gain, or a shutter speed. 17. The remote drawing apparatus according to claim 16, wherein the photographing unit adjusts the shutter speed earlier than the aperture or gain when the aperture, gain, or shutter speed is automatically adjusted. The remote drawing device further adjusts the aperture, gain, shutter speed, display brightness of the display means or display brightness parameters of the remote drawing device according to the brightness of the image displayed on the display means. The remote drawing apparatus according to claim 1, further comprising: 4. The remote drawing apparatus according to claim 1, wherein the video signal of the information processing apparatus is transmitted by a video cable or a wireless signal. 5. The remote drawing apparatus according to claim 3, further comprising an input unit capable of inputting coordinates by touching the display area. 3. The remote drawing apparatus according to claim 1, wherein the display area is a substance that can be directly written or erased with a pen. The remote drawing apparatus according to claim 1, wherein the display area is made of a metal to which a magnet can be attached. 4. The remote drawing apparatus according to claim 3, wherein the display unit displays a drawing method selection button. The remote drawing apparatus according to claim 3, further comprising a selection button capable of selecting a drawing method. 4. The remote drawing apparatus according to claim 1, wherein the transmission unit transmits a video signal when a change occurs in the video to be transmitted. 5. The remote drawing device according to claim 1 or 2,
Conversion means for converting a video signal transmitted from the remote drawing apparatus into a displayable format, display means for displaying a predetermined video based on the video signal converted by the conversion means, and drawing information input from a predetermined input means And a second remote drawing apparatus including a transmission means for transmitting to the remote drawing apparatus. 27. The system according to claim 26, wherein the display means displays buttons for controlling pan, tilt, and zoom of the camera. 27. The system of claim 26, further comprising buttons for controlling camera pan, tilt, and zoom. The remote drawing device according to claim 3,
First conversion means for visualizing a video signal transmitted from the remote drawing apparatus, transmission means for transmitting drawing information from a predetermined input means to the remote drawing apparatus, and drawing information acquired from the remote drawing apparatus Second converting means for converting the image into a displayable format, and combining means for combining the image information converted by the first converting means with the drawing information from the input means and the drawing information converted by the second converting means And a second remote drawing device including display means for displaying a predetermined video based on the video signal synthesized by the synthesizing means. The first converting means outputs a white or uniform color video signal to the synthesizing means when receiving a message that the video signal has not been transmitted or that there is no video signal. 30. The system of claim 29. 30. The system according to claim 26 or 29, further comprising a server that relays transmission and reception of the video signal and the drawing information. 30. The system according to claim 26, further comprising a server that stores the video signal, the drawing information, and attribute information thereof, and transmits the stored data in response to a request. The described system. The system includes a server that manages a transmission source and a transmission destination of the video signal and the drawing information, and changes the transmission source and the transmission destination according to a request. The system described. 30. The system according to claim 26 or 29, further comprising a server that synthesizes video signals sent from a plurality of points into one video. A first display step of displaying an image from the information processing apparatus in a predetermined display area from the first display means;
A second display step of displaying a predetermined image from a second display means on the display area based on information acquired from outside via a network;
A shooting step of shooting the display area;
A remote drawing method comprising: a transmission step of transmitting a video signal of the video imaged in the imaging step to the outside via a network. A synthesis step of synthesizing information acquired from the outside via a network with the video signal acquired from the information processing apparatus;
A display step of displaying a predetermined video in a predetermined display area based on the video signal combined in the combining step;
A shooting step of shooting the display area;
A remote drawing method comprising: a transmission step of transmitting a video signal of the video imaged in the imaging step to the outside through a network. A transmission step of transmitting drawing information input from a predetermined input means to the outside via a network;
A synthesis step of synthesizing information acquired from the outside via a network and drawing information input from the input unit with a video signal acquired from a predetermined information processing apparatus;
A remote drawing method comprising: a display step of displaying a predetermined video based on the video signal synthesized in the synthesis step.

Images