JP2007158796A - Immediate document image/sound mutually discussing system and method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an immediate document image/sound mutually discussing system and method including a display screen, a communication module, a handwriting module, and a controller. <P>SOLUTION: The handwriting module is designed to acquire handwriting input information by detecting a handwriting operation performed by a handwriting pen on a tablet. The controller is designed to display a document image on an alternating area of a display screen, and to make the handwriting input information which is acquired by an object to be discussed via the communication module or which is inputted from the handwriting module displayed on the alternating area in which the document image is made to be a background image. Thus, an operator performs handwriting input by the handwriting pen on the document image, and mutual discussion is further made with the object to be discussed in response to the operation of immediate image/sound television. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an immediate document video / audio mutual discussion system and method, and more particularly, to an immediate document video / audio mutual discussion system and method for mutual discussion with a discussion object by television dialogue and handwriting pen input on a document video. .

  It is necessary to meet and talk about related people gathering together and discussing about documents such as symbols and charts, even if it takes a round-trip time of related personnel. The main reason for this is that it is difficult to clearly interpret a document such as a graphic or chart by telephone. For example, when you invite an opponent and look at a number or a part of a pattern on a chart, you can finally understand which one the opponent points to after interacting for a lot of time.

  When adopting a videophone or videoconferencing system, you can see the numbers or patterns that the other party points to, but the resolution is usually not good and the details are difficult to see in order to reduce the amount of Internet bandwidth used. So when we discuss, we still can't achieve perfect boundaries. Also, when drawing a part of a design or character on a document such as a design or a chart, it is necessary to capture the image with a videophone or a video conference system microphone video camera after writing with a brush. Or when discussing a document using a video conferencing system, it is not convenient enough for both discussions.

  In addition, in the current market, in general, so-called immediate video / audio file video exchanges can be recorded and talked on both the Internet, and can be achieved to the extent that the exchange effect is satisfactory by adding exchanges of screen screen dynamic operations. Internet bandwidth used in the exchange of at least several hundred Kbps (generally about 500 K to 600 Kbps or more), which means that an immediate screen video plane will have at least 10-20 screens per second Since it cannot be achieved unless it is received, it is an issue to be solved that both parties discuss over the Internet and do not occupy too much net bandwidth.

  The main object of the present invention is to add handwritten input information on the document video with the handwriting pen of the handwriting module after each video of the document to be discussed by both discussions and to reduce the net bandwidth via the communication module. Provided is an immediate document video / audio mutual discussion system and method which can transmit handwritten input information occupying a very small amount to a partner as a handwritten input signal and can immediately and conveniently perform a mutual discussion.

  To achieve the above object, the present invention provides an immediate document video / audio mutual discussion system and method including a display screen, a communication module, a handwriting module, and a controller. The handwriting module obtains handwritten input information by sensing a handwriting operation on the tablet by a handwriting pen. The controller displays the document video in the AC area of the display screen, and the handwritten input information acquired by the discussion target or input from the handwriting module via the communication module in the AC area having the document video as a background diagram. Display. In this way, the operator adds handwritten input information with the handwriting pen on the document video, and discusses with the object of discussion, and both parties interact through video.

  The features and technical contents of the present invention can be deeply and concretely understood by referring to the detailed description and the accompanying drawings related to the present invention, which are used only for reference and description. It goes without saying that the claimed scope of the present invention is not narrowly limited.

  FIG. 1 is a diagram showing an immediate document video / audio mutual discussion system. As shown in FIG. 1, when both discussions (that is, the operator and the discussion target) are going to discuss each other via the Internet, the immediate document video / audio mutual discussion systems 10 and 20 of this embodiment are respectively set. Own. In the immediate document video / audio mutual discussion systems 10 and 20 of the present embodiment, the display screens 12 and 22, the communication modules 16 and 26, the handwriting modules (handwriting pens 19 and 29, tablets (plate-shaped main bodies) 18 and 28). ), Controllers 14 and 24, video input devices 13 and 23, and audio input devices 15 and 25.

  Simply put, the operator (who owns the immediate document video / audio mutual discussion system 10), the object of discussion (which owns the immediate document video / audio mutual discussion system 20), and the document video (for example, the document video in FIG. 2A). 30), the controller 14 opens a document video to be discussed, and further performs a mutual discussion through handwritten input information added to the document video. In the course of the mutual discussion, the video and / or Or increase the smoothness of the discussion process by voice.

  According to the present embodiment, the operator inputs his / her video signal and voice signal by the video input device 13 and the voice input device 15, writes the data on the tablet 18 by the handwriting pen 19, and inputs handwritten input information as a handwritten input signal. To do. The controller 14 transmits and receives the acquired video signal, audio signal, handwritten input signal, and document video to the other party's immediate document video / audio mutual discussion system 20 via the communication module 16, and the controller 14 The handwritten input information is added to the document video to be discussed, and the handwritten input information can be displayed on the discussion target display screen 22 in synchronization with the received document video and document video. Signals can be received synchronously.

  In order to reduce the net transmission bandwidth used, the transmission of the document video is not a continuous transmission of the document video (in this way, the net transmission bandwidth is likely to be wasted). Both the operator and the discussion subject transmit and display the handwritten input signal synchronously on the document video, and also interpret the video signal and the audio signal in synchronization. In this way, it becomes easy to understand what the operator is trying to convey in addition to the exchange of the video signal and the audio signal by the handwritten input signal drawn on the document video. On the other hand, since the operation of the immediate document video / audio mutual discussion system 20 on the discussion target side is the same as that of the immediate document video / audio mutual discussion system 10 on the operator side, detailed description will not be given here. Also, the communication modules 16 and 26 described above can provide network transmission operations.

  The handwriting input itself is a conventional technique, but here, some possibilities are mentioned. One is an external tablet 18, and the external tablet 18 senses the handwriting movement of the handwriting pen 19 to obtain a handwriting locus, and the other integrates the tablet 18 and the display screen 12. Similarly, a handwriting locus can be obtained by sensing the handwriting action of the handwriting pen 19. However, at this time, the handwriting pen 19 performs handwriting input on the display screen 12 including the tablet 18. Alternatively, an operation for inputting a movement locus is provided by moving the mouse.

  There are two possible sources for the document video as the basis for the discussion, that is, the document video as the background diagram on the screen 12, and it depends on who can start the mutual discussion. When the discussion is started in the immediate document video / audio mutual discussion system 10 by the operator, the document video is obtained from the storage medium and transmitted to the other party via the communication module 16 in addition to being displayed on the display screen 12. When a discussion is started in the immediate document video / audio mutual discussion system 20 from the discussion target, the document video is received from the communication module 16 in the immediate document video / audio mutual discussion system 10.

  Before actually discussing who will be offered or how to get it, the document video that both sides will see is always the same, and each controller 14, 24 has acquired the document video together It will be displayed on the display screen 12 later. Subsequently, both the operator and the discussion object can be input by handwriting on the document video via the handwriting modules (handwriting pens 19 and 29 and tablets 18 and 28). Can be sent to the other party and the handwritten information entered by the other party can be shown synchronously.

  As described above, between the immediate document video / audio mutual discussion systems 10 and 20 according to the present invention, the document video to be discussed by both discussions is obtained, and then the handwriting pens 19 and 29 in the handwriting module are provided. Handwritten input on the document video, and via the communication modules 16 and 26, the handwritten input signal occupying a very small Internet bandwidth and the video signal and audio signal input by the video input devices 13 and 23 and the audio input devices 15 and 25 Can be transmitted to the other party for immediate and convenient mutual discussion. On the other hand, in the past, a moving image is completely transmitted with a video / audio (video) signal, and the required net bandwidth is higher than 500 Kbps to 600 Kbps, which is particularly necessary when discussing among a large number of people. Although the net bandwidth is surprisingly larger, the system and method provided by the present invention can save a great deal of internet bandwidth because it sends document video (non-moving images) and handwritten input signals only once. In addition, video signals and audio signals can also be controlled within the Internet transmission bandwidth that can be received through appropriate processing. Here, the mutual discussion will be described more specifically by using the screens displayed on the display screens 12 and 22 of the immediate document video / audio mutual discussion systems 10 and 20.

  2A to 2D are diagrams showing a state of mutual discussion of the present invention. As shown in FIG. 2A, on the display screens 12 and 22 of the immediate document video / audio mutual discussion systems 10 and 20, the AC screen areas 12a and 22a and the TV display areas 40 and 42 are further included, respectively. The document video 30 is displayed in the 12 AC regions 12a. At this time, since the display screen 22 waits for reception of the document video 30, no screen is displayed in the AC region 22a. The television display area 40 displays the video signal output by the video / audio mutual discussion system 20, and the television display area 42 displays the video signal output by the video / audio mutual discussion system 10.

  The instant document video / audio mutual discussion system 10 is shown in FIG. 2B after transmitting the document video 30 to the communication module 26 of the immediate document video / audio mutual discussion system 20 via the communication module 16 shown in FIG. Thus, the controller 24 can display this in the AC area 22 a of the display screen 22.

  Subsequently, after the handwriting input information 32 shown in FIG. 2C appears in the AC region 12a in which the operator holds the handwriting pen 19 and uses the document video 30 as a background diagram, communication provided by the communication modules 16 and 26 separately. As shown in FIG. 2D, the handwritten input information 32 is also displayed on the AC area 22a of the display screen 22 through the means.

  2A to 2D, in addition to discussing with handwritten input information, video and / or audio input can be combined, and a video signal is displayed via the television display areas 40 and 42, and video and audio can be exchanged. Debate can be achieved.

  Further, when the operator (who owns the immediate document video / audio mutual discussion system 10) tries to discuss another subject (the immediate document video / audio mutual discussion system 20) and another document video 30, The discussion can be made again as shown in FIGS. 2A to 2D.

  It should be noted that the above description is merely an embodiment in which the present invention can be implemented, and does not limit the scope of the claims of the present invention. While appropriate changes and modifications can be made in the field, it goes without saying that such implementation should be delivered within the scope of the claimed invention.

1 is a diagram showing an immediate document video / audio mutual discussion system according to a preferred embodiment of the present invention; FIG. It is a figure which shows the mode of the mutual discussion of this invention. It is a figure which shows the mode of the mutual discussion of this invention. It is a figure which shows the mode of the mutual discussion of this invention. It is a figure which shows the mode of the mutual discussion of this invention.

Explanation of symbols

10, 20 Immediate document video / audio mutual discussion system 12, 22 Display screen 12a, 22a AC domain 13, 23 Video input device 14, 24 Controller 15, 25 Voice input device 16, 26 Communication module 18, 28 Tablet 19, 29 Handwriting Pen 30 Document video 32 Handwritten input information 40, 42 Television display area

Claims (16)

In an immediate document video / audio mutual discussion system in which the operator interacts with the object of discussion via the Internet based on the document video as a background diagram,
A display screen;
A communication module for transmitting and receiving the document video;
A handwriting module that obtains handwritten input information by sensing a handwriting action on a tablet with a handwriting pen;
A controller for displaying the document video in the AC area of the display screen and displaying the handwritten input information in the AC area using the document video as a background diagram;
An immediate document video / audio mutual discussion system including an audio input device that inputs an audio signal of the operator and outputs the audio signal through the communication module under the control of a controller.   2. The instant document video / audio mutual discussion system owned by the operator and the discussion object, wherein the document images displayed in the AC area of the display screen are all the same. Instant document video / audio mutual discussion system.   2. The immediate document video / audio mutual discussion system according to claim 1, wherein the document video is obtained from a storage medium in the immediate document video / audio mutual discussion system owned by an operator or a discussion object.   2. The immediate document video / audio mutual discussion system according to claim 1, wherein the document video can be supplied to the other party by the communication module in the immediate document video / audio mutual discussion system owned by an operator or a discussion object.   2. The immediate document video / audio according to claim 1, wherein the handwritten input information is supplied by a handwriting module when the handwritten input information is displayed in an AC area having the document video as a background diagram. 3. Mutual discussion system.   2. Immediately according to claim 1, wherein the handwritten input information is received as a handwritten input signal by a communication module when the handwritten input information is displayed in an AC area having the document image as a background diagram. Document video / audio mutual discussion system.   The handwritten input information obtained by the handwriting module of the operator's immediate document video / audio mutual discussion system is transmitted as a handwritten input signal to the discussion target immediate document video / audio mutual discussion system by the communication module. 2. The immediate document video / audio mutual discussion system according to claim 1.   2. The immediate document video / audio mutual discussion system according to claim 1, wherein the tablet of the handwriting module is integrated with the display screen.   2. The immediate document video / audio according to claim 1, further comprising a video input device for inputting the video signal of the operator and outputting the video signal through the communication module under the control of the controller. Mutual discussion system. In an immediate document video / audio mutual discussion method in which the operator interacts with the discussion target via the Internet based on the document video as the background diagram,
Receiving the document video;
Displaying the document image in an AC area of a display screen;
Obtaining handwritten input information by sensing a handwriting action on a tablet with a handwriting pen;
Displaying the handwritten input information in an AC area with the document image as a background diagram;
And a step of outputting a voice signal of the operator to the discussion object.   11. The immediate document video / audio mutual discussion method according to claim 10, wherein both the operator and the document video from which a discussion target is obtained are the same.   11. The immediate document video / audio mutual discussion method according to claim 10, wherein the document video from which the operator and the discussion object are obtained is supplied by a partner.   When the handwritten input information is displayed in an AC area having the document image as a background diagram, the handwritten input information is obtained by sensing a handwriting operation on a tablet by a handwriting pen. 11. The method for immediate discussion between video and audio according to claim 10.   The handwritten input information is received as a handwritten input signal by a counterpart through a communication module when the handwritten input information is displayed in an AC area having the document image as a background diagram. Item 10. The instant document video / audio mutual discussion method according to Item 10.   11. The immediate document video / audio mutual discussion method according to claim 10, wherein the handwritten input information obtained by the operator is transmitted to the discussion object by the communication module as a handwritten input signal. The method of claim 10, further comprising the step of outputting the operator's video signal to the discussion object.

Images