JP3774509B2 - Trajectory data communication system, trajectory data communication terminal, and trajectory data communication method - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention, trajectory data communication system performs communication between terminals mutually by displaying enter a locus counterpart terminal and own terminal device, the trajectory data communication terminal, and a trajectory data communications methods.
[0002]
[Prior art]
Conventionally, as a trajectory data communication system that communicates by transmitting / receiving trajectory data, as input in Japanese translation of PCT publication No. 2-502492 “Multi-window communication system”, etc., an input pen is input to the terminal on its own side. In some cases, the input point trajectory data is transmitted to the counterpart terminal via a communication line, and the transmitted trajectory data is displayed on the counterpart terminal for communication.
[0003]
[Problems to be solved by the invention]
However, in the above prior art, since there is no means for the other party to sense that it has started transmitting the trajectory data at the same time, in order to detect when the other party has started drawing, There was a problem that the display area of the side track data had to be constantly monitored.
[0004]
Further, when a plurality of trajectories are drawn on the same screen at the same time, for example, it may not be possible to determine whether the trajectory is drawn by the application of the terminal being executed or the trajectory transmitted by the other party.
[0005]
Accordingly, the present invention has been made in view of the above points, and a trajectory data communication system that can easily determine the time when trajectory data is transmitted and can improve the discriminability of the type of trajectory data. It is an object to provide a trajectory data communication terminal and a trajectory data communication method .
[0006]
[Means for Solving the Problems]
In order to solve the above-mentioned problem, the invention according to claim 1 is a trajectory data communication system for transmitting / receiving trajectory data of a trajectory handwritten by a user between a plurality of terminals, and an identifier of trajectory data and an identifier of an application drawing request. And setting means for associating and setting different desired voices used at the time of voice output , input means for inputting trajectory data, and transmission for transmitting trajectory data input by the input means to the counterpart terminal means and the trajectory by the drawing request receiving means for receiving the route data transmitted from the counterpart terminal, from the trajectory data and trajectory data and applications entered at his terminal from the counterpart terminal received by the receiving means based on any of the data, and drawing means for drawing reproduced on a predetermined display unit, the receiving hands There recognition means for recognizing one of the identifier of the received application of drawing requests the identifier of the route data from the other party terminal and the identification of the locus data input in their terminal have drawing request, the When the drawing unit draws and reproduces the trajectory data related to the identifier recognized by the recognition unit, the voice corresponding to the identifier recognized by the recognition unit is output with reference to the setting content by the setting unit And an audio output means.
[0007]
According to a fourth aspect of the present invention, there is provided a trajectory data communication terminal that receives trajectory data input at a counterpart terminal and draws and reproduces the trajectory data identifier and application drawing request. against an identifier, receiving a setting unit configured to set each in association with different desired voice used during voice output, an input means for inputting locus data, the trajectory data was manner is sent either et mating terminal receiving means, based on any of the locus data according to the drawing request from the trajectory data and applications entered the locus data in the locus data communication terminal from the counterpart terminal received by the receiving unit, a predetermined and drawing means for drawing reproduced on the display unit, the identifier and the trace data communication terminal of the trajectory data from another terminal received by the receiving means Recognition means for recognizing one of the identifier of Oite input trajectory data identifier and drawing requesting applications have drawing request, locus data related to the identifier the drawing means is recognized by the recognition means And a voice output unit that outputs a voice corresponding to the identifier recognized by the recognition unit with reference to the setting content by the setting unit .
In order to solve the above problem, the invention described in claim 7 is a trajectory data communication method for receiving trajectory data input at a counterpart terminal and drawing and reproducing the trajectory data, and an application drawing request. against an identifier, a setting step of setting each in association with different desired voice used during voice output, a receiving step of receiving a signal by specifically had locus data feed said other terminal or al, in said receiving step based on one of the locus data according to the received drawing request from the trajectory data and trajectory data and applications entered at his terminal from the counterpart terminal, and rendering step of drawing reproduced on a predetermined display means is input in the identifier and the own terminal trajectory data from another terminal received in the receiving step Both the recognition step of recognizing whether, drawing playback line trajectory data associated with the identifier recognized by the recognition steps in the drawing step of the identifier of the drawing request from the application that has the identifier drawing request locus data And a voice output step of outputting a voice corresponding to the identifier recognized in the recognition step with reference to the setting content in the setting step .
[0008]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The following embodiment shows one aspect of the present invention, and does not limit the present invention, and can be arbitrarily changed within the scope of the present invention.
[0009]
(First embodiment)
First, the first embodiment according to the present invention will be described.
[0010]
FIG. 1 is a system function configuration diagram showing a functional configuration of a trajectory data communication system according to the present invention and also showing a system configuration, and FIG. 2 is a specific hardware for realizing the function of each block of FIG. It is a block diagram showing the configuration.
[0011]
The trajectory data communication system 100 according to the present invention includes a plurality of terminal devices, and includes, for example, a local terminal 101 and a counterpart terminal 102 as shown in FIG.
[0012]
In the trajectory data communication system 100, the block configuration of each terminal of the own terminal 101 and the counterpart terminal 102 is the same for each terminal, and the input unit 1 for inputting the trajectory and the input unit 1 A transmitting unit 2 that transmits the input trajectory data to the counterpart terminal 102, a receiving unit 3 that receives the trajectory data transmitted from the counterpart terminal 102, and a rendering request that makes a rendering request by an application in the own terminal 101, for example. A drawing unit 4 that creates drawing data from the locus data and draws and reproduces the locus input from the input unit 1 and the like on the display unit 5; a display unit 5 that displays the drawing data created by the drawing unit 4; A voice generation unit 6, a voice output unit 7 for outputting voice from the voice data, a recognition unit 8 for recognizing the attribute of the trajectory data sent from the counterpart terminal, for example, Composed of a memory unit 9 for storing various data such as the recognition result in section 8.
[0013]
Here, the drawing unit 4 creates locus drawing data, sends the drawing data to the display unit 5 and simultaneously gives a trigger for outputting sound to the sound generating unit 6.
[0014]
Further, the voice generation unit 6 detects appropriate trigger data from the voice data table registered in the storage unit 9 and the recognition result of the recognition unit 8 by detecting the trigger from the drawing unit 4, and the voice output unit 7. Voice data is to be delivered to As a result, the sound generation unit 6 and the sound output unit 7 function as sound output means for outputting a sound notifying that the drawing data is being drawn and reproduced by the drawing unit 4 according to the attribute recognition result by the recognition unit 8. It comes to realize the function.
[0015]
The storage unit 9 stores a writer data table, a voice data table, and a voice variable table as recognition results in the recognition unit 8. 3 shows an example of the writer data table stored in the storage unit 9, FIG. 4 shows an audio data table, and FIG. 5 shows an example of the audio variable table. .
[0016]
Each functional configuration block described above is configured by, for example, hardware as shown in FIG.
[0017]
That is, the input pen 10, the transparent digitizer 11, and the input interface 12 as the input unit 1, the communication interface 13 and the communication line 14 as the transmission unit 2 and the reception unit 3, the liquid crystal display 15 as the display unit 5, the VRAM 16, and the display A controller 17, a synthesizer 18 as the sound generation unit 6, a speaker 19 as the sound output unit 7, a storage device 20 as the storage unit 9, a CPU 21 as the drawing request unit 3 a, the drawing unit 4, and the recognition unit 8. It is comprised.
[0018]
As a result, the own terminal 101 inputs the locus of the input point on the transparent digitizer 11 with the input pen 10 and displays it on the liquid crystal display 15, and at the same time, the own terminal on the liquid crystal display 15 of the partner terminal 102 through the communication line 14. The trajectory input at 101 can be displayed. In this case, of course, the other party terminal 102 can also communicate with each other by the same configuration and operation.
[0019]
Next, the operation of the trajectory data communication system 100 in the present embodiment will be described with reference to the flowcharts of FIGS.
[0020]
FIG. 6 is a flowchart showing the operation in the present embodiment. In the present embodiment, it is assumed that software that operates according to the flowcharts shown in FIGS. 6 to 8 is stored in the storage device 20 as an executable program.
[0021]
First, the CPU 21 checks the coordinate value of the input point when the input pen 10 comes into contact with the transparent digitizer 11 in the input unit 1 constituted by the input pen 10, the transparent digitizer 11, and the input interface 12. It is determined whether or not there is (S22), and if there is input trajectory data, step S26 described later is executed.
[0022]
If there is no trajectory data (S22; NO), the CPU 21 receives trajectory data received by the receiving unit 3 constituted by the communication line 14 and the communication interface 13 or a trajectory due to a drawing request from the application of the terminal 101 on its own. The data is examined and it is determined whether or not there is trajectory data requested to be received or drawn (S23). If there is trajectory data requested to be received or drawn (S23; YES), step 27 described later is executed.
[0023]
If there is no trajectory data (S23; NO), the trajectory data input immediately before and the trajectory data received immediately before are examined to determine whether or not the state is "end of writing" (S24).
[0024]
If there is trajectory data having the same identifier immediately before, that is, the data of one stroke is in an “end of writing” state (S24; YES), a pen-up process described in detail later is performed. Execute (S25), and end one operation. If there is no trajectory data having the same identifier immediately before (S24; NO), it means that input or reception of another trajectory data is waited, so step S22 is executed again.
[0025]
It should be noted that the application of the own terminal 101 handled in the present embodiment is targeted for an application that can select audio output. In this embodiment, since it is assumed that a plurality of applications are activated by a multi-window system or the like, after step S25 is completed, another application is executed and the operation from step S22 is repeated again. .
[0026]
On the other hand, when it is determined in step S22 that there is trajectory data input, the input trajectory data is transmitted by the transmission unit 2 configured by the communication line 14 and the communication interface 13 (S26).
[0027]
Next, CPU21 sets the terminal identifier for communication contained in the input locus | trajectory data or the received locus | trajectory data as a writer identifier (S27). Here, for the sake of explanation, as shown in FIG. 3, the identifier of the own terminal 101 is 1, the identifier of the partner terminal 102 is 2, the identifier 0 is assigned to the application drawing request, and the voice in response to the drawing request from the application Is not output.
[0028]
After setting the writer identifier, the trajectory data input immediately before and the trajectory data received immediately before are checked, and if there is no trajectory data having the same identifier immediately before, the state is “begin writing”. (S28; YES), a pen-down process described in detail later is executed (S29). Note that the current voice data is acquired from the voice data table as shown in FIG. 4 as the pen-down process in step S29.
[0029]
In addition, if there is trajectory data having the same identifier immediately before, it means that writing is in progress, so step 30 is executed. That is, in step 30, the trajectory data input or received is sent to the drawing unit 4 realized by the display controller 17 writing it into the VRAM 16 and drawn (S30).
[0030]
After performing the drawing process, an audio process is executed (S31). That is, a voice number value preset in the voice variable table as shown in FIG. 5 is acquired from the writer identifier, and voice data corresponding to the value is acquired from the voice data table shown in FIG. Is transmitted to the sound generator 6 realized by the above. A different voice number is set for each writer identifier. As a result, sound based on the sound data is output from the speaker 19 which is the sound output unit 7. After step S31, step S22 is executed again.
[0031]
Next, the operation of the pen-up process will be described.
[0032]
FIG. 7 is a flowchart for explaining the pen-up processing operation of the present embodiment. Here, the pen-up process refers to a final process when the input of the trajectory data and the drawing process are terminated.
[0033]
First, in this pen-up process, the CPU 21 acquires the value of the writer identifier set in step S27 (S32). Next, the sound being output is stopped based on the trajectory data corresponding to the acquired writer identifier (S33).
[0034]
Next, the operation of the pen-down process will be described.
[0035]
FIG. 8 is a flowchart for explaining the pen-down processing operation of the present embodiment. Here, the pen-down process refers to an initial input process of trajectory data that is performed when input of trajectory data is started.
[0036]
First, in this pen-down process, the voice generation unit 6 acquires the writer identifier set in step S27 (S38).
[0037]
Then, the voice generation unit 6 acquires a voice number corresponding to the writer identifier acquired in step S38 of the voice variable table of FIG. 5 (S39). The voice number is set in advance. Here, the voice number 4 is set for the writer identifier 1 and the voice number 1 is set for the writer identifier 2 . The application identifier 0 is set to the voice number 0 here, and the voice is not output in the locus drawn by the drawing request of the application. As a matter of course, it is also possible to output a voice even if it is an application drawing request by setting another voice number.
[0038]
And the audio | voice generation part 6 acquires the audio | voice data corresponding to the audio | voice number acquired at step 39 from the audio | voice data table | surface of FIG. 4 (S40). Note that the term “speech” here is not limited to human voices, but refers to sound that can be felt by humans by vibrating the air in a broad sense, such as sound effects, vibration sounds, and instrument sounds. The audio data table in FIG. 4 is shown simply for explanation.
[0039]
Finally, sound based on the acquired sound data is output from the speaker 19 constituting the sound output unit 7 (S41).
[0040]
By performing the above processing, it is possible to output a voice specific to the trajectory, so even when the other party's trajectory data display area on the terminal screen is not always monitored, the timing when the other party starts drawing can be known. The operability in the communication system of trajectory data by pen input is improved.
[0041]
In the present invention, it is assumed that there are a plurality of counterpart terminals, and it is needless to say that different voices can be set in the trajectories transmitted by a plurality of counterparts by the terminal identifier.
[0042]
(Second Embodiment)
Next, a second embodiment according to the present invention will be described.
[0043]
In the present embodiment, the recognition unit 8 recognizes the shape of the trajectory, that is, gesture recognition based on the gesture recognition dictionary (see FIG. 9) stored in the storage unit 9, and the writer variable existing in the storage unit 9 and The recognition result is registered in the voice variable.
[0044]
The configuration of each part of the system in this embodiment is substantially the same as that in the first embodiment, and the operation also operates according to the flowchart of FIG. Therefore, in the present embodiment, only the part different from the first embodiment, that is, the pen-up process called in step S25 will be described.
[0045]
FIG. 10 is a flowchart showing the pen-up processing operation in the present embodiment.
[0046]
First, in this pen-up process, the CPU 21 acquires the writer identifier (S34), and then stops the sound being output based on the trajectory data corresponding to the acquired writer identifier (S35).
[0047]
Next, the CPU 21 (recognition unit 8) performs gesture recognition (S36). This gesture recognition is performed, for example, by extracting the features of the input trajectory shape as shown in FIG. 9 and calculating the similarity with the gesture shape registered in advance to obtain the shape number. Incidentally, the shape recognition of the trajectory is a known technique and is not the main point of the present invention, as described in Japanese Patent Publication No. 5-67988 and Japanese Patent Publication No. 5-84540. Is omitted here.
[0048]
Finally, the result of gesture recognition is registered in the speech variable table as shown in FIG. 5 as a speech number corresponding to the writer identifier acquired in step S34 (S37). Thus, when the next input or received locus data is drawn, the sound is output according to the corresponding sound number in the sound data table of FIG. As in the case of the first embodiment, the present embodiment also assumes a case where there are a plurality of counterpart terminals, and it is possible to set different voices on the trajectories transmitted by a plurality of counterparts using terminal identifiers. Needless to say.
[0049]
By performing the above processing, even when multiple traces are drawn at the same time, it is possible to determine whether the trace is written by the running application or the trace sent by the other party. Therefore, in the communication system of the trajectory data by pen input, trajectory discrimination can be improved, and operability is improved.
[0050]
【The invention's effect】
The data communication system trajectory according to the invention described in detail above, the trajectory data communication terminal, and according to the trajectory data communications method, when receiving and displaying the locus data from the other party, a specific voice on the locus data Since the data is output simultaneously with the drawing process, it is possible to easily determine the time when the trajectory data is transmitted and to improve the trajectory discrimination.
[Brief description of the drawings]
FIG. 1 is a block diagram illustrating system functions according to the present invention.
FIG. 2 is a block diagram showing a specific hardware configuration according to the present invention.
FIG. 3 is a diagram showing a writer data table according to the present invention.
FIG. 4 is a diagram showing an audio data table in the present invention.
FIG. 5 is a diagram showing an audio variable table in the present invention.
FIG. 6 is a flowchart of the operation of the trajectory data communication system according to the present invention.
FIG. 7 is a flowchart showing a pen-up processing operation in the first embodiment.
FIG. 8 is a flowchart showing a pen-down processing operation in the first embodiment.
FIG. 9 is a diagram showing a gesture recognition dictionary according to the present invention.
FIG. 10 is a flowchart showing a pen-up processing operation in the second embodiment.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 Input part 2 Transmission part 3 Reception part 4 Drawing part 5 Display part 6 Voice generation part 7 Voice output part 8 Recognition part 9 Storage part 10 Input pen 11 Transparent digitizer 12 Input interface 13 Communication interface 14 Communication line 15 Liquid crystal display 16 VRAM
17 Display Controller 18 Synthesizer 19 Speaker 20 Storage Device 21 CPU
100 locus data communication system 101 own terminal 102 partner terminal

Claims (7)

In a trajectory data communication system for transmitting and receiving trajectory data of a trajectory handwritten by a user between a plurality of terminals,
A setting unit configured to associate and set different desired voices used at the time of voice output with respect to the identifier of the trajectory data and the identifier of the drawing request of the application;
Input means for inputting trajectory data;
Transmitting means for transmitting the trajectory data input by the input means to the counterpart terminal;
Receiving means for receiving trajectory data transmitted from the counterpart terminal;
Based on any of the locus data according to the drawing request from the trajectory data and applications entered in the trajectory data and their side terminal from the counterpart terminal received by the receiving unit, the drawing reproduced on a predetermined display means Drawing means to perform,
Recognizing means for recognizing any one of the identifier of the trajectory data received from the counterpart terminal received by the receiving means, the identifier of the trajectory data input at the own terminal, and the identifier of the drawing request of the application that requested the drawing When,
When the drawing unit draws and reproduces the trajectory data related to the identifier recognized by the recognition unit, the voice corresponding to the identifier recognized by the recognition unit is output with reference to the setting content by the setting unit And a voice data communication means. Identifier of the trajectory data, locus data communication system according to claim 1, characterized in that a scribe identifier entered the locus data. The setting means, by recognizing the shape of the input trajectory data, locus data communication according to claim 1, wherein the sound corresponding to the recognized shape and setting with respect to the identifier of the locus data system. A trajectory data communication terminal that receives trajectory data input at a partner terminal and draws and reproduces the trajectory data,
A setting unit configured to associate and set different desired voices used at the time of voice output with respect to the identifier of the trajectory data and the identifier of the drawing request of the application;
Input means for inputting trajectory data;
Receiving means for receiving a signal by specifically had locus data transmission terminal on the other end or, et al.,
Based on any of the locus data according to the drawing request from the trajectory data and applications entered the locus data in the locus data communication terminal from the counterpart terminal received by the receiving unit, on a predetermined display means Drawing means for drawing and reproducing;
Recognition that recognizes one of the identifier of the trajectory data from the counterpart terminal received by the receiving means, the identifier of the trajectory data input in the trajectory data communication terminal, and the identifier of the drawing request of the application that has requested the drawing. Means,
When the drawing unit draws and reproduces the trajectory data related to the identifier recognized by the recognition unit, the voice corresponding to the identifier recognized by the recognition unit is output with reference to the setting content by the setting unit And a voice data communication terminal. 5. The locus data communication terminal according to claim 4, wherein the identifier of the locus data is an identifier of a writer who inputs the locus data. 5. The trajectory data communication according to claim 4, wherein the setting means recognizes the shape of the input trajectory data, and sets a voice corresponding to the recognized shape for the identifier of the trajectory data. Terminal. A trajectory data communication method for receiving and drawing and reproducing trajectory data input at a counterpart terminal,
A setting step for associating and setting different desired voices used at the time of voice output to the identifier of the trajectory data and the identifier of the application drawing request;
A receiving step of receiving a signal by specifically had locus data transmission et or said other terminal,
Based on any of the locus data according to the drawing request from the trajectory data and trajectory data and applications entered at his terminal from the counterpart terminal received in the receiving step, the drawing reproduced on a predetermined display means A drawing step to
Recognizing step of recognizing any one of the identifier of the trajectory data received from the counterpart terminal received in the receiving step, the identifier of the trajectory data input in the own terminal, and the identifier of the drawing request of the application that requested the drawing When,
When drawing and reproduction of the trajectory data related to the identifier recognized by the recognition step is performed in the drawing step, the voice corresponding to the identifier recognized by the recognition step is referred to by referring to the setting content by the setting step. A trajectory data communication method comprising: an audio output step for outputting.

Images