JPH1165752A - Data editing device and its method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To perform the data relating editing without losing the original semantics of time by designating the 3rd data which are newly related to the 1st data and relating the 1st data to the 3rd data via the additional information. SOLUTION: An editing additional information selection part 24 refers to the additional information on the pen data related to the pen data and the sound data to detect that only the additional information on the types of 'time' are added and selects the additional information to relate the pen data to the sound data. When an editing additional information selection part 26 selects the additional information for the data relating editing, a relating change part 27 opens the sound data which are already related to the pen data and then relates the sound data to the new sound data. Then the part 27 retrieves both pen and sound data having the types of additional information and adds the additional information on the types of 'edit' by means of the integer value larger by 1 than the maximum value of the pen and sound data and also by means of an ID of '3'.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a data editing apparatus and a data editing method for storing a plurality of pieces of additional information to data and for associating the data with the additional information.

[0002]

2. Description of the Related Art Conventionally, various devices have been developed for simultaneously recording a handwriting locus (hereinafter referred to as pen data) and a sound (hereinafter referred to as sound data) of a pen drawn on a screen using a portable pen computer. Have been. For example, such a device is designed to associate pen data with sound data so that pen data specified by a user and sound data "simultaneously recorded" can be retrieved and reproduced after recording the data. ing.

As a devised method for this association, as described in JP-A-6-176171, when pen data is recorded, the time at which the pen data was recorded is simultaneously recorded, and the sound data is recorded. This is realized by simultaneously recording the time at which the sound data was recorded at the time of recording, referring to the time for each of the pen data and the sound data, and specifying the pen data and the sound data recorded at the same time.

In the example described in this publication, in order to specify that the pen data is recorded at the same time, the user first specifies pen data displayed on the screen, and the pen data is recorded simultaneously with the pen data. In this case, the sound data including the time when the pen data is recorded is searched for from the time of the recorded sound data.

[0005]

On the other hand, in an apparatus for simultaneously recording pen data and sound data, pen data associated with existing sound data is associated with newly recorded sound data (the already recorded sound data). (Exchange sound data with new sound data). In this case, this "edit of association" is realized by changing "time (information) at which pen data was recorded" to the same time as "time (information) at which sound data was recorded" which was newly recorded. be able to.

However, when "editing the association" is performed by this method, the "time recorded at the same time as the pen data" is changed by the editing, the time when the pen data was recorded is lost, and the pen data is lost. The information of when it was recorded loses its original meaning. That is, it becomes impossible to specify the time and extract the pen data drawn in the range, or to automatically reproduce the pen data in the order of the recorded time.

Therefore, the present invention makes it possible to "edit association" of data recorded in association with time (information) and the like without additional information such as time (information) without losing the temporal meaning inherent in time (information). It is an object to provide a data editing device and a data editing method.

[0008]

In order to achieve the above object, the present invention relates to a method in which first data such as characters and second data such as voice are associated with first data and second data. What is claimed is: 1. A data editing apparatus and method for changing a third data such as a voice different from data so as to be newly associated with the third data, wherein an instruction for changing the association between the first data and the second data is provided. Is obtained, additional information for newly associating the first data with the third data is selected, third data to be newly associated with the first data is designated, and the first information is added via the additional information. A data editing apparatus and method are provided, wherein data is associated with third data.

[0009]

BEST MODE FOR CARRYING OUT THE INVENTION

(Embodiment 1) An embodiment of the present invention will be described below with reference to the drawings. Here, the time (information) at which the pen data and the sound data were recorded using the portable terminal device is set as additional information, and each data recorded (associated) at the same time via this additional information already exists. Will be described. Further, of the pen data recorded on the screen by the user, the association between the pen data designated by the user and the sound data recorded at the same time is released, and the pen data newly associated with the newly recorded sound data is released. A method of implementing “editing association” without losing the meaning of the additional information (time (information)) of the pen data will be described in detail in particular.

First, FIG. 1 shows an appearance of the portable terminal device. The apparatus includes a pen 10 for inputting pen data, a tablet 11, a liquid crystal panel 12 for displaying each pen data input by the pen 10, a microphone 13 for inputting sound data, a speaker 14 for reproducing sound data, and various buttons. Consists of The pen 10 is for the user to directly write characters and the like on the tablet 11.

In FIG. 1, “conference materials” are displayed on the liquid crystal panel 12.
Displayed above is a state in which the recording start button 15 is operated and a comment is drawn on the material with the pen 10 while recording the state of the meeting with the microphone 13. The conference materials and the like are displayed on the liquid crystal panel 12, and the pen 10
There is already a device that records characters and the like by using. The meeting material may be read from a built-in disk, sent from a network, or received by wireless. The example of FIG. 1 illustrates a state in which two pieces of pen data 1 and 2 are input by a user at a certain timing. One is the next meeting place "Meeting room" A "", which was verbally conveyed to the right of "Next meeting place: undecided" in the meeting materials.
Is drawn (pen data 1), and the other is a star-shaped figure (pen data 2) indicating that it is important to the left of ".brief headline" in the meeting material.

At the time of recording each of the pen data 1 and 2, each sound data acquired by the microphone 13 is associated with each other. When the pen data 1 is drawn, the moderator of the conference says, "The next conference will be Building A. In the conference room. "
The sound data (sound data 1) is associated with the pen data 1. Also, when the pen data 2 is drawn, the voice of the user who drew “this is important” is associated with the pen data 2 as this sound data (sound data 2). The capture of the sound data is started by operating the recording start button 14. When only a sound having a predetermined volume or more is detected, the sound data is captured (stored) as sound data. As such a mechanism, an established one can be used. However, not all the captured sound data can be associated with the pen data, and the sound data at almost the same time as the time when the pen data was recorded (including a case near or overlapping the time) is used. Associated. The time mentioned here may be an absolute time (clock time) or a time inside the portable terminal device.

FIG. 4 schematically shows a data structure in which pen data and sound data are stored in association with each other via additional information. The pen data 1 and 2 contain “Ti
The time is stored in the item of additional information of the type “me”. On the other hand, the sound data 1 and 2 also store the time in the item of additional information of the type “Time”. FIG.
Is the same time as the time when the pen data was recorded and the time when the sound data was recorded, and the pen data is respectively associated with the sound data.

The pen data 1 has a time "'10" 00
-'10''12 "(10:00 to 10:12)
At the same time "'1
0 "00-'10" 12 "(10:00 to 10
12:00). In this case, since all the times (sections) overlap, the pen data 1 is associated with the sound data 1 via additional information of the type of time. The same applies to pen data 2 and sound data 2.

FIG. 2 shows the overall configuration of the present apparatus.
With reference to the flowcharts of FIGS. 2 and 3, a method of performing association editing of data associated with the additional information (time information) illustrated in FIG. 4 will be described. FIG. 3 shows a procedure for performing association editing. The pen data 1 and 2 shown in FIG. 4 are stored in the storage unit 20 in advance according to the procedure described above, and the display control unit 21 controls the tablet 11.
(The screen of the liquid crystal panel 12). The sound data shown in FIG. 4 is stored in the storage unit 30,
The reproduction can be reproduced from the speaker 13 by the reproduction control unit 29.

Here, pen data 2 displayed on the screen
The operation procedure of performing “association editing” of releasing the association between the pen data 2 and the newly recorded sound data (sound data 3) by releasing the association with the sound data 2 recorded at the same time as explain.

First, the user looks at the pen data displayed on the screen and designates pen data 2 from the pen data. The pen data is specified by performing a mode specification (using a button or the like (not shown): S40) for performing “association editing”, whereby the pen data specification unit 22 in FIG. When the user looks at the pen data displayed on the screen and searches for the pen data 2, the user touches the displayed liquid crystal panel 12 with the pen 10. Thereby, the pen data specifying unit 2
2 detects coordinates (Xt, Yt) on the tablet 11 to determine where on the tablet 11 the pen 10 has touched. The pen data designating unit 22 stores all of the coordinates (Xn, Yn) of all the pen data stored in the storage unit 20,
The distance from the coordinates (Xt, Yt) is expressed by, for example, the formula ((X
t−Xn) ** 2+ (Yt−Yn) ** 2)
The pen data including the coordinates having the minimum value is searched.

In this example, there are only two pieces of pen data, pen data 1 and pen data 2. Since the user touches the pen data 2, the pen data 2 is specified by the pen data specifying section 22. .

Next, the user specifies a mode for editing the association of associating the pen data 2 with the sound data 3 to be newly recorded (using a button or the like (not shown): S
Perform 41). By this designation, the editing instruction unit 23 of FIG.
Drives. When the user presses the new sound data association button 16 after selecting the pen data 2, the editing instruction unit 23 detects which pen data is specified by the pen data specifying unit 22, and the sound to be newly recorded with the pen data 2. Instruct to associate with data 3. Then, the user presses the recording start button 14 to start recording the sound data 3, and outputs the sound “point here” to the microphone 1.
7, the recording is stopped by pressing the recording stop button 15, and the sound data 3 is stored in the storage unit 30. At this time, the time when the sound data 3 was recorded is added to the additional information of the type “Time” in the sound data 3 and stored in the storage unit 30. This is shown in FIG.

Next, the type of additional information used for editing is selected by the additional information selecting section 24 for editing in FIG. 2 (S4).
2). The editing additional information selecting unit 24 refers to the additional information of the pen data 2 and the sound data 3 associated with the pen data 2 and detects that only additional information of the type “Time” is added. In the additional information selection table storage unit 25 of FIG. 2, priority order information indicating which type of additional information is to be prioritized and associated is stored in the additional information selection table as shown in FIG. Pen data 2 and sound data 3 using any additional information
Select whether to associate with.

In the additional information selection table shown in FIG. 7, for example, in the case of association editing, if the association has already been performed using the additional information of the type “Time” in the past, the “Edit” of the next priority order Is used. When the additional information used for association editing is selected by the additional information selecting unit for editing 26, the association changing unit 27 of FIG. 2 releases the sound data 2 already associated with the pen data 2 and newly creates the sound data 3 with the sound data 3. The association is performed (S44, 45).

First, the association changing unit 27 searches all pen data and sound data having the type of additional information selected by the additional information selecting unit for editing 26, and obtains an integer one greater than the maximum value. In this way, this value is unique as far as the selected additional information is concerned (S4
3). Then, the association change unit 27 uses this value to add additional information of the type “Edit” using the ID “3” as shown in FIG. 6 (S44, 45).

A method of reproducing the data that has been subjected to the association editing will be described with reference to FIG. First, pen data displayed on the screen is specified by the pen data specifying unit 22 in FIG. Then, the reference additional information selection unit 24 stores the additional information selection table storage unit 2
With reference to the contents of No. 5, it is checked which type of additional information is used for association.

In the example of FIG. 6, the pen data 2 contains "Tim
Although two types of additional information, the type of “e” and the type of “Edit”, are added, the “Edit” type has a higher priority than the “Time” type in the additional information selection table shown in FIG. It is detected that the association is performed using the “Edit” type. Then, the fact that the ID of “3” is added to the “Edit” type is obtained by referring to the storage unit 20. Then, the sound data search unit 2
Reference numeral 8 designates, from the sound data stored in the storage unit 30, the sound data in which the ID of "3" is added to the "Edit" type by referring to the value of the "Edit" type of all the sound data. I do. Since this ID is unique at the time of association editing, a plurality of sound data is not searched. In this way, the sound data 3 which is the sound data of the “Edit” type and having the ID of “3” is specified. Then, the reproduction control unit 29 reads out the sound data of the sound data 3 specified by the sound data search unit 28 from the storage unit 30 and reproduces the sound data from the speaker 13 attached to the housing.

As described above, in the association editing, the pen data 2 having higher priority than the additional information used in associating the pen data 2 with the sound data 2 associated before the editing is used. Is associated with the sound data 3, and thereafter, the association is performed using the additional information having the highest priority. Therefore, the association by the additional information added up to that point becomes invalid.

By providing such a mechanism, for example, a handwriting locus of the pen 10 recorded during the time ('10''00-'10''12) is obtained. Even after editing, it is possible to perform a search using another meaning of the temporal context of the added time information.

Another example showing the effectiveness of the present invention is to automatically reproduce sound data associated with handwritten trajectories of the pen 10 one after another in the order of recording time. In the editing according to the present invention, the time information added to the handwriting locus of the pen 10 is not changed. Therefore, during automatic reproduction, the sound data is reproduced in the same order as the handwriting locus of the pen 10 during reproduction before editing. I can do it. Moreover, as the sound data of the handwriting locus of the pen 10 that has been edited, the newly recorded sound data is reproduced.

(Embodiment 2) In the first embodiment, the reference additional information selecting section 24 performs the selection based on the contents of the additional information selection table storage section 25, but as shown in FIG. The additional information may be stored in the storage unit 20 and the storage unit 30 to store which additional information is used for the association, and the additional information may be selected by referring to this.

(Embodiment 3) In the first embodiment, the "Edit" type additional information is used as the additional information used for the association in editing, but the sound data to be edited is an independent file. May be used as the file name.

[0030]

According to the present invention, it is possible to perform the association editing without losing the meaning of the already added additional information.

[Brief description of the drawings]

FIG. 1 is an external view of the present invention.

FIG. 2 is an overall configuration diagram of the present invention.

FIG. 3 is a procedure for changing an association.

FIG. 4 shows data before association editing.

FIG. 5 shows a state of data being edited for association.

FIG. 6 shows the state of data after association editing

FIG. 7 shows the contents of an additional information selection table.

FIG. 8 shows data with an association additional information tag.

[Explanation of symbols]

 REFERENCE SIGNS LIST 20 storage unit 21 display control unit 22 pen data designation unit 23 editing instruction unit 24 reference information selection unit 25 additional information selection table storage unit 26 editing additional information selection unit 27 association change unit 28 sound data search unit 29 playback control unit 30 Memory

Claims (4)

[Claims] 1. Newly associating associated first data such as characters and second data such as voice, and first data and third data such as voice different from the second data. A data editing apparatus for changing the association between the first data and the second data; and a means for giving an instruction to change the association between the first data and the second data; Means for selecting additional information for associating the first data, means for specifying third data to be newly associated with the first data, means for associating the first data with the third data via the additional information A data editing device comprising: And means for retrieving the first data from the first data and the third data associated with each other by the data editing apparatus according to claim 1. Means for extracting, means for searching for third data associated with the additional information extracted by this means, and means for reproducing the third data searched for by this means. Data editing device. 3. Newly associated first data such as characters and second data such as voice, and associated first data and third data such as voice different from the second data. In the data editing method for changing the first data and the second data, an instruction for changing the association between the first data and the second data is obtained, and the first data and the third data are newly associated. A third data to be newly associated with the first data, and associating the first data with the third data via the additional information. Method. 4. The first data and the third data associated with each other by the data editing method according to claim 3, extracting the additional information when searching for the first data, and associating the additional information with the additional information. A data editing method comprising: searching for retrieved third data; and reproducing the retrieved third data.