JPH10134029A - Multimedia message recording and reproducing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a user interface which easily recording a sound and draw an image while switching still pictures and to switching still pictures in the same timing with the recording at the time of reproduction by performing recording in the same format with other operations according to index information and reproducing recorded events according to time information as to selecting operation for stored still pictures. SOLUTION: This device is equipped with an image index information generation part 110 which generates and stores reference information on image files registered from an image input/output part 107. Then, an event analysis and reproduction part 104 records events in the same format with other events in an event recording part 106 on the basis of the identifier of image information obtained on the basis of the kinds of events and image index information by an image index information generation part 110 for switching events of images. Consequently, sound recording and drawing can easily be performed and reproduction can be performed in the same timing with the recording.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multimedia message recording / reproducing apparatus for generating a multimedia message composed of images and sounds and recording / reproducing the multimedia message.

[0002] In particular, a message is created and recorded by adding a sound or a drawing by a pointing device such as a mouse to a still image, and when a player reproduces the still image, the sound or drawing information is generated at the same timing as when the message was created. The present invention relates to a multimedia message recording / playback apparatus that is played back in synchronization.

[0003]

2. Description of the Related Art In a conventional system for transmitting and receiving multimedia messages, a multimedia mail system using the MIME protocol is found in a system used for transmitting temporary requirements, such as an electronic mail system. As described above, images and sounds are handled independently as separate media, and are played back independently.

Also, when a still image is drawn using a pointing device such as a mouse, the image is generally transmitted as part of the image information at the time of transmission.

In the multimedia mail system disclosed in Japanese Patent Application Laid-Open No. 8-83224, the drawing information is provided with a time so that the sound and the drawing by the pointing device can be reproduced on the receiving side at the same timing as when recording. Configuration.

[0006]

However, the method disclosed in Japanese Patent Application Laid-Open No. 8-83224 does not have a mechanism for recording while switching the page of a still image serving as background information. A message cannot be created while switching a still image to be a topic during recording.

That is, since the recording format does not have time information relating to still image recording, for example, when sound addition or drawing is performed while changing pages of a plurality of still images,
The switching of the still image as the background cannot be reproduced at the same timing as the recording.

A first object of the present invention is to solve the above-mentioned problems and to provide a user interface for easily performing voice and drawing while switching still images, and to reproduce switching of still images at the same timing as recording. Is to make it possible.

Further, in the above-mentioned conventional method, only a voice or a drawing by a mouse operation can be reproduced at the same time as a still image as a background of a message, and an image or an image with audio information is added to the still image. Means for recording / reproducing as additional information of a specific part of the above have not been provided.

A second object of the present invention is to provide a recording apparatus for recording voice, drawing, etc. based on the passage of real time.
It is an object to provide means for recording and reproducing an image or an image with audio information as additional information of a specific portion of a still image.

It is another object of the present invention to provide a means for allowing a person who has received a message for additional information to independently select the additional information and instruct reproduction.

Further, the drawing of the symbol indicating the attachment of the additional information is changed according to the type of the additional information, so that the message of the player can be easily understood.

The present invention also provides a terminal (telephone,
It is an object of the present invention to provide a unit that enables a part of a multimedia message to be obtained from a fax.

[0014]

SUMMARY OF THE INVENTION In order to solve this problem, the present invention firstly provides a voice input / output unit for recording and reproducing voice, a voice recording unit for storing input voice, a mouse and the like. A pointing device, an image input / output unit for inputting and displaying image information, an image recording unit for storing the input image information, and an event analysis / reproduction unit for detecting and analyzing the respective inputs and controlling the operation of the apparatus. A timer for monitoring the execution time, an event recording unit for recording the operation analyzed by the event analysis and reproduction unit as an event together with time information obtained from the timer, and an index of a plurality of image files input from the image input / output unit. An image index information creating unit for creating and accumulating information, wherein the event analysis and playback unit is provided with the image recording unit as a background image of a multimedia message. The stored still image selection operation is recorded in the event recording unit in the same format as other operations based on the index information created by the image index information creation unit, and the event recorded in the event recording unit is recorded according to the time information. It has means for reproducing.

This provides a user interface for easily recording and drawing while switching between still images.
At the time of reproduction, the still image can be switched at the same timing as at the time of recording.

Secondly, in addition to the first means, the event analysis / reproduction unit includes an event determination means for detecting an input event, and media for recording the contents of the drawing / audio / still image input and the time. A time information recording means, a recording event interpretation and reproduction means for interpreting and reproducing the event record, and a drawing / additional information attachment operation determining means for detecting an instruction from the pointing device and determining whether the operation is a drawing operation or an additional information attachment operation; In the case of an additional information attachment operation, an attachment position acquisition unit for acquiring an attachment position on a still image to be added, and an additional information attachment operation order / time recording unit for recording a recording order and an execution time in an event record. At the time when the timing for reproducing the additional information has been reached, an attached position drawing that displays a symbol indicating that the additional information is attached at a position on the still image to which the additional information is attached. And means, has a configuration provided with the additional information display position determining means for calculating the position of displaying the attached additional information.

Thus, it is possible to display the additional information attachment position and reproduce the additional information at the timing intended by the producer.

Third, in addition to the second means, the event analysis / reproduction unit detects that the pointing device has selected a certain range from the position coordinates on the still image to which the additional information has been attached by using a pointing device. It is configured to include a detecting means and a selected additional information reproduction instructing means for instructing reproduction of the additional information selected in response to the detection information.

Thus, the person who has received the message can independently select and display the additional information.

Fourth, in the second means, after the event analysis / reproduction unit detects the operation of the pointing device for the operation of attaching the additional information to the still image,
A PD operation / drawing pattern correspondence table for recording the correspondence between the operation of the pointing device and the drawing pattern;
It has a drawing pattern selecting means for selecting a drawing pattern to be reproduced according to the drawing pattern acquired from the correspondence table.

Thus, the drawing can be changed depending on the type of the additional information, so that the player can easily understand the message.

Fifth, in addition to the first means, a message transmitting / receiving section for transmitting / receiving a multimedia message via a network, and the message transmitting / receiving section is provided with a communication interface for a plurality of different line types such as a public line and a LAN. Heterogeneous communication interface provided, telephone,
When a request to play back a message received from a facsimile is requested, a structure including playback medium selection means for playing only information suitable for each terminal from the received message, and data conversion means for converting the information into data suitable for the playback medium. Has become.

Thus, it is possible to obtain a part of the information of the message created by the recording / reproducing apparatus from a terminal (telephone, facsimile) other than the apparatus.

[0024]

(Embodiment 1) Hereinafter, a first embodiment of the present invention will be described with reference to FIGS. 1, 2, 3, 4, and 5. FIG.

FIG. 1 is a functional block diagram showing the configuration of the multimedia message recording / playback apparatus. FIG.
Example of creating image index information in the present embodiment,
FIG. 3 is an example of event record data according to the present embodiment, FIG. 4 is a flowchart for explaining an operation at the time of recording of the present embodiment, and FIG. 5 is a diagram for explaining an operation at the time of reproduction according to the present embodiment. It is a flowchart.

A still image to be a topic at the time of creating a message is fetched from the image input / output unit 107 in FIG. 1 and registered in the image recording unit 108. At this time, the fetched order is stored, the image index information creating unit 110 creates image index information as shown in FIG. 2, and registers the image index information in the image recording unit 108.

Reference numerals 202, 203, and 204 in FIG. 2 denote identifiers of the captured still images.
Stores the order relation.

Next, a procedure for creating a message message based on the captured still image will be described. Select a still image to be talked about through the image input / output unit, and
When a message is created by giving a voice or drawing using the (mouse) 103 and the voice input / output unit 102, the event analysis / reproduction unit 104 causes the voice input / output unit 102 and the PD 10
3 and detects the input event from the event recording unit 10 based on the time information from the timer 105.
Register in 6.

At this time, if the switching of images is detected by the event analysis / reproduction unit 104, the image index information creation unit 110 determines the type of event (previous page, next page).
Then, an identifier of the image information is acquired based on the image index information 201 in FIG. 2, and registered as an event record in the event recording unit 106 in a format as shown in FIG.

FIG. 3 is a diagram in which the message creation result shown in FIG. 4 is registered as an event at the time of reproduction. The PD drawing of FIG. 4 is used for the PD drawing of FIG. 3, and the recording of FIG. ,
The still image switching in FIG. 4 corresponds to the background image display in FIG.

Next, when the event analysis / reproduction unit 104 receives an end event for creating a message message, the message transmission / reception unit 109 sends a message based on the information of the voice recording unit 101, the event recording unit 106, and the image recording unit 108. And send it to the destination in an email or other format.

Next, the procedure of reception and reproduction will be described with reference to the flowchart of FIG. Message transmitting / receiving unit 109
Receives the message, the message content is developed in the image recording unit 108, the audio recording unit 101, and the event recording unit 106 based on the recorded content shown in FIG.

Next, when the event analysis unit 104 receives the event of the reproduction start instruction, the event recording unit 106 shown in FIG.
Are sequentially interpreted to reproduce the recorded events. The time obtained from the timer 105 is compared with the execution time interval obtained from the event recording, and if the time reaches the reproducible time, the following operation is performed depending on the type of event.

That is, if the event is a sound event, the sound is reproduced from the sound input / output unit 102 based on the identifier of the sound to be reproduced from the sound recording unit 101. In the case of drawing information by PD, in the case of background image display in which a point is displayed at the pointed coordinates, background image information is exchanged based on the image identifier and displayed from the image input / output unit 108.

In the drawing by the PD, the drawing process is recorded in the event record, and the drawing of a curve or the like is achieved by continuously recording and reproducing the drawing of the above points.

In this embodiment, the configuration has been described in which the created multimedia message is transmitted to another multimedia message recording / reproducing apparatus in the form of e-mail or the like and is reproduced by the receiving apparatus. A configuration for reproducing a multimedia message created by the created device can be similarly described.

As described above, according to the present embodiment, an audio input / output unit for recording and reproducing audio, an audio recording unit for storing input audio, a pointing device such as a mouse, and image information are input. An image input / output unit to be displayed, an event analysis / reproduction unit that detects each input and controls the operation of the device, a timer that monitors the execution time, and an event recording unit that records the content analyzed by the event analysis / reproduction unit, It has a message transmitting / receiving unit for transmitting and receiving messages over a network.While displaying a still image, it inputs audio from an audio input / output unit, draws a still image as a background from a pointing device such as a mouse, and draws a message message etc. Create and record multimedia messages, and synchronize audio and drawing information at the same timing as information recording In the multimedia message recording and reproducing apparatus for raw includes an image index information creation unit that creates storing reference information of a plurality of image files registered from the image input unit, the event analyzing reproducing unit,
Event type (previous page, next page) for image switching event by the image index information creation unit
Based on the identifier of the image information acquired based on the image index information, the event is recorded in the event recording unit in the same format as the other events, so that the still image can be switched even for a plurality of still images. Voice and drawing can be easily performed, and switching between voice, drawing and still image can be reproduced at the same timing as when recording.

(Embodiment 2) A second embodiment of the present invention will be described below with reference to FIGS. 6, 7, 8, 9, and 10.

FIG. 6 is a logical block diagram showing the configuration of the event analysis and reproduction unit 104 of FIG. 1 in the present embodiment. FIG. 7 illustrates the contents of the event record recorded in the event recording unit 106 according to the present embodiment. FIG. 8 illustrates a method of determining a display position when reproducing additional information according to the present embodiment. FIG.
9 is a flowchart illustrating a recording procedure according to the present embodiment. FIG. 10 is a flowchart illustrating a reproduction procedure according to the present embodiment.

First, the operation at the time of recording will be described with reference to the flowchart of FIG. When the recording / reproducing apparatus described in the first embodiment receives an instruction to attach additional information from the state of recording audio and drawing by the drawing / additional information attachment operation determining unit 601 in FIG. The state of the device changes, and the operation in FIG. 9 starts.

First, when a still image is attached, an image is input, and when a sound is attached, a sound is recorded by each media time information recording means 605. In the case of voice input, the timer 105 in FIG. 1 of the first embodiment is operated to acquire the time at which the voice was input.

Next, an attachment position input is accepted, and the event is monitored until an input event occurs. When the event determining unit 604 determines that the attached position of the additional information has been input, the attached position acquiring unit 602 acquires the position coordinates on the still image to which the additional information is attached.

Next, additional information operation order / time recording means 60
3, the event execution order, the media identifier (audio / image), the position coordinates in the still image to which the additional information is attached,
The time for reproducing the additional information is output to the event recording unit 106 in FIG. 1 in the format of FIG.

The time for reproducing the additional information, that is, the interval time between events in FIG. 7 is set in consideration of the time when the voice of the additional information is input.

Next, the operation at the time of reproduction will be described with reference to the flowchart of FIG. First, the event interpretation and reproduction unit 104 sequentially retrieves and interprets reproduction events from the event recording unit. If the content of the event is other than the reproduction of the additional information, the subsequent operation is the same as in the first embodiment.

In the case of reproducing the additional information (when the event type in FIG. 7 is "additional information"), the additional information is attached to the additional information attachment position on the already displayed still image according to the content of the event record. 6 is drawn by the attached position table drawing / displaying means 606 in FIG.

Next, the recording event interpretation / reproduction means 608 reproduces the media (audio / still image) of the additional information. Here, in the case of displaying a still image as additional information, the additional information display position determining unit 607 divides a still image serving as a background image into four parts as shown in FIG. Calculate by determining the position that does not obstruct the display of the position as much as possible.

In FIG. 8, reference numeral 801 denotes still image information serving as a background image, 802 denotes a circle centered on the position where the additional information is attached, and 803 denotes a line for associating the still images 804 and 802 as the additional information.

Next, when a sound is attached, the sound is reproduced by the recorded event interpretation / reproduction means 608, and the event interval time obtained from the event recording of FIG.
The elapsed time 05 is compared to monitor the end of the reproduction, and if the reproduction is ended, the next event is reproduced.

As described above, according to the present embodiment, the event analysis / reproduction unit includes an event determination unit for detecting an input event, and media / time information for recording the contents of the drawing / still image input and the time thereof. In addition to the recording means, P
Drawing / additional information attachment operation determining means for detecting an instruction from D and determining whether the operation is a drawing operation or an additional information attachment operation, and an attachment for acquiring an attachment position on a still image to be added if the additional information attachment operation A position obtaining means, and an additional information attaching operation order / time recording means for recording a recording order and an execution time in the operation record, and using a PD to record a position on the still image to which the additional information is attached at the time of recording. In addition to the recording event interpretation / reproduction means for generating the attached record of the additional information accompanied by the time information and interpreting and reproducing the recorded additional information by the event analysis / reproduction unit, the timing for reproducing the additional information At the time of reaching the position of the still image to which the additional information is attached, the attachment position drawing means for displaying a sign indicating that the additional information is attached, and displaying the attached information. By having the additional information display position determining means for calculating a location, it is possible to reproduce and display the additional information in the additional information attachment position in the intended timing of the message creator.

(Embodiment 3) Hereinafter, a third embodiment of the present invention will be described with reference to FIGS. 11, 12, and 13. FIG. FIG. 11 is a logical block diagram illustrating the internal configuration of the event recording / reproducing unit of FIG. 1 in the present embodiment.
FIG. 12 is an example of an initial state at the time of reproduction in the present embodiment. FIG. 13 is a flowchart describing the message playback operation in the present embodiment.

The sender creates and transmits a message with additional information in the same procedure as in the second embodiment.

The receiver of the message develops and stores the message in the event recording unit 106, the audio recording unit 101, and the image recording unit 108 in FIG. 1, as in the first embodiment.
Then, similarly to the second embodiment, the event is reproduced by the recorded event interpretation / reproduction means according to the time information.

FIG. 13 shows the operation after one event is reproduced according to the time information. The additional information attached position drawing means 1106 of FIG. 11 draws a symbol such as a circle in a certain range around the coordinates of all the positions where the additional information is attached on the still image as shown in FIG. FIG.
In FIG. 2, reference numeral 1201 denotes a background still image; 1202, coordinates to which additional information is attached; 1203, a circle centered on 1202;

Next, when the receiver presses (clicks) the circle 1203 indicating the attachment of the additional information on the displayed still image with a pointing device in order to interactively select and reproduce the additional information, This recording / reproducing apparatus detects that the additional information is selected by the additional information selection detecting means 1109 in FIG.

Next, the event recording unit of FIG. 1 is searched from the selected coordinates, and the contents of the selected additional information are obtained. The content of the selected additional information is reproduced by the selected additional information reproduction instructing unit 1110 in FIG. 11 as in the second embodiment.

As described above, according to the present embodiment, the additional information selection detecting means for detecting that the PD has selected a certain range from the position coordinates on the still image to which the additional information is attached, Providing the selected additional information reproduction instructing means for instructing the reproduction of the additional information selected in response to the detection information enables the person who has received the message to independently select and display the additional information.

(Embodiment 4) Hereinafter, a fourth embodiment of the present invention will be described with reference to FIGS. FIG. 14 is a logical block diagram illustrating the internal configuration of the event recording / reproducing unit 104 of FIG. 1 in the present embodiment.
FIG. 15 shows an example of a correspondence table between the operation of the pointing device, the processing pattern during reproduction, and the drawing pattern during reproduction according to the present embodiment.

At the time of recording, the attached position acquisition means 1402 of the event recording / reproducing unit shown in FIG. 14 determines whether the creator has single-clicked or double-clicked the pointing device (for example, a mouse) together with the attached position, and determines the type. The event is recorded in the event type of the event recording in FIG.

At the time of reproduction, the event record is interpreted in the same manner as in the third embodiment, and the symbol indicating the attachment position is drawn by the attachment position drawing instructing means 1406. At this time, a drawing pattern is obtained by searching the PD operation / drawing pattern correspondence table of FIG. 15 from the event type obtained by the drawing pattern selection means 1409 of the event recording unit. If the event type is single click, a circle is drawn, and double click is performed. If the circle is rippled 2
Draw multiple times.

After the drawing, the timing of the end of the reproduction of the additional information is waited. When the reproduction is completed, the drawing contents indicating the attachment position are deleted.

As described above, according to this embodiment, after detecting the operation of the pointing device for the operation of attaching the additional information to the still image, the correspondence between the operation of the pointing device and the drawing pattern is recorded. By having a PD operation / drawing pattern correspondence table and a drawing pattern selecting means for selecting a drawing pattern to be reproduced according to the drawing pattern obtained from the correspondence table, the drawing is changed according to the type of the additional information to understand the message of the player. Can be facilitated.

(Embodiment 5) A fifth embodiment of the present invention will be described below with reference to FIGS.

FIG. 16 shows a configuration of a multimedia message recording / reproducing apparatus according to the present embodiment.
This is obtained by adding a heterogeneous communication interface unit 1611 to the configuration of FIG. FIG. 17 illustrates the internal configuration of the event analysis and playback unit 1604 in FIG. 16 according to the present embodiment. FIG. 18 is a flowchart for explaining the present embodiment.

The operation flow will be described with reference to FIG. An operation of reproducing information recorded in the second embodiment from a telephone with a FAX function will be described as an example. There is an access from a telephone with a facsimile to the heterogeneous communication interface 1611 in FIG. 16, and the event analysis / reproduction unit gives the reproduction request event.

FIG. 17 The reproduction medium selection means 1709 performs reproduction according to the same procedure as in the second embodiment if the recording / reproduction apparatus is used, and if the request is from a telephone or a facsimile, depending on the type of terminal requesting the reproduction. , According to the following example.

First, as playback for telephone, events related to audio are sequentially acquired from the event recording unit 1606.
The sound is reproduced in the event recording order, and the sound is transmitted to the telephone line via the heterogeneous communication interface 1611. When the reproduction of all the voice events is completed, the reproduction ends when the terminal is a telephone, and the following procedure is further executed when the terminal is a facsimile-equipped telephone.

All the events relating to the still images are acquired from the event recording file, and all the records of the drawing on each still image are acquired from the event recording file. FIG. 17 The data conversion unit 1710 overwrites the drawing trajectory on the still image, and further performs conversion to FAX transmission data such as binary image conversion and MH compression.

FAX transmission is performed by the ITU-T T.30 FAX transmission procedure via the heterogeneous communication interface 1611. When the fax transmission ends, the reproduction ends.

As described above, according to the present embodiment, a heterogeneous communication interface unit for providing a communication interface with a plurality of different line types such as a public line and a LAN, and reproduction of a message received from a telephone or a facsimile. When requested, the recording / reproducing apparatus includes a reproducing medium selecting unit that reproduces only information suitable for each terminal from a received message and a data converting unit that converts data into data suitable for the reproducing medium. It is possible to acquire a part of information from a terminal (telephone, facsimile) other than the present recording / reproducing apparatus.

[0071]

As described above, according to the present invention, the first
An image index information creating unit that creates and stores index information of a plurality of image files, wherein the event analysis and playback unit performs a selection operation of a still image stored in the image recording unit as a background image of a multimedia message. According to the present invention, there is provided a user interface for easily recording and drawing while switching a plurality of still images (background images) by recording and reproducing the same format as other operations based on the index information created by the image index information creating unit. And
At the time of reproduction, the still image can be switched at the same timing as at the time of recording.

Second, in addition to the above configuration, the event analysis / reproduction unit includes an event determination means for detecting an input event,
In addition to the media and time information recording means for recording the contents of the drawing, audio, and still image input and their time, and the recording event interpretation and reproduction means for interpreting and reproducing the event record, an instruction from the pointing device is detected and the drawing operation is performed. A drawing / additional information attachment operation determining unit that determines whether the operation is an additional information attachment operation, an attachment position acquisition unit that acquires an attachment position on a still image to be added in the case of an additional information attachment operation, Additional information attaching operation order / time recording means for recording the recording order and execution time, and when the timing for reproducing the additional information is reached, the additional information is attached to a position on the still image to which the additional information is attached. Position drawing means for displaying a sign indicating that the information is provided, and additional information display position determining means for calculating a position at which the attached additional information is displayed, thereby providing the intention of the creator. It becomes possible to at the timing of reproducing the display and additional information of the additional information attached position.

Third, the event analysis / reproduction unit sets the PD to a certain range from the position coordinates on the still image to which the additional information is attached.
The additional information selection detecting means for detecting that the additional information has been selected, and the selection additional information reproduction instructing means for instructing the reproduction of the selected additional information in response to the detection information, the person who received the additional information message Can independently select and display.

Fourth, a PD operation / drawing pattern for recording the correspondence between the operation of the PD and the drawing pattern after the event analysis / reproduction unit detects the operation of the PD for the operation of attaching the additional information to the still image By having a correspondence table and a drawing pattern selecting means for selecting a drawing pattern to be reproduced in accordance with the drawing pattern acquired from the correspondence table, the drawing is changed according to the type of the additional information, so that the player can easily understand the message. .

Fifth, a message transmission / reception unit for transmitting / receiving multimedia messages via a network, and a heterogeneous communication interface unit for providing the message transmission / reception unit with a communication interface with a plurality of different line types such as a public line and a LAN. A reproduction media selection unit that reproduces only information suitable for each terminal from a received message when reproduction of a message received from a telephone or a facsimile is requested, and a data conversion unit that converts the information into data suitable for the reproduction medium. , It is possible to acquire a part of the multimedia message from a terminal (telephone, facsimile) other than this apparatus.

[Brief description of the drawings]

FIG. 1 is a functional block diagram showing a configuration of a multimedia message recording / playback apparatus according to Embodiment 1 of the present invention.

FIG. 2 is a diagram illustrating an example of creating image index information according to the first embodiment of the present invention;

FIG. 3 is an example of event record data according to the first embodiment of the present invention;

FIG. 4 is a flowchart illustrating an operation at the time of recording according to the first embodiment of the present invention;

FIG. 5 is a flowchart illustrating an operation at the time of reproduction according to the first embodiment of the present invention;

FIG. 6 is a logical block diagram showing the configuration of an event recording / reproducing unit according to a second embodiment of the present invention.

FIG. 7 is a conceptual diagram of event record contents according to the second embodiment of the present invention;

FIG. 8 is a conceptual diagram illustrating a method of determining a display position when reproducing additional information according to Embodiment 2 of the present invention.

FIG. 9 is a flowchart illustrating an operation during recording according to the second embodiment of the present invention.

FIG. 10 is a flowchart illustrating an operation at the time of reproduction according to the second embodiment of the present invention;

FIG. 11 is a logical block diagram illustrating an internal configuration of an event recording / reproducing unit according to Embodiment 3 of the present invention.

FIG. 12 is an example diagram of an initial state at the time of reproduction according to Embodiment 3 of the present invention;

FIG. 13 is a flowchart describing an operation of reproducing a message according to the third embodiment of the present invention.

FIG. 14 is a logical block diagram illustrating an internal configuration of an event analysis / playback unit according to the fourth embodiment of the present invention.

FIG. 15 is a diagram illustrating an example of a correspondence table between a PD operation pattern, a processing pattern during reproduction, and a drawing pattern during reproduction according to the fourth embodiment of the present invention;

FIG. 16 is a functional block diagram showing a configuration of the present multimedia message recording / playback apparatus according to Embodiment 5 of the present invention.

FIG. 17 is a logical block diagram illustrating an internal configuration of an event analysis / reproduction unit according to the fifth embodiment of the present invention.

FIG. 18 is a flowchart illustrating an operation according to the fifth embodiment of the present invention.

[Description of sign]

Reference Signs List 101 audio recording section 102 audio input / output section 103 pointing device (PD) 104 event analysis / reproduction section 105 timer 106 event recording section 107 image input / output section 108 image recording section 109 message transmission / reception section 110 image index information creation section 201 image index information 202 First captured still image data identifier 203 Second captured still image data identifier 204 Third captured still image data identifier 601 Drawing / additional information attachment operation determination means 602 Attachment position acquisition means 603 Additional information operation Order / time recording means 604 Event (drawing / voice input / image input) determining means 605 Media / time information recording means 606 Attached position drawing instructing means 607 Additional information display position determining means 608 Recording event interpretation / playback means 801 Still image (background information) 802 Additional information attachment position 803 Line for associating attachment position with additional information 804 Still image (additional information) 1101 Drawing / additional information attachment operation determining unit 1102 Attachment position acquisition unit 1103 Additional information operation order / Time recording means 1104 Event (drawing / voice input / image input) determining means 1105 Each media / time information recording means 1106 Attached position drawing means 1107 Additional information display position determining means 1108 Recorded event interpretation / reproduction means 1109 Additional information selection detection means 1110 Selection Additional information reproduction instructing means 1201 Still image as background 1202 Coordinates 1203 with additional information attached 1203 Circle centered on 1202 1401 Drawing / additional information attachment operation determination means 1402 Attachment position acquisition means 1403 Additional information operation order / time recording means 140 Event (drawing / voice input / image input) determination means 1405 Each media / time information recording means 1406 Attached position rendering means 1407 Additional information display position determination means 1408 Recorded event interpretation / reproduction means 1409 Drawing pattern selection means 1601 Voice recording unit 1602 Voice input Output unit 1603 Pointing device (PD) 1604 Event analysis / reproduction unit 1605 Timer 1606 Event recording unit 1607 Image input / output unit 1608 Image recording unit 1609 Message transmission / reception unit 1610 Image index information creation unit 1611 Heterogeneous communication interface unit 1701 Drawing / additional information attachment Operation determination means 1702 Attached position acquisition means 1703 Additional information operation order / time recording means 1704 Event (drawing / voice input / image input) determination means 1705 Each media Time information recording unit 1706 attachment positions drawing instruction unit 1707 additional information display position determining unit 1708 records event interpreting reproducing means 1709 play media selection means 1710 data converting means

Claims (5)

[Claims] An audio input / output unit for recording and reproducing audio;
An audio recording unit for storing input audio, a pointing device such as a mouse, an image input / output unit for inputting and displaying image information, an image recording unit for storing input image information, and detecting each of the inputs An event analysis and playback unit that analyzes and controls the operation of the device, a timer that monitors the execution time, and an event recording unit that records the operation analyzed by the event analysis and playback unit as an event together with time information obtained from the timer, An image index information creating unit that creates and stores index information of a plurality of image files input from an image input / output unit, wherein the event analysis and playback unit is stored in the image recording unit as a background image of a multimedia message. The still image selection operation with other operations based on the index information created by the image index information creation unit. A multimedia message recording / reproducing apparatus which records in an event recording section in a similar format and reproduces an event recorded in an event storage section in accordance with time information. 2. An event analysis / reproduction unit, an event determination means for detecting an input event, media / time information recording means for recording the contents of a drawing / voice / still image input and its time, and interpreting / reproducing the event recording In addition to the recorded event interpretation and playback means, a drawing / additional information attachment operation determining means for detecting an instruction from the pointing device and determining whether the operation is a drawing operation or an additional information attachment operation, and an additional information attachment operation if provided. Attachment position acquisition means for acquiring the attachment position on the still image, additional information attachment operation order / time recording means for recording the recording order and execution time in the event record, and when the timing for reproducing the additional information is reached The attached position drawing means for displaying a sign indicating that the additional information is attached at the position on the still image to which the additional information is attached, and the attached additional information Multimedia message recording and reproducing apparatus according to claim 1, characterized in that an additional information display position determining means for calculating a Shimesuru position. 3. An additional information selection detecting means for detecting that a pointing device has selected a certain range from a position coordinate on a still image to which the additional information is attached, and receiving the detection information. 3. The multimedia message recording / reproducing apparatus according to claim 2, further comprising a selection additional information reproduction instructing unit for instructing reproduction of the additional information selected by the user. 4. A pointing device operation / drawing unit for recording the correspondence between the operation of the pointing device and a drawing pattern after detecting an operation of the pointing device for an operation of attaching additional information to a still image. 3. The multimedia message information recording / reproducing apparatus according to claim 2, further comprising: a pattern correspondence table; and a drawing pattern selection unit that selects a drawing pattern to be reproduced according to the drawing pattern acquired from the correspondence table. 5. A message transmission / reception unit for transmitting / receiving a multimedia message via a network, a heterogeneous communication interface unit for providing the message transmission / reception unit with a communication interface with a plurality of different line types such as a public line and a LAN. When a request to reproduce a message received from a telephone or a facsimile is provided, the apparatus has a reproducing medium selecting means for reproducing only information suitable for each terminal from the received message, and a data converting means for converting the information into data suitable for the reproducing medium. The multimedia message recording / reproducing apparatus according to claim 1, wherein: