JP2001209361A - Multimedia display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a multimedia display device which can display a corresponding position in a still picture and a document in synchronism with the contents of a reproduced animation. SOLUTION: This multimedia display device which displays an animation and a still picture synchronously is provided with a reproduction part 104 which reproduces the animation, a still picture display part 103 which displays the still picture, a cursor display part 102 which displays a cursor indicating a position in the still picture, a reproduction position detection part 105 which detects the reproduction position of the animation, a position information storage part 101 which stores position information representing the display position and display section of the cursor in the still picture, and a control part 106 which controls the cursor display part so that the cursor is displayed at the display position is the still picture shown by the position information when the reproduction position of the animation found by the reproduction position detection part is in the display section of the position information. When the document and still picture are reproduced in synchronism with the moving picture, a specific position in the document and still picture which relates closely to the moving picture is indicated in synchronism with the reproduction of the moving picture.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multimedia display device for displaying multimedia contents including moving images, still images, texts, sounds, and the like. This makes it possible to reproduce and display the contents in an easy-to-understand manner.

[0002]

2. Description of the Related Art A multimedia display device opens a still image or text window while displaying a moving image on a screen in accordance with a scenario of multimedia contents.
Display still images and text related to videos. This scenario stipulates when to open a still image or text window, the display position, and the display content based on the time axis of the moving image. When a multimedia display device starts playing a moving image, it reads out the stored data of the specified still image or text according to the scenario specification and by the specified time, and displays the still image or text in the specified area on the screen for the specified period I do.

[0003] In the contents including lectures, lectures, research presentations, etc., if the instructor's operation is represented by a moving image and the document pointed to by the instructor is edited so as to be displayed in a text window, the reproduction of the contents allows the lecture or the lecture to be reproduced. Lectures and research presentations are clearly displayed to viewers.

[0004]

However, when displaying multimedia contents such as lectures, when a lecturer points to a position on a document and gives a lecture, the position is displayed on the text window displayed in a text window. If it is not clear whether this is the case, there is an inconvenience that the viewer has to follow the characters of the document displayed in the text window one by one to check the corresponding portion.

[0005] Japanese Patent Application Laid-Open No. 9-152952 discloses a method in which an operator designates a position on a moving image displayed by multimedia contents with a pointing device of a mouse and displays the position of the still image. It is described in JP-A-10-261106.

However, since this method does not display the position on the still image in synchronization with the reproduced moving image, the position on the document pointed to by the instructor in the moving image is displayed on the still image or text. Not applicable when displaying.

SUMMARY OF THE INVENTION The present invention solves the above-mentioned conventional problems. A multimedia display device capable of displaying a still image or a corresponding position on a document in synchronization with the content of a reproduced moving image or sound. It is intended to provide.

[0008]

SUMMARY OF THE INVENTION Therefore, according to the present invention, there is provided a multimedia display device for displaying a moving image or sound and a still image in synchronization with each other, and a reproducing unit for reproducing the moving image or sound and a still image for displaying a still image. An image display unit, a graphic display unit for displaying a position designation graphic indicating a position on a still image, a reproduction position detection unit for detecting a reproduction position of a moving image or audio based on the number of frames or time information, and a still image of the position specification graphic A position information storage unit for storing position information indicating the display position above and a display section of the position designation graphic indicated by the frame number or the time information; and a reproduction position of the moving image or the sound obtained from the reproduction position detection unit. A control unit that controls the graphic display unit to display the position designation graphic at a display position on the still image represented by the position information when the display section is hit.

In a multimedia display device for displaying a moving image and a document in synchronization, a reproducing unit for reproducing a moving image, a text display unit for displaying each page of document data composed of a plurality of pages, and a reproducing unit for the moving image A scenario storage unit that stores a scenario that defines the order of a plurality of scenes as a scene in which a section and a page of document data are associated with each other, a graphic display unit that displays a position designation graphic indicating a position on a page, A playback position detection unit that detects the playback position of the moving image based on the number of frames or time information, and stores position information indicating a display position of the position designation graphic on the page and a display section of the position designation graphic indicated by the frame number or time information. Reads the scenario from the location information storage unit and the scenario storage unit, and displays text according to the playback position of the moving image obtained from the playback position detection unit. The control unit controls the graphic display unit to display the page specified by the scenario, and when the reproduction position falls into the display section of the position information, the position designation graphic is displayed at the display position on the page represented by the position information. Are provided.

In a multimedia display device for displaying a moving image and a document in synchronization, a reproducing unit for reproducing a moving image, a text display unit for displaying each page of document data including a plurality of pages, A graphic display unit that displays a position designation graphic indicating a position, a reproduction position detection unit that detects a reproduction position of a moving image based on the number of frames or time information, and a scene that associates a reproduction section of a moving image with a page of document data. Defines the order of multiple scenes,
For each scene, a scenario storage unit that stores a scenario to which position information indicating a display position of a position designation graphic on a page and a display section of the position designation graphic indicated by the number of frames or time information is added, and a scenario from the scenario storage unit. Is read, and the page specified by the scenario is displayed on the text display unit in accordance with the playback position of the moving image obtained from the playback position detection unit, and when the playback position falls into the display section of the position information of the scenario, the position information is displayed. And a control unit for controlling the graphic display unit so as to display the position designation graphic at the display position on the page represented by.

Therefore, when a document or a still image is reproduced in synchronization with a moving image or a sound, a specific position on the document or the still image closely related to the moving image or the sound is synchronized with the reproduction of the moving image or the sound. Can point.

[0012]

DESCRIPTION OF THE PREFERRED EMBODIMENTS (First Embodiment) In a multimedia display device according to a first embodiment, an image of a lecturer pointing to a document 222 is displayed as a moving image 221 as illustrated in FIG. The document having the same content as the document 222 displayed on the moving image 221 is enlarged and displayed in synchronization with the text display area 223.
When the instructor in the moving image points to the location (a) on the document 222, a cursor (a) is displayed at a position on the document 223 corresponding to the location (a). When the instructor stops this operation, the cursor (a) is displayed. ) Disappears. When the instructor in the moving image points to the location (b) on the document 222, the document 22 corresponding to the location (b)
The cursor (b) is displayed at the upper position of 3 and the cursor (b) disappears when the instructor stops this operation.

As shown in FIG. 2A, the digital moving image data 201 of the multimedia content displaying the moving image can be read at the playback position by the time or frame from the start of the playback. The media display device can control the display of a still image or a document based on the read reproduction position.

In the digital moving image data 201, the instructor writes the location (a) on the document 222 between the times ta1 and ta2.
And a moving image 203 indicating a point (b) on the document 222 is recorded from time tb1 to tb2.

In the multimedia content, cursor position information 204 describing the type of cursor, the display position of the cursor, and the display section of the cursor is recorded corresponding to the digital moving image data 201. In this example, the cursor (a) 205 is displayed at the position (ax, ay) on the screen from the playback time ta1 to ta2 of the moving image, and the cursor (b) 206 is displayed from the playback time tb1 to tb2 of the moving image. Until, display at the position (bx, by) on the screen is recorded as cursor position information.

FIG. 1A shows a multimedia display device according to the first embodiment. This apparatus includes a cursor position information storage unit 101 that stores cursor position information, a cursor display unit 102 that displays a cursor, a still image display unit 103 that displays a still image, and a moving image reproduction unit 104 that reproduces a digital moving image. A playback time detection unit 105 that detects the playback time of the moving image playback unit 104; and a control unit 106 that controls the operation of each unit.

The control unit 106 causes the moving image reproduction unit 104 to reproduce a moving image, causes the still image display unit 103 to display a still image, reads the cursor position information from the cursor position information storage unit 101, and reads the cursor position information from the reproduction time detection unit 105. Based on the obtained reproduction time, the cursor display unit 102 is controlled so that the cursor is displayed on the still image displayed by the still image display unit 103 over the screen position and the reproduction section specified by the cursor position information.

FIG. 1 (2) shows a display screen displayed by the multimedia display device.
22 is a still image area displayed on the moving image screen 121, 123 is a designated position displayed on the still image area 122 during moving image playback, 124 is a still image screen obtained by enlarging the area 122, and 125 is displayed on the still image screen 124. Cursor position.

When the designated position 123 is the position (a) of the area 122 (FIG. 2 (2)), the cursor position 125 is based on the cursor position information 205 (FIG. 2 (1)) of the cursor (a). Is displayed at the position (ax, ay) on the still image screen 124.

At this time, the designated position 123 is set to (Xa,
If the designated position 123 is displayed on the still image screen 124 at the same magnification as that of the position Ya, and the magnification of the area 122 of the still image screen 124 is n, the cursor corresponding to the designated position 123 is displayed. The position 125 is (Xa × n, Ya × n). Therefore, the cursor position information is stored as the position (Xa × n, Ya × n), and the cursor is displayed at the position (Xa × n, Ya × n) on the still image screen 124 based on the cursor position information.

As described above, in the multimedia display device, the still image embedded in the digital moving image data is enlarged and displayed, and the enlarged still image corresponding to the position designated on the embedded still image is displayed. The cursor can be synchronously displayed at a position on the screen.

In this multimedia display device, in addition to digital moving image data compressed by the MPEG system, digital moving image data in a file format such as AVI and ASF, MP3 or CODEC,
It can handle digital audio data compressed by a method or the like.

Further, it is possible to display the document data on the still image screen and handle the document data. The document data handled at this time is a text file or XML or SGM
In addition to the structured document described in L, image data obtained by imaging the document, a document file in PDF format, a file in word processing format, or the like may be used.

The cursor pointing at the still image may be an icon or a pixel image of a small area in addition to the cursor.

Further, by adding information to be displayed on a moving image as cursor position information, the display of the cursor is synchronized with the reproduction of the moving image and the display of the still image, so that the cursor is displayed not only on the still image but also on the moving image. It may be displayed at the position. At this time, even if only one of the moving image and the still image is designated as the cursor display area, or both the moving image and the still image are designated as the cursor display area and the cursor is simultaneously displayed on both the moving image and the still image, Good.

(Second Embodiment) In the multimedia display device of the second embodiment, new pages of a document are sequentially displayed in a still image area so as to repeat pages of the document in synchronization with a moving image, and the page is displayed. The cursor is displayed at the designated position and for the designated period.

FIG. 3 (2) schematically shows multimedia contents for such display.

A scenario 350 that defines a plurality of scenes is set with a scene in which a reproduction section of digital moving image data is associated with a page of document data. In the scenario 350, a reproduction period of each scene and its reproduction are set. The relationship with the page of the document displayed during the period is specified. According to this scenario, a text page n (331) is displayed in the still image area corresponding to the scene 311 from the playback time t1 to immediately before t2 (t2-1), and the text n (331) is displayed immediately before the playback time t2 to t3. −
Text page n corresponding to scene 312 up to 1)
+1 (332) is displayed, and a text page n + 2 (333) is displayed corresponding to the scene 313 from the reproduction time t3 to immediately before (t4-1) before t4.

The cursor displayed on the text page is defined by cursor position information 340. According to the cursor position information 340, during the period (321) from the reproduction time ta1 to ta2 of the scene 311, the cursor (a) is displayed at the position (ax, ay) on the text page n (331), and the reproduction is performed. Period from time tb1 to tb2 (32
2) contains (bx, b) on page n + 1 (332) of text
The cursor (b) is displayed at the position y), and during the period (323) from the reproduction time tc1 to tc2, the text page n + 2
A cursor (c) is displayed at the position (cx, cy) on (333).

By displaying in this manner, when a moving image is divided into a plurality of scenes and reproduced, it is possible to indicate a corresponding part of the document according to the content of each scene.

As shown in FIG. 3A, the multimedia display device of the second embodiment for performing such display includes a text display unit 303 for displaying text and a scenario storage unit 301 for storing a scenario. In addition, similarly to the first embodiment (FIG. 1), the cursor position information storage unit 101,
Cursor display section 302, video playback section 304, playback time detection section 30
5 and a control unit 306.

The control unit 306 reads the scene of the scenario from the scenario storage unit 301, and causes the moving image reproduction unit 304 and the text display unit 303 to display the reproduction of the moving image in the corresponding reproduction section and the page of the corresponding document data. The cursor position information is read from the cursor position information storage unit 101, and the cursor is displayed on the page of the displayed document by the cursor display unit 302 based on the reproduction time obtained from the reproduction time detection unit 305.

When the reproduction of the scene ends at the end time, the next scene is read from the scenario storage unit 301, the next scene is reproduced, and the cursor is similarly displayed based on the cursor position information.

As described above, in this multimedia display device, a plurality of scenes included in a scenario are sequentially read, each scene is reproduced, and a cursor is displayed based on cursor position information corresponding to a reproduction section of each scene. Is possible.

In this multimedia display device, in addition to digital moving image data compressed by the MPEG system, digital moving image data in a file format such as AVI and ASF, MP3 or CODEC,
It can handle digital audio data compressed by a method or the like.

It is also possible to display document data on a still image screen and handle the document data. The document data handled at this time is a text file or XML or SGM
In addition to the structured document described in L, image data obtained by imaging the document, a document file in PDF format, a file in word processing format, or the like may be used.

The cursor pointing to the still image may be an icon or a pixel image of a small area in addition to the cursor.

Further, by adding information to be displayed on a moving image as cursor position information, the display of the cursor is synchronized with the reproduction of the moving image and the display of the still image, so that the cursor is displayed not only on the still image but also on the moving image. It may be displayed at the position. At this time, even if only one of the moving image and the still image is designated as the cursor display area, or both the moving image and the still image are designated as the cursor display area and the cursor is simultaneously displayed on both the moving image and the still image, Good.

(Third Embodiment) In the multimedia display device of the third embodiment, cursor position information is incorporated in a scenario scene.

FIG. 4B shows a scenario defining multimedia display. For each of the scenes 411, 412, and 413, a scene composed of a set of a reproduction section for reproducing a moving image and a page for displaying a document. , Cursor position information (position and display section) is set.

According to this scenario, while the scene 411 is being reproduced, the cursor is moved to the position (ax, ay) on the page n of the document between the ta1 seconds and the ta2 seconds based on the cursor position information included in the scene 411. (A) is displayed and scene 41
During playback of 2, the cursor (b) is displayed at the position (bx, by) of the page n + 1 of the document during the playback time of the moving image from tb1 seconds to tb2 seconds from the cursor position information included in the scene 412, and During playback of the scene 413, the playback time of the moving image is changed from tc1 second to tc2 based on the cursor position information included in the scene 413.
During the second, the cursor (c) is displayed at the position (cx, cy) of the page n + 2 of the document.

As described above, by embedding the cursor position information in the scene reproduction information, the scene control and the cursor control can be collectively processed. Further, according to this method, the reproduction processing of the scene and the position information of the cursor are linked, so that the synchronization processing is facilitated.

FIG. 4A shows a multimedia display device according to the third embodiment. This apparatus is different from the second embodiment (FIG. 3A) in that it does not have a cursor position information storage unit and that the scenario stored in the scenario storage unit 406 includes cursor position information. Is different.

The control unit 405 reads the scene of the scenario stored in the scenario storage unit 406, and
Based on the playback time detected, the playback section of the corresponding moving image and the page of the document data are displayed from the playback information of the scene, and the cursor position information included in the scene is used to display the cursor during the display section of the cursor. The display unit 401 displays a cursor on the page of the document displayed by the text display unit 402. When the reproduction of the scene ends at the end time, the next scene is read from the scenario storage unit 406, the next scene is reproduced, and the cursor is similarly displayed based on the cursor position information.

Each scene may include one or more pieces of cursor position information. If a plurality of pieces of cursor position information are included, a plurality of pieces of cursor information included in the scene are sequentially read and the cursor is displayed. .

As described above, in this apparatus, a plurality of scenes included in the scenario are read in order, each scene is reproduced, and the cursor can be displayed based on the cursor position information corresponding to the reproduction section of each scene. is there.

In this multimedia display device, in addition to digital moving image data compressed by the MPEG system, digital moving image data in a file format such as AVI or ASF, MP3 or CODEC,
It can handle digital audio data compressed by a method or the like.

Further, the document data can be displayed on the still image screen and the document data can be handled. The document data handled at this time is a text file or XML or SGM
In addition to the structured document described in L, image data obtained by imaging the document, a document file in PDF format, a file in word processing format, or the like may be used.

The cursor pointing at the still image may be an icon or a pixel image of a small area in addition to the cursor.

Further, by adding information to be displayed on a moving image as cursor position information, the display of the cursor is synchronized with the reproduction of the moving image and the display of the still image, so that the cursor is displayed not only on the still image but also on the moving image. It may be displayed at the position. At this time, even if only one of the moving image and the still image is designated as the cursor display area, or both the moving image and the still image are designated as the cursor display area and the cursor is simultaneously displayed on both the moving image and the still image, Good.

(Fourth Embodiment) The multimedia display device of the fourth embodiment has a function of setting cursor position information.

As shown in FIG. 5A, the apparatus includes a start point setting section 508 for setting a cursor display position and a cursor display start time, and an end point setting section 509 for setting a cursor display end time. And a playback time correction unit 510 that corrects the playback time of the moving image back and forth in frame or time units. The cursor position information set by the start point setting unit 508 and the end point setting unit 509 is stored in the cursor position information storage unit 501.
Is stored in Other configuration is the second embodiment (FIG. 3)
There is no change.

In this apparatus, when setting the cursor position information, first, a text is displayed in the still image area, and the cursor is displayed on the text by the cursor display unit 502. Next, the reproduction of the moving image is stopped at the cursor display start time, the cursor is displayed at a predetermined position on the text, and then the start point setting unit 508 is operated to set the cursor display position and the cursor display start time.

At this time, prior to the setting by the start point setting unit 508, the reproduction time correction unit 510 corrects the reproduction position of the stopped moving image in units of one second or one frame as necessary.

The display position of the cursor and the start time of the cursor display set by the start point setting unit 508 are held by the control unit 506, and the reproduction of the moving image is resumed simultaneously with this setting.

Next, the reproduction of the moving image is stopped by operating the end point setting section 509 at the end time of the cursor display, and the reproduction time correction section 5 is operated.
At 10, the moving image playback stop position is corrected in units of one second or one frame as necessary, and then the end point setting unit 509
Set the end time of the cursor display. In response to this setting, the control unit 506 stores the cursor display position and the cursor display start time and end time in the cursor position information storage unit 50.
Store in 1.

If the next cursor position information has not been set, the editing is completed. If the next cursor position information has been set, the above operation is repeated.

FIG. 5B shows a procedure for setting the cursor position information.

Step 1: The moving image is stopped at the cursor display start time.

Step 2: The cursor position is set, the start time of the cursor display is set, and the reproduction of the moving image is started.

Step 3: Next, the reproduction of the moving image is stopped to set the display end of the cursor. Step 4: After correcting the end time, the display end time is set.

Step 5: If the next cursor position information needs to be set, the procedure from step 1 is repeated, and if no cursor position information needs to be set, the process ends.

As described above, in this multimedia display device, it is possible to create information for displaying a cursor at a position corresponding to the content of a moving image on a still image in synchronization with the reproduction of the moving image.

The cursor can be moved not only on a still image, but also on a still image.
It can also be displayed on the video, in which case,
Information indicating that the cursor is displayed on the moving image is set in the cursor position information. The setting of the display position of the cursor, the display start time, and the display end time can be performed in the same manner as the procedure described above.

In this multimedia display device, in addition to digital moving image data compressed by the MPEG system, digital moving image data in a file format such as AVI or ASF, MP3 or CODEC,
It can handle digital audio data compressed by a method or the like.

It is also possible to display the document data on the still image screen and handle the document data. The document data handled at this time is a text file or XML or SGM
In addition to the structured document described in L, image data obtained by imaging the document, a document file in PDF format, a file in word processing format, or the like may be used.

The cursor pointing at the still image may be an icon or a pixel image of a small area in addition to the cursor.

Also, by adding information to be displayed on the moving image as cursor position information, the display of the cursor is synchronized with the reproduction of the moving image and the display of the still image, so that the cursor is displayed not only on the still image but also on the moving image. It may be displayed at the position. At this time, even if only one of the moving image and the still image is designated as the cursor display area, or both the moving image and the still image are designated as the cursor display area and the cursor is simultaneously displayed on both the moving image and the still image, Good.

(Fifth Embodiment) In the fifth embodiment,
A description method of a scenario when cursor position information is included in a scenario will be described.

FIG. 6 shows a scenario in which tags for controlling cursor display on the cursor display unit 502 are described.

In FIG. 6, reference numeral 601 denotes a scenario described using a tag <scenario>; 602, a <video> tag that defines digital moving image data with the name st1, and 603, document data with the name txt1. <Text> tag, 60
4, 608, and 609 are <scene> tags indicating that the video and text are to be reproduced simultaneously. 605 is a playback section of the digital video data st1 reproduced in the scene of the tag 604. An <video> tag indicating the end time in the end attribute, 606 is a <text> tag indicating the page to be displayed in the document data txt1 displayed in the scene of the tag 604 in the page attribute, and 607 is a page of the document data in the scene of the tag 604 A <cursor> tag indicating position information of a cursor to be displayed on the top of the screen or a moving image screen.

At this time, the time displayed by the tag 607 is start
The attribute indicates the display start time and the end attribute indicates the display end time, and must be within the reproduction time described by the tag 605. In other words, (start of tag 605) <= (star of tag 607
t) and (end of tag 607) = << (end of tag 605). If (start of tag 605)> (start of tag 607), it is handled as (start of tag 607) = (start of tag 605). If (end of tag 607)> (end of tag 605),
(End of tag 607) = (end of tag 605).

A <video> tag indicating reproduction of digital moving image data, a <text> tag indicating a page of document data, and And cursor position information <
By describing the cursor> tag, the scenario can be described in a hierarchical structure, and the scenario can be easily edited by a standard text editor or the like by the document description of such a hierarchical structure.

The tag 607 is added to the <cursor> tag indicating the cursor position information like the tag 610 by adding a name attribute indicating the area for displaying the cursor, thereby making the area for displaying the cursor clear. The display position can be displayed not only on a still image but also on a moving image.

As described in the first embodiment, the multimedia display device of the present invention uses digital moving image data compressed in the MPEG format, digital moving image data in a file format such as AVI or ASF as digital moving image data. In addition to data, digital audio data compressed by the MP3 or CODEC method or the like can be handled.

As the document data, in addition to a text file or a structured document described in XML or SGML, image data obtained by imaging a document, a document file in a PDF format, a file in a word processor format, and the like can be handled.

The cursor pointing at a still image or a moving image may be an icon or a pixel image of a small area in addition to the cursor.

[0078]

As is clear from the above description, the multimedia display device of the present invention can reproduce a document or a still image in synchronism with a digital moving image or digital audio based on the multimedia content. A specific position on a document or a still image closely related to a moving image or sound can be indicated in synchronization with the reproduction of the digital moving image or digital sound.

Such display is performed by using multimedia contents based on lectures, lectures, research presentations, and the like to reproduce the speaker's behavior as a digital moving image, and to synchronously reproduce the document cited in the lecture as a still image. In this case, it can be used when pointing out the contents of a moving image on a still image, and the contents of lectures, lectures, research presentations, etc. can be shown to the viewer in an easy-to-understand manner.

[Brief description of the drawings]

FIG. 1 is a block diagram (1) showing a configuration of a multimedia display device according to a first embodiment of the present invention, and a display example (2) thereof.

FIG. 2 is a conceptual diagram showing the correspondence between multimedia content (1) and display of a cursor on a screen (2) according to the first embodiment;

FIG. 3 is a block diagram (1) showing a configuration of a multimedia display device according to a second embodiment of the present invention, and a conceptual diagram (2) showing multimedia contents;

FIG. 4 is a block diagram (1) showing a configuration of a multimedia display device according to a third embodiment of the present invention, and a diagram (2) showing a scenario of multimedia content;

FIG. 5 is a block diagram (1) showing a configuration of a multimedia display device according to a fourth embodiment of the present invention, and a diagram (2) showing a procedure for creating cursor position information;

FIG. 6 is a diagram showing a scenario of multimedia content according to a fifth embodiment of the present invention.

[Explanation of symbols]

 101, 501 cursor position information storage unit 102, 302, 401, 502 cursor display unit 103 still image display unit 104, 304, 403, 504 video playback unit 105, 305, 404, 505 playback time detection unit 106, 306, 405, 506 Control unit 121 Video screen 122 Video screen still image 123 Pointed position 124 Still image screen 125 Cursor 201 Video data 204 Cursor position information 221 Video 222 Document 223 Text display area 301, 406, 507 Scenario storage 303, 402, 503 Text Display sections 311, 312, 313 Scenes 321, 322, 323 Cursor display sections 331, 332, 333 Text pages 508 Start point setting section 509 End point setting section 510 Playback time correction section 601 Scenario 602 Tags defining video data 603 Document data Tags to be defined 604, 608, 609 Tags indicating scenes 605 Tags indicating playback sections of video data 606 Tags indicating pages of document data 607 Tags indicating cursor position information on document data 610 Cars on video Tag indicating Le positional information

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) G06F 3/14 380 G06F 3/14 380B G09B 19/00 G09B 19/00 Z F-term (Reference) 2C028 AA00 5B069 CA17 DD16 GA08 5C082 AA01 AA03 AA05 AA15 BA02 BA12 BA27 BA29 BA34 BA41 BB25 BB26 BB46 BD01 BD02 CA04 CA52 CA54 CA76 CB05 DA61 DA86 MM05 MM08 5E501 AB13 AC14 AC16 BA03 FA02 FA15 FA32 9A001 JJ19 JJ32

Claims (8)

[Claims] 1. A multimedia display device for displaying a moving image or a sound and a still image in synchronization with each other, a reproducing unit for reproducing a moving image or a sound, a still image displaying unit for displaying a still image, and a position on the still image. A graphic display unit for displaying a position designation graphic indicating the position, a reproduction position detection unit for detecting a reproduction position of a moving image or audio based on the number of frames or time information, and a display position of the position designation graphic on a still image and the number of frames or A position information storage unit that stores position information indicating a display section of the position designation graphic indicated by time information, and when a playback position of a moving image or audio obtained from the playback position detection unit falls in a display section of the position information, A control unit that controls the graphic display unit to display the position designation graphic at a display position on the still image represented by the position information. A Display device. 2. A multimedia display device for synchronously displaying a moving image and a document, comprising: a reproducing unit for reproducing a moving image; a text display unit for displaying each page of document data including a plurality of pages; A scenario storage unit that stores a scenario that defines the order of a plurality of scenes, with a scene in which a section and a page of document data are associated with each other, a graphic display unit that displays a position designation graphic indicating a position on a page, A playback position detection unit that detects the playback position of the moving image based on the number of frames or time information; and position information indicating a display position of the position designation graphic on a page and a display section of the position designation graphic indicated by the frame number or time information. A scenario information is read from the scenario storage unit, and is stored in accordance with the playback position of the moving image obtained from the playback position detection unit. Displaying the page specified by the scenario on the text display unit, and displaying the position designation graphic at a display position on the page represented by the position information when the reproduction position falls within a display section of the position information. And a control unit for controlling the graphic display unit to perform the operation. 3. A position information setting unit for setting a display position of the position designation graphic on a page displayed along with reproduction of a moving image, and setting a display section of the position designation graphic from the reproduction position of the moving image. The multimedia display device according to claim 2, wherein the display position and the display section set by the position information setting unit are stored in the position information storage unit as the position information. 4. A multimedia display device for synchronously displaying a moving image and a document, comprising: a reproducing unit for reproducing a moving image; a text display unit for displaying each page of document data including a plurality of pages; A figure display section for displaying a position designation figure indicating a position, a reproduction position detection section for detecting a reproduction position of a moving image based on the number of frames or time information, and a scene in which a reproduction section of a moving image is associated with a page of document data. A scenario in which the order of a plurality of scenes is defined, and for each scene, position information representing the display position of the position designation graphic on a page and the display section of the position designation graphic indicated by the number of frames or time information is added. A scenario storage unit for storing a scenario, reading a scenario from the scenario storage unit, and according to a playback position of a moving image obtained from the playback position detection unit. Displaying the page specified by the scenario on the text display unit, and when the playback position falls within a display section of the position information of the scenario, the position designation graphic is displayed at a display position on the page represented by the position information. And a control unit for controlling the graphic display unit so as to display the multimedia display. 5. The scenario is described using a tag,
5. A tag indicating moving image data, a tag indicating a page of document data, and a tag indicating position information of the position designation graphic are hierarchically described in tags representing each scene. A multimedia display device according to claim 1. 6. The multimedia display device according to claim 1, wherein the position designation graphic is a cursor, an icon, or a pixel image of a small area. 7. The method according to claim 1, wherein the position information represents a display position and a display section of the position designation graphic on the moving image, and the graphic display unit displays the position designation graphic on the moving image. 7. The multimedia display device according to any one of 1 to 6. 8. The document data may be a text file,
The multimedia display device according to any one of claims 2 to 5, comprising a structured document described in XML or SGML, digital image data obtained by imaging the document, PDF data, or word processing data.