JP2003337706A - Method and apparatus for reproducing multimedia data - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To efficiently view or listen only necessary information by allowing a user to easily prepare or reproduce a multimedia title. <P>SOLUTION: Multimedia data is previously stored in a database 13 as multimedia data parts obtained by parting the multimedia data unit by unit according to contents of the multimedia data. In response to a user's command, sequential data including key data specifying each multimedia part is prepared so as to determine an order of reproducing an arbitrary plurality of the multimedia data parts stored in the database 13. The plurality of multimedia data parts are read out from the database 13 and sequentially reproduced according to the prepared sequence data. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

(Table of contents) Industrial applications Conventional technology Problems to be Solved by the Invention Means for Solving the Problems (FIGS. 1 to 5) Action (Figs. 1-5) Example (A) Description of the first embodiment (FIGS. 6 to 19) (B) Description of the second embodiment (FIGS. 20 and 21) (C) Description of the third embodiment (FIGS. 22 to 33) The invention's effect

[0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method and apparatus for reproducing multimedia information (including operation guide information) including image information and audio information.

[0003]

2. Description of the Related Art Generally, when an abnormality (error, medium replenishment requirement, etc.) occurs in a main unit or a peripheral device due to a physical cause that is not a computer bug, and a recovery work by an operator is required, When an operator (user) needs an operation guide regardless of the presence or absence, an operation guide screen (help screen) is displayed on the display unit of the main body device or the display unit of peripheral equipment.

Symbols and explanations in text are shown on the operation guide screen, and the operator is treating the main body device or peripheral equipment while referring to the screen. Then, the operator advances the display of the operation guide screen displayed on the display unit by operating the input means such as the keyboard and the mouse as the treatment for the main body device or the peripheral device progresses.

[0005]

However, if the operation guidance is given by symbol display or textual explanation, it is difficult for the operator to understand the specific operation method. In order to make the operation guidance easier to understand, in recent years, a method of reproducing the operation guidance information (help information) by multimedia using image display and audio output is rapidly spreading. In many cases, the device is not provided with a function of displaying detailed operation guidance information, and the operator could not grasp the specific operation method.

Further, in the above-mentioned conventional operation guidance information reproducing method, when the operator refers to the operation guidance to be performed next as the procedure for the main body device or peripheral equipment progresses, a keyboard, a mouse, etc. It was extremely troublesome to operate and to input some instructions one by one. Further, when there are many users of the device, it is desirable to provide help information according to the proficiency level of the users.
Explaining basic information endlessly to advanced level users, and conversely providing technical information-rich help information to beginner level users who have no knowledge of the device. This forces the user to work inefficiently.

[0007] Therefore, conventionally, as a means for realizing the provision of help information having different difficulty levels and detailed levels according to the user's proficiency level, a device determines the user's proficiency level and stores it, or Include those who input their own proficiency level into the device, and those which manage the proficiency level for each operator based on personal ID information such as an operator card. But,
In order to provide help information having different degrees of difficulty and level of detail according to the user's proficiency level, the device determines and stores the proficiency level for each user. However, even if another user tries to use the help function of the device, the help information that does not match the user's level is arbitrarily reproduced, and the efficient use of the help function cannot be expected.

Further, in the means for the user to input his / her proficiency level into the device, it is necessary to identify which one of the beginner, the intermediate and the advanced the user is, before looking at the actual help information. At first, I thought that I was an intermediate level and called help information for that level, but if the content was too difficult, return to the level selection screen again and select help information for beginner level again. , And so on.

Further, the means for managing the proficiency level for each operator based on the personal ID information merely remembers the proficiency level of the operator, and forgets the operation once performed by a certain user. A long time has passed since the last operation or the previous operation,
If you forget the operation method, you have to reselect the level of help information, which is hard to say.

In particular, in the case of an apparatus in which an error does not occur so often (for example, a cash depositing / dispensing machine of a bank in which it is obligatory to replenish the medium at a fixed time every day), it was possible to operate it last time. Since it is easy to be unable to operate this time, if the user's proficiency level is determined and the help information is reproduced, the user is forced to perform inefficient work.

Therefore, the user himself / herself can use the help information at a level suitable for himself / herself so that he / she can step down the hierarchy step by step while checking the contents of the help information classified by the difficulty level. is necessary. Also,
It is hoped to develop a mechanism that allows help information to be automatically used while checking the recovery state with a mechanical sensor, with as little trouble as possible for the user.

Further, when a plurality of events such as errors occur at the same time, conventionally, operation guidance is provided for each event, but it is extremely inefficient to individually deal with errors in this way. is there. In the worst case, it may happen that the user performs the operation that can be omitted twice or more if the processing is performed in consideration of the order. Therefore, depending on the user's proficiency level, the help information having different difficulty levels and detail levels can be reproduced, and when a plurality of errors occur, unnecessary operations are omitted and the same operations are repeated. It is necessary to have a method that can deal with errors in the most efficient order without performing.

By the way, in recent years, the multimedia used for the above-mentioned operation guidance and the like has become particularly widespread, and a multimedia title for providing multimedia information and a reproducing apparatus thereof have been generally used. ing.
Usually end-users of multimedia (end users)
Can use the multimedia information only in accordance with the scenario previously intended by the multimedia title creator.

However, the interactivity of information is an important factor that determines the spread of multimedia software, and the end user can only show the scenario intended by the multimedia title creator. Instead, it is required to efficiently use only the information desired to be reproduced in a reproduction mode that meets the demand of the end user. Also, since multimedia titles require a very large memory capacity, portable small capacity storage media such as floppy disks could not be used.

The present invention has been made in view of the above problems, and enables a user to easily create and reproduce a multimedia title so that only necessary information can be efficiently viewed. An object is to provide a media information reproducing method and a multimedia information reproducing apparatus.

[0016]

FIG. 1 is a block diagram of the principle of the related art of the present invention. In FIG. 1, 1A is a reproduction control unit, and this reproduction control unit 1A is a treatment by an operator in a target device 3. When an event that needs to be performed occurs, the operation guidance information corresponding to the event is read from the database 4 and the reproduction of the operation guidance information is controlled.

Reference numeral 2A is a reproduction section, which is a reproduction section 2A.
Is controlled by the reproduction control unit 1A to reproduce the operation guidance information and notify the operator. In the present invention, the reproduction unit 2A is connected to the target device 3 and is connected to the target device 3.
Is a terminal device that can manage the
The operation guide information regarding the treatment to be applied to the state of the target device 3, which changes according to the treatment performed by the operator, is reproduced.

FIG. 2 is a block diagram of the principle of the related art of the present invention. In FIG. 2, reference numeral 1A is a reproduction control unit, and this reproduction control unit 1A is an event in the target device 3 which requires treatment by an operator. In the case of occurrence of the event, the operation guidance information corresponding to the event is read from the database 4 and the reproduction of the operation guidance information is controlled. Further, reference numeral 2 is a reproduction unit, which is controlled by the reproduction control unit 1A to reproduce the operation guidance information and notify the operator.

Then, the reproduction control section 1A receives the state of the target device 3 which changes according to the procedure performed by the operator as a detection result by the sensor 5 in the target device 3, and links with the state of the target device 3. The control unit controls the reproduction unit 2 to sequentially reproduce the operation guidance information regarding the treatment to be performed on the current state of the target device 3.

FIG. 3 is a block diagram of the principle of the related art of the present invention. In FIG. 3, 1B is a reproduction control unit basically having the same function as the reproduction control unit 1A described above with reference to FIGS. , 6 are input units for instructing to change the level of detail of the operation guidance information reproduced by the reproduction unit 2. Then, the reproduction control unit 1B first reproduces the operation guidance information having the lowest level of detail with the reproducing unit 2, and the level of detail is gradually increased each time the operator gives an instruction / request to change the level of detail from the input unit 6. The operation guide information having a high content is controlled to be sequentially reproduced by the reproducing unit 2.

FIG. 4 is a block diagram of the principle of the related art of the present invention. In FIG. 4, 1C is a reproduction control basically having the same function as the reproduction control unit 1A described above with reference to FIGS. It is a department. It should be noted that the operation guide information is stored in advance in the database 4 in the state of treatment information parts which are made into parts for each minimum unit of treatment that the operator can perform on the target device 3.

Reference numeral 7 is a search unit for searching the database 4 for a plurality of treatment information parts corresponding to an event occurring in the target device 3, and reference numeral 8 is the same as the reproduction order of the plurality of treatment information parts searched by the search unit 7. It is an order determination unit that determines according to the event so that the treatment information parts of are not duplicated.
Then, the reproduction control unit 1C controls the reproduction unit 2 to sequentially reproduce a plurality of treatment information parts from the database 4 in accordance with the reproduction order determined by the order determination unit 8.

As the reproducing unit 2, a display unit for reproducing and displaying the operation guide information as an image is provided, and as the operation guide information, an actual operation procedure is visualized while the target device 3 is viewed from the operator's viewpoint. The image may be reproduced and displayed on the display unit. At this time, character information explaining the actual operation procedure may be reproduced and displayed on the display unit as the operation guide information together with the image.

Further, the reproducing section 2 includes an audio output section for reproducing and outputting the operation guidance information as a sound, and the image is reproduced and displayed on the display section, and at the same time, the audio information for explaining the actual operation procedure is output by the audio output section. May be reproduced and output. Furthermore, the reproduction of the operation guidance information may be performed by a terminal device connected to the target device 3 and capable of managing the target device 3, or the database 4 is provided on the upper device side and is configured to be shared with other devices. Good.

FIG. 5 is a block diagram of the principle of the present invention. In FIG. 5, reference numerals 11 and 12 respectively denote a display section for reproducing image information for reproducing multimedia information including image information and audio information, and audio information reproduction. Is a voice output unit for. And 13 is a database, 14 is an input unit, 1
Reference numeral 5 is a sequence data creating means, and 16 is a sequence data reproducing means.

Here, the database 13 stores multimedia information in advance in the form of multimedia data parts which are made into parts for each unit according to the information content, and the input unit 14 stores the multimedia information in the database 13. It is for inputting the necessary instructions for reproducing the media data part. Also, the sequence data creating means 15
In order to determine the reproduction order of a plurality of arbitrary multimedia data parts in the database 13 according to an instruction from the input unit 14, sequence data including key data designating each multimedia part is created. .

Further, the sequence data reproducing means 16
When receiving a reproduction start instruction from the input unit 14, the plurality of multimedia data parts are read from the database 13 according to the sequence data created by the sequence data creating unit 15, and the plurality of multimedia data parts are displayed on the display unit 11 and The audio output unit 12 sequentially reproduces the sound.

The sequence data creating means 15 is
The display unit 11 and the voice output unit 12 reproduce the information necessary for creating the sequence data, and upon receiving an instruction input from the input unit 14 by the user who referred to the information, the sequence data is created. Good. In addition, the multimedia data parts are composed of key data unique to each multimedia data part, video data for one scene and audio data for one scene, and control data for these video data and audio data. You can also

[0029]

In the operation guide information reproducing method and device as the related art of the present invention described above with reference to FIG. 1, the operation guide information regarding the treatment to be performed on the state of the target device 3 according to the treatment performed by the operator is: It is reproduced on the display unit of the terminal device (reproduction unit) 2A. Therefore, the operation guidance of each target device 3 can be grasped in detail on the display unit of the terminal device 2A.

In the operation guide information reproducing method and apparatus as the related art of the present invention described above with reference to FIG. 2, the sensor 5 detects the state of the target apparatus 3 which changes according to the procedure performed by the operator, and the reproduction control is performed. Based on the detection result of the sensor 5, the unit 1A interlocks with the state of the target device 3,
The operation guide information regarding the treatment to be performed on the current state of the target device 3 is sequentially and automatically reproduced by the reproducing unit 2. Therefore, the operator does not need to give an instruction one by one to refer to the next operation guide, and the operation guide information can be automatically used without bothering the operator.

In the operation guidance information reproducing method and apparatus as the related art of the present invention described above with reference to FIG. 3, the reproduction control unit 1 is used.
According to B, the operation guidance information having the lowest degree of detail is first reproduced by the reproducing unit 2, and when the operator instructs / requests the change of the degree of detail from the input unit 6, the degree of detail is gradually increased. The operation guide information of the content is sequentially reproduced by the reproducing unit 2. Therefore, the operator himself / herself can use the operation guidance information of his / her own level so that he / she can step down each level of the detail level while confirming the content of the operation guidance information according to the detail level. .

In the operation guidance information reproducing method and apparatus as the related art of the present invention described above with reference to FIG. 4, the retrieval unit 7 retrieves from the database 4 a plurality of treatment information parts corresponding to the event occurring in the target apparatus 3. Then, the reproduction order determination unit 8 determines the reproduction order of the plurality of treatment information parts retrieved by the retrieval unit 7 according to the event so that the same treatment information parts are not duplicated.

After this, the reproduction control unit 1C follows the reproduction order determined by the order determination unit 8 and the database 4
The plurality of treatment information parts from are sequentially reproduced by the reproducing unit 2. Therefore, when a plurality of events occur at the target device 3 at the same time, the operator can be notified of the operation guidance information corresponding to these events by one-time reproduction, and the same operation is not repeated, resulting in unnecessary operation. It can be omitted.

The operator visually grasps the operating procedure by reproducing and displaying an image of the actual operating procedure on the display unit while looking at the target device 3 from the operator's point of view. can do. At this time, the multimedia function can be effectively used by reproducing and displaying the character information that describes the actual operation procedure on the display unit or by reproducing and outputting the audio information that describes the actual operation procedure. .

The function as the operation guidance information reproducing device of the related art of the present invention can be realized in the terminal device that manages the target device 3, and the database 4 is provided on the upper device side and shared with other devices. Thus, the database 4 (system resource) can be effectively used. In the multimedia information reproducing method and apparatus of the present invention described above with reference to FIG.
As a result, sequence data composed of key data for designating multimedia parts is created in accordance with an instruction from the input unit 14, and the reproduction order of arbitrary plural multimedia data parts in the database 13 is determined.

When a reproduction start instruction is received from the input unit 14, the sequence data reproducing unit 16 reads a plurality of multimedia data parts from the database 13 in accordance with the sequence data created by the sequence data creating unit 15. Then, the plurality of multimedia data parts are sequentially reproduced on the display unit 11 and the audio output unit 12.

Therefore, when the user arbitrarily selects a pre-created multimedia data part, each selected part is automatically reproduced in accordance with the reproduction order (sequence data) of each part. It is possible to easily create and reproduce a multimedia title that includes only the information that is desired to be reproduced in a reproduction mode according to the request. In addition,
The sequence data creating means 15 reproduces the information necessary for creating the sequence data on the display unit 11 and the voice output unit 12, and the user refers to the information and inputs an instruction from the input unit 14 to interact. By advancing the creation of sequence data in the format, even a user who does not know how to create can easily create a multimedia title.

Further, the multimedia data parts are composed of video data and audio data for one scene, in addition to key data, and control data for these data, so that one part is provided for each scene. You can select to configure a multimedia title.
Further, the control data can be used to apply a special effect when reproducing the video data and the audio data.

[0039]

Embodiments of the present invention will be described below with reference to the drawings. (A) Description of First Embodiment FIG. 6 is a block diagram showing a configuration of an operation guidance information reproducing apparatus as a first embodiment of the present invention. In FIG.
Reference numeral 20 denotes a bill depositing / dispensing machine (business equipment, peripheral equipment, target equipment) having a mechanism described later with reference to FIG.
When an event (hereinafter, collectively referred to as an error) that requires an operator's action, such as an error and a medium replenishment requirement, occurs in the bill depositing / dispensing machine 20, the type of the error is detected. This is for automatically reproducing and displaying the recovery operation procedure of the error that is currently occurring.

Here, the banknote depositing / dispensing machine 20 is used for the window operation of a financial institution such as a bank, and is used for depositing / dispensing the banknotes exchanged by a transaction window operator with a customer. is there. Therefore, the banknote pay-in / pay-out device 20 is usually arranged in the vicinity of an operator at a transaction counter with a customer, and is connected to a terminal device for the operator to perform an input operation, and the operation state is managed via this terminal device. It is like this. The function of the operation guidance information reproducing apparatus of the present embodiment described below is
For example, the terminal device described above can be provided.

The bill depositing / dispensing machine 20 is constructed, for example, as shown in FIG. In FIG. 7, reference numeral 21 is a deposit port into which a bill is inserted, 22 is a deposit discriminating unit that discriminates the bill inserted from the deposit port 21, 23 is a front / back reversing unit that reverses the front and back of the bill, and 24A to 24C are deposits. A temporary holding unit for temporarily pooling the bills, 25 is a reject separation / conveyance path for branching and discharging the improper banknotes from the normal conveyance path, and 26 is an improper branch branched by the reject separation / conveyance path 25. It is a reject port for ejecting banknotes.

27 is a banknote cassette for storing / holding banknotes, 28 and 29 are first and second stackers for storing / holding banknotes respectively, and 30 is a banknote from the banknote cassette 27 and the stackers 28, 29. For transporting money, 31 is a dispenser identification unit for identifying bills dispensed from the bill cassette 27 and stackers 28, 29, 32 is a dispense port through which dispensed bills are discharged, and 33 is an improper dispense. It is a reject box that takes in banknotes.

In order to convey the bills in the bill depositing / dispensing machine 20, as shown in FIG. 7, a large number of rollers (not shown) are provided along the bill conveying path. It is adapted to be rotationally driven by a drive motor 35. Further, the drive motor 35 operates by receiving power supply from the power supply unit 34. In such a mechanism (mechanism 20A in FIG. 6), there is jamming of bills on the conveying path, bill cassette 27, stackers 28, 29.
An optical sensor 20B for detecting the amount of banknotes in, the presence / absence of banknotes in the reject box 33, and the like is arranged at each position in the mechanism 20A. In addition, although not shown in FIG. 7, a bill depositing / dispensing machine such as an opened / closed state of a door on the front of the bill depositing / dispensing machine 20 and various mechanisms (hereinafter referred to as a mechanism) such as a mechanical storage chamber in the bill depositing / dispensing machine 20. 20 Mechanical sensor 20C that detects the mounting state of the main body (see FIG. 6)
Are placed at each location.

Further, as shown in FIG. 6, the bill depositing / dispensing machine 20 has a mechanical operation control section 20D for controlling the operating state of a mechanism 20A in the bill depositing / dispensing machine 20, and sensors 20B, 2 as well.
A sensor control unit 20E for grasping and monitoring the state of the mechanism 20A (error occurrence) via 0C is provided, as well as an error information storage unit 20G and a bill depositing / dispensing machine control unit 20F.

The error information accumulating section 20G is for pre-storing an error code (error information) about an error or the like occurring in the mechanism 20A, and the bill depositing / dispensing machine control section 2
0F is for searching the error information storage unit 20G based on the information collected by the sensor control unit 20E and notifying the corresponding error code to the multimedia help control unit 47.

Next, the configuration of the apparatus of this embodiment for reproducing the operation guide information (help information) for the bill depositing / dispensing machine 20 as described above will be described with reference to FIG. In FIG. 6, reference numeral 40 denotes an input unit for the operator to input various instructions.
The input section 40 has a keyboard 40A and a mouse 40B, and also has a keyboard 40A and a mouse 40B.
It has an input control section 40C for managing the input state from the.

Reference numeral 41 is a user interface control unit for receiving a signal from the input unit 40 (input control unit 40C) and transferring it to a multimedia help control unit 47 and an error information registration control unit 44, which will be described later, and 42 is image information and audio. The reproducing unit 42 reproduces multimedia information including information. The reproducing unit 42 has a CRT (display unit) 42A for reproducing image information and a speaker (audio output unit) 42B for reproducing audio information. And speaker 42
The multimedia information display / output control unit 42C for controlling the actual reproduction state of the image information and the audio information in B is provided.

Reference numeral 43 denotes a multimedia database. The multimedia database 43 of this embodiment stores various operation guide information about the bill depositing / dispensing machine 20 in advance as multimedia information including image information and voice information. Here, the operation guidance information is the banknote deposit / withdrawal machine 20.
Not only when an error (banknote jam, banknote runout, etc.) that requires the operator to take action occurs, but when the operator needs an operation guide regardless of whether there is an abnormality, it is reproduced as described below. , Is notified to the operator.

Further, in the multimedia database 43 of this embodiment, the multimedia information regarding the operation guide information is applied to the bill depositing / dispensing machine 20 by the operator, as will be described later in Table 2 and FIG. It is stored in the state of multimedia help data parts (treatment information parts; hereinafter simply referred to as parts) which are made into parts for each minimum unit of possible treatment.

Further, in each part, as operation guidance information, image information visualizing an actual operation procedure in a state where the banknote depositing / dispensing machine 20 is viewed from the operator's point of view, and characters for explaining the actual operation procedure. Information (which may be included in the image information) and voice information for explaining the actual operation procedure are included. 44
Is an error information registration control unit, 45 is an error information storage unit, 4
6 is a multimedia information search control unit (search unit), 47 is a multimedia help control unit (playback control unit, order determination unit), and 48 is a flag memory.

Here, the error information registration control section 44 constitutes a function of registering an error code for each error that occurs in the bill depositing / dispensing machine 20, and help information for coping with the error for each error code. It has a function of registering and editing the information [part code (key data) that specifies the part] necessary for the parts. That is, the error information registration control unit 44 cooperates with the multimedia help control unit 46 to register / edit the part code for each error, and to rearrange the registered / edited part code in the order of operation. It has a function of assigning a sequence of its part codes to each error code. The error information registration status by these means is displayed on the CRT 42A and provided to the operator, as will be described later with reference to FIGS. 8 to 10, and the operator operates the keyboard 40A and the mouse 40B while referring to the display. By inputting the desired information, error information can be registered / edited interactively.

The information edited by the error information registration control unit 44 is stored in the error information storage unit 45 for each error code as a table shown in Table 1, for example.
It is supposed to be retained. In the error information storage unit 45, only the part code for designating the part is registered, but the actual image information and audio information are not registered.

As will be described later, the multimedia information search control unit 46 follows the instruction from the multimedia help control unit 47 and the information from the error information storage unit 45 according to the instructions.
The parts in the multimedia database 43 are searched. Also, the multimedia help control unit 47
Operates in accordance with the flow charts described later with reference to FIGS. 14 and 16 to 19 and performs a characteristic function of the present invention. The multimedia help control unit 47 includes a mechanical operation control unit 20D, a sensor control unit 20E, Error information registration control unit 44 and multimedia information search control unit 4
In cooperation with 6, the multimedia help information is controlled to be reproduced and displayed / outputted.

More specifically, the multimedia help control section 47 detects an error occurrence in the mechanism 20A of the banknote depositing / dispensing machine 20 by the sensor control section 20E and receives a notification to that effect from the sensor control section 20E. Information registration control unit 44
To retrieve the error information according to the error code of the error that occurred this time (see Table 1), and then according to the error information (part code sequence), the multimedia information retrieval control unit 46 The multimedia database 43 is searched by and the read parts (multimedia information) are controlled to be reproduced in the reproduction order determined based on the sequence of the part code.

At this time, the timing of reproducing and displaying / outputting the multimedia information of each part is determined in cooperation with the sensor control unit 20E, and the multimedia information of each part is reproduced in association with the state of the mechanism 20A. It is supposed to be done. Depending on the registration status of the error information, a reset operation of the mechanism 20A is performed through the mechanism operation control unit 20D.

Here, the function of the multimedia help control section 47 of this embodiment will be described in detail. The multimedia help control section 47 mainly performs the following three functions. First, as a first function, the multimedia help control unit 47 changes the state of the mechanism 20A that changes according to the procedure performed by the operator to the sensors 20B and 20C.
Also, the current mechanism 20 is received via the sensor control unit 20E and is linked with the state of the mechanism 20A as described above.
The reproduction unit 42 is controlled to sequentially reproduce the help information regarding the treatment to be performed for the state A.

As a second function, the multimedia help control unit 47 first reproduces the operation guide information (help information for advanced users) having the lowest degree of detail, as will be described later with reference to FIGS. Each time the operator instructs / requests a change in the degree of detail from the input unit 40, the operation guide information (help information for intermediate users, help information for beginners) with gradually higher details is reproduced. At 42, control is performed so as to sequentially reproduce.

As a third function, the multimedia help control section 47 responds to all the errors retrieved from the error information storage section 45 by the error information registration control section 44 when a plurality of errors occur simultaneously in the mechanism 20A. Sort all part codes, and if the same part code exists, add only one part code to the playback order (sequence) of help information, and determine the playback order of parts so that the same parts do not overlap To do. And
The multimedia help control unit 47 controls the reproduction unit 42 to sequentially reproduce the parts obtained by searching the database 43 by the multimedia information search control unit 46 according to the determined reproduction order.

The flag memory 48 is for storing various flags set at the time of control operation by the multimedia help control section 47. Specifically, FIGS.
As will be described later with reference to FIG. 19, a part flag or the like for clarifying that the part has been processed for the mechanism 20A and the display / reproduction process has already been completed is stored in the memory 48.
Is set and held.

The operation of the operation guidance information reproducing apparatus of the present embodiment constructed as described above will be described below with reference to FIGS. First, the third function of the multimedia help control unit 47 described above (even if a plurality of errors occur at the same time, the parts can be combined without overlapping the same work and the operation guidance can be performed in the most efficient order. Function), an example of a concrete realizing means will be described below.

In the screen display states of the items (a1) to (a3) among the following items (a1) to (a4), the multi display is performed in accordance with a request (instruction input from the input unit 40) from the user (operator). The media help control unit 47 and the error information registration control unit 44 cooperate with each other, and the error information registration result is stored in the error information storage unit 45 through the error information registration control unit 44.

(A1) First, all error events that can be recovered by the user (operator) with their own hands are registered for each error type. At this time, a unique error code is added to each error type. Error code setting screen CRT42A
An example of the above display is shown in FIG. On the screen shown in FIG.
As shown by the shaded area, for example, the error type “mechanical γ
A case is shown in which a unique error code “00003” is set for “cash jam” (cash jam generated in the mechanism γ part of the mechanism 20A). At this stage, the part structure has not been registered for the error type.

(A2) The flow of the error handling operation corresponding to each error code is divided into the smallest units that can be divided on the time axis and registered as parts. At that time, the type and state of the sensor that is the termination condition of the part are also registered at the same time. FIG. 9 shows a display example of the parts setting screen on the CRT 42A at this time. In the screen shown in FIG. 9, the content "door A open" of the part A is displayed, and the condition setting condition for ending the reproduction of the part (here, the door A sensor is open) is displayed. It is displayed. Further, in the parts setting screen shown in FIG. 9, areas for "new registration", "change", "delete", "content search", and "sensor search" are provided in order to confirm / edit the contents of each part. It is displayed and various operations can be performed by clicking each area with the mouse pointer.

(A3) The order in which the parts registered on the parts setting screen shown in FIG. 9 are processed most efficiently and the error can be dealt with without waste is examined.
Determine the ideal order of implementation. Register the decided execution order on the parts operation order setting screen. FIG. 10 shows a display example of the parts operation order setting screen on the CRT 42A. This Figure 1
On the screen 0, the part number is automatically added / changed every time the parts are rearranged in the order of operation.

(A4) When the operation order, that is, the part reproduction order is set on the part operation order setting screen shown in FIG. 10, the error code setting screen shown in FIG. 8 is automatically displayed. In the display state, the part configuration corresponding to each error code is input. The parts configuration is input by selecting from the list box (window display) of "Parts selection" where you can see the list of parts.
If there is a common operation between different error codes, it is possible that parts are shared.

Note that the above-mentioned error code registration is not performed by an operator such as a bank clerk, but is pre-installed, so that the operator's labor for registration can be omitted. A specific example of following the steps (a1) to (a4) and adding an error code to a certain error event will be described below.

Here, it is assumed that the error event is “a cash jam has occurred in the mechanism α” (that is, a cash jam occurred in the mechanism α part of the mechanism 20A). Error code: 00001 Error type: "Mechanical α cash jam" Part type: "Door A open": Open door A on the front of the device "Mechanical storage room B open": Pull out mechanical storage room B from the main body "Mechanical α "Remove jam from mechanism": Remove cash jam from mechanism α on top of mechanism storage room B "Mechanical storage room B closed": Push mechanism storage room B into the main unit to set "door A close": Close door A End condition of parts: Door A sensor: Open Mechanical storage room B sensor: Open Mechanical α sensor: Normal Mechanical storage room B sensor: Close Door A sensor: Close As an example, assume that there are 7 error events. , Shall be classified as follows. Table 1 shows the priorities a to c corresponding to each error code, the error type, and the parts and sequences necessary for error recovery, and Table 2 shows the operation content of each part code used for the error codes 00001 and 00002. Details are shown and FIG. 11 shows an example of the relationship between the part codes A to X.

[0068]

[Table 1]

[0069]

[Table 2]

Multimedia help information is created for each part determined by the above procedure. This multimedia help information is reproduced in order, the image information is displayed on the CRT 42A, and the audio information is output from the speaker 42B, whereby the operator is notified of the operation guidance information, and the mechanism 20A of the banknote depositing / dispensing machine 20 operates. The error that occurred can be recovered.

In FIG. 11, error code 00001
And the part code used in 00002 is
A, B, E, and I are common, and only C and D are different. Therefore, when these two errors occur at the same time, it is desirable to perform the operations of parts codes A and B, then the operations of C and D at one time, and then the operations of E and I. If you do this,
Since it is not necessary to repeat the common operations A, B, E, and I, more effective work can be performed. Based on this idea, the priority of part codes is determined for all error codes.

Data such as images and sounds of multimedia help information are stored in a large-capacity storage device (database 43) such as a CD-ROM or a hard disk. All the part codes of the multimedia help data corresponding to the error code are stored in the error data accumulating unit 45 in a help data parts table as shown in FIG. 12, for example. Note that each help data parts table has a variable length, and the TOD (To which is a key when the error information registration control unit 44 searches the position of each table is provided at the head of the help data parts table.
p Of Data) is attached. The address where each help data part exists is stored in the address conversion table as shown in FIG. 13, for example, in the error information storage unit 45.

By the way, the above-mentioned error code 0000
If the errors 1 and 00002 occur simultaneously, the multimedia help control unit 47 causes the error information registration control unit 4 to
The data parts table of both error codes is searched in the error information storage unit 45 via 4, and the necessary part code is checked in the multimedia help control unit 47.

Then, the multimedia help control unit 47
In step 2, all part codes of both error codes are sorted, and when there are a plurality of same part codes, only one is put in the help information component. Here, A, B, E, and I, which are common part codes between both errors, correspond to them. Therefore, the part code sequence after sorting is
“A → B → C → D → E → I”.

The multimedia help control section 47 refers to the address of each part code in the address conversion table of the error information storage section 45 and, in the reproduction order, through the multimedia information search control section 46, the multimedia database. The parts are retrieved from 43 and their reproduction is controlled. As a result, the multimedia error recovery operation guide is reproduced and displayed / outputted, so that the operator can take the most efficient countermeasure against the error by taking action on the mechanism 20A of the banknote depositing / dispensing machine 20 in accordance with the operation guide. It becomes possible to do.

Next, the overall flow of the help information reproduction process by the apparatus of this embodiment is shown in FIG. 14 (steps S1 to S8).
Will be described. Normally, in a business device such as a banknote depositing / dispensing machine 20 used at a bank teller, a business screen is displayed on its display or a display (CRT 42A of this embodiment) of a terminal device to which the business device is connected. .

As described above, the bill depositing / dispensing machine 20 is provided with a large number of optical or mechanical sensors 20B, 20C, and the sensor control section 20E controls the sensor signals based on the detection signals from these sensors 20B, 20C. When it is detected that the mechanism 20A of the bill depositing / dispensing machine 20 has an error (YES determination in step S1), first, the mechanical operation of the bill depositing / dispensing machine 20 is forcibly stopped (step S2).

Thereafter, error information such as the location of the error, the error code, and the state of the mechanism 20A of the bill depositing / dispensing machine 20 is collected through the sensor control unit 20E, and the collected information is notified to the bill depositing / dispensing machine control unit 20F. Then, the banknote pay-in / pay-out device control unit 20F searches the error information storage unit 20G based on the collected information and notifies the multimedia help control unit 47 of the corresponding error code (step S).
3). At this time, if multiple errors occur simultaneously, information about the multiple errors is collected,
Multiple error codes are searched and notified. Based on the notified error code, the multimedia help control unit 47 searches the data parts table of each error code in the error information storage unit 45 via the error information registration control unit 44, and searches for the necessary part code. -Collect (step S4).

Then, the multimedia help control unit 47
Sorts all the collected part codes (step S5) and integrates a plurality of identical part codes into one to create a part code sequence (part reproduction order) (step S6). Further, the multimedia help control unit 47 uses the address conversion table in the error information storage unit 45 to determine the address on the database 43 in which the necessary help data parts are stored, based on the integrated part code sequence. Then, the multimedia information search control unit 46 searches the database 43 for the corresponding help data parts, reproduces and displays the image information about the help information on the CRT 42A, and the voice information about the help information through the speaker 4.
2B is reproduced and output (steps S7 and S8).

Next, according to the flowcharts (steps S11 to S50) shown in FIG. 15 and FIGS. 16 to 19, the first function of the multimedia help control unit 47 (in association with the state of the mechanism 20A) is described. A processing procedure for implementing a function of reproducing help information) and a second function (a function of easily reproducing help information according to an operator's level) will be described.

16 to 19 show the control processing procedure executed by the multimedia help control unit 47 when the error codes 00001 and 00002 in Table 1 occur at the same time. In particular, FIG. Is
FIG. 6 is a concrete illustration of a hierarchical screen display example according to an operator's level along the flow of actual processing. First,
When an error occurs in the mechanism 20A of the banknote deposit / withdrawal machine 20,
After the parts flag in the flag memory 48 is cleared (step S11 in FIG. 16), the help screen A is first displayed from the work screen A0 on the CRT 42A as shown in FIG. 15 (step S12). This screen A
The error occurrence location, error code, and detailed information are displayed in. No multimedia help titles are used here.

An advanced-level operator who is accustomed to dealing with errors in the bill depositing / dispensing machine 20 can recover the bill depositing / dispensing machine 20 just by looking at the help screen A and taking appropriate action. . When the restoration is completed, the mechanism 20A
The restoration is detected by the sensors 20B and 20C in the inside (Fig. 1
After determining YES in step S13 of 6) and displaying "restored" on the screen (step S4 of FIG. 19).
9), the display on the CRT 42A automatically returns to the work screen A0 (step S50).

If an error cannot be dealt with using only the help screen A, click the "detailed description" display on the CRT 42A with the mouse 40B or use the keyboard 40
Press the detailed explanation button on A (step S in FIG. 16).
(YES judgment at 14). In response to this operation, the parts flag in the memory 48 is checked (step S15),
Special display processing such as gray display is performed on the screens of the parts for which the flag is set (step S1).
6), the help screen B is displayed (step S17).

The significance of the processing in steps S15 and S16 will be described later. Further, in this embodiment,
The help screen A is displayed at the same time as the error occurs, and the timer is activated at the same time, and the state in which neither the restoration of the failure nor the request for "detailed explanation" is made (NO determination in steps S13 and S14) continues for a predetermined time When this is detected by the timer, the processes of steps S15 and S16 are automatically performed, and then the help screen B is displayed in step S17.

On the help screen B, as shown in FIG.
Figure (image) and text (character information) showing the flow of a series of work to recover the error that is currently occurring
However, a plurality of small screens B1 for each work unit (part)
B6 are divided in a grid pattern and displayed in the order of operation from the upper left to the lower right. The display order follows the predetermined part code sequence as described above for the most efficient error handling.

At this time, each of the screens B1 to B6 is the same as the top screen of each part constituting the multimedia help title. An intermediate-level operator who is used to some extent to deal with the error handling of the banknote pay-in / pay-out device 20 can recover the banknote pay-in / pay-out device 20 by performing an appropriate error coping by looking at the help screen B. When the restoration is completed, the restoration is detected by the sensors 20B and 20C in the mechanism 20A (YES determination in step S18), and "Restored" or the like is displayed on the screen (step S49 in FIG. 19), and then on the CRT 42A. Is automatically returned to the work screen A0 (step S50).

When the error cannot be dealt with even by referring to the help screen B, the display screen of the operation of which the operation method is not known among the small screens B1 to B6 of the help screen B is clicked on the CRT 42A by the mouse 40B. To select (step S19 in FIG. 16). By this operation, each part of the multimedia help information is reproduced. In this case, too, the timer is activated at the same time that the help screen B is displayed, and failure recovery and selection of the small screens B1 to B6 are not performed (N in steps S18 and S19).
If (O determination) continues for a predetermined time or more, the process proceeds to the help screen display process in step S20 of FIG.

As shown in FIG. 15, when the part A (help screen B1) is clicked, or when it is detected by the timer that a predetermined time has elapsed after the help screen B is displayed, the steps of FIG. After shifting to S20, more detailed help screens C1-1 to C1-n are sequentially displayed. Similarly, parts B, C, D, E, I (help screen B
2 to B6) are clicked, respectively.
Step S24 of FIG. 7, Steps S28 and S32 of FIG.
(S35), the process proceeds to steps S41 and S45 in FIG. 19, and more detailed help screens C2-1 to C2-n; ...; C
6-1 to C6-n are sequentially displayed. These help screens C1-1 to C1-n; ...; C6-1 to C6-n are collectively referred to as a help screen C.

On this help screen C, an operation explanation of an error recovery method using a moving image, a still image, a voice, a text (character information), etc. is performed, and the bill depositing / dispensing machine 20 is touched for the first time. Even beginner level operators,
If the banknote pay-in / pay-out device 20 is operated in parallel while referring to the help screen C, appropriate error handling can be surely performed and the banknote pay-in / pay-out device 20 can be restored.

The moving images and still images displayed on the help screen C are images of the actual operating procedure when the banknote depositing / dispensing machine 20 is viewed from the operator's point of view. Is displayed together with the character information (text) for explaining. At the same time as the display, a voice explaining the actual operation procedure is also output from the speaker 42B. The help screen C as described above indicates whether or not the multimedia help control unit 47 has actually performed the procedure performed by the operator based on the detection result (state of the mechanism 20A) by the sensors 20B and 20C in the mechanism 20A. While making a judgment, the screen is sequentially switched to a screen showing the operation to be performed next.

For example, when the help screen B1 is selected (or when a predetermined time has elapsed after the help screen B is displayed), the part A at the beginning of the part code sequence is reproduced and the help screen C1-1 is displayed. Parts A
Is the help information that prompts the operation to open the door A on the front of the device, so as shown in Fig. 15, the characters such as "Prepare a green key." And "Insert the key." ( Along with the audio output), the actual image of each operation is displayed on the help screen C1.
Are sequentially displayed as -1, C1-2, ... (Step S20 in FIG. 17).

After the display of the part A, if the mouse 40B is not double-clicked or the predetermined key on the keyboard 40A is not pressed (NO determination in step S21; the detailed description of the operation will be described later), the help display next to the part A is displayed. However, it is necessary to confirm that the door A is open at this time. Therefore, the detection signal from the door A sensor attached to the door A is checked to confirm that the door A is opened (YES determination in step S22), and the next help display is performed.

That is, the operator selects the help screen C1-1,
The door A is opened by referring to C1-2, ..., At the time when the door A sensor detects the open state, a flag indicating that the process for the part A is completed is set to ON in the memory 48 (step S23). ), The part B which is the next help information is reproduced (step S24). Thus help screen C
If is selected once, the help screen C (each help data part) that continues after that is interlocked with the detection signals (state of the mechanism 20A) from the sensors 20B and 20C unless the operator indicates intention to interrupt. The playback timing is automatically determined and automatically played back and displayed.

However, if the operator reproduces the help screen C,
When it is desired to suspend the display, for example, the mouse 40B is double-clicked or a predetermined key on the keyboard 40A is pressed (steps S21 and S2 in FIG. 17).
5, steps S29, S33, S36 of FIG. 18, FIG.
Determination in steps S42 and S46), step S
After performing the processing of 15 and S16, the screen returns to the help screen B display in step S17 and shifts to the input waiting state.

Thereafter, similarly, the reproduction timing of the help data parts is automatically determined by linking with the detection results (state of the mechanism 20A) from the sensors 20B and 20C. When the processing by the part A is completed or when the help screen B2 is selected, the part B is reproduced and the help screen C2-1 is displayed. Part B
Is help information that prompts the operation of pulling out the mechanical storage room B. Therefore, as shown in FIG. 15, along with the character display (voice output) such as "while pushing the release button ..." and "pull the release lever." The actual image of each operation is the help screen C2
Are sequentially displayed as -1, C2-2, ... (Step S
24).

After the display of the part B, if the mouse 40B is not double-clicked or the predetermined key on the keyboard 40A is not pressed (NO determination in step S25), the process moves to the next help display of the part B. At this time, It is necessary to confirm that the mechanical storage room B is pulled out. Therefore, the mechanical storage room B attached to the mechanical storage room B
After checking the detection signal from the sensor to confirm that the mechanical storage chamber B has been pulled out (YES in step S26).
(S judgment), the next help is displayed.

That is, the operator selects the help screen C2-1,
With reference to C2-2, ..., the mechanical storage room B is pulled out, and at the time when the mechanical storage room B sensor detects the open state, a flag indicating that the processing for the part B is completed is set to ON in the memory 48. From (step S27 in FIG. 18), the next help information, part C, is reproduced (step S2).
8).

When the processing by the part B is completed or when the help screen B3 is selected, the part C is reproduced and the help screens C3-1, C3-2, ... Are sequentially displayed (step S28), The operator is urged to remove the cash jam from the mechanism α on the upper surface of the mechanism storage room B as help information. Mouse 4 after displaying part C
If the user does not double-click 0B or press the predetermined key on the keyboard 40A (NO determination in step S29), the help display for the next part C is displayed, but at this time, the cash jam is removed from the mechanism α. You need to make sure. Therefore, after checking the detection signal from the mechanical α sensor attached to the mechanical α to confirm that the cash jam has been removed (step S30
If YES, the next help is displayed.

That is, the operator selects the help screen C3-1,
When the cash jam is removed from the mechanism α by referring to C3-2, and the mechanism α sensor detects “jam removal”,
After the flag indicating that the process for the part C is completed is set to ON in the memory 48 (step S31), the next help information, part D, is reproduced (step S).
32).

In this embodiment, the parts D are three as shown in Table 2, "drawing the mechanism β from the mechanism storage chamber B, removing the cash jam, and pushing the mechanism β into the mechanism storage chamber B to set". The operation is treated as one part. This is because it is necessary to perform the three operations in succession, and it is meaningless to divide them into different parts. However, in order to explain the operation in an easy-to-understand manner, the help data content of the part D is divided into two parts D-1 and D-2 in this embodiment.

Therefore, when the processing by the part C is completed or when the help screen B4 is selected, the part D-1 is first reproduced (step S32), and the operator is instructed to the mechanical storage room B. The operation to pull out the mechanism β from is prompted as help information. After displaying the part D-1, if the mouse 40B is not double-clicked or the predetermined key on the keyboard 40A is not pressed (NO in step S33).
Judgment), the display moves to the next help display for part D-2,
At this time, it is necessary to confirm that the mechanism β has been pulled out. Therefore, after checking the detection signal from the mechanical β sensor attached to the mechanical storage room B to confirm that the mechanical β has been pulled out (YES determination in step S34), the second part D-2 Is reproduced and displayed (step S35).

In the display of the part D-2, the operator is urged as the help information to remove the cash jam from the mechanism β and then set the mechanism β in the mechanism storage room B. If the mouse 40B is not double-clicked or the predetermined key on the keyboard 40A is not pressed after displaying the part D-2 (NO determination in step S36), the part D-
Whether or not the operation corresponding to the display of No. 2 has been surely performed is confirmed as follows (steps S37 and S38).

The mechanism β does not operate normally unless it is securely set in the mechanism storage room B. Therefore, first, the detection signal from the mechanism β set sensor is checked, and the mechanism β is set in the mechanism storage room B. After confirming that the cash jam is present (YES in step S37), the detection signal from the mechanical β sensor is checked to confirm the removal of the cash jam (step S38).

If the cash jam of the mechanism β is not surely removed (NO judgment in step S38), the part Z has the contents such as "Jam is not removed. Please try again". Is reproduced and displayed (step S39), the process returns to step S32, and the content D-1 is reproduced again. In this way, after confirming that the cash jam has been surely removed (step S3
After determining YES in step 8), a flag indicating that the process for the part D has been completed is set to ON in the memory 48 (step S40), and the next help information, part E, is reproduced (step S41 in FIG. 19). ).

When the processing by the part D is completed or the help screen B5 is selected, the part E is reproduced and the help screens C5-1, C5-2, ... Are sequentially displayed (step S41). The operator is urged to push the mechanical storage room B into the main body as help information. If the mouse 40B is not double-clicked or the predetermined key on the keyboard 40A is not pressed after the display of the part E (NO determination in step S42), the help display for the next part E is displayed. It is necessary to confirm that B is pushed in. Therefore, the detection signal from the mechanical storage room B sensor is checked to check the mechanical storage room B
After confirming that has been pressed (YES determination in step S43), the next help display is performed.

That is, the operator selects the help screen C5-1,
Referring to C5-2, ..., the mechanical storage room B is pushed in, and at the time when the mechanical storage room B sensor detects the closed state, a flag indicating that the processing for the part E is finished is set to ON in the memory 48. From (step S44), the last help information, part I, is reproduced (step S45).

When the processing by the part E is completed or when the help screen B6 is selected, the part I is reproduced and the help screens C6-1, C6-2, ... Are sequentially displayed. Since the part I is the help information for prompting the operation of closing the door A on the front of the device, as shown in FIG. 15, "Wait without turning the key ...", "Close the door as it is", etc. Actual images of each operation are sequentially displayed as help screens C6-1, C6-2, ... Together with the character display (voice output) (step S45).

After displaying the part I, if the mouse 40B is not double-clicked or the predetermined key on the keyboard 40A is not pressed (NO determination in step S46), the help guidance is ended, but at this time, the door A is closed. Need to make sure. Therefore, the detection signal from the door A sensor is checked to confirm that the door A is closed (YES determination in step S47), and the help guidance ends.

That is, the operator selects the help screen C6-1,
The door A is closed with reference to C6-2, ... At the time when the door A sensor detects the closed state, a flag indicating that the process for the part I is completed is set to ON in the memory 48 (step S48). ), "Restored" and the like are displayed on the screen (step S49), and then the display on the CRT 42A automatically returns to the work screen A0 (step S50).

As for the screens B1 to B6 on which the operator actually performed the work, since the predetermined flag in the memory 48 is set to ON, the reproduction of the help screen C is performed.
When the display is interrupted and the help screen B is displayed, the flag is referred to (step S15 in FIG. 16), and special display processing such as gray display is automatically performed on the small screen (B1 to B6) of the parts whose flag is ON. Apply (step S16). As a result, it is made clear to the operator that the work has already been completed, and the gray-displayed small screen cannot be selected again.

Further, as described above, even when the help screens A and B are displayed, when the error handling for the bill depositing / dispensing machine 20 is completed and the error is recovered, the bill depositing / dispensing machine 2
Error recovery is detected by the sensor control unit 20E of 0 (YES determination in steps S13 and S18 of FIG. 16), and a message such as “error recovery” is displayed on the currently displayed help screen A or B (see FIG. 19). Step S4
9), the help screen A or B is deleted from the CRT 42A, and the display on the CRT 42A automatically returns to the work screen A0 (step S50).

As described above, according to the first embodiment of the present invention, the apparatus itself detects the operation of error recovery and medium replenishment, and the help guidance can be automatically reproduced in synchronization with this. Therefore, the help information can be automatically used without bothering the operator, and the operation efficiency is significantly improved. Further, the function as the operation guidance information reproducing device of the present embodiment is provided to the terminal device as described above, but this terminal device is originally provided to the terminal device for managing the bill depositing / dispensing machine 20. Therefore, it is not necessary to additionally provide a device for reproducing detailed operation guidance information, and there is an advantage that an accurate operation procedure can be reproduced at low cost.

Further, since the help information for the intermediate level and the beginner level can be displayed and reproduced step by step in response to the operator's request from the simple help explanation for the advanced level, inefficient work can be performed for the operator. It is possible to efficiently provide the help information of the level content suitable for the operator to the operator of any level without forcing the operation, and the operator can operate only by efficiently viewing the necessary information. Can be done.

Furthermore, when a plurality of errors or medium replenishment requirements occur, the same processing is not duplicated and the processing order is customized for each user, so that it is most efficient. The help screens B and C can be displayed in any order. Further, while the bill depositing / dispensing machine 20 is viewed from the operator's point of view, an image of an actual operating procedure is reproduced and displayed on the help screen C, and at the same time, character information and voice information are reproduced to enable the multimedia function. By using it, the operator can surely visually and audibly understand the operation procedure, and can notify the operator of the operation content in an extremely easy-to-understand manner.

In the above-described embodiment, the case where the target device for performing the operation guidance is the bill depositing / dispensing machine has been described, but the present invention is not limited to this and the same applies to other business devices. The same operational effects as those of the above-described embodiment can be obtained. Further, in the above-described embodiment, an example of performing operation guidance when an error or medium replenishment requirement occurs has been described, but when an operator (user) needs an operation guide regardless of whether there is an abnormality, Operation guidance may be provided in the same manner as in the above-described embodiment.

Further, in the above-mentioned embodiment, the case where the operator has three levels of advanced, intermediate, and beginner, and the three-level display corresponding to each level is performed, is explained.
The present invention is not limited to this, and two-step display or hierarchical display of four or more steps may be performed. (B) Description of Second Embodiment FIG. 20 is a block diagram showing the configuration of a system having an operation guidance information reproducing device as a second embodiment of the present invention.
Also in the second embodiment shown in FIG. 20, the terminal device (workstation) 50 has substantially the same function as that of the operation guidance information reproducing device described in the first embodiment. The device (target device) 60 is managed, and when an event such as an error occurs in the peripheral device 60, the operation guidance (operation guide information) corresponding to the event is reproduced on the terminal device 50. ing.

However, in the second embodiment, the terminal device 5
0 is connected to a server device (upper device; other terminal device, inquiry computer, etc.) 70 via a transmission line 65 that constitutes a network such as a LAN, and an operation guidance registration file (database) connected to this server device 70. )
From 71, information about operation guidance to be reproduced and displayed is provided.

As shown in FIG. 20, the terminal device 50 of this embodiment includes a processing unit 51, a network connection control mechanism 52,
Communication mechanism 53, input unit control mechanism 54, display unit control mechanism 5
5 and a voice output unit control mechanism 56. Here, the processing unit 51 uses the network connection mechanism 52.
In addition to performing transmission / reception access to a LAN (transmission path 65) via the communication device and managing the peripheral device 60 via the communication mechanism 53, it performs almost the same function as the multimedia help control unit 47 described in the first embodiment. Is.

Further, the input section control mechanism 54, the display section control mechanism 55 and the voice output section control mechanism 56 are respectively connected to the terminal device 50 by the input section 57, the display section 58, the voice output section 59 and the processing section 51. The interface between and. The input unit 57 is, for example, a mouse or keyboard for inputting instructions from the operator, and the display unit 58 is, for example, a display such as a CRT, and displays operation guidance information by moving images, still images, characters, or the like. The sound output unit 59 reproduces and displays the sound, and the sound output unit 59 reproduces and outputs the operation guidance information by sound using a speaker or the like.

On the other hand, the peripheral device 60 of this embodiment has a communication mechanism 61, an I / O mechanism 62 and an I / O control mechanism 63. The communication mechanism 61 serves as an interface with the terminal device 50, and the I / O mechanism 62 detects a detailed state (operating state, error, etc.) in the peripheral device 60. Then, the I / O control mechanism 6
3 notifies the terminal device 50 of the detailed information in the device 60 detected by the I / O mechanism 63 via the communication mechanism 61.

Further, the server device 70 of this embodiment has a network connection control mechanism 72, a communication mechanism 73, and a guidance data support processing unit 74. The network connection control mechanism 72 is a LAN (transmission path 65)
And the guidance data support processing unit 74, and the communication mechanism 73 interfaces the operation guidance registration file 71 and the guidance data support processing unit 74.

Then, when the guidance data support processing unit (search unit) 74 receives a request for reading the operation guidance from the terminal device 50 via the transmission path 65 and the connection control mechanism 72, it registers the operation guidance via the communication mechanism 73. The file 71 is searched, the operation guidance information requested to be read is read, and the connection control mechanism 72 and the transmission path 6 are read.
5 to the terminal device 50.

Incidentally, the operation guidance registration file 71
Is an external storage device such as a hard disk, and stores in advance data such as video and audio reproduced by the terminal device 50 as operation guidance information. Especially, the video data is
It is created by photographing the actual operation method while viewing the peripheral device 60 from the operator's point of view. Then, the processing unit (reproduction control unit) 51 in the terminal device 50 of the present embodiment,
The state of the peripheral device 60 (which is detected by the I / O mechanism 62) that changes according to the procedure performed by the operator is received from the peripheral device 60, and the operation progress is linked with the state of the peripheral device 60. The operation guidance corresponding to is received from the operation guidance registration file 71, and the display unit 58 and the audio output unit 59 are controlled to sequentially reproduce the operation guidance.

Next, the operation of the apparatus of the second embodiment configured as described above will be described according to the flow chart (steps S51 to S65) shown in FIG. When some abnormality occurs in the peripheral device 60 (step S51), the abnormality is detected by the I / O mechanism 62 and detailed error information is acquired (step S52). The acquired error detailed information is notified to the terminal device 50 via the I / O control mechanism 63 and the communication mechanism 61 (step S53).

When the processing unit 51 of the terminal device 50 acquires the error detailed information via the communication mechanism 53 (step S
54), based on the error detailed information, the operation guide to be reproduced is selected (step S55), and the video and audio data to be reproduced by the selected operation guide is read by the transmission line 6
Request to the server device 70 via step 5 (step S5
6).

Upon receiving a reading request from the terminal device 50, the guidance data support processing section 74 of the server device 70 searches the operation guidance registration file 71 via the communication mechanism 73 and reads out the operation guidance information requested to be read. (Step S57), transfer to the terminal device 50 via the connection mechanism 72 and the transmission path 65 (step S58).

Then, in the processing section 51 of the terminal device 50,
Upon receiving the operation guidance information from the server device 70, the video data and the audio data included in the operation guidance information are processed into a format that can be actually reproduced (step S59), and then the display control mechanism 55 and the audio output. The operation guide information is sent to the display unit 58 and the audio output unit 59 via the unit control mechanism 56, the operation guide information is reproduced and displayed as a video on the display unit 58, and the operation guide information is reproduced and output as a sound by the audio output unit 59 (step S60). ).

The user uses the display unit 58 and the voice output unit 5.
Peripheral device 6 while referring to the operation guide reproduced in 9
Recovery work and the like at 0 are performed (step S61). When the recovery work of the part where the operation guide is reproduced is completed (YES determination in step S62), the state is detected by the I / O mechanism 62, and the fact that the error recovery process is completed is indicated by the I / O.
The terminal device 50 is notified via the control mechanism 63 and the communication mechanism 61 (step S63). When the peripheral device 60 does not notify the completion of the recovery work of the portion where the operation guide is reproduced, the processing unit 51 of the terminal device 50 is not performed for a predetermined time or longer.
Replays the same operation guide again.

When the processing unit 51 of the terminal device 50 receives the notification of the completion of the restoration work of the portion where the operation guide is reproduced, it is judged whether or not there is operation guide to be reproduced next (step S64).
When there is no operation guide to be reproduced, that is, when all the recovery processing is completed, the reproduction control processing by the processing unit 51 is ended, while when the recovery processing is still in progress,
Again, the operation guide to be reproduced in the next error recovery process is selected (step S65), and steps S56 to S6 described above are selected.
The process of 3 is repeated.

Similarly, the user refers to the operation guidance reproduced by the display unit 58 and the voice output unit 59 to repeat the recovery operation for the peripheral device 60 to return the peripheral device 60 to the normal state. . In this way, the terminal device 50 reproduces the operation guidance information in association with the state of the peripheral device 60, thereby assisting the operator who actually performs the recovery work on the peripheral device.

Further, when the operator needs the operation guide, the information indicating that the operation guide is necessary is input from the input section 57. The input information is notified to the processing unit 51 via the input unit control mechanism 54. Upon receiving this information, the processing unit 51 causes the display unit 5 via the display unit control mechanism 55.
A selection screen for inquiring the operator what kind of operation guide is requested is displayed on 8.

Then, the operator refers to the selection screen displayed on the display unit 58 and obtains a necessary operation guide from the input unit 5
Select / specify by 7. Information regarding the selected operation guide is notified to the processing unit 51 via the input unit control mechanism 54, and the processing unit 51 selects the operation guide to be reproduced based on the notified operation guide information and performs the operation. Read the video and audio data to be played by the guide,
Request to the server device 70 via. Thereafter, the operation guide requested by the operator is reproduced on the display unit 58 and the audio output unit 59 in the same manner as the procedure described above with reference to FIG.

As described above, according to the second embodiment of the present invention, as in the case of the above-described first embodiment, the state of recovery from the peripheral device 60 to the terminal device 50 is performed every time the recovery operation is performed on the peripheral device 60. Since the information is notified and the operation guide corresponding to the recovery state (that is, the recovery operation stage) is reproduced on the terminal device 50, the necessary operation guide is automatically provided without the user giving a special instruction with the mouse or the like. Since it is regenerated, the operation efficiency is greatly improved.

Further, since the image of the actual operation procedure is reproduced and displayed while the peripheral device 60 is viewed from the operator's point of view, the operator can be notified of the operation contents in an extremely easy-to-understand manner. In addition, the client / server system is constructed by LAN etc.
Since data such as voice is collectively registered in the operation guidance registration file 71 connected to the server device 70 and can be shared by each terminal device, the disk resource of the terminal device (workstation) 50 is reduced. Besides, there is an advantage that traffic on the communication path between the terminal devices can be reduced.

(C) Description of Third Embodiment FIG. 22 is a block diagram showing the structure of a multimedia information reproducing apparatus as a third embodiment of the present invention. In the first embodiment, the data to be reproduced is made into parts and registered,
The case where the necessary data parts are searched and combined and the operation guidance information is appropriately created has been described.
The apparatus of the embodiment is such that the above-described parts are formed for arbitrary multimedia information, and the user can create an arbitrary multimedia title by combining the parts.

In FIG. 22, reference numerals 81 and 82 denote an image display device (display unit) and an audio reproduction device (audio output unit) for reproducing multimedia information including image information and audio information, respectively. 83 is a database,
The database 83 stores multimedia information in advance in the form of multimedia data parts which are made into parts for each unit according to the information content.

The multimedia data parts in this embodiment are constructed, for example, as shown in FIG. That is, in each multimedia data part, a unique number for identifying the part is stored as key data, and video data for one scene and audio data for one scene are stored. Further, in each multimedia data part, as control data, an address in the part of video data and audio data, a length of this part, control information regarding reproduction of the video data and audio data (information for applying a special effect, etc.) ) Etc. are stored.

The database 83 is constructed by collecting a large number of multimedia data parts having such a configuration as shown in FIG. Further, by simply storing the key data at the beginning of each multimedia data part in the storage medium (sequence data storage device 91 described later) in order, the address and the reproduction order of the multimedia information can be specified. There is. A file in which this key data is stored in a storage medium and made into a file is called a sequence data file and has a structure as shown in FIG. 25, for example.

In FIG. 22, reference numeral 84 denotes a user inputting an instruction necessary for reproducing the multimedia data parts in the database 83. For example, a mouse,
An input unit such as a keyboard, 85 is a ROM for storing a sequence data creation / update program (sequence data creation means) 86 and a sequence data playback program (sequence data playback means) 87.

The program 86 stored in the ROM 85,
Reference numeral 87 actually operates on a CPU (not shown), and the sequence data creation / update program 86 operates according to the flowcharts described later with reference to FIGS. 27 to 31, and the database 83 according to an instruction from the input unit 84. Create a sequence data file consisting of key data that specifies each multimedia part in order to determine the playback order of multiple multimedia data parts in
It is set and stored in the sequence data storage device 91.

The sequence data reproducing program 8
32 operates in accordance with a flowchart described later with reference to FIG. The multimedia data parts are read from the database 83, and a plurality of multimedia data parts are sequentially reproduced by the reproduction processing unit 88 on the image display device 81 and the audio reproduction device 82.

Further, 88 is a reproduction processing unit, which reproduces the sequence data creation / update program 86.
And various data notified from the sequence data reproducing program 87 to process image data and audio data, and the image data and audio data are processed by the image display device 8.
In addition to having a function of transmitting to and reproducing from the audio data reproducing device 1 and the audio reproducing device 82, it also has a function of accessing the sequence data storage device 91 to write and read the sequence data file.

89 is a RAM, 90 is a register,
The RAM 89 and the register 90 are the reproduction processing unit 88.
It is used during the processing operation of, and is for temporarily storing various data. Next, the operation of the apparatus of the third embodiment configured as described above will be described with reference to FIGS.

In the present embodiment, normally, as shown in FIG. 26, the processing by each program is performed in the order of the processing by the sequence data creation / update program 86 (step S69) and the processing by the sequence data reproduction program 87 (step 70). To be executed. Then, the scenario of the sequence data creation / update program 86 is developed as shown in FIG. In this scenario, first, a program that prompts the user to select an arbitrary multimedia data part is reproduced (step S71), and then process A (step S72; see FIG. 28) and process B (step S7).
3; see FIG. 29) and process C (step S74; FIG. 3).
(See 0) is continuously executed, and these processes A, B, and C are repeatedly performed until the input of a series of data parts is completed. After that, the process D (step S75; see FIG. 31)
To execute the sequence data creation / update program 86
Ends the process.

In process A, as shown in FIG. 28, the user is allowed to select and input an arbitrary multimedia data part through the input unit 84, and the input is accepted (step S7).
6) The key data of the selected multimedia data part is temporarily stored in the register 90 through the reproduction processing unit 88 (step S77). As shown in FIG. 29, the process B displays the name of the selected multimedia data part on the image display device 8 in order to let the user know that some multimedia data part was selected in the process A.
It is for displaying on the screen of No. 1. That is, first, each piece of information (display character string, display coordinates, font / point, character color) of a character to be displayed is received from the sequence data creation / update program 86 (steps S78 to S8).
1). Thereafter, the reproduction processing unit 88 displays characters indicating the name of the multimedia data part on the screen of the image display device 81 (step S82).

In the process C, as shown in FIG. 30, the key data temporarily stored in the register 90 in the process A is
It is for transferring to the RAM 89 as sequence data (input result transfer; step S83). RAM8
The data transferred to 9 becomes sequence information when the sequence data reproducing program 87 reproduces a multimedia title arbitrarily selected by the user. This is sequence data, and that file is a sequence data file.

In process D, as shown in FIG. 31, when the user is prompted to input the name of the sequence data file created this time, and the sequence data file name is input from the input unit 84 (step S84), RAM8
The sequence data file on 9 is transferred to the sequence data storage device 91 and stored together with the file name through the reproduction processing unit 88 (step S85).

When the execution of the sequence data creation / update program 86 is completed as described above, the user can arbitrarily execute the sequence data reproduction program 87. The sequence data reproducing program 87 is developed as shown in FIG. That is, first, a plurality of sequence data files stored in the sequence data storage device 91 are searched, and the user is prompted to select an arbitrary sequence data file.

When the sequence data file is selected (step S86), the selected sequence data file is read from the sequence data storage device 91 into the RAM 89 (step S87), and based on the key data in the sequence data file, The corresponding multimedia data parts are searched from the database 83 (step S88).

Then, the retrieved data is read into the RAM 89 through the reproduction processing section 88 (step S8).
9), the image data and audio data are reproduced by the image display device 81 and the audio reproduction device 82 (step S).
90). The processing in steps S88 to S90 is executed for all the key data of one sequence data file, and when the processing for all the key data is completed (YES determination in step S91), the processing by the sequence data reproducing program 87 is completed.

Now, an operation example of the apparatus of the third embodiment described above will be described more specifically with reference to FIG. This Figure 3
The multimedia titles shown in 3 are created for the purpose of installing them at the customer service counters of travel agencies. They allow the customer to arbitrarily select the city to visit, the company of the aircraft to board, and the tourist destination to visit, and explain the information. The reproduced multimedia information can be reproduced and displayed. Note that FIG.
The progress of the multimedia title shown in FIG.
It is based on the flowchart shown in FIG.

First, when the multimedia title of this embodiment is started, a screen as shown in FIG. 33A is displayed on the image display device 81. In that title,
Two types of menus, "CREAT (execute creation / update program)" and "PLAY (execute reproduction program)" are displayed. Here, first, “CREATE” is selected and the sequence data creation / update program 86 is executed.

In response to the selection of "CREATE", the image and sound are output, the program is reproduced, and a screen for selecting a visited city is displayed as shown in FIG. 33 (b). At this time,
By designating a certain location on the screen, the user can view a list of features (main sightseeing spots, highlights, etc.) with multimedia information that can be used as a reference when deciding which city to visit. . Fig. 28
Process A is executed and the input result is temporarily stored in the register 90. Note that, in FIG. 33B, Paris is selected as the visiting city.

When the visiting city is selected, the process B of FIG. 29 and the process C of FIG. 30 are executed, and the input result is displayed on the screen as shown in FIG. Is transferred as sequence data. Next, as shown in FIG. 33D, a screen for selecting the company of the aircraft to be used is displayed. Also at this time, the user can view the feature list (fee, meal menu, special service, etc.) based on the multimedia information, which can be used as a reference when deciding the airline, by designating a location on the screen. It is like this. When the airline is selected, the process A is executed and the input result is temporarily stored in the register 90 as described above. Note that in FIG. 33 (d), Japan Airlines is selected.

When the airline company is selected, processing B and processing C are executed again, and the input result is displayed on the screen as shown in FIG.
Transferred as a sequence to the AM 89. Next, FIG.
As shown in (f), a screen for selecting a tourist spot to visit is displayed. Also at this time, the user can specify the location on the screen so that he / she can view the tourist spot information (highlights, costs, time, etc.) by multimedia information, which is helpful when determining the tourist spot. Has become. When the tourist spot is selected, the process A is executed and the input result is temporarily stored in the register 90, as described above. Note that FIG.
In 3 (f), the Eiffel Tower is selected.

When a tourist spot is selected, processing B and processing C are also executed, and as shown in FIG. 33 (g), the input result is displayed on the screen and the input result is RA.
Transferred to M89 as a sequence. When all items have been selected as described above, the process D of FIG. 31 is executed, and a screen for inputting the file name of the created sequence data is displayed as shown in FIG. 33 (h). It When an arbitrary file name is input and "Save" is selected, the sequence data file held in the RAM 89 is transferred to and stored in the sequence data storage device 91 as a sequence data file having the corresponding file name.

In this way, the creation / update program 86
When the execution of is finished, the display state on the image display device 81 returns to the initial selection menu screen as shown in FIG. The user selects "PLAY" on the screen and executes the sequence data reproducing program 87.
At this time, the process shown in FIG. 32 is executed, and the process shown in FIG.
As shown in FIG. 3, all sequence data file names in the sequence data storage device 91 (here, as an example, the extension .SQC
(Indicated by) is searched and displayed on the screen. The user selects any sequence data from the display. The selected sequence data file is read from the sequence data storage device 91 to the RAM 89.

Then, the multimedia title is reproduced based on the sequence data read in the RAM 89. In this example, the multimedia data parts describing the highlights of Paris, the multimedia data parts describing the services of Japan Airlines, and the multimedia data parts describing the Eiffel Tower are displayed on the image display device 81.
And the audio reproduction device 82 sequentially reproduces and outputs.

In this way, the user can efficiently view only the arbitrarily selected multimedia information. Thus, according to the third embodiment of the present invention,
A user who does not know how to create a multimedia title can create a secondary multimedia title by connecting arbitrary multimedia data parts without being aware of the program. There is an advantage that only information can be viewed efficiently.

Since the portable small capacity storage medium can store the sequence data consisting of the key code and can easily deliver the data, the multimedia title can be made more familiar and convenient to the user. , Greatly contributes to the spread of the multimedia information reproducing apparatus.
In the third embodiment described above, the case of a multimedia title created for the purpose of setting it on a customer service counter of a travel agency has been described, but the present invention is not limited to this, and various multimedia titles. When the media information is reproduced, it is applied in the same manner as described above, and it is possible to obtain the same effect as the above embodiment.

[0161]

As described above in detail, according to the multimedia information reproducing method and apparatus of the present invention, when the user arbitrarily selects the multimedia data parts created in advance, according to the reproducing order of each part, Since each selected part is automatically played back, you can easily create and play a multimedia title consisting of only the information you want to play in a playback form that meets the user's request, and efficiently view only the necessary information. There is an effect that can be done.

By creating the sequence data interactively with the user, even a user who does not know how to create the sequence data can easily create the multimedia title and efficiently use only the necessary information. Also, 1 for each scene
By selecting one part, multimedia titles for multiple scenes can be created very easily, and by using control data, special effects can be easily applied when playing each part.

[Brief description of drawings]

FIG. 1 is a principle block diagram of a related technique of the present invention.

FIG. 2 is a principle block diagram of a related technique of the present invention.

FIG. 3 is a principle block diagram of a related technique of the present invention.

FIG. 4 is a principle block diagram of a related technique of the present invention.

FIG. 5 is a principle block diagram of the present invention.

FIG. 6 is a block diagram showing a configuration of an operation guidance information reproducing device as a first embodiment of the present invention.

FIG. 7 is a target device (banknote depositing / dispensing machine) in the first embodiment.
FIG. 3 is a schematic vertical cross-sectional view showing a configuration example and a sensor arrangement example.

FIG. 8 is a diagram showing an error code setting screen according to the first embodiment.

FIG. 9 is a diagram showing a parts setting screen of the first embodiment.

FIG. 10 is a diagram showing a parts operation order setting screen according to the first embodiment.

FIG. 11 is a diagram showing a relationship between parts codes according to the first embodiment.

FIG. 12 is a diagram showing a help data parts table of the first embodiment.

FIG. 13 is a diagram showing an address conversion table of the first embodiment.

FIG. 14 is a flowchart for explaining the overall flow of help information reproduction processing according to the first embodiment.

FIG. 15 is a flowchart specifically showing a hierarchical screen display example according to an operator's level in the first embodiment along the flow of actual processing.

FIG. 16 is a flowchart for explaining a reproduction processing procedure of multimedia help information in the first embodiment.

FIG. 17 is a flowchart for explaining a reproduction processing procedure of multimedia help information in the first embodiment.

FIG. 18 is a flow chart for explaining a reproduction processing procedure of multimedia help information in the first embodiment.

FIG. 19 is a flowchart for explaining a reproduction processing procedure of multimedia help information in the first embodiment.

FIG. 20 is a block diagram showing a configuration of a system having an operation guidance information reproducing device as a second embodiment of the present invention.

FIG. 21 is a flow chart for explaining the operation of the second embodiment.

FIG. 22 is a block diagram showing the structure of a multimedia information reproducing apparatus as a third embodiment of the present invention.

FIG. 23 is a diagram showing the structure of multimedia data parts according to the third embodiment.

FIG. 24 is a diagram showing the structure of a multimedia database according to the third embodiment.

FIG. 25 is a diagram showing a structure of a sequence data file of a third embodiment.

FIG. 26 is a flow chart for explaining the operation of the third embodiment.

FIG. 27 is a flow chart for explaining the operation of the third embodiment.

FIG. 28 is a flow chart for explaining the operation of the third embodiment.

FIG. 29 is a flow chart for explaining the operation of the third embodiment.

FIG. 30 is a flow chart for explaining the operation of the third embodiment.

FIG. 31 is a flow chart for explaining the operation of the third embodiment.

FIG. 32 is a flow chart for explaining the operation of the third embodiment.

33 (a) to (k) are diagrams showing specific display examples for explaining the operation of the third embodiment.

[Explanation of symbols]

1A to 1C Reproduction control unit 2 Reproduction unit 3 Target device 4 Database 5 Sensor 6 Input unit 7 Search unit 8 Order determination unit 11 Display unit 12 Voice output unit 13 Database 14 Input unit 15 Sequence data creation unit 16 Sequence data reproduction unit 20 Cash Deposit / withdrawal machine (target device) 20A Mechanism 20B, 20C Sensor 20D Mechanical operation control section 20E Sensor control section 20F Banknote deposit / withdrawal machine control section 20G Error information storage section 21 Deposit port 22 Deposit verification section 23 Front / back reversing section 24A-24C Temporary hold Part 25 Reject Separation and Conveyance Path 26 Reject Port 27 Banknote Cassette 28 First Stacker 29 Second Stacker 30 Lower Conveying Part 31 Outgoing Discharge Identification Unit 32 Outgoing Discharge Port 33 Reject Box 34 Power Supply Unit 35 Drive Motor 40 Input Section 40A Keyboard 40B Mouse 40C Input control unit 41 Interface control unit 42 Playback unit 42A CRT (display unit) 42B Speaker (audio output unit) 42C Multimedia information display / output control unit 43 Multimedia database 44 Error information registration control unit 45 Error information storage unit 46 Multimedia information search control unit (Search unit) 47 Multimedia help control unit (playback control unit, order determination unit) 48 Memory for flag 50 Terminal device (operation guidance information playback device) 51 Processing unit (playback control unit) 52 Network connection control mechanism 53 Communication mechanism 54 Input unit control mechanism 55 Display unit control mechanism 56 Audio output unit control mechanism 57 Input unit 58 Display unit (playback unit) 59 Audio output unit (playback unit) 60 Peripheral device (target device) 61 Communication mechanism 62 I / O mechanism 63 I / O control mechanism 65 Transmission line (LAN) 70 Server device (upper device) 71 Operation guidance registration file (database) 72 Network connection control mechanism 73 Communication mechanism 74 Guidance data support processing unit (search unit) 81 Image display device (display unit) 82 Voice reproduction device (voice output unit) 83 Database 84 Input unit 85 ROM 86 Sequence data creation / update program (sequence data creation means) 87 Sequence data playback program (sequence data playback means) 88 Playback processing unit 89 RAM 90 Register 91 Sequence data storage device

Continued front page    (72) Inventor Shuichi Matsuda             Gunma Prefecture Maebashi City 1-8-3 Toyacho Stock             Company Fujitsu Terminal Systems (72) Inventor Noriaki Negishi             Gunma Prefecture Maebashi City 1-8-3 Toyacho Stock             Company Fujitsu Terminal Systems (72) Inventor Tadashi Yoshida             Gunma Prefecture Maebashi City 1-8-3 Toyacho Stock             Company Fujitsu Terminal Systems F term (reference) 5B076 AB14 AB17                 5B082 AA13 GC05                 5C053 FA23 FA29 GB12 HA29 JA12                       JA16 LA11 LA14

Claims (6)

[Claims] 1. A multimedia information reproducing method for reproducing multimedia information including image information and audio information, wherein the multimedia information is divided into parts for each unit according to information content. In order to determine the playback order of a plurality of multimedia data parts in the database, the sequence data is stored in the database in advance in order to determine the reproduction order of the multimedia parts in the database. And reproducing the plurality of multimedia data parts from the database and sequentially reproducing the plurality of multimedia data parts according to the generated sequence data. 2. The multimedia information reproducing method according to claim 1, wherein the sequence data is created in an interactive form with the user. 3. The multimedia data parts are key data unique to each multimedia data part, video data for one scene and audio data for one scene, and control data for these video data and audio data. The multimedia information reproducing method according to claim 1 or 2, further comprising: 4. A multimedia information reproducing apparatus having a display unit for reproducing image information and an audio output unit for reproducing audio information, in order to reproduce multimedia information including image information and audio information. A database that stores information in advance in the form of multimedia data parts divided into units according to the information content; an input unit that inputs instructions necessary to reproduce the multimedia data parts in the database; Sequence data creating means for creating sequence data consisting of key data designating each multimedia part in order to determine the reproduction order of any plurality of multimedia data parts in the database in accordance with an instruction from the input unit; , When the reproduction start instruction is received from the input section, the sequence data creating means According to the generated sequence data, the plurality of multimedia data parts are read from the database, and the plurality of multimedia data parts are sequentially reproduced on the display unit and the audio output unit. Characteristic multimedia information reproducing apparatus. 5. The sequence data creating means reproduces information necessary for creating sequence data by the display section and the audio output section, and receives an instruction input from the input section by a user who refers to the information. The multimedia information reproducing apparatus according to claim 4, wherein the sequence data is created. 6. The multimedia data parts are key data unique to each multimedia data part, video data for one scene and audio data for one scene, and control data for these video data and audio data. The multimedia information reproducing apparatus according to claim 4 or 5, further comprising: