JP4751593B2 - Image display device, image display method, and image display program - Google Patents

Description

  The present invention relates to an image display device that sequentially displays a plurality of images, an image display method, and an image display program.

  In recent years, in the field of endoscopes, swallowable capsule endoscopes have been proposed. This capsule endoscope is provided with an imaging function and a wireless communication function. Capsule endoscopes are peristaltic in the body cavity, for example, inside the organs such as stomach and small intestine, after being swallowed from the subject's mouth for observation (examination) and before being spontaneously discharged. And has a function of taking images of the subject at intervals of 0.5 seconds, for example.

  While moving in the body cavity, image data captured by the capsule endoscope is sequentially transmitted to the outside by wireless communication and stored in a memory provided outside. By carrying a receiver having a wireless communication function and a memory function, the subject can freely move between swallowing the capsule endoscope and discharging it. After the capsule endoscope is ejected, the doctor or nurse can make a diagnosis by displaying an organ image on a display based on the image data stored in the memory (see Patent Document 1).

Japanese Patent Laid-Open No. 2003-19111

  By the way, in recent years, a technique for extracting a feature image that is highly likely to include, for example, a bleeding part from an image captured by a capsule endoscope has been proposed. In this extraction technique, a red level value obtained by quantifying the ratio of the red area included in the image is obtained. In a conventional extraction technique, an image having a red level value based on a predetermined threshold is extracted as a feature image that is highly likely to include a bleeding site. In a conventional image display device, when images captured by a capsule endoscope are sequentially displayed, the extracted feature images are displayed with a predetermined marking or the like. A doctor or nurse who is a user determines whether or not the displayed image is a characteristic image that has a high possibility of including a bleeding site based on the presence or absence of the marking or the like. Here, unlike a normal endoscope, the capsule endoscope images each organ during a period until the subject swallows and is naturally discharged, and thus the observation (examination) takes a long time. Take a huge number of images. The user has to check the images displayed on the display one by one in order to grasp the feature image from such an enormous amount of images. Therefore, the user spends a lot of time for confirming the captured image, and the image confirmation is a heavy burden for the user. However, if the display rate of the image displayed on the display is increased in order to shorten the image confirmation time, the display time for one image is reduced. As a result, the user may miss the feature image and may not be able to make an accurate diagnosis.

  The present invention has been made in view of the above-described drawbacks of the prior art, and an object thereof is to provide an image display device, an image display method, and an image display program that can prevent a user from overlooking a characteristic image. And

  In order to solve the above-described problems and achieve the object, an image display device according to the present invention is an image display device including display means for sequentially displaying a plurality of images, and sequentially displays the plurality of images on the display means. Display control means for displaying, audio output means for outputting sound, and notification sound for notifying that the predetermined image is displayed when the display control means causes the display means to display the predetermined images in the plurality of images. And voice control means for outputting the voice to the voice output means.

  Further, in the image display device according to the present invention, the sound control means includes a warning sound for notifying the display of the predetermined image before the display control means displays the predetermined image on the display means, and the display control means Notification sound for notifying that the predetermined image is displayed when the predetermined image is displayed on the display means, or displaying the predetermined image after the display control means displays the predetermined image on the display means The sound output means outputs at least one of an end sound for notifying the end of the sound as the notification sound.

  In the image display device according to the present invention, the sound control unit causes the sound output unit to output at least two of the notification sound, the notification sound, and the end sound as the notification sound. And

  Further, in the image display device according to the present invention, the sound control means outputs the warning sound, the notification sound and / or the end sound with different sound volume, pitch, tone, sound output pattern, or a combination thereof. It is made to output to a means.

  Further, in the image display device according to the present invention, the sound control means outputs the sound volume, pitch, tone, sound output pattern, or combination thereof of the warning sound and / or the end sound to be output to the sound output means, It is characterized by changing according to the display interval between the predetermined image and the image displayed on the display means.

  The image display device according to the present invention acquires a feature amount representing a predetermined feature for each image of the plurality of images, and selects an image having the feature amount based on a predetermined threshold from the plurality of images. The image processing apparatus further includes extraction means for extracting as a predetermined image.

  Also, in the image display device according to the present invention, the sound control means is configured to notify the notification by using a volume, a pitch, a tone, a sound output pattern, or a combination thereof corresponding to the feature amount acquired by the extracting means in the predetermined image. Sound is output to the sound output means.

  Further, in the image display device according to the present invention, the extraction means provides a plurality of the predetermined threshold values, extracts an image having the feature amount based on each threshold value from the plurality of images as the predetermined image, and the audio control The means is characterized in that the sound output means outputs the notification sound with a sound volume, a pitch, a tone color, a sound output pattern, or a combination thereof corresponding to the predetermined threshold values provided by the extracting means.

  According to another aspect of the present invention, there is provided an image display device including a display unit that sequentially displays a plurality of images, a display control unit that sequentially displays the plurality of images on the display unit, and a vibration that generates vibrations. And vibration control means for causing the vibration means to generate a notification vibration informing that the predetermined image is displayed when the display control means causes the display means to display the predetermined image in the plurality of images. It is characterized by having.

  Further, in the image display device according to the present invention, the vibration control means includes a notice vibration for notifying the display of the predetermined image before the display control means displays the predetermined image on the display means, and the display control means Notification vibration for notifying that the predetermined image is displayed when the predetermined image is displayed on the display means, or display of the predetermined image after the display control means displays the predetermined image on the display means The vibration means generates at least one of end vibrations for notifying that the operation has ended as the notification vibration.

  In the image display device according to the present invention, the plurality of images are images obtained by imaging the inside of the subject.

  The image display method according to the present invention is an image display method for sequentially displaying a plurality of images, a display step for sequentially displaying the plurality of images, and a predetermined image in the plurality of images being displayed in the display step. A sound output step of outputting a notification sound notifying the display of the predetermined image.

  The image display method according to the present invention is an image display method for sequentially displaying a plurality of images, a display step for sequentially displaying the plurality of images, and a predetermined image in the plurality of images being displayed in the display step. A vibration step for generating a notification vibration informing the display of the predetermined image.

  The image display program according to the present invention is an image display program for sequentially displaying a plurality of images, wherein a display procedure for sequentially displaying the plurality of images and a predetermined image in the plurality of images in the display procedure are displayed. A sound output procedure for outputting a notification sound for notifying the display of the predetermined image.

  The image display program according to the present invention is an image display program for sequentially displaying a plurality of images, wherein a display procedure for sequentially displaying the plurality of images and a predetermined image in the plurality of images in the display procedure are displayed. A vibration procedure for generating a notification vibration informing the display of the predetermined image.

  According to the present invention, when a predetermined image in a plurality of images is displayed on the display means, a notification sound is output to notify that the predetermined image is displayed. Since the user can recognize that the predetermined image is displayed on the display means by confirming the notification sound, according to the present invention, it is possible to prevent the predetermined image from being overlooked when the user confirms the image. Can do.

  Hereinafter, an image display apparatus according to an embodiment of the present invention will be described with reference to the drawings. Note that the present invention is not limited to the embodiments. In the description of the drawings, the same parts are denoted by the same reference numerals. Further, as an image display apparatus according to the present embodiment, an image display apparatus in an in-vivo information acquiring system using a capsule endoscope will be described as an example.

(Embodiment 1)
First, the image display apparatus according to the first embodiment will be described. The image display apparatus according to the first embodiment outputs a warning sound for notifying that an extracted image extracted in advance from a plurality of stored images under a predetermined extraction condition is displayed, so that the user's attention to the feature image Prompts.

  FIG. 1 is a schematic diagram showing an overall configuration of an in-vivo information acquiring system according to the present embodiment. As shown in FIG. 1, the in-vivo information acquiring system according to the first embodiment is introduced into the body of a receiving device 2 having a receiving function and the subject 1, and captures an in-vivo image to the receiving device 2. A capsule endoscope 3 that performs data transmission is provided. The in-subject information acquisition system also performs image transfer between the image display device 4 that displays an image in the body cavity based on data received by the reception device 2 and the reception device 2 and the image display device 4. A portable recording medium 5. The receiving device 2 includes a receiving jacket 2a worn by the subject 1 and an external device 2b that performs processing of radio signals transmitted and received through the receiving jacket 2a.

  The image display device 4 is for displaying an in-vivo image captured by the capsule endoscope 3 and includes a workstation that displays an image based on data obtained by the portable recording medium 5. The image display device 4 sequentially displays a plurality of still images captured by the capsule endoscope 3 according to frame numbers. Hereinafter, the sequentially displayed images are referred to as pseudo moving images. Note that the image display device 4 may sequentially display still images one by one, or may sequentially display a plurality of still images.

  The portable recording medium 5 is detachable with respect to the external device 2b and the image display device 4, and has a structure capable of outputting or recording information when attached to both. Specifically, the portable recording medium 5 is inserted into the external device 2 b and transmitted from the capsule endoscope 3 while the capsule endoscope 3 is moving in the body cavity of the subject 1. Record the data. Then, after the capsule endoscope 3 is ejected from the subject 1, that is, after the imaging of the inside of the subject 1 is finished, the capsule endoscope 3 is taken out from the external device 2b and inserted into the image display device 4, and the image is displayed. Data recorded by the display device 4 is read out. The data transfer between the external device 2b and the image display device 4 is not limited to a configuration in which the portable recording medium 5 such as a compact flash (registered trademark) memory is used. It is also possible to take a configuration in which the connection is wired.

  Here, the image display device 4 will be described with reference to FIG. FIG. 2 is a block diagram showing a schematic configuration of the image display device 4 shown in FIG. As shown in FIG. 2, the image display device 4 includes an input unit 20, a display unit 30, a storage unit 40, a control unit 50, and an audio output unit 60.

  The input unit 20 is realized by a pointing device such as a keyboard or a mouse, and outputs an operation instruction for the image display device 4 and instruction information for processing performed by the image display device 4 to the control unit 50.

  The display unit 30 is realized by a CRT display, a liquid crystal display, or the like, and displays instruction information or an instruction result of the input unit 20. Further, the display unit 30 sequentially displays a plurality of still images captured by the capsule endoscope 3 as pseudo moving images according to the frame number under the control of the display control unit 52 in the control unit 50.

  The storage unit 40 is realized by, for example, a hard disk device. The storage unit 40 stores various types of information including image information. For example, in the folder F1, an image group Pa captured by the capsule endoscope 3 is stored. Further, information generated by the image processing of the image processing unit 51 is stored in the folder F2. For example, the folder Ta stores a table Ta that associates the frame number of each image in the image group Pa with a feature amount such as a red level value.

  The control unit 50 controls each process or operation of the input unit 20, the display unit 30, the storage unit 40, and the audio output unit 60. The control unit 50 includes an image processing unit 51, a display control unit 52, a sound control unit 53, and a sound generation unit 54.

  The image processing unit 51 processes an image included in the image group Pa and acquires a feature amount representing a predetermined feature for each image in the image group Pa. As shown in Japanese Patent Application No. 2004-120367, the image processing unit 51, when an area corresponding to predetermined color information is included in the image information, digitizes the ratio of the area including the predetermined color information. The obtained feature amount is acquired. Then, the image processing unit 51 extracts an image having a feature amount based on a predetermined threshold as a feature image based on the acquired feature amount of each image. For example, the image processing unit 51 obtains the ratio of red information in the entire image based on the presence and distribution of red information in the color information of the image information, and uses the red level value obtained by quantifying this ratio as a feature amount. get. Then, when the red level value of each acquired image exceeds a predetermined threshold, the image processing unit 51 determines that there is a high possibility that the image has a bleeding portion, and extracts it as a feature image. In this case, as illustrated in FIG. 2, the image processing unit 51 generates a table Ta in which the frame number of each image in the image group Pa is associated with a feature amount such as a red level value. Further, the image processing unit 51 assigns a flag indicating that the image is a feature image to the frame number of the image extracted as the feature image and outputs the table Ta. For example, in the table Ta, the flag “1” indicates that the image is a feature image, and the flag “0” indicates that the image is not a feature image.

  The display control unit 52 controls display processing in the display unit 30. The display control unit 52 causes the display unit 30 to sequentially display the image groups Pa stored in the folder F1 in the order of frame numbers with reference to the feature image information such as the table Ta.

  The sound control unit 53 controls the sound output processing in the sound output unit 60 with reference to the feature image information such as the table Ta. When the display control unit 52 causes the display unit 30 to display the feature image in the image group Pa, the sound control unit 53 causes the sound output unit 60 to output a notification sound informing that the feature image is displayed. The sound control unit 53 is a predetermined warning sound for notifying the display of the feature image before the display control unit 52 displays the feature image on the display unit 30, and the sound control unit 53 is configured to display the feature image by the display control unit 52. A predetermined notification sound for notifying that the feature image is displayed when the feature image is displayed, or notifying that the display of the feature image is finished after the display control unit 52 displays the feature image on the display unit 30. A predetermined end sound is output to the audio output unit 60 as a notification sound. These warning sound, notification sound, and end sound are different volumes, pitches, timbres, sound output patterns, or combinations thereof. The voice control unit 53 controls voice generation processing in the voice generation unit 54.

  The sound generation unit 54 generates various sounds output from the sound output unit 60 under the control of the sound control unit 53. The warning sound, the end sound, and the notification sound, which are passing sounds, are generated by the sound generation unit 54, respectively.

  The sound output unit 60 is realized using a speaker or the like, and outputs a warning sound, an end sound, and a notification sound as notification sounds under the sound control unit 53. The sound output unit 60 outputs a warning sound before the feature image is displayed on the display unit 30, and notifies that the feature image will be displayed. When the feature image is displayed on the display unit 30, the sound output unit 60 outputs a notification sound to notify that the feature image is displayed. The audio output unit 60 outputs an end sound after the feature image is displayed on the display unit 30, and notifies that the display of the feature image has already been completed and the display of the feature image has passed.

  Next, with reference to FIG. 3, the control procedure of each component by the controller 50 will be described by taking an example in which the image group Pa stored in the storage unit 40 is displayed. In FIG. 3, first, the image processing unit 51 acquires image information of the image group Pa stored in the folder F1 (step S102). The image processing unit 51 acquires feature amounts of each image based on the acquired image information of the image group Pa, and performs feature image extraction processing for extracting an image having a feature amount based on a predetermined threshold as a feature image. It performs (step S104). The image processing unit 51 generates and outputs a table Ta in which a flag indicating whether each image is a feature amount and a feature image is added to the frame number of each image.

  Thereafter, the display control unit 52 determines whether or not instruction information for instructing display of the pseudo moving image has been received (step S106). When the display control unit 52 determines that the instruction information for instructing the display of the pseudo moving image is not received (step S106: No), the control unit 50 ends the image processing for the image group Pa. On the other hand, when the display control unit 52 determines that the instruction information for instructing the display of the pseudo moving image has been received (step S106: Yes), the display control unit 52 extracts the image information of the image group Pa that is the display target from the storage unit 40. (Step S108). Then, the control unit 50 extracts the table Ta from the storage unit 40 as feature image information (step S110). Thereafter, the display control unit 52 initializes the frame number of the image to be displayed (step S112). Then, the display control unit 52 causes the display unit 30 to display the next image to be displayed (step S114) and performs pseudo moving image display.

  Next, the sound control unit 53 refers to the table Ta extracted by the control unit 50 and determines whether the image displayed on the display unit 30 is a feature image or a predetermined number of frames before and after the feature image. Judgment is made (step S116). When the sound control unit 53 determines that the image displayed on the display unit 30 is a feature image or a predetermined number of frames before and after the feature image (step S116: Yes), the sound control unit 53 A sound output process for outputting a notification sound informing that the feature image is displayed on the display unit 30 is performed (step S118). When the audio control unit 53 determines that the image displayed on the display unit 30 is not a feature image or a predetermined number of frames before and after the feature image (Step S116: No), or the audio output When the audio output process (step S118) in the unit 60 is completed, a numerical value corresponding to the number of images displayed on the display unit 30 is added to the frame number (step S120).

  Thereafter, the display control unit 52 determines whether or not the instruction information for instructing the end of the display of the pseudo moving image is received from the input unit 20 (step S122), and when the instruction information is received (step S122: Yes), the pseudo moving image display on the display unit 30 is terminated. On the other hand, when the display control unit 52 determines that the instruction information for instructing the display end of the pseudo moving image from the input unit 20 is not received (step S122: No), the display unit 30 displays the final image of the image group Pa. It is determined whether it has been displayed (step S124). When the display control unit 52 determines that the display unit 30 has displayed up to the final image of the image group Pa (step S124: Yes), the display unit 30 ends the pseudo moving image display on the display unit 30. On the other hand, when the display control unit 52 determines that the display unit 30 does not display the final image of the image group Pa (step S124: No), the display control unit 52 proceeds to step S114 and becomes the next display target in the image group Pa. The image is displayed on the display unit 30, and the display of the pseudo moving image is continued on the display unit 30.

  Next, the audio output processing shown in FIG. 3 will be described with reference to FIG. FIG. 4 is a flowchart showing a processing procedure of the audio output process shown in FIG. As illustrated in FIG. 4, the sound control unit 53 refers to the table Ta and the frame number of the image displayed on the display unit 30, and the image displayed on the display unit 30 is a feature image and a previous frame of the feature image. It is determined whether the current image or the feature image is a subsequent frame image (step S142).

  When the sound control unit 53 determines that the image displayed on the display unit 30 is the image of the previous frame of the feature image (step S142: the image of the previous frame), the sound control unit 53 notifies the sound output unit 60 as a notification sound. A predetermined warning sound is output, and the voice output unit 60 outputs the warning sound (step S144) and ends the voice output process. Note that this warning sound is generated by the sound generation unit 54.

  When the sound control unit 53 determines that the image displayed on the display unit 30 is a feature image (step S142: feature image), the sound control unit 53 causes the sound output unit 60 to output a notification sound as a notification sound. The sound output unit 60 outputs a notification sound (step S146), and ends the sound output process. The notification sound is generated by the sound generation unit 54.

  Also, when the sound control unit 53 determines that the image displayed on the display unit 30 is an image of the rear frame of the feature image (step S142: an image of the rear frame), the sound control unit 53 notifies the sound output unit 60 of the notification sound. The predetermined output sound is output, and the audio output unit 60 outputs the end sound (step S148), and the audio output process ends. The end sound is generated by the sound generation unit 54.

  Next, an example of a warning sound, a notification sound, and an end sound output from the sound output unit 60 in the sound output process will be described. The sound control unit 52 changes the volume of the warning sound and the end sound to be output from the sound output unit 60 according to the display interval between the feature image and the image displayed on the display unit 30. FIG. 5 is a diagram showing the relationship between the frame number of the image displayed on the display unit 30 and the volume level of the audio output from the audio output unit 60. In FIG. 5, the horizontal axis indicates the frame number of the image displayed on the display unit 30, and the vertical axis indicates the volume level of the sound output from the sound output unit 60. The volume output from the audio output unit 60 increases as the volume level increases. FIG. 5 shows a case where the image with the frame number “10” is a feature image extracted by the image processing unit 51. Further, FIG. 5 illustrates an example in which the image display device 4 outputs a warning sound and an end sound for images of five frames before and after the feature image.

  As shown in FIG. 5, in a period Ta in which images with frame numbers “1” to “4” that are not feature images within the preceding and following 5 frames are displayed on the display unit 30, the audio control unit 53 includes the audio output unit 60. The voice output unit 60 does not output voice.

  On the other hand, in the period Tb in which the image of the frame number “9” of the previous frame of the feature image is displayed on the display unit 30 from the image of the frame number “5” 5 frames of the previous feature image. The sound output unit 60 is caused to output a warning sound. The audio output unit 60 outputs a warning sound whose volume is increased stepwise as the frame number of the image displayed on the display unit 30 approaches the frame number of the feature image. Specifically, when the image of frame number “5” five frames before the feature image is displayed, the audio output unit 60 starts audio output at the volume of the stage “V1”. Thereafter, when the image of the frame number “6” is displayed, the sound control unit 53 increases the volume level from “V1” to “V2”. The sound control unit 53 gradually increases the volume as the frame number of the image displayed on the display unit 30 advances.

  As described above, the image display device 4 outputs the warning sound for notifying the display of the feature image before the feature image is displayed, and further notifies the image displayed on the display unit 30 as it approaches the feature image. By raising the sound volume step by step, the user is notified that the feature image is displayed. By confirming the warning sound, the user can predict that the feature image will be displayed, and pay attention to the image displayed on the display unit 30. Therefore, the image display device 4 can prevent the user from overlooking the characteristic image by outputting the warning sound.

  Then, the audio control unit 53 causes the audio output unit 60 to output a notification sound during the period Tc in which the image of the frame number “10” that is the feature image is displayed. For example, the voice control unit 53 causes the voice output unit 60 to output the voice at the maximum volume level “V6” as the notification sound. As described above, when the feature image is displayed, the image display device 4 notifies the user that the feature image is displayed by outputting the sound with the maximum volume. As a result, the user can recognize that the feature image is displayed. Therefore, the image display device 4 can prevent the user from overlooking the characteristic image by outputting the notification sound.

  Furthermore, the audio control unit 53 sends an end sound to the audio output unit 60 during a period Td in which an image with a frame number “15” that is five frames after the image with the frame number “11” that is the subsequent frame of the feature image is displayed. Output. The audio output unit 60 outputs an ending sound whose volume is decreased stepwise as the image frame number displayed on the display unit 30 moves away from the frame number of the feature image. Specifically, when the image of the frame number “11” after the frame number of the feature image is displayed, the audio output unit 60 outputs an end sound that is lowered from the volume level “V6” to “V5”. Thereafter, when the image of the frame number “12” is displayed next, the audio output unit 60 lowers the volume level from “V5” to “V4”.

  As described above, after the feature image is displayed, the image display device 4 outputs an end sound for notifying that the display of the feature image is finished, and the image displayed on the display unit 30 is separated from the feature image. Accordingly, the end sound is lowered stepwise to notify the user that the display of the feature image has ended. As a result, the user can recognize that the feature image is displayed by confirming the end sound, and even if the feature image is missed, the user can display the feature image again to confirm the missed feature image. The image displayed on the unit 30 can be adjusted.

  As described above, the image display device 4 according to the first embodiment has the notification sound for notifying that the feature image is displayed on the display unit 30, the notification sound for notifying that the feature image is displayed, and An end sound for notifying that the display of the feature image has ended is output as a notification sound. By recognizing the notification sound, the user can grasp the prediction of the display of the feature image and the end of the display of the feature image, and can accurately perform the diagnosis based on the feature image without missing the feature image. it can.

  The image display device 4 according to the first embodiment has been described with reference to FIG. 5 in which the warning sound and the end sound are output when displaying the five frames before and after the feature image. It is sufficient to output the warning sound and the end sound while a predetermined number of images having the above are displayed or during a predetermined time before and after the characteristic image is displayed. In addition, the sound control unit 52 may automatically set the output period of the warning sound and the end sound in accordance with the display rate of the image displayed on the display unit 30, and output the warning sound and the end sound. You may set based on the instruction information from the input part 20 which instruct | indicates a period.

  In addition, the image display device 4 according to the first embodiment increases the volume of the warning sound stepwise and decreases the volume of the end sound stepwise according to the frame number of the displayed image, and also displays a feature image. The volume of the notification sound may be gradually increased from before the predetermined time, and the volume of the end sound may be gradually decreased during the predetermined time after the feature image is displayed.

  Further, the image display device 4 may change the pitches of the warning sound, the notification sound, and the end sound and output them. For example, as shown in FIG. 6, the audio output unit 60 gradually increases the pitch of the warning sound as the image frame number displayed on the display unit 30 approaches the frame number of the feature image during the period Tb. Output. For example, when the image of the frame number “5” five frames before the feature image is displayed, the audio output unit 60 starts outputting the warning sound at the pitch of the stage “L1”. Next, when the image of the frame number “6” is displayed, the audio output unit 60 increases the pitch stage from “L1” to “L2”. Then, the audio output unit 60 outputs a predetermined notification sound at the maximum stage “L6” during the period Tc during which the image of the frame number “10” that is the characteristic image is displayed. Further, the audio output unit 60 lowers the pitch in steps as the frame number of the image displayed on the display unit 30 moves away from the frame number of the feature image, and outputs a predetermined end sound. Specifically, when the image of frame number “11” is displayed after the feature image is displayed, the audio output unit 60 outputs an end sound in which the pitch stage is lowered from “L6” to “L5”. Thereafter, when the image of the frame number “12” is displayed, the sound output unit 60 lowers the pitch stage from “L5” to “L4”. As described above, the image display device 4 outputs the warning sound with the pitch raised stepwise and the end sound with the pitch lowered stepwise to notify the notice of the feature image display and the end of the display of the feature image. May be.

  In addition, the sound control unit 53 may cause the sound output unit 60 to output a warning sound, a notification sound, and an end sound in which the timbre of the sound to be output is changed step by step without being limited to the volume and the pitch. Further, as shown in FIG. 7, the sound control unit 53 may cause the sound output unit 60 to output a warning sound, a notification sound, and an end sound in a sound output pattern. FIG. 7 is a diagram illustrating the relationship between the frame number of the image displayed on the display unit 30 and the on state or off state of the sound output from the sound output unit 60. In FIG. 7, the image with the frame number “10” is a feature image, a warning sound is output during image display Tf three frames before the feature image, and an end sound is output during image display Th three frames after the feature image. The case where it is output is shown.

  In the period Tf in FIG. 7, the audio output unit 60 shortens the output interval and outputs a warning sound as the image frame number displayed on the display unit 30 approaches the frame number of the feature image. For example, the sound output unit 60 outputs the warning sound once while the image of the frame number “7” three frames before the feature image is displayed. Next, the audio output unit 60 outputs the warning sound twice while the image of the frame number “8” is displayed, and outputs the warning sound three times while the image of the frame number “9” is displayed. . Then, the audio output unit 60 continuously outputs a predetermined notification sound during the period Tg in which the image of the frame number “10” that is the feature image is displayed. Furthermore, the audio output unit 60 extends the output interval and outputs an end sound as the frame number of the image displayed on the display unit 30 is separated from the frame number of the feature image. In the period Th after the feature image is displayed, the audio output unit 60 outputs the end sound three times while the image of the frame number “11” is displayed. Thereafter, the sound output unit 60 outputs the end sound twice while the image of the frame number “12” is displayed, and outputs the end sound once while the image of the frame number “13” is displayed. The image display device 4 changes the volume, pitch, timbre, or sound output pattern according to the display interval between the feature image and the image displayed on the display unit 30, and predicts the display of the feature image and displays the feature image. It is enough to notify the end of the.

  As described above, in the image display device 4, it is sufficient that at least one of the volume of the warning sound, the notification sound, and the end sound, the pitch, the tone color, and the sound output pattern is different. If at least one of the volume, pitch, tone, or sound output pattern of the warning sound, notification sound, and end sound is different, the user determines whether the output sound is the warning sound, notification sound, or end sound. This is because it is possible to recognize the prediction of the display of the feature image and the end of the display of the feature image.

  Further, the image display device 4 changes any one of the volume, pitch, tone, and sound output pattern of the warning sound, the notification sound, and the end sound, as well as the volume, pitch, tone, and voice of the warning sound, the notification sound, and the end sound. The output patterns may be changed in combination.

  Furthermore, in the image display device 4, the case where a single feature image is displayed in FIGS. 5 to 7 has been described. However, when a plurality of feature images are displayed at a narrow interval, each feature image and the display unit 30 are displayed. Depending on the display interval with the image displayed in the above, the volume, pitch, tone color, sound output pattern, or combination thereof of the warning sound, the notification sound and the end sound may be changed.

  For example, as shown in FIG. 8, the case where the volume level is changed and the warning sound and the end sound are output will be described, taking as an example the case where the images of frame number “10” and frame number “16” are feature images. .

  In the period Tb1 before the feature image with the frame number “10” is displayed, the audio output unit 60 advances the frame number of the image displayed on the display unit 30 as in the case of the period Tb in FIG. To increase the volume step by step and output a warning sound. Then, the audio output unit 60 outputs the notification sound at the maximum volume “V6” during the period Tc1 during which the feature image with the frame number “10” is displayed. After that, the audio output unit 60 displays on the display unit 30 during the period Td1 during which the images with the frame numbers “11” to “13” are displayed during the period until the feature image with the frame number “16” is displayed. As the image progresses, the volume is lowered stepwise and an end sound is output to notify that the display of the feature image with the frame number “10” has ended. Then, the sound output unit 60 increases the sound volume step by step as the image displayed on the display unit 30 progresses during the period Tb2 in which the images of the frame numbers “14” and “15” are displayed. And a warning sound for notifying that the feature image of the frame number “16” will be displayed from now on. After that, the audio output unit 60 outputs a notification sound at the maximum volume “V6” during the period Tc2 in which the feature image of the frame number “16” is displayed, notifying that the feature image is displayed. Then, the audio output unit 60 outputs an end sound in which the volume is decreased stepwise during the period Td2 in which the images of the frame numbers “17” to “22” are displayed, and displays the second feature image to the user. Notify that has ended. Further, the image display device 4 is not limited to the case where the sound volume is changed step by step, and as shown in FIG. May be notified that is displayed. As described above, even when a plurality of feature images are displayed at a narrow interval, the image display device 4 performs a warning sound and a notification sound according to the display interval between each feature image and the image displayed on the display unit 30. Further, by changing the volume, pitch, tone color, sound output pattern, or combination thereof of the end sound, the feature image display may be notified in advance and the end of the feature image display may be notified to the user.

  In addition, the sound control unit 53 outputs a warning sound, a notification sound, and an end sound with a volume, a pitch, a tone, a sound output pattern, or a combination thereof corresponding to the feature amount acquired by the image processing unit 51 in the feature image. May be. For example, as shown in FIG. 10, the audio control unit 53 sets the volume corresponding to the red level value “8” in the period Tc1 during which the feature image of the frame number “8” whose red level value is “8” is displayed. In step "V8", the sound output unit 60 is caused to output a notification sound. In addition, the sound control unit 53 performs the notification sound at the volume level “V10” corresponding to the red level value “10” in the period Tc2 in which the feature image of the frame number “18” having the red level value “10” is displayed. Is output to the audio output unit 60. In this case, the user can grasp the level of the red level value of the feature image displayed on the display unit 30 based on the volume of the notification sound. Note that the voice control unit 53 may increase or decrease the volume of the warning sound and the end sound in stages according to the volume level of the notification sound.

  In addition, when the image processing unit 51 provides a plurality of threshold values and extracts an image having a feature amount based on each threshold value from the image group Pa as a feature image, the sound control unit 53 includes each of the image processing units 51 provided. The sound output unit 60 may output the warning sound, the notification sound, and the end sound by using a volume, a pitch, a tone color, a sound output pattern, or a combination thereof corresponding to each threshold value. For example, as shown in FIG. 11, the voice control unit 53 corresponds to the first threshold T1 in the period Tc1 in which the feature image of the frame number “8” having the red level value based on the first threshold T1 is displayed. The sound output unit 60 may output the notification sound at the volume level “V10”. In addition, the voice control unit 53 performs the second control in the period Tc2 in which the feature image of the frame number “18” having a red level value based on the second threshold T2 that is lower than the first threshold T1 is displayed. The notification sound may be output to the audio output unit 60 at the volume level “V6” corresponding to the threshold T2. As a result, the user can grasp which threshold value the red level value of the feature image displayed on the display unit 30 is based on according to the volume of the notification sound. Note that the voice control unit 53 may increase or decrease the volume of the warning sound and the end sound in stages according to the volume level of the notification sound.

  When the image processing unit 51 acquires a plurality of types of feature amounts and extracts feature images according to the acquired types of feature amounts, the audio control unit 53 extracts the feature images extracted by the image processing unit 51. Depending on the type of sound, a warning sound, a notification sound, and an end sound may be output in which the volume, pitch, tone color, sound output pattern, or combination thereof is changed. In this case, the user can predict in advance the type of feature image displayed on the display unit 30 by recognizing the warning sound, the notification sound, and the end sound, and accurately check without missing the feature image. Can do. In addition to the red level value, the feature amount includes a concavo-convex level value obtained by quantifying the size of a region where the concavo-convex portion is distributed in the image.

  In the first embodiment, the case where the warning sound, the notification sound, and the end sound are output as the passing sound has been described. However, the image display device 4 passes at least one of the warning sound, the notification sound, or the end sound. You may output as a sound. This is because the user can recognize the display of the feature image by confirming at least one of the warning sound, the notification sound, and the end sound. Further, the image display device 4 may output a combination of at least two of the warning sound, the notification sound, and the end sound as the passing sound. Furthermore, the image display device 4 according to the first exemplary embodiment may store audio information corresponding to the warning sound, the notification sound, and the end sound in the storage unit 40. In this case, since the sound control unit 53 can extract each sound information stored in the storage unit 40 and cause the sound output unit 60 to output the sound information, the image display device 4 outputs the warning sound, the notification sound, and the end sound. It is possible to adopt a configuration in which the generated voice generation unit 54 is deleted.

(Embodiment 2)
Next, a second embodiment will be described. In the first embodiment, the case where the predetermined warning sound and the end sound are output has been described. In the second embodiment, the predetermined warning display and the characteristic image are displayed by outputting the predetermined warning vibration and the end vibration. Notify the end of the display.

  FIG. 12 is a block diagram of a schematic configuration of the image display apparatus according to the second embodiment. As illustrated in FIG. 12, the image display apparatus 204 according to the second embodiment includes a control unit 250 instead of the control unit 50 in the first embodiment, and includes a vibration unit 260 instead of the audio output unit 60. . The control unit 250 includes a vibration control unit 253 in addition to the image processing unit 51 and the display control unit 52. The vibration unit 260 is attached to, for example, a user's hand or finger, and generates a predetermined vibration under the control of the vibration control unit 253. The control unit 250 functions in the same manner as the control unit 50, and controls each process or operation of the input unit 20, the display unit 30, the storage unit 40, and the vibration unit 260. For example, the vibration control unit 253 refers to the table Ta and controls the vibration processing in the vibration unit 260. When the display control unit 52 causes the display unit 30 to display a feature image, the vibration control unit 253 causes the vibration unit 260 to generate a predetermined notification vibration informing that the feature image is displayed. The vibration control unit 253 is a notification vibration for notifying the display of the feature image before the display control unit 52 displays the feature image on the display unit 30 as the notification vibration, and the display control unit 52 displays the feature image on the display unit 30. An oscillating portion for notifying that the feature image is sometimes displayed and an ending vibration for notifying that the display of the feature image is ended after the display control unit 52 displays the feature image on the display unit 30 260.

  Next, with reference to FIG. 13, the control procedure of each component by the control unit 250 will be described. In FIG. 13, the image processing unit 51 performs an image information acquisition process (step S202) and a feature image extraction process (step S204), and the display control unit 52 Instruction information reception determination processing for instructing image display is performed (step S206). 3, the display control unit 52 performs image information extraction processing (step S208), feature image information extraction processing (step S210), frame number initialization processing (step S212), Image display processing (step S214) is performed. Thereafter, the vibration control unit 253 determines whether the image displayed on the display unit 30 is a feature image or a predetermined number of frames before and after the feature image (step S216), as in step S116 shown in FIG. I do.

  When the vibration control unit 253 determines that the image displayed on the display unit 30 is a feature image or a predetermined number of frames before and after the feature image (step S216: Yes), the vibration control unit 253 displays the display unit A vibration process for generating a passing vibration corresponding to the image displayed at 30 is performed (step S218). When the vibration control unit 253 determines that the image displayed on the display unit 30 is not a feature image or a predetermined number of frames before and after the feature image (step S216: No), or vibration processing in the vibration unit 260 (step S218) ) Is completed, the display control unit 52 performs a frame addition process in the same manner as in step S120 shown in FIG. 3 (step S220). Thereafter, similarly to step S122 and step S124 shown in FIG. 3, the display control unit 52 performs a determination process for receiving instruction information for instructing the end of image display (step S222) and a determination process for the final image display (step S224). . When the display control unit 52 determines that the final image of the image group Pa is not displayed (step S224: No), the display control unit 52 proceeds to step S214 and displays the next image to be displayed in the image group Pa on the display unit 30. Display.

  Next, the vibration processing shown in FIG. 13 will be described with reference to FIG. FIG. 14 is a flowchart showing a processing procedure of the vibration processing shown in FIG. As illustrated in FIG. 14, the vibration control unit 253 refers to the table Ta and the frame number of the image displayed on the display unit 30, and the image displayed on the display unit 30 is the feature image and the previous frame of the feature image. It is determined whether the current image or the feature image is a subsequent frame image (step S242). When the vibration control unit 253 determines that the image displayed on the display unit 30 is an image of the previous frame of the feature image (step S242: image of the previous frame), the vibration control unit 253 determines a predetermined vibration as a passing vibration. The notice vibration is generated, and the vibration unit 260 generates the notice vibration (step S244) and ends the vibration process. On the other hand, when the vibration control unit 253 determines that the image displayed on the display unit 30 is a feature image (step S242: feature image), the vibration control unit 253 generates a predetermined notification vibration as a passing vibration. Then, the vibration unit 260 generates a notification vibration (step S246), and ends the vibration process. In addition, when the vibration control unit 253 determines that the image displayed on the display unit 30 is an image of the rear frame of the feature image (step S242: an image of the rear frame), Then, a predetermined end vibration is generated, and the vibration unit 260 generates the end vibration (step S248) and ends the vibration processing.

  Next, the notice vibration, the notification vibration, and the end vibration generated by the vibration unit 260 in the vibration processing will be specifically described. FIG. 15 is a diagram illustrating the relationship between the frame number of the image displayed on the display unit 30 and the intensity of vibration generated by the vibration unit 260. In FIG. 15, the horizontal axis indicates the frame number of the image displayed on the display unit 30, and the vertical axis indicates the vibration intensity level of the vibration generated by the vibration unit 260. As the vibration intensity level increases, the intensity of vibration generated by the vibration unit 260 increases. Also, in FIG. 15, as in FIG. 5, the image with the frame number “10” is shown as a feature image, and the vibration control unit 253 displays the notice vibration and end vibration for the images of the five frames before and after the feature image. An example in which is generated in the vibration part 260 is shown.

  As illustrated in FIG. 15, in the period Ta, the vibration control unit 253 does not instruct the vibration unit 260 to generate vibration, and the vibration unit 260 does not generate vibration. On the other hand, the vibration control unit 253 causes the vibration unit 260 to generate a predetermined warning vibration in a period Tb before the feature image is displayed. The vibration unit 260 generates a notice vibration by increasing the vibration intensity stepwise as the frame number of the image displayed on the display unit 30 approaches the frame number of the feature image. For example, when the image of the frame number “6” five frames before the feature image is displayed, the vibration unit 260 generates vibration at the vibration intensity at the stage “S1”. Thereafter, when the image of the frame number “6” is displayed, the vibration unit 260 increases the vibration intensity level from “S1” to “S2” to generate vibration. As described above, the image display device 204 generates a warning vibration for notifying the display of the feature image before the feature image is displayed, and further notifies the image displayed on the display unit 30 as it approaches the feature image. By raising the intensity of vibration step by step, the user is notified that the feature image is displayed.

  In addition, the vibration control unit 253 causes the vibration unit 260 to generate a predetermined notification vibration during the period Tc in which the feature image having the frame number “10” is displayed. For example, the vibration unit 260 generates the notification vibration with the intensity of the maximum stage “S6”. As described above, when the feature image is displayed, the image display device 204 notifies the user that the feature image is displayed by generating a notification vibration at the maximum intensity.

  Further, the vibration control unit 253 causes the vibration unit 260 to perform a predetermined end vibration in a period Td in which an image with a frame number “15” that is five frames after the image with the frame number “11” that is the subsequent frame of the feature image is displayed. Is generated. The vibration unit 260 generates an end vibration in which the vibration intensity is lowered stepwise as the frame number of the image displayed on the display unit 30 moves away from the frame number of the feature image. For example, when the image of the frame number “11” after the feature image is displayed, the vibration unit 260 reduces the intensity from the step “S6” to “S5” to generate the end vibration. Thereafter, when the image of the frame number “12” is displayed, the vibration unit 260 further reduces the intensity level to “S4” and generates the end vibration. As described above, after the feature image is displayed, the image display device 204 generates an end vibration for informing that the display of the feature image has passed, and the image displayed on the display unit 30 is separated from the feature image. Accordingly, the user is notified that the feature image is displayed by lowering the intensity of the end vibration step by step. Thus, the vibration control unit 253 changes the vibration intensity of the notice vibration, the notification vibration, and the end vibration generated by the vibration unit 260 according to the display interval between the feature image and the image displayed on the display unit 30. Yes.

  As described above, the image display device 204 according to the second embodiment includes the notice vibration for notifying that the feature image is displayed on the display unit 30, the special image vibration for notifying that the feature image is displayed, and An end vibration for notifying that the display of the feature image has ended is generated. The user can predict the display of the feature image by receiving the notice vibration, the notification vibration, and the end vibration, and can grasp the end of the display of the feature image, and the diagnosis based on the feature image without missing the feature image. Can be done accurately.

  In the second embodiment, the vibration intensity of the notice vibration, the notification vibration, and the end vibration generated by the vibration unit 260 is changed according to the display interval between the feature image and the image displayed on the display unit 30. However, the strength pattern of the notice vibration, the notification vibration, and the end vibration may be changed. Further, the vibration control unit 253 may change the generation intervals of the notice vibration, the notification vibration, and the end vibration generated by the vibration unit 260 in accordance with the display interval between the feature image and the image displayed on the display unit 30. For example, as the frame number of the image displayed on the display unit 30 approaches the frame number of the feature image, the vibration control unit 253 causes the vibration unit 260 to generate a notice vibration by gradually reducing the generation interval. Then, when the feature image is displayed on the display unit 30, the vibration control unit 253 causes the vibration unit 260 to continuously generate the notification vibration. Thereafter, the vibration control unit 253 causes the vibration unit 260 to generate end vibration by gradually extending the generation sensation as the frame number of the image displayed on the display unit 30 moves away from the frame number of the feature image.

  In the image display device 204 according to the second embodiment, the vibration control unit 253 may cause the vibration unit 260 to generate a notification vibration at a vibration intensity or generation interval corresponding to the feature amount of the feature image. Further, when the image processing unit 51 provides a plurality of threshold values and extracts feature images corresponding to the respective threshold values, the vibration control unit 253 performs vibration intensities corresponding to the respective threshold values provided by the image processing unit 51. Alternatively, the notification vibration may be output to the vibration unit 260 at the generation interval. Note that the vibration control unit 253 may increase or decrease the intensity of the notice vibration and the end vibration step by step according to the vibration intensity of the notification vibration. When the image processing unit 51 acquires a plurality of types of feature amounts and extracts feature images according to the acquired types of feature amounts, the vibration control unit 253 extracts the feature images extracted by the image processing unit 51. The vibration unit 260 may generate the notice vibration, the notification vibration, and the end vibration at the vibration intensity or the generation interval according to the type.

  Further, in the second embodiment, the notice of the display of the feature image and the passage of the display of the feature image may be notified by changing the vibration generation unit. For example, an example will be described in which the image display device 204 includes a plurality of vibration generation devices that are the vibration units 260 and the vibration generation devices are respectively attached to the right hand and the left hand of the user. For example, the vibration control unit 253 notifies that the feature image is displayed by causing the vibration generating device attached to the left hand of the user to generate vibrations whose intensity is increased stepwise. In addition, the vibration control unit 253 informs the user that the vibration is generated on both the left hand and the right hand and that the feature image is displayed, and the vibration is attached to the right hand. The device is notified of the end of the display of the feature image by generating a vibration in which the intensity of the vibration is gradually reduced.

  In the second embodiment, the case of outputting the notice vibration, the notice vibration, and the finish vibration as the finish vibration has been described. However, the image display device 4 finishes at least one of the notice vibration, the notice vibration, or the finish vibration. You may output as vibration. This is because the user can recognize the display of the feature image by confirming at least one of the notice vibration, the notification vibration, and the end vibration. Further, the image display device 4 may output a combination of at least two of the notice vibration, the notification vibration, and the end vibration as the end vibration. Further, in the first and second embodiments, the case where the warning sound, the notification sound, each sound of the end sound or each vibration of the notification vibration, the notification vibration, and the end vibration is output or generated has been described. Both the sound of the notification sound and the end sound and the vibrations of the notice vibration, the notification vibration, and the end vibration may be output and generated. In this case, the image display device 4 may associate the magnitudes of the volume of each of the warning sound, the notification sound, and the end sound with the strength of each vibration of the warning vibration, the notification vibration, and the end vibration. For example, the image display device 4 increases or decreases the volume of the notification sound, the notification sound, and the end sound according to the strength of each vibration of the notification vibration, the notification vibration, and the end vibration. In addition, the image display device 4 determines the pitch of the warning sound, the notification sound, and the end sound, the tone change, the output interval of the sound output pattern, the strength of each vibration of the warning vibration, the notification vibration, and the end vibration, Or you may match | combine with a strong / weak pattern and an generating interval. In this case, the image display device 4 needs to further include a vibration control unit 253 and a vibration unit 260.

  The image display devices 4 and 204 described in the first and second embodiments can be realized by executing a program prepared in advance on a computer system such as a personal computer or a workstation. Hereinafter, a computer system that executes an image display program having the same function as that of the image display apparatus described in the above embodiment will be described.

  FIG. 16 is a system configuration diagram showing a configuration of a computer system using the above-described embodiment, and FIG. 17 is a block diagram showing a configuration of a main body in this computer system. As illustrated in FIG. 16, the computer system 100 according to the first and second embodiments includes a main body 101, a display 102 for displaying information such as an image on a display screen 102 a according to an instruction from the main body 101, A keyboard 103 for inputting various information to the computer system 100 and a mouse 104 for designating an arbitrary position on the display screen 102a of the display 102 are provided.

  Further, as shown in FIG. 17, the main body 101 in the computer system 100 includes a CPU 121, a RAM 122, a ROM 123, a hard disk drive (HDD) 124, a CD-ROM drive 125 that receives a CD-ROM 109, and a flexible disk. An FD drive 126 that accepts an (FD) 108; an I / O interface 127 that connects the display 102, keyboard 103, and mouse 104; and a LAN interface 128 that connects to a local area network or wide area network (LAN / WAN) 106 Prepare.

  Further, a modem 105 for connecting to a public line 107 such as the Internet is connected to the computer system 100, and another computer system (PC) 111 and server 112 are connected via a LAN interface 128 and a LAN / WAN 106. The printer 113 is connected.

  And this computer system 100 implement | achieves an image display apparatus by reading and executing the image display program recorded on the predetermined recording medium. Here, the predetermined recording medium is not limited to “portable physical medium” such as flexible disk (FD) 108, CD-ROM 109, MO disk, DVD disk, magneto-optical disk, IC card, etc. Connected to internal and external hard disk drives (HDD) 124, “fixed physical media” such as RAM 122 and ROM 123, public line 107 connected via modem 105, other computer system 111 and server 112 Any recording medium that records an image display program that can be read by the computer system 100, such as a “communication medium” that holds the program in a short period of time when the program is transmitted, such as a LAN / WAN 106 that is used.

  That is, the image display program is recorded on a recording medium such as the above-mentioned “portable physical medium”, “fixed physical medium”, “communication medium”, etc. so that it can be read by a computer. The image display program and the image display method are realized by reading and executing the image display program from such a recording medium. Note that the image display program is not limited to be executed by the computer system 100, and when the other computer system 111 or the server 112 executes the image display program or in cooperation with them, the image display program is executed. The present invention can be similarly applied to the case where the above is executed.

1 is a schematic diagram illustrating an overall configuration of an in-subject information acquisition system according to Embodiment 1. FIG. 1 is a block diagram illustrating a schematic configuration of an image display apparatus according to a first embodiment; It is a flowchart which shows the image processing procedure by the control part shown in FIG. It is a flowchart which shows the process sequence of the audio | voice output process shown in FIG. It is the figure which showed the relationship between the frame number of the image displayed on a display part, and the volume level of the audio | voice output from an audio | voice output part. It is the figure which showed the relationship between the frame number of the image displayed on a display part, and the pitch step of the audio | voice output from an audio | voice output part. It is the figure which showed the relationship between the frame number of the image displayed on a display part, and the audio | voice output pattern output from an audio | voice output part. It is the figure which showed the relationship between the frame number of the image displayed on a display part, and the volume level of the audio | voice output from an audio | voice output part. It is the figure which showed the relationship between the frame number of the image displayed on a display part, and the pitch step of the audio | voice output from an audio | voice output part. It is the figure which showed the relationship between the frame number of the image displayed on a display part, and the volume level of the audio | voice output from an audio | voice output part. It is the figure which showed the relationship between the frame number of the image displayed on a display part, and the volume level of the audio | voice output from an audio | voice output part. FIG. 3 is a block diagram illustrating a schematic configuration of an image display apparatus according to a second embodiment. It is a flowchart which shows the image processing procedure by the control part shown in FIG. It is a flowchart which shows the process sequence of the vibration process shown in FIG. It is the figure which showed the relationship between the frame number of the image displayed on a display part, and the intensity | strength level of the vibration output from a vibration part. 1 is a configuration diagram illustrating a configuration of a computer system using Embodiments 1 and 2. FIG. It is a block diagram which shows the structure of the main-body part in the computer system shown in FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Subject 2 Reception apparatus 2a Reception jacket 2b External apparatus 4,204 Image display apparatus 5 Portable recording medium 20 Input part 30 Display part 40 Memory | storage part 50,250 Control part 51 Image processing part 52 Display control part 53 Audio | voice control part 54 Audio generation unit 60 Audio output unit 253 Vibration control unit 260 Vibration unit 100 Computer system 101 Main unit 102 Display 102a Display screen 103 Keyboard 104 Mouse 105 Modem 106 Local area network or wide area network (LAN / WAN)
107 Public line 108 Flexible disk (FD)
109 CD-ROM
111 Other computer systems (PC)
112 server 113 printer 121 CPU
122 RAM
123 ROM
124 hard disk drive (HDD)
125 CD-ROM drive 126 FD drive 127 I / O interface 128 LAN interface

Claims (10)

In an image display device comprising a display means for sequentially displaying a plurality of images taken inside a subject according to frame numbers,
Extracting means for obtaining a feature amount representing a predetermined feature for each of the plurality of images, and extracting an image having the feature amount based on a predetermined threshold from the plurality of images as a feature image;
Display control means for sequentially displaying the plurality of images according to the frame number on the display means;
Audio output means for outputting audio;
When the display control means causes the display means to display the feature images in the plurality of images, a notification sound is sent to notify that the feature image is displayed by an output method according to the feature amount of the feature image. Voice control means for causing the voice output means to output;
An image display device comprising:   The sound control means is a warning sound for notifying the display of the feature image before the display control means displays the feature image on the display means, and when the display control means displays the feature image on the display means. At least a notification sound for notifying that the feature image is displayed, or an end sound for notifying that the display of the feature image has ended after the display control means has displayed the feature image on the display means. The image display apparatus according to claim 1, wherein any one of the notification sounds is output to the sound output unit.   The image display device according to claim 2, wherein the sound control unit causes the sound output unit to output at least two of the notification sound, the notification sound, and the end sound as the notification sound. .   The sound control means causes the sound output means to output the warning sound, the notification sound, and / or the end sound in different volumes, pitches, timbres, sound output patterns, or combinations thereof. 4. The image display device according to 2 or 3.   The voice control means displays the volume, pitch, tone, voice output pattern, or a combination thereof of the warning sound and / or the end sound to be output to the voice output means on the feature image and the display means. The image display device according to claim 4, wherein the image display device is changed according to a display interval with respect to the image.   The voice control unit causes the voice output unit to output the notification sound with a volume, a pitch, a timbre, a voice output pattern, or a combination thereof corresponding to the feature amount acquired by the extraction unit in the feature image. The image display device according to claim 1, wherein the image display device is a display device. The extraction means provides a plurality of the predetermined threshold values, extracts an image having the feature amount determined based on each threshold value from the plurality of images as the feature image,
The voice control unit causes the voice output unit to output the notification sound with a volume, a pitch, a tone, a voice output pattern, or a combination thereof corresponding to each of the plurality of predetermined thresholds provided by the extraction unit. The image display device according to claim 1, wherein the image display device is a display device. The extraction means acquires a plurality of types of feature amounts for the image, extracts the feature images according to the acquired types of feature amounts,
The voice control unit causes the voice output unit to output the notification sound with a volume, a pitch, a tone, a voice output pattern, or a combination thereof according to the type of the feature image extracted by the extraction unit. The image display apparatus as described in any one of Claims 1-5. In an image display method for sequentially displaying a plurality of images according to a frame number from a plurality of images obtained by imaging the inside of a subject,
An extraction step of acquiring a feature amount representing a predetermined feature for each of the plurality of images, and extracting an image having the feature amount based on a predetermined threshold from the plurality of images as a feature image;
A display step of sequentially displaying the plurality of images according to the frame number;
An audio output step of outputting a notification sound notifying that the feature image is displayed by an output method according to the feature amount of the feature image when the feature image in the plurality of images is displayed in the display step; When,
An image display method comprising: In a display device having a function of performing image display and sound output,
Acquires feature quantity representing a predetermined characteristic for each of a plurality of images captured within a subject, and extracted instructions on extracting an image having the feature value based on a predetermined threshold value from among the plurality of images as the feature image ,
Display instructions on sequentially displaying thus the plurality of images to the frame number,
If the characteristic image is displayed in the plurality of images in the display procedure, the in the feature quantity output method corresponding to the characteristic image, sound output the feature image output a notification sound indicating that it appears Procedure and
An image display program for executing

Images