JP2005338212A - Device, method and program for displaying image - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To make it possible for a user to check quality of a strobe image even before completing to generate the strobe image by displaying the strobe image in the middle of generating the strobe image. <P>SOLUTION: The image display device of this invention is constituted of a dynamic image data storage device 101 for storing dynamic image data, a strobe image generation device 102 for generating the strobe image by cutting out an object from the dynamic image data and overwriting the cut-out object on a background image, and a display device 103 for displaying the generated strobe image, and the strobe image generation device 102 sends the strobe image being in the middle of generation, to the display device 103 until the strobe image is completely generated, and the display device 103 displays the strobe image being in the middle of generation until the strobe image is completely generated. By using this image display device, the quality of the strobe image can be checked even before completely generating the strobe image. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image display device, an image display method, and an image display program.

  Conventionally, a strobe image is generated by extracting an image of a moving object part (hereinafter referred to as an object) included in moving image data from still image data constituting moving image data and superimposing it on a background image. There has been a proposal for a strobe image generation device (see, for example, Patent Document 1). In such a conventional strobe image generation device, the main focus has been on providing an algorithm for accurately extracting an object from moving image data.

  However, even if any algorithm is used, when generating a strobe image from moving image data, it is necessary to set appropriate parameters for generating a strobe image depending on the characteristics of the moving image data to be handled. For example, in the case of moving image data that captures a fast-moving object and moving image data that captures a slow-moving object, in order to display the object over the strobe image at an appropriate interval, the time interval for overlapping the object Must be changed. Therefore, when a strobe image is generated from moving image data, it is essential to observe the generated strobe image and adjust parameters so as to obtain a desired strobe image. Accordingly, the fact that parameter adjustment can be easily performed can be said to be an extremely important element of the strobe image generation device.

  Further, as a method for cutting out an object with high accuracy, an algorithm is disclosed in which a rough shape of an object is first detected roughly, and then an accurate shape of the object is detected from the rough shape (for example, non-deletion). (See Patent Document 1). When an algorithm that performs such multi-stage processing is used, a large amount of calculation is required to detect an object, and thus it may take a long time to complete generation of a strobe image. Therefore, if the generation of the strobe image is completed and the completed strobe image is not displayed, the quality of the generated strobe image can only be confirmed and the parameters cannot be adjusted. become. Therefore, the strobe image generating device is required to have a function of promptly presenting the quality of the generated strobe image to the user and easily adjusting necessary parameters.

  However, from this point of view, there has been no strobe image generation device configured in consideration of the convenience of parameter adjustment. In particular, there is no example in which the strobe image being generated is displayed during the strobe image generation, and the generation of the strobe image can be stopped when the desired quality is not satisfied.

  Conventionally, as a method for displaying a list of image data stored on a storage medium such as a computer or a mobile phone, a thumbnail display for processing a small image of the image data and displaying it has been widely used. In the conventional thumbnail display, when the image data is moving image data composed of time-series still image data, a thumbnail image is generated and displayed by processing the image of the first still image data to be small. .

  However, when the moving image data is a strobe image, the first still image data is a background image. Therefore, when a conventional method is used, whether the data is a strobe image or normal moving image data from a thumbnail image. There was a problem that could not be distinguished.

  In addition, as a method for measuring the distance between an object of known size and the observation position, a reference figure is also displayed in the field of view of a telescope and the like, and the appearance of the object reflected in the field of view of the telescope is displayed. There is known a method for obtaining a distance between an object and an observation position from the size and the size of a reference figure.

  However, according to this method, in order to accurately measure the distance between the object and the observation position, a reference figure having the same size as the apparent size of the object in the field of view such as a telescope is required. It was necessary to display a plurality of reference figures in the field of view of a telescope or the like. For this reason, there is a problem that it is difficult to see an object that is covered with a reference figure and is reflected on a telescope or the like.

Also, when looking for a reference figure that is the same size as the object's apparent size while observing the object while supporting the telescope etc. with the hand, the reference figure of the same size is grasped due to camera shake etc. There was also a problem that it was difficult to do. Furthermore, there is a problem that the distance between the object and the observation position cannot be obtained accurately by obtaining the distance based on an erroneous reference figure.
Japanese Patent No. 2786190 (page 4, Fig. 3) Takashi Ida and three others: "Development of a fully automatic FlashMotion system that synthesizes motion form trajectories", Proceedings of the 9th Image Sensing Symposium, June 2003, pp. 495-500

  The present invention has been made to solve the above-described problems of the prior art, and displays a strobe image that is being generated during the generation of the strobe image, so that the strobe image can be generated even before the generation of the strobe image is completed. An object of the present invention is to provide an image display device, an image display method, and an image display program that enable confirmation of image quality.

  Further, according to the present invention, when the moving image data is a strobe image, by selecting the still image data at the end of the moving image data and generating a thumbnail image, it is determined whether the data is a strobe image from the thumbnail image. An object of the present invention is to provide an image display device, an image display method, and an image display program capable of discriminating whether the data is moving image data.

  In addition, the present invention captures a still image of a subject and changes the still image display magnification to match the size of the subject on the still image with the size of the reference figure, thereby accurately connecting the subject and the photographing means. An object of the present invention is to provide an image display device that can determine the distance of the image.

  In order to achieve the above object, an image display device of the present invention includes a data storage unit that stores moving image data composed of time-series still image data, and the moving image data stored in the data storage unit. A strobe image generating means for cutting out an object included in the moving image data and generating a strobe image by overwriting the extracted object on a background image; and the strobe image generated by the strobe image generating means Display means for displaying, wherein the strobe image generation means sends a strobe image being generated to the display means, and the display means displays the strobe image being generated.

The image display device of the present invention also includes a data storage means for storing moving image data composed of time-series still image data, and the last still image data from the time-series still image data constituting the moving image data. A thumbnail image generation unit that selects and generates a thumbnail image; and a display unit that displays the thumbnail image generated by the thumbnail image generation unit.

  The image display device of the present invention is for comparing the size of a photographing means for photographing a still image of a subject, the still image photographed by the photographing means, and at least a part of the subject appearing in the still image. Display means for simultaneously displaying a reference graphic, magnification changing means for changing the display magnification of the still image displayed on the display means, the subject and the object based on the display magnification of the still image displayed on the display means And a distance calculating means for calculating the distance to the photographing means.

  According to the present invention, it is possible to check the quality of the strobe image even before the generation of the strobe image is completed by displaying the strobe image being generated during the generation of the strobe image.

  Hereinafter, embodiments of the present invention will be described.

  FIG. 1 is a block diagram showing a first embodiment of the present invention.

  The image display apparatus according to the first embodiment includes a moving image data storage apparatus 101, a strobe image generation apparatus 102, a display apparatus 103, and an operation apparatus 104.

  The moving image data storage device 101 is a storage medium having a function of storing moving image data, such as a semiconductor memory, a hard disk, a CD-R, a CD-RW, a DVD-R, a DVD-RAM, and a DVD-RW. is there.

  The strobe image generation device 102 has a function of generating a strobe image from moving image data stored in the moving image data storage device 101 and a function of calculating the progress of strobe image generation. The strobe image generation device 102 includes a first shape detection unit 102a, a second shape detection unit 102b, an image composition unit 102c, and a progress status calculation unit 102d.

  The first shape detection unit 102 a has a function of cutting out a schematic shape of an image (object) of a moving object part from moving image data stored in the moving image data storage device 101.

  The second shape detection unit 102b has a function of cutting out the detailed shape of the object from the schematic shape detected by the first shape detection unit 102a.

  The image composition unit 102c has a function of generating a strobe image by overwriting a detailed object cut out by the second shape detection unit 102b on a background image.

  The progress status calculation unit 102d has a function of calculating the progress status information of strobe image generation from the moving image data stored in the moving image data storage device 101 and the strobe image generated by the image composition unit 102c.

  The display device 103 has a function of displaying the strobe image generated by the strobe image generation device 102 and the progress status information of the strobe image generation. For example, a CRT display or a liquid crystal display is used as the display device 103.

  The operation device 104 is an input operation performed by a user, and has a function of instructing the strobe image generation device 102 to stop generating the strobe image. As the operation device 104, for example, a button, a keyboard, a mouse, a microphone, or the like is used.

  Next, the operation of the image display apparatus according to the first embodiment will be described.

  Moving image data captured by a camera (not shown) is temporarily stored in the moving image data storage device 101, and the moving image data is sent from the moving image data storage device 101 to the strobe image generation device 102. Here, it is assumed that the moving image data is composed of, for example, time-series still image data captured at equal time intervals. Hereinafter, each still image data is referred to as a frame.

  The strobe image generation device 102 first generates a strobe image using the moving image data sent from the moving image data storage device 101. Here, a strobe image generation operation in the strobe image generation apparatus 102 will be described.

  The first shape detection unit 102 a detects the approximate shape of the object from the moving image data stored in the moving image data storage device 101. As a method for detecting the approximate shape of the object from the moving image data, for example, an inter-frame difference AND method can be used.

  In the inter-frame difference AND method, as shown in FIG. 8, first, between a frame (current frame) from which an object is to be cut out and a past frame (past frame) for a predetermined time with respect to the frame, The difference between pixel values is obtained for each pixel. Next, the difference between the obtained pixel values is compared with a predetermined threshold value, and an image (alpha mask) is generated in which a pixel having a pixel value difference larger than the threshold value is “1” and a pixel equal to or smaller than the threshold value is “0”. To do. Similarly, an alpha mask is generated by obtaining a pixel value difference for each pixel between the current frame and a future frame (future frame) for a predetermined time with respect to the current frame. Next, an object area in the current frame is detected by obtaining a logical product of pixel values for each pixel for the two obtained alpha masks. This is the approximate shape of the object.

  The second shape detection unit 102b detects the detailed shape of the object from the schematic shape of the object detected by the first shape detection unit 102a. As a method for detecting a detailed shape from the approximate shape of an object, for example, a fractal contour extraction method (see, for example, Non-Patent Document 1) or a snake method (for example, M. Kass, A. Wickin and D. Terapoulos, “Snakes: active control models, "Int. J. of Computer Vision, vol. 1, no. 4, pp. 321-331, 1988) can be used.

  The image composition unit 102c overwrites the background image with the object cut out by the second shape detection unit 102b to generate a composite image. Here, as the background image, one piece of still image data selected from the still image data constituting the moving image data may be used, or still image data taken separately from the still image data constituting the moving image data May be used. In addition, when an object has already been overwritten on the background image, the image composition unit 102c creates a composite image by overwriting the image with the object newly cut out by the second shape detection unit 102b. Here, the composite image is sent to the display device 103 as a strobe image being generated.

  If all the objects cut out for each frame are overwritten on one background image to generate one still image data, the strobe image data becomes still image data. Further, each time a new object is overwritten, if the latest overwritten still image data is saved in time series, the strobe image data becomes moving image data.

  Next, calculation of the progress information of strobe image generation in the strobe image generation device 102 will be described. The progress calculation unit 102d of the strobe image generation device 102 calculates the progress information of strobe image generation from the moving image data stored in the moving image data storage device 101 and the strobe image data generated by the image composition unit 102c. .

  That is, the progress information of the strobe image generation is obtained as, for example, R = M / N × 100 (%) from the number of frames N included in the entire moving image data and the number of frames M already used for generating the strobe image. Can do. In this example, if R <100 (%), the strobe image is still being generated, and if R = 100 (%), generation of the strobe image is complete. The progress status calculation unit 102d calculates this R and sends it to the display device 103 as progress status information of strobe image generation.

  The display device 103 displays the strobe image sent from the strobe image generating device 102 and the progress status information. When the strobe image is being generated, the strobe image being generated and the progress status information are displayed simultaneously as shown in FIG. Here, FIG. 9 shows a strobe image generated from moving image data in which a car is traveling in front of a house or a tree, and a plurality of cars that are moving objects are displayed as objects in the strobe image. In FIG. 9, the progress status information is represented by characters (for example, 60% complete). However, the progress status information may be processed into a meter and displayed as shown in FIG.

  Thus, by displaying the strobe image being generated by the strobe image generating device 102 on the display device 103, the user can check the quality of the strobe image even during the generation of the strobe image. It becomes possible. In addition, by displaying the strobe image generation progress information on the display device 103 together with the strobe image, the user can grasp how far the strobe image generation has progressed.

  The display device 103 may display options associated with the parameter adjustment method so that the user can adjust the parameters for generating the strobe image, together with the strobe image and the progress information. Is possible. Here, parameters for generating a strobe image include, for example, a time interval (sampling rate) at which an object is overwritten, a threshold for a pixel value difference between frames in the above-described interframe difference AND method, and the like. FIG. 11 shows an example in which options associated with these parameter adjustment methods are displayed.

  The relationship between the options shown in FIG. 11 and the parameter adjustment method will be described below.

  The predetermined threshold for the difference in pixel value between frames in the inter-frame difference AND method described above is a parameter for identifying the object and the background. For example, if the difference between the pixel values is smaller than the threshold value, it can be determined that there is no difference in the pixel values between the frames to be compared. Conversely, if the difference in pixel values is larger than the threshold value, it can be determined that there is a difference in pixel values between the frames to be compared, so that part is detected as a part with a large change, that is, an object with motion. Therefore, if the threshold value is set to be large, only a portion having a larger movement is detected as an object.

  However, if the threshold value is set too large, it is determined that the pixel value difference is smaller than the threshold value for all pixels, and the object cannot be cut out from the moving image data at all. In this case, since no object is overwritten on the background image, the strobe image is an image that does not change from the background image. Therefore, as shown in FIG. 11, an option of “2. Widen object cutout range” is provided. When the user selects this option, the stroboscopic image generation apparatus 102 that has received the input adjusts the parameter so as to reset the threshold value. In order to select an option, the operation device 104 may have a function that allows a user to input an option, or a device (for example, a button) for inputting an option separately from the operation device 104. , A keyboard, a mouse, a microphone, etc.) may be provided so that options can be input using this device. In the following description, it is assumed that the operation device 104 has a function that allows the user to input options.

  On the other hand, if the threshold value for the difference in pixel value between frames is set too small, it is determined that the difference in pixel value is larger than the threshold value in all pixels, and the entire frame is detected as an object. In this case, since the entire frame is overwritten on the background image, the image of each frame is displayed as it is in the strobe image. Therefore, as shown in FIG. 11, an option of “1. narrowing the object cutout range” is provided. When the user selects this option from the operation device 104, the strobe image generation device 102 that has received the input adjusts the parameter so as to reset the threshold value to a larger value.

  The sampling rate for overwriting an object is a parameter for determining at what time interval the object is overwritten on the background image. If the sampling rate is high, as shown in FIG. 13A, the object (car) is displayed densely on the strobe image. Conversely, if the sampling rate is low, as shown in FIG. 13B, Objects are displayed sparsely on the strobe image. Therefore, as shown in FIG. 11, an option “3. Increase display interval of objects” is provided. When the user selects this option from the operation device 104, the strobe image generation device 102 that has received the input adjusts the parameter so as to reset the sampling rate.

  Further, as an option when all parameters are set to appropriate values and a desired strobe image is displayed, an option “4. Composite OK → Save” is also provided as shown in FIG. When the user selects this option from the operation device 104, the stroboscopic image generation device 102 that has received the input may continue generating the stroboscopic image without adjusting parameters.

  In this way, by presenting the user with the options associated with the parameter adjustment method for strobe image generation, the user can adjust the parameters without understanding the meaning of each parameter itself. Is possible.

  As options for parameter adjustment, as shown in FIG. 12, it is also possible to express the state of the strobe image as it is and display it as an option.

  That is, as described above, when the threshold value for the difference between the pixel values between frames in the inter-frame difference AND method is too large, the strobe image is an image that does not change from the background image. The option “does not move from the first image” is provided. When the user selects this option from the operation device 104, the strobe image generating device 102 that has received the input adjusts the parameter so as to reset the threshold value.

  Also, if the threshold for the difference in pixel values between frames is too small, the strobe image is displayed as it is as shown in FIG. 12. Therefore, as shown in FIG. The option of “reproduced” is provided. When the user selects this option from the operation device 104, the strobe image generation device 102 that has received the input adjusts the parameter so as to reset the threshold value to a larger value.

  If the sampling rate is high, the object is displayed on the strobe image so as to overlap with the nectar, and therefore, an option “3. Subjects are excessively overlapped” is provided as shown in FIG. When the user selects this option from the operation device 104, the strobe image generation device 102 that has received the input adjusts the parameter so as to reset the sampling rate.

  In this way, by providing options that express the appearance of the displayed strobe image, the user selects the options without having to understand not only the meaning of the parameters themselves but also the concept of objects, etc. And parameter adjustment is facilitated.

  When there is an input from the user, the operation device 104 transmits a signal instructing the strobe image generation device 102 to stop the strobe image generation. For example, when a specific button of the operation device 104 is pressed, a signal instructing to stop the strobe image generation is transmitted to the strobe image generation device 102.

  Next, the operation of the strobe image generation processing according to the first embodiment will be described using the flowchart of FIG.

  First, in step S101, a strobe image is generated from moving image data by the first shape detection unit 102a, the second shape detection unit 102b, and the image composition unit 102c of the strobe image generation device 102.

  In step S102, the progress status calculation unit 102d calculates the progress status information of the strobe image generation.

  Next, the process proceeds to step S103, and it is determined whether or not the strobe image generation is completed. Whether or not the strobe image has been generated is determined based on the progress status information calculated by the progress status calculation unit 102d. That is, when the progress status information is obtained as R = M / N × 100 (%) from the number N of frames included in the entire moving image data and the number M of frames already used for generating the strobe image as described above. If R <100 (%), it is determined that the generation of the strobe image has not yet been completed, and the process proceeds to step S105. On the other hand, if R = 100 (%), it is determined that the strobe image generation is completed, and the process proceeds to step S104.

  In step S <b> 104, the completed strobe image generated by the strobe image generation device 102 is displayed on the display device 103. In step S <b> 105, the strobe image being generated generated by the strobe image generation device 102 is displayed on the display device 103. The user can know the quality of the strobe image by viewing the strobe image being generated displayed on the display device 103, and can decide whether or not to stop the generation of the strobe image.

Next, in step S106, it is determined whether or not the operating device 104 has been operated. As described above, when the specific button of the operation device 104 is pressed, the process proceeds to step S107, and the strobe image generation device 102 generates a strobe image in response to a signal instructing the stop of the strobe image generation from the operation device 104. Is canceled. On the other hand, if the specific button has not been pressed, the process returns to step S101, and the strobe image generation device 102 continues to generate the strobe image.
As shown in FIG. 6, after the generation of the strobe image is stopped in step S107, step S108 is further provided on the display device 103 to display options associated with the adjustment method for adjusting the strobe image generation parameters. The user may select it. In this way, the user can check the quality of the strobe image with the strobe image being generated, operate the operation device 104 to stop the strobe image generation, and then adjust appropriate parameters. Become. The other steps in FIG. 6 are the same as those in FIG.

  As described above, according to the image display device according to the first embodiment, during the generation of the strobe image, the strobe image being generated is displayed, thereby improving the quality of the strobe image even before the generation of the strobe image is completed. This makes it possible to confirm, and if necessary, the generation of the strobe image can be stopped. In addition, it is possible to adjust appropriate parameters after the generation of the strobe image is stopped.

  FIG. 2 is a block diagram showing a second embodiment of the present invention.

  The image display apparatus according to the second embodiment includes a moving image data storage apparatus 201, a thumbnail image generation apparatus 202, and a display apparatus 203.

  The moving image data storage device 201 is a storage medium having a function of storing moving image data, such as a semiconductor memory, a hard disk, a CD-R, a CD-RW, a DVD-R, a DVD-RAM, and a DVD-RW. is there. The thumbnail image generation device 202 has a function of selecting one piece of still image data from the moving image data stored in the moving image data storage device 201 and generating a thumbnail image from the selected still image data. The display device 203 has a function of displaying the thumbnail image generated by the thumbnail image generation device 202, and for example, a CRT display or a liquid crystal display is used.

  Next, the operation of the image display apparatus according to the second embodiment will be described.

  The moving image data storage device 201 sends the stored moving image data to the thumbnail image generation device 202. Here, it is assumed that the moving image data is composed of, for example, time-series still image data captured at equal time intervals. Further, the moving image data stored in the moving image data storage device 201 may be a processed image such as strobe image data, which is moving image data itself taken by a camera not shown in FIG. Also good.

  The thumbnail image generation device 202 first selects one piece of still image data from the moving image data sent from the moving image data storage device 201. As still image data to be selected, for example, still image data at the end of moving image data is used. Here, when the moving image data is a strobe image, the still image data at the end is generated by overwriting at least one image (object) of a moving object part extracted from the moving image data on the background image. It is a processed image. Therefore, if a thumbnail image is generated using this still image data, a plurality of objects are continuously overwritten on the thumbnail image, so that the user can display the data as a strobe image from the thumbnail display. It becomes possible to judge.

  Further, as still image data to be selected by the thumbnail image generating device 202, identification information indicating that it is a processed image is added to each still image data when generating a strobe image, and this identification information can be used freely. It is also possible to select still image data.

  As a method of adding identification information indicating a processed image when generating a strobe image, for example, the pixel value of a specific pixel is set to “0” when the still image data is a processed image, and the processing is performed. If it is not an image, a value other than “0” may be set. In this way, the thumbnail image generating apparatus 202 can identify whether or not the still image data is a processed image from the pixel value of the specific pixel.

  Next, the thumbnail image generating apparatus 202 generates thumbnail images by reducing the selected still image data to a predetermined size. As a method of reducing still image data, for example, pixels of still image data may be thinned out at an appropriate interval.

  The display device 203 has a function of displaying a thumbnail image sent from the thumbnail image generation device 202. The user can confirm the content of the image data from the thumbnail display displayed on the display device 203.

  Next, the operation of thumbnail display processing according to the second embodiment will be described using the flowchart of FIG.

  First, in step S201, the thumbnail image generation device 202 selects one piece of still image data from the moving image data stored in the moving image data storage device 201. As the still image data selected here, still image data at the end of the moving image data is selected.

  In step S 202, the thumbnail image generation device 202 generates a thumbnail image from the selected single still image data, and sends the thumbnail image to the display device 203.

  In step S203, the thumbnail image generated by the thumbnail image generation device 202 is displayed on the display device 203. The user can select desired moving image data based on the thumbnail image displayed on the display device 203.

  As described above, according to the thumbnail display device according to the second embodiment, the user can confirm the content of the image data from the thumbnail image, and the image data is a strobe image or a normal moving image. It is possible to determine whether it is data.

  FIG. 3 is a block diagram showing a third embodiment of the present invention.

  The image display apparatus according to the third embodiment includes a photographing apparatus 301, a display apparatus 302, a display magnification changing apparatus 303, a reference figure moving apparatus 304, and a distance calculating apparatus 305.

  The photographing device 301 is a camera having a function of photographing a still image of a subject. The display device 302 has a function of simultaneously displaying a still image photographed by the photographing device 301 and a reference graphic for comparing the size with the subject appearing in the still image. For example, a CRT display, a liquid crystal display, or the like is used. Used.

  The display magnification changing device 303 has a function of changing the display magnification of the still image displayed on the display device 302 in accordance with an instruction from the user. As the display magnification changing device 303, for example, a button, a keyboard, a mouse, or the like is used.

  The reference graphic moving device 304 has a function of moving the reference graphic displayed on the display device 302 on the display surface in accordance with an instruction from the user. As the reference graphic moving device 304, for example, a button, a keyboard, a mouse, or the like is used.

  The distance calculation device 305 has a function of calculating the distance between the subject and the photographing device 301 based on the display magnification of the still image displayed on the display device 302.

  Next, the operation of the image display apparatus according to the third embodiment will be described.

  A still image of a subject photographed by the photographing device 301 is sent to the display device 302 by a photographing operation by the user.

  The display device 302 displays a still image photographed by the photographing device 301 and also displays a reference graphic with a predetermined size. For example, as shown in FIG. 14, the reference graphic may display two lines on the still image display surface at a predetermined interval. If the subject is a golf pin flag or the like, FIG. As shown, the general shape (pin flag) of the subject may be displayed as a reference graphic. Also, a plurality of reference figures may be prepared in advance so that an arbitrary reference figure can be selected by a selection operation from the user.

  The display magnification changing device 303 changes the display magnification of the still image displayed on the display device 302 in accordance with an instruction from the user. For example, if the magnification is set to “2 ×”, a still image is displayed on the display device 302 in a double size, and if the magnification is set to “½ ×”, the still image is displayed on the display device 302. It is made to display with 1/2 size. As a result, as shown in FIG. 16, the user can match the size of the subject (pin flag) displayed on the display device 302 with the size of the reference figure (pin flag). Also, in this case, the user can change the display magnification using the display magnification changing device 303 while viewing a still image, so that the size of the reference figure is not affected by camera shake. In addition, the display magnification can be accurately changed.

  The reference graphic moving device 304 moves the reference graphic displayed on the display device 302 on the display surface in accordance with an instruction from the user. As a moving method, for example, with the reference figure selected, the drag function can be used to move the display screen in the vertical direction, the horizontal direction, the diagonal direction, and the rotation function to perform rotation. To. As a result, the user can accurately match the reference graphic with the height and width of the subject displayed on the display device 302 as shown in FIG.

  Instead of the reference graphic moving device 304 for moving the reference graphic, a device for moving the still image by fixing the reference graphic on the display surface may be provided. Even in this case, as shown in FIG. 18, it is possible to accurately match the height and width of the reference figure and the subject by moving the still image.

  The distance calculation device 305 calculates the distance between the subject and the photographing device 301 from the display magnification of the subject displayed on the display device 302 and the size of the reference graphic.

  Here, as a method for calculating the distance between the subject and the photographing device 301 from the display magnification of the subject displayed on the display device 302 and the size of the reference figure, a case where the subject is a golf pin flag is taken as an example. explain.

  The height of a golf pin flag is generally set at 8 feet (2.44 m). Accordingly, first, an object having a height of 8 feet is photographed at a predetermined distance (for example, 100 m) in advance, and a reference figure having the same size as the height of the object appearing in the still image is created and stored. Keep it. Next, a still image of a golf pin flag as a subject is photographed by the photographing device 301, and the still image and the stored reference graphic are simultaneously displayed on the display device 302. At this time, if the size of the reference graphic and the pin flag are the same on the display surface, the distance between the pin flag and the imaging device 301 can be obtained as 100 m. Further, if the display magnification is changed by the display magnification changing device 303 and the display magnification of the still image is doubled, if the size of the reference figure and the pin flag becomes the same, the distance between the pin flag and the photographing device 301 is changed. The distance can be calculated as 100 m × 2 = 200 m. Similarly, if the size of the reference figure and the pin flag is the same when the display magnification is halved, the distance between the pin flag and the photographing device 301 is 100 m × (1/2) = 50 m. Can be calculated.

  The distance between the subject and the photographing device 301 calculated by the distance calculation device 305 may be displayed by providing a separate display device, or may be sent to the display device 302 and displayed together with the still image. Thereby, the user can grasp the distance between the subject and the photographing apparatus 301.

  According to the image display apparatus described above, the user can change the display magnification of the captured still image or move the reference graphic displayed at the same time, without being affected by camera shake or the like. Since the size of the subject and the size of the reference figure can be matched, the distance between the subject and the photographing apparatus 301 can be obtained accurately. In addition, since the display magnification of the captured still image can be changed to make the size of the subject coincide with the size of the reference graphic, it is not necessary to display a plurality of reference graphics having different sizes on the display surface. Therefore, the size of the subject and the reference figure can be accurately matched on the display surface without the subject being covered with a plurality of reference figures.

  In place of the display magnification changing device 303 in the third embodiment described above, a reference graphic magnification changing device 403 for changing the size of the reference graphic displayed on the display device 402 is provided as shown in FIG. Also good.

  In this case, the reference graphic magnification changing device 403 has a function of changing the size of the reference graphic displayed on the display device 402 in accordance with an instruction from the user. For example, if the size of the reference graphic is set to “double”, the reference graphic is displayed in double size on the display device 402, and if the size of the reference graphic is set to “1/2” The reference graphic is displayed on the display device 402 in a half size. As a result, the user can match the size of the subject displayed on the display device 402 with the size of the reference graphic, as shown in FIG.

  Next, the operation of the distance calculation device 405 when the reference graphic magnification changing device 403 is provided will be described.

  In the distance calculation device 405, in the example of the golf pin flag described above, if the size of the reference graphic becomes the same when the size of the reference graphic is doubled, The distance between them can be calculated as 100 m ÷ 2 = 50 m. Similarly, when the size of the reference graphic is halved and the size of the reference graphic and the pin flag are the same, the distance between the pin flag and the photographing device 401 is 100 m / (1/2). = 200 m can be calculated.

  As described above, according to the third embodiment, a still image of a subject with a known size is captured, the still image and the reference graphic are displayed at the same time, and the size of the subject and the reference graphic are displayed on the display surface. By matching, it is possible to accurately obtain the distance between the subject and the photographing apparatus without being affected by camera shake or the like.

1 is a block diagram showing a configuration of an image display apparatus according to a first embodiment of the present invention. The block diagram which shows the structure of the image display apparatus concerning the 2nd Embodiment of this invention. The block diagram which shows the structure of the image display apparatus concerning the 3rd Embodiment of this invention. The block diagram which shows the structure of the image display apparatus using the reference | standard figure magnification change apparatus. The flowchart which shows the operation | movement of the 1st Embodiment of this invention. The flowchart which shows the operation | movement of the 1st Embodiment of this invention. The flowchart which shows the operation | movement of the 2nd Embodiment of this invention. The figure which shows the method of detecting an object by the frame difference AND method. A display example of a strobe image being generated and a progress status. Display example of strobe image in progress and progress status An example of how to adjust parameters. An example of how to adjust parameters. An example of a strobe image when the sampling rate is changed. A display example of a reference graphic. A display example of a reference graphic. The figure which shows the change of a display when the display magnification of a display image is changed. The figure which shows the change of a display when a reference | standard figure is moved. The figure which shows the change of a display when a still image is moved. The figure which shows the change of a display when the magnitude | size of a reference | standard figure is changed.

Explanation of symbols

101 ... Moving image data storage device 102 ... Strobe image generation device 102a ... First shape detection unit 102b ... Second shape detection unit 102c ... Image composition unit 102d ... Progress status Calculation unit 103 ... display device 104 ... operation device 201 ... moving image data storage device 202 ... thumbnail image generation device 203 ... display devices 301 and 401 ... photographing devices 303, 402, ... Display device 303: Display magnification changing device 304, 404 ... Reference figure moving device 305, 405 ... Distance calculation device 403 ... Reference figure magnification changing device

Claims (16)

Data storage means for storing moving image data composed of time-series still image data;
Strobe image generation means for cutting out an object included in the moving image data from the moving image data stored in the data storage means, and generating a strobe image by overwriting the extracted object on a background image;
Display means for displaying the strobe image generated by the strobe image generating means,
The strobe image generation means sends a strobe image being generated to the display means,
The display means displays the strobe image being generated. The strobe image generation means further sends a message indicating that the strobe image is being generated to the display means,
The image display device according to claim 1, wherein the display unit displays the strobe image being generated and a message indicating that the strobe image is being generated.   The image display apparatus according to claim 1, further comprising an operation unit that instructs the strobe image generation unit to stop the strobe image generation. The strobe image generating means includes
First shape detecting means for detecting a schematic shape of an object included in the moving image data;
Second shape detection means for detecting a detailed shape of the object from the approximate shape detected by the first shape detection means;
4. The image synthesizing unit according to claim 1, further comprising: an image synthesis unit that overwrites a background image with the object based on the shape detected by the second shape detection unit. 5. Image display device.   The image display device according to claim 1, wherein the strobe image is moving image data.   The image display apparatus according to claim 1, wherein options associated with a method for adjusting a strobe image generation parameter in the strobe image generation unit are displayed on the display unit. Data storage means for storing moving image data composed of time-series still image data;
Thumbnail image generating means for selecting a still image data at the end from time-series still image data constituting the moving image data and generating a thumbnail image;
An image display apparatus comprising: display means for displaying the thumbnail image generated by the thumbnail image generation means. Data storage means for storing moving image data composed of time-series still image data;
A function for generating thumbnail images by selecting at least one piece of still image data from time-series still image data constituting the moving image data, and the moving image data is a strobe image; Thumbnail image generating means for selecting a still image data generated by overwriting a background image with an object cut out from image data and generating a thumbnail image;
An image display apparatus comprising: display means for displaying the thumbnail image generated by the thumbnail image generation means. Photographing means for photographing a still image of the subject;
Display means for simultaneously displaying a still image photographed by the photographing means and a reference figure for comparing the size with at least a part of a subject appearing in the still image;
Magnification changing means for changing the display magnification of the still image displayed on the display means;
An image display apparatus comprising: distance calculation means for calculating a distance between the subject and the photographing means based on a display magnification of a still image displayed on the display means. Photographing means for photographing a still image of the subject;
Display means for simultaneously displaying a still image photographed by the photographing means and a reference figure for comparing the size with at least a part of a subject appearing in the still image;
Reference figure magnification changing means for changing the display magnification of the reference figure displayed on the display means;
An image display apparatus comprising: a distance calculation unit that calculates a distance between the subject and the photographing unit based on a display magnification of a reference graphic displayed on the display unit.   The image display apparatus according to claim 9, further comprising a moving unit for moving the reference graphic for displaying the reference graphic on at least a part of the subject.   11. The image display apparatus according to claim 9, further comprising a moving unit for moving the still image for displaying at least a part of the subject in conformity with the reference graphic. In an image display method for generating and displaying a strobe image from moving image data composed of time-series still image data,
A strobe image generation step of cutting out an object included in the moving image data from the moving image data stored in the data storage means, and generating a strobe image by overwriting the extracted object on a background image;
And a step of displaying the strobe image being generated which is generated in the strobe image generation step. In an image display method for generating and displaying thumbnail images from moving image data composed of time-series still image data,
Selecting a still image data at the end of the moving image data to generate a thumbnail image; and
And a step of displaying the generated thumbnail image. In an image display program for causing a computer to generate and display a strobe image from moving image data composed of time-series still image data,
A strobe image generation function for generating a strobe image by cutting out an object included in the moving image data from the moving image data stored in the data storage means and overwriting the extracted object on a background image;
An image display program comprising: a function of displaying a strobe image being generated by the strobe image generation function. In an image display program for causing a computer to generate and display a thumbnail image from moving image data composed of time-series still image data,
A function for generating a thumbnail image by selecting still image data at the end of the moving image data;
An image display program having a function of displaying the generated thumbnail image.

Images