JP2006099058A - Display device and method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display device for displaying a plurality of images quickly in a short time while guaranteeing high visibility. <P>SOLUTION: The display device includes: an image acquisition part for acquiring a plurality of images which should be displayed, in response to acquisition of an instruction of updating and displaying the plurality of images at a high speed; a cutting part for cutting out a partial region of each of the plurality of image acquired by the image acquisition part, as a partial image; an image composition part for generating a composite image by arranging and combining partial images the number of which can be displayed at one time, out of the plurality of partial images cut out by the cutting part and generating the next composite image by not only deleting one of the plurality of partial images included in the composite image but also adding a next partial image which is not included in the composite image; and a display part for sequentially updating the composite image at a designated update speed to display the composite image. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a display device, a display method, and a program. In particular, the present invention relates to a display device, a display method, and a program that display a plurality of images quickly in a short time while ensuring high visibility.

Conventionally, in order to display a large amount of digital images on a display device, in accordance with a user operation, images are scrolled, images are switched one after another as in a slide show, or thumbnail images obtained by reducing individual image data are displayed. A plurality of images are displayed on the screen (for example, see Patent Document 1).
JP 2004-90632 A

  However, when the images are scrolled or switched one after another, there is a problem that it is difficult to display a large amount of images in a short time because the number of images that the user visually recognizes is small. In addition, since thumbnail images are displayed by reducing the characteristic portion of each image, there is a problem that it is difficult to distinguish a plurality of thumbnail images having similar compositions.

  Accordingly, an object of the present invention is to provide a display device, a display method, and a program that can solve the above-described problems. This object is achieved by a combination of features described in the independent claims. The dependent claims define further advantageous specific examples of the present invention.

  In order to solve the above problem, in the first embodiment of the present invention, a display device is a display device that sequentially updates and displays a plurality of images, and the images are updated and displayed at high speed. An image acquisition unit that acquires a plurality of images to be displayed, and a cutout unit that extracts a partial area of each of the plurality of images acquired by the image acquisition unit as a partial image, A composite image is generated by arranging and synthesizing a plurality of partial images that can be displayed at once from the plurality of partial images cut out by the cutout unit, and one partial image of the plurality of partial images included in the composite image is obtained. An image composition unit that generates the next composite image by deleting and adding the next partial image not included in the composite image, and sequentially updating and displaying the composite image at a specified update rate And a display unit.

  Each of the plurality of images acquired by the image acquisition unit may include information for specifying the position of the main subject, and the cutout unit may cut out the partial image so as to include the main subject. Then, when the one image acquired by the image acquisition unit includes information for specifying the positions of the plurality of main subjects, the cutout unit cuts out the plurality of partial images so as to include the plurality of main subjects, respectively. The image composition unit may generate a composite image by arranging and synthesizing each of the plurality of partial images cut out from one image by the cut-out unit. Furthermore, when the designated update speed exceeds a predetermined threshold, the cutout unit may reduce the size of the partial image, and the image composition unit may increase the number of partial images included in the composite image.

  Then, when the designated update speed exceeds a predetermined threshold, the image composition unit may generate a composite image by thinning out a plurality of partial images. The display unit may increase at least one of display brightness and contrast when the image is updated and displayed at high speed. The image acquisition unit further includes a continuous image selection unit that selects a plurality of images captured by continuous imaging from among the plurality of images acquired by the image acquisition unit, and the image composition unit is selected by the continuous image selection unit. Each of the plurality of composite images may be generated so that each of the plurality of partial images cut out from the plurality of images is continuously displayed in time series at the same position.

  The image composition unit generates a composite image including a partial image cut out from the first image selected by the continuous image selection unit, and the partial image included in the first image selected by the continuous image selection unit. And generating a next composite image by adding a partial image included in the second image selected by the continuous image selection unit, and the display unit selects a plurality of images selected by the continuous image selection unit. The partial image cut out from the image may be updated and displayed at a shorter update speed than the partial images cut out from the plurality of images that are not selected by the continuous shot image selection unit. The image capturing unit further includes an update speed determining unit that determines an update speed of the partial image according to the contents of the plurality of partial images clipped by the clip unit, and the image composition unit updates each partial image determined by the update speed determining unit. Based on the speed, the partial image to be deleted is determined from the composite image, the next partial image is added to generate the next composite image, and the display unit updates the update speed for each partial image determined by the update speed determination unit. The partial image may be updated and displayed.

  Furthermore, the frequency component calculation unit that calculates the frequency component included in each of the plurality of images cut out by the cut-out unit is further provided, and the update speed determination unit is a high-frequency component that is equal to or higher than a predetermined frequency in the frequency component calculated by the frequency component calculation unit The update speed of the partial image having a higher level may be determined slower, and the update speed determination is further provided with an object number calculation unit that calculates the number of objects included in each of the plurality of partial images cut out by the cutout unit The unit may determine the update speed of the partial image having a larger number of objects calculated by the object number calculation unit to be slower. The object number calculating unit calculates the number of persons included in each of the plurality of partial images cut out by the cutout unit, and the update speed determining unit is a partial image having a larger number of persons calculated by the object number calculating unit. The update speed may be determined later.

  Then, an object number calculation unit that calculates the number of persons included in each of the plurality of partial images cut out by the cutout unit, and a display that determines the display order of the partial images in descending order of the number of persons calculated by the object number calculation unit An order determining unit, and the image composition unit may sequentially generate partial composite images by sequentially selecting partial images according to the display order determined by the display order determination unit. Each of the plurality of images acquired by the image acquisition unit includes information for specifying the orientation of the image, and the cutout unit cuts out a horizontal partial image from the horizontal image and extracts a vertical partial image from the vertical image. The cut-out and image composition unit may combine a plurality of horizontally long partial images to generate a combined image, and combine the plurality of vertically long partial images to generate a combined image.

  Further, in the second embodiment of the present invention, a display method for sequentially updating and displaying a plurality of images on a display device, when an instruction to update and display a plurality of images is obtained. Acquiring a plurality of images to be displayed, cutting out a partial area of each of the acquired plurality of images as a partial image, and arranging a plurality of partial images that can be displayed at once from the cut out partial images A composite image is generated by combining, and one partial image of a plurality of partial images included in the composite image is deleted, and the next partial image not included in the composite image is added to the next composite image An image is generated, and the composite image is sequentially updated and displayed at a designated update rate.

  In the third embodiment of the present invention, there is provided a program for a display device that sequentially updates and displays a plurality of images, and instructs the display device to update and display the plurality of images at a high speed. When acquired, an image acquisition function for acquiring a plurality of images to be displayed, a cutout function for cutting out a partial area of each of the plurality of images acquired by the image acquisition unit, and a cutout unit A composite image is generated by arranging and synthesizing a quantity of partial images that can be displayed at once from the plurality of partial images, and one partial image included in the composite image is deleted and combined. An image composition function that generates the next composite image by adding the next partial image not included in the image, and a display that sequentially updates and displays the composite image at the specified update rate To realize the function.

  In the fourth embodiment of the present invention, a display device that sequentially updates and displays a plurality of images, and obtains an instruction to update and display a plurality of images including still images and moving images at high speed. In this case, an image acquisition unit that acquires still images and videos to be displayed, and a display that displays each of the number of still images and videos that can be displayed at one time among the still images and videos acquired by the image acquisition unit side by side. Still image or moving image acquired by the image acquisition unit instead of one still image or moving image displayed on the display unit and the still image or moving image displayed on the display unit. Or the display control part which displays a moving image on a display part, and the update control part which updates and displays the still image or moving image which a display part displays at the update speed designated by the user sequentially are provided.

  The video acquisition unit further includes a partial-period video extraction unit that extracts a partial-period video that is a video of a characteristic partial period of the video, and the display unit is acquired by the image acquisition unit The still image and the partial period video extracted by the partial period video extraction unit are displayed side by side, and the update control unit is designated by the user while the partial period video extracted by the partial period video extraction unit is displayed. Still images displayed on the display unit at the update speed may be sequentially updated and displayed. Further, the image acquisition unit further includes a main subject specifying unit that specifies a main subject of the moving image acquired, and the partial period moving image extraction unit includes a portion in which the main subject specified by the main subject specifying unit is reflected. May be extracted.

  Then, the partial period moving image extraction unit may extract a partial period moving image including a portion in which the volume of the sound attached to the moving image is larger than a predetermined value among the moving images acquired by the image acquisition unit. . The update control unit may sequentially update and display still images displayed on the display unit at an update rate designated by the user while the moving image acquired by the image acquisition unit is displayed. Furthermore, a still image cutout unit that cuts out a partial region of the still image acquired by the image acquisition unit as a partial still image, and a partial region of each of the plurality of moving image constituent images included in the moving image acquired by the image acquisition unit. A partial moving image generation unit that generates a partial moving image by cutting out, and the display unit displays the partial still image cut out by the still image cutting unit and the partial moving image generated by the partial moving image generation unit side by side. Good.

  The video acquisition unit further includes a main subject specifying unit that specifies a main subject of the video acquired by the image acquisition unit, and the partial video generation unit acquires the video acquired by the image acquisition unit so as to include the main subject specified by the main subject specifying unit. A partial video that tracks the main subject identified by the main subject identification unit may be generated by cutting out a partial area of each of the plurality of video composition images included in the image, and the display unit displays a plurality of videos at the same time. A plurality of audio output units for outputting each of the plurality of sounds attached to each of the plurality of videos from the direction corresponding to the position where each of the plurality of videos is displayed. Also good.

  According to a fifth aspect of the present invention, there is provided a display method for sequentially updating and displaying a plurality of images on a display device, wherein a plurality of images including still images and moving images are updated and displayed at high speed. When the instructions are acquired, the still images and videos to be displayed are acquired, and the still images and videos that can be displayed at one time are displayed and displayed side by side. In place of one still image or movie among still images and movies, a still image or movie that has not yet been displayed is displayed and displayed at an update rate specified by the user. The still image or moving image to be displayed is sequentially updated and displayed.

  According to a sixth aspect of the present invention, there is provided a program for a display device that sequentially updates and displays a plurality of images. The display device updates a plurality of images including still images and moving images at high speed. When an instruction to display is acquired, an image acquisition function for acquiring still images and moving images to be displayed, and a number of still images and moving images that can be displayed at one time among the still images and moving images acquired by the image acquisition unit, and Display function that displays each of the videos side by side, and still images or videos acquired by the image acquisition unit in place of one of the still images and videos displayed on the display unit A display control function for displaying still images or moving images not displayed on the display unit on the display unit, and a still image or moving image displayed on the display unit are sequentially updated and displayed at an update speed designated by the user. To realize and update control function.

  The above summary of the invention does not enumerate all the necessary features of the present invention, and sub-combinations of these feature groups can also be the invention.

  According to the present invention, it is possible to provide a display device that quickly displays a large amount of images in a short time while ensuring high visibility, and the user can quickly find a desired image from a large amount of images.

  Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the invention according to the scope of claims, and all combinations of features described in the embodiments are included. It is not necessarily essential for the solution of the invention.

  FIG. 1 shows a portable display device 100 which is a first embodiment of a display device. The display device 100 includes a display unit 110, an instruction acquisition unit 140a, and an instruction acquisition unit 140b (hereinafter collectively referred to as an instruction acquisition unit 140) on the surface of a casing that is a thin rectangular parallelepiped. When the user searches for a specific image from a plurality of images, the display device 100 sequentially updates and displays the plurality of images. The display device 100 determines which of the instruction acquisition unit 140a and the instruction acquisition unit 140b the user has contacted. Then, based on the determination result, the display order of the images is determined in either the forward direction or the reverse direction. Therefore, the user can update the image in both the forward direction and the reverse direction.

  The instruction acquisition units 140a and 140b each have a planar contact portion such as an electrostatic pad. The shape of the contact portion is long in one direction, for example. The user inputs the update speed according to the contact position in the instruction acquisition units 140a and 140b. When the user contacts the contact portion, the display device 100 detects the contact position of the user in the contact portion. Then, the image update speed is determined based on the detected contact position. The display device 100 may determine the image update speed based on the moving speed of the contact position or the acceleration at the time of movement. Note that the image may be either a still image or a moving image. Moreover, the moving image may be composed of a plurality of images, and the plurality of images included in the moving image may include any of various types of images constituting a frame image, a field image, and other moving images.

  The display device 100 according to the present embodiment is capable of quickly displaying a large amount of images in a short time while ensuring high visibility, and is intended for a user to quickly find a desired image from a large amount of images. To do.

  FIG. 2 shows a first embodiment of the functional configuration of the display device 100. When a book having a plurality of pages is turned at a high speed, the afterimage phenomenon causes a person to see a plurality of pages that are preceded and followed. However, if you blink at the moment when a page appears, the page will not be visible. Also, no afterimage remains. Therefore, a person cannot confirm a page that appears at the moment of blinking.

  Therefore, it is required that the user can confirm the page that appears at the moment of blinking. In order to achieve this object, the display device 100 displays one image and the next image to be displayed next to each other. In addition, the display is updated while reducing the density ratio of one image to the next image.

  The display device 100 includes an image holding unit 120, an image acquisition unit 160, a density ratio update unit 180, and an image composition unit 200 in addition to the display unit 110 and the instruction acquisition unit 140. The image holding unit 120 holds an image group having a plurality of images in advance. The image group is, for example, an electronic book and an electronic album. In this case, the image may be a page of a book or an electronic photograph. Further, when the image includes character data, the image includes character size information indicating the size of the displayed character. Furthermore, the image group may be a plurality of images constituting a moving image. In such a case, the image may be a frame image, a field image, and other types of images that constitute other moving images. The image acquisition unit 160 reads an image group from the image holding unit 120.

  The density ratio update unit 180 updates the density ratio of one image to the next image in the composite image so as to decrease with time. Based on the density ratio calculated by the density ratio update unit 180, the image composition unit 200 generates a composite image obtained by combining one image and the next image. Then, the display unit 110 displays the composite image. For this reason, the display device 100 displays the one image for a while in a state of being superimposed on the next image. Therefore, the user can check all the pages even when blinking.

  The recording medium 500 stores a program that causes the display device 100 to implement the operations of the instruction acquisition unit 140, the image holding unit 120, the image acquisition unit 160, the density ratio update unit 180, the image composition unit 200, and the display unit 110 described above. . The recording medium 500 may be connected to the display device 100 via a network such as the Internet. The display device 100 may install and execute such a program via a network.

  FIG. 3 is a flowchart showing the operation of the display device 100 shown in FIG. The user contacts the instruction acquisition unit 140 for the purpose of displaying the updated image group on the display device 100. At this time, the instruction acquisition unit 140 determines that an instruction to sequentially display images constituting the image group has been input (S100). The image acquisition unit 160 acquires an image group from the image holding unit 120 (S200). Further, the density ratio update unit 180 calculates the density ratio (S300). The image composition unit 200 composes one image and the next image in accordance with the calculated density ratio to generate a composite image (S400). The display unit 110 displays the generated composite image (S500).

  The display device 100 repeats the operations from S300 to S500 until there is no input to update the image, and sequentially displays a plurality of images (S600). Then, the image displayed when there is no input to update is displayed as it is (S700).

  As described above, the display device 100 displays the one image for a while in a state of being superimposed on the next image. Therefore, the user can check all the pages even when blinking.

  Note that the repetition period of S300 to S500, that is, the image update interval is preferably 0.1 seconds or less.

  FIG. 4 is a flowchart showing details of S300 of FIG. 3, that is, details of the operation of the density ratio update unit 180. When the user switches the image update direction, there is a high possibility that an image that the user wants to confirm the content is displayed immediately before that. Therefore, the density ratio update unit 180 reduces the image update speed when the instruction for the image update direction is switched.

  That is, the density ratio update unit 180 determines which of the instruction acquisition unit 140a and the instruction acquisition unit 140b the user has contacted. Then, the direction of the image display order is determined based on the determination result. The image update speed is determined and set based on the contact position of the user in the contact portion of the instruction acquisition unit 140. (S310). When an input for switching the image update direction is made to the instruction acquisition unit 140 (S320), the density ratio update unit 180 decreases the image update speed (S330).

  Here, a method of changing the image update speed by the density ratio update unit 180 will be described.

  When the density ratio update unit 180 increases the change amount of the density ratio with respect to the elapsed time from the start of the display of the next image, the time until the density ratio becomes 0 is shortened. In such a case, the image update speed is increased. On the contrary, when the density ratio update unit 180 decreases the change amount of the density ratio, the time required until the density ratio becomes 0 becomes longer. In such a case, the image update speed is slow.

  Therefore, the density ratio update unit 180 can change the image update speed by changing the change amount of the density ratio with respect to the elapsed time from the start of the display of the next image.

  Then, the density ratio update unit 180 acquires an elapsed time after displaying the next image (S340). Then, the density ratio is updated using the time after displaying the next image and the image update speed (S350). As described above, the density ratio update unit 180 reduces the image update speed when the instruction for the image update direction is switched. Therefore, the user can easily find an image whose contents are to be confirmed.

  FIG. 5 is a flowchart showing details of S400 in FIG. 3, that is, details of the operation of the image composition unit 200. Information indicating information attributes such as a headline and a title in a book or the like has a larger character size than other character data. When turning a book or the like at a high speed, a person searches for a target page by focusing on headlines. Therefore, the image composition unit 200 operates as follows for the purpose of making it easy to check headings and the like. That is, when character data is included in at least one of the one image and the next image (S410), character size information of the character data is acquired (S420).

  Then, based on the contact position of the user in the contact portion of the instruction acquisition unit 140, the image update speed is determined (S430). Based on the character size information and the update rate, the density ratio of the character data in the composite image is calculated (S440). That is, the image composition unit 200 darkens relatively large characters compared to relatively small characters. Note that the image composition unit 200 may not display characters smaller than the reference value.

  Then, based on the density ratio of one image to the next image and the density ratio of characters, the image composition unit 200 combines the one image and the next image to generate a composite image (S450). When the density ratio of one image to the next image is 0 (S460), the image composition unit 200 sets the next image as the new one image and sets the image to be displayed next to the next image as the new next image. It is set as an image (S470).

  As described above, the image composition unit 200 darkens relatively large characters compared to relatively small characters. Therefore, the user can check headlines and the like with priority. In S <b> 470, the image composition unit 200 changes an image update interval by changing the time from when the density ratio of one image to the next image becomes 0 until the one image and the next image are updated. Can be changed.

  FIG. 6 is a flowchart showing details of S500 in FIG. 3, that is, details of the operation of the display unit 110. When turning a book or the like, the portion of a page that starts to be seen first differs depending on the turning direction. Therefore, the display unit 110 operates as follows.

  The display unit 110 determines the image update speed based on the contact position of the user in the contact unit of the instruction acquisition unit 140 (S510). Then, based on the determined update speed, the contrast for displaying the composite image is determined (S520). The display unit 110 increases the contrast when the update speed is fast compared to the case where the update speed is relatively slow. For this reason, even when the update speed is fast, the user can easily confirm the image displayed on the display unit 110.

  Then, when the display unit 110 determines the update direction input by the user to the instruction acquisition unit 140 (S530), the display unit 110 determines the display order in the composite image based on the determination result of the update direction (S540). For example, the display unit 110 reverses the display order when the update direction is the forward direction with respect to the display order when the update direction is the reverse direction. For example, when the image group is assumed to be a right-bound book, the display unit 110 displays composite images in order from the left side when the update direction is the forward direction. Further, when the update direction is the reverse direction, the composite images are displayed in order from the right side. Then, a composite image is displayed according to the determined contrast and display order (S550). Therefore, when the user confirms the image on the display device 100, the user can recognize the update direction of the image, that is, the turning direction of the book.

  FIG. 7 shows a configuration in which the display device 100 acquires an image via a network. The display device 100 of this embodiment has a wireless communication function, and is connected to the communication network 10 via the relay station 20. Then, the image group is wirelessly received from the image holding unit 120 provided outside via the communication network 10 and the relay station 20 and displayed. According to the display device 100 according to the present embodiment, when an image group received from the outside is displayed, one image is displayed for a while while being superimposed on the next image. Therefore, the user can check the information on all pages even after blinking.

  FIG. 8 shows a display device 101 which is another embodiment of the display device 100 of the present invention. The display unit 110 in the display device 101 changes the density distribution of the composite image based on the direction of the user's line of sight. Specifically, for example, only a portion of the composite image that the user is viewing is displayed. In this case, the calculation load applied to the display device 101 when displaying a composite image is reduced.

  The display device 101 has imaging devices 300a and 300b on the surface for imaging the user for the purpose of detecting the direction of the user's line of sight. In addition, it has a line-of-sight detection unit that analyzes image data captured by the imaging devices 300a and 300b and detects the direction of the user's line of sight. Since other functions are the same as those of the display device 100 according to the embodiment, the description thereof is omitted.

  The imaging devices 300a and 300b periodically and simultaneously image users who are viewing the display device 100 to generate image data. The line-of-sight detection unit analyzes the image data generated by the imaging devices 300a and 300b and calculates the line of sight of the user. Specifically, the orientation of the user's face included in the image data is calculated. In addition, the position of the user's eyes is calculated. Then, the line of sight is calculated based on the position of the eyes and the orientation of the face.

  Note that the display unit 110 in the display device 101 may display a region that the user is viewing darker than other portions. Further, the area viewed by the user may be displayed in detail, and the other areas may not be displayed in detail.

  FIG. 9 shows a second embodiment of the functional configuration of the display device 100. The display device 100 according to the present embodiment is different from the first embodiment shown in FIG. The instruction acquisition unit 140 according to the present embodiment inputs an instruction to update and display a plurality of images at high speed. When acquiring an instruction to update and display a plurality of images at high speed, the image acquisition unit 160 acquires a plurality of images to be displayed from the image holding unit 120. Also in this embodiment, the image may be either a still image or a moving image. The plurality of images constituting the moving image may include any of various types of images constituting the frame image, the field image, and other moving images.

  The cutout unit 190 cuts out a partial area of each of the plurality of images acquired by the image acquisition unit 160 as a partial image. For example, each of the images of the present embodiment includes information specifying the position of the main subject as tag information. Then, the cutout unit 190 reads out the position of the main subject from the tag information of each image, and cuts out the partial image with a certain width, for example, 1/4 width of the original image, with the main subject as the center in the left-right direction. When tag information indicating the position of the main subject is not written in the image, the clipping unit 190 recognizes the subject that is the largest among the subjects included in the image or the subject that is in focus as the main subject. May be. Then, a partial image may be cut out centering on the recognized main subject. In this case, the cutout unit 190 may recognize a person as a main subject with priority. Alternatively, the cutout unit 190 may cut out a certain width as a partial image from the center in the left-right direction of each image regardless of the position of the main subject.

  The image synthesizing unit 200 according to the present embodiment arranges the number of partial images that can be displayed on the display unit 110 at a time among the plurality of partial images cut out by the cut-out unit 190 according to the display order of the images, and combines them. Is generated. When the generated composite image is displayed on the display unit 110 and an instruction to update and display the next composite image is input, the image composition unit 200 generates the next composite image in the following procedure. That is, by deleting the partial image with the earliest display order from among the multiple partial images included in the previously generated composite image, the next partial image is added by adding the next partial image not included in the composite image. Generate. The display unit 110 sequentially updates and displays the composite image at the update rate specified by the instruction acquisition unit 140.

  The recording medium 500 stores a program that causes the display device 100 to realize the operations of the instruction acquisition unit 140, the image holding unit 120, the image acquisition unit 160, the cutout unit 190, the image composition unit 200, and the display unit 110 described above. The recording medium 500 may be connected to the display device 100 via a network such as the Internet. The display device 100 may install and execute such a program via a network.

  According to the display device 100 of the present embodiment, each of the plurality of images is reduced to generate thumbnail images, and the magnification of the subject is larger than the case where the thumbnail images are displayed in a number that can be displayed on the display unit 110 side by side. Can be displayed. Therefore, the user can quickly and reliably recognize the characteristics of each image when updating and displaying a plurality of images at high speed.

  10, FIG. 11, FIG. 12, and FIG. 13 show examples in which the cutout unit 190 cuts out partial images. Each of the images of the present embodiment includes information specifying the position of the main subject as tag information. Then, the cutout unit 190 reads the position of the main subject from the tag information of each image, and cuts out a partial image around the position of the main subject. For example, the cutout unit 190 is 001. jpg, 002. jpg, 003. jpg, and 004. The position of the main subject is read from the tag information of each image indicated by jpg, and a quarter width of the image is cut out as a partial image with the position of the main subject as the center in the left-right direction. The cut out partial image is, for example, 001-1. jpg, 002-1. jpg, 003-1. jpg, and 004-1. It becomes strip-shaped image data indicated by jpg.

  FIG. 14 shows an example of a composite image generated by the image composition unit 200 from a plurality of partial images. The image composition unit 200 generates a composite image by arranging and synthesizing a number of partial images that can be displayed at a time on the display unit 110 among a plurality of partial images cut out by the cutout unit 190 in accordance with the display order of the images. For example, it is assumed that the display unit 110 of the present embodiment can display a maximum of four partial images obtained by cutting out a quarter width of the image side by side. The image composition unit 200 displays four partial images (001-1.jpg, 002-1.jpg, 003-1.jpg, and 004-1.jpg) that can be displayed on the display unit 110 as original images. In accordance with the order, for example, a composite image is generated by combining from left to right.

  15 and 16 show an example in which the image composition unit 200 updates the composite image. The image composition unit 200 deletes the partial image with the earliest display order from among the plurality of partial images included in the composite image, and adds the next partial image not included in the composite image, thereby adding the next composite image. Is generated. For example, the image synthesizing unit 200 displays the first partial image 001-1... Which is the first display order among the four partial images included in the synthesized image illustrated in FIG. Delete jpg. Then, it is the next partial image 005-1. The next composite image is generated by adding jpg.

  When generating the next composite image, the image composition unit 200 adds the next partial image (005-1) to the display position of the partial image (001-1) deleted immediately before, as shown in FIG. Also good. Further, as shown in FIG. 16, the next partial image (005-1) may be added after the last partial image (004-1) included in the previous combined image.

  FIG. 17 is an example of a composite image when the update speed exceeds the threshold value. When the update speed specified by the instruction acquisition unit 140 exceeds a predetermined threshold, the clipping unit 190 reduces the size of the partial image, and the image composition unit 200 increases the number of partial images included in the composite image. . For example, when the update speed specified stepwise by the instruction acquisition unit 140 exceeds a first threshold value (hereinafter referred to as threshold value 1), the cutout unit 190 sets the width of the partial image cut out from the image up to that point. Reduce to half of That is, when the update speed exceeds the threshold value 1, the cutout unit 190 changes the width of the partial image to 1/8 of the width of the original image. As the width of the partial image is reduced, the number of partial images that can be displayed on the display unit 110 at a time increases. Therefore, the image composition unit 200 generates a composite image by arranging a larger number of partial images in accordance with the display order of the original images. Thereby, the display part 110 can display more partial images at once. Therefore, the user can quickly find a target image from a large number of images.

  FIG. 18 is another example of the composite image when the update speed exceeds the threshold value. When the update speed designated by the instruction acquisition unit 140 exceeds a predetermined threshold, the image composition unit 200 generates a composite image by thinning out a plurality of partial images according to a certain rule. For example, when the threshold value 2, which is higher than the threshold value 1 described above, is exceeded, the image composition unit 200 generates a composite image by thinning out every other partial image clipped by the clip unit 190. In the example of this figure, 002-2, 004-2, 006-2, and 008-2 displayed in the example of FIG. 17 are thinned out to newly add 009-2, 011-2, and 015-2. An image has been added. The thinning rule may be set arbitrarily. Further, as the update speed increases, more images may be thinned out. By thinning out the partial images and generating the composite image, it is possible to search many images at higher speed.

  FIG. 19 is a flowchart showing the operation of the display device 100 of this embodiment. The display device 100 operates according to the following flowchart to update and display partial images of many images at high speed. First, the instruction acquisition unit 140 acquires an instruction to update and display a plurality of images from the user (S800). The image acquisition unit 160 specifies a plurality of images to be updated and displayed at high speed based on conditions such as folder specification and shooting time specification, for example, and acquires the images from the image holding unit 120 (S802). ).

  The cutout unit 190 determines whether or not the update rate input to the instruction acquisition unit 140 exceeds the threshold value 1 (S804). If the input update speed does not exceed the threshold value 1 (S804: N), the cutout unit 190 sets the cutout size of the partial image as a standard size, for example, 1/4 of the width of the original display image ( S806). On the other hand, when the input update speed exceeds the threshold value 1 (S804: Y), the cutout unit 190 sets the cutout size of the partial image as a reduced size, for example, 1/8 of the width of the original display image. (S808). The cutout unit 190 reads tag information of each image. If the position of the main subject is written in the tag information, the partial image is cut out with the width set in Step 806 or Step 808 with the position of the main subject as the center in the left-right direction (S810). When the position of the main subject is not written in the tag information, the cutout unit 190 cuts out the center portion of the image with the set width.

  Next, the image composition unit 200 determines whether or not the update speed input to the instruction acquisition unit 140 exceeds the threshold value 2 (S812). When the input update speed exceeds the threshold value 2 (S812: Y), the image composition unit 200 thins out the partial images cut out by the cutout unit 190 (S814). On the other hand, if the input update rate does not exceed the threshold value 2 (S812: N), the process of step 814 is skipped.

  Next, the image composition unit 200 generates a composite image by arranging the number of partial images that can be displayed on the display unit 110 at a time among the plurality of partial images according to the display order of the images (S816). When the image is updated and displayed at high speed, the display unit 110 increases the display brightness and / or contrast (S817), and displays the composite image (S818). By increasing at least one of display brightness and contrast, the visibility in updating and displaying an image at a high speed is improved.

  Next, the image composition unit 200 determines whether or not an instruction to continue the update display of the image is input from the instruction acquisition unit 140 (S820). When an instruction to continue the update display is input (S820: Y), it is further determined whether or not the update speed has been changed (S822). If it is determined that the update speed has been changed, the process returns to step 804. On the other hand, when the update speed is not changed, the image composition unit 200 deletes the partial image with the earliest display order from among the plurality of partial images included in the composite image that has been displayed (S824). By adding the next partial image not included in the synthesized image (S826), the next synthesized image is generated. Then, the process returns to step 818, and the next composite image is updated and displayed at the designated update rate.

  On the other hand, if an instruction to continue the update display is not input in step 820 (S820: N), the display unit 110 stops updating the image (S828). When one partial image is selected from a plurality of partial images displayed on the display unit 110 at the time when the update of the composite image is stopped (S830: Y), the display unit 110 displays the original of the selected partial image. An image is acquired and the entire image is displayed (S832). This flow is complete | finished above.

  As is clear from the above description, according to the present embodiment, it is possible to provide a display device that displays a large amount of images quickly in a short time while ensuring high visibility. Therefore, the user can quickly find a desired image from a large number of images.

  FIG. 20 shows a third embodiment of the functional configuration of the display device 100. The display device 100 includes an image holding unit 120, an instruction acquisition unit 140, an image acquisition unit 160, a continuous shot image selection unit 165, a clipping unit 190, a frequency component calculation unit 130, an object number calculation unit 132, a display order determination unit 134, an update A speed determination unit 150, an image composition unit 200, and a display unit 110 are provided. Here, the image holding unit 120, the instruction acquisition unit 140, the image acquisition unit 160, the cutout unit 190, the image composition unit 200, and the display unit 110 are described with the same reference numerals in the above description of FIGS. Since it has substantially the same function as each component, detailed description is omitted. The display device 100 according to the present embodiment may be an example of the display device 100 described above with reference to FIGS. The display device 100 according to the present embodiment may further include a part or all of the configuration and functions of the display device 100 described in the above description of FIGS.

  The instruction acquisition unit 140 inputs an instruction to update and display a plurality of images at high speed. The instruction acquisition unit 140 supplies information about the input instruction to the image acquisition unit 160, the cutout unit 190, the image composition unit 200, and the display unit 110. The image acquisition unit 160 acquires a plurality of images to be displayed from the image holding unit 120 when an instruction to update and display a plurality of images at high speed is acquired from the instruction acquisition unit 140. The image acquisition unit 160 supplies the image acquired from the image holding unit 120 to the cutout unit 190 and the continuous shot image selection unit 165. Note that the image may be either a still image or a moving image. The plurality of images constituting the moving image may be frame images, field images, and other types of images constituting the moving image.

  The continuous shot image selection unit 165 selects a plurality of images captured by continuous shooting from among a plurality of images acquired by the image acquisition unit 160. The continuous shot image selection unit 165 determines whether a plurality of images are captured by continuous shooting based on the respective capturing times at which the plurality of images are captured included in each of the plurality of images acquired from the image acquisition unit 160. You may decide whether or not. For example, the continuous shot image selection unit 165 analyzes information on the imaging time included in each of a plurality of captured images. Then, the continuous-shot image selection unit 165 determines that the plurality of images are captured by continuous-shot imaging when the respective imaging times when the plurality of images are captured are included in a predetermined time interval.

  In addition, the continuous shot image selection unit 165 determines whether or not a plurality of images have been continuously shot based on an imaging device ID that can uniquely identify the imaging device that captured the image and the imaging time at which the image was captured. May be. For example, consider a case where a plurality of images are captured by different imaging devices at a predetermined time interval, and the captured images are held in the image holding unit 120. In such a case, it is not possible to accurately determine whether or not a plurality of images have been continuously shot and captured only by information indicating the imaging time included in each of the plurality of images. That is, even when the imaging times of a plurality of images are close to each other, the plurality of images may not always be captured by the same imaging device. However, the continuous shot image selection unit 165 determines whether or not a plurality of images have been continuously shot based on the imaging device ID that picked up the plurality of images and the information of the respective imaging times when the plurality of images were picked up. it can. Thereby, the continuous shot image selection unit 165 accurately determines whether or not a plurality of images are shot continuously even when the image holding unit 120 holds images taken by different imaging devices. A plurality of images taken continuously can be selected.

  Furthermore, the continuous shot image selection unit 165 may determine whether or not a plurality of images are continuously shot based on the similarity of the images calculated from the plurality of images. That is, the continuous shot image selection unit 165 calculates the similarity of each of the plurality of images by performing image processing such as matching of each of the plurality of images. Then, the continuous shot image selection unit 165 may determine that the plurality of images whose calculated image similarity is larger than a predetermined reference value are a plurality of images obtained by continuous shooting. The continuous image selection unit 165 supplies the selected plurality of images to the clipping unit 190.

  The cutout unit 190 cuts out a partial area of each of the plurality of images received from the image acquisition unit 160 and the plurality of images received from the continuous shot image selection unit 165 as a partial image. Note that the cutout unit 190 may assign an identifier that can uniquely identify each partial image to the cut out partial image. When one image acquired by the image acquisition unit 160 includes information for specifying the positions of a plurality of main subjects, the cutout unit 190 displays a plurality of partial images so as to include a plurality of main subjects from one image, respectively. cut. For example, the clipping unit 190 reads the positions of a plurality of main subjects from the tag information of each image. Then, the cutout unit 190 cuts out the partial image with a predetermined width with the plurality of main subjects as the center in the left-right direction or the center in the up-down direction. Thereby, the cutout unit 190 can cut out a partial image including each main subject when a plurality of main subjects are included in one image.

  In addition, the cutout unit 190 reads information for specifying the image orientation, that is, image orientation specifying information included in each of the plurality of images acquired from the image acquisition unit 160. The image orientation specifying information may be information such as a landscape mode and a portrait mode, for example. When the landscape mode information is read as the image orientation specifying information included in each of the plurality of images acquired from the image acquisition unit 160, the clipping unit 190 extracts a horizontally long partial image from the horizontally oriented image. On the other hand, when the cutout unit 190 reads the portrait mode information as the image orientation specifying information included in each of the plurality of images acquired from the image acquisition unit 160, a vertically long partial image is extracted from the portrait image. cut. The cutout unit 190 supplies the cut out partial image to the frequency component calculation unit 130, the object number calculation unit 132, and the image composition unit 200. In addition, the clipping unit 190 supplies a plurality of partial images clipped by the clipping unit 190 from the plurality of images selected by the continuous shot image selection unit 165 to the image composition unit 200.

  The frequency component calculation unit 130 receives a plurality of images cut out by the cut-out unit 190 and calculates a frequency component included in each of the plurality of images. The frequency component calculation unit 130 supplies the calculated frequency component information of each image to the update speed determination unit 150. The object number calculation unit 132 calculates the number of objects included in each of the plurality of partial images cut out by the cutout unit 190. In addition, the object number calculation unit 132 may calculate the number of persons included in each of the plurality of partial images cut out by the cut-out unit 190. The object number calculation unit 132 extracts persons by image processing such as template matching and skin color extraction, and calculates the number of persons included in each of the partial images. The object number calculation unit 132 supplies the calculated number of objects to the display order determination unit 134.

  The display order determination unit 134 determines the display order of the partial images in descending order of the number of persons calculated by the object number calculation unit 132. The display order determination unit 134 supplies the determined display order of the partial images to the update speed determination unit 150.

  The update speed determination unit 150 determines the update speed of the partial image according to the contents of the plurality of partial images cut out by the cutout unit 190. The update speed determination unit 150 determines the update speed of the partial image having a high level of a high frequency component equal to or higher than a predetermined frequency among the frequency components calculated by the frequency component calculation unit 130 received from the frequency component calculation unit 130. Further, the update speed determination unit 150 may determine the update speed of the partial image having a larger number of objects calculated by the object number calculation unit 132 to be slower. Furthermore, the update speed determination unit 150 may determine the update speed of the partial image having a larger number of persons calculated by the object number calculation unit 132 to be slower. Thereby, since it is possible to determine the update speed of a partial image that is difficult for the human eye to quickly grasp the content, the user can easily grasp the content of the image. On the other hand, the update speed determination unit 150 can display a partial image whose contents can be easily grasped by human eyes quickly, so that the user can search for a desired partial image earlier because the update speed can be increased. be able to. The update speed determination unit 150 supplies the determined partial image update speed and the display order of the partial images determined by the display order determination unit 134 to the image composition unit 200.

  The image synthesizing unit 200 generates a synthesized image by arranging and synthesizing a quantity of partial images that can be displayed at a time among a plurality of partial images clipped by the clipping unit 190. Then, the image composition unit 200 deletes one partial image from the plurality of partial images included in the generated composite image, and adds the next partial image not included in the composite image, thereby A composite image is generated. In addition, when the cutout unit 190 cuts out a plurality of partial images so that the cutout unit 190 includes each of a plurality of main subjects, the image synthesis unit 200 cuts out the single image from the single image. Alternatively, a composite image may be generated by combining each of the plurality of partial images.

  When a plurality of partial images cut out from the plurality of images selected by the continuous image selection unit 165 are received from the cutout unit 190, the image composition unit 200 determines that each of the cut out partial images is Each of the plurality of composite images may be generated so as to be continuously displayed in time series at the same position. Then, the image composition unit 200 generates a composite image including a partial image cut out from the first image selected by the continuous-shot image selection unit 165, and the first image selected by the continuous-shot image selection unit 165. While deleting the partial image included in the image, the next combined image may be generated by adding the partial image included in the second image selected by the continuous shot image selection unit 165.

  Further, the image composition unit 200 determines a partial image to be deleted from the composite image based on the update speed for each partial image determined by the update speed determination unit 150, and adds the next partial image to thereby determine the next image. A composite image may be generated. For example, when the update speed determination unit 150 determines that the update speed of the partial image is slower, the image composition unit 200 removes the partial image while leaving the partial image in the composite image. Is deleted from the composite image and the next partial image is added.

  Further, the image composition unit 200 may sequentially generate partial composite images by sequentially selecting partial images in accordance with the display order determined by the display order determination unit 134. Then, when the clipping unit 190 extracts a horizontally long partial image from the horizontally oriented image, the image combining unit 200 may combine a plurality of horizontally long partial images to generate a combined image. In addition, when the vertically long partial image is cut out from the vertically oriented image in the cutout unit 190, the image synthesizing unit 200 may generate a composite image by combining a plurality of vertically long partial images together. . The image synthesis unit 200 supplies the synthesized image to the display unit 110.

  The display unit 110 sequentially updates and displays the composite image received from the image composition unit 200 at the update rate designated by the instruction acquisition unit 140. Further, the display unit 110 cuts out the partial images cut out by the cutout unit 190 from the plurality of images selected by the continuous shot image selection unit 165 from the plurality of images not selected by the continuous shot image selection unit 165. Update and display at a lower update rate than partial images.

  The display unit 110 updates and displays the partial image at the update rate for each partial image determined by the update rate determination unit 150. The display unit 110 updates and displays the partial image at the update speed determined by the update speed determination unit 150 based on the frequency component of the partial image, the number of objects, and the number of persons. That is, the display unit 110 displays the partial image that is difficult to be perceived by the human eye, such as when the partial image includes a large number of objects or a large number of people, at a slower update speed. it can. Thereby, the person can recognize a partial image more reliably.

  The recording medium 500 includes the above-described image holding unit 120, instruction acquisition unit 140, image acquisition unit 160, continuous shot image selection unit 165, clipping unit 190, frequency component calculation unit 130, object number calculation unit 132, and display order determination unit 134. A program for causing the display device 100 to execute the operations of the update speed determination unit 150, the image composition unit 200, and the display unit 110 is stored. The recording medium 500 may be connected to the display device 100 via a network such as the Internet. The display device 100 may install and execute such a program via a network.

  According to the display device 100 according to this embodiment, when a plurality of main subjects are included in one image, each main subject can be cut out and a composite image can be generated from the cut out partial images. As a result, even when a plurality of main subjects are included in one image, each main subject can be recognized more reliably, so that the user can more reliably select an image for which viewing is desired.

  Further, according to the display device 100 according to the present embodiment, a plurality of composite images are generated from partial images of a plurality of images captured by continuous shooting, and the partial image of the image captured by continuous shooting is used. It can be updated and displayed at a fast update rate. Thereby, the time for which a part of the display unit 110 is exclusively used for similar captured images can be shortened. In addition, since the display unit 110 can update and display a plurality of images obtained by continuous shooting more quickly, it can also make a human eye feel that a moving image is displayed. Compared with the case where it does, the load of image processing can be reduced.

  Furthermore, according to the display device 100 according to the present embodiment, the update speed of partial images can be determined according to the contents of a plurality of partial images. Accordingly, the display time of the partial image that is difficult for the user to perceive visually, that is, the partial image that is difficult for the user to grasp the content depending on the perception by the human eye, can be increased. The content of the partial image can be grasped more reliably. That is, even if the image is difficult to grasp, the user can more surely check whether the image is an image that the user wants to view.

  And according to the display apparatus 100 which concerns on this embodiment, a synthesized image can be produced | generated based on the direction of the imaged image. Thereby, since a composite image suitable for the orientation of the partial image can be generated, the user can select a desired captured image more accurately without feeling uncomfortable.

  FIG. 21 shows an example of a composite image generated by the image composition unit 200 from a plurality of partial images. The image synthesizing unit 200 generates a synthesized image by arranging and synthesizing a number of partial images that can be displayed at once on the display unit 110 among the plurality of partial images clipped by the clipping unit 190. Then, the display unit 110 has a shorter partial image cut out from the plurality of images selected by the continuous shot image selection unit 165 than the partial image cut out from the plurality of images not selected by the continuous shot image selection unit 165. Update and display at the update rate.

  For example, it is assumed that the display unit 110 of this embodiment can display a maximum of four partial images obtained by cutting out a quarter width of the image side by side. The image composition unit 200 synthesizes four partial images (020-1), partial images (021-1), partial images (022-1), and partial images (0244-1) that can be displayed on the display unit 110. Thus, a composite image 610 is generated. Then, the display unit 110 updates and displays the portion of the partial image (021-1) selected by the continuous-shot image selection unit 165 at a higher update speed than other partial images.

  That is, the partial image (021-1), the partial image (021-2), and the partial image (021-3) cut out from the image selected by the continuous-shot image selection unit 165 are in the order of the captured time series. Therefore, the composite image 610, the composite image 612, and the composite image 614 are generated in this order. On the other hand, the update speed of the partial image (020-1), the partial image (022-1), and the partial image (024-1) cut out from the images that are not selected by the continuous image selection unit 165 is the continuous image. It is set later than the partial image cut out from the image selected by the selection unit 165. For example, the partial image (021-1) cut out from the image selected by the continuous shot image selection unit 165 is updated to the partial image (021-2) and the partial image (021-3), and the combined image 612 and Consider the case where a composite image 614 is generated. In such a case, the partial image cut out from the image that has not been selected by the continuous shot image selection unit 165 is not updated while the composite image 610 is updated to the composite image 612. Then, when the composite image 614 is generated from the composite image 612, the continuous image selection unit 165 selects the partial image (020-1) so that the partial image (020-1) is only updated to the partial image (026-1). The update speed of the missing image may be set slower than the image selected by the continuous shot image selection unit 165.

  According to the display device 100 according to the present embodiment, it is possible to generate a composite image by updating a partial image of a continuously captured image at a higher update speed than a partial image of an image that has not been continuously captured. Thereby, the display device 100 can prevent a similar partial image from occupying the same position on the display unit 110 among images taken continuously, and a moving image can be seen in human eyes. Can make you feel.

  FIG. 22 shows an example of a composite image generated by the image composition unit 200 from a plurality of partial images. The image synthesizing unit 200 generates a synthesized image by arranging and synthesizing a number of partial images that can be displayed at once on the display unit 110 among the plurality of partial images clipped by the clipping unit 190. Then, the update speed determination unit 150 determines the update speed of the partial image according to the content of the partial image. Subsequently, the display unit 110 updates the partial image based on the update speed of the partial image determined by the update speed determination unit 150 and displays the composite image.

  For example, consider a composite image 620 in which a partial image (025-1) includes a plurality of persons. When the partial image (025-1) includes a plurality of persons, the partial image (025-1) is provided so that the user can accurately grasp the contents of the partial image (025-1). Is updated later than the partial image (020-1), the partial image (022-1), and the partial image (023-1) that include only one subject. That is, when the composite image 622 and the composite image 624 are generated in time series order, the partial image (025-1) is not updated in a predetermined period, and a part excluding the partial image (025-1). The image (020-1), the partial image (022-1), and the partial image (023-1) are updated at a faster update rate than the partial image (025-1). For example, when the composite image 620 is updated to the composite image 622, the partial image (020-1) is updated to the partial image (0244-1). In addition, when the composite image 622 is updated to the composite image 624, the partial image (022-1) is updated to the partial image (026-1). That is, when the other partial images other than the partial image (025-1) are not partial images that are difficult for the user to recognize quickly, the partial images are updated according to the display order of the partial images, and the composite image is updated. May be generated. Note that images that are difficult for the user to recognize quickly include, for example, an image including a plurality of subjects, an image including a plurality of persons, and a level of a high frequency component in which a spatial frequency component calculated from the image is equal to or higher than a predetermined frequency. It may be a larger image.

  According to the display device 100 according to the present embodiment, a partial image that is difficult for humans to recognize quickly, for example, a partial image including a plurality of objects, a partial image including a plurality of persons, and a level of a high frequency component at a predetermined frequency or higher. When a partial image with a larger is included, the update speed of the partial image that is difficult for those persons to recognize quickly can be reduced. Thereby, the person can grasp | ascertain the content of the captured image more reliably.

  FIG. 23 shows an example of a composite image generated by the image composition unit 200 from a plurality of partial images. The image composition unit 200 synthesizes the partial images cut out by the cut-out unit 190 based on the information specifying the image orientation included in each of the plurality of images acquired by the image acquisition unit 160 and combines the combined images. Is generated.

  For example, when each of the plurality of images acquired by the image acquisition unit 160 includes information indicating the portrait mode, the clipping unit 190 converts the portrait image from the portrait mode, that is, the vertically long image ( 020-1), partial image (022-1), partial image (023-1), and partial image (0244-1). Then, the image composition unit 200 generates a composite image 630 from the vertically long partial image (020-1), partial image (022-1), partial image (023-1), and partial image (0244-1).

  In addition, when each of the plurality of images acquired by the image acquisition unit 160 includes information indicating the landscape mode, the clipping unit 190 converts the landscape mode, that is, a horizontally-oriented partial image (060-1). ), Partial image (061-1), partial image (062-1), and partial image (063-1). The image composition unit 200 generates a composite image 635 from the horizontally long partial image (060-1), the partial image (061-1), the partial image (062-1), and the partial image (063-1).

  According to the display device 100 according to the present embodiment, a composite image can be generated by cutting out a partial image in an appropriate direction based on the orientation of the captured image. Thereby, the user can fully confirm the partial image in the composite image that is visually uncomfortable.

  FIG. 24 shows a fourth embodiment of the functional configuration of the display device 100. The display device 100 includes an image holding unit 120, an instruction acquiring unit 140, an image acquiring unit 160, a main subject specifying unit 240, a partial period moving image extracting unit 230, a display control unit 210, a still image cutting unit 250, a partial moving image generating unit 260, The update control part 220, the display part 110, the 1st audio | voice output part 270, and the 2nd audio | voice output part 272 are provided. Here, the image holding unit 120, the instruction acquisition unit 140, the image acquisition unit 160, and the display unit 110 have substantially the same functions as the components described with the same reference numerals in the above description in FIGS. Therefore, the detailed description is omitted. The display device 100 according to the present embodiment may be an example of the display device 100 described above with reference to FIGS. The display device 100 according to the present embodiment may further include a part or all of the configuration and functions of the display device 100 described in the above description of FIGS.

  The instruction acquisition unit 140 acquires an instruction to update and display a plurality of images including still images and moving images, for example, an update speed designated by the user. The instruction acquisition unit 140 supplies the image acquisition unit 160 and the update control unit 220 with information related to an instruction specified by the user to update and display a plurality of images at high speed. The image acquisition unit 160 receives, from the image holding unit 120, still images and moving images to be displayed when acquiring information indicating that a plurality of images are updated and displayed at high speed and received from the instruction acquisition unit 140. get. The image acquisition unit 160 supplies the image acquired from the image holding unit 120 to the main subject specifying unit 240, the display control unit 210, the partial period moving image extraction unit 230, the still image cutout unit 250, and the partial moving image generation unit 260. The image acquisition unit 160 supplies audio data to the first audio output unit 270 and the second audio output unit 272 when the acquired image includes audio.

  The main subject specifying unit 240 specifies the main subject of the moving image acquired by the image acquisition unit 160. When the subject is a person, the main subject specifying unit 240 may preferentially set the person as the main subject in the moving image. The main subject specifying unit 240 gives information specifying the position of the subject specified as the main subject to the image including the main subject as tag information. The main subject specifying unit 240 supplies the moving image with the tag information to the partial period moving image extracting unit 230 and the partial moving image generating unit 260. The partial period moving image extraction unit 230 extracts a partial period moving image that is a moving image of a characteristic partial period of the moving image from among the moving images acquired by the image acquisition unit 160. The partial period moving image may be, for example, a moving image including a plurality of images selected from a predetermined period before and after the imaging time when the image is captured centering on an image including the main subject. The plurality of images constituting the moving image may include any of various types of images constituting the frame image, the field image, and other moving images.

  The partial period moving image extraction unit 230 extracts a partial period moving image from the moving image to which the tag information is given, received from the main subject specifying unit 240. That is, the partial period moving image extraction unit 230 extracts a partial period moving image including a part in which the main subject is reflected, which is specified by the main subject specifying unit 240. In addition, the partial period moving image extraction unit 230 may assign a partial period moving image identifier that can uniquely identify the extracted partial period moving image to the extracted partial period moving image. Moreover, the partial period moving image extraction unit 230 may extract a plurality of images including a portion where the main subject is larger than the background image as partial period moving images. Specifically, the partial period video extraction unit 230 calculates the area of the main subject, and when the ratio of the area of the main subject to the background image is equal to or greater than a predetermined value, the partial period moving image extraction unit 230 focuses on the image including the subject. As a partial period video is extracted. Furthermore, the partial period moving image extraction unit 230 may extract a portion of the moving image in which the main subject is continuously captured for a longer time as a partial period moving image.

  Then, the partial period moving image extraction unit 230 may extract, as the partial period moving image, an image including a portion in which the volume of the sound attached to the moving image is larger than a predetermined value. For example, the partial period moving image extraction unit 230 may extract a portion where a person's voice is larger than a predetermined value as a partial period moving image. Note that the partial period moving image extraction unit 230 may generate the partial period moving image so that the extracted partial period moving image can be reproduced by looping the beginning and end of the extracted partial period moving image. The partial period moving image extraction unit 230 supplies the extracted partial period moving image to the display control unit 210. In addition, the partial period moving image extraction unit 230 supplies the partial control moving image identifier associated with the partial period moving image to the update control unit 220.

  The display control unit 210 replaces one still image or moving image of the still images and moving images displayed on the display unit 110 with the display unit that is still in the still image or moving image acquired by the image acquisition unit 160. Still images or moving images not displayed on 110 are displayed on the display unit 110. Specifically, the display control unit 210 associates the image received from the image acquisition unit 160 with an image identifier that can uniquely identify the image. The partial period moving image identifier is assigned to the partial period moving image extraction unit 230 so that the partial period moving image can be uniquely identified.

  Then, the display control unit 210 adds information indicating that the image is displayed on the display unit 110 to the image and the partial period moving image displayed on the display unit 110. Subsequently, the display control unit 210 reads from the display unit 110 information about the image and the partial period moving image supplied to the display unit 110, that is, an image identifier, a partial period moving image identifier, and information indicating that the display unit 110 has displayed the information. Thus, it is determined whether the image and the partial period moving image held by the display control unit 210 are displayed on the display unit 110. Then, the display control unit 210 supplies the display unit 110 with images and partial period moving images that are not yet displayed on the display unit 110.

  In addition, when audio is attached to the image and the partial period moving image, the display control unit 210 outputs the audio data and the position information on the display unit 110 where the image with the audio is displayed as the first audio output. To the unit 270 or the second audio output unit 272. Furthermore, the display control unit 210 displays the image identifier of the image displayed on the display unit 110 and the image identifier of the image to be displayed next, the partial period moving image identifier of the partial period moving image displayed on the display unit 110, and the next. The partial period moving image identifier of the partial period moving image to be displayed is supplied to the update control unit 220.

  The still image cutout unit 250 cuts out a partial region of the still image received from the image acquisition unit 160 as a partial still image. The region cut out by the still image cutout unit 250 may be a region including the main subject. When the subject is a person, the region including the person may be cut out preferentially. The still image cutout unit 250 supplies the cut out partial still image to the display unit 110.

  The partial moving image generation unit 260 generates a partial moving image by cutting out a partial area of each of a plurality of moving image constituent images included in the moving image received from the image acquisition unit 160. The area cut out by the partial moving image generation unit 260 may be an image including the main subject. Note that the moving image constituent image may include any of various types of images constituting a frame image, a field image, and other moving images. In addition, the partial moving image generation unit 260 determines a partial area of each of the plurality of moving image constituent images included in the moving image acquired by the image acquisition unit 160 so as to include the main subject specified by the main subject specifying unit 240. cut.

  Then, the partial moving image generation unit 260 may generate a partial moving image in which the main subject specified by the main subject specifying unit 240 is tracked. Specifically, the partial moving image generating unit 260 uses the image to which the information indicating the position of the main subject is added as tag information in the main subject specifying unit 240 to track the main subject and generate a partial image. More specifically, the partial moving image generating unit 260 reads tag information attached to the image, and cuts out a partial area of the moving image constituent image including the main subject. Then, the partial moving image generation unit 260 generates a partial moving image from an area cut out from the moving image constituent image including the main subject. The partial moving image generation unit 260 supplies the generated partial moving image to the display unit 110.

  The display unit 110 displays a number of still images and moving images that can be displayed at a time among the still images and moving images acquired by the image acquisition unit 160 side by side. The display unit 110 may display the still image acquired by the image acquisition unit 160 and the partial period moving image extracted by the partial period moving image extraction unit 230 side by side. The display unit 110 may display the partial still image cut out by the still image cutout unit 250 and the partial moving image generated by the partial moving image generation unit 260 side by side.

  The update control unit 220 sequentially updates and displays still images or moving images displayed on the display unit 110 based on the update rate designated by the user, that is, the update rate information received from the instruction acquisition unit 140. The update control unit 220 also includes the image identifier of the image displayed on the display unit 110 and the image identifier of the image to be displayed next, the partial period video identifier of the partial period video displayed on the display unit 110, and the next. Based on the partial period moving image identifier of the partial period moving image to be displayed, the image displayed on the display unit 110 is updated, and the updated image is displayed on the display unit 110.

  Further, the update control unit 220 sequentially updates the still images displayed on the display unit 110 at the update speed designated by the user while the partial period moving image extracted by the partial period moving image extraction unit 230 is displayed. It may be displayed. That is, the update control unit 220 may sequentially update the still images of other parts except for a part of the display unit 110 on which the partial period moving image is displayed. Then, after the display of the partial period moving image is finished, the update control unit 220 displays either the next still image, the moving image, or the partial period moving image at the place where the partial period moving image is displayed.

  Further, the update control unit 220 may sequentially update and display still images displayed on the display unit 110 at an update rate designated by the user while the moving image acquired by the image acquisition unit 160 is displayed. Good. That is, the update control unit 220 may sequentially update the still images of other parts except for a part of the display unit 110 on which the moving image is displayed. Then, after the display of the moving image is finished, the update control unit 220 displays either the next still image, the moving image, or the partial period moving image at the place where the moving image is displayed.

  The first audio output unit 270 and the second audio output unit 272 are configured to display each of a plurality of sounds attached to each of the plurality of videos when the display unit 110 displays a plurality of videos at the same time. Are output from the direction corresponding to the displayed position. For example, in the display device 100, the first audio output unit 270 and the second audio output unit 272 are arranged at symmetrical positions with the display unit 110 interposed therebetween. Then, the audio of the image is output from the first audio output unit 270 or the second audio output unit 272 in accordance with the moving image display position on the display unit 110.

  For example, when the moving image is displayed at a position closer to the first sound output unit 270 on the display unit 110, the sound of the moving image is output from the first sound output unit 270. Further, the first audio output unit 270 and the second audio output unit 272 may be a stereo device, and the direction in which audio is reproduced may be specified by controlling the phase difference between the left and right channels in stereo reproduction. . That is, by making the sound localization position coincide with the position of the moving image displayed on the display unit 110, the user can feel that the sound can be heard from the direction of the moving image.

  The recording medium 500 includes the image holding unit 120, the instruction acquisition unit 140, the image acquisition unit 160, the main subject specifying unit 240, the partial period moving image extraction unit 230, the display control unit 210, the still image cutout unit 250, and the partial moving image generation unit. 260, a program for causing the display device 100 to realize the operations of the update control unit 220, the display unit 110, the first audio output unit 270, and the second audio output unit 272 are stored. The recording medium 500 may be connected to the display device 100 via a network such as the Internet. The display device 100 may install and execute such a program via a network.

  According to the display device 100 according to the present embodiment, a partial period moving image that is a moving image having a characteristic partial period of the moving image can be extracted and displayed side by side with the still image acquired by the image acquisition unit 160. Thus, the user can quickly confirm a large number of still images and moving images while sequentially updating the moving images and still images while accurately displaying the portion of the moving image that the user desires to watch.

  Further, according to the display device 100 according to the present embodiment, it is possible to generate and display a partial image obtained by tracking the main subject included in the moving image. As a result, a partial image centered on the main subject is displayed on the display unit 110. Therefore, when searching for a moving image desired by the user, the still image and the moving image can be updated and displayed at high speed on the display unit 110. , Missed still images and moving images including the main subject can be suppressed.

  Furthermore, according to the display device 100 according to the present embodiment, it is possible to make the user feel that each of the sounds attached to each of the plurality of moving images can be heard from the position where each of the plurality of moving images is displayed. . Thereby, the user can quickly determine which moving image the sound corresponds to.

  FIG. 25 shows an example when still images and moving images are displayed side by side on the display unit 110. In the image 640, a partial image (029-1) indicates a partial area cut out from a plurality of moving image constituent images included in the moving image. Further, the partial image (020-1), the partial image (022-1), and the partial image (023-1) indicate partial areas cut out from the still image. In the display device 100 according to the present embodiment, the display unit 110 includes the partial image (029-1), the partial image (029-2), and the partial image (029-) included in the image 640, the image 642, and the image 644. As shown in 3), a partial period moving image that is a moving image of a characteristic partial period of the moving image is displayed. Then, a partial image (020-1), a partial image (022-1), and a partial image (023-1) which are partial areas of the still image are displayed side by side with the partial period moving image.

  On the display unit 110, the partial period moving image is displayed as a moving image such as a partial image (029-1), a partial image (029-2), and a partial image (029-3). The still image is sequentially updated in the part where the image which is the part area is displayed. For example, when the image 640 is updated to the image 642, the partial image (020-1) is updated to the partial image (0244-1). Subsequently, when the image 642 is updated to the image 644, the partial image (022-1) is sequentially updated to the partial image (027-1).

  According to the display device 100 according to the present embodiment, only a characteristic part of a moving image is extracted and displayed as a partial period moving image, and still images are also displayed side by side, and the still image and the partial period moving image are sequentially updated. Can be displayed. Accordingly, even when a large amount of still images and moving images are stored in the display device 100, the user can quickly find desired still images and moving images.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

The portable display apparatus 100 which is one Example of a display apparatus is shown. 3 is a block diagram illustrating a first embodiment of a functional configuration of the display device 100. FIG. 3 is a flowchart showing an operation of the display device 100 shown in FIG. It is a flowchart which shows the detail of S300 of FIG. It is a flowchart which shows the detail of S400 of FIG. It is a flowchart which shows the detail of S500 of FIG. The structure which the display apparatus 100 acquires an image via a network is shown. The display apparatus 101 which is another Example of the display apparatus 100 is shown. 6 is a block diagram illustrating a second embodiment of the functional configuration of the display device 100. FIG. It is a figure which shows the 1st example from which the cutout part 190 cuts out a partial image. It is a figure which shows the 2nd example which the cutout part 190 cuts out a partial image. It is a figure which shows the 3rd example from which the cutting-out part 190 cuts out a partial image. It is a figure which shows the 4th example from which the cutting-out part 190 cuts out a partial image. It is a figure which shows the example of the synthesized image which the image composition part 200 produced | generated from the partial image. It is a figure which shows the 1st example in which the cutting-out part 190 updates a synthesized image. It is a figure which shows the 2nd example in which the cutting-out part 190 updates a synthesized image. It is an example of a composite image when the update speed exceeds a threshold value. It is another example of a synthesized image when the update speed exceeds a threshold value. 10 is a flowchart illustrating an operation of the display device 100 illustrated in FIG. 9. FIG. 10 is a block diagram illustrating a third embodiment of the functional configuration of the display device 100. It is a figure which shows the example of the synthesized image which the image composition part 200 produced | generated from the partial image. It is a figure which shows the example of the synthesized image which the image composition part 200 produced | generated from the partial image. It is a figure which shows the example of the synthesized image which the image composition part 200 produced | generated from the partial image. FIG. 10 is a block diagram illustrating a fourth embodiment of the functional configuration of the display device 100. 6 is a diagram illustrating an example of images displayed side by side on a display unit 110. FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Communication network 20 Relay station 100,101 Display apparatus 110 Display part 120 Image holding part 130 Frequency component calculation part 132 Object number calculation part 134 Display order determination part 140 Instruction acquisition part 150 Update speed determination part 160 Image acquisition part 165 Continuous shot image Selection unit 180 Density ratio update unit 190 Clipping unit 200 Image composition unit 210 Display control unit 220 Update control unit 230 Partial period moving image extraction unit 240 Main subject specifying unit 250 Still image cutting unit 260 Partial moving image generation unit 270 First audio output unit 272 Second audio output unit 300 Imaging device 500 Recording medium 610, 612, 614 Composite image 620, 622, 624 Composite image 630, 635 Composite image 640, 642, 644 image

Claims (26)

A display device that sequentially updates and displays a plurality of images,
An image acquisition unit that acquires a plurality of images to be displayed when an instruction to update and display a plurality of images is displayed;
A cutout unit that cuts out a partial area of each of the plurality of images acquired by the image acquisition unit;
One of the plurality of partial images included in the composite image is generated by arranging and synthesizing a quantity of partial images that can be displayed at a time among the plurality of partial images cut out by the cutout unit. An image composition unit that deletes an image and generates a next composite image by adding a next partial image not included in the composite image;
And a display unit that sequentially updates and displays the composite image at a designated update rate. Each of the plurality of images acquired by the image acquisition unit includes information for specifying the position of the main subject,
The display device according to claim 1, wherein the cutout unit cuts out a partial image so as to include the main subject. The cutout unit, when one image acquired by the image acquisition unit includes information specifying the positions of a plurality of main subjects, each of the plurality of partial images so as to include the plurality of main subjects from one image, respectively. Cut out,
The display device according to claim 1, wherein the image composition unit generates a composite image by arranging and synthesizing each of a plurality of partial images cut out from one image by the cut-out unit. The cutout unit reduces the size of a partial image when the designated update rate exceeds a predetermined threshold, and the image composition unit increases the number of partial images included in the composite image. The display device described. The display device according to claim 1, wherein when the designated update rate exceeds a predetermined threshold, the image composition unit generates a composite image by thinning a plurality of partial images. The display device according to claim 1, wherein the display unit increases at least one of display brightness and contrast when an image is updated and displayed at high speed. Among the plurality of images acquired by the image acquisition unit, further comprises a continuous image selection unit that selects a plurality of images captured by continuous shooting,
The image composition unit includes a plurality of composite images such that each of a plurality of partial images cut out from the plurality of images selected by the continuous shot image selection unit is continuously displayed in time series at the same position. The display device according to claim 1, which generates each. The image composition unit generates a composite image including a partial image cut out from the first image selected by the continuous-shot image selection unit, and a part included in the first image selected by the continuous-shot image selection unit Deleting the image and generating a next composite image by adding a partial image included in the second image selected by the continuous image selection unit;
The display unit can update a partial image cut out from a plurality of images selected by the continuous-shot image selection unit at an update rate shorter than a partial image cut out from a plurality of images not selected by the continuous-shot image selection unit. The display device according to claim 7, wherein the display device is updated and displayed. An update rate determining unit that determines an update rate of the partial image according to the contents of the plurality of partial images cut out by the cutout unit;
The image composition unit determines a partial image to be deleted from the composite image based on the update speed for each partial image determined by the update speed determination unit, and generates the next composite image by adding the next partial image And
The display device according to claim 1, wherein the display unit updates and displays a partial image at an update rate for each partial image determined by the update rate determination unit. A frequency component calculation unit that calculates a frequency component included in each of the plurality of images cut out by the cutout unit;
The display device according to claim 9, wherein the update rate determination unit determines a update rate of a partial image having a higher level of a high frequency component equal to or higher than a predetermined frequency in the frequency component calculated by the frequency component calculation unit. An object number calculation unit for calculating the number of objects included in each of the plurality of partial images cut out by the cutout unit;
The display device according to claim 9, wherein the update speed determination unit determines the update speed of a partial image having a larger number of objects calculated by the object number calculation unit. The object number calculation unit calculates the number of persons included in each of the plurality of partial images cut out by the cutout unit,
The display device according to claim 11, wherein the update speed determination unit determines the update speed of a partial image having a larger number of persons calculated by the object number calculation unit more slowly. An object number calculation unit for calculating the number of persons included in each of the plurality of partial images cut out by the cutout unit;
A display order determining unit that determines the display order of the partial images in the order in which the number of persons calculated by the object number calculating unit is large,
The display device according to claim 1, wherein the image composition unit sequentially generates partial composite images by sequentially selecting partial images according to the display order determined by the display order determination unit. Each of the plurality of images acquired by the image acquisition unit includes information for specifying the orientation of the image,
The cutout unit cuts out a horizontally long partial image from a horizontally oriented image, cuts out a vertically long partial image from a vertically oriented image,
The display device according to claim 1, wherein the image synthesis unit generates a composite image by combining a plurality of horizontally long partial images, and generates a composite image by combining the plurality of vertically long partial images. A display method for sequentially updating and displaying a plurality of images on a display device,
If you get instructions to update and display multiple images at high speed, you can get multiple images to display,
Cut out a partial area of each of the acquired images as a partial image,
Generate a composite image by arranging and combining the partial images of a quantity that can be displayed at once from the cut out partial images,
Deleting one partial image of the plurality of partial images included in the composite image and generating a next composite image by adding a next partial image not included in the composite image;
A display method of sequentially updating and displaying the composite image at a designated update rate. A program for a display device that sequentially updates and displays a plurality of images, the display device,
An image acquisition function for acquiring a plurality of images to be displayed when an instruction to update and display a plurality of images is displayed;
A cut-out function that cuts out a partial area of each of the plurality of images acquired by the image acquisition unit;
One of the plurality of partial images included in the composite image is generated by arranging and synthesizing a quantity of partial images that can be displayed at a time among the plurality of partial images cut out by the cutout unit. An image composition function for deleting the image and generating a next composite image by adding a next partial image not included in the composite image;
A program for realizing a display function for sequentially updating and displaying the composite image at a designated update rate. A display device that sequentially updates and displays a plurality of images,
An image acquisition unit that acquires a still image and a video to be displayed when an instruction to update and display a plurality of images including a still image and a video is displayed at a high speed;
A display unit that displays each of a number of still images and videos that can be displayed at a time among the still images and videos acquired by the image acquisition unit;
In place of one still image or moving image of the still image and moving image displayed by the display unit, the still image or moving image acquired by the image acquisition unit that has not yet been displayed on the display unit Or a display control unit for displaying a moving image on the display unit;
A display device comprising: an update control unit configured to sequentially update and display still images or moving images displayed on the display unit at an update rate designated by a user. Among the videos acquired by the image acquisition unit, further comprising a partial period video extraction unit that extracts a partial period video that is a video of a characteristic partial period of the video,
The display unit displays the still image acquired by the image acquisition unit and the partial period video extracted by the partial period video extraction unit side by side,
The update control unit sequentially updates and displays still images displayed on the display unit at an update rate designated by a user while the partial period video extracted by the partial period video extraction unit is displayed. Item 18. A display device according to Item 17. A main subject specifying unit for specifying a main subject of the video acquired by the image acquisition unit;
The display device according to claim 18, wherein the partial period moving image extraction unit extracts a partial period moving image including a portion in which the main subject specified by the main subject specifying unit is reflected. The partial period moving image extraction unit extracts a partial period moving image including a portion of the moving image acquired by the image acquisition unit that includes a portion where the volume of the sound attached to the moving image is larger than a predetermined value. The display device described in 1. 18. The update control unit according to claim 17, wherein the update control unit sequentially updates and displays still images displayed on the display unit at an update rate designated by a user while the moving image acquired by the image acquisition unit is displayed. Display device. A still image cutout unit that cuts out a partial region of the still image acquired by the image acquisition unit as a partial still image;
A partial video generation unit that generates a partial video by cutting out a partial area of each of a plurality of video configuration images included in the video acquired by the image acquisition unit;
The display device according to claim 17, wherein the display unit displays a partial still image cut out by the still image cutout unit and a partial moving image generated by the partial moving image generation unit side by side. A main subject specifying unit for specifying a main subject of the video acquired by the image acquisition unit;
The partial video generation unit cuts out a partial area of each of a plurality of video constituent images included in the video acquired by the image acquisition unit so as to include the main subject specified by the main subject specifying unit, The display device according to claim 22, wherein a partial moving image in which the main subject specified by the main subject specifying unit is tracked is generated. When the display unit displays a plurality of videos at the same time, each of a plurality of sounds attached to each of the plurality of videos is respectively viewed from a direction corresponding to a position where each of the plurality of videos is displayed. The display device according to claim 17, further comprising a plurality of audio output units for outputting. A display method for sequentially updating and displaying a plurality of images on a display device,
When an instruction to update and display a plurality of images including still images and videos is acquired at high speed, the still images and videos to be displayed are acquired.
Of the acquired still images and videos, each of the still images and videos that can be displayed at once is displayed side by side.
In place of one of the displayed still images and moving images, a still image or moving image that has not yet been displayed among the acquired still images or moving images is displayed.
A display method in which still images or moving images to be displayed are sequentially updated and displayed at an update speed designated by the user. A program for a display device that sequentially updates and displays a plurality of images, the display device,
An image acquisition function for acquiring a still image and a video to be displayed when an instruction to update and display a plurality of images including a still image and a video is displayed at a high speed;
A display function that displays each of a number of still images and moving images that can be displayed at a time among the still images and moving images acquired by the image acquisition unit;
In place of one still image or moving image of still images and moving images displayed on the display unit, still images or moving images acquired by the image acquisition unit that have not yet been displayed on the display unit Or a display control function for displaying a moving image on the display unit;
A program for realizing an update control function for sequentially updating and displaying still images or moving images displayed on the display unit at an update rate designated by a user.

Images