JP5172455B2 - Image display system - Google Patents

Description

  The present invention relates to an image display system for displaying a list of JPEG images on a digital terrestrial television receiver.

  As a conventional image display system that displays a list of JPEG images, a system that determines the display position of an image based on the similarity between images is used. For example, in Patent Document 1, the similarity calculation unit analyzes the similarity between set data composed of a plurality of data, calculates the similarity, and the structure extraction unit calculates a structure related to each other based on the similarity. A configuration is disclosed in which the position of each data in the extracted structure is defined, the designation of the position on the structure is received, and the data is displayed on the display means according to the designation of the position. Thus, when a structural position command between a plurality of data is received, the data corresponding to the received position is displayed on the display means to display the data systematically, thereby improving the convenience of the image display system. ing.

JP 2007-80109 A

  However, in the above-described conventional image display system, since the display position of an image having a high degree of similarity is determined, the drawing order is not taken into consideration, and in the terrestrial digital television receiver, the user can draw the focus data that is a gaze item. There was a problem that waiting time of.

  The present invention has been made to solve the above-described problems, and an object thereof is to obtain an image display system that realizes quick drawing of focus data in consideration of the drawing order.

An image display system according to the present invention accepts a storage unit that stores image data and metadata of the image data, and a focus instruction that specifies a thumbnail image to be watched from among a plurality of thumbnail images included in the metadata. A distance between a focus management unit that calculates a focus position, a classification unit that determines display positions of the plurality of thumbnail images based on the metadata, a focus thumbnail image located at the focus position, and other thumbnail images And a drawing order of thumbnail images in the screen including the focus position based on the focus position , the display position information input from the classification unit, and the distance information input from the distance calculation unit A drawing order management unit for determining And an image drawing control unit for controlling the drawing of thumbnails image, in which and an image drawing unit for drawing the plurality of thumbnail images based on the control information inputted from the image drawing control unit.

According to the present invention, a storage unit that stores image data and metadata of the image data, a focus instruction that specifies a thumbnail image to be watched from among a plurality of thumbnail images included in the metadata, and a focus position A distance between a focus management unit that calculates the position, a classification unit that determines display positions of the plurality of thumbnail images based on the metadata, a focus thumbnail image that is positioned at the focus position, and other thumbnail images Based on the distance calculation unit, the focus position, the display position information input from the classification unit, and the distance information input from the distance calculation unit, the rendering order of thumbnail images in the screen including the focus position is determined. A drawing order management unit, and a plurality of thumbnail images based on the drawing order. An image drawing control unit that controls an image and an image drawing unit that draws the plurality of thumbnail images based on control information input from the image drawing control unit. Can be displayed in order.

Embodiment 1 FIG.
1 is a block diagram showing a configuration of an image display system according to Embodiment 1 of the present invention. The image display system includes a focus management unit 1 that calculates a current gaze item (hereinafter referred to as focus) position, a distance calculation unit 2 that calculates a distance from the focus position to a target thumbnail image, a JPEG image, and metadata of the image. A storage unit 3 that stores the metadata, a metadata management unit 4 that acquires metadata of each JPEG image, a two-dimensional classification unit (classification unit) 5 that determines all display positions of thumbnail images in the two-dimensional space, and the current focus position An image drawing control unit 6 that receives input of all image display positions and distance information of thumbnail images and controls the display operation of thumbnail images, an image drawing order management unit 7 that determines the image drawing order of thumbnail images, and decodes JPEG data Thus, a decoder unit 8 for obtaining bitmap data and an image drawing unit 9 for drawing the bitmap data on the screen are configured. It is.

  The focus management unit 1 receives an input from a remote controller (not shown) that is an external device, calculates the current focus position, and outputs the calculated focus position information to the image drawing control unit 6. The distance calculation unit 2 calculates the distance from the focus position to the target thumbnail image based on focus position information and display position information (details will be described later) input from the image drawing control unit 6, and draws the image as distance information. Output to the control unit 6. The storage unit 3 stores the main image, moving image, and metadata of the JPEG image, outputs the main image and moving image to the image drawing control unit 6, and outputs the metadata to the metadata management unit 4. The metadata includes the shooting date / time, shooting location, ID, file name, file size, and thumbnail image of the JPEG image.

  The metadata management unit 4 outputs the metadata acquired from the storage unit 3 to the two-dimensional classification unit 5. In addition, image information such as ID, file name, and file size and thumbnail images in the metadata are output to the image drawing control unit 6. The two-dimensional classification unit 5 determines all image display positions of thumbnail images in the two-dimensional space based on data such as the shooting date and time of the JPEG image in the metadata, and the image drawing control unit 6 as display position information. Output to. The image drawing control unit 6 outputs the input focus position information, display position information, and distance information to the image drawing order management unit 7. The image drawing order management unit 7 determines an image drawing order indicating the order of drawing thumbnail images based on the input focus position information, display position information, and distance information, and outputs the image drawing order to the image drawing control unit 6.

  The image drawing control unit 6 first transmits JPEG data of the focus thumbnail image located at the focus position to the decoder unit 8, and the decoder unit 8 decodes the JPEG data and outputs bitmap data to the image drawing control unit 6. . The image drawing control unit 6 outputs the input bitmap data to the image drawing unit 9, and the image drawing unit 9 draws the bitmap data on the screen. The image drawing control unit 6 transmits JPEG data of the thumbnail image to the decoder unit 8 according to the image drawing order input from the image drawing order management unit 7 and obtains bitmap data until the thumbnail image in one screen is drawn. The transmission of the bitmap data to the image drawing unit 9 is repeated.

  Next, the operation of the image display system will be described with reference to FIGS. FIG. 2 is a flowchart showing the operation of the image display system according to Embodiment 1 of the present invention. 3 to 9 are diagrams showing an example of processing contents of the image system according to Embodiment 1 of the present invention. In the following, the processing operation shown in the flowchart of FIG. 2 will be described with reference to specific processing contents shown in FIGS.

  When the focus management unit 1 receives an input from the remote controller, it notifies the image drawing control unit 6 (step ST1). In step ST1, the image drawing control unit 6 that has received the input notification determines whether or not the image stored in the storage unit 3 has been analyzed (step ST2). If it is determined in step ST2 that the analysis has been completed, the process proceeds to step ST6. On the other hand, when it is determined in step ST2 that the analysis has not been completed, the image drawing control unit 6 instructs the metadata management unit 4 to acquire metadata from the storage unit 3, and the metadata management unit 4 stores the metadata. Obtain (step ST3). The metadata management unit 4 that has acquired the metadata in step ST3 outputs the metadata to the two-dimensional classification unit 5, and outputs the image information and the thumbnail image to the image drawing control unit 6 (step ST4).

  The two-dimensional classification unit 5 determines the display positions of all the thumbnail images in the two-dimensional space based on data such as the shooting date and time of the JPEG image of the metadata input in step ST4, and the image drawing control unit (Step ST5). The display positions of all the images are determined based on the shooting month and the shooting location. First, the images are classified by the shooting month, and then the shooting locations are classified by prefecture in the image group of each shooting month.

  FIG. 3 shows an example of display position information of all images. FIG. 3A shows an example of display position information classified by shooting month, which is arranged in a vertical row for each shooting month, and is given a file ID. FIG. 3B shows an example of the display position information classified by the shooting month and the shooting prefecture, which is arranged in a vertical column for each shooting month, and further, an image group of each shooting month is displayed for each prefecture. The file IDs are assigned consecutively. FIG. 4 shows an example when the thumbnail images of file ID1 to file ID6 in FIG. 3B are arranged on a screen (not shown). The display information A includes thumbnail images and image information, and the focus frame B is a frame for displaying an image to be focused in the display image A. On the screen, the display information A is classified into columns for each photographing month, and further classified into rows for each prefecture. If there are images of the same prefecture, they are displayed adjacent to the left and right (see display images A of file ID1 and file ID2 in FIG. 4). In FIG. 4, the focus frame B is positioned on the display image A with the file ID 2.

  Next, the focus management unit 1 calculates focus position information based on the input information from the remote controller in step ST1, and outputs the focus position information to the image drawing control unit 6 (step ST6). The image drawing control unit 6 outputs screen image information including the focus position to the image drawing unit 9 (step ST7). The image drawing unit 9 to which the image information is input in step ST7 performs character drawing of the image information such as the ID, file name, and file size of each image (step ST8). FIG. 5 is a diagram illustrating a processing order for performing character drawing of image information. The display information A is composed of a thumbnail image a and image information b, and character drawing of the image information b is sequentially performed in the horizontal direction from the upper left to the lower right as shown by the arrows in FIG. draw.

  The image drawing control unit 6 outputs focus position information and display position information to the distance calculation unit 2, and the distance calculation unit 2 uses the focus thumbnail image at the focus position as the center based on the input focus position and display position information. The distance to each of the thumbnail images is calculated and output as distance information to the image drawing control unit 6 (step ST9). The image drawing control unit 6 outputs the focus position information, the display position information, and the distance information to the image drawing order management unit 7. The image drawing order management unit 7 based on these pieces of information, the thumbnail in the screen including the focus position. The image drawing order is determined and output to the image drawing control unit 6 (step ST10). The drawing order is the order of thumbnail images at the position where the distance from the focus position is the shortest.

  FIG. 6 is a diagram illustrating an example of defining the distance between thumbnail images. When there is an x image in the horizontal direction and a y image in the vertical direction between the focus frame B and the target display information A, the distance between the thumbnail images is defined as x + y. In the example of FIG. 6, since there are x = 2 images in the horizontal direction and y = 3 images in the vertical direction from the focus position B to the target display information A, the distance between both thumbnail images is defined as x + y = 5. . If the distance from the focus frame B to the plurality of display information A is the same, the rendering order is determined randomly within the thumbnail images.

  The image drawing control unit 6 outputs JPEG data of thumbnail images to the decoder unit 8 based on the drawing order, and the decoder unit 8 decodes the input JPEG data and outputs bitmap data to the image drawing control unit 6 ( Step ST11). The image drawing control unit 6 outputs the bitmap data to the image drawing unit 9, and the image drawing unit 9 draws the bitmap data on the screen (step ST12). The image drawing control unit 6 determines whether all thumbnail images on the screen have been drawn (step ST13). If it is determined in step ST13 that all thumbnail images have not been drawn, the process returns to step ST11 and the above-described process is repeated. On the other hand, if it is determined in step ST13 that all thumbnail images have been drawn, the process ends.

  FIG. 7 is a diagram showing an example of the drawing operation of the image list display system according to Embodiment 1 of the present invention. As shown in FIG. 7, the display information A is composed of a thumbnail image a and image information b, and a focus frame B is displayed on the display video A of file ID0. The thumbnail images are drawn in order so as to draw a concentric circle counterclockwise from the file ID 1 to the file ID 8 with the focus frame B as the center.

  FIG. 8 is a diagram illustrating an example of a drawing operation when the screen is moved. When a button such as a remote controller (not shown) is pressed briefly on the screen on which each thumbnail image is drawn, the focus frame B moves within the screen (see the arrow in FIG. 8A). In the state of FIG. 8A, for example, when the button is pressed and held, the display content on the screen moves to the data of the next page, and the cursor position is fixed at the focus frame B position. At this time, an area in which the thumbnail image is drawn in the display information A is blank, and updated information is displayed in the area in which the image information is drawn. When the long-pressed button is released, the thumbnail images are drawn in order so as to draw a concentric circle counterclockwise around the focus frame B (cursor position) as shown in FIG.

  As described above, according to the first embodiment, the distance calculation unit that calculates the distance from the focus thumbnail image at the focus position to the other thumbnail images, and the focus position based on the display position information and the distance information. Since the image drawing order management unit for determining the drawing order of the thumbnail images in the screen including the image is provided, the thumbnail images are drawn in consideration of the drawing order determined based on the distance from the focus thumbnail image. It is possible to draw quickly from an image close to the condition of the focus thumbnail image.

Embodiment 2. FIG.
FIG. 9 is a block diagram showing a configuration of an image display system according to Embodiment 2 of the present invention. This image display system is provided by adding a moving image thumbnail generation unit to the image display system according to Embodiment 1 shown in FIG. In the following, the same or corresponding parts as those of the components of the image display system according to the first embodiment are denoted by the same reference numerals as those used in the first embodiment, and description thereof is omitted or simplified.

  The moving image thumbnail generation unit 10 extracts the most representative one scene from the moving images input from the storage unit 3 as a still image, and outputs the extracted image to the metadata management unit 4 as a moving image thumbnail image. The metadata management unit 4 outputs the moving image thumbnail image to the image drawing control unit 6 together with the image information. The image information of the moving image thumbnail image includes a date such as a shooting date and a place such as a shooting location.

  As a representative scene extracted from the moving image, for example, a scene that the user last viewed is used. Therefore, after the user views each moving image, the moving image thumbnail generation unit 10 stores the still image of the last scene when the viewing is stopped as a moving image thumbnail. In the case of sports programs, highlight scenes may be extracted as representative scenes. In this case, the highlight scene is analyzed based on the voice of the announcer or the audience.

  As described above, according to the second embodiment, a configuration is provided in which a moving image thumbnail generation unit that extracts a representative scene from a moving image as a still image and outputs it as a moving image thumbnail image is selected by the user. It is possible to present a thumbnail image that is easy to do.

Embodiment 3 FIG.
FIG. 10 is a block diagram showing a configuration of an image display system according to Embodiment 3 of the present invention. In this image display system, a music thumbnail generation unit is additionally provided in the image display system according to Embodiment 1 shown in FIG. In the following, the same or corresponding parts as those of the components of the image display system according to the first embodiment are denoted by the same reference numerals as those used in the first embodiment, and description thereof is omitted or simplified.

  The music thumbnail generation unit 11 extracts a music thumbnail image from the music information input from the storage unit 3 and outputs it to the metadata management unit 4. Thereafter, the metadata management unit 4 outputs the music thumbnail image together with the image information to the image drawing control unit 6. As the music thumbnail image, a typical still image such as a music CD jacket is used. The image information of the music thumbnail image is composed of a date such as a CD release date and a place such as an artist's hometown. The date and place information is acquired by the music thumbnail generation unit 11 via the Internet (not shown).

  As described above, according to the third embodiment, since the music thumbnail generating unit that generates the music thumbnail image based on the music information is provided, it is possible to provide a thumbnail image that is easier for the user to select. .

Embodiment 4 FIG.
FIG. 11 is a block diagram showing a configuration of an image display system according to Embodiment 4 of the present invention. This image display system is provided by adding the moving image thumbnail generation unit shown in the second embodiment and the music thumbnail generation unit shown in the third embodiment to the image display system according to the first embodiment shown in FIG. Yes. In the following, the same or corresponding parts as those of the image display system according to Embodiment 1-3 are denoted by the same reference numerals as those used in Embodiment 1-3, and description thereof is omitted or simplified. To do.

  The moving image thumbnail generation unit 10 extracts the most representative one scene from the moving images input from the storage unit 3 as a still image, and outputs the extracted image to the metadata management unit 4 as a moving image thumbnail image. The music thumbnail generation unit 11 extracts a music thumbnail image from the music information input from the storage unit 3 and outputs it to the metadata management unit 4. The metadata management unit 4 outputs the moving image thumbnail, the music thumbnail, and the image information to the image drawing control unit 6. The image information includes a date such as a shooting date and time corresponding to a moving image thumbnail image, a location such as a shooting location, a date such as a release date of a CD corresponding to a music thumbnail image, and a place such as an artist's hometown. Note that image information corresponding to the music thumbnail image is acquired through the Internet (not shown).

  As described above, according to the fourth embodiment, music that generates a music thumbnail image based on a moving image thumbnail generation unit that extracts one representative scene from a moving image as a still image and outputs it as a moving image thumbnail image and music information. Since the thumbnail generation unit is provided, it is possible to provide a thumbnail image that is easier for the user to select.

  In the first to fourth embodiments described above, the arrangement of the thumbnail images is determined based on the shooting location and the shooting date / time as image information. However, the arrangement of the thumbnail images is determined based on other information. May be determined. Also, the image information is not limited to the shooting location, shooting date and time.

Embodiment 5 FIG.
FIG. 12 is a block diagram showing a configuration of an image display system according to Embodiment 3 of the present invention. In this image display system, a thumbnail image storage unit is added to the image display system according to the first embodiment shown in FIG. In the following, the same or corresponding parts as those of the components of the image display system according to the first embodiment are denoted by the same reference numerals as those used in the first embodiment, and description thereof is omitted or simplified.

  The thumbnail image storage unit 12 is a cache area that temporarily stores bitmap data of each thumbnail image decoded by the decoder unit 8 as cache data. The thumbnail image storage unit 12 stores as cache data until the movement of the previous and next pages of the screen displaying the thumbnail image and the image information, and deletes it when moving two or more pages. Thereby, the time for drawing the thumbnail image is shortened.

  As described above, according to the fifth embodiment, since the thumbnail image storage unit that temporarily stores the bitmap data of the thumbnail image as cache data is provided, the time for rendering the thumbnail image is shortened. be able to.

  In the fifth embodiment described above, the configuration in which the thumbnail image storage unit is provided in the configuration of the first embodiment has been described. However, the configuration in which the thumbnail image storage unit is provided in the configurations in the second to fourth embodiments. May be.

It is a block diagram which shows the structure of the image display system which concerns on Embodiment 1 of this invention. It is a flowchart which shows operation | movement of the image display system which concerns on Embodiment 1 of this invention. It is a figure which shows an example of the display position information of the image display system which concerns on Embodiment 1 of this invention. It is a figure which shows an example of the display method of the image display system which concerns on Embodiment 1 of this invention. It is a figure which shows the display order of the image information of the image display system which concerns on Embodiment 1 of this invention. It is a figure which shows the calculation method of the distance between images of the image display system which concerns on Embodiment 1 of this invention. It is a figure which shows the display order of the thumbnail image of the image display system which concerns on Embodiment 1 of this invention. It is a figure which shows the display operation of the image display system which concerns on Embodiment 1 of this invention. It is a block diagram which shows the structure of the image display system which concerns on Embodiment 2 of this invention. It is a block diagram which shows the structure of the image display system which concerns on Embodiment 3 of this invention. It is a block diagram which shows the structure of the image display system which concerns on Embodiment 4 of this invention. It is a block diagram which shows the structure of the image display system which concerns on Embodiment 5 of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Focus management part 2 Distance calculation part 3 Storage part 4 Metadata management part 5 Two-dimensional classification part 6 Image drawing control part 7 Image drawing order management part 8 Decoder part 9 Image drawing part 10 Movie Thumbnail generation unit, 11 music thumbnail generation unit, 12 thumbnail image storage unit, A display video, B focus frame, a thumbnail image, b image information.

Claims (4)

A storage unit for storing image data and metadata of the image data;
A focus management unit that receives a focus instruction for designating a thumbnail image to be watched from among a plurality of thumbnail images included in the metadata, and calculates a focus position;
A classification unit that determines display positions of the plurality of thumbnail images based on the metadata;
A distance calculation unit for calculating a distance between the focus thumbnail image located at the focus position and the other thumbnail images;
A drawing order management unit that determines a drawing order of thumbnail images in the screen including the focus position based on the focus position , display position information input from the classification unit, and distance information input from the distance calculation unit; ,
An image drawing control unit that controls drawing of the plurality of thumbnail images based on the drawing order;
An image display system comprising: an image drawing unit that draws the plurality of thumbnail images based on control information input from the image drawing control unit. The storage unit stores moving image data,
The image display system according to claim 1, further comprising a moving image thumbnail generation unit that extracts a thumbnail image from the moving image data. The storage unit stores music data,
The image display system according to claim 1, further comprising a music thumbnail generation unit that extracts a thumbnail image from the music data.   The image display system according to any one of claims 1 to 3, further comprising a thumbnail image storage unit that stores a thumbnail image already displayed in the image drawing unit.

Images