JP2016218652A - Display device, information processing program, and information processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a device for automatically sorting image files stored in an external memory.SOLUTION: A display device 10 includes a CPU. When an external memory 40 is attached to the display device, the display device reads image data from an image file stored in the external memory 40, and displays an image shown by the image data on a display part 20. The display part 20 extracts attribute information about the image file, uses a theme dictionary for dividing the extracted attribute information and a previously prepared theme to determine the theme of the image file, and distributes the image file to a folder of each different theme.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a display device, an information processing program, and an information processing method, and more particularly, to a display device, an information processing program, and an information processing method that display an image stored in an external storage medium, for example.

  In the digital photo frame disclosed in Patent Document 1, when an external memory is inserted into the main body, an image file is read from the external memory, and a human image is detected from the read image file using face recognition software. Is retrieved, and a representative image of each retrieved person image is displayed on the display. Further, when a user selects an image of a desired person from representative images of the displayed images of each person, a selection screen for selecting the facial expression of the person is displayed on the display. Furthermore, when any facial expression is selected by the user from the selection screen, an image of the selected facial expression is searched from images of a desired person, and an album composed of the searched images is automatically created. Is done.

JP 2011-129033 A

  However, in Patent Document 1, in order to create an album, the user needs to manually select an image of a desired person and a desired facial expression, which is troublesome.

  Therefore, a main object of the present invention is to provide a novel display device, information processing program, and information processing method.

  Another object of the present invention is to provide a display device, an information processing program, and an information processing method capable of automatically sorting image files stored in an external memory.

  A display device according to a first aspect of the present invention is a display device for displaying an image corresponding to image data included in an image file stored in an external storage medium, the attribute information extracting means for extracting attribute information about the image file The theme dictionary storage means for storing dictionary data corresponding to a theme dictionary in which a plurality of themes for classifying image files and keywords related to each of the plurality of themes are described in association with each other and extracted by attribute information extraction means Image files classified into the themes determined by the theme determination means for determining the theme of the image file based on the matching degree between the character string included in the attribute information and the keyword described in the theme dictionary, and the theme determination means Sorting means is stored in the internal storage medium.

  According to the first invention, since the theme of the image file is determined (determined), classified and sorted (stored) by theme, the image file stored in the external storage medium can be automatically sorted.

  In the display device of the second invention, the attribute information includes the file name of the image file.

  In the display device of the third invention, the attribute information includes the title of the image file.

  In the display device of the fourth invention, the attribute information includes a comment of the image file.

  According to the second to fourth inventions, similarly to the first invention, the image files stored in the external storage medium can be automatically sorted.

  In the display device of the fifth invention, when the character string included in the attribute information includes a keyword described in the theme dictionary, the display device further includes score adding means for adding the score of the theme corresponding to the keyword, The theme having the maximum score added by the score adding means is determined as the theme of the image file.

  According to the fifth aspect, since the theme having the maximum added score is determined as the theme of the image file, the image file can be appropriately classified.

  In the display device of the sixth invention, the theme determining means determines each of the plurality of themes as the theme of the image file when there are a plurality of themes having the maximum score added by the score adding means.

  According to the sixth invention, when there are a plurality of themes having the maximum score, each of the plurality of themes is determined as the theme of the image file. Therefore, the image file stored in the external storage medium is automatically selected. Can be sorted.

  In the display device according to the seventh aspect, the attribute information further includes information on the date and time of generation of the image file, and the theme judging unit is configured to store the image file when the maximum score added by the score adding unit is zero. The time zone including the generation date and time is determined, and the sorting unit classifies the time zone determined by the theme determination unit and stores the image file in an internal storage medium.

  According to the seventh invention, when the theme of the image file cannot be determined, the image file is classified by time zone and stored in the internal storage medium. Therefore, the image file stored in the external storage medium is stored. Can be sorted automatically.

  In the display device of the eighth invention, the theme dictionary further stores an image pattern corresponding to each of the plurality of themes, and the attribute information extraction unit further extracts the image pattern from the image data included in the image file, The score adding means compares the image pattern extracted by the attribute information extracting means with each image pattern corresponding to each theme stored in the theme dictionary, and corresponds to an image pattern having a matching rate equal to or greater than a predetermined value. Add theme scores.

  According to the eighth invention, since the score is further added using the image pattern, the theme of the image file can be determined more accurately.

  An information processing program according to a ninth aspect of the invention is a theme dictionary storage for storing dictionary data corresponding to a theme dictionary in which a plurality of themes for classifying image files and keywords associated with each of the plurality of themes are described in association with each other. An information processing program for a display device for displaying an image corresponding to image data included in an image file stored in an external storage medium, and extracting attribute information about the image file to a processor of the display device Attribute information extraction step, a theme determination step for determining the theme of the image file based on the degree of matching between the character string included in the attribute information extracted in the attribute information extraction step and the keyword described in the theme dictionary, and theme determination The image file is stored in the internal storage medium classified according to the theme determined in the step. To perform the sorting step.

  An information processing method according to a tenth aspect of the invention is a theme dictionary storage for storing dictionary data corresponding to a theme dictionary in which a plurality of themes for classifying image files and keywords associated with each of the plurality of themes are described in association with each other. An information processing method for a display device that displays an image corresponding to image data included in an image file stored in an external storage medium, and (a) extracts attribute information about the image file; b) Determine the theme of the image file based on the degree of matching between the character string included in the attribute information extracted in step (a) and the keyword described in the theme dictionary, and (c) determine in step (b) The image files are stored in an internal storage medium classified into the themes.

  According to the ninth and tenth inventions, as in the first invention, image files stored in an external storage medium can be automatically sorted.

  According to the present invention, the image file stored in the external memory can be automatically sorted.

  The above object, other objects, features and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

FIG. 1 is an illustrative view showing an appearance of a display device and an external memory of the first embodiment. FIG. 2 is a block diagram showing an electrical configuration of the display device of the first embodiment. FIG. 3A is an illustrative view showing a data structure of an image file, and FIG. 3B is an illustrative view showing Exif data. FIG. 4 is an illustrative view showing an example of dictionary data. FIG. 5A is an illustrative view showing an example of data extracted from an image file, and FIG. 5B is an illustrative view showing an example of a score table. FIG. 6 is an illustrative view showing one example of a memory map of the RAM shown in FIG. FIG. 7 is a flowchart showing a part of an example of the CPU sorting control process shown in FIG. FIG. 8 is another part of the CPU sorting control process shown in FIG. 2, and is a flowchart subsequent to FIG. FIG. 9 is another part of the CPU sorting control process shown in FIG. 2, and is a flowchart subsequent to FIG. FIG. 10 is another part of the CPU sorting control process shown in FIG. 2, and is a flowchart subsequent to FIG. FIG. 11 is another part of the CPU sorting control process shown in FIG. 2, and is a flowchart subsequent to FIG. FIG. 12 shows another part of the CPU sorting control process in the second embodiment, and is a flowchart subsequent to FIG. FIG. 13 is another part of the CPU sorting control process in the third embodiment, and is a flowchart subsequent to FIG.

<First embodiment>
FIG. 1 is an illustrative view showing the appearance of the display device 10 and the external memory 40 of the first embodiment.

  As shown in FIG. 1, the display device 10 includes a display unit 20 (see FIG. 2). Further, a connection terminal 10 a for connecting the external memory 40 is provided on the side surface of the display device 10. In the first embodiment, a USB memory is shown as an example of the external memory 40, but it is not necessary to be limited to this. For example, the external memory 40 may be a general-purpose memory card such as an SD card, a memory stick, a multimedia card (registered trademark), or another storage medium such as an external HDD. However, the connection terminal 10a is appropriately changed according to the external memory 40 to be used. For example, when an SD card is used, a card slot is provided instead of the connection terminal 10a. Alternatively, a configuration in which a plurality of types of storage media can be mounted on the display device 10 may be adopted. In such a case, the display device 10 is provided with a connection terminal and a card slot for mounting various storage media. In addition, the display device 10 can be connected to an external computer in a communicable manner using, for example, a LAN cable or a USB cable, or in a wireless LAN. It can be said that the external memory 40 is used. However, a digital camera can also be connected using a USB cable. In such a case, the memory built in or attached to the digital camera can be said to be the external memory 40.

  When an external computer or a digital camera is connected, the CPU 12 communicates with a CPU built in them to indirectly access an external memory 40 built in or attached to them.

  FIG. 2 is a block diagram showing an electrical configuration of the display device 10 of the first embodiment.

  Referring to FIG. 2, display device 10 according to the first embodiment of the present invention includes a CPU 12. A RAM 14, a display driving unit 16, and a communication unit 18 are connected to the CPU 12 via a bus 30. A display unit 20 is connected to the display drive unit 16.

  Although not shown, the display device 10 is also provided with a nonvolatile memory such as an HDD or a ROM, and is connected to the CPU 12 via the bus 30.

  The CPU 12 governs overall control of the display device 10. The RAM 14 is used as a work area and a buffer area for the CPU 12.

  The display driving unit 16 is a controller for generating and outputting image data corresponding to an image displayed on the display unit 20. The display unit 20 includes a display panel and a backlight, and outputs image data given from the display driving unit 16.

  The communication unit 18 is an interface for communicating with the external memory 40 or another computer. For example, a wired LAN, RS-232C, USB, DDC / CI (Display Data Channel Command Interface), HDMI-CEC (High Definition Multimedia). Interface Consumer Electronics Control) can be used. As described above, when an SD card, a memory card, a memory stick, or a multimedia card is used as the external memory 40, an interface corresponding to that is provided.

  As described above, the external memory 40 is a USB memory and stores an image file. This image file is data generated in a predetermined file format (for example, JPEG format).

  Although illustration is omitted, the display device 10 has interfaces (DisplayPort, HDMI (registered trademark), DVI, and D-SUB) for inputting video (or image) and audio data provided from another computer. Etc.) are provided.

  In the display device 10 having such a configuration, when the external memory 40 is attached to the display device 10, a slide show that sequentially reads out image data from a plurality of image files stored in the external memory 40 and outputs the image data to the display unit 20. The function can be executed. At this time, the image file is read by the CPU 12. That is, the plurality of image files stored in the external memory 40 are read by the CPU 12 and stored in the RAM 14. Therefore, for example, image files can be classified according to a certain theme (category), and images can be displayed in a slide show for each theme.

  However, when classifying image files, for example, the user creates a folder for each theme in the RAM 14, determines the theme for the image corresponding to the image data included in each image file, and determines the folder of the determined theme. It is necessary to sort (classify) each image file. In other words, it is troublesome for the user to manually sort the image file. Further, such inconvenience appears more markedly as the number of themes and the number of image files stored in the external memory 40 increase.

  In order to avoid such inconvenience, in the first embodiment, the image files stored in the external memory 40 are automatically sorted.

  Briefly, in the first embodiment, attribute information about image data is extracted from an image file, and a theme dictionary for classifying the extracted attribute information and a theme prepared in advance is used. Are determined (determined), and are sorted (stored) in thematic folders. However, if there is no folder to be distributed (not generated), the image file is stored in the created folder after the folder is created. This will be specifically described below.

  3A is an illustrative view showing a data structure of an image file, and FIG. 3B is an illustrative view showing Exif data 52b shown in FIG. 3A. FIG. 4 is an illustrative view showing an example of dictionary data. FIG. 5A is an illustrative view showing an example of data extracted from an image file, and FIG. 5B is an illustrative view showing an example of a score table.

  As shown in FIG. 3A, the image file includes an SOI (start marker) 50, an APP1 (application marker segment 1) 52, image data 54, and an EOI (end marker) 56. However, the file name is given to the image file.

  The image file includes DQI, DHT, SOF, SOS, etc., but the illustration and description thereof are omitted because they are not directly related to the present invention. In addition, for APP1, parentheses are given in the following description in order to show the reference numerals in an easy-to-understand manner.

  The SOI (start marker) 50 is a marker indicating the start of an image file. APP1 (52) is data related to an image file, and includes an APP1 marker 52a, Exif data 52b, thumbnail image data 52c, and the like. However, the thumbnail image data 52c may not be stored.

  The APP1 marker 52a is a marker indicating that the marker segment is APP1. The Exif data 52b is information (general information, shooting information, etc.) related to the image file added when the image file is generated. For example, as shown in FIG. 3B, the Exif data 52b includes the title 100 of the image file (image data) input by the user, the comment 102 about the image file (image data), and the shooting date and time (year) of the image file. Data of image generation date and time 104 for the month (including the month). The thumbnail image data 52 c is reduced image data of the image data 54.

  Although not shown, the Exif data 52b includes data such as GPS (latitude, longitude, altitude), focal length, subject distance, and azimuth at the time of shooting.

  Returning to FIG. 3A, the image data 54 is data about a captured image typically captured by a digital camera. However, other image data may be used as long as the image data is recorded in a file format having a data structure compatible with Exif. An EOI (end marker) 56 is a marker indicating the end of the image file.

  Further, as shown in FIG. 4, information corresponding to each theme is described in the theme dictionary. Specifically, in the theme dictionary, themes, keywords, and image patterns are described corresponding to the numbers.

  In the number column, a number indicating a serial number assigned to each theme is described. This number is assigned to each theme in order for the CPU 12 to refer to the theme dictionary for each theme.

  The name of the theme is described in the theme column. The theme is determined in advance by a developer of a program (information processing program described later) for distributing image files.

  In the keyword column, words related to the theme are described. The keyword is also determined in advance by a developer or the like in the same manner as the theme.

  In the column of the image pattern, information about the feature of the image corresponding to the corresponding theme is described. For example, a Haar-Like feature amount corresponds to the image feature. The Haar-Like feature amount uses a luminance difference between two areas (black region and white region) as a feature amount. That is, the local black-and-white pattern of the sample image corresponding to each theme is described in the image pattern column. However, in the theme dictionary shown in FIG. 4, for the sake of simplicity, the character strings (pattern A, pattern B,...) Are described without describing the specific contents of the image pattern. Hereinafter, the same applies to the image pattern.

  For example, in FIG. 4, “fashion” is described in the theme column, “fashion”, “model”, etc. are described in the keyword column, and “pattern A” is displayed in the image pattern column. Described. Corresponding to the number 2, “Christmas” is described in the theme column, “Christmas”, “Santa Claus”, etc. are described in the keyword column, and “Pattern B” is described in the image pattern column. In addition, about the content described after the number 3, illustration is abbreviate | omitted.

  Here, in many cases, the file name, the title 100, and the comment 102 are not input by the user in the image data of an image taken by a digital camera or the like. In such a case, depending on the main body function of the digital camera, a file name represented by a predetermined alphabet and number (serial number) or a file name represented by a number indicating the shooting date and time (including year and month) is added to the image file. It remains attached. In such a case, it is difficult to determine the theme and distribute the image file.

  Therefore, in the first embodiment, even when the file name is not attached and / or the title 100 and the comment 102 are not input, the image data is included based on the image pattern of the image data. The theme of the image file can be judged as much as possible.

  Next, a method for determining the theme of an image file using the theme dictionary and distributing the image file for each theme will be described.

  First, attribute information about image data is extracted from the image file. As shown in FIG. 5A, in the first embodiment, a file name, a title 100 (Exif title), a comment 102 (Exif comment), and an image pattern (Haar-Like feature) are extracted as attribute information. The That is, the file name attached to the image file is read, and the title 100 and the comment 102 are read from the Exif data 52b. Also, an image pattern (Haar-Like feature value) is acquired (calculated) from the image data 54.

  For example, in FIG. 5A, “Santa Claus fashion show.jpg” is extracted as the file name, “fashion show” is extracted as the Exif title, and “model” is extracted as the Exif comment. Further, “pattern X” is extracted as an image pattern.

  Then, a score is calculated for each theme using the extracted attribute information and the theme dictionary, and the theme having the largest total score is determined (determined) as the theme of the image file. That is, the matching degree between the character string included in the attribute information extracted from the image file and the keyword described for each theme is detected, and the theme having the highest matching degree is determined as the theme of the image file.

  As shown in FIG. 5B, a score is calculated for each theme in the score table. Specifically, the score table is provided with columns for inputting (description) scores for each item of the file name, title, comment, and image pattern corresponding to each theme. The score table also includes a column for inputting a total score obtained by summing up the scores of the respective items corresponding to each theme.

  In the file name column, the score determined using the file name assigned to the image file and the keyword described in correspondence with the theme in the theme dictionary is described. Specifically, it is determined whether the file name includes at least one keyword described corresponding to the theme in the theme dictionary. In the first embodiment, it is determined whether all or a part of the character string excluding the file name extension includes at least one keyword described corresponding to each theme in the theme dictionary. . If the file name includes at least one keyword described corresponding to the theme in the theme dictionary, “1” is described as a score in the file name column. If the file name does not include any keyword described corresponding to the theme in the theme dictionary, “0” is described as the score in the file name column.

  In the title column, the score determined using the Exif title extracted from the image file and the keyword described corresponding to the theme in the theme dictionary is described. Since the method for determining the title score is the same as the method for determining the file name score, a duplicate description is omitted.

  In the comment column, a score determined by using an Exif comment extracted from the image file and a keyword described corresponding to the theme in the theme dictionary is described. The method for determining the comment score is also the same as the method for determining the file name score, and thus a duplicate description is omitted.

  In the image pattern column, a score determined using the image pattern acquired from the image data 54 and the image pattern described in correspondence with the theme in the theme dictionary is described. When determining the score of this image pattern, first, the image pattern acquired from the image data 54 is compared with the image pattern described corresponding to the theme in the theme dictionary, and the matching rate thereof is calculated. The If the coincidence rate is equal to or higher than a predetermined value, “1” is described as a score in the image pattern column. On the other hand, if the matching rate is less than a predetermined value, “0” is described as the score in the image pattern column.

  The total score column describes the sum of scores obtained by adding (summing) the scores described in the file name, title, comment, and image pattern columns for each theme.

  For example, in the score table of FIG. 5, “1” is described in the file name, title, comment, and image pattern fields corresponding to the theme “fashion”. Therefore, in the target image file for which the theme is determined (hereinafter sometimes referred to as “target image file”), the total score for the theme “fashion” is “4”.

  Further, in the score table of FIG. 5, “1” is described in the file name and image pattern columns, and “0” is described in the title and comment columns, respectively, corresponding to the theme “Christmas”. Is done. Therefore, in the target image file, the total score for the theme “Christmas” is “2”.

  In the score table shown in FIG. 5, although the other themes are omitted, as with the themes “fashion” and “Christmas”, scores are determined for each of the file name, title, comment, and image pattern. A total score for is calculated.

  When the total score for each theme is calculated, the theme of the target image file is determined. In the first embodiment, the theme having the maximum total score is determined as the theme of the target image file. When the theme of the image file is determined, the image file is stored (sorted) in a folder in which the theme name is assigned as a folder name. However, in this first embodiment, since the folder is not created in advance, if there is no folder to be stored, after the folder with the file name of the theme determined for the target image file is created, The target image file is stored in the folder. In the first embodiment, the folder is created in the RAM 14.

  However, in the first embodiment, when there are a plurality of themes having the maximum total score, a theme with a high priority set in advance is determined as the theme of the target image file. Alternatively, in the score display, priority (weight) may be set for each item of the file name, title, comment, and image pattern, and the total score considering the weight may be calculated to determine the theme. .

  When the maximum value of the total score is 0, the theme of the target image file cannot be determined. Therefore, such an image file is stored in a folder with “Unknown” as the folder name ( Sort out). Since the “Unknown” folder is not created in advance, it is created in the RAM 14 in the same manner as each theme folder.

  The above operation of the display device 10 is realized by the CPU 12 executing an information processing program stored in the RAM 14. Specific processing will be described later with reference to a flowchart.

  FIG. 6 shows an example of the memory map 300 of the RAM 14 shown in FIG. As shown in FIG. 6, the RAM 14 includes a program storage area 302 and a data storage area 304. The program storage area 302 stores information processing programs including a display control program and a sorting control program. The information processing program includes a display program 310, a decode program 312, a data extraction program 314, a theme determination program 316, a folder creation program 318, a sorting program 320, and the like.

  The display program 310 is a program for displaying an image corresponding to the image data 54 on the display unit 20, and controls the display driving unit 16 to output the image data 54 to the display unit 20.

  The decode program 312 is a program for decoding (reading) the Exif data 52b, the thumbnail image data 52c, and the image data 54 from the image file.

  The data extraction program 314 is a program for extracting a file name given to an image file. Further, the data extraction program 314 obtains the image file title 100, the comment 102 about the image file, and the shooting date and time (including year and month) of the image file (image data 54) from the Exif data 52b decoded according to the decoding program 312. It is also a program for extracting the data of the image generation date / time 104. However, the data extraction program 314 is also a program for extracting (calculating) an image pattern (Haar-Like feature value) from the image data 54.

  The theme determination program 316 is a program for determining a theme for distributing image files. The theme determination program 316 is also a program for creating a score table using extracted data 332 and dictionary data 334, which will be described later.

  The folder creation program 318 is a program for creating a folder in the RAM 14 when there is no folder in the RAM 14 whose folder name is the theme determined according to the theme determination program 316.

  The sorting program 320 is a program for sorting (storing) image files in folders for each theme.

  The data storage area 304 stores a data buffer 330, extracted data 332, dictionary data 334, score data 336, sorting data 338, and the like.

  The data buffer 330 is an area for temporarily storing the image data 54 and the Exif data 52b decoded from the image file in the external memory 40.

  The extracted data 332 is data regarding attribute information extracted from the image file in accordance with the data extraction program 314. Specifically, as shown in FIG. 5A, the extracted data 332 includes an image pattern extracted from the file name attached to the image file, the title 100 included in the image file, the comment 102, and the image data 54. This is data on (Haar-Like feature value).

  The dictionary data 334 is data about the theme dictionary as shown in FIG. The score data 336 is data on a score table created according to the theme determination program 316.

  The sorting data 338 is data on a folder in which image files are sorted (stored) by theme according to the sorting program 320.

  In the data storage area 304, other data necessary for executing the information processing program is stored, and a timer (counter) and a register necessary for executing the information processing program are provided.

  7 to 11 are flowcharts showing the information processing of the CPU 12. When the main power supply of the display device 10 is turned on, as shown in FIG. 7, the CPU 12 determines whether or not the external memory 40 is connected in step S1. If “NO” in the step S1, that is, if the external memory 40 is not connected, the process returns to the step S1 as it is. On the other hand, if “YES” in the step S1, that is, if the external memory 40 is connected, the number (total number) of image files in the external memory 40 is acquired in a step S3.

  In step S5, the maximum value imax of the variable i is set. In step S7, an initial value is set in the variable i (i = 1), and the process proceeds to step S9. However, the variable i is a variable for referring to a plurality of image files stored in the external memory 40 individually (in order). In step S5, the CPU 12 sets the number of image files acquired in step S3 as the maximum value imax of the variable i.

  In step S9, the i-th image data 54 is decoded. In step S <b> 9, the CPU 12 reads the image data 54 from the i-th image file stored in the external memory 40 and stores it in the data buffer 330. For example, the CPU 12 refers to the image file in accordance with the old or new order of dates (including time) stored in the external memory 40.

  In the next step S11, the Exif data 52b is decoded, and in step S13, the file name, the title 100, and the comment 102 are extracted. In this step S13, the CPU 12 reads the Exif data 52b from the image file, stores it in the data buffer 330, extracts the file name attached to the image file, and outputs the title 100 and the comment 102 described in the Exif data 52b. Are extracted and stored in the data storage area 304 as extracted data 332.

  Subsequently, in step S15, the maximum value jmax of the variable j is set. In step S17, an initial value is set in the variable j (j = 1), and the process proceeds to step S19 shown in FIG. However, the variable j is a variable for referring to the theme dictionary corresponding to the dictionary data 334 for each theme. For example, the theme dictionary is referred to according to the numbers shown in the theme dictionary.

  In step S19, it is determined whether or not the file name includes at least one keyword of the jth theme. In step S19, the CPU 12 refers to the dictionary data 334, and even if the character string included in the extracted file name is one of a plurality of keywords described corresponding to the jth theme of the theme dictionary. Determine if there are matching keywords. This determination is the same in steps S23 and S27 described later.

  If “NO” in the step S19, that is, if the file name does not include any keyword of the jth theme, the process proceeds to a step S23 as it is. On the other hand, if “YES” in the step S19, that is, if the file name includes at least one keyword of the jth theme, the score of the jth theme is incremented by 1 in a step S21, and the process proceeds to a step S23. move on. In step S <b> 21, the CPU 12 describes “1” as the score in the file name column for the j-th theme in the score table corresponding to the score data 336, and calculates (updates) the total score. The same applies to the case where 1 is added to the score.

  In step S23, it is determined whether or not the title includes at least one keyword of the jth theme. If “NO” in the step S23, that is, if the title does not include any keyword of the jth theme, the process proceeds to a step S27 shown in FIG. 9 as it is.

  On the other hand, if “YES” in the step S23, that is, if the title includes even one keyword of the jth theme, the score of the jth theme is incremented by 1 in a step S25, and then the process proceeds to the step S27. move on.

  In step S27, it is determined whether or not the comment includes even one keyword of the jth theme. If “NO” in the step S27, that is, if the comment does not include any keyword of the jth theme, the process proceeds to a step S31 as it is. On the other hand, if “YES” in the step S27, that is, if the comment includes even one keyword of the jth theme, the score of the jth theme is incremented by 1 in a step S29, and the process proceeds to the step S31. .

  In step S31, the image pattern of the image data is compared with the image pattern of the jth theme, and in step S33, it is determined whether or not the matching rate between the image pattern of the image data 54 and the image pattern of the jth theme is equal to or greater than a predetermined value. to decide. Here, the CPU 12 compares the image pattern (Haar-Like feature value) included in the extracted data 332 with the image pattern (Haar-Like feature value) of the jth theme in the theme dictionary corresponding to the dictionary data 334. , It is determined whether the coincidence rate of the Haar-Like feature amount is equal to or greater than a predetermined value.

  If “NO” in the step S33, that is, if the matching rate is not equal to or greater than the predetermined value, the process proceeds to a step S37 as it is. On the other hand, if “YES” in the step S33, that is, if the matching rate is equal to or higher than a predetermined value, the score of the jth theme is incremented by 1 in a step S35, and the variable j is set to the maximum value jmax in a step S37. Determine if there is.

  If “NO” in the step S37, that is, if the variable j is not the maximum value jmax, the variable j is incremented in a step S39, and the process returns to the step S19 shown in FIG. That is, the score for the next theme in the theme dictionary, which is the score of the i-th image file (image data 54), is calculated (determined).

  On the other hand, if “YES” in the step S37, that is, if the variable j is the maximum value jmax, it is determined that the scores have been calculated (determined) for all themes, and the score data 336 is determined in a step S41 shown in FIG. In step S43, it is determined whether the maximum value of the total score is zero or not.

  If “NO” in the step S43, that is, if the maximum value of the total score is not 0, the process proceeds to a step S49 shown in FIG. On the other hand, if “YES” in the step S43, that is, if the maximum value of the total score is 0, it is determined whether or not an Unknown folder is created in a step S45. In step S45, the CPU 12 determines whether or not the data of the Unknown folder is included in the sorting data 338 (RAM 14).

  If “YES” in the step S45, that is, if an Unknown folder is created, the process proceeds to a step S59 shown in FIG. On the other hand, if “NO” in the step S45, that is, if the Unknown folder has not been created, the Unknown folder is created in a step S47, and the process proceeds to the step S59.

  As shown in FIG. 11, in step S49, it is determined whether there are a plurality of themes having the highest total score. If “NO” in the step S49, that is, if there is one theme having the highest total score, the theme having the highest total score is determined (determined) as a theme of the i-th image file in a step S51. Proceed to step S55.

  On the other hand, if “YES” in the step S49, that is, if there are a plurality of themes having the highest total score, the theme having the higher priority set in advance is determined as the theme of the i-th image file in a step S53. (Determination), and the process proceeds to step S55.

  In step S55, it is determined whether a folder with the determined theme folder name has been created. In step S55, the CPU 12 determines whether or not the sorting data 338 (RAM 14) includes data of a folder with the determined theme folder name.

  If “YES” in the step S55, that is, if a folder having the determined theme folder name is created, the process proceeds to a step S59 as it is. On the other hand, if “NO” in the step S55, that is, if a folder with the determined theme folder name is not created, a folder with the determined theme folder name is created in a step S57. The process proceeds to step S59. In step S59, the i-th image file is stored in the corresponding theme folder from the external memory 40, and the process proceeds to step S61. Therefore, image files are sorted into folders for each theme.

  In step S61, it is determined whether the variable i is the maximum value imax. If “NO” in the step S61, that is, if the variable i is not the maximum value imax, the variable i is incremented (i = i + 1) in a step S63, and the process returns to the step S9 shown in FIG. That is, for the next image file, a score is calculated using the theme dictionary, and the next image file is sorted into folders by theme. On the other hand, if “YES” in the step S61, that is, if the variable i is the maximum value imax, it is determined that all the image files stored in the external memory 40 are sorted into the thematic folders, and the information processing is ended. To do.

  According to the first embodiment, the theme of the image file is determined (determined), and is distributed (stored) to a folder for each theme, so that the image file stored in the external memory 40 can be automatically sorted. Therefore, for example, if a slide show is executed in units of folders, a plurality of images classified by theme can be displayed as a slide show.

  In the first embodiment, the file name, the title 100, the comment 102, and the image pattern (Haar-Like feature) are used as the attribute information of the image file. However, the present invention is not limited to this. For example, when the user assigns a file name using text characters regardless of the main function of the digital camera, the image file theme can be determined using only the file name.

  Also, for an image file in which the title 100 or / comment 102 is input by the user, the theme of the image file can be determined using the title 100 or / comment 102. Therefore, the theme of the image file can be determined using at least one of the file name, the title 100, and the comment 102.

  Furthermore, in the first embodiment, when there is no folder for the determined theme, the folder is created and the image file is stored. However, the present invention is not limited to this. As another example, when information processing is started, data of folders (including unknown folders) for all themes may be created in the sorting data 338 (RAM 14). In such a case, for example, processing for creating folders for all themes is executed between “YES” in step S1 and step S7, and the processing in steps S45, S47, S55, and S57 is omitted. The

  Furthermore, in the first embodiment, the image file including the image data of the photographed image according to the JPEG format is sorted into the thematic folders, but the present invention is not limited to this. As long as the attribute information (meta information) capable of determining the theme is an image file stored in association with the image data, it can be classified into another format. In such a case, a theme dictionary corresponding to attribute information (meta information) is created, and a score is calculated.

In the first embodiment, the image files are classified into the thematic folders, but the present invention is not limited to this. For example, a character string (theme name or identification information attached to the theme) that can identify the theme may be added to the head of the file name attached to the image file to classify the image file by theme. .
<Second embodiment>
The display device 10 of the second embodiment is the same as the display device 10 of the first embodiment except that the theme determination (determination) method is different when there are a plurality of themes having the largest total score. The contents different from the example will be described, and redundant description will be omitted.

  Specifically, when there are a plurality of themes having the highest total score, the plurality of themes are determined (determined) as the theme of the target image file, and the target images are respectively stored in the folders for the determined plurality of themes. Remember the file.

  Further, since the information processing of the CPU 12 of the second embodiment is the same except that a part of the information processing shown in FIGS. 7 to 11 is different, a duplicate description is omitted. FIG. 12 is a part of information processing of the CPU 12 in the second embodiment and is a flowchart subsequent to FIG. However, the same reference numerals are attached to the same processes as the information processing of the first embodiment.

  As shown in FIG. 12, in the information processing of the CPU 12 shown in FIGS. 7 to 11, the process of step S101 is executed instead of step S53 shown in FIG.

  If the CPU 12 determines “YES” in step S49, it determines (determines) each theme as the theme of the i-th image file in step S101, and proceeds to step S55.

  In the second embodiment, when a plurality of themes are determined in step S101, it is determined in step S55 whether a folder for each of the plurality of themes has been created.

  If “NO” in the step S55, in a step S57, a folder is created for all the themes for which no folder has been created among the plurality of themes.

  Further, when a plurality of themes are determined in step S101, in step S59, the i-th image file is stored in each of the folders for the plurality of themes.

According to the second embodiment, when there are a plurality of themes having the largest total score, each theme is determined as the theme of the image file, and the image file is stored in each of the folders for the determined plurality of themes. Therefore, the image file stored in the external memory 40 can be automatically sorted.
<Third embodiment>
In the display device 10 of the third embodiment, for an image file whose maximum total score is 0, a folder different from the folder for each theme using attribute information other than the file name, the title 100, the comment 102, and the image pattern. Since the display device 10 is the same as the display device 10 of the first embodiment except for the classification, the contents different from those of the first embodiment will be described, and redundant description will be omitted.

  Specifically, when the maximum value of the total score is 0, the theme of the image file cannot be determined. Therefore, the data about the image generation date and time 104 extracted from the Exif data 52b of the image file is used. The image files are classified by date and time. Therefore, in the third embodiment, a plurality of image files generated in the same time zone on the same day (including year and month) are stored in one folder. However, the same time zone means one period when 24 hours (one day) is divided every predetermined time from 0:00. Therefore, when classifying image files by date and time, if there is no folder, a folder with a folder name in a time zone including the image generation date and time 104 is created. For example, in the time zone from 9:00 to 12:00 on April 3, 2015, “20150503-9-12” is added as the folder name.

  In this way, when the theme of the image file cannot be determined, it is highly possible that the shooting location is the same for the same time zone on the same day, and the same subject is shot. This is because it is predicted. That is, as a result, it can be said that image files are classified into the same theme.

  Further, since the information processing of the CPU 12 of the third embodiment is the same except that a part of the information processing shown in FIGS. 7 to 11 is different, a duplicate description is omitted. FIG. 13 is a part of information processing of the CPU 12 in the third embodiment, and is a flowchart subsequent to FIG. Note that the same reference numerals are assigned to the same processes as the information processing of the first embodiment.

  As shown in FIG. 13, in the information processing of the CPU 12 shown in FIGS. 7 to 11, the processes of steps S151, S153, and S155 are executed instead of the steps S45 and S47 shown in FIG.

  Therefore, when it is determined in step S43 that the maximum value of the total score is 0, in step S151, data of the image generation date / time 104 is extracted from the Exif data 52b, and in step S153, the time zone including the image generation date / time 104 is extracted. It is determined whether a folder with the folder name is created. In this step S153, the CPU 12 determines whether or not the sorting data 338 (RAM 14) stores the data of the folder with the folder name in the time zone including the image generation date 104.

  If “YES” in the step S153, that is, if a folder with a folder name in a time zone including the image generation date 104 has been created, the process proceeds to a step S59 as it is. On the other hand, if “NO” in the step S153, that is, if a folder with a folder name in the time zone including the image generation date 104 has not been created, the folder name in the time zone including the image generation date 104 in a step S155. A folder marked with is created, and the process proceeds to step S59.

  However, in the third embodiment, in step S59, the image file having the maximum total score of 0 is stored in a folder with the folder name of the time zone including the image generation date 104 (classification) because the theme is not determined. )

  According to the third embodiment, when the theme of the image file cannot be determined, the image file is stored in a folder classified by time zone, so that the image file stored in the external memory 40 can be automatically sorted. it can.

  In the third embodiment, when image files are classified by date and time, a plurality of image files generated in the same time zone in a day are combined into one file. However, the present invention is not limited to this. There is no. For example, one month may be classified by a predetermined number of days, or one year (12 months) may be classified by a season (for example, four seasons).

  In addition, the specific numerical values and the like given in each of the above-described embodiments are examples, and can be appropriately changed according to the actual product. Moreover, when the same effect is acquired, the order of each step shown to the flowchart may be changed suitably.

10 ... Display device 12 ... CPU
14 ... RAM
16 ... display drive unit 18 ... communication unit 20 ... display unit 40 ... external memory

Claims (10)

A display device that displays an image corresponding to image data included in an image file stored in an external storage medium,
Attribute information extraction means for extracting attribute information about the image file;
A theme dictionary storage means for storing dictionary data corresponding to a theme dictionary in which a plurality of themes for classifying the image files and keywords associated with each of the plurality of themes are described in association with each other;
Theme determination means for determining a theme of the image file based on a degree of matching between a character string included in the attribute information extracted by the attribute information extraction means and a keyword described in the theme dictionary; and the theme determination A display device comprising sorting means for classifying the image files into an internal storage medium classified into the themes determined by the means.   The display device according to claim 1, wherein the attribute information includes a file name of the image file.   The display device according to claim 1, wherein the attribute information includes a title of the image file.   The display device according to claim 1, wherein the attribute information includes a comment of the image file. When the character string included in the attribute information includes the keyword described in the theme dictionary, it further includes score addition means for adding the score of the theme corresponding to the keyword,
The display device according to claim 1, wherein the theme determination unit determines a theme having a maximum score added by the score addition unit as a theme of the image file.   The display device according to claim 5, wherein the theme determination unit determines each of the plurality of themes as the theme of the image file when there are a plurality of themes having the maximum score added by the score addition unit. The attribute information further includes information on the generation date and time of the image file,
The theme determination unit determines a time zone including the generation date and time of the image file when the maximum score added by the score addition unit is 0,
The display device according to claim 5, wherein the sorting unit stores the image file in an internal storage medium classified according to the time zone determined by the theme determination unit. The theme dictionary further stores an image pattern corresponding to each of the plurality of themes,
The attribute information extraction unit further extracts an image pattern from the image data included in the image file,
The score adding means compares the image pattern extracted by the attribute information extracting means with each image pattern corresponding to each theme stored in the theme dictionary, and the matching rate is equal to or higher than a predetermined value. The display device according to claim 1, wherein the scores of the theme corresponding to the image pattern are added. A theme dictionary storage means for storing dictionary data corresponding to a theme dictionary in which a plurality of themes for classifying image files and a keyword related to each of the plurality of themes is described in association with each other is provided. An information processing program for a display device that displays an image corresponding to image data included in a stored image file,
In the processor of the display device,
Attribute information extraction step for extracting attribute information about the image file Based on the degree of match between the character string included in the attribute information extracted in the attribute information extraction step and the keyword described in the theme dictionary An information processing program for executing a theme determining step for determining a theme, and a sorting step for classifying the image file into an internal storage medium by classifying the image into the theme determined in the theme determining step. A theme dictionary storage means for storing dictionary data corresponding to a theme dictionary in which a plurality of themes for classifying image files and a keyword related to each of the plurality of themes is described in association with each other is provided. An information processing method of a display device for displaying an image corresponding to image data included in a stored image file,
(A) extracting attribute information about the image file;
(B) determining the theme of the image file based on the degree of matching between the character string included in the attribute information extracted in the step (a) and the keyword described in the theme dictionary; and (c) the step An information processing method in which the image files are stored in an internal storage medium classified into the themes determined in (b).

Images