JP2018007271A - Image processing device, image processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing system for generating a reduced image easy to recognize.SOLUTION: A diary generation unit 111 generates an illustrated diary. A keyword selection unit 112 includes: a word extraction unit 1121 for extracting a characteristic word from a text included in the illustrated diary; and a keyword comparison unit 1122 for comparing a keyword included in a keyword list 122 stored in a storage unit 120 with the word extracted by the word extraction unit 1121 to select an appropriate keyword. A recognition method selection unit 113 selects a method for image recognition on the basis of the selected keyword. A characteristic image extraction unit 114, using the selected image recognition method, extracts a characteristic image from an image included in the illustrated diary. A characteristic thumbnail image generation unit 115, on the basis of the characteristic image, generates a characteristic thumbnail image. A calendar generation unit 116, using the characteristic thumbnail image, generates a calendar.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an image processing system, an image processing method, and an image processing program.

  2. Description of the Related Art Printing apparatuses that can create printed matter that includes images and text, such as a photo diary and a photo haiku, are laid out. For example, when displaying a diary with photos as a list, the file name of a photo diary created on a calendar, a reduced image of a creation, a mark for each color, and the like may be displayed. When displaying a list of creations, it is preferable to display a reduced image of the creation on the calendar according to the creation date instead of a file name or a mark because the contents of the creation are easily grasped. However, the image may be difficult to see as a result of reducing the image of the product. In particular, when there are a plurality of creations on the same date, the visibility is further increased if the image is further reduced.

  For example, Patent Document 1 discloses a technique for generating a thumbnail image based on image data and assigning the generated thumbnail image to a display area on a calendar image. However, with the technique disclosed in Patent Document 1, the thumbnail images displayed as a list are simply reduced images of the entire image, and when the reduction ratio increases, it is difficult to recognize what image is represented.

  For example, Patent Document 2 discloses a technique for displaying a desired image large enough to be easily searched visually and performing a calendar display having a functional beauty on a display screen with a sense of unity. However, the technique disclosed in Patent Document 2 requires a display screen that is somewhat large.

JP 2006-115126 A JP 2006-135430 A

  As described above, when managing a document including an image, displaying a reduced image of the image included in the document is effective in achieving both grasping of the contents of the document and listability. At this time, the reduced image is desired to be an image that is easily recognized.

  SUMMARY An advantage of some aspects of the invention is that it provides an image processing system, an image processing method, and an image processing program that generate a reduced image that is easily recognized.

To achieve the above object, an aspect of the image processing system according to the present invention includes a keyword selection unit that selects a keyword included in the text of data including an image and text, and a keyword comparison that selects a genre corresponding to the keyword. And an image for recognizing a selected subject image of the genre among the subjects included in the image by image recognition and generating a feature thumbnail image based on the feature image An extraction generation unit.
According to another aspect of the image processing system of the present invention, a keyword selection unit that selects a keyword included in the text of the data including the image and the text, and an image recognition method associated with the keyword based on the keyword. A recognition method selection unit that selects the feature image, and a feature image related to the keyword is extracted from the image based on the image recognition method selected based on the keyword, and a feature thumbnail image based on the feature image An image extraction and generation unit for generating
According to another aspect of the image processing system of the present invention, a keyword selection unit that selects a keyword included in the text of the data including the image and the text, and a feature related to the keyword from the image based on the keyword An image extraction and generation unit that extracts an image and generates a feature thumbnail image based on the feature image, wherein the text includes a heading text and a body text, and the keyword selection unit includes the heading text A headline keyword selection unit for selecting a headline keyword from the text; a body keyword selection unit for selecting a body keyword from the body text; and a relevance for selecting the keyword based on the relevance between the headline keyword and the body keyword And an analysis unit.
According to another aspect of the image processing system of the present invention, a keyword selection unit that selects a keyword included in the text of the data including the image and the text, and a feature related to the keyword from the image based on the keyword An image extraction and generation unit that extracts an image and generates a feature thumbnail image based on the feature image, and the data includes date information and is arranged based on the date information The image forming apparatus further includes a calendar creating unit that creates a calendar including the feature thumbnail image.

In order to achieve the object, one aspect of the image processing method of the present invention is to select a keyword included in the text of the data including the image and the text, to select a genre corresponding to the keyword, Extracting a subject image of the selected genre among the subjects included in the image by recognition as a feature image, and generating a feature thumbnail image based on the feature image. It is characterized by that.
According to another aspect of the image processing method of the present invention, a keyword included in the text of data including an image and text is selected, and an image recognition method associated with the keyword is selected based on the keyword. And extracting a feature image related to the keyword from the image based on the image recognition method selected based on the keyword, and generating a feature thumbnail image based on the feature image , Including.
According to another aspect of the image processing method of the present invention, a keyword included in the text of data including an image and text is selected, and an image recognition method associated with the keyword is selected based on the keyword. And extracting a feature image related to the keyword from the image based on the image recognition method selected based on the keyword, and generating a feature thumbnail image based on the feature image , Including.
According to another aspect of the image processing method of the present invention, a keyword included in the text of the data including the image and the text is selected, and a feature image related to the keyword is selected from the image based on the keyword. Extracting and generating a feature thumbnail image based on the feature image, wherein the text includes heading text and body text, and selecting the keyword is a heading keyword from the heading text , Selecting a body keyword from the body text, and selecting the keyword based on the relevance between the heading keyword and the body keyword.
According to another aspect of the image processing method of the present invention, a keyword included in the text of the data including the image and the text is selected, and a feature image related to the keyword is selected from the image based on the keyword. Extracting and generating a feature thumbnail image based on the feature image, wherein the data includes date information and includes the feature thumbnail image arranged based on the date information The method further includes creating a calendar.

To achieve the object, one aspect of the image processing program of the present invention is to select a keyword included in the text of the data including the image and the text, select a genre corresponding to the keyword, Extracting a subject image of the selected genre from among the subjects included in the image as a feature image by recognition, and generating a feature thumbnail image based on the feature image; It is made to perform.
According to another aspect of the image processing program of the present invention, a keyword included in the text of the data including the image and the text is selected, and an image recognition method associated with the keyword is selected based on the keyword. And extracting a feature image related to the keyword from the image based on the image recognition method selected based on the keyword, and generating a feature thumbnail image based on the feature image Are executed by a computer.

  According to the present invention, it is possible to provide an image processing system, an image processing method, and an image processing program that generate a reduced image that is easily recognized.

1 is a perspective view illustrating an outline of an appearance of an example of a printing apparatus according to an embodiment. 1 is a block diagram illustrating an outline of a configuration of a printing apparatus according to an embodiment. The figure which shows an example of the diary with a photograph produced with the printing apparatus which concerns on one Embodiment. The figure which shows an example of the calendar produced by the printing apparatus which concerns on one Embodiment. 6 is a flowchart illustrating an example of a photo diary management process performed by the printing apparatus according to the embodiment. The figure which shows an example of the edit screen of the diary with a photograph by the printing apparatus which concerns on one Embodiment. The figure which shows an example of the diary with a photograph produced with the printing apparatus which concerns on one Embodiment. The figure which shows an example of the diary with a photograph produced with the printing apparatus which concerns on one Embodiment. The figure which shows an example of the diary with a photograph produced with the printing apparatus which concerns on one Embodiment. 6 is a flowchart illustrating an example of feature thumbnail image generation processing by the printing apparatus according to the embodiment. FIG. 3 is a diagram illustrating an example of a keyword list included in a printing apparatus according to an embodiment. The figure for demonstrating extraction of the feature image by the printing apparatus which concerns on one Embodiment. The figure for demonstrating extraction of the feature image by the printing apparatus which concerns on one Embodiment. The figure for demonstrating extraction of the feature image by the printing apparatus which concerns on one Embodiment. 6 is a flowchart illustrating an example of a calendar list display process performed by the printing apparatus according to the embodiment. The figure which shows an example of the calendar produced by the printing apparatus which concerns on one Embodiment.

  An embodiment of the present invention will be described with reference to the drawings. An outline of the appearance of the printing apparatus 100 according to the present embodiment is shown in FIG. The printing apparatus 100 is a printing apparatus that creates a document design such as a diary or a postcard and prints the diary or postcard of the created design. According to the printing apparatus 100, design creation, management, printing, and the like of a diary can be performed with a single machine. As shown in FIG. 1, the printing apparatus 100 includes a box-shaped housing 192 as a main body, a display panel 194, and a keyboard 150.

  The keyboard 150 is disposed in front of the housing 192. The keyboard 150 is mounted so that the keyboard 150 rotates with respect to the housing 192 by an attachment shaft 152 provided in the vicinity of the lower front end of the housing 192. The keyboard 150 is tilted forward as shown in FIG. 1 when used, and stored in a state facing the front surface of the housing 192 when not used.

  The display panel 194 is provided on the top surface of the housing 192. The display panel 194 includes a display unit 130 including, for example, a liquid crystal display element, and a touch panel 140 provided on the display surface of the display unit 130. The display unit 130 displays images such as a diary and a calendar to be printed and various images such as a menu screen. The touch panel 140 detects the position of contact with a stylus pen, a user's finger, or the like. The display panel 194 is also provided with an audio output unit 160 including a speaker.

  The display panel 194 is rotatably attached to the front end of the upper surface of the housing 192 by a support shaft (not shown) at the front end. In a state where the printing apparatus 100 is used, the inclination angle of the display panel 194 with respect to the upper surface of the housing 192 can be adjusted to a free angle. In a state where the printing apparatus 100 is not used, the display panel 194 is parallel to the upper surface of the housing 192.

  A mechanism for performing printing is provided in the housing. A supply port 174 through which printing paper is supplied is provided on the upper surface of the housing 192. On the front surface of the housing 192, a paper discharge port 172 is provided through which a print sheet on which printing or photo printing has been completed is discharged.

  In addition, a plurality of types of storage medium insertion ports 182 into which a portable storage medium is inserted are provided on the front surface of the housing 192. The printing apparatus 100 includes the storage medium insertion port 182 so that image data of a photograph taken with a digital camera can be taken from a portable storage medium. Further, the printing apparatus 100 can store the edited data in a portable storage medium. Further, the printing apparatus 100 is provided with an ink cartridge replacement port 176 in which an ink cartridge for printing is installed.

  The casing 192 is provided with a U-shaped handle 196. The handle 196 is attached so as to be rotatable between the rear side of the housing 192 and the top of the housing 192. The handle 196 is gripped and used when the printing apparatus 100 is transported.

  A schematic configuration example of the printing apparatus 100 is shown in a block diagram of FIG. As shown in this figure, the printing apparatus 100 includes an image processing control unit 110. The image processing control unit 110 has a CPU, for example. The image processing control unit 110 performs various calculations according to the control program, and controls each unit of the printing apparatus 100. The image processing control unit 110 performs a photo diary management process described later and image processing included in this process. A storage unit 120 is connected to the image processing control unit 110. The storage unit 120 includes a ROM, a RAM, and the like. For example, a control program is recorded in the ROM. The ROM stores, for example, character fonts and print font data used when editing a document, standard data of printing paper to be edited, other control programs, and the like. Other programs include, for example, a print data generation program that converts image data into print data, a print control program that controls a print head and the like in accordance with the print data, and the like. The RAM is used as a work memory, for example. In addition, the storage unit 120 stores a keyword list 122 including keywords to be described later.

  A display control unit 132 is connected to the image processing control unit 110. The display control unit 132 controls the operation of the display unit 130 under the control of the image processing control unit 110 and causes the display unit 130 to display various images. In addition, a touch panel control unit 142 is connected to the image processing control unit 110. The touch panel control unit 142 controls the operation of the touch panel 140 under the control of the image processing control unit 110. The touch panel control unit 142 acquires the position of the touch on the touch panel 140 by the user and outputs the position to the image processing control unit 110. In addition, a keyboard 150 is connected to the image processing control unit 110, and input by the user is performed on the image processing control unit 110 through the keyboard 150.

  An audio output unit 160 is connected to the image processing control unit 110. The sound output unit 160 outputs sound under the control of the image processing control unit 110. Further, a printing unit 170 is connected to the image processing control unit 110. The printing unit 170 prints, for example, a photo diary, a calendar, or a postcard under the control of the image processing control unit 110. A storage medium connection unit 180 is connected to the image processing control unit 110. A portable storage medium 184 is connected to the storage medium connection unit 180, and data is read from the portable storage medium 184 and data is written to the portable storage medium 184.

  The printing apparatus 100 according to the present embodiment has a function for creating and managing a photo diary as a document. According to the printing apparatus 100, the user can easily create a diary 910 with photos as shown in FIG. The photo diary 910 includes, for example, a heading 912, an image 914, and a text 916. In order to manage the created diary with photos, the printing apparatus 100 creates a calendar 920 as shown in FIG. A feature thumbnail image 922 is inserted into the calendar 920 in accordance with the created photo diary. This feature thumbnail image 922 is inserted at a position associated with the date of the created photo diary 910. The feature thumbnail image 922 is a part of the image 914 included in the photo diary 910 and is an image that well represents the contents of the created photo diary 910.

  In order to create and manage such a diary with photos, the image processing control unit 110, as shown in FIG. 2, includes a diary creation unit 111, a keyword selection unit 112, a recognition method selection unit 113, and a feature image. An extraction unit 114, a feature thumbnail image generation unit 115, and a calendar creation unit 116 are included. The diary creation unit 111 performs various arithmetic processes for creating a photo diary as shown in FIG. 3 in accordance with a user instruction.

  The keyword selection unit 112 includes a word extraction unit 1121, a keyword comparison unit 1122, a headline keyword selection unit 1123, a body keyword selection unit 1124, and a relevance analysis unit 1125. The word extraction unit 1121 extracts characteristic words from the texts included in the headline and the body included in the diary with photos. The keyword comparison unit 1122 compares the keywords included in the keyword list 122 stored in the storage unit 120 with the words extracted by the word extraction unit 1121, and selects an appropriate keyword from the extracted words. Also, the headline keyword selection unit 1123 compares the keywords included in the keyword list 122 with the words extracted from the headlines, and selects an appropriate headline keyword from the words extracted from the headlines. The text keyword selection unit 1124 compares the keywords included in the keyword list 122 with the words extracted from the text, and selects an appropriate text keyword from the words extracted from the text. The relevance analysis unit 1125 analyzes the relevance between the headline keyword and the text keyword, and selects an appropriate keyword from the headline keyword and the text keyword.

  The recognition method selection unit 113 selects an image recognition method based on the keyword selected by the keyword selection unit 112. The feature image extraction unit 114 extracts a feature image related to the keyword from the images included in the diary with photos using the image recognition method selected by the recognition method selection unit 113. The feature thumbnail image generation unit 115 generates a feature thumbnail image that is a reduced image of the feature image and is used for calendar display based on the feature image.

  The calendar creation unit 116 creates a calendar as shown in FIG. 4 using the feature thumbnail image created by the feature thumbnail image generation unit 115. A plurality of photo diaries as shown in FIG. 3 may be created on the same day. For this reason, the calendar creation unit 116 includes a same-day diary number determination unit 1161 and a size change unit 1162. That is, the same-day diary number determination unit 1161 determines the number of diaries created on the same day. The size changing unit 1162 resizes the feature thumbnail image so that the feature thumbnail image fits in the date frame of the calendar, that is, suitable for calendar display, according to the number of diaries created on the same day.

  The printing apparatus 100 according to the present embodiment has a function for creating and managing a photo diary. The main process of the photo diary management process related to the photo diary will be described with reference to the flowchart shown in FIG.

  In step S101, the image processing control unit 110 determines whether to newly create a diary with photos. That is, the image processing control unit 110 displays a menu screen on the display unit 130, for example, and determines whether or not a new creation of a photo diary is selected. When it is determined that new creation has not been selected, the process proceeds to step S104. On the other hand, when it is determined that new creation has been selected, the process proceeds to step S102. In step S102, the image processing control unit 110 performs photo diary creation processing. In the diary creation process with photos, the image processing control unit 110 creates a diary with photos desired by the user in accordance with input from the touch panel 140 or the keyboard 150 by the user. The photo diary according to the present embodiment includes, for example, a headline text, an image, and a body text. An example of an edit screen including an example of a photo diary layout is shown in FIG. For example, an image as shown in FIG. 6 is displayed on the display unit 130. The user touches the operation panel 220 to input via the touch panel 140 disposed on the display unit 130. Further, the user can perform input using the keyboard 150. The user creates a diary 210 with photos using these input means. The photo diary 210 includes, for example, a “headline text” area 211, an “image” area 212, and a “body text” area 213.

  In the photo diary creation process, for example, the user selects the “image” area 212. At this time, the image processing control unit 110 displays the image file stored in the storage unit 120 or the portable storage medium 184 on the display unit 130 and prompts the user to select an image. The image processing control unit 110 acquires an input from the user to the touch panel 140 or the keyboard 150 and inserts the selected image into the “image” area 212. At this time, the image processing control unit 110 may perform trimming of an image to be inserted in accordance with an input from the user.

  For example, when the user selects the “Heading text” area 211, the text entered in the “Heading text” area 211 is inserted in response to subsequent input to the touch panel 140 or the keyboard 150 by the user. In this column, for example, the title of the photo diary being edited is inserted.

  Similarly, for example, when the user selects the “body text” area 213, the text entered in the “body text” area 213 is inserted in response to subsequent input to the touch panel 140 or the keyboard 150 by the user. In the “body text” area 213, for example, a free sentence by the user such as an explanation or impression about the image is inserted. Further, date information input by the user or determined according to the creation date is added to the diary with photos.

  By the photo diary creation processing, for example, photo diaries as shown in FIGS. 7, 8, and 9 are created. The image processing control unit 110 stores such photo diary data in the storage unit 120 as “diary data”. This diary data is displayed in a calendar list based on the date. In the calendar list display, thumbnail images of images included in the “image” area 212 of each diary data are displayed on the calendar. In the present embodiment, as a thumbnail display in the calendar list display, a “feature thumbnail image” that is a part of the registered image and well represents the contents of each diary data is displayed on the calendar.

  Hereinafter, for the sake of explanation, an example of the diary data shown in FIG. 7 is referred to as first diary data, an example of the diary data shown in FIG. 8 is referred to as second diary data, and the diary data shown in FIG. One example will be referred to as third diary data.

  When the photo diary creation process in step S102 ends, the process proceeds to step S103. That is, every time one diary data is created, the process proceeds to step S103. In step S103, the image processing control unit 110 performs a feature thumbnail image generation process for generating a feature thumbnail image displayed in the calendar list display. The feature thumbnail image generation processing will be described with reference to the flowchart shown in FIG.

  In step S201, the image processing control unit 110 initializes the RAM area of the storage unit 120. In step S202, the image processing control unit 110 extracts a characteristic word from the “body text” of the created diary data. For example, words such as “Saturday”, “Rina”, “rape”, and “park” are extracted from the first diary data. For example, words such as “shutter”, “clear sky”, and “mountain” are extracted from the second diary data. For example, words such as “summer”, “neighborhood”, and “sunflower” are extracted from the third diary data.

  In step S203, the image processing control unit 110 compares the word extracted in step S202 with a keyword included in a keyword list prepared in advance. An example of the keyword list is shown in FIG. As shown in this figure, in the keyword list, keywords that are often subjects, words that are related to the subject, and the like are set as keywords. In addition to those shown in FIG. 11, words related to nature, words related to the names of organisms such as “birds” and “dogs” can also be keywords. In addition, a related genre is set for each keyword. The genre includes, for example, “people”, “landscape”, “flowers” and the like. This keyword list may be set in advance, may be updated based on the extracted word, or may be added or deleted by the user.

  In step S204, the image processing control unit 110 determines whether or not the extracted word matches the word included in the keyword list. When it is determined that the extracted word matches the word included in the keyword list, the process proceeds to step S205. For example, in the first diary data, it is determined that the words “Rina”, “rape”, and “park” match. For example, in the second diary data, it is determined that the words “sunny” and “mountain” match. For example, in the third diary data, it is determined that the word “sunflower” matches. In step S <b> 205, the image processing control unit 110 causes the storage unit 120 to store the word determined to be matched as the body keyword of the image recognition keyword.

  In step S206, the image processing control unit 110 determines whether there are a plurality of body keywords. If it is determined that there are a plurality of body keywords, the process proceeds to step S208. On the other hand, when it is determined that there are not a plurality of body keywords, that is, when it is determined that there is one body keyword, the process proceeds to step S207. In step S207, the image processing control unit 110 stores the genre corresponding to the text keyword in the storage unit 120 as a recognition genre used for subsequent image recognition. Thereafter, the process proceeds to step S215.

  In step S <b> 208, the image processing control unit 110 extracts words from “headline text” of the diary data. For example, words such as “grandchild” and “holiday” are extracted from the first diary data. For example, a word such as “superb view” is extracted from the second diary data. For example, words such as “summer” are extracted from the third diary data.

  In step S209, the image processing control unit 110 compares the word extracted in step S208 with the keyword list. In step S210, the image processing control unit 110 determines whether or not the word extracted in step S207 matches the word included in the keyword list. If it is determined that they match, the process proceeds to step S212. On the other hand, when it is determined that the extracted word does not match the word included in the keyword list, the process proceeds to step S211.

  For example, in the first diary data, it is determined that the word “grandchild” matches. For example, in the second diary data, it is determined that the word “superb view” matches. For example, it is determined that there is no matching word in the third diary data.

  In step S211, the image processing control unit 110 determines a recognition genre based on the text keyword stored in the storage unit 120 in step S205. Here, since there are a plurality of text keywords, the genre is determined according to the following rules. When all genres of a plurality of text keywords are common, the genre is set as a recognized genre. When there are a plurality of different genres with respect to the genres of the plurality of body keywords, and the number of each genre is the same (for example, one “person” and one “landscape”, etc.), Prioritize “person” as the recognition genre. When the number of each genre is different (for example, when there are one “person” and two “landscapes”), a genre with a large number (for example, “landscape”) is given priority as a recognition genre. Thereafter, the process proceeds to step S215.

  In step S212, the image processing control unit 110 causes the storage unit 120 to store a word that matches the word included in the keyword list as a headline keyword of the image recognition keyword. In step S213, the image processing control unit 110 analyzes the relevance between the text keyword stored in step S205 and the headline keyword stored in step S212, and determines the keyword that seems to have the highest relevance. The relevance is determined by comparing the genres, and keywords having the same genre are evaluated as having high relevance. If there are a plurality of headline keywords stored in step S212 and the genres are different, a plurality of keywords are evaluated that are highly relevant.

  For example, in the first diary data, the text keywords stored in step S205 are “Rina (people)”, “rape (flowers)”, and “park (place)”, and the headline keywords stored in step S212 are “grandchildren”. (Person) ", and since the genre of" grandchild "is person," Rina "is determined to be the most relevant keyword. For example, in the second diary data, the text keywords stored in step S205 are “fine weather (landscape)” and “mountain (landscape)”, and the headline keyword stored in step S212 is “superb view (landscape)”. Therefore, since the genres of “sunny” and “mountain” are landscapes, both “sunny” and “mountain” are determined to be highly relevant keywords.

  In step S214, the image processing control unit 110 causes the storage unit 120 to store the keyword genre determined to be highly relevant in step S213 as a recognized genre. When all genres are common, the genre is set as a recognition genre. When there are a plurality of different genres and the number of keywords corresponding to each genre is the same (for example, when there is one “person” and one “landscape”, etc.), priority is given to “person”. “Person” is the recognition genre. When the number of keywords corresponding to each genre is different (for example, when there are one “person” and two “landscapes”), the genre with the larger number (for example, “landscape”) is given priority as the recognized genre. To do. Thereafter, the process proceeds to step S215.

  In step S215, the image processing control unit 110 sets an image recognition method based on the recognition genre determined and stored in step S207, step S211 or step S214. For example, when the recognition genre is “person”, face recognition is the image recognition method. When the recognition genre is “landscape”, landscape recognition is the image recognition method. When the recognition genre is “flower”, flower recognition is the image recognition method.

  In step S216, the image processing control unit 110 performs image recognition processing based on the image recognition method set in step S215. For example, in the first diary data, since the recognition genre is “person”, the face recognition process is performed. For example, in the second diary data, since the recognition genre is “landscape”, landscape recognition processing is performed. For example, in the third diary data, since the recognition genre is “flower”, the flower recognition process is performed.

  In step S217, the image processing control unit 110 trims the image recognized in step S216 with a display aspect ratio for the feature thumbnail image used for calendar list display. For example, in the first diary data, a human face is trimmed as shown in FIG. When the image includes a plurality of faces, a predetermined face may be selected based on the face data stored in the storage unit 120, or a plurality of faces may be presented to the user. It may be configured to be selected by the user, or may be configured to arrange a plurality of faces. In the second diary data, the landscape is trimmed as shown in FIG. In the case of a landscape, the thumbnail image may be created for the entire image without being trimmed. In the third diary data, flowers are trimmed as shown in FIG. In step S218, the image processing control unit 110 resizes the image trimmed in step S217 to a display size, and generates a feature thumbnail image. Thereafter, the process proceeds to step S220.

  If it is determined in step S204 that the extracted word does not match the keyword in the keyword list, the process proceeds to step S219. In step S 219, the image processing control unit 110 generates a thumbnail image of the entire image inserted in the “image” area 212. Thereafter, the process proceeds to step S220. In step S204, when it is determined that the extracted word does not match the keyword in the keyword list, the user may be inquired whether to add the extracted word to the keyword list. When the user desires to add a keyword list, the keyword list is edited based on the extracted words.

  In step S220, the image processing control unit 110 causes the storage unit 120 to store the feature thumbnail image generated in step S218 or the thumbnail image generated in step S219 as a thumbnail image of the diary data. Thereafter, the feature thumbnail image generation process ends, and the process returns to the main flow described with reference to FIG.

  In the above-described feature thumbnail image generation process, an example is shown in which one thumbnail image is generated for each diary data, but the present invention is not limited to this. For example, a plurality of thumbnail images may be generated. A plurality of thumbnail images may be generated and presented to the user, and the thumbnail images selected by the user may be stored.

  After the feature thumbnail image generation process, the image processing control unit 110 displays a menu screen on the display unit 130, and the process proceeds to step S104. In step S104, the image processing control unit 110 determines whether calendar list display has been selected. If it is determined that the calendar list display is not selected, the process proceeds to step S114. On the other hand, when it is determined that the calendar list display has been selected, the process proceeds to step S105. In step S105, the image processing control unit 110 performs a calendar list display process. The calendar list display process will be described with reference to the flowchart shown in FIG.

  In step S301, the image processing control unit 110 initializes a RAM area. In step S <b> 302, the image processing control unit 110 reads date information of diary data stored in the storage unit 120. In step S303, the image processing control unit 110 updates a reading counter representing a thumbnail image to be read.

  In step S304, the image processing control unit 110 determines whether there is a thumbnail image to be read. When there is no thumbnail image to be read, the calendar list display process ends, and the process returns to the main flow described with reference to FIG. On the other hand, when there is a thumbnail image to be read, the process proceeds to step S305.

  In step S305, the image processing control unit 110 determines whether there are a plurality of thumbnail images to be displayed on the same day. When it is determined that there are not a plurality, the process proceeds to step S306. In step S306, the image processing control unit 110 sets the display size of the thumbnail image to the size for one sheet. This single sheet size is, for example, a size set by default. Thereafter, the process proceeds to step S308.

  If it is determined in step S305 that there are a plurality of thumbnail images to be displayed, the process proceeds to step S307. In step S307, the image processing control unit 110 calculates the display size of the thumbnail images according to the number of thumbnail images to be displayed on the same day and the size of the display area. Thereafter, the process proceeds to step S308.

  In step S <b> 308, the image processing control unit 110 reads a thumbnail image stored from the storage unit 120. In step S309, the image processing control unit 110 resizes the thumbnail image read in step S308 based on the thumbnail size set in step S306 or step S307, and inserts and displays the thumbnail image on the calendar. Thereafter, the process returns to step S303.

  By the above calendar list display processing, for example, a calendar list display as shown in FIG. 16 is performed. That is, a thumbnail image that well represents the diary data is displayed at a position corresponding to the date of the diary data in the calendar.

  Returning to FIG. 5, the main flow will be described. After the calendar list display process in step S105, the process proceeds to step S106. In step S106, the image processing control unit 110 determines whether or not calendar printing has been selected. If it is determined that calendar printing has not been selected, the process proceeds to step S108. On the other hand, when it is determined that calendar printing has been selected, the process proceeds to step S107. In step S107, the image processing control unit 110 performs a calendar printing process. That is, the image processing control unit 110 causes the printing unit 170 to print a calendar displayed on the display unit 130 as shown in FIG. 16, for example.

  In step S <b> 108, the image processing control unit 110 determines whether or not a photo diary is selected by displaying a calendar list. For example, in the calendar as shown in FIG. 16, when the touch panel 140 detects that the feature thumbnail image has been touched, it is determined that the diary with photos corresponding to the feature thumbnail image has been selected. When it is determined that the photo diary is not selected and the calendar list display is completed, the image processing control unit 110 displays a menu screen on the display unit 130, and the process proceeds to step S114. On the other hand, when it is determined in step S108 that a photo diary has been selected, the process proceeds to step S109.

  In step S109, the image processing control unit 110 causes the display unit 130 to display the selected photo diary. In step S110, the image processing control unit 110 determines whether or not diary editing has been selected. If it is determined that diary editing has not been selected, the process proceeds to step S112. On the other hand, when it is determined that diary editing has been selected, the process proceeds to step S111. In step S111, the image processing control unit 110 performs diary editing processing. That is, the image processing control unit 110 displays the selected photo diary on the diary editing screen as shown in FIG. 6 and allows the user to edit the photo diary. After the diary editing process, the process proceeds to step S112.

  In step S <b> 112, the image processing control unit 110 determines whether printing of a photo diary is selected. When it is determined that printing of a diary with a photo is not selected, and when the end of diary display is selected, the image processing control unit 110 displays a menu screen on the display unit 130, and the processing is step S114. Proceed to On the other hand, when it is determined that printing of a photo diary is selected, the process proceeds to step S113. In step S113, the image processing control unit 110 causes the printing unit 170 to print the selected photo diary. When the diary display end is selected after the photo diary is printed, the image processing control unit 110 displays a menu screen on the display unit 130, and the process proceeds to step S114.

  In step S114, the image processing control unit 110 determines whether editing of the keyword list has been selected. If it is determined that editing of the keyword list has not been selected, the process proceeds to step S116. On the other hand, when it is determined that editing of the keyword list has been selected, the process proceeds to step S115. In step S115, the image processing control unit 110 performs a keyword list editing process. In other words, the image processing control unit 110 displays the keyword list on the display unit 130 and edits the keyword according to the input from the user. Thereafter, the process proceeds to step S116. In step S116, the image processing control unit 110 determines whether or not the end of the photo diary management process is selected. When it is determined that the end is not selected, the process returns to step S101. On the other hand, when it is determined that the end is selected, the photo diary management process ends.

  According to this embodiment, in managing a photo diary as a document including images and text, a feature thumbnail image is displayed on the calendar, so the presence or absence and number of diary data recorded for each date are clearly indicated. Is done. Here, since the reduced image of the feature image that well represents the contents of the diary data is displayed as the feature thumbnail image, the displayed image is more distinguishable than the original thumbnail image. Excellent. In addition, when a plurality of characteristic thumbnail images are displayed on the same day, the image size is appropriately adjusted and the layout is improved. The calendar list display as described above is excellent in listability and identification, and is convenient for searching diary data. In the present embodiment, such a calendar list excellent in listability and distinguishability is created without various settings by the user.

  In addition, an appropriate keyword can be easily selected from the text by using the keyword list in determining the keyword. Furthermore, by updating this keyword list, keywords can be selected more appropriately. In addition, the accuracy of keyword selection is improved by comparing the heading text and the body text when determining the keyword. In the present embodiment, a feature image associated with a keyword can be selected by selecting an image recognition method associated with the keyword.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, even if some constituent elements are deleted from all the constituent elements shown in the embodiment, the problem described in the column of problems to be solved by the invention can be solved and the effect of the invention can be obtained. The configuration in which this component is deleted can also be extracted as an invention. Furthermore, constituent elements over different embodiments may be appropriately combined.

Hereinafter, the invention described in the scope of claims of the present application will be appended.
[1]
A keyword selection unit for selecting a keyword included in the text of the data including the image and the text;
An image extraction generation unit that extracts a feature image related to the keyword from the image based on the keyword, and generates a feature thumbnail image based on the feature image;
Comprising
An image processing system characterized by that.

[2]
The image extraction generation unit
A feature image extraction unit that extracts the feature image related to the keyword from the image based on the keyword;
A feature thumbnail image generation unit that generates the feature thumbnail image, which is a reduced image of the feature image, based on the feature image;
Having
[1] The image processing system according to [1].

[3]
The keyword is associated with an image recognition method,
A recognition method selection unit that selects the image recognition method based on the keyword;
The feature image extraction unit extracts the feature image from the image based on the selected image recognition method;
[2] The image processing system according to [2].

[4]
A storage unit for storing a keyword list including a plurality of the keywords;
The keyword selection unit includes a word extraction unit that extracts words from the text;
A keyword comparison unit that selects the keyword by comparing the extracted word with the keyword list;
Comprising
The image processing system according to any one of [1] to [3], wherein:

[5]
The text includes heading text and body text,
The keyword selection unit
A headline keyword selection unit for selecting a headline keyword from the headline text;
A body keyword selection unit for selecting a body keyword from the body text;
A relevance analysis unit that selects the keyword based on the relevance between the headline keyword and the text keyword;
Comprising
The image processing system according to any one of [1] to [4], wherein:

[6]
The data has date information;
A calendar creation unit for creating a calendar including the feature thumbnail images arranged based on the date information;
The image processing system according to any one of [1] to [5], wherein:

[7]
The calendar creation unit
The same day data number determination unit for determining the same day data number which is the number of the data having the same date;
A size changing unit for changing the size of the feature thumbnail image to create a resized feature thumbnail image based on the number of data of the same day;
With
Creating the calendar using the resized feature thumbnail image;
[6] The image processing system according to [6].

[8]
Selecting a keyword contained in the text of the data containing the image and text,
Extracting a feature image related to the keyword from the image based on the keyword, and generating a feature thumbnail image based on the feature image;
Comprising
An image processing method.

[9]
Selecting a keyword contained in the text of the data containing the image and text,
Extracting a feature image related to the keyword from the image based on the keyword, and generating a feature thumbnail image based on the feature image;
To run on a computer,
An image processing program characterized by that.

DESCRIPTION OF SYMBOLS 100 ... Printing apparatus, 110 ... Image processing control part, 111 ... Diary preparation part, 112 ... Keyword selection part, 1121 ... Word extraction part, 1122 ... Keyword comparison part, 1123 ... Keyword selection part, 1124 ... Text keyword selection part, 1125 ... relevance analysis unit, 113 ... recognition method selection unit, 114 ... feature image extraction unit, 115 ... feature thumbnail image generation unit, 116 ... calendar creation unit, 1161 ... same day diary number determination unit, 1162 ... size change unit, 120 ... Storage unit 122 ... Keyword list 130 ... Display unit 132 ... Display control unit 140 ... Touch panel 142 ... Touch panel control unit 150 ... Keyboard 152 ... Mounting shaft 160 ... Speaker 170 ... Printing unit 172 ... Exhaust Paper port, 174 ... supply port, 176 ... ink cartridge replacement port, 180 ... storage medium connection , 182 ... Storage medium insertion slot, 184 ... Portable storage medium, 192 ... Housing, 194 ... Display panel, 196 ... Handle, 910 ... Diary with pictures, 912 ... Headings, 914 ... Images, 916 ... Text, 920 ... Calendar 922 ... Feature thumbnail image.

The present invention relates to an image processing apparatus, an image processing method及beauty program.

An object of the present invention is to extract or recognize feature images that are easily recognized .

The present invention provides an acquisition unit that detects and acquires a specific keyword from data associated with an image , a selection unit that selects a genre corresponding to the specific keyword acquired by the acquisition unit, and the selection unit. the engagement Ru feature images in the selected genre, characterized by comprising a extraction means for extracting from the image.
Claim 5, selection means for selecting an acquisition unit configured to acquire detect certain keyword from among the data associated with the image, the image recognition method associated with a particular keyword acquired by the acquisition unit, based on the image recognition method selected by the selecting means, and recognizing means for recognizing the image or al characteristic images, characterized by comprising a.

According to the present invention, feature images that are easily recognized can be extracted or recognized .

Claims (11)

A keyword selection unit for selecting a keyword included in the text of the data including the image and the text;
A keyword comparison unit for selecting a genre corresponding to the keyword;
An image extraction and generation unit that extracts an image of a subject related to the selected genre among the subjects included in the image as a feature image by image recognition, and generates a feature thumbnail image based on the feature image When,
An image processing system comprising: A keyword selection unit for selecting a keyword included in the text of the data including the image and the text;
A recognition method selection unit that selects an image recognition method associated with the keyword based on the keyword;
Based on the image recognition method selected based on the keyword, an image extraction generation unit that extracts a feature image related to the keyword from the image and generates a feature thumbnail image based on the feature image;
An image processing system comprising: A keyword selection unit for selecting a keyword included in the text of the data including the image and the text;
An image extraction generation unit that extracts a feature image related to the keyword from the image based on the keyword, and generates a feature thumbnail image based on the feature image;
Comprising
The text includes heading text and body text,
The keyword selection unit
A headline keyword selection unit for selecting a headline keyword from the headline text;
A body keyword selection unit for selecting a body keyword from the body text;
A relevance analysis unit that selects the keyword based on the relevance between the headline keyword and the text keyword;
Comprising
Image processing system. A keyword selection unit for selecting a keyword included in the text of the data including the image and the text;
An image extraction generation unit that extracts a feature image related to the keyword from the image based on the keyword, and generates a feature thumbnail image based on the feature image;
Comprising
The data has date information;
A calendar creation unit for creating a calendar including the feature thumbnail images arranged based on the date information;
Image processing system. The calendar creation unit
The same day data number determination unit for determining the same day data number which is the number of the data having the same date;
A size changing unit for changing the size of the feature thumbnail image to create a resized feature thumbnail image based on the number of data of the same day;
With
Creating the calendar using the resized feature thumbnail image;
The image processing system according to claim 4. Selecting a keyword contained in the text of the data containing the image and text,
Selecting a genre corresponding to the keyword;
Extracting the image of the subject related to the selected genre among the subjects included in the image as a feature image by image recognition, and generating a feature thumbnail image based on the feature image;
An image processing method including: Selecting a keyword contained in the text of the data containing the image and text,
Selecting a genre corresponding to the keyword;
Extracting the image of the subject related to the selected genre among the subjects included in the image as a feature image by image recognition, and generating a feature thumbnail image based on the feature image;
An image processing program for causing a computer to execute. Selecting a keyword contained in the text of the data containing the image and text,
Selecting an image recognition method associated with the keyword based on the keyword;
Extracting a feature image related to the keyword from the image based on the image recognition method selected based on the keyword, and generating a feature thumbnail image based on the feature image;
An image processing method including: Selecting a keyword contained in the text of the data containing the image and text,
Selecting an image recognition method associated with the keyword based on the keyword;
Extracting a feature image related to the keyword from the image based on the image recognition method selected based on the keyword, and generating a feature thumbnail image based on the feature image;
An image processing program for causing a computer to execute. Selecting a keyword contained in the text of the data containing the image and text,
Extracting a feature image related to the keyword from the image based on the keyword, and generating a feature thumbnail image based on the feature image;
Including
The text includes heading text and body text,
Selecting the keyword
Selecting a headline keyword from the headline text;
Selecting a body keyword from the body text;
Selecting the keyword based on the relevance between the headline keyword and the body keyword;
An image processing method including: Selecting a keyword contained in the text of the data containing the image and text,
Extracting a feature image related to the keyword from the image based on the keyword, and generating a feature thumbnail image based on the feature image;
Including
The data has date information;
Further comprising creating a calendar including the feature thumbnail images arranged based on the date information.
Image processing method.

Images