JP2006277038A - Image display method, image display device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To obtain a display effect according to a user, who appreciates image data, and a display effects according to the information on a person photographed on image data. <P>SOLUTION: Face data included in image data configuring an image data group 1a managed by an image data registration management part 1 are recognized by a face recognizing part 3, and a layout area as an area where the face are arranged in the image data is detected. Also, the recognized face data are collated with face data 2a managed by a face data registration managing part 2 by the face recognizing part 3, and when the face data recognized by the face recognizing part 3 are included in the face data 2a managed by the face data registration managing part 2, the image data are displayed on a screen in secularly changing display configurations so as to display at least the layout area of the face data. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image display method, an image display device, and a program for displaying image data on a screen.

  In recent years, with the rapid spread of digital devices such as digital cameras, images are often displayed and enjoyed as digital data. As one of them, a technique called slide show display is used in which images are taken with a digital camera, the taken images are taken into a personal computer and displayed in order.

  In this slide show display, a plurality of image data captured in a personal computer is displayed on the personal computer in order at regular intervals. When switching images, a display effect called a transition is added, or one image is displayed. You can also perform zooming display and moving display (pan & zoom) etc. in the image while displaying the image, so that you can add motion to the still image and enjoy the slideshow It is possible to perform an attractive image display with movement for a user who is present. For example, from a state in which a part of one image captured on a personal computer is displayed, the display range is moved to display another part, or the whole or part of one image captured on a personal computer is displayed. From the state, zoom in to display a range narrower than the display range of the image, and vice versa, from the state of displaying a part of the image, zoom to display a range wider than the display range of the image Can be out.

  Here, the display effect as described above may be set by the user for each image data captured in the personal computer or may be set randomly by the personal computer. However, when the user sets the display effect, it takes time and effort. In addition, when the display effect is set at random on a personal computer, the display effect is set regardless of the elements included in the image data. For example, in the displayed image, the main subject is not shown. Zooming up may be performed, or an important person may not be displayed in an image that includes a plurality of persons, and the display effect may not be effectively performed.

Therefore, when capturing the image data into a personal computer or the like, the shooting information recorded in association with the image data is acquired when the image data is shot, and the display mode of the image data is selected and selected based on the shooting information. A technique for displaying image data in accordance with a display form has been considered (see, for example, Patent Document 1). In this technology, when shooting an image with a digital camera, shooting date and time, camera model name, shooting scene mode, focus position information indicating the focus position in the viewfinder at the time of shooting, strobe lighting state information, information indicating the distance to the subject, Shooting information such as zoom state information is recorded in association with the image data, and when the image data is displayed on a personal computer or the like, it is displayed in a display form based on these shooting information, and thereby the display effect of the image data Can be made more effective in accordance with the contents of the image.
Japanese Patent Laid-Open No. 2005-12673

  However, since the technique described in Patent Document 1 described above sets the display form of the image data depending on the shooting environment at the time of shooting the image data, the display effect according to the user who views the image data is given. It's hard to say that you can.

  In addition, since the shooting information associated with the image data is information related to the shooting date and time and the setting of the shooting device at the time of shooting, for example, the person shown in the image data is identified and the information on the person shown in the image data It is difficult to say that a display effect according to the contents of image data that cannot be determined from the shooting information, such as a display effect, can be provided.

  The present invention has been made in view of the problems of the conventional techniques as described above, and has a display effect according to a user who appreciates image data and a display according to information of a person shown in the image data. An object of the present invention is to provide an image display method, an image display device, and a program capable of providing an effect.

In order to achieve the above object, the present invention provides:
An image display device that displays image data including face data on a screen,
Face recognition means for recognizing the face data and detecting an arrangement area to be an area in which the face data is arranged in the image data;
Display execution means for displaying the image data in a display form that changes over time so that the arrangement area is displayed at least.

Further, importance setting means for setting importance in the arrangement area according to face data recognized by the face recognition means;
An attention area setting means for setting an attention area including an arrangement area where the importance is equal to or greater than a predetermined value;
The display execution means displays the image data in a display form that changes with time so that at least the attention area set by the attention area setting means is displayed.

Also, it has face data management means for registering and managing face data in advance,
The face recognition means collates the recognized face data with face data registered in advance by the face data management means,
The importance setting means sets the importance of the arrangement area of the face data high when the recognized face data matches the pre-registered face data as a result of the collation in the face recognition means. Features.

  Further, the face data management means registers and manages face data for setting a high importance level in advance for each image data group composed of at least one image data.

Further, face data selection that selects face data that increases the importance of the arrangement area in accordance with an image data group composed of at least one image data to be displayed among the face data registered in advance by the face data management means. Having means,
The importance level setting unit sets the importance level of the arrangement area of the face data to be high when the face data recognized by the face recognition unit matches the face data selected by the face data selection unit. It is characterized by that.

  The importance level setting means sets the importance level of the arrangement area higher as the distance from the center of the image data of the arrangement area detected by the face recognition means is closer.

  Further, the importance level setting means sets the importance level of the arrangement area higher as the size of the arrangement area detected by the face recognition means is larger.

  Further, the importance level setting means sets a high importance level of the arrangement area of the face data having a large number recognized by the face recognition means for an image data group composed of at least one image data.

  In addition, the display apparatus may further include a display pattern setting unit that sets a type of the display form in accordance with the size of the arrangement area to be displayed and the position in the image data.

  Further, the display form that changes over time according to the size of the arrangement area to be displayed, the position in the image data, and the type of the display form, and so that the central area of the image data is displayed. It is characterized by having an area setting means for setting the start state and end state.

  In the present invention configured as described above, when image data to be displayed on the screen is captured, first, face data included in the image data is recognized, and the face data is arranged in the image data. An arrangement region is detected. Then, the image data is displayed on the screen in a display form that changes with time so that at least the arrangement area is displayed.

  In this way, the face data included in the image data is recognized, and the image data is displayed in a display form that changes over time so that the face data is displayed. A display effect according to a user who appreciates the image data can be given, and a display effect according to the information of a person shown in the image data can be given.

  Also, if the importance is set in the arrangement area in accordance with the recognized face data, and the image data is displayed in a display form that changes over time so that at least the arrangement area whose importance is equal to or higher than a predetermined value is displayed. Even when a plurality of face data are included in the image data, the image data is displayed so that the main face data is the main one.

  Also, when the recognized face data and the pre-registered face data are collated, and the recognized face data matches the pre-registered face data, the importance of the arrangement area of the face data should be set high. For example, by registering in advance face data to be displayed as a main, such as a family member or a friend, image data is displayed so that the face data becomes the main.

  Further, if face data for setting high importance is registered and managed in advance for each image data group composed of at least one image data, the face displayed as the main for each displayed image data group Data can be set.

  In addition, face data that increases the importance of the arrangement area is selected from the face data registered in advance according to an image data group including at least one image data to be displayed, and the face data is selected as recognized face data. When the face data matches, if the importance of the arrangement area of the face data is set high, the desired face data is displayed as the main for each displayed image data group.

  If the type of display form is set according to the size of the displayed arrangement area and the position in the image data, the image data is displayed in an appropriate display form according to the arrangement area to be displayed.

  As described above, in the present invention, the face data included in the image data is recognized, the arrangement area of the face data in the image data is detected, and the display form changes with time so that the arrangement area is displayed at least. Since the image data is displayed on the screen, the displayed image data can have a display effect according to the user who views the image data, and information about the person in the image data can be displayed. The display effect according to can be given.

  Embodiments of the present invention will be described below with reference to the drawings.

(First embodiment)
FIG. 1 is a block diagram showing a first embodiment of an image display apparatus of the present invention.

  As shown in FIG. 1, in this embodiment, an image data registration management unit 1 that takes in n pieces of image data captured by a digital camera or the like, and registers and manages the n pieces of image data as an image data group 1a. When the slide show display is performed using the captured image data group 1a, the facial data of the person who wants to display with higher importance than the other subjects included in the image data constituting the image data group 1a are captured, The face data registration management unit 2 registered and managed as data 2a and the face area included in the image data constituting the image data group 1a are recognized, and the placement area is the area in which the face data is placed. And the face recognition unit 3 for comparing and comparing the recognized face data with the face data 2a managed by the face data registration management unit 2 and the face recognition unit 3 An importance level setting unit 4 that sets the importance level in the arrangement area according to the face data, and an attention area setting that sets an attention area for each image data based on the importance level set by the importance level setting unit 4 Unit 5, display pattern setting unit 6 that sets a display pattern of image data based on the size of the region of interest and the position in the image data set by region of interest setting unit 5, and setting by region of interest setting unit 5 The area setting for setting the display start area to be the display start state and the display end area to be the display end state for each image data based on the set attention area and the display pattern set by the display pattern setting unit 6 A storage unit 11 for storing the recognition results in the unit 7, the recognition result in the face recognition unit 3, and the setting contents in the importance level setting unit 4, the attention area setting unit 5, the display pattern setting unit 6 and the area setting unit 7 11 is a slide show execution unit 8 which is a display execution unit for executing a slide show using the image data group 1a managed by the image data registration management unit 1 on the display unit 9 such as a display based on the information stored in the image data registration management unit 1. And the control part 10 which controls these is provided.

  Hereinafter, an image display method in the image display apparatus configured as described above will be described with reference to flowcharts.

  FIG. 2 is a flowchart for explaining an image display method in the image display apparatus shown in FIG.

  First, the image data is taken with a digital camera or the like, and n pieces of image data to be displayed as a slide show are captured in the image display apparatus shown in FIG. The acquired n pieces of image data are registered and managed as an image data group 1 a in the image data registration management unit 1.

  Further, when performing a slide show display on the image display device using the image data group 1a, the face of a person who wants to display with higher importance than other subjects included in the image data constituting the image data group 1a. Capture the data. The fetched face data is registered and managed as face data 2a in the face data registration management unit 2.

  After that, when an instruction to execute a slide show using the image data group 1a managed by the image data registration management unit 1 is input (step S1), the control unit 10 causes the face recognition unit 3 to input an image. An image data group 1a managed by the data registration management unit 1 is acquired, and a command indicating that face recognition is performed on the image data constituting the image data group 1a is output.

  Then, the face recognition unit 3 acquires the image data group 1a managed by the image data registration management unit 1, and first, for each of the n pieces of image data constituting the image data group 1a, the image data is converted into the image data. The position and size of the face data included in the image data are detected by detecting the included face data, and the detection result is recorded in the face recognition result table 11b in the storage unit 11 (step). S2). Here, the recognition of the face data in the image data is performed using a known technique of face recognition. For example, Japanese Patent Application Laid-Open No. 7-31833 discloses a technique for detecting a human eye and mouth area from the luminance characteristics of a photographed image and detecting a face area by a combination thereof. Using such a technique, the face data is recognized for each of the n pieces of image data, and the position and size of the face data to be an area in the image data are detected. Although details of the face recognition result table 11b will be described later, the position and size of the recognized face data are detected as coordinates, and the coordinate information is stored as an arrangement area in the face recognition result table 11b. .

  FIG. 3 is a diagram showing a recognition result in the face recognition unit 3 shown in FIG.

  As shown in FIG. 3, the face recognition unit 3 recognizes the face data included in the image data for each of the n pieces of image data constituting the acquired image data group 1a, and the face in the image data A data arrangement area is detected.

  Next, it is checked whether or not the face data recognized in the image data has already been recorded in the face detection person table 11a (step S3). Although details of the face detection person table 11a will be described later, face data already recognized by the face recognition unit 3 is recorded, and the face recognition unit 3 stores the face data recognized in the image data. By comparing and collating with the face data recorded in the face detection person table 11a, it is verified whether the face data recognized in the image data has already been recorded in the face detection person table 11a. Further, it is conceivable to perform such face data comparison and collation using a known technique of face collation. For example, in Japanese Patent Laid-Open No. 2001-283224, three-dimensional face data is registered, and when an inquiry image and its photographing conditions are input, a verification image is generated from the three-dimensional data based on the photographing conditions. However, a technique for performing face matching by comparing the matching image and the inquiry image is disclosed. If this technology is used, even if the face data recognized in the image data is taken from any angle, the face data recognized in the image data and the face registered in the face detection person table 11a are used. If the data is that of the same person, it can be recognized that the face data recognized in the image data is already recorded in the face detection person table 11a.

  As a result of collating whether the face data recognized in the image data has already been recorded in the face detection person table 11a, the face data recognized in the image data has already been recorded in the face detection person table 11a. If it is present (step S4), the number of image data whose face data is recognized for the person of the face data in the face detection person table 11a is increased by 1 (step S5).

  On the other hand, when the face data recognized in the image data is not yet recorded in the face detection person table 11a, the face data recognized in the image data is stored in the face detection person table 11a in the face recognition unit 3. It is recorded (step S6). At that time, the number of image data whose face data is recognized for the person of the face data is set to “1”.

  Next, in the face recognition unit 3, the face data 2a managed by the face data registration management unit 2 is acquired, and the face data recognized in the image data is managed by the face data registration management unit 2. It is checked whether the face data is included in the face data 2a (step S7). Note that the face data 2a is composed of at least one face data. When the face data 2a is composed of a plurality of face data, the face data recognized with respect to the face data recognized in the image data for all of the plurality of face data. Collation is performed, and whether the face data recognized in the image data is face data included in the face data 2a managed by the face data registration management unit 2 is collated.

  As a result of collating whether the face data recognized in the image data is the face data included in the face data 2a managed by the face data registration management unit 2, the face recognized in the image data If the data is face data included in the face data 2a managed by the face data registration management unit 2, that fact is recorded in the face detection person table 11a (step S8).

  FIG. 4 is a diagram illustrating an example of the face detection person table 11a illustrated in FIG.

  As shown in FIG. 4, in the face detection person table 11a in this embodiment, identification information (A, B, C, D,...) For identifying a person of face data recognized by the face recognition unit 3 is used. ), The number of image data in which the face data is recognized among n pieces of image data constituting the image data group 1a, and the face data 2a managed by the face data registration management unit 2 When it is included face data, information indicating that is recorded. In the face detection person table 11a shown in FIG. 4, the face data recognized by the face recognition unit 3 is face data included in the face data 2a managed by the face data registration management unit 2. As the information indicating, the name of the person of the face data is recorded. This is because the face data 2a managed by the face data registration management unit 2 includes the name of the person of the face data in association with the captured face data, whereby the face recognition unit 3 If the face data recognized in step (b) is face data included in the face data 2a managed by the face data registration management unit 2, the name of the person is specified by the face data.

  Thereafter, the face recognition unit 3 identifies the person of the face data in the face detection person table 11a for the face data that is recognized in the image data and whose position and size are recorded in the face recognition result table 11b. Therefore, the identification information (A, B, C, D,...) Given for this purpose is also recorded in the face recognition result table 11b (step S9).

  In the face recognition unit 3, when the above-described processing is completed for all n pieces of image data constituting the image data group 1 a managed by the image data registration management unit 1 (step S <b> 10), this is indicated by the control unit 10. Will be notified.

  Next, in the control unit 10, the importance setting unit 4 is important for each of the arrangement areas of the face data included in the image data based on the information recorded in the face detection table 11a and the face recognition result table 11b. A command to set the degree is output.

  Then, in the importance setting unit 4, the face detection person table 11a is referred to, and for each person (A, B, C, D,...) Whose face is recognized, the face data in the image data group 1a. And the face data included in the image data by referring to the face recognition result table 11b and recognizing whether the face data is the face data registered as the face data 2a. , The size of the face data placement area, the distance from the center of the face data placement area in the image data, and the person (A, B, C) whose face data is registered in the face detection person table 11a. , D,...) Is recognized. Then, in the importance setting unit 4, the number of image data including face data, whether the face is a face registered as face data 2a, the size of the face data arrangement area, and the face Based on the four parameters such as the distance from the center in the image data of the data arrangement area, the importance of the face arrangement area is calculated for each of the face data included in the n pieces of image data (step S11). . For each of the four parameters, the greater the number of image data including face data, the higher the importance is set, and the face data registered as face data 2a is registered as face data 2a. The importance is set higher than the face that has not been set, and the larger the size of the face data arrangement area, the higher the importance is set, and the distance from the center of the image data of the face data arrangement area The closer the is, the higher the importance is set. In addition, the importance calculation using the four parameters may be performed, for example, by weighting each of the four parameters described above and adding the four weighted parameters. In this case, the weighting coefficients for weighting the four parameters may be set in advance by the importance setting unit 4, but for each user, the weighting coefficient of the parameter to be regarded as important among the four parameters is determined. It may be possible to set from the outside so as to increase. For example, when a slide show execution command is input in step S1, a screen on which the weighting coefficients can be input or selected for the four parameters is displayed on the display unit 9, and the user can select the weighting coefficients for the four parameters on this screen. Is input or selected, and the weighting coefficient is set in the importance setting unit 4 in advance.

  The importance calculated in step S11 is recorded in the face recognition result table 11b (step S12). As a result, the importance level setting unit 4 sets the importance level for each of the arrangement areas of the face data included in the image data.

  FIG. 5 is a diagram illustrating an example of the face recognition result table 11b illustrated in FIG.

  As shown in FIG. 5, in the face recognition result table 11b in the present embodiment, the position and size detected in step S2 and the recording in steps S4 to S9 for each face data arrangement area included in the image data. The recorded identification information (A, B, C, D,...) And the importance calculated in step S11 are recorded. Here, the position (x, y) of the arrangement area is represented by coordinate information in which the upper left vertex of the image data is (0, 0), the x axis extends to the right, and the y axis extends downward. The coordinates of the top left vertex are recorded.

  When the importance level setting unit 4 finishes recording the importance level in the face recognition result table 11b for each arrangement area of the face data included in each of the n pieces of image data constituting the image data group 1a, this is indicated. The control unit 10 is notified.

  Next, the control unit 10 outputs a command to the attention area setting section 5 to determine the attention area for each image data based on the information recorded in the face recognition result table 11b.

  Then, the attention area setting unit 5 refers to the face recognition result table 11b, and for each image data, based on the position and size of the face data arrangement area recorded in the face recognition result table 11b and the importance, A region of interest is determined (step S13). Specifically, first, for each image data, the arrangement area of the face data having the highest importance is recognized, and the importance of a certain ratio (for example, 80% of the highest importance) or more is given to the importance. A range including the face data arrangement area is set as the attention area. For each face data, the position (starting point) and size of the face are recorded. Therefore, the arrangement area of the face data, that is, the range including the face data is specified from these pieces of information. Become. Further, the importance range of the arrangement area of the face data included in the attention area can be set from the outside as in the case of the above-described weighting coefficient, or is fixedly set by the attention area setting section 5. It is also conceivable that a range including only the arrangement area of the face data having the highest importance is determined as the attention area.

  At this time, the range specified from the position and size of the arrangement area of the face data recorded in the face recognition result table 11b is not set as the attention area as it is, but the specified range is determined in a predetermined ratio. It may be expanded as a region of interest. For example, the specified range is expanded by 0.2 times in the vertical and horizontal directions so that the periphery of the face data is displayed, or the vertical length of the range is displayed below the specified range in the image data. If there is more than twice the space, it is determined that the person's body is included in the space, and the specified range is expanded downward by 1 times the vertical length. It is conceivable that the part is also displayed.

  The attention area set in step S13 is recorded in the pattern management table 11c in the storage unit 11 (step S14). Although details of the pattern management table 11c will be described later, the coordinate information of the set attention area is also stored in the pattern management table 11c.

  In the attention area setting section 5, when the recording of the attention area in the pattern management table 11c for each of the n pieces of image data constituting the image data group 1a is completed, the control section 10 is notified of this.

  Next, the control unit 10 outputs a command for determining a display pattern for each image data to the display pattern setting unit 6 based on the information recorded in the pattern management table 11c.

  Then, the display pattern setting unit 6 refers to the pattern management table 11c, and what display pattern is to be performed based on the position and size of the attention area recorded in the pattern management table 11c for each image data. It is determined (step S15). Here, as a display pattern determined by the display pattern setting unit 6, from a state in which a part of the image data is displayed, a pan in which the display range is moved in the horizontal direction or the vertical direction to display another part, Zoom in to display a range that is narrower than the display range of the image from a state where all or part of the image data is displayed, or Zoom to display a range that is wider than the display range of the image from a state where a part of the image data is displayed A display form is set such that the displayed image data changes with time, such as “out”.

  The display pattern is determined by the following method, for example. The method for determining the display pattern is not limited to the following, and other methods may be used.

  For example, when the image data is horizontally long and a plurality of faces are arranged in the attention area, if the horizontal length of the attention area is ½ or more of the horizontal length of the image data, the image data spreads in the horizontal direction. It is determined that the face data are arranged, and the display pattern is set to horizontal pan. Further, when the horizontal length of the attention area is less than ½ of the horizontal length of the image data, the vertical length of the attention area is more than 1.5 times the horizontal length. If it is long, it is determined that the face data is arranged in the vertical direction, and the display pattern is set to the vertical pan. Otherwise, the display pattern is set to zoom.

  Further, when the image data is vertically long and a plurality of faces are arranged in the attention area, if the vertical length of the attention area is ½ or more of the vertical length of the image data, it spreads in the vertical direction. It is determined that the face data are arranged, and the display pattern is set to vertical pan. When the vertical length of the attention area is less than ½ of the vertical length of the image data, the horizontal length of the attention area is ½ of the horizontal length of the image data. If it is above, it is judged that the face data is arranged in the horizontal direction, and the display pattern is set to the vertical pan. When the vertical length and the horizontal length of the attention area are less than ½ of the vertical length and the horizontal length of the image data, respectively, the display pattern is set to zoom.

  If the image data is horizontally long and only a single face data exists in the attention area, large face data is included if the vertical length of the attention area is 3/4 or more of the vertical length of the image data. The display pattern is set to horizontal panning. If the vertical length of the attention area is less than 3/4 of the vertical length of the image data, the display pattern is set to zoom.

  In addition, when the image data is vertically long and only a single face data exists in the attention area, large face data is included if the length of the attention area in the vertical direction is 1/2 or more of the vertical length of the image data. The display pattern is set to the vertical pan. When the vertical length of the attention area is less than ½ of the vertical length of the image data, the display pattern is set to zoom.

  If the display pattern is pan in the horizontal direction, there are patterns in which the display area moves from the left side to the right side of the image data, and vice versa, but this pattern is randomized using random numbers. A method such as deciding is conceivable. Similarly, in the case of a vertical pan, there are an upper side to a lower side and a lower side to an upper side, and in the case of a zoom, there are zoom in and zoom out, respectively, and the display pattern can be determined at random.

  The display pattern determined in step S15 is recorded in the pattern management table 11c for each image data (step S16).

  When the display pattern setting unit 6 finishes recording the display pattern in the pattern management table 11c for each of the n pieces of image data constituting the image data group 1a, the display pattern setting unit 6 notifies the control unit 10 to that effect.

  Next, the control unit 10 outputs a command for setting the display start region and the display end region for each image data to the region setting unit 7 based on the information recorded in the pattern management table 11c. The

  Then, the area setting unit 7 refers to the pattern management table 11c and displays the attention area for each image data based on the position and size of the attention area recorded in the pattern management table 11c and the display pattern. Thus, the display start area and the display end area are set (step S17). Even if the region of interest is near the edge of the image data, it is considered that a subject other than a person is captured near the center of the image data. The display start area and the display end area are set so that the center area of the image data (hereinafter referred to as the center area) is displayed during the display.

  For example, the vertical direction and the horizontal direction of the image data are each divided into three equal parts, and the area that is the central part of each is defined as the center area. When the display pattern is pan, the display start area and the display end area are set so that the attention area and the center area are included by the display start area, the display end area, and the locus thereof. When the display pattern is zoomed in, the display end area is set as an area including the attention area, and the display start area is set as an area including the attention area and the center area and wider than the display end area by a certain percentage or more. The When the display pattern is zoomed out, the display start area is set as an area including the attention area, and the display end area is set as an area including the attention area and the center area and wider than the display start area by a certain percentage or more. Is done. Further, the display start area and the display end area may be set so as not to fit in the image data.

  Here, the display start area and the display end area described above will be specifically described using coordinate information. In the following description, the coordinates (x, y) are represented by integers with the upper left vertex of the image data being (0, 0), the x axis extends to the right, the y axis extends downward, and the right It is assumed that the value of x increases as it goes and the value of y increases as it goes down. Also, the coordinates of the lower right vertex of the image data are (xx, yy). Further, the upper left vertex coordinates of the attention area are (x1, y1), the lower right vertex coordinates are (x2, y2), the upper left vertex coordinates of the center area are (xc1, yc1), and the lower right vertex coordinates are ( xc2, yc2). Also, the upper left vertex coordinates of the display start area are (xs1, ys1), the lower right vertex coordinates are (xs2, ys2), the upper left vertex coordinates of the display end area are (xe1, ye1), and the lower right vertex coordinates. Is (xe2, ye2). In addition, min (A, B) represents a smaller value between A and B, and max (A, B) represents a larger value between A and B. Also, rand (A, B) is a function that returns a value between A and B by a random number. In addition, the aspect ratio of the area in which image data is displayed on the display unit 9 is 4: 3 (horizontal 4: vertical 3).

If the display pattern is a horizontal pan and the display area moves from the left side to the right side of the image data,
xs1 <min (x1, xc1)
ys1 <min (y1, yc1)
ys2> max (y2, yc2)
xe2> max (x2, xc2)
ye1 <min (y1, yc1)
ye2> max (y2, yc2)
By setting the display start area and the display end area so as to satisfy the above condition, it is possible to display the attention area and the center area when image data is displayed using the horizontal pan as a display pattern. Here, a combination of values satisfying the conditional expression is not unique. For example, an actual value may be obtained by a method such as determining using a random number within a range satisfying the conditional expression. It should be noted that the x coordinate xs2 of the lower right vertex of the display start area and the x coordinate xe1 of the upper left vertex of the display end area are the aspect ratio of the area where the image data is displayed on the display unit 9 and the above-described six coordinates. It can ask for.

  An example of a method for determining a value satisfying the conditional expression using a random number is as follows. Note that the method of determining the value is not limited to the following, and other methods may be used.

  First, values of xs1, ys1, ys2, and xe2 are obtained using random numbers. This can be obtained, for example, by the following calculation.

xs1 = rand (0, min (x1, xc1) -1)
ys1 = rand (0, min (y1, yc1) -1)
ys2 = rand (max (y2, yc2) +1, yy)
xe2 = rand (max (x2, xc2) +1, xx)
Next, it is checked whether there is a sufficient difference between the values of xe2 and xs1 obtained by the above-described calculation for displaying in the horizontal pan. If there is not a sufficient difference, the values of xe2 and xs1 are corrected.

  For example, if the aspect ratio of the area where the image data is displayed on the display unit 9 is 4: 3 and the horizontal panning is intended to move at least 10% of the horizontal length of the image data, xe2 If -xs1 <(ys2-ys1) ÷ 3 × 4 × 1.1, the difference between xe2 and xs1 is not sufficient, so the values of xe2 and xs1 are corrected as follows.

The deficit dx of the difference between the values of xe2 and xs1 is
dx = (ys2-ys1) ÷ 3 × 4 × 1.1− (xe2-xs1)
Therefore, xe2 + dx ÷ 2 is set as new xe2, and xs1-dx ÷ 2 is set as new xs1.

Next, the values of ye1 and ye2 are obtained. These values are
ye2> max (y2, yc2)
And,
ye1 <min (y1, yc1)
And,
ye2-ye1 = ys2-ys1
A value satisfying the above may be used. Therefore, it can be obtained by the following calculation.

ye1 = rand (ys1- (ys2-max (y2, yc2) -1), min (y1, yc1) -1)
ye2 = ye1 + (ys2-ys1)
Finally, the values of xs2 and xe1 are obtained. This can be obtained from the already obtained values of xs1, xe2, ys1, ys2, ye1, and ye2 and the aspect ratio of the area in which image data is displayed on the display unit 9.

xs2 = xs1 + (ys2-ys1) ÷ 3 × 4
xe1 = xe2- (ye2-ye1) ÷ 3 × 4
With the above calculation, the coordinate values of the display start area and the display end area can be obtained.

If the display pattern is a horizontal pan and the display area moves from the right side to the left side of the image data,
xs2> max (x2, xc2)
ys1 <min (y1, yc1)
ys2> max (y2, yc2)
xe1 <min (x1, xc1)
ye1 <min (y1, yc1)
ye2> max (y2, yc2)
By setting the display start area and the display end area so as to satisfy the above condition, it is possible to display the attention area and the center area when image data is displayed using the horizontal pan as a display pattern. Here, a combination of values satisfying the conditional expression is not unique. For example, an actual value may be obtained by a method such as determining using a random number within a range satisfying the conditional expression. Note that the x coordinate xs1 of the upper left vertex of the display start area and the x coordinate xe2 of the lower right vertex of the display end area are the aspect ratio of the area where the image data is displayed on the display unit 9, and the above-described six coordinates. It can ask for. As an example of a method of determining a value satisfying the conditional expression using a random number, a method of obtaining the display area in the same procedure as the case where the display area is moved from the left side to the right side of the image data by the horizontal pan described above can be considered.

Also, if the display pattern is a vertical pan and the display area moves from the top to the bottom of the image data,
xs1 <min (x1, xc1)
xs2> max (x2, xc2)
ys1 <min (y1, yc1)
xe1 <min (x1, xc1)
xe2> max (x2, xc2)
ye2> max (y2, yc2)
By setting the display start area and the display end area so as to satisfy the above condition, it is possible to display the attention area and the center area when image data is displayed with the vertical pan as a display pattern. Here, a combination of values satisfying the conditional expression is not unique. For example, an actual value may be obtained by a method such as determining using a random number within a range satisfying the conditional expression. Note that the y coordinate ys2 of the lower right vertex of the display start area and the y coordinate ye1 of the upper left vertex of the display end area are the aspect ratio of the area where the image data is displayed on the display unit 9, and the above-described six coordinates. It can ask for. As an example of a method of determining a value satisfying the conditional expression using a random number, a method of obtaining the display area in the same procedure as the case where the display area is moved from the left side to the right side of the image data by the horizontal pan described above can be considered.

Also, if the display pattern is a vertical pan and the display area moves from the bottom to the top of the image data,
xs1 <min (x1, xc1)
xs2> max (x2, xc2)
ys2> max (y2, yc2)
xe1 <min (x1, xc1)
xe2> max (x2, xc2)
ye1 <min (y1, yc1)
By setting the display start area and the display end area so as to satisfy the above condition, it is possible to display the attention area and the center area when image data is displayed with the vertical pan as a display pattern. Here, a combination of values satisfying the conditional expression is not unique. For example, an actual value may be obtained by a method such as determining using a random number within a range satisfying the conditional expression. Note that the y coordinate ys1 of the upper left vertex of the display start area and the y coordinate ye2 of the lower right vertex of the display end area are the aspect ratio of the area where the image data is displayed on the display unit 9 and the above-described six coordinates. It can ask for. As an example of a method of determining a value satisfying the conditional expression using a random number, a method of obtaining the display area in the same procedure as the case where the display area is moved from the left side to the right side of the image data by the horizontal pan described above can be considered.

If the display pattern is zoomed in,
xs1 <min (x1, xc1)
xs2> max (x2, xc2)
ys1 <min (y1, yc1)
ys2> max (y2, yc2)
xe1 <x1
xe2> x2
ye1 <y1
ye2> y2
And the display start area is wider than the display end area by a certain percentage or more, and the aspect ratio of the area where the image data is displayed on the display unit 9 matches the aspect ratio of the display start area and the display end area. The display start area and the display end area are set as described above. Here, a combination of values satisfying the conditional expression is not unique. For example, an actual value may be obtained by a method such as determining using a random number within a range satisfying the conditional expression.

  An example of a method for determining a value satisfying the conditional expression using a random number is as follows. Note that the method of determining the value is not limited to the following, and other methods may be used.

  First, values of xs1, xs2, ys1, ys2, xe1, xe2, ye1, and ye2 are obtained using random numbers. This can be obtained, for example, by the following calculation.

xs1 = rand (0, min (x1, xc1) -1)
xs2 = rand (max (x2, xc2) +1, xx)
ys1 = rand (0, min (y1, yc1) -1)
ys2 = rand (max (y2, yc2) +1, yy)
xe1 = rand (0, x1-1)
xe2 = rand (x2 + 1, xx)
ye1 = rand (0, y1-1)
ye2 = rand (y2 + 1, yy)
Next, the aspect ratio of the area where the image data is displayed on the display unit 9 is matched with the aspect ratio of the display start area / display end area. For example, if the aspect ratio of the area where the image data is displayed on the display unit 9 is 4: 3, and the display start area is wider than 4: 3, the aspect ratio is 4: 3. Increase the display area. This can be done by the following process.

if,
xs2-xs1> (ys2-ys1) ÷ 3 × 4
Then, since the display start area is horizontally longer than 4: 3, the amount dy that is enlarged in the vertical direction is
dy = (xs2-xs1) ÷ 4 × 3- (ys2-ys1)
Thus, ys1−dy ÷ 2 is set as a new ys1, and ys2 + dy ÷ 2 is set as a new ys2, thereby increasing the display start area in the vertical direction.

  Similarly, when the display start area is vertically longer than 4: 3, the area is enlarged in the horizontal direction so as to be 4: 3. The same applies to the display end area.

  Finally, it is checked whether there is a certain difference between the sizes of the display start area and the display end area. If there is no difference, the display start area is enlarged to make a difference between these areas. For example, when the ratio of the length of one side is set so that the display start area is 1.2 times or more the display end area, the length of the side of the display start area is the length of the side of the display end area. If it is smaller than 1.2 times, the display start area is enlarged so that the side length becomes 1.2 times the side length of the display end area. This can be done by the following process.

if,
xs2-xs1 <(xe2-xe1) × 1.2
If so, since the display start area is less than 1.2 times the display end area by the ratio of the lengths of one side, the amounts dx and dy for expanding the display start area are
dx = (xe2−xe1) × 1.2− (xs2−xs1)
dy = (ye2-ye1) × 1.2− (ys2-ys1)
Xs1−dx ÷ 2 becomes new xs1, xs2 + dx ÷ 2 becomes new xs2, ys1−dy ÷ 2 becomes new ys1, and ys2 + dy ÷ 2 becomes new ys2. , Enlarge the display start area.

  Through the above processing, the coordinate values of the display start area and the display end area can be obtained.

If the display pattern is zoomed out,
xs1 <x1
xs2> x2
ys1 <y1
ys2> y2
xe1 <min (x1, xc1)
xe2> max (x2, xc2)
ye1 <min (y1, yc1)
ye2> max (y2, yc2)
And the display end area is wider than the display start area by a certain percentage or more, and the aspect ratio of the area in which the image data is displayed on the display unit 9 matches the aspect ratio of the display start area and the display end area. In this way, the display start area and the display end area are set. Here, a combination of values satisfying the conditional expression is not unique. For example, an actual value may be obtained by a method such as determining using a random number within a range satisfying the conditional expression. As an example of a method for determining a value satisfying the conditional expression using a random number, a method for obtaining in the same procedure as in the case of zoom-in described above can be considered.

  The display start area and display end area set in step S17 are recorded in the pattern management table 11c for each image data (step S18).

  FIG. 6 is a diagram illustrating an example of the pattern management table 11c illustrated in FIG.

  As shown in FIG. 6, in the pattern management table 11c in this embodiment, for each of n pieces of image data constituting the image data group 1a, the image size and coordinate information indicating the attention area set in step S13 are displayed. The display pattern set in step S15 and the coordinate information indicating the display start area and display end area set in step S17 are recorded. Here, as the coordinate information of each area, the coordinates of the upper left and lower right vertices of each area are recorded by the above-described coordinate information.

  When the area setting unit 7 finishes recording the display start area and the display end area of each of the n pieces of image data constituting the image data group 1a in the pattern management table 11c, the area setting unit 7 notifies the control unit 10 to that effect. Is done.

  Next, the control unit 10 acquires the image data group 1a managed by the image data registration management unit 1 from the slide show execution unit 8, and the image data group 1a is recorded in the pattern management table 11c. Based on the received information, a command to execute the slide show is output.

  Then, in the slide show execution unit 8, the image data group 1a managed by the image data registration management unit 1 is acquired, the pattern management table 11c is referred to, and the pattern management table for the acquired image data group 1a is referred to. A slide show is displayed on the display unit 9 in accordance with the display pattern recorded in 11c and the display start area and display end area (step S19).

  7 and 8 are diagrams for explaining the slide show display in the slide show execution unit 8 shown in FIG.

  With respect to the image data as shown in FIG. 7A, the horizontal pan is recorded as the display pattern in the pattern management table 11c, and the display start area and the display end area are respectively shown in FIG. 7B. When the area as shown in FIG. 7 is recorded, the image data in the display start area shown in FIG. The image is displayed in an enlarged state (FIG. 7C), and then the image data moves from the right side to the left side to the display end area shown in FIG. 7B, and the display shown in FIG. The image data in the end area is displayed in an enlarged state on the entire display unit 9, and the display of the image data is ended (FIG. 7D). Note that the above-described image data enlargement processing is performed by using the coordinates of the four vertices in the display start area and the display end area shown in FIG. This is performed by a known method such as replacement with the coordinates of the four vertices or the diagonal two vertices.

  Further, for the image data as shown in FIG. 8A, zoom-up is recorded as a display pattern in the pattern management table 11c, and the display start area and the display end area thereof are respectively shown in FIG. 8B. When the area as shown in FIG. 8 is recorded, the image data in the display start area shown in FIG. The image is displayed in an enlarged state (FIG. 8C), and then the image data is further expanded to the display end area shown in FIG. 8B, and the display end area shown in FIG. Is displayed in an enlarged state on the entire display unit 9, and the display of the image data ends (FIG. 8D). Note that the image data enlargement process described above is performed by using the coordinates of the four vertices in the display start area and the display end area shown in FIG. This is performed by a known method such as replacement with the coordinates of the four vertices or the diagonal two vertices.

  Thereafter, in the slide show execution unit 8, the display as described above is performed for each of the n pieces of image data constituting the image data group 1a while being switched at regular intervals.

  As described above, in this embodiment, the face data included in the captured image data is recognized, the size of the arrangement area of the face data, the number of image data including the face data, and the arrangement area of the face data. The display mode in the slide show display using the image data is set based on the distance from the center of the image data and whether the face data is pre-registered face data. A display effect according to the user can be given, and a display effect according to the information of the person shown in the image data can be given.

  In the present embodiment, the processing in steps S2 to S19 described above is performed after the slide show execution command is input to the control unit 10, but the processing in steps S2 to S18 acquires image data and face data. It may be possible to go in advance.

(Second Embodiment)
FIG. 9 is a block diagram showing a second embodiment of the image display apparatus of the present invention.

  As shown in FIG. 9, this embodiment is an image that is a plurality of image data groups each composed of at least one image data in the image data registration management unit 1 in contrast to that shown in the first embodiment. The difference is that the data groups 1a-1 to 1a-N are managed. Further, the face data registration management unit 2 determines the importance of the managed face data 2a for each of the plurality of image data groups 1a-1 to 1a-N managed by the image data registration management unit 1. Face data for setting high is registered.

  FIG. 10 is a diagram showing an example of a table provided in the face data registration management unit 2 shown in FIG.

  As shown in FIG. 10, the face data registration management unit 2 in this embodiment manages each of a plurality of image data groups 1a-1 to 1a-N managed by the image data registration management unit 1. Of the face data 2a, which face data is set to have a high importance level is managed by associating the name of the person of the face data with the image data groups 1a-1 to 1a-N.

  Hereinafter, an image display method in the image display apparatus configured as described above will be described with reference to flowcharts.

  FIG. 11 is a flowchart for explaining an image display method in the image display apparatus shown in FIG.

  First, N types of image data groups made up of n pieces of image data to be photographed with a digital camera or the like and to be displayed as a slide show in the image display apparatus shown in FIG. 9 are captured. The N types of captured image data groups are registered and managed as image data groups 1a-1 to 1a-N in the image data registration management unit 1, respectively. That is, in this embodiment, N types of image data groups composed of n pieces of image data are captured and managed.

  Further, when a slide show is displayed on the image display device using the image data groups 1a-1 to 1a-N, other subjects included in the image data constituting the image data groups 1a-1 to 1a-N, respectively. The face data of the person who wants to display with higher importance than that is captured. The captured face data is registered and managed as face data 2a in the face data registration management unit 2, and the image data group 1a managed by the image data registration management unit 1 in a table as shown in FIG. It is set which image data group of -1 to 1a-N is displayed with higher importance.

  Thereafter, a desired image data group is designated among the image data groups 1a-1 to 1a-N managed by the image data registration management unit 1, and a slide show execution command using the image data group is input. Then (step S101), in the control unit 10, the image data designated among the image data groups 1a-1 to 1a-N managed by the image data registration / management unit 1 with respect to the face recognition unit 3 is designated. A group is acquired, and a command indicating that face recognition is performed on the image data group is output.

  Then, the face recognition unit 3 acquires the designated image data group among the image data groups 1a-1 to 1a-N managed by the image data registration management unit 1 (step S102). For each of the n pieces of image data constituting the image data group, the face data included in the image data is recognized, the position and size indicating the arrangement area of the face data are detected, and the detection result is stored in the storage unit 11. Is recorded in the face recognition result table 11b (step S103).

  Next, it is checked whether or not the face data recognized in the image data has already been recorded in the face detection person table 11a (step S104).

  As a result of collating whether the face data recognized in the image data has already been recorded in the face detection person table 11a, the face data recognized in the image data has already been recorded in the face detection person table 11a. If it is present (step S105), the number of image data whose face data is recognized for the person of the face data in the face detection person table 11a is increased by 1 (step S106).

  On the other hand, when the face data recognized in the image data is not yet recorded in the face detection person table 11a, the face data recognized in the image data is stored in the face detection person table 11a in the face recognition unit 3. It is recorded (step S107). At that time, the number of image data whose face data is recognized for the person of the face data is set to “1”.

  Next, in the face recognition unit 3, the face data associated with the image data group acquired from the image data registration management unit 1 is acquired from the face data 2 a managed by the face data registration management unit 2. Whether the face data recognized in the image data is the face data included in the face data acquired from the face data registration management unit 2 is checked (step S108). In the face data registration management unit 2, as shown in FIG. 10, it is desired to set a high importance level for each of the image data groups 1 a-1 to 1 a -N managed by the image data registration management unit 1. Although the names of face data are managed in association with each other in the table, the face data 2a managed by the face data registration management unit 2 is similar to that shown in the first embodiment. Since the name of the person of the face data is included in association with the captured face data, it is possible to search for the face data that is desired to set a high degree of importance by referring to the name managed in this table. When the face data acquired from the face data registration management unit 2 is composed of a plurality of face data, all of the plurality of face data is collated with the face data recognized in the image data. Whether the face data recognized in the image data is a face included in the face data acquired from the face data registration management unit 2 is verified.

  As a result of collating whether the face data recognized in the image data is a face included in the face data acquired from the face data registration management unit 2, the face data recognized in the image data is If the face data is included in the face data acquired from the data registration management unit 2, that fact is recorded in the face detection person table 11a (step S109).

  The subsequent processing is the same as the processing in steps S9 to S19 shown in the first embodiment (steps S110 to S120).

  As described above, in the present embodiment, even when a plurality of types of image data groups each including at least one image data are captured, the face data whose importance is set to be high for the captured image data groups is image data. Since it is set for each group, it is possible to give a display effect according to the user who views the image data for each of a plurality of types of captured image data groups, and also to the information of the person reflected in the image data A corresponding display effect can be provided.

  In this embodiment as well, as in the case of the first embodiment, the processing in steps S102 to S119 can be performed in advance when image data and face data are acquired. However, in this embodiment, a plurality of types of image data groups 1a-1 to 1a-N are captured and a slide show display using these image data groups 1a-1 to 1a-N is performed. When the face recognition result table 11b and the pattern management table 11c are set for each of the image data groups 1a-1 to 1a-N and an image data group for performing a slide show display is designated, which face person detection table and face recognition result are specified. The face person detection table 11a, the face recognition result table 11b, and the pattern management table are set for each of the image data groups 1a-1 to 1a-N so that it can be understood whether slide show display should be performed based on the table and the pattern management table. Each of 11c is assigned with identification information indicating which image data group corresponds to management There is a need advance.

(Third embodiment)
FIG. 12 is a block diagram showing a third embodiment of the image display device of the present invention.

  As shown in FIG. 12, the present embodiment is different from the face data 2a managed by the face data registration management unit 2 in accordance with an instruction from the outside, as shown in the first embodiment. The difference is that a face data selection unit 12 is provided for selecting face data for which the importance of the arrangement area is set to be high when performing a slide show display.

  Hereinafter, an image display method in the image display apparatus configured as described above will be described with reference to flowcharts.

  FIG. 13 is a flowchart for explaining an image display method in the image display apparatus shown in FIG.

  First, the image data is taken with a digital camera or the like, and n pieces of image data to be displayed as a slide show are captured in the image display apparatus shown in FIG. The acquired n pieces of image data are registered and managed as an image data group 1 a in the image data registration management unit 1.

  Further, when a slide show is displayed on the image display device using the image data group 1a, the face of a person who wants to display with higher importance than other subjects included in the image data constituting the image data group 1a. Capture the data. The fetched face data is registered and managed as face data 2a in the face data registration management unit 2.

  Thereafter, when an instruction to execute a slide show using the image data group 1a managed by the image data registration management unit 1 is input (step S201), the control unit 10 causes the face recognition unit 3 to input an image. The image data group 1a managed by the data registration management unit 1 is acquired, and a command indicating that face recognition is performed on the image data constituting the image data group 1a is output, and the control in the control unit 10 is performed. As a result, a screen for selecting face data to be set with high importance is displayed on the display unit 9 from the face data 2 a managed by the face data registration management unit 2.

  The display unit 9 displays information that can identify the face data 2a managed by the face data registration management unit 2, for example, the name of the person of the face, and when face data is selected from the information, The face data selection unit 12 selects the face data from the face data 2a managed by the face data management unit 2 (step S202), and only the selected face data is acquired from the face data management unit 2. The

  Further, the face recognition unit 3 acquires the image data group 1a managed by the image data registration management unit 1, and first, n image data constituting the image data 1a are included in the image data. Face data is recognized, the position and size indicating the arrangement area of the face data is detected, and the detection result is recorded in the face recognition result table 11b in the storage unit 11 (step S203).

  Next, it is checked whether or not the face data recognized in the image data is already recorded in the face detection person table 11a (step S204).

  As a result of collating whether the face data recognized in the image data is already recorded in the face detection person table 11a, the face recognized in the image data is already recorded in the face detection person table 11a. In this case (step S205), the number of image data whose face data is recognized for the person of the face data in the face detection person table 11a is increased by 1 (step S206).

  On the other hand, when the face data recognized in the image data is not yet recorded in the face detection person table 11a, the face data recognized in the image data is stored in the face detection person table 11a in the face recognition unit 3. It is recorded (step S207). At that time, the number of image data whose face data is recognized for the person of the face data is set to “1”.

  Next, the face recognition unit 3 acquires the face data selected by the face data selection unit 12 from the face data 2a managed by the face data registration management unit 2, and recognizes it in the image data. Whether the face data is a face included in the face data selected by the face data selection unit 12 is checked (step S208). When the face data selected by the face data selection unit 12 is composed of a plurality of face data, all of the plurality of face data is collated with the face recognized in the image data, It is verified whether the face recognized in the image data is a face included in the face data selected by the face data selection unit 12.

  As a result of collating whether the face data recognized in the image data is the face data included in the face data selected by the face data selection unit 12, the face data recognized in the image data is If the face data is included in the face data selected by the face data selection unit 12, that fact is recorded in the face detection person table 11a (step S209).

  The subsequent processing is the same as the processing in steps S9 to S19 shown in the first embodiment (steps S210 to S220).

  As described above, in the present embodiment, since it is possible to appropriately select the face data to be regarded as important for one image data, it is possible to provide a display effect according to the user who views the captured image data. It is possible to provide a display effect corresponding to the information of the person shown in the image data.

  In this embodiment as well, as in the case of the first embodiment, the processes in steps S202 to S219 can be performed in advance when image data and face data are acquired. However, in this embodiment, since there are cases where a plurality of types of face data for which the importance of the arrangement area is set is set for one captured image data group, face detection is performed for each set face data. When the person table 11a, the face recognition result table 11b, and the pattern management table 11c are set and a slide show execution command is input, a slide show display is performed based on which face detection person table, face recognition result table, and pattern management table in the slide show. Identification information is assigned to each of the face detection person table 11a, the face recognition result table 11b, and the pattern management table 11c so that the identification information is input when a slide show execution command is input. There is a need.

  In the present invention, the processing in the image display apparatus is recorded on a recording medium readable by the image display apparatus, in addition to the process realized by the dedicated hardware described above. The program recorded on the recording medium may be read by the image display device and executed. The recording medium readable by the image display device refers to a transfer medium such as a floppy disk, a magneto-optical disk, a DVD, and a CD, as well as an HDD built in the image display device. The program recorded on this recording medium is read by a control block, for example, and the same processing as described above is performed under the control of the control block.

1 is a block diagram showing a first embodiment of an image display device of the present invention. 3 is a flowchart for explaining an image display method in the image display apparatus shown in FIG. 1. It is a figure which shows the recognition result in the face recognition part shown in FIG. It is a figure which shows an example of the face detection person table shown in FIG. It is a figure which shows an example of the face recognition result table shown in FIG. It is a figure which shows an example of the pattern management table shown in FIG. It is a figure for demonstrating the slide show display in the slide show execution part shown in FIG. It is a figure for demonstrating the slide show display in the slide show execution part shown in FIG. It is a block diagram which shows 2nd Embodiment of the image display apparatus of this invention. It is a figure which shows an example of the table provided in the face data registration management part shown in FIG. 10 is a flowchart for explaining an image display method in the image display device shown in FIG. 9. It is a block diagram which shows 3rd Embodiment of the image display apparatus of this invention. 13 is a flowchart for explaining an image display method in the image display apparatus shown in FIG. 12.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image data registration management part 1a, 1a-1-1a-N Image data group 2 Face data registration management part 2a Face data 3 Face recognition part 4 Importance setting part 5 Attention area setting part 6 Display pattern setting part 7 Area setting part 8 Slideshow execution unit 9 Display unit 10 Control unit 11 Storage unit 11a Face detection person table 11b Face recognition result table 11c Pattern management table 12 Face data selection unit

Claims (30)

An image display method for displaying image data including face data on a screen,
Processing for recognizing the face data and detecting an arrangement area that is an area in which the face data is arranged in the image data;
And a process of displaying the image data in a display form that changes over time so that the arrangement area is displayed at least. The image display method according to claim 1,
Processing to set importance in the arrangement area according to the recognized face data;
An image display method, wherein the image data is displayed in a display form that changes with time so that at least an arrangement region having an importance level equal to or greater than a predetermined value is displayed. The image display method according to claim 2,
A process of collating the recognized face data with previously registered face data;
An image display method comprising: processing for setting the importance of an arrangement area of the face data high when the recognized face data matches face data registered in advance. The image display method according to claim 3,
An image display method comprising a process of previously registering and managing face data for setting a high degree of importance for each image data group including at least one image data. The image display method according to claim 3,
A process of selecting face data that increases the importance of the arrangement area according to an image data group composed of at least one image data to be displayed among the previously registered face data;
An image display method characterized in that when the recognized face data matches the selected face data, the importance of the arrangement area of the face data is set high. The image display method according to any one of claims 2 to 5,
The image display method characterized by setting the importance of the arrangement area higher as the distance from the center in the image data of the detected arrangement area is closer. The image display method according to any one of claims 2 to 6,
The image display method characterized by setting the importance of the arrangement area higher as the size of the detected arrangement area is larger. The image display method according to any one of claims 2 to 7,
An image display method characterized in that the importance of an arrangement area of face data having a large number of recognized image data groups composed of at least one image data is set high. The image display method according to any one of claims 1 to 8,
An image display method comprising: setting a type of the display form in accordance with a size of an arrangement area to be displayed and a position in the image data. The image display method according to claim 9,
Start of the display form that changes over time according to the size of the arrangement area to be displayed, the position in the image data, and the type of the display form, and so that the central area of the image data is displayed. An image display method comprising a process of setting a state and an end state. An image display device that displays image data including face data on a screen,
Face recognition means for recognizing the face data and detecting an arrangement area to be an area in which the face data is arranged in the image data;
An image display apparatus comprising: a display execution unit configured to display the image data in a display form that changes with time so that at least the arrangement area is displayed. The image display device according to claim 11,
Importance setting means for setting importance in the arrangement area in accordance with the face data recognized by the face recognition means;
An attention area setting means for setting an attention area including an arrangement area where the importance is equal to or greater than a predetermined value;
The display execution means displays the image data in a display form that changes with time so that at least the attention area set by the attention area setting means is displayed. The image display device according to claim 12,
Having face data management means for pre-registering and managing face data;
The face recognition means collates the recognized face data with face data registered in advance by the face data management means,
The importance setting means sets the importance of the arrangement area of the face data high when the recognized face data matches the pre-registered face data as a result of the collation in the face recognition means. A characteristic image display device. The image display device according to claim 13.
The face data management means registers and manages in advance face data for setting a high degree of importance for each image data group composed of at least one image data. The image display device according to claim 13.
Face data selection means for selecting face data that increases the importance of the arrangement area in accordance with an image data group composed of at least one image data to be displayed among face data registered in advance by the face data management means. Have
The importance level setting unit sets the importance level of the arrangement area of the face data to be high when the face data recognized by the face recognition unit matches the face data selected by the face data selection unit. An image display device characterized by that. The image display device according to any one of claims 12 to 15,
The image display apparatus according to claim 1, wherein the importance level setting unit sets the importance level of the arrangement region higher as the distance from the center of the image data of the arrangement region detected by the face recognition unit is shorter. The image display device according to any one of claims 12 to 16,
The image display apparatus according to claim 1, wherein the importance level setting unit sets the importance level of the arrangement area higher as the size of the arrangement area detected by the face recognition unit is larger. The image display device according to any one of claims 12 to 17,
The importance level setting unit sets a high level of importance level of an arrangement area of face data that is recognized by the face recognition unit for an image data group including at least one image data. . The image display device according to any one of claims 11 to 18,
An image display device comprising display pattern setting means for setting a type of the display form in accordance with the size of the arrangement area to be displayed and the position in the image data. The image display device according to claim 19,
Start of the display form that changes over time according to the size of the arrangement area to be displayed, the position in the image data, and the type of the display form, and so that the central area of the image data is displayed. An image display device comprising region setting means for setting a state and an end state. On the computer,
Recognizing face data included in image data captured by the computer, and detecting an arrangement area that is an area in which the face data is arranged in the image data;
A program for executing the procedure of displaying the image data in a display form that changes with time so that the arrangement area is displayed at least. The program according to claim 21, wherein
In the computer,
A procedure for setting importance in the arrangement area according to the recognized face data;
A program for executing a procedure for displaying the image data in a display form that changes with time so that at least an arrangement region having the importance level equal to or higher than a predetermined value is displayed. The program according to claim 22,
In the computer,
A procedure for collating the recognized face data with previously registered face data;
A program for executing, when the recognized face data and face data registered in advance match, a procedure for setting the importance of the arrangement area of the face data high. The program according to claim 23,
In the computer,
A program for executing a procedure for previously registering and managing face data for setting a high importance level for each image data group including at least one image data. The program according to claim 23,
In the computer,
A step of selecting face data that increases the importance of the arrangement area according to an image data group composed of at least one image data to be displayed among the previously registered face data;
A program for executing, when the recognized face data matches the selected face data, a procedure for setting the importance of the arrangement area of the face data high. The program according to any one of claims 22 to 25,
In the computer,
A program for executing a procedure for setting the importance of an arrangement area higher as the distance from the center of the detected arrangement area in the image data is closer. In the program according to any one of claims 22 to 26,
In the computer,
A program for executing a procedure for setting a higher importance level of the arrangement area as the size of the detected arrangement area is larger. The program according to any one of claims 22 to 27,
In the computer,
A program for executing a procedure for setting the importance of a face data arrangement region having a large number of recognized image data groups composed of at least one image data to a high level. The program according to any one of claims 21 to 28,
In the computer,
A program for executing a procedure for setting the type of the display form in accordance with the size of the arrangement area to be displayed and the position in the image data. The program according to claim 29,
In the computer,
Start of the display form that changes over time according to the size of the arrangement area to be displayed, the position in the image data, and the type of the display form, and so that the central area of the image data is displayed. A program for executing a procedure for setting a state and an end state.

Images