JP2013083689A - Image output device, program, and method for determining display size according to relation between browsing person and subject person - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image output device, a program, and a method which can output screen data with a layout displaying images which strongly interest a browsing person in an emphasized manner.SOLUTION: An image output device comprises: subject information storage means for storing respective images in association with subject person identifiers of persons photographed in each image; browsing person information acquisition means for acquiring a browsing person identifier of a browsing person who browses the images; display size ratio determination means for determining display size ratios of the images according to relation types between the respective subject person identifiers of the persons in the image and the browsing person identifier of the browsing person; and screen output means for outputting screen data which lays out the images according to the size corresponding to the display size ratios of the respective images.

Description

  The present invention relates to a technique for laying out and outputting a plurality of images on one screen.

  Conventionally, according to the slide show technique, there is a technique in which a large number of images are classified into groups according to the degree of similarity, and images belonging to the same group are simultaneously displayed on one screen (for example, see Patent Document 1). According to this technique, it is possible to prevent the viewer from continuing a monotonous browsing state in which similar images are continuously displayed for a long time.

  In addition, as a slide show technique, there is a technique for displaying a plurality of images on the same screen so that other images do not overlap with an area that is viewed by the viewer (see, for example, Patent Document 2). According to this technique, a large number of images are classified into groups, a region of interest is detected from the images for each group, and the region of interest is arranged and displayed on a template so as not to overlap with other images.

  Further, there is a frame division technique in which a display area of a display is divided into a plurality of sections and one image is displayed in each section in a predetermined order (see, for example, Patent Document 3 and Non-Patent Documents 1 and 2). According to the techniques described in Patent Literature 3 and Non-Patent Literature 1, for a plurality of designated images, an important area in the image, the shape of the frame including the important area in order to maintain the importance of the image, and The size of the frames can be determined to enlarge important images and automatically laid out on the display. It is also possible to maintain the order in which images are displayed in a comic style. According to the technique described in Non-Patent Document 2, it is not possible to display the images in the same order. However, if the shape of the image and the importance of the image are designated for a plurality of designated images, the shape and the shape of the frame And the importance can be automatically laid out on the display so that the importance is reflected in the area of the frame relatively accurately.

JP 2010-004479 A JP 2011-059775 A JP 2011-050528 A

KDDI R & D Media Solutions Group Emi Meido, “Comic Style Layout Technology”, [online], [searched September 13, 2011], Internet <URL: http://www.kddilabs.jp/assets/files/technology /65.pdf> C.B.Atkins, "Blocked Recursive Image Composition", ACMMM'08, pp.821-824, 2008. OpenCV, [online], [Search September 18, 2011], Internet <URL: http://opencv.jp/>

  According to the technique described in Patent Document 1, the image cannot be displayed in different sizes depending on the importance of the image to the viewer. Since each image is always displayed in the same size, it is generally monotonous for the viewer, and it is often difficult to emphasize the visual effect of some images, and often feel bored.

  In addition, according to the techniques described in Patent Documents 2 and 3 and Non-Patent Document 1, in order to display an image in different sizes, the attention area as a parameter, the importance of the image, and the number of images displayed on one screen are set. , Must be set by the viewer. Of course, in order to display an image in which a face is detected in a large size, the parameters of the image can be automatically set. However, in particular, a face (photo) taken in a home is often captured, It is difficult for a viewer to recognize an image of interest in an emphasized manner.

  On the other hand, the inventors thought that in the case of a photograph taken at home, the photograph that the viewer wants to recognize with emphasis may be based on the relationship between the viewer and the person in the image. . That is, whether or not the image should be displayed in an emphasized manner should be determined according to the relationship between the viewer and the person shown in the image. In other words, an image showing a person who is not interested in the viewer need not be displayed in an emphasized manner.

  SUMMARY An advantage of some aspects of the invention is that it provides a screen output device, a program, and a method capable of outputting screen data having a layout in which an image that is highly interesting for a viewer is displayed in an emphasized manner.

According to the present invention, in a screen output device for laying out and outputting a plurality of images on one screen,
Subject information storage means for storing the subject person identifier of the person appearing in the image in association with each image;
Browser information acquisition means for acquiring a browsing person identifier of a viewer who browses an image;
Display size ratio determining means for determining the display size ratio of the image according to the relationship type of the subject person identifier of the person shown in the image with respect to the browsing person identifier of the viewer;
Screen output means for outputting screen data in which the image is laid out in a size corresponding to a display size ratio for each image.

  According to another embodiment of the screen output apparatus of the present invention, it is also preferable that the screen display apparatus includes a display for displaying the screen data output by the screen output means.

  According to another embodiment of the screen output apparatus of the present invention, it is also preferable that the screen output apparatus has a printing function for printing the screen data output by the image output means on a paper medium.

According to another embodiment of the screen output device of the present invention,
By the relationship type of subject person identifier of an image for viewing by Person identifier Audience further comprises a display rule storage means for defining a weighting alpha ₁ to the basic size ratio of the image,
The browsing information acquisition means also acquires a person identifier for each relationship type with respect to the browsing person identifier,
Display size ratio determining means uses the display rule storage means, in accordance with the relationship type of subject person identifier for viewing person identifier, the weighted values of the weights alpha ₁ in the basic size ratio, also output as the display size ratio preferable.

According to another embodiment of the screen output device of the present invention,
The weight α ₁ of the display rule storage means is
When the viewer person identifier of the viewer is included in the subject person identifier of the image, a value larger than the basic size ratio is set as the display size ratio, or
If the viewer's browsing person identifier is not included in the subject person identifier of the image, it is also preferable to set the display size ratio to a value smaller than the basic size ratio.

According to another embodiment of screen output apparatus of the present invention, the weight alpha ₁ display rule storage means, if the image subject person identifier includes viewing person identifier of visitors to a value smaller than the basic size ratio A display size ratio is also preferable.

According to another embodiment of the screen output device of the present invention, the display size ratio determining means includes:
When one or more predetermined person identifiers are included in the subject person identifier of the image, the face area size detected in the image is detected using the face area detection function, and the weight α is set according to the size of the face area size. It is also preferable to further weight ₁ .

According to another embodiment of screen output apparatus of the present invention, the weight alpha ₁ display rule storage means, in accordance with the relationship type obtained from social graph SNS (Social Networking Service), or a viewer person identifier It is also preferable that it is determined according to the shortest path distance to the subject person identifier (a larger value as the distance is shorter).

According to another embodiment of the screen output device of the present invention,
Display rule storage means, the personal attributes of the viewing person identifier visitors further defines a weight alpha ₂ relative to the base size ratio of the image,
The browsing information acquisition means also acquires the personal attribute of the browsing person identifier,
Display size ratio determining means uses the display rule storage means, in accordance with the personal attribute for viewing person identifier, a further was weighted value weighted alpha ₂ to the basic size ratio, it is also preferable to output as the display size ratio.

According to another embodiment of the screen output device of the present invention,
Personal attributes are age-specific according to the viewer ’s visual capabilities,
Weight alpha ₂ display rule storage means, as the viewer age range is increased, it is also preferable that the display size ratio value greater than the basic size ratio.

According to another embodiment of the screen output device of the present invention, it is also preferable to increase the display time for an image having a larger value of the weight α ₁ , the weight α _2, or the weight α ₁ × α ₂ .

According to another embodiment of the screen output device of the present invention,
The screen size is divided into N display sizes, and that one display size is the basic size ratio.
The screen output means extracts an image group that is divided so that the sum of the display sizes of a plurality of images in consecutive order is close to the screen size, and images of different display sizes included in the image group are displayed as one screen size. It is also preferable to lay out.

  According to another embodiment of the screen output device of the present invention, it is also preferable that the N divided display sizes are determined based on the number of viewers.

According to another embodiment of the screen output device of the present invention,
The viewer information acquisition means
Biometric data input means for inputting biometric data of a viewer who is currently browsing;
A viewer specifying data storage means for storing a set of viewer specifying data consisting of biometric data associated with the person identifier;
It is also preferable to further include a viewer specifying means for outputting a viewer identifier for the biometric data of the viewer using the viewer specifying data.

According to another embodiment of the screen output device of the present invention,
The biometric data is preferably a face photograph, voice data, fingerprint data, vein data, or iris data, and the authentication is preferably image authentication, voice authentication, fingerprint authentication, vein authentication, or iris authentication.

According to the present invention, in a screen output program for causing a computer mounted on a device that lays out and outputs a plurality of images to one screen to function,
Subject information storage means for storing the subject person identifier of the person appearing in the image in association with each image;
Browser information acquisition means for acquiring a browsing person identifier of a viewer who browses an image;
Display size ratio determining means for determining the display size ratio of the image according to the relationship type of the subject person identifier of the person shown in the image with respect to the browsing person identifier of the viewer;
The computer is caused to function as image output means for outputting screen data in which the image is laid out with a size corresponding to a display size ratio for each image.

According to the present invention, in a screen output method in an apparatus for laying out and outputting a plurality of images on one screen,
For each image, it has a subject information storage unit that stores a subject person identifier of a person shown in the image in association with the image,
A first step of acquiring a browsing person identifier of a viewer who browses an image;
A second step of determining a display size ratio of the image according to a relation type of a subject person identifier of a person appearing in the image with respect to a browsing person identifier of the viewer;
And a third step of outputting screen data in which the image is laid out in a size corresponding to a display size ratio for each image.

  According to the screen output device, program, and method of the present invention, it is possible to output screen data of a layout in which an image that is highly interesting to the viewer is displayed in an emphasized manner. According to the present invention, in particular, by automatically determining the display size according to the relationship between the viewer and the subject person, the layout can be determined according to the relationship between the persons without specially setting parameters by the viewer. Changing screen data is output. This screen data is displayed on a display like a slide show or printed on a paper medium like an album. The layout of the image data varies depending on the viewer who views the image data.

It is a 1st display image in this invention. It is a 2nd display image in this invention. It is a 3rd display image in this invention. It is a 4th display image in the present invention. It is a functional block diagram of the screen output apparatus in this invention. It is a 5th display image in the present invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  The screen output device 1 in the present invention may be a screen display device having a display for displaying screen data, or a screen printing device having a printing function for printing screen data on a physical paper medium. Also good. Further, it may be an image browsing program or a slide show program executed on a personal computer, or a printing program executed on a printer.

  When the screen output device 1 is a screen display device, it is a home digital photo frame, for example, and continuously displays screen data on a display. The image displayed on the display of the photo frame 1 is a still image such as a photograph taken at home.

  In the following description, it is assumed that the screen output device 1 is a digital photo frame.

  FIG. 1 is a first display image in the present invention.

  According to the present invention, when the screen data is displayed on the display, the display size ratio of the image to be displayed is changed depending on the relationship between the viewer and the subject person. Each viewer and subject person is given a unique person identifier.

According to FIG. 1A, the person identifier [001] of the viewer and the person identifier [001] of the subject person are the same. This means that the viewer is browsing his own image. On the other hand, according to FIG. 1B, the person identifier [001] of the viewer is different from the person identifier [002] of the subject person. When there is such a difference, the viewer generally wants to see an image in which he / she is photographed in a large display size. Therefore, when a viewer browses an image of himself / herself, the display size ratio is changed so that the image is displayed larger than an image of a person other than himself / herself. According to FIG. 1, it is assumed that the display size ratio of the image is defined in advance as follows.
When both identifiers are “same” (when viewer's photo is displayed): 1
When both identifiers are “different” (when photos other than the viewer are displayed): 0.3

  FIG. 2 is a second display image in the present invention.

According to FIG. 2, the display size ratio is changed in accordance with the relationship type of the subject person identifier with respect to the browsing person identifier. “Relationship type” refers to a human relationship such as “family”, “acquaintance”, and “others” of the subject person with respect to the viewer. The “display size ratio” is a value obtained by multiplying the basic size ratio by the weight α ₁ as follows.
Display size ratio = basic size ratio (S) × weight (α ₁ )

Weight alpha ₁ has been determined in accordance with the relationship type of subject person identifier for viewing person identifier. According to FIG. 2, a browsing person A (ID: 001) is a person A (ID: 001), a person B (ID: 002), a person C (ID: 003), a person D, and a person E (persons) as subject persons. ID: 005) is being viewed. According to FIG. 2, the relationship type of the subject persons A to E with respect to the viewer A is expressed as follows.
[Subject Person] [Subject Person Identifier] [Relationship Type]
A 001 Principal B 002 Family C 003 Acquaintance D *** Others E 005 Family

Here, the weight α ₁ is determined to be “2” according to the display rule, for example, when the relationship type is the principal. In this example, the subject person is closer as human relations, the value of the weight α ₁ becomes larger when viewed from the viewer. Further, when the relationship type is “family” and “acquaintance”, the weight α ₁ is determined as “1.5”, and when the relationship type is “other”, the weight α ₁ is determined as “1”. . When no person is shown in the image, the weight α ₁ is determined as “1”.

Further, the weight α ₁ is set according to a relationship type obtained from a social graph of SNS (Social Networking Service) or according to the shortest path distance between the viewer person identifier and the subject person identifier (the shorter the distance, (Large value) may be determined. For example, it can be acquired from an SNS server such as facebook (registered trademark), mixi (registered trademark), or GREE (registered trademark). According to the SNS server, there is a mode for designating family members and lovers. As the relationship type information, for example, a person identifier of “family” and a person identifier of “acquaintance” are associated with the viewer person identifier as the person concerned. If such information is not obtained, the shortest path between the viewer and the object (the number of edges of the social graph), to reduce the weight alpha ₁ as the number increases. For example, “2” is set when the subject is the viewer himself, “1.5” when the number of edges is 1, “1” when the number of edges is 2, and “0. 5 ”, and“ 0.5 ”when no person is shown in the image. Furthermore, using the number of recent message exchanges on the SNS, it is possible to determine that the greater the number of messages, the higher the familiarity, and to increase the weight α ₁ .

According to FIG. 2, four images are displayed, and the display size ratio according to the relationship type of the subject person with respect to the viewer (A) is expressed as follows.
[Subject Person] [Relationship Type] [Display Size Ratio (S × α ₁ )]
A / B person / family S × 2
B / E Family / Family S × 1.5
C acquaintance S × 1.2
D others S × 1

Subject person is more present in one image, if the relationship type is also a wide, weight alpha ₁ may be a value of any relevant type. For example, when the subject person in the image is “A / B” and the relationship type is “person / family”, the weight α ₁ may be set to the larger value (relation type “person”). It may also be adding the weights alpha ₁ relationship type in all subject person. For example, when the subject person is “A / B” and the relationship type is “person / family”, the weight α ₁ = 2 + 1.5 = 3.5.

  FIG. 3 shows a third display image in the present invention.

It is also preferable to set the display rules individually according to the “mode”. For example, when the viewer is shy, there is a request for reducing the display size ratio of the image in which the viewer is shown. Therefore, for example, a mode such as “shy mode” is set, and the weight α _{1 of the} display rule is determined so that the viewer can reduce the display size ratio of the image included in the subject person.
"Normal mode" (See Fig. 1 and Fig. 2)
"Shy mode" (see Figure 3)

In FIG. 3, a shy person B (ID: 002) is a subject person A (ID: 001), B (ID: 002), C (ID: 003), D, and E (ID: 005). ) Is viewed. The relationship types of the subject persons A to E with respect to the viewer B are shown below.
[Subject Person] [Subject Person Identifier] [Relationship Type]
A 001 family
B 002 himself
C 003 Acquaintance
D *** Others
E 005 family

Here, the weight α ₁ is determined according to the display rule, for example, when the relationship type is “person”, the weight α ₁ is determined as “0.8”, and when the relationship type is “family” or “acquaintance”, the weight α 1 ₁ is determined to be “2”. When the relationship type is “others”, the weight α ₁ is determined as “1”. Further, when a person is not shown in the image, the weight α ₁ is determined as “1”.

  The shy mode may be automatically applied to a person over a certain age. The age, which is the personal attribute of the viewer, may be stored in advance by the viewer himself / herself. In addition, a technique of automatically estimating the age from a face photograph obtained by photographing a viewer's face may be applied.

According to FIG. 3, four images are displayed, and an example of the display size ratio according to the relationship type of the subject person with respect to the viewer (B) is shown below.
[Subject Person] [Relationship Type] [Display Size Ratio (S × α ₁ )]
A / E Family / Family S × 2
B himself S × 0.8
C Acquaintance S × 2
D others S × 1

  Here, the “shy mode” may reduce the display size ratio only in the case of an image in which the viewer himself / herself is greatly shown. In this case, whether or not the viewer himself / herself is shown largely is determined by the ratio of the area of the face area to the entire image.

  FIG. 4 shows a fourth display image in the present invention.

In general, the visual ability tends to decrease as the age increases. Therefore, when the age of the viewer is high, the area per image is increased as compared with a person with high visual ability. For example, when a mode such as “personal attribute mode” is set and the viewer is old, the display rule weight α ₁ is determined so as to increase the display size ratio of the image.

In FIG. 4, an elderly reader E (ID: 005) is browsing an image in which the subject person A (ID: 001), B (ID: 002), and E (ID: 005) are shown. According to FIG. 4, the relationship types and personal attributes of the subject persons A to E with respect to the viewer E are expressed as follows.
[Subject Person] [Subject Person Identifier] [Relationship Type] [Personal Attributes]
A 001 family
Under 65
B002 family
Under 65
E 005 himself
65 years old or older

Here, the weight α ₁ is determined to be a large value as a whole by the display rule. For example, when the relationship type is “person”, the weight α ₁ is determined as “2.5”, and when the relationship type is “family”, the weight α ₁ is determined as “2”. “For an acquaintance, the weight α ₁ is determined to be“ 1.5 ”. Further, when the relationship type is “other”, the weight α ₁ is determined to be “1.2”. Furthermore, if the person in the image is not photographed, the weight alpha ₁ is determined as "1.2".

According to FIG. 4, two images are displayed, and an example of a display size ratio according to the relationship type of the subject person with respect to the viewer (E) is shown below.
[Subject Person] [Relationship Type] [Display Size Ratio (S × α ₁ )]
A / B Family / Family S × 2
BE Family / Principal S × 2.5

  The age, which is the personal attribute of the viewer, may be stored in advance by the viewer himself / herself. In addition, a technique of automatically estimating the age from a face photograph obtained by photographing a viewer's face may be applied.

  FIG. 5 is a functional configuration diagram of the screen output apparatus according to the present invention.

  Referring to FIG. 5, the screen output device 1 includes a memory card 101, an input interface 102, a display 103 that displays screen data, and a print function unit 104 that prints screen data on a physical paper medium. A screen output device including the display 103 is a digital photo frame, and a screen output device including the print function unit 104 is a printer.

  The memory card 101 is an SD (Secure Digital) card, for example, and is often detachable from the digital photo frame 1. The memory card 101 can be inserted into a digital camera, for example, and accumulates a large number of images taken by the digital camera. The digital photo frame 1 continuously displays a large number of images stored in the memory card 101 on the display 103 like a slide show. When browsing with a terminal such as a personal computer, a mobile phone, a smartphone, or a tablet, the photo is often stored in a storage server on the Web or a storage unit of these terminals, and the memory card 101 plays this role.

  The input interface 102 acquires information about the viewer, and may be a device that can acquire biometric data according to the embodiment or a keyboard that can be input by the viewer. Devices that can acquire biometric data include cameras, microphones, sensors, and the like. For example, in the case of a camera, the viewer's face photo data can be acquired. Moreover, if it is a microphone, a viewer's voice data can be acquired. Furthermore, if it is a sensor, according to the function, a reader's fingerprint data, vein data, iris data, etc. can be acquired. Information acquired by the input interface 102 is used to identify the viewer.

  Further, according to FIG. 5, the digital photo frame 1 includes a subject information acquisition unit 11, a subject information storage unit 12, a viewer information acquisition unit 13, a display rule storage unit 14, and a display size ratio determination unit 15. And a screen output unit 16. These functional components are realized by executing a program that causes a computer mounted on the screen output device to function.

[Subject information acquisition unit 11]
The subject information acquisition unit 11 acquires, for each image stored in the memory card 101, a subject person identifier of a person shown in the image. The image associated with the subject person identifier is output to the subject information storage unit 12.

  The subject information acquisition unit 11 may be an image management program that automatically detects a subject person from an image. This program extracts face regions from photographs, groups them by the identity of the faces in many photographs, and sequentially assigns “name tags” to the faces. Typical image management programs include Picasa (registered trademark) provided by Google (name tag function after v3.5), Microsoft's Windows Live Photo Gallery (registered trademark), Apple's iPhoto ' 09 (registered trademark). According to the present invention, it is only necessary that a subject person identifier (name tag) is given to an image, and this subject authentication processing is not limited to automatic, but may be manual.

  According to the above-described embodiment, the image displayed on the display has been described as a still image, but it can also be realized as a moving image (video). In order to detect a person identifier, face recognition authentication or gait authentication for a key frame of a moving image can be applied.

[Subject information storage unit 12]
The subject information storage unit 12 stores, for each image, a subject person identifier of a person shown in the image in association with the image. The image to which the subject person identifier is assigned is output to the display size ratio determination unit 15. Note that the subject information storage unit 12 may be integrated with the memory card 101 and may add a subject identifier to an image stored in the memory card 101.

[Browser information acquisition unit 13]
The related person information acquisition unit 13 includes a biometric data input unit 131, a viewer specifying data storage unit 132, a viewer specifying unit 133, a relationship type information storage unit 134, and a personal attribute information storage unit 135. The browser information acquisition unit 13 acquires information for specifying a viewer who is currently browsing the display via the input interface 102, and specifies a browsing person identifier.

  As the simplest method for specifying the viewer, the viewer can be input a browsing person identifier. For example, the viewer name and the browsing person identifier may be acquired by voice recognition based on text input using a keyboard or voice input using a microphone. Also, the login ID for the SNS server can be handled as a browsing person identifier.

  As another method, the biometric data of the viewer can be acquired and the viewer can be specified from the biometric data.

The biometric data input unit 131 inputs the biometric data of the viewer from the input interface 102. The biometric data includes the following, for example.
Reader's face photo acquired by camera Reader's voice data acquired by microphone Reader's fingerprint data acquired by fingerprint sensor Viewer's vein data acquired by vein sensor Viewer acquired by pupil sensor Iris data

  The browser specifying data storage unit 132 stores a set of viewer specifying data including biometric data associated with the person identifier. For example, the person who browses the photo frame 1 is a relatively limited family, acquaintance, etc., and biometric data of those persons is stored in advance.

The browser specifying unit 132 inputs biometric data, authenticates using the viewer specifying data, and specifies a viewer identifier for the biometric data of the viewer. The authentication here is as follows.
Image authentication for the viewer's face photo Voice (voice print) authentication for the viewer's voice data Fingerprint authentication for the viewer's fingerprint data Vein authentication for the viewer's vein data Iris authentication for the viewer's iris data The specified viewer identifier is And output to the display size ratio determination unit 15.

  When the types of biometric data (for example, face data) are the same in the viewer specifying data storage unit 132 and the subject information storage unit 12, they can be shared.

  The relationship type information storage unit 134 stores the relationship type information of the subject person identifier of the image with respect to the browsing person identifier of the viewer. Such relationship type information can also be obtained from an SNS (Social Networking Service) server such as facebook (registered trademark) or mixi (registered trademark) as described above. According to the SNS server, there is a mode for designating family members and lovers. As the relationship type information, for example, a person identifier of “family” and a person identifier of “acquaintance” are associated with the viewer person identifier as the person concerned. The relationship type information is output to the display size ratio determination unit 15.

  As described above, the shortness of the SNS social graph path may be used as the relationship type. Intimacy such as the number of messages via the SNS server may be used. In particular, when browsing an image stored in the SNS server or an image associated with the SNS server, the relationship type obtained from the SNS server may be applied.

  The personal attribute information storage unit 135 stores personal attribute information of the viewer. The personal attribute is, for example, an age-specific attribute corresponding to the viewer's visual ability. The personal attribute information is output to the display size ratio determination unit 15.

[Display rule storage unit 14]
Display rule storage unit 14, by the relationship type of image photographed person identifier for viewing person identifier visitors stores display rule defining the weights alpha ₁ for the basic size ratio of the image. Specifically, the display rule weight α ₁ is a value larger than the basic size ratio when the subject person identifier of the image includes the viewer person identifier of the viewer, or the subject person identifier of the image If the browsing person identifier of the viewer is not included, the display size ratio may be a value smaller than the basic size ratio.

Further, the display rule weight α ₁ may be a display size ratio that is smaller than the basic size ratio when the viewer person identifier of the viewer is included in the subject person identifier of the image. Furthermore, the display rule weight α ₁ may be a display size ratio that is larger than the basic size ratio as the viewer's age zone increases.

The display rule, by personal attributes in viewing person identifier visitors may be configured to further define the weight alpha ₂ relative to the base size ratio of the image.

[Display size ratio determination unit 15]
The display size ratio determining unit 15 uses the display rule storage unit 14 to determine the display size ratio determining unit 15 according to the relationship type and / or personal attribute of the subject person identifier of the person shown in the image to be displayed with respect to the browsing person identifier of the viewer. Determine the display size ratio of the image. The display size ratio is determined by multiplying the basic size ratio S by the weight α of the display rule. The larger the value of the weight α, the larger the display size ratio. The determined display size ratio R is output to the screen output unit 16.

  In addition, when the viewer person identifier of the image is included in the subject person identifier of the image, the display size ratio determination unit 15 uses the face area size of the viewer in the image to increase the face area size with respect to the full screen size. The ratio may be further weighted.

  The display size ratio determination unit 15 further includes a face area detection function to detect the face area size of the subject person. The face area detection function extracts a feature amount for each photographic image stored in the subject information storage unit 12 and detects the face area of the subject person. Here, the face area detection technology can be detected by applying a face detector library based on a cascade classifier using OpenCV Haar Feature features to images converted to a plurality of resolutions (for example, non-detection). (See Patent Document 3).

  Note that the face area detection function may use a face detection function in an image management program that automatically detects a subject person from a photographic image. Typical image management programs include Picasa (registered trademark) provided by Google (name tag function after v3.5), Microsoft's Windows Live Photo Gallery (registered trademark), Apple's iPhoto ' 09 (registered trademark).

  When the display size ratio determination unit 15 includes a face area detection function, it is possible to perform further weighting so as to be “proportional” to the ratio of the face area sizes. In this case, the larger the face area size ratio, the larger the display size and the more likely the layout will be. This is preferably used in the “normal mode”.

  Conversely, further weighting can be performed so as to be “inversely proportional” to the ratio of the face area sizes. In this case, regardless of each image display size in the layout, the face area of a certain type of person is likely to be a layout with a constant face area. This is preferably used in the “shy mode”.

  As another embodiment, the display size ratio determination unit 15 includes a viewer and their related persons when the viewer and the related person identifier (family, acquaintance) exist in the same image. An image may be cut out. It is also preferable to display the clipped image at the display size ratio as described above.

[Screen output unit 16]
The screen output unit 16 outputs screen data in which the image is laid out with a size corresponding to the display size ratio for each image. When screen data spans multiple pages, it is output continuously. The screen data is output to the display unit 103 or the print function unit 104.

  FIG. 6 shows a fifth display image in the present invention.

  According to FIG. 6, the frame division technique described in Patent Document 3, Non-Patent Document 1, and Non-Patent Document 2 is applied to the present invention. According to this technique, the screen division number N is set in advance, but the display area S and the division number N are determined according to the display size ratio R (and the personal attributes of the viewer) of the present invention. .

  Nmax may be preset according to the screen size. For example, 7 is 7 inches, 14 is larger than 12 inches, and 18 is larger than it. When viewing the same image in a remote place using different displays, the smaller display size Nmax is adopted. Similarly, Nmin is determined in advance. For example, 1 for all display sizes. (If Nmin is 1, only one image may be displayed on the screen. Nmax is 2 or more.)

(1) Method of determining the maximum number of divisions Nmax according to the number of viewers The maximum number of divisions Nmax and the average number of divisions Nave are determined according to the number of viewers. For example, when the number of viewers is larger than a predetermined number, the maximum division number Nmax is reduced and the basic size S is increased. For example, it is set to a half value of the preset Nmax value.

(2) The maximum division number Nmax is determined according to the visual ability of the viewer. The maximum division number Nmax and the average division number Nave are determined according to the visual ability of the viewer. For example, the visual ability tends to decrease as the age increases. In this case, the maximum division number Nmax is decreased and the basic size S is increased. For example, it is set to a half value of the preset Nmax value. When specifying the minimum area Smin, for example, the value of the minimum area is doubled so that it is displayed larger.

  The display screen is divided into N frames by a value calculated from the maximum division number Nmax and the average division number Nave. The one display area is a display area S. The screen output unit 16 extracts an image group that is divided so that the sum of display areas of a plurality of images is close to the image pasting area (screen size), and displays images included in the image group with a display size S. The image is enlarged / reduced according to the above and laid out on a single screen.

  The display area S given to each image is obtained from the display size ratio R. For example, the display size ratio R is acquired for a plurality of images to be displayed, and the area of the display size ratio R that is the smallest among them is (screen size / Nmax), and the display size ratio R is The display area S is calculated by a linear function so that the maximum area of R becomes (screen size / Nmin). As another method, two sets of (display area, basic size ratio) are given, and the display area S is calculated by a linear function. For example, using the average division number Nave, the area (screen size / Nave) matches a certain value (for example, R = 1) of the display size ratio R, and is the specified minimum display area Smin (screen size / Nmax)? And S is recalculated with a linear function so that the minimum value of the display size ratio R matches. However, when the display area S exceeds (screen size / Nmin), the display area S is set to (screen size / Nmin).

  Each image is assigned to each frame so as to reflect the area S as much as possible. For example, the process of selecting a plurality of images appropriately is repeated on the first page until the screen size is reached, and the first page is laid out using a set of images whose sum is closest to the screen size. The division number N is the number of selected images. For the second page, the same processing is repeated except for the image used for the first page. Similarly, when the order of images is determined, the pages are divided so that the sum is close to the screen size, and the layout is performed so as to reflect the display area S as much as possible. Also in this case, the division number N is automatically determined by the number of selected images.

As another embodiment, when continuously displayed as a slide show, the more weight alpha ₁ is large, not only increasing the display size, it is also preferable to increase the display time. In that case, the display time is set as follows, for example.
Threshold value T1 <α ₁ <T2: The display time is 1.5 times longer than the normal time
α ₁ ≧ T2: The display time is made twice as long as the normal time.
In addition, it is also preferable that the layout calculates the area of the margin, selects one image that can be arranged in the area, or adds a plurality of images that can be arranged in the area, and arranges the image at the position.

Furthermore, as another embodiment, it is also preferable to increase the display time for an image having a larger value of the weight α ₁ , the weight α _2, or the weight α ₁ × α ₂ . An image that is to be displayed in an emphasized manner is displayed larger and for a longer time.

  As described above in detail, according to the screen output apparatus, program, and method of the present invention, it is possible to output screen data having a layout in which an image that is highly interesting to the viewer is displayed in an emphasized manner. According to the present invention, in particular, by automatically determining the display size according to the relationship between the viewer and the subject person, the layout can be determined according to the relationship between the persons without specially setting parameters by the viewer. Changing screen data is output. This screen data is displayed on a display like a slide show or printed on a paper medium like an album. The layout of the image data varies depending on the viewer who views the image data.

  According to the present invention, by increasing the display size of an image to be emphasized according to the importance of the relationship between persons, the listability is higher than that of a single image display, and the size of the frame is clearly displayed. The image can be browsed with a layout having a high subjective evaluation and a frame size that meets the user's request.

  Various changes, modifications, and omissions of the above-described various embodiments of the present invention can be easily made by those skilled in the art. The above description is merely an example, and is not intended to be restrictive. The invention is limited only as defined in the following claims and the equivalents thereto.

DESCRIPTION OF SYMBOLS 1 Screen output device 101 Memory card 102 Input interface 103 Display part 104 Printing mechanism part 11 Subject information acquisition part 12 Subject information storage part 13 Reader information acquisition part 131 Biometric data input part 132 Data storage part 133 for viewer specification 133 Viewer specification Part 134 Relationship type information storage part 135 Personal attribute information storage part 14 Display rule storage part 15 Display size ratio determination part 16 Screen output part

Claims (17)

In a screen output device that lays out and outputs a plurality of images on one screen,
Subject information storage means for storing the subject person identifier of the person appearing in the image in association with each image;
Browser information acquisition means for acquiring a browsing person identifier of a viewer who browses the image;
Display size ratio determining means for determining a display size ratio of the image according to a relation type of a subject person identifier of the person shown in the image with respect to the browsing person identifier of the viewer;
A screen output device comprising screen output means for outputting screen data in which the image is laid out in a size corresponding to the display size ratio for each image.   The screen output device according to claim 1, wherein the screen output device includes a display that displays the screen data output by the screen output unit.   The screen output apparatus according to claim 1, wherein the screen output apparatus has a print function for printing the screen data output by the image output unit on a paper medium. By the relationship type of subject person identifier of an image for viewing by Person identifier Audience further comprises a display rule storage means for defining a weighting alpha ₁ to the basic size ratio of the image,
The browsing information acquisition means also acquires a person identifier for each relationship type with respect to the browsing person identifier,
The display size ratio determining means uses the display rule storage means, in accordance with the relationship type of the photographed person identifier for the viewing person identifier, the weighted values of the weights alpha ₁ in the basic size ratio, the display size ratio 4. The screen output device according to claim 1, wherein the screen output device outputs the image as The weight α ₁ of the display rule storage means is
When the viewer person identifier of the viewer is included in the subject person identifier of the image, a value larger than the basic size ratio is set as the display size ratio, or
5. The screen output device according to claim 4, wherein when the viewer person identifier of the image does not include the viewer person identifier of the image, a value smaller than the basic size ratio is set as the display size ratio. . The weight α ₁ of the display rule storage means is
The screen output device according to claim 4, wherein when the browsing person identifier of the viewer is included in the subject person identifier of the image, a value smaller than the basic size ratio is set as the display size ratio. The display size ratio determining means includes
When the subject person identifier of the image includes one or more predetermined person identifiers, the face area size detected in the image is detected using the face area detection function, and the weight is determined according to the size of the face area size. The screen output device according to claim 4, wherein α ₁ is further weighted. The weight alpha ₁ display rule storage means, in accordance with the relationship type obtained from social graph SNS (Social Networking Service), or, depending on the shortest path distance between the viewer person identifier and the subject person identifier ( The screen output device according to claim 4, wherein a larger value is determined as the distance is shorter. The display rule storage means, the personal attributes of the viewing person identifier visitors further defines a weight alpha ₂ relative to the base size ratio of the image,
The browsing information acquisition means acquires personal attributes of the browsing person identifier,
The display size ratio determining means uses the display rule storage unit, according to the personal attributes for the viewing person identifier, a further was weighted value weighted alpha ₂ to the basic size ratio, and outputs it as the display size ratio The screen output device according to claim 4, wherein the screen output device is a screen output device. The personal attribute is age-specific according to the viewer's visual ability,
The weight alpha ₂ display rule storage means, the viewer as age group increases, the screen output device according to claim 9, characterized in that the display size ratio value greater than the basic size ratio. 11. The screen output apparatus according to claim 9, wherein an image having a larger value of the weight α ₁ , the weight α _2, or the weight α ₁ × α ₂ has a longer display time. The screen size is divided into N display sizes, and the one display size is set as the basic size ratio.
The screen output means extracts an image set divided so that the sum of display sizes of a plurality of images in a continuous order is close to the screen size, and images of different display sizes included in the image set are extracted as one sheet. The screen output device according to claim 4, wherein the screen output device is laid out in a screen size.   13. The screen output apparatus according to claim 12, wherein N divided display sizes are determined based on the number of viewers. The viewer information acquisition means includes:
Biometric data input means for inputting the biometric data of the viewer who is currently browsing;
A reader specifying data storage means for storing a set of viewer specifying data comprising biometric data associated with the person identifier;
The screen according to any one of claims 1 to 13, further comprising: a viewer specifying unit that outputs a viewer identifier for the biometric data of the viewer using the viewer specifying data. Output device.   15. The biometric data is facial photograph, voice data, fingerprint data, vein data or iris data, and the authentication is image authentication, voice authentication, fingerprint authentication, vein authentication or iris authentication. The screen output device described in 1. In a screen output program for causing a computer mounted on a device that lays out and outputs a plurality of images to one screen,
Subject information storage means for storing the subject person identifier of the person appearing in the image in association with each image;
Browser information acquisition means for acquiring a browsing person identifier of a viewer who browses the image;
Display size ratio determining means for determining a display size ratio of the image according to a relation type of a subject person identifier of the person shown in the image with respect to the browsing person identifier of the viewer;
A screen output program that causes a computer to function as image output means for outputting screen data in which the image is laid out with a size corresponding to the display size ratio for each image. In a screen output method in an apparatus for laying out and outputting a plurality of images on one screen,
For each image, it has a subject information storage unit that stores a subject person identifier of a person shown in the image in association with the image,
A first step of acquiring a browsing person identifier of a viewer who browses the image;
A second step of determining a display size ratio of the image according to a relation type of a subject person identifier of a person appearing in the image with respect to the browsing person identifier of the viewer;
And a third step of outputting screen data in which the image is laid out in a size corresponding to the display size ratio for each image.

Images