JP5348682B2 - Image management apparatus, control method thereof, and program - Google Patents

Image management apparatus, control method thereof, and program Download PDF

Info

Publication number
JP5348682B2
JP5348682B2 JP2008293409A JP2008293409A JP5348682B2 JP 5348682 B2 JP5348682 B2 JP 5348682B2 JP 2008293409 A JP2008293409 A JP 2008293409A JP 2008293409 A JP2008293409 A JP 2008293409A JP 5348682 B2 JP5348682 B2 JP 5348682B2
Authority
JP
Japan
Prior art keywords
person
determination
step
disclosure level
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2008293409A
Other languages
Japanese (ja)
Other versions
JP2010122733A (en
Inventor
恭二 平田
Original Assignee
Necビッグローブ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Necビッグローブ株式会社 filed Critical Necビッグローブ株式会社
Priority to JP2008293409A priority Critical patent/JP5348682B2/en
Publication of JP2010122733A publication Critical patent/JP2010122733A/en
Application granted granted Critical
Publication of JP5348682B2 publication Critical patent/JP5348682B2/en
Application status is Active legal-status Critical
Anticipated expiration legal-status Critical

Links

Images

Description

  The present invention relates to an image management apparatus, a control method thereof, and a program, and more particularly to a technique for appropriately setting an image disclosure level.

  The present invention is not limited, but is an effective technique when applied to a photo publishing service. In the photo publishing service, there is a need for a technique related to attribute information generation for effectively using held images, and more specifically, a method or apparatus for appropriately determining the release level of held images. Providing is an issue.

Many services, such as news, web logs, and social network services, have been proposed and used in practice, where information held by individuals and companies is stored on the Internet and shared and used by multiple users. In such an environment, with regard to photography, many album services have been proposed in which photos taken by individuals are stored on a network storage and shared with friends, acquaintances, groups, etc., or disclosed to an unspecified number of users. Is being operated.
Patent Document 1 discloses a technique related to a repository service for users to share and exchange photos.

When storing personal information in a network storage and sharing it with others, it is usually common to set the disclosure level of the information when storing or storing the information. The same applies when photos are stored in network storage and shared. The user sets a public level for each photo when accumulating the photo images, and operates the photo images according to the set public level. Patent Document 2 discloses a technique relating to a method of designating the relationship between an editing authority level and a disclosure level of videos and information published on a homepage based on a tree diagram as to individuals, companies, and families.
In addition, a method of managing private information with a password is also performed. Patent Document 3 discloses a technique relating to image data supply that allows personal information to be freely browsed while being kept secret.
JP 2005-129056 A JP 2003-203092 A JP 2002-142051 A

  In the system proposed above, the user manually designates the publication level when storing and registering on the network of photographic images to be shared. However, in the method of setting the public level manually, the user needs to perform a troublesome process of setting the public level when registering. When an image taken by a photographing device such as a camera is immediately stored in a network storage, the user has to perform a work of setting a public level every time a photograph is taken, which is very troublesome.

  It is also conceivable to set default disclosure level information for a photograph taken in advance and automatically assign the set disclosure level. However, in this case, if the release level intended by the user for the photo is the same as the preset release level, there is no need to perform the troublesome processing of setting the release level. Must be specified. In addition, when such a method is used, the setting change may be forgotten when the image is registered, and the image may be registered at a public level that is not desired by the user.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide an image management apparatus, a control method thereof, and a program for appropriately setting a public level of an image such as a photograph without requiring a user. To do.

  To achieve the above object, the present invention comprises the following arrangement.

An image management apparatus according to the present invention includes:
A determination reference pattern storage means for storing a plurality of patterns criteria for associating the person detection result and the disclosure level,
Among patterns of the criterion pattern of the plurality of determination criteria stored in the storage unit, a determination reference storage means for storing a determination criteria selected by the user for each of the users,
A person detecting means for detecting a person from the input image;
Based on the determination criteria for each of the user stored in the criterion storage means, and disclosure level determination means for determining the disclosure level corresponding to the person detection result of the human detection means,
I have a,
The disclosure level determining means recognizes the person detected by the person detecting means, determines whether or not the image includes a specific person, and the image includes the specific person The disclosure level is determined to be non-public or public, and when the image includes a plurality of persons and the determination standards of the disclosure levels of the plurality of persons are different from each other, Adjust the level,
And wherein a call.
An image management apparatus according to the present invention
A determination reference pattern storage means for storing a plurality of determination reference patterns for associating the person detection result with the disclosure level;
A criterion storage unit that stores, for each of the users, a criterion selected by a user from among the plurality of criteria patterns stored in the criterion pattern storage unit;
A person detecting means for detecting a person from the input image;
A public level determining unit that determines a public level corresponding to a person detection result by the human detection unit based on the determination criterion for each user stored in the determination criterion storage unit;
Have
The disclosure level determining means recognizes a person detected by the person detecting means using a specific person as a key, determines whether or not the specific person is included in the image, and the specific person The disclosure level is determined to be private or public for a plurality of captured images.
It is characterized by that.

An image management apparatus control method according to the present invention includes:
A determination reference pattern storage step for storing a plurality of determination reference patterns in the memory for associating the person detection result with the disclosure level;
Among patterns of the criterion pattern of the plurality of determination criteria stored by the storage step, and the determination reference storage step of storing the determination criteria selected by the user in the memory for each of the users,
A person detection step for detecting a person from the input image;
Based on the determination criteria of each stored the user that by the criterion storing step, and disclosure level determination step for determining the disclosure level corresponding to the person detection result of the person detection step,
Equipped with a,
In the disclosure level determination step, the person detected in the person detection step is recognized, it is determined whether or not the image includes a specific person, and the image includes the specific person The disclosure level is determined to be non-public or public, and when the image includes a plurality of persons and the determination standards of the disclosure levels of the plurality of persons are different from each other, Adjust the level,
And wherein a call.
The control method of the image management apparatus according to the present invention includes:
A determination reference pattern storage step for storing a plurality of determination reference patterns in the memory for associating the person detection result with the disclosure level;
A determination criterion storage step of storing, in the memory for each user, a determination criterion selected by a user from the plurality of determination criterion patterns stored in the determination criterion pattern storage step;
A person detection step for detecting a person from the input image;
A disclosure level determination step for determining a disclosure level corresponding to a person detection result by the person detection step based on the determination criterion for each user stored in the determination criterion storage step;
With
In the disclosure level determining step, the specific person is used as a key, the person detected in the person detecting step is recognized, it is determined whether or not the specific person is included in the image, and the specific person The disclosure level is determined to be private or public for a plurality of captured images.
It is characterized by that.

An image management program according to the present invention is stored in a computer.
A determination reference pattern storage step for storing a plurality of determination reference patterns in the memory for associating the person detection result with the disclosure level;
Among patterns of the criterion pattern of the plurality of determination criteria stored by the storage step, and the determination reference storage step of storing the determination criteria selected by the user in the memory for each of the users,
A person detection step for detecting a person from the input image;
Based on the determination criteria of each stored the user that by the criterion storing step, and disclosure level determination step for determining the disclosure level corresponding to the person detection result of the person detection step,
Was executed,
In the disclosure level determination step, the person detected in the person detection step is recognized, it is determined whether or not the image includes a specific person, and the image includes the specific person The disclosure level is determined to be non-public or public, and when the image includes a plurality of persons and the determination standards of the disclosure levels of the plurality of persons are different from each other, Adjust the level,
And wherein a call.
An image management program according to the present invention is stored in a computer.
A determination reference pattern storage step for storing a plurality of determination reference patterns in the memory for associating the person detection result with the disclosure level;
A determination criterion storage step of storing, in the memory for each user, a determination criterion selected by a user from the plurality of determination criterion patterns stored in the determination criterion pattern storage step;
A person detection step for detecting a person from the input image;
A disclosure level determination step for determining a disclosure level corresponding to a person detection result by the person detection step based on the determination criterion for each user stored in the determination criterion storage step;
And execute
In the disclosure level determining step, the specific person is used as a key, the person detected in the person detecting step is recognized, it is determined whether or not the specific person is included in the image, and the specific person The disclosure level is determined to be private or public for a plurality of captured images.
It is characterized by that.

  According to the present invention, it is possible to provide an image management apparatus, a control method thereof, and a program for appropriately setting a disclosure level of an image such as a photograph without requiring the user to take time.

Hereinafter, embodiments of the present invention will be described in detail.
The system according to the present embodiment described below includes an image input unit that inputs an image, a person detection unit that analyzes an image input by the image input unit and detects a person included in the image, and a person detection result And a public level judging means for judging the public level based on the image, and judges the public level of the image based on the detection result of the person in the input image. By adopting such a configuration, it becomes possible for a user to assign a public level without manually setting a public level after taking a picture, and sharing or using an image while retaining human information. It is possible to achieve the problem of determining the public level of the image for performing the image in a manner that reduces the load on the user.

  In addition, by adopting such a configuration, it is possible to provide a service that reduces the load on the user in a service that stores and uses photographs on a network. Further, by forgetting the setting of the disclosure level, it is possible to provide a service that avoids a situation where an image is disclosed at a disclosure level that does not conform to the user's intention. As a result, there is an effect that it is possible to further activate the storage and use of photographs in the service.

(First embodiment)
A first best mode for carrying out the present invention will be described with reference to the drawings.
Referring to FIG. 1, the first best mode of the present invention is an image input means 10100, a person detection means 10200, a disclosure level determination means 10300, an image recording means 10400, an accumulation means 10500, and a criterion storage means. 10600. Next, functions of each unit included in the present embodiment will be described.

  The image input means 10100 has a function of inputting a photographic image. The person detection means 10200 has a function of receiving a photographic image input from the image input means 10100 and detecting a person appearing in the photographic image. The disclosure level determination unit 10300 has a function of receiving the person detection result from the person detection unit 10200 and determining the disclosure level. The image recording unit 10400 has a function of receiving an image from the image input unit 10100, receiving a disclosure level from the disclosure level determining unit 10300, and recording it in the storage unit 10500. The accumulation unit 10500 has a function of accumulating images.

  The image input means 10100 is, for example, a CPU equipped with a program that operates according to a predetermined rule. In this case, for example, a function of reading an image file stored in an external storage medium such as a hard disk or a memory is provided. The image input means may be an external state CCD sensor group such as an image pickup unit of a video camera.

  The person detection means 10200 is a CPU equipped with a program that operates according to a predetermined rule, for example. A feature amount may be extracted from the image information, and the person may be detected based on whether or not a pattern of the feature amount detected when a person exists prepared in advance as dictionary information is observed. As person detection, instead of detecting the person itself, a specific part unique to the person such as face, upper body, and rear view may be detected, and the person may be detected based on the detection result. The person detection may be performed only for a person whose face portion exceeds a predetermined size. In this case, processing efficiency can be improved. The CPU may be a dedicated CPU or a CPU shared with other components.

  The public level determining means 10300 is, for example, a CPU equipped with a program that operates according to a predetermined rule. Predetermined criteria for the correspondence between the person detection result and the public level are stored in the criterion storage means 10600, and when the detection result is input, the criterion is handled based on the stored criterion. Select a publication level. The input may be only the person detection means, or may be configured to make a determination based on a plurality of inputs such as the user's history, time, other image feature amounts, and determination result patterns. The CPU may be a dedicated CPU or a CPU shared with other components.

  The image recording means 10400 is, for example, a CPU equipped with a program that operates according to a predetermined rule. The image input by the image input unit 10100 is recorded in the storage unit 10500 in association with the determined disclosure level. When images are stored in a shared storage connected to a network, communication means may be provided and the input image may be operated to be stored in a storage at a remote location on the network. In addition, a security function such as encryption or authentication may be further provided in order to record an image safely at a remote location on the network. The CPU may be a dedicated CPU or a CPU shared with other components.

  As an example, the storage unit 10500 includes a storage device such as a hard disk / flash memory, and may be a dedicated storage device or may be used in combination with another storage device. The input image may be stored in the form of a file, or may be stored in the form of a database describing the registrant, registration time, size, release level, and the like. Moreover, it may be a portable terminal that accumulates images according to the disclosure level.

  The determination criterion storage unit 10600 has a function of storing / accumulating the correspondence between the person detection result and the disclosure level as a “determination criterion”. Note that the criterion storage unit 10600 is a functional unit that is realized by a software program using hardware such as a hard disk or a flash memory.

  FIG. 2 is a diagram illustrating an example of a hardware configuration as an example of the construction of a system that stores and uses photographic images on a network.

  A photo sharing server 20200, a plurality of photo registration terminals 20310, 20320,... 203N0 and a plurality of photo browsing terminals 20410, 20420,. An example of the communication network 20100 is the Internet, but it may be a corporate LAN or a private network.

  The photo sharing server 20200 is realized by a computer having a communication unit 20210, a photo sharing / publication control CPU 20220, and a data storage unit 20230 which is a large-capacity storage. The photo sharing / publishing control CPU 20220 performs data exchange and file management for sharing and publishing photos. The data storage unit 20230 stores photographic images to be shared / disclosed and meta information associated with each photographic image. Here, it is assumed that the meta information of the photographic image includes information indicating the disclosure level of the photographic image.

  A photo registration terminal 20310 is a photo shooting unit 21314 such as a camera, a CPU 20315 that handles various data processing, an instruction input unit 200313 that gives instructions for shooting and registration of a keyboard, buttons, and the like, and a user instruction and a photo image check. A terminal equipped with a communication unit 20311 for communicating with a monitor 20312 and a network and a data storage unit 20316 for storing data such as photographic images and meta-information of the photographic images and various programs, a mobile phone with a camera, a computer with a camera function This includes a communication function and a digital camera with a built-in CPU. Although the photo registration terminal is described as one module in FIG. 2, it may be realized by a combination of a plurality of hardware such as a digital camera and a computer, a video camera and a dedicated communication dedicated terminal. In that case, one hardware may be configured such that there is no photographing device or no monitor. The communication unit may be a communication unit that bundles a plurality of photo registration terminals and a communication unit that communicates with a photo sharing server via a network, and a plurality of communication devices may be installed in a hierarchical structure.

  A photo browsing terminal 20410 includes a control CPU 20414 that controls various data processing, an instruction input unit 20412 that supports the browsing of photos such as a keyboard and buttons, and a similar 204413 network that confirms user instructions and displays photo images. A terminal equipped with a communication unit 20411 for communication with a data storage unit for storing data such as photographs and various programs, a personal computer, a mobile phone with a camera, a communication function, a digital camera with a built-in CPU, a car navigation terminal, etc. It hits. Similar to the photo registration terminal 20310, all functions need not be realized by a single terminal, and may be realized by a plurality of terminals such as a server and a thin client, a mobile phone and a home server.

  It should be noted that the photo browsing terminal and the photo registration terminal may be the same terminal and can be used for photo registration and photo browsing according to a user instruction.

  When the hardware configuration shown in FIG. 2 is adopted, the image input unit 10100 in FIG. 1 is realized by, for example, cooperation between the imaging unit 20314, the control CPU 20315, and the instruction input unit 20313. When not linked to an imaging device such as a camera, the control CPU 20315 may read and input an image stored in advance from the data storage unit 20316 in accordance with an instruction via the instruction input unit 20313. The communication may be either wired communication in which information is exchanged by a cable or wireless communication in which information is exchanged by a wireless signal, or cooperation.

  Similarly, the person detection unit 10200 and the disclosure level determination unit 10300 are implemented on the data storage unit 20316 and the control CPU 20315 that store programs describing operations. The image recording means 10400 includes a control CPU 20315 on the photo registration terminal 20310 side, a data storage unit 20316, a communication unit 20311 and a communication network 20100, a communication unit 20210 on the photo sharing server 20200, a photo sharing / publication control CPU 20220, and a control program. It can be implemented by a combination of data storage units 20230 to be stored. The storage means can be mounted on the data storage unit 20230 of the photo sharing server. In addition, the person detection unit 10200 and the disclosure level determination unit 10300 may be mounted on the photo sharing server 20200. In this case, the photo input means is configured to include a communication unit 20311 of the photo registration terminal 20310 and a communication unit 20210 of the photo sharing server 20200. The photo recording unit 10400 is implemented by the CPU 20220 and the data storage unit 20230 on the photo sharing server side. Is possible.

  Next, an overall operation example of the present embodiment will be described with reference to the flowcharts of FIGS. 1 and 3.

  The image input means 10100 inputs a photographic image (S1001). Captures and inputs the output from an imaging device mounted on a digital camera or camera-equipped mobile phone. Alternatively, an image designated by the user may be read out and input from images stored in a hard disk or memory.

  The person detection means 10200 analyzes the input photographic image and detects a person appearing in the photographic image (S1002).

  In the present embodiment, as a technique for detecting that a person is in the screen by an image processing technique, several detection methods well known to those skilled in the art can be used. For example, a detection method can be used in which a face area is detected and a person is detected based on the aspect ratio of the detected skin color area and determination of the eyes and lips area. The person detection means 10200 may operate so as to output not only the presence / absence of person detection but also the number of detected persons and the detected person's size and position information as necessary.

  The disclosure level determining means 10300 determines the disclosure level of the photograph based on the detection result of the person in the photograph image and the determination criteria stored in the determination criterion storage means 10600 (S1003).

  The image recording unit 10400 stores the image in the storage unit 10500 based on the determined disclosure level (S0004).

  Next, the process for determining the disclosure level in step S1003 of FIG. 3 will be described in detail below.

  FIG. 4 is a process flow diagram showing an embodiment (part 1) of the criterion for determining the disclosure level. In FIG. 4, if a person is detected as a result of the person detection, it is not disclosed (step S1103), and if no person is detected, it is disclosed (step S1104). As a result, when a landscape photograph such as a sunset or a flower-up is photographed, the disclosure level determining means 10300 makes the photograph public, and when a portrait or group photograph is inputted, the input photograph is not disclosed. . According to the present embodiment, it is possible to provide a system for storing and publishing images in which privacy is strictly protected.

  FIG. 5 is a process flow diagram showing an embodiment (part 2) of a criterion for determining the disclosure level. In FIG. 5, the disclosure level is determined according to the number of detected persons (step S1202). As a result of the person detection, if the number of detected persons is larger than 10 (generally, there are many group photographs), the photograph is made public (step S1203). If the number is 10 or less, the photograph is made private (step S1204). Yes. According to the present embodiment, even if a photograph such as a group photo is taken on the premise of disclosure, an appropriate disclosure level can be determined without requiring the user to set a disclosure standard. it can.

  FIG. 6 is a process flow diagram showing an embodiment (part 3) of the criterion for determining the disclosure level. In FIG. 6, the size (number of pixels) of the detected person on the photographic image is determined in advance, the person is detected (Yes in step S1302), and appears larger than the predetermined specific size. If it is present (step S1303, Yes), it is not disclosed (step S1304), otherwise it is disclosed (step S1305). According to the present embodiment, if the user's face is small and the resolution is low, the user who allows the disclosure without taking the trouble of setting a cumbersome disclosure standard to the user, An appropriate level of publication can be determined.

  As shown in FIGS. 4, 5, and 6, the determination standard determined by the public level determining unit 10300 is based on the presence or absence of person detection, but this is combined with other items such as the size and the number of detected persons. May be. In addition, the detected person may be recognized, and may be determined to be private only when a specific person is included (such as his own child) or a specific category (such as female) is included. .

  As described in the description of FIG. 2, the image recording unit 10400 performs operations such as network connection and authentication as necessary during storage due to the physical positional relationship between the disclosure level determination unit 10300 and the storage unit 10500. I do.

  By adopting the above-described configuration, the public level of the image can be set by detecting a person appearing in the photograph without manual designation by the user.

  In the present embodiment, the determination criterion is associated with a user identifier for identifying each user and stored in the determination criterion storage means 10600 (for each user). The image input means 10100 When inputting a photographic image, a user identifier is also input, and the disclosure level determining unit 10300 reads the criterion for the user identifier input together with the input photographic image from the criterion storage unit 10600 and reads the criterion. The public level may be determined based on the detection result of the person.

(Second Embodiment)
Next, a second best mode for carrying out the present invention will be described with reference to the drawings.
Referring to FIG. 7, the second best mode of the present invention is an image input means 30100 for inputting a photographic image, and a person who receives a photographic image input from the image input means and appears in the photographic image. A person detection means 30200 for detecting the person detection result, a person detection result received from the person detection means, a public level determination means 30300 for determining a public level, an image received from the image input means, and a public level from the public level determination means. An image recording unit 30400 that receives and records in the storage unit 30500, a storage unit 30500 that stores the image, and a determination reference pattern storage unit 30600 that stores a public level determination reference (hereinafter simply referred to as “determination reference”) pattern. Judgment criteria designator for the user to specify the criteria to be used when determining the disclosure level of photographic images And 30700, a determination reference storage unit 30800 for storing the criteria selected by the criterion specifying unit is configured to have a.

  The image input means 30100, the person detection means 30200, the disclosure level determination means 30300, the image recording means 30400, and the storage means 20500 are the image input means 10100, person detection means 10200, and disclosure disclosed in FIG. 1 of the first best mode. Since the level determination unit 10300, the image recording unit 10400, and the storage unit 10500 may have the same configuration, description thereof is omitted.

  An example of the criterion storage means 30600 for storing the criterion pattern is a storage device such as a hard disk / flash memory. Even if it is a dedicated storage device, it may be shared with other storage devices. When storing, it may be in the form of a file describing the rules, or in the form of a table in which the disclosure level is set for each pattern. The determination criterion is associated with a user identifier for identifying each user and stored for each user.

  As an example, the determination criterion designating unit 30700 for the user to specify the determination criterion for determining the disclosure level is an instruction device such as a keyboard or a mouse. If necessary, a user may have a monitor for confirming the contents of the designation, and a CPU that controls the designation for easy designation. Although it may be a dedicated device, it may be shared with other input devices, CPUs, and display devices.

  In this embodiment, an instruction to change the designation of the judgment standard by the judgment standard designating unit 30700 is given together with the input of the user identifier. The determination criterion storage unit 30800 specifies / changes the determination criterion associated with the input user identifier when the determination criterion specifying unit 30700 receives specification / change of the determination criterion accompanied by the input of the user identifier.

  An example of the criterion storage means 30800 for storing the criterion specified in the criterion specification means 30700 is a storage device such as a hard disk / flash memory. Even if it is a dedicated storage device, it may be shared with other storage devices.

FIG. 8 is a flowchart showing the processing flow of the second embodiment of the present invention.
In the present embodiment, the result of detecting an instruction to the present embodiment using the determination criterion designating unit 30700 when the user wants to change the determination criterion setting from the previous one (S2001). When selection of a determination criterion to be adopted is detected from the determination criterion pattern storage unit 30600 (S2002), the determination criterion storage unit 30800 stores the selection criterion (S2003). In step S2003, when the determination criterion desired by the user is not in the determination criterion pattern storage means 30600 or when it is not newly created, it may be newly created and registered.

  If the setting is not changed, the user does nothing regarding the setting. When there is an image to be registered in the storage unit 30500 (S2004, Yes), the image input unit 30100 performs image input (S2005), the person detection unit 30200 performs person detection (S2006), and a disclosure level determination unit. 30300 determines the disclosure level using the person detection result detected by the person detection unit 30200 and the criterion set in step S2003 (S2007), and the image recording unit 30400 discloses the input image and the disclosure to the storage unit 30500. The level is accumulated (S2008).

FIG. 9 is an example of a determination reference pattern stored in the determination reference pattern storage unit.
As a determination reference pattern, in addition to disclosure (pattern 3) when a person is not detected when a person is detected, it is not disclosed when a person is detected with a size greater than a specific size (pattern 5). ), Selected when not more than a specific number of persons are detected (pattern 6), disclosed when a person is detected, and not disclosed when a person is not detected (pattern 4) I do. Further, the list may include information that is disclosed regardless of the person detection result (pattern 1) and information that is not disclosed regardless of the person detection result (pattern 2).

  In FIG. 9, two levels of disclosure and non-disclosure are shown as disclosure levels, but in addition to disclosure and non-disclosure, three levels of disclosure may be set only for a predetermined person. The predetermined person is, for example, a family member, a friend, or an acquaintance. In addition, friends, acquaintances, etc. may be set in different categories in detail. For example, an image in which a large person is detected is disclosed to the person, family, and friends, while an image in which a small person is detected is disclosed only to the person and family. Since the actual hardware configuration can be realized by the configuration shown in FIG. 2, the description thereof is omitted here.

  As an example of person detection performed by the person detection means 30200, in addition to a direct method such as a method based on face detection and a method based on person detection, such a method is used through a method for detecting a landscape and a method for detecting an up of a flower. An indirect (indicating nothing) method may be used that does not include a person.

  As a disclosure level storage method performed by the image recording unit 30400, a disclosure level is recorded as an attribute for each photograph as a photograph attribute. However, at the stage of implementation, the same disclosure level may be recorded together in a form that can be collectively managed by assigning positions as images.

  At the publication level, the automatically set publication level may include an error, and thus may have a function of changing the publication level or re-registering on a browser through the network.

  Moreover, in this embodiment, it is preferable to accumulate | store a criterion for every user and to determine a publication level for every user. In this case, the determination criteria may be configured to be set in advance by each user. By accumulating judgment criteria for each user, one-to-many public level determination is possible, in which judgment is automatically performed for multiple photos, which are photos of the person, for the key of a certain person. become. Therefore, it is possible to provide a system capable of setting a policy for each person.

  In addition, when a plurality of people are photographed in one photo and the judgment criteria of the public level of each person are different, the photo publication level is adjusted to the person with the strictest judgment criteria. Good.

Hereinafter, the effects obtained from the embodiment will be further described.
According to the above-described embodiment, it is possible to automatically determine the public level of a photograph recorded in a network storage or the like. Thus, the user can set the photo release level without performing the troublesome process of setting the photo release level.

  The above-described embodiment can be applied to a photo storage / use service that stores and uses photos on the Internet. In addition, it can also be applied to individual photo storage and use services such as groups, companies, and organizations. Furthermore, it can be applied not only to photographs but also to services for storing and sharing multimedia information including moving images.

  The preferred embodiment of the present invention has been described above, but the present invention is not limited to this, and various modifications can be made without departing from the scope of the invention.

It is a block diagram which shows schematic structure of 1st Embodiment by this invention. It is a block diagram which shows the structural example at the time of comprising 1st Embodiment by this invention as a photo storage and utilization service. It is a flowchart which shows the processing flow of 1st Embodiment by this invention. It is the figure which showed the flow of the 1st method of the publication level determination which concerns on 1st Embodiment by this invention. It is the figure which showed the flow of the 2nd method of the publication level determination which concerns on 1st Embodiment by this invention. It is the figure which showed the flow of the 3rd method of the publication level determination which concerns on 1st Embodiment by this invention. It is a block diagram which shows schematic structure of 2nd Embodiment by this invention. It is a flowchart which shows the processing flow of 2nd Embodiment by this invention. It is a figure for demonstrating the pattern of the criterion based on 2nd Embodiment by this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10100 Image input means 10200 Person detection means 10300 Public level determination means 10400 Image recording means 10500 Image storage means 20100 Communication network 20200 Photo sharing server 20210 Communication part 20220 Photo sharing / publication control CPU
20230 Data storage unit 20310 Photo registration terminal 1
20311 Communication unit 20312 Monitor 20313 Instruction input unit 20314 Imaging unit 20315 Control CPU
20316 Data storage unit 20320 Photo registration terminal 2
203N0 Photo registration terminal N
20410 Photo viewing terminal 1
20411 Communication unit 20412 Instruction input means 20413 Monitor 20414 Control CPU
20415 Data storage unit 20420 Photo browsing terminal 2
204M0 Photo browsing terminal M
30100 Image input means 30200 Person detection means 30300 Disclosure level determination means 30400 Image recording means 30500 Storage means 30600 Determination reference pattern storage means 30700 Determination reference designation means 30800 Determination reference storage means

Claims (12)

  1. A determination reference pattern storage means for storing a plurality of patterns criteria for associating the person detection result and the disclosure level,
    Among patterns of the criterion pattern of the plurality of determination criteria stored in the storage unit, a determination reference storage means for storing a determination criteria selected by the user for each of the users,
    A person detecting means for detecting a person from the input image;
    Based on the determination criteria for each of the user stored in the criterion storage means, and disclosure level determination means for determining the disclosure level corresponding to the person detection result of the human detection means,
    I have a,
    The disclosure level determining means recognizes the person detected by the person detecting means, determines whether or not the image includes a specific person, and the image includes the specific person The disclosure level is determined to be non-public or public, and when the image includes a plurality of persons and the determination standards of the disclosure levels of the plurality of persons are different from each other, Adjust the level,
    Image management apparatus, wherein the this.
  2.   A determination reference pattern storage means for storing a plurality of determination reference patterns for associating the person detection result with the disclosure level;
      A criterion storage unit that stores, for each of the users, a criterion selected by a user from among the plurality of criteria patterns stored in the criterion pattern storage unit;
      A person detecting means for detecting a person from the input image;
      A public level determining unit that determines a public level corresponding to a person detection result by the human detection unit based on the determination criterion for each user stored in the determination criterion storage unit;
      Have
      The disclosure level determining means recognizes a person detected by the person detecting means using a specific person as a key, determines whether or not the specific person is included in the image, and the specific person The disclosure level is determined to be private or public for a plurality of captured images.
      An image management apparatus.
  3. The determination reference pattern storage means stores the disclosure level that specifies whether to disclose the image to a predetermined person in association with the person detection result.
    The image management apparatus according to claim 1, wherein:
  4. The determination criterion storage means can change the patterns of the plurality of determination criteria for each user according to an instruction from the user.
    The image management apparatus according to claim 1 , wherein the image management apparatus is an image management apparatus.
  5. The criterion storage means stores the determination criteria indicating that determines the disclosure level based on the size of the person detected by the person detection means,
    The image management apparatus according to any one of claims 1 to 4 , wherein the image management apparatus is characterized in that:
  6. The criterion storage means stores the determination criteria indicating that determines the disclosure level on the basis of the number of persons detected by the person detection means,
    The image management apparatus according to any one of claims 1 to 4 , wherein the image management apparatus is characterized in that:
  7. The criterion storage means stores the determination criteria indicating that determines the disclosure level based on the number of magnitude or more persons to a preset of the person detected by the person detection means,
    The image management apparatus according to any one of claims 1 to 4 , wherein the image management apparatus is characterized in that:
  8. The person detection means is performed by detecting a face of a person included in the image.
    Characterized in that, the image managing apparatus according to any one of claims 1 to 7.
  9. A determination reference pattern storage step for storing a plurality of determination reference patterns in the memory for associating the person detection result with the disclosure level;
    Among patterns of the criterion pattern of the plurality of determination criteria stored by the storage step, and the determination reference storage step of storing the determination criteria selected by the user in the memory for each of the users,
    A person detection step for detecting a person from the input image;
    Based on the determination criteria of each stored the user that by the criterion storing step, and disclosure level determination step for determining the disclosure level corresponding to the person detection result of the person detection step,
    Equipped with a,
    In the disclosure level determination step, the person detected in the person detection step is recognized, it is determined whether or not the image includes a specific person, and the image includes the specific person The disclosure level is determined to be non-public or public, and when the image includes a plurality of persons and the determination standards of the disclosure levels of the plurality of persons are different from each other, Adjust the level,
    Control method for an image management device according to claim and this.
  10.   A determination reference pattern storage step for storing a plurality of determination reference patterns in the memory for associating the person detection result with the disclosure level;
      A determination criterion storage step of storing, in the memory for each user, a determination criterion selected by a user from the plurality of determination criterion patterns stored in the determination criterion pattern storage step;
      A person detection step for detecting a person from the input image;
      A disclosure level determination step for determining a disclosure level corresponding to a person detection result by the person detection step based on the determination criterion for each user stored in the determination criterion storage step;
      With
      In the disclosure level determining step, the specific person is used as a key, the person detected in the person detecting step is recognized, it is determined whether or not the specific person is included in the image, and the specific person The disclosure level is determined to be private or public for a plurality of captured images.
      And a control method for the image management apparatus.
  11. On the computer,
    A determination reference pattern storage step for storing a plurality of determination reference patterns in the memory for associating the person detection result with the disclosure level;
    Among patterns of the criterion pattern of the plurality of determination criteria stored by the storage step, and the determination reference storage step of storing the determination criteria selected by the user in the memory for each of the users,
    A person detection step for detecting a person from the input image;
    Based on the determination criteria of each stored the user that by the criterion storing step, and disclosure level determination step for determining the disclosure level corresponding to the person detection result of the person detection step,
    Was executed,
    In the disclosure level determination step, the person detected in the person detection step is recognized, it is determined whether or not the image includes a specific person, and the image includes the specific person The disclosure level is determined to be non-public or public, and when the image includes a plurality of persons and the determination standards of the disclosure levels of the plurality of persons are different from each other, Adjust the level,
    Program which is characterized a call.
  12.   On the computer,
      A determination reference pattern storage step for storing a plurality of determination reference patterns in the memory for associating the person detection result with the disclosure level;
      A determination criterion storage step of storing, in the memory for each user, a determination criterion selected by a user from the plurality of determination criterion patterns stored in the determination criterion pattern storage step;
      A person detection step for detecting a person from the input image;
      A disclosure level determination step for determining a disclosure level corresponding to a person detection result by the person detection step based on the determination criterion for each user stored in the determination criterion storage step;
      And execute
      In the disclosure level determining step, the specific person is used as a key, the person detected in the person detecting step is recognized, it is determined whether or not the specific person is included in the image, and the specific person The disclosure level is determined to be private or public for a plurality of captured images.
      A program characterized by that.
JP2008293409A 2008-11-17 2008-11-17 Image management apparatus, control method thereof, and program Active JP5348682B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2008293409A JP5348682B2 (en) 2008-11-17 2008-11-17 Image management apparatus, control method thereof, and program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2008293409A JP5348682B2 (en) 2008-11-17 2008-11-17 Image management apparatus, control method thereof, and program

Publications (2)

Publication Number Publication Date
JP2010122733A JP2010122733A (en) 2010-06-03
JP5348682B2 true JP5348682B2 (en) 2013-11-20

Family

ID=42324046

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2008293409A Active JP5348682B2 (en) 2008-11-17 2008-11-17 Image management apparatus, control method thereof, and program

Country Status (1)

Country Link
JP (1) JP5348682B2 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011007554A1 (en) * 2009-07-16 2011-01-20 パナソニック株式会社 Access control device, access control method, program, storage medium, and integrated circuit
JP5545084B2 (en) * 2010-07-08 2014-07-09 ソニー株式会社 Information processing apparatus, information processing method, and program
JP2012083915A (en) * 2010-10-08 2012-04-26 Canon Inc Image disclosure system, image disclosure method, and imaging device
US10089327B2 (en) 2011-08-18 2018-10-02 Qualcomm Incorporated Smart camera for sharing pictures automatically
KR101579016B1 (en) * 2011-12-16 2015-12-18 엠파이어 테크놀로지 디벨롭먼트 엘엘씨 Automatic privacy management for image sharing networks
JP2013191035A (en) * 2012-03-14 2013-09-26 Fujifilm Corp Image disclosure device, image disclosure method, image disclosure system, and program
JP6373001B2 (en) * 2013-12-25 2018-08-15 キヤノン株式会社 Information processing apparatus, information management apparatus, information processing system, control method therefor, and program
JP6088468B2 (en) 2014-07-31 2017-03-01 富士フイルム株式会社 Image processing apparatus, image processing method, moving image release system, moving image release method, program, and recording medium
JP6067041B2 (en) * 2015-02-18 2017-01-25 エンパイア テクノロジー ディベロップメント エルエルシー Automatic privacy management for image sharing networks

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3740351B2 (en) * 2000-06-23 2006-02-01 日本電信電話株式会社 Image processing apparatus and method, and recording medium on which execution program for the method is recorded
JP2002077862A (en) * 2000-09-05 2002-03-15 Minolta Co Ltd Digital picture communication system
JP2003203092A (en) * 2001-12-28 2003-07-18 Hiroaki Okamoto Digital photo collection system managing authority by tree structure
JP2004054452A (en) * 2002-07-18 2004-02-19 Fuji Photo Film Co Ltd Image censoring system
JP4357178B2 (en) * 2003-01-23 2009-11-04 三洋電機株式会社 Image server
JP4206888B2 (en) * 2003-09-30 2009-01-14 カシオ計算機株式会社 Image processing apparatus and program
JP2006024060A (en) * 2004-07-09 2006-01-26 Sony Corp Information acquisition utilization managing apparatus, and information acquisition utilization managing method
WO2007055193A1 (en) * 2005-11-08 2007-05-18 Pioneer Corporation Information disclosure device, information disclosure method, information disclosure program, and computer-readable recording medium
JP5225587B2 (en) * 2006-03-20 2013-07-03 楽天株式会社 Social networking service system
WO2007116736A1 (en) * 2006-03-30 2007-10-18 Nec Corporation Photographic management system, photographic management method, and device and program used for them
JP4823758B2 (en) * 2006-04-28 2011-11-24 富士フイルム株式会社 Image management server
JP4424364B2 (en) * 2007-03-19 2010-03-03 ソニー株式会社 Image processing apparatus and image processing method

Also Published As

Publication number Publication date
JP2010122733A (en) 2010-06-03

Similar Documents

Publication Publication Date Title
US8429205B2 (en) Associating data with media signals in media signal systems through auxiliary data steganographically embedded in the media signals
JP4668200B2 (en) Method and system for automatically sharing digital images over a communication network
US7456872B2 (en) Device and method for embedding and retrieving information in digital images
US8266716B2 (en) Digital rights management of streaming captured content based on criteria regulating a sequence of elements
US9179021B2 (en) Proximity and connection based photo sharing
US8345118B2 (en) Image capturing apparatus, image capturing method, album creating apparatus, album creating method, album creating system and computer readable medium
JP5261724B2 (en) Representative image selection by hierarchical clustering
TWI379581B (en) Information processing apparatus and method, and program
US20110064281A1 (en) Picture sharing methods for a portable device
JP5225082B2 (en) Identifying aggregate images using special events
JP2004259249A (en) Image print system using peer to peer network
US20030074373A1 (en) Method and apparatus for storing images, method and apparatus for instructing image filing, image storing system, method and apparatus for image evaluation, and programs therefor
EP1549051A1 (en) Portable telephone
JP2009533761A (en) Image value index based on user input to the camera
US7711211B2 (en) Method for assembling a collection of digital images
JP2011521489A (en) Method, system, computer program, and apparatus for extending media based on proximity detection
JP5624034B2 (en) Digital camera and related methods
US7610629B2 (en) Access control apparatus, access control method, and access control program
US8031170B2 (en) User interface for selecting a photo tag
US20030184653A1 (en) Method, apparatus, and program for classifying images
US20180005188A1 (en) Systems And Methods For Sharing Images In A Social Network
US8867779B2 (en) Image tagging user interface
JP2004062868A (en) Digital camera and method for identifying figure in image
JP2007041987A (en) Image processing apparatus and method, and program
JP2005174308A (en) Method and apparatus for organizing digital media by face recognition

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20100916

RD01 Notification of change of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7421

Effective date: 20110921

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A821

Effective date: 20110921

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20120224

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20120228

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20120425

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20121204

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20130130

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20130723

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20130815

R150 Certificate of patent or registration of utility model

Ref document number: 5348682

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

Free format text: JAPANESE INTERMEDIATE CODE: R150

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313111

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

S531 Written request for registration of change of domicile

Free format text: JAPANESE INTERMEDIATE CODE: R313531

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250