JP2018028716A - Information processing apparatus and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing apparatus and a program that facilitate association of a person with an object.SOLUTION: In an information processing apparatus, an imaging part 109 picks up an image of a person and a handout and creates image data capturing the person and handout. A control part 101 detects, with a detection part 1001, the face and the handout present in an image shown by the image data, and creates, with a creation part 1002, image data showing an image of the handout. The control part 101 specifies, with a specification part 1003, a name corresponding to the detected face, and stores, in a storage part 102, the specified name and the image data showing the image of the handout in association with each other.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an information processing apparatus and a program.

  Patent Document 1 discloses an information processing apparatus that associates a person with a container. This information processing apparatus extracts a person, a container and a product from an image photographed by a camera. When the information processing device identifies the movement of putting a product into a container or the movement of putting out a product from a container, the information processing apparatus associates a person into which the product has been put in or a predetermined relationship with the container that has been put out.

Japanese Patent Laying-Open No. 2006-81174

  In the information processing apparatus of Patent Document 1, a person can be associated only with a container, and a specific operation is required when associating a person.

  The present invention has been made under the above-described background, and an object thereof is to facilitate the association between a person and an object.

  According to the present invention, a detection unit that detects a face and an arrangement target in the first image, a generation unit that generates a second image that is the arrangement target image detected by the detection unit, and the detection unit detects Provided is an information processing apparatus comprising: a specifying unit that specifies a person corresponding to a face; and a storage control unit that associates and stores the person specified by the specifying unit and the second image generated by the generating unit in a storage unit To do.

  In this invention, the said detection part is good also as a structure which detects the thing currently hold | maintained by the hand in the said 1st image, or the thing currently worn | worn as the said organizing object.

  In the present invention, the organizing target is set for each person, and the detection unit may detect the organizing target set for the person specified by the specifying unit.

  Moreover, in this invention, it is good also as a structure which sets the said organizing object according to a user's operation.

  In the present invention, when the detecting unit detects a plurality of faces from the first image, the specifying unit specifies a person corresponding to each face detected by the detecting unit, and the storage control unit The one or a plurality of persons specified by the specifying unit and the second image may be associated with each other and stored in the storage unit.

  In the present invention, when the detection unit detects a plurality of organizing objects from the first image, the generating unit generates the second image for each of the plurality of organizing objects detected by the detecting unit. The storage control unit may be configured to store the one or more second images specified by the generation unit and the person specified by the specification unit in the storage unit in association with each other.

  In the present invention, the specifying unit is configured to respond to a positional relationship between the position of the face detected by the detection unit in the first image and the organizing target detected by the detection unit in the first image. The person may be specified.

  Moreover, in this invention, it is good also as a structure which sets the person corresponding to the face which the said detection part detected according to a user's operation.

In the present invention, the detection unit detects a character string from the second image, and the storage control unit associates the person specified by the specifying unit with the character string detected by the detection unit. It is good also as a structure memorize | stored in the said memory | storage part.
In the present invention, the detection unit may detect the attribute to be organized, and the storage control unit may associate the detected attribute with each other.

  Further, the present invention provides a computer, a detection unit that detects a face and an organizing target in the first image, a generating unit that generates a second image that is the organizing target image detected by the detecting unit, A specifying unit that specifies a person corresponding to the face detected by the detecting unit, a person specified by the specifying unit, and the second image generated by the generating unit are associated with each other and stored in the storage unit. A program is provided.

  According to the present invention, association between a person and an object can be facilitated.

The block diagram which showed the hardware constitutions of the information processing apparatus 10 which concerns on this invention. FIG. 3 is a functional block diagram showing a functional configuration of the information processing apparatus 10. The figure which showed an example of the image which the imaging part 109 produced | generated. The flowchart which showed the flow of the process which the control part 101 performs.

[Embodiment]
(Configuration of the embodiment)
FIG. 1 is a block diagram showing an example of a hardware configuration of an information processing apparatus 10 according to an embodiment of the present invention. The information processing apparatus 10 according to the present embodiment is a smartphone having a shooting function. Note that the information processing apparatus 10 is not limited to a smartphone, and may be a digital camera, a tablet terminal having a photographing function, a feature phone, a wristwatch-type wearable device, or the like.

  The communication unit 105 is hardware (transmission / reception device) for performing communication between computers via a wired and / or wireless network, and is also referred to as a network device, a network controller, a network card, a communication module, or the like.

  The audio processing unit 107 has a microphone and a speaker. When the information processing apparatuses make a voice call, the voice processing unit 107 converts the supplied digital signal into an analog signal when a digital signal related to the voice of the other party is supplied from the communication unit 105. This analog signal is supplied to a speaker, and the voice of the other party is emitted from the speaker. In addition, when the microphone collects sound, the sound processing unit 107 converts the collected sound into a digital signal. The voice processing unit 107 supplies a digital signal obtained by converting a user's voice to the communication unit 105 when performing a voice call with the information processing apparatus. This digital signal is transmitted from the communication unit 105 to the communication network 2 and transmitted to the information processing apparatus of the other party.

  The imaging unit 109 includes an imaging device (such as CMOS or CCD) and an optical system that forms an image on the imaging device. The imaging unit 109 generates image data representing an image obtained by the imaging element, and outputs the generated image data.

  The touch panel 103 is a device that combines a display device (for example, a liquid crystal display) and a sensor that detects finger contact on the display surface of the display device, and is an example of an operation unit operated by a user. The touch panel 103 displays characters, a GUI (Graphical User Interface), an image generated by the imaging unit 109, a menu screen for operating the information processing apparatus 10, and the like on the display device. In addition, the touch panel 103 detects a position touched by the user with a finger using a sensor. The control unit 101 identifies a user operation according to the position detected by the touch panel 103 and the screen displayed on the touch panel, performs control of each unit according to the identified operation, and executes various processes.

  The storage unit 102 has a nonvolatile memory, and stores operating system programs, application programs, images extracted from image data, feature point data representing feature points of a human face, and the like. In the present embodiment, the storage unit 102 detects, as an application program, predetermined arrangement objects and faces in the image represented by the image data, the person corresponding to the detected face, and the detected arrangement object image. Are stored in association with each other. In the present embodiment, the storage unit 102 stores the feature point data of the face of the child of the user of the information processing apparatus 10 as the feature point data. The name is stored in association with each other, and the feature point data of the younger brother's face and the name of the younger brother are stored in association with each other.

  The control unit 101 includes a CPU (Central Processing Unit) and a RAM (Random Access Memory). The function according to the present invention is to read predetermined software (program) on hardware such as CPU and RAM, so that the CPU performs an operation, controls each unit, reads data in the RAM and the storage unit 102, and / or Alternatively, it is realized by controlling writing. The CPU executes an operating system program stored in the storage unit 102 and controls the entire information processing apparatus 10. When the CPU executes the operating system program, the application program can be executed.

  FIG. 2 is a block diagram showing a configuration of functions according to the present invention among the functions realized in the information processing apparatus 10. The detection unit 1001 detects a face and an organizing target in the image represented by the image data output from the imaging unit 109. The generation unit 1002 generates image data representing the organizing object detected by the detection unit 1001. The identification unit 1003 identifies a person corresponding to the face detected by the detection unit 1001. The storage control unit 1004 stores the person specified by the specifying unit 1003 and the image data generated by the generating unit 1002 in the storage unit 102 in association with each other.

(Operation example of embodiment)
Next, an operation example of this embodiment will be described. In the following description, an operation example will be described on the assumption that the information processing apparatus 10 executes the above-described application program and the organizing target is a paper distribution in which a sentence is written. .

  When the information processing apparatus 10 is executing the above-described application program, an image generated by the imaging element of the imaging unit 109 is displayed on the touch panel 103. For example, when a mother who is a user of the information processing apparatus 10 records a paper distribution distributed from school to an older brother in association with the older brother, the mother has a distribution as illustrated in FIG. . The mother holds the information processing apparatus 10 so that the older brother and the distribution are displayed on the touch panel 103, and performs an operation of photographing the older brother and the distribution on the touch panel 103.

  When the photographing operation is performed, the control unit 101 performs the processing illustrated in FIG. First, the control unit 101 controls the imaging unit 109 in accordance with the user's operation, and photographs the handout with the brother (Step SA1). The control unit 101 acquires image data (first image) of the image including the photographed older brother and the distribution (Step SA2). The control unit 101 stores the image data generated by the imaging unit 109 in the storage unit 102 (step SA3).

  The control unit 101 (detection unit 1001) analyzes the image data stored in the storage unit 102 and detects a face portion in the image represented by the image data (step SA4). Next, the control unit 101 (identification unit 1003) collates the feature point data of the face in the detected portion with the feature point data stored in the storage unit 102, and uses a known or well-known face matching technique. The person corresponding to the face in the detected part is specified (step SA5). Here, when the control unit 101 determines that the feature point data of the facial feature point in the detected part is similar to the feature point data of the brother's face stored in the storage unit 102, The name stored in association with the facial feature point data, that is, the name of the older brother is acquired.

  Next, the control unit 101 (detection unit 1001) analyzes the image data stored in the storage unit 102, and detects a portion of the distribution item that is an arrangement target in the image represented by the image data (step SA6). The control unit 101 (generation unit 1002) generates image data of an image of the detected distribution part, that is, image data (second image) of an image representing an arrangement target (step SA7).

  The control unit 101 (storage control unit 1004) stores the acquired name of the older brother, the generated image data of the organizing object, and the generation date and time of the image data generated by the imaging unit 109 in the storage unit 102 (step SA8). ).

  Next, when the mother who is the user of the information processing apparatus 10 records the paper distribution distributed to the younger brother from the school in association with the younger brother, the mother gives the younger brother the distribution. Then, the mother holds the information processing apparatus 10 so that the brother and the distribution are displayed on the touch panel 103, and performs an operation of photographing the distribution with the brother on the touch panel 103. The control unit 101 controls the imaging unit 109 according to the user's operation, and images the brother and the distribution (Step SA1). The control unit 101 acquires image data (first image) of an image including the photographed younger brother and the distribution (Step SA2). The control unit 101 stores the image data generated by the imaging unit 109 in the storage unit 102 (step SA3).

  The control unit 101 (detection unit 1001) analyzes the image data stored in the storage unit 102 and detects a face portion in the image represented by the image data (step SA4). Next, the control unit 101 (identification unit 1003) collates the feature point data of the face in the detected part with the feature point data stored in the storage unit 102, and the person corresponding to the face in the detected part Is specified (step SA5). Here, when the control unit 101 determines that the feature point data of the facial feature point in the specified portion is similar to the feature point data of the younger brother's face stored in the storage unit 102, The name stored in association with the facial feature point data, that is, the name of the younger brother is acquired.

  Next, the control unit 101 (detection unit 1001) analyzes the image data stored in the storage unit 102, and detects a portion of the distribution item that is an arrangement target in the image represented by the image data (step SA6). The control unit 101 generates image data of the image of the detected distribution part, that is, image data (second image) of an image representing the organizing object (step SA7).

  The control unit 101 (storage control unit 1004) causes the storage unit 102 to store the acquired name of the younger brother, the generated image data of the organizing object, and the generation date and time of the image data generated by the imaging unit 109 in association with each other (Step S102). SA8).

  When searching for a distribution distributed to the older brother, the mother inputs the older brother's name on the touch panel 103 and performs an operation to instruct retrieval of image data stored in association with the older brother's name. In response to a user operation, the control unit 101 searches the storage unit 102 for image data stored in association with the input name of the older brother so that a thumbnail image of the image data hit in the search is displayed. The touch panel 103 is controlled. When the mother performs an operation of tapping one of the displayed thumbnail images on the touch panel 103, the control unit 101 controls the touch panel 103 so that the thumbnail image at the tapped position is displayed on the full screen. .

  As a result, the mother can easily find and view the distribution from the school distributed to her brother. In addition, when viewing the distribution distributed to the younger brother, the name of the younger brother is input on the touch panel 103 and an operation for instructing the search of the image data stored in association with the younger brother's name is performed. As with, you can easily find and view the distribution from the school distributed to your brother.

[Modification]
As mentioned above, although embodiment of this invention was described, this invention is not limited to embodiment mentioned above, It can implement with another various form. For example, the present invention may be implemented by modifying the above-described embodiment as follows. In addition, you may combine each of embodiment mentioned above and the following modifications.

  In the embodiment described above, the organizing target is a paper distribution in which text is written, but the organizing target may be other than a paper distribution, for example, the organizing target is clothing. It may be. According to this configuration, the name of the person and the clothing image are stored in the storage unit 102 in association with each other. Thereby, for example, the name of the brother and the image of the clothes worn by the brother can be stored in association with each other, and the clothes worn by the brother can be easily known.

  In the present invention, the control unit 101 may detect an object held by a hand in the image represented by the image data as an organizing target. According to this configuration, the name of the person and the image of the object that the photographed person has are stored in the storage unit 102 in association with each other. Thereby, for example, the name of the older brother and the image of the book owned by the older brother are stored in association with each other, and the book owned by the older brother can be easily known.

  In the present invention, the control unit 101 may detect the clothing worn by the person photographed in the image represented by the image data as the organizing object. According to this configuration, the name of the person and the clothing image worn by the photographed person are stored in the storage unit 102 in association with each other. Thereby, for example, the name of the brother and the image of the clothes worn by the brother can be stored in association with each other, and the clothes worn by the brother can be easily known.

  In the embodiment described above, the arrangement target is set in advance, but the arrangement target may be set by the user of the information processing apparatus 10. For example, the user of the information processing apparatus 10 holds the information processing apparatus 10 so that the person and the organizing target are displayed on the touch panel 103, and points to the area where the organizing target is displayed before performing the shooting operation. Perform the operation specified in. Thereafter, when the user performs an operation to instruct photographing, the imaging unit 109 generates image data (first image) including the photographed person and the organizing target. The control unit 101 stores the image data generated by the imaging unit 109 in the storage unit 102. After specifying the name corresponding to the photographed face, the control unit 101 generates the image data of the image in the part in the area specified by the user as the image data (second image) representing the image of the organizing object. . According to this configuration, for example, when the user designates an area in which an object placed on the table is shown, the image data of the object placed on the table is stored as image data representing the image of the organizing object, and the person to be photographed Even if the organizing object is not held in the hand, the name of the photographed person and the image of the organizing object can be stored in association with each other.

  In the embodiment described above, the organizing target is a paper distribution in which text is written, but the organizing target may be different for each person to be photographed. For example, when the above-described brother is photographed, the control unit 101 may set a paper distribution as an organizing target, and when photographing the above-described brother, may set clothing as an organizing target.

  In the present invention, the information processing apparatus 10 detects a plurality of face portions and a plurality of organizing object portions from one image data, and names of persons corresponding to the detected faces and the detected organizing target portion. The image may be stored in association with each other. For example, when the imaging unit 109 captures a state in which a brother with a distribution from a school and a brother with a distribution from a school are lined up, the control unit 101 uses the image data generated by the imaging unit 109 to The brother's face part and the brother's face part are detected. In addition, the control unit 101 generates image data of an image representing a distribution possessed by the older brother and image data of an image representing the distribution possessed by the younger brother from the image data generated by the imaging unit 109. The control unit 101 associates the name of the brother and the image data of the image of the organizing object close to the brother's face in the storage unit 102, and stores the name of the brother and the image of the organizing object close to the brother's face. Are stored in the storage unit 102 in association with each other. According to this configuration, it is possible to associate an organizing object for each person from one image.

  In the present invention, the information processing apparatus 10 detects a plurality of organizing object parts from one image data, and associates the names of persons corresponding to the detected faces with the detected plural organizing object images. It may be added and stored. For example, when the imaging unit 109 captures an older brother who has two distribution items from the school, the control unit 101 detects the brother's face from the image data generated by the imaging unit 109. In addition, the control unit 101 uses the image data generated by the imaging unit 109 to display image data representing a distribution that the brother has on the right hand and image data representing another distribution that the left hand has. Is generated. The control unit 101 associates the name of the elder brother with the image data of the image of the organizing object that the elder brother had in the right hand, and stores it in the storage unit 102. Furthermore, the name of the elder brother and the elder brother held in the left hand The image data of the image of the organizing object is associated with and stored in the storage unit 102. According to this configuration, a plurality of organizing objects can be associated with one person from one image.

  In the present invention, the information processing apparatus 10 detects a plurality of faces and a part of one organizing object from one image data, the name of the person corresponding to the detected face, the image of the organizing object detected May be stored in association with each other. For example, when a certificate, a brother and a younger brother are photographed by the imaging unit 109, the control unit 101 detects the brother's face part and the brother's face part from the image data generated by the imaging unit 109. Further, the control unit 101 generates image data of an image representing a certificate that is an organizing target from the image data generated by the imaging unit 109. The control unit 101 associates the name of the elder brother with the image data of the award certificate and stores it in the storage unit 102, and further associates the name of the brother and the image data of the award certificate in the storage unit 102. Let According to this configuration, an arrangement target can be associated with each of a plurality of persons from one image.

  In the present invention, the information processing apparatus 10 may determine the person associated with the organizing object according to the positional relationship between the face and the organizing object. For example, the information processing apparatus 10 stores the feature point data of the father's face and the brother's name in association with each other, and further stores the brother's name in association with the feature point data of the father's face. When the imaging unit 109 captures the distribution and the father, the control unit 101 detects the face part of the father from the image data generated by the imaging unit 109. In addition, the control unit 101 generates image data of an image representing a distribution object that is an arrangement target object from the image data generated by the imaging unit 109. The control unit 101 identifies the position of the organizing object with respect to the face part. When the control unit 101 determines that the feature point data of the facial feature point in the detected part is similar to the feature point data of the father's face stored in the storage unit 102, the control unit 101 The name stored in association with the feature point data, that is, the name of the brother and the name of the brother is acquired. When the distribution object that is the organizing object is on the right side of the father's face, the control unit 101 stores the brother's name and the image data of the organizing object in association with each other in the storage unit 102, and the distribution object that is the organizing object Is on the left side of the father's face, the younger brother's name and the image data of the organizing object are associated with each other and stored in the storage unit 102. According to this configuration, the person associated with the organizing object can be changed according to the position of the organizing object.

  In the present invention, the storage unit 102 may store the name of the older brother for the feature point data of the father's face and the name of the younger brother for the feature point data of the mother's face. In the case of this configuration, the information processing apparatus 10 stores the name of the brother and the image data of the image of the distribution in association with each other when the father with the distribution is photographed, and when the mother with the distribution is photographed, The brother's name and the image data of the distribution image are stored in association with each other. According to this configuration, even if there is no older brother and / or younger brother, it is possible to store an image of a distribution distributed to the older brother and / or younger brother in association with the older brother or younger brother.

  In the present invention, if the feature point data similar to the feature point data of the face in the part detected in step SA4 is not stored in the storage unit 102, the control unit 101 determines the face in the part detected in step SA4. The user may be prompted to input the name of the person corresponding to the feature point data, and the input name may be stored in association with the feature point data of the face in the part specified in step SA4.

  In the present invention, when the user performs a writing operation on the touch panel 103 with the finger or the stylus pen for the image of the organizing target displayed after tapping the thumbnail image, the image of the organizing target object is displayed. You may make it add the image according to the movement locus | trajectory of a finger | toe or a stylus pen.

  In the present invention, when the printed matter on which the text is described is the organizing target, the control unit 101 performs character recognition on the image of the organizing target and detects the character string described on the organizing target. May be stored. In addition, when performing character recognition on the image of the organizing target, the control unit 101 may be configured to detect a predetermined character string and notify the user according to the detected character string. For example, when the control unit 101 (detection unit 1001) uses a distribution from a school as an object to be organized, a character string related to a school event such as an athletic meet, excursion, medical checkup, class visit, etc. described in the distribution, Detect date and time related to school events and character strings related to places. For example, when the character string “○ month × day” and the character string “athletic day” are extracted, the control unit 101 notifies the user that there is an athletic day the day before ○ month × day.

  Note that the control unit 101 may perform notification other than the user of the information processing apparatus 10. For example, the storage unit 102 stores the brother's e-mail address with respect to the feature point data of the brother's face. When the control unit 101 extracts the character string “○ month × day” and the character string “athletic day” from the image represented by the image data of the organizing target stored in association with the brother's name, the name of the brother An e-mail in which a character string “○ month × day” and a character string “athletic day” are written in the body is sent to the e-mail address associated with

  Moreover, when transmitting an electronic mail, the structure which sets the transmission destination of an electronic mail for every predetermined character string may be sufficient. For example, set the siblings' grandparents, father, mother, siblings e-mail addresses for the string "athletic meet", and the siblings father and mother e-mail addresses for the string "visiting class". You may make it set. In the case of this configuration, when the information processing apparatus 10 photographs a handout of athletic meet guidance, a notice about the athletic meet is sent to the siblings' grandparents, father, mother, and brother by e-mail, and the handout of the guidance for class attendance is photographed. Notifications about class visits can be sent by e-mail to the siblings' parents, and the notification destination can vary depending on the contents of the distribution. The control unit 101 may be configured to register a schedule in an application program that manages the schedule based on the extracted character string.

  In the present invention, in a configuration in which a character string is detected from the image of the organizing object, a numerical value may be detected from the image of the organizing object, and a graph may be created based on the detected numerical value. For example, the control unit 101 uses the arrangement object as a test sheet, detects a character string of a score as a test scoring result from the image of the arrangement object, and stores the detected score in association with the image data of the arrangement object. To do. The control unit 101 creates a graph with the horizontal axis representing the date and time when the image data and the score of the organizing object are stored and the vertical axis representing the score, and plots the score stored in association with the image data of the organizing object on the graph. And displayed on the touch panel 103. According to this configuration, the test scoring results can be automatically displayed as a graph.

Moreover, in this invention, it is good also as a structure which adds an attribute to the detected character string, when an arrangement target object is made into a test paper and a character string is detected from the arrangement object. For example, the control unit 101 detects a character string from an image on a test sheet. If the detected character string is a handwritten black character string, the control unit 101 assigns a black attribute and a handwritten attribute to the character string. . In addition, when the character string detected from the image on the test sheet is a black character string of the font, the control unit 101 assigns a black attribute and a font attribute to the character string, and the extracted character string is handwritten. If the character string is a red character string, the red attribute and the handwritten attribute are assigned to the character string. The control unit 101 stores the extracted character string and attribute in the storage unit 102. The control unit 101 extracts, for example, a character string to which a black attribute and a font attribute are assigned from a character string stored in the storage unit 102 in accordance with a user operation, and the extracted character string is displayed on the touch panel 103. To display. On the test sheet, the question sentence is a character string in black font. According to this configuration, it is possible to extract and display only the test problem, and to review the test.
In the present modification, the information processing apparatus 10 displays a check box for each question sentence when displaying the test question character string, and the question sentence with the check box marked is stored in the storage unit. It may be deleted from 102 or not displayed on the touch panel 103.

In the present invention, when the organizing object is a distribution object from a school, a predetermined character string may be added to the image generated by the generating unit 1002 as an image of the organizing object. For example, the storage unit 102 stores the names and addresses of sibling guardians in advance, and if there is a guardian entry field, an address entry field, etc. in the distribution from the school, the name of the guardian stored is stored. May be added to the entry column of the guardian of the image of the distribution, and the stored address may be added to the entry column of the address. According to this configuration, if an image in which the name and address of the guardian are written is output to a printer and printed, the name and address of the guardian can be automatically written without being written by hand. it can.
In this modified example, when the image of the distribution is displayed on the touch panel 103, the control unit 101 displays character string candidates to be added to the entry field, and is selected by the user from the displayed character strings. You may make it add a character string to an entry column. In addition, when the control unit 101 outputs an image of the organizing target to the printer and prints it, the control unit 101 outputs the image of the organizing target, the character string of the name written in the entry column, and the character string of the address written in the entry column to the printer. The designation and address may be printed in the entry field and output by the technique of merge printing.

  In the present invention, the control unit 101 detects the attribute of the organizing object by analyzing the image data stored in the storage unit 102 or the image data of the organizing object, and the detected attribute is also an image of the name and the organizing object. The data may be stored in the storage unit 102 in association with the data. For example, when the organizing target is clothing, the control unit 101 detects the type of clothing such as a suit, a coat, and a sweater as an attribute. In this case, if an attribute is specified when searching for an arrangement target associated with a person, the information processing apparatus 10 selects and displays only a court image, for example. Only types of clothing can be displayed.

  When the information processing apparatus 10 is a smartphone, a tablet terminal, or a feature phone and the imaging unit 109 includes an in-camera and an out-camera, the user's face is photographed with the in-camera and the organizing target is photographed with the out-camera. It is good also as a structure. In the case of this configuration, the control unit 101 detects a face part from image data generated by the in-camera, and acquires a name corresponding to the face in the detected part. In addition, the control unit 101 detects a part of the organizing target from the image data generated by the out-camera, and generates image data of the organizing target in the detected part. Then, the control unit 101 stores the acquired name and the generated image data of the organizing object in the storage unit 102 in association with each other. According to this configuration, the person and the organizing object can be associated with each other without holding the organizing object.

  In the present invention, the information processing apparatus 10 may perform the processes from step SA3 to step SA8 on image data acquired by communication from another computer apparatus or image data acquired from an external recording medium. Good. In addition, a computer apparatus that does not include the imaging unit 109 performs the processes from step SA3 to step SA8 on image data acquired from another computer apparatus through communication or image data acquired from an external recording medium. It may be. According to this configuration, it is possible to easily associate a person with an object even in a computer apparatus that does not include the imaging unit 109.

  The functional blocks (configuration units) described above are realized by any combination of hardware and / or software. Further, the means for realizing each functional block is not particularly limited. That is, each functional block may be realized by one device physically and / or logically coupled, and two or more devices physically and / or logically separated may be directly and / or indirectly. (For example, wired and / or wireless) and may be realized by these plural devices. For example, the information processing apparatus according to an embodiment of the present invention may function as a computer that performs the processing of the present invention. In the following description, the term “apparatus” can be read as a circuit, a device, a unit, or the like. The hardware configuration of the information processing apparatus 10 may be configured to include one or a plurality of each device, or may be configured not to include some devices.

  Further, the control unit 101 reads a program (program code), software module, and data from the storage unit 102 and / or the communication unit 105 to the RAM, and executes various processes according to these. As the program, a program that causes a computer to execute at least a part of the operations described in the above embodiments is used. For example, the control unit 101 of the information processing apparatus 10 may be realized by a control program stored in a RAM and operated by a CPU, and may be realized similarly for other functional blocks. Although the above-described various processes have been described as being executed by one CPU, they may be executed simultaneously or sequentially by two or more processor CPUs. The control unit 101 may be mounted on one or more chips. Note that the program may be transmitted from a network via a telecommunication line.

  The RAM may be called a register, a cache, a main memory (main storage device), or the like. The RAM can store a program (program code), a software module, and the like that can be executed to perform the functions according to the embodiment of the present invention.

  The information processing apparatus 10 includes hardware such as a microprocessor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), and a field programmable gate array (FPGA). A part or all of each functional block may be realized by the hardware. For example, the control unit 101 may be implemented by at least one of these hardware.

  As long as there is no contradiction, the order of the processing procedures, sequences, flowcharts, and the like of each aspect / embodiment described in this specification may be changed. For example, the methods described herein present the elements of the various steps in an exemplary order and are not limited to the specific order presented.

  Input / output information or the like may be stored in a specific location (for example, a memory) or may be managed by a management table. Input / output information and the like can be overwritten, updated, or additionally written. The output information or the like may be deleted. The input information or the like may be transmitted to another device.

  Each aspect / embodiment described in this specification may be used independently, may be used in combination, or may be switched according to execution. In addition, notification of predetermined information (for example, notification of being “X”) is not limited to explicitly performed, but is performed implicitly (for example, notification of the predetermined information is not performed). Also good.

  Regardless of whether the program is called software, firmware, middleware, microcode, hardware description language, or another name, the instruction, instruction set, code, code segment, program code, subprogram, software module, application Software applications, software packages, routines, subroutines, objects, executables, threads of execution, procedures, functions, etc. should be interpreted broadly.

  Further, programs, instructions, etc. may be transmitted / received via a transmission medium. For example, the program may use websites, servers, or other devices using wired technology such as coaxial cable, fiber optic cable, twisted pair and digital subscriber line (DSL) and / or wireless technology such as infrared, wireless and microwave. When transmitted from a remote source, these wired and / or wireless technologies are included within the definition of transmission media.

Information, signals, etc. described herein may be represented using any of a variety of different technologies. For example, data, commands, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description are voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, light fields or photons, or any of these May be represented by a combination of
Note that the terms described in this specification and / or terms necessary for understanding this specification may be replaced with terms having the same or similar meaning.

  The information processing apparatus 10 is a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal by those skilled in the art. , Wireless terminal, remote terminal, handset, user agent, mobile client, client, or some other appropriate terminology.

  As used herein, the terms “determining” and “determining” may encompass a wide variety of actions. “Judgment” and “determination” are, for example, judgment, calculation, calculation, processing, derivation, investigating, looking up (eg, table) , Searching in a database or another data structure), considering ascertaining as “determining”, “deciding”, and the like. In addition, “determination” and “determination” are reception (for example, receiving information), transmission (for example, transmitting information), input (input), output (output), and access. (Accessing) (eg, accessing data in a memory) may be considered as “determined” or “determined”. In addition, “determination” and “determination” means that “resolving”, “selecting”, “choosing”, “establishing”, and “comparing” are regarded as “determining” and “determining”. May be included. In other words, “determination” and “determination” may include considering some operation as “determination” and “determination”.

  The terms “connected”, “coupled”, or any variation thereof, means any direct or indirect connection or coupling between two or more elements and It can include the presence of one or more intermediate elements between two “connected” or “coupled” elements. The coupling or connection between the elements may be physical, logical, or a combination thereof. As used herein, the two elements are radio frequency by using one or more wires, cables and / or printed electrical connections, and as some non-limiting and non-inclusive examples By using electromagnetic energy, such as electromagnetic energy having a wavelength in the region, microwave region, and light (both visible and invisible) region, it can be considered to be “connected” or “coupled” to each other.

  As used herein, the phrase “based on” does not mean “based only on,” unless expressly specified otherwise. In other words, the phrase “based on” means both “based only on” and “based at least on.”

Any reference to elements using the designations “first”, “second”, etc. as used herein does not generally limit the amount or order of those elements. These designations can be used herein as a convenient way to distinguish between two or more elements. Thus, a reference to the first and second elements does not mean that only two elements can be employed there, or that in some way the first element must precede the second element.

  As long as the terms “including”, “comprising”, and variations thereof are used herein or in the claims, these terms are inclusive of the term “comprising”. Intended to be Further, the term “or” as used herein or in the claims is not intended to be an exclusive OR.

  Although the present invention has been described in detail above, it will be apparent to those skilled in the art that the present invention is not limited to the embodiments described herein. The present invention can be implemented as modified and changed modes without departing from the spirit and scope of the present invention defined by the description of the scope of claims. Therefore, the description of the present specification is for illustrative purposes and does not have any limiting meaning to the present invention.

DESCRIPTION OF SYMBOLS 10 ... Information processing apparatus 101 ... Control part 102 ... Memory | storage part 105 ... Communication part 107 ... Audio | voice processing part 109 ... Imaging part, 1001 ... Detection part, 1002 ... Generation | occurrence | production part, 1003 ... Specific | specification part, 1004 ... Memory | storage Control unit.

Claims (10)

A detection unit for detecting a face and an arrangement target in the first image;
A generation unit that generates a second image that is the image to be organized detected by the detection unit;
A specifying unit for specifying a person corresponding to the face detected by the detecting unit;
An information processing apparatus comprising: a storage control unit that associates the person specified by the specifying unit with the second image generated by the generation unit and stores the second image in the storage unit. The information processing apparatus according to claim 1, wherein the detection unit detects an object held or worn by a hand in the first image as the organizing target. By setting the organizing target for each person,
The information processing apparatus according to claim 1, wherein the detection unit detects the organizing target set for the person specified by the specifying unit. The information processing apparatus according to any one of claims 1 to 3, wherein the organization target is set according to a user operation. The identifying unit identifies a person corresponding to each face detected by the detecting unit when the detecting unit detects a plurality of faces from the first image;
The information processing according to any one of claims 1 to 4, wherein the storage control unit stores the one or more persons specified by the specifying unit and the second image in association with each other in the storage unit. apparatus. When the detecting unit detects a plurality of organizing objects from the first image, the generating unit generates the second image for each of the plurality of organizing objects detected by the detecting unit,
The storage control unit stores the one or more second images specified by the generation unit and the person specified by the specification unit in association with each other and stores them in the storage unit. The information processing apparatus according to item. The specifying unit specifies the person according to a positional relationship between a face position detected by the detection unit in the first image and the organizing target detected by the detection unit in the first image. The information processing apparatus according to any one of claims 1 to 6. The information processing apparatus according to claim 1, wherein a person corresponding to the face detected by the detection unit is set according to a user operation. The detection unit detects a character string from the second image,
The information processing according to any one of claims 1 to 8, wherein the storage control unit stores the person specified by the specifying unit and the character string detected by the detection unit in association with each other in the storage unit. apparatus. Computer
A detection unit for detecting a face and an arrangement target in the first image;
A generation unit that generates a second image that is the image to be organized detected by the detection unit;
A specifying unit for specifying a person corresponding to the face detected by the detecting unit;
The program for functioning as a storage control unit that stores the person specified by the specifying unit and the second image generated by the generation unit in association with each other.

Images