JP2014081791A - Information management system, information management device, information providing device, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make it possible to authenticate information to be provided to a plurality of persons on the basis of feature information representing a biological feature of any of the plurality of persons.SOLUTION: A biological information acquiring unit 30 acquires feature information representing a biological feature of a person. A feature information-associated provision information generating unit 36 associates the feature information of a plurality of persons with provision information to be provided to the plurality of persons.

Description

  The present invention relates to an information management system, an information management device, an information providing device, and a program.

  Information that ensures the security that the information created by the individual can be associated with the characteristic information representing the characteristics of the living body peculiar to the individual, so that the associated information is retrieved from the characteristic information and can be used. There is a management device.

JP 2006-277097 A

  One of the objects of the present invention is to make it possible to authenticate information provided to a plurality of persons using feature information representing characteristics of any one of the plurality of persons.

  Invention of Claim 1 is an information management system, Comprising: The characteristic information acquisition means which acquires the characteristic information showing the characteristic of a person's biological body, The said information of the said several persons in the provision information provided to a several person And feature information associating means for associating the feature information.

  The invention according to claim 2 is the information management system according to claim 1, wherein the feature information associating means uses the feature information obtained by the feature information obtaining means while the provided information is displayed. And associated with the provided information.

  Invention of Claim 3 is the information management system of Claim 1 or 2, Comprising: The said feature information acquisition means acquires the facial feature information produced | generated based on the image of a person's face, The said The feature information associating means associates the face feature information of a plurality of persons to whom the provided information is provided with the provided information.

  Invention of Claim 4 is the information management system of Claim 1 or 2, Comprising: The said characteristic information acquisition means acquires the voiceprint characteristic information produced | generated based on the voice which a person utters, The said characteristic The information association means associates the voice print feature information of a plurality of persons to whom the provision information is provided with the provision information.

  Invention of Claim 5 is the information management system as described in any one of Claims 1-4, Comprising: The characteristic information showing the biometric characteristic of the provision destination candidate of the said provision information, The said Based on a comparison result with the feature information associated with the provision information, the information processing apparatus further includes a determination unit that determines whether the provision information is provided to the provision destination candidate.

  The invention according to claim 6 is the information management system according to claim 5, wherein when the determination unit determines to provide the provision information to the provision destination candidate, the provision information is Further, providing means for providing to the provision destination candidate is included.

  The invention according to claim 7 is the information management system according to claim 5 or 6, wherein the feature information associating means includes any one of a plurality of persons to whom the provided information is provided in the provided information. The character information extracted from the uttered voice or the character information included in the provision information is associated, and the determination unit associates with the provision information, the feature information indicating the biological characteristics of the provision destination candidate of the provision information, and the provision information Based on the comparison result with the feature information, and the comparison result between the character information extracted from the speech uttered by the provision destination candidate and the character information associated with the provision information, the provision destination candidate It is determined whether or not to provide information.

  The invention according to claim 8 is an information management system including an information management device and an information providing device, wherein the information management device obtains feature information representing a feature of a person's living body. And information providing means for associating the feature information of the plurality of persons with the provision information provided to the plurality of persons, wherein the information providing device is a living body of the person who is a candidate for providing the provision information. Determination means for determining whether or not to provide the provision information to the provision destination candidate based on a comparison result between the feature information representing the characteristics of the information and the feature information associated with the provision information; Provision means for providing the provision information to the provision destination candidate when the judgment means determines to provide the provision information to a candidate.

  The invention according to claim 9 is an information providing device, which is associated with provision information provided to a plurality of persons and represents the characteristics of the biological characters of the plurality of persons, and the provision of the provision information Based on the comparison result with the feature information representing the characteristics of the previous candidate's living body, a determination means for determining whether or not to provide the provided information to the provided candidate, and the provided to the provided candidate And providing means for providing the provision information to the provision destination candidate when the judgment means determines to provide information.

  The invention according to claim 10 is a program, wherein the feature information acquisition means acquires feature information representing the characteristics of a person's biological body, and the feature information of the plurality of persons is added to provided information provided to the plurality of persons. The computer is caused to function as the feature information associating means to be associated.

  The invention according to claim 11 is a program, which is associated with provision information provided to a plurality of persons, and represents feature information representing the characteristics of the living bodies of the plurality of persons, and a candidate for providing the provision information Determination means for determining whether or not to provide the provision information to the person as the provision destination candidate based on the comparison result with the feature information representing the biological characteristics of the person who becomes the person as the provision destination candidate When the determination unit determines that the provision information is to be provided, the computer is caused to function as a provision unit that provides the provision information to the provision destination candidate.

  According to the first, eighth, ninth, tenth and eleventh aspects of the present invention, information related to a plurality of persons can be authenticated by the feature information representing the characteristics of any one of the plurality of persons.

  According to the second aspect of the present invention, information related to a plurality of persons can be authenticated by feature information representing any of the biometric features of the plurality of persons related while the information is displayed. It becomes.

  According to the third aspect of the present invention, information related to a plurality of persons can be authenticated by facial feature information of any of the plurality of persons.

  According to the invention described in claim 4, information related to a plurality of persons can be authenticated by the voiceprint feature information of any of the plurality of persons.

  According to the fifth aspect of the present invention, information related to a plurality of persons can be authenticated by the feature information of any one of the plurality of persons.

  According to the sixth aspect of the present invention, when the plurality of persons are authenticated by the feature information representing the characteristics of any one of the plurality of persons and related to the related information, the information can be provided. It becomes.

  According to the seventh aspect of the present invention, information related to a plurality of persons can be authenticated by character information related to the information.

It is a figure which shows an example of the structure of the outline of the information management system in one Embodiment of this invention. It is a figure which shows typically an example of a mode that the information management system in one Embodiment of this invention is used. It is a functional block diagram which shows an example of the function implement | achieved by the information management system in one Embodiment of this invention. It is a figure which shows an example of the characteristic information list. It is a figure which shows an example of a provision information list. It is a flowchart which shows an example of the flow of the process performed by the information management apparatus in one Embodiment of this invention. It is a flowchart which shows an example of the flow of the process performed by the information management apparatus in one Embodiment of this invention. It is a flowchart which shows an example of the flow of the process performed by the information management apparatus in one Embodiment of this invention. It is a flowchart which shows an example of the flow of the process performed by the information processing apparatus in one Embodiment of this invention. It is a flowchart which shows an example of the flow of the process performed by the information management apparatus in one Embodiment of this invention. It is a flowchart which shows an example of the flow of the process performed by the information management apparatus in one Embodiment of this invention. It is a flowchart which shows an example of the flow of the process performed by the information management apparatus in one Embodiment of this invention. It is a flowchart which shows an example of the flow of the process performed by the information processing apparatus in one Embodiment of this invention. It is a flowchart which shows an example of the flow of the process performed by the information management apparatus in one Embodiment of this invention.

[First Embodiment]
Hereinafter, a first embodiment of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram showing an example of the configuration of the information management system 10 in the first embodiment of the present invention. As shown in FIG. 1, the information management system 10 in this embodiment includes, for example, an information management device 12, an information processing device 13, a printing device 14, an operation terminal 16, a projector 18, and a camera 20. The information management device 12, the information processing device 13, the printing device 14, and the operation terminal 16 are connected to communication means such as a LAN and the Internet, and communicate with each other.

  The information management device 12 includes a control unit that is a program control device such as a CPU that operates according to a program installed in the information management device 12, a storage unit such as a ROM and RAM, a storage unit such as a hard disk drive, and a communication such as a network board. It includes a communication unit that is an interface. These elements are connected via a bus. The storage unit of the information management device 12 stores a program executed by the control unit of the information management device 12. In addition, the storage unit of the information management device 12 also operates as a work memory of the information management device 12.

  The information processing device 13 is a control unit that is a program control device such as a CPU that operates according to a program installed in the information processing device 13, a storage unit such as a ROM or RAM, a storage unit such as a hard disk drive, or a communication such as a network board. It includes a communication unit, a camera, and the like as interfaces. These elements are connected via a bus. A program executed by the control unit of the information processing device 13 is stored in the storage unit of the information processing device 13. Further, the storage unit of the information processing apparatus 13 also operates as a work memory of the information processing apparatus 13.

  The printing device 14 is, for example, a printing device such as a printer or a multifunction device. The printing device 14 is a control unit that is a program control device such as a CPU that operates according to a program installed in the printing device 14, a storage element such as a ROM or a RAM, or a hard disk A storage unit such as a drive, a communication unit such as a network board, an operation unit, a display unit, an image forming unit, a digital camera, and a microphone are included. These elements are connected via a bus. A program executed by the control unit of the printing apparatus 14 is stored in the storage unit of the printing apparatus 14. The storage unit of the printing apparatus 14 also operates as a work memory for the printing apparatus 14.

  The operation terminal 16 is a computer such as a personal computer or a tablet terminal, for example, a control unit that is a program control device such as a CPU that operates according to a program installed in the operation terminal 16, a storage element such as ROM or RAM, or a hard disk drive A storage unit such as a network board, a communication unit such as a network board, a display, a speaker, a mouse, a keyboard, a button, and the like.

  The projector 18 is a display device that projects an image or video on a screen.

  The camera 20 is, for example, a known digital camera, and transmits the captured black-and-white, grayscale, or color moving image to the information management apparatus 12 and the information processing apparatus 13 wirelessly or by wire via communication means such as the Internet. The camera 20 in the present embodiment also includes a microphone, and transmits collected sound to the information management apparatus 12 wirelessly or by wire via communication means such as the Internet. In the present embodiment, the information processing system 10 includes a plurality of (for example, three) cameras 20. Note that the camera included in the information processing apparatus 13 is the same camera as the camera 20.

  FIG. 2 is a diagram schematically illustrating an example of a state in which the information management system 10 is used in the first embodiment.

  In the present embodiment, a conference is held among a plurality of participants 24 gathered in the conference room 22 while browsing provided information displayed on the screen 26. In this embodiment, a plurality of pieces of provision information are previously associated with information associated with the provision information (for example, provision information ID, provision information name, location information indicating where the provision information is stored (for example, URL , Path), and the like) and stored in the storage unit of the information management device 12. Hereinafter, the information associated with the provision information is referred to as correspondence information. Here, the projector 18 projects the provided information onto the screen 26 in response to an instruction from the operation terminal 16 installed in the conference room 22. In this manner, in the first embodiment, the provided information is displayed on the screen 26. And the camera 20 is installed in the position which can image | photograph the whole meeting room 22, and image | photographs the mode inside the meeting room 22 during the meeting. In the present embodiment, the camera 20 collects sound emitted inside the conference room 22. In the present embodiment, for example, three cameras 20 are installed in the conference room 22. Even during the conference, the participant 24 can enter and exit from the door 28.

  In the first embodiment, provision information to be displayed on the screen 26 is stored in advance in the storage unit of the information management apparatus 12. Then, the provided information stored in the storage unit of the information management device 12 is displayed on the screen 26 according to an instruction from the operation terminal 16.

  Next, functions executed by the information management device 12 and the information processing device 13 in the first embodiment will be described. FIG. 3 is a functional block diagram illustrating an example of main functions executed by the information management apparatus 12 and the information processing apparatus 13 in the first embodiment. As shown in FIG. 3, the information management apparatus 12 in the first embodiment functionally includes, for example, a biological information acquisition unit 30, a feature information generation unit 32, a provision information acquisition unit 34, a provision information list generation unit 35, A feature information association provision information generation unit 36 is included. These functions are realized by the control unit executing a program stored in the storage unit. This program is supplied to the information management apparatus 12 via a computer-readable information storage medium such as an optical disk, a magnetic disk, a magnetic tape, a magneto-optical disk, or a flash memory, or via communication means such as the Internet. .

  Further, the information processing apparatus 13 in the first embodiment includes a feature information association provision information acquisition unit 40, a provision destination candidate biometric information acquisition unit 42, a provision destination candidate feature information generation unit 44, and a feature information collation unit 46. It is configured. These functions are realized by the control unit executing a program stored in the storage unit. This program is supplied to the information processing apparatus 13 via a computer-readable information storage medium such as an optical disk, a magnetic disk, a magnetic tape, a magneto-optical disk, or a flash memory, or via communication means such as the Internet. .

  The biological information acquisition unit 30 of the information management device 12 acquires a moving image captured by the camera 20. In the first embodiment, the moving image taken by the camera 20 includes a plurality of still images (frame images). In the first embodiment, for example, photographing by the camera 20 is performed every predetermined time (for example, 1/60 seconds). That is, a moving image in which the number of frames per second is a predetermined number (for example, 60) is taken by the camera 20. A moving image shot by the camera 20 is transmitted to the information management device 12. Then, the biological information acquisition unit 30 of the information management device 12 acquires the moving image. The camera 20 may transmit a frame image included in the captured moving image to the information management apparatus 12 at predetermined time intervals. Alternatively, the camera 20 may record and store the captured moving images, and transmit the stored moving images (a plurality of frame images) collectively in response to a request from the information management device 12. .

  The feature information generation unit 32 of the information management device 12 is known from the moving image acquired by the biological information acquisition unit 30 (in the first embodiment, for example, a frame image included in the moving image acquired by the biological information acquisition unit 30). The face image of the participant 24 is detected using the face recognition technology. For example, the feature information generation unit 32 may detect facial parts such as eyes, nose and mouth, and may detect the face based on the positions of these parts. In addition, the feature information generation unit 32 may detect a face using skin color information, for example. Further, the feature information generation unit 32 may detect the face using other detection methods. Then, the feature information generating unit 32 generates face feature information based on the detected face image. Note that the feature information generation unit 32, for example, from the moving image acquired by the biological information acquisition unit 30 (in the first embodiment, for example, a frame image included in the moving image acquired by the biological information acquisition unit 30). The iris portion may be detected. Then, the feature information generation unit 32 may generate face feature information based on the detected iris portion. In the first embodiment, the feature information generation unit 32 generates face feature information corresponding to the participant 24 for each participant 24 existing in the conference room 22 while the conference is being performed.

  In the first embodiment, the feature information generation unit 32 of the information management device 12 includes the face feature information list illustrated in FIG. 4 including the face feature information of the participant 24 acquired during the conference. Is generated and stored in the storage unit of the information management device 12. As shown in FIG. 4, the face feature information list according to the first embodiment includes an identification number indicating the order of detection and a face image of the detected participant 24 given to each detected participant 24. The facial feature information generated based on this is managed in association with each other.

  The provision information acquisition unit 34 of the information management device 12 detects provision information (provision information displayed on the screen 26) that the projector 18 projects on the screen 26, and stores the correspondence information stored in association with the detected provision information. Information is acquired from the storage unit of the information management device 12.

  The provision information list generation unit 35 of the information management device 12 generates the provision information list illustrated in FIG. 5 including the correspondence information acquired during the conference, and stores the provision information list in the storage unit of the information management device 12. Remember. As shown in FIG. 5, the provided information list of the first embodiment is managed by associating the file name of the provided information with the location information indicating the location of the storage location of the provided information for each provided information.

  The feature information association provision information generation unit 36 of the information management device 12 acquires the provision information from the storage destination of the provision information managed in the provision information list, and the facial feature generated by the feature information generation unit 32 in the provision information. The face feature information list association provision information is generated by associating the information list. Then, the feature information list association providing information is stored in the original storage destination.

  The feature information acquisition unit 40 of the information processing device 13 acquires feature information associated with provided information to be printed out by the printing device 14 from the storage unit of the information management device 12 via the communication unit.

  The provision destination candidate biometric information acquisition unit 42 of the information processing device 13 acquires a still image captured by a camera provided in the information processing device 13. The camera is installed at a position where it is possible to photograph a candidate for a destination who operates the information processing apparatus 13. In the first embodiment, the camera operates the information processing apparatus 13 to capture a still image of a provision destination candidate who has input a print instruction to print out provision information. The provision destination candidate biometric information acquisition unit 42 acquires a still image captured by the camera when a print instruction is input to the information processing apparatus 13.

  The provision destination candidate feature information generation unit 44 of the information processing device 13 detects the face image of the provision destination candidate from the still image acquired by the provision destination candidate biometric information acquisition unit 42 using a known face recognition technology. To do. For example, the provision destination candidate characteristic information generation unit 44 may detect facial parts such as eyes, nose, and mouth, and may detect the face based on the positions of these parts. Further, the provision destination candidate feature information generation unit 42 may detect a face using skin color information, for example. Further, the providing destination candidate feature information generation unit 42 may detect the face using other detection methods. Then, the provision destination candidate feature information generation unit 44 generates provision destination candidate feature information based on the detected face image. For example, the provision destination candidate feature information generation unit 44 may detect the iris portion of the provision destination candidate from the still image acquired by the provision destination candidate biometric information acquisition unit 42. Then, the provision destination candidate feature information generation unit 44 may generate provision destination candidate feature information based on the detected iris portion.

  The feature information matching unit 46 of the information processing device 13 operates the feature information list associated with the provided information acquired by the feature information acquiring unit 40 and the information processing device 13 generated by the provision destination candidate feature information generating unit 44. Then, the information is collated with the feature information of the recipient candidate who has input the print instruction for printing the provision information.

  The print output unit 48 prints out the provided information from the storage unit of the information management device 12 based on the result of the collation by the feature information collating unit 46.

  Here, an example of the flow of the feature information list generation process and the provided information list generation process executed by the information management apparatus 12 in the first embodiment will be described.

  First, an example of the flow of the feature information list generation process will be described with reference to the flowchart of FIG.

  First, when the information management device 12 accepts the start of a conference, for example, when the operation terminal 16 in the conference room 22 is turned on (S101), the camera 20 starts capturing a moving image in the conference room. . Then, a frame image included in the captured moving image is transmitted to the information management device 12 at predetermined time intervals. The information management apparatus 12 executes the processing shown in processing S102 to processing S107 in FIG. 6 based on the frame image received every predetermined time.

  First, the biometric information acquisition unit 30 acquires the face image of the participant 24 from the frame image (S102). Then, the feature information generation unit 32 generates feature information (in this embodiment, face feature information is used as feature information) from the acquired face image (S103).

  When the feature information is generated in step S103, the feature information generation unit 32 determines whether a feature information list corresponding to the conference is stored in the storage unit of the information management device 12 (S104).

  If it is determined that there is no feature information list, a feature information list is created (S105) and stored in the storage unit of the information management device 12.

  Subsequently, the feature information generation unit 32 determines whether or not the feature information generated in the process S103 exists in the feature information list (S106).

  If it is determined that it does not exist, the feature information generated in step S103 is added to the feature information list (S107). Then, the information management apparatus 12 determines whether or not the end of the conference is accepted (for example, whether or not the operation terminal 16 is turned off) (S108). If not received, the information processing apparatus 12 executes the process S102 and subsequent steps again. In this way, in the present processing example, the processing shown in S102 to S107 is repeatedly executed until the end of the conference is accepted.

  Then, when the end of the meeting is accepted in step S108, the information management apparatus 12 ends the feature information list generation process.

  Next, an example of the flow of the provided information list generation process will be described with reference to the flowchart of FIG.

  First, when the information management device 12 accepts the start of a conference, for example, when the operation terminal 16 in the conference room 22 is turned on (S201), the provided information acquisition unit 34 stores the storage unit of the information management device 12 Corresponding information corresponding to the provided information displayed on the screen 26 is acquired (S202).

  Then, when the provision information acquisition unit 34 acquires the correspondence information, the provision information list generation unit 35 determines whether the correspondence information list corresponding to the conference is stored in the storage unit of the information management apparatus 12 (S203). ).

  If it is determined that there is no corresponding information list, the provision information list generation unit 35 creates a provision information list (S204) and stores it in the storage unit of the information management apparatus 12.

  Subsequently, in step S202, the provision information list generation unit 35 determines whether the correspondence information acquired by the provision information acquisition unit 34 exists in the provision information list (S205).

  When it is determined that the information does not exist, the provision information list generation unit 35 adds the correspondence information acquired by the provision information acquisition unit 34 to the provision information list (S206). Then, the information management device 12 determines whether or not the end of the conference is accepted (for example, whether or not the operation terminal is turned off) (S207). If not received, the information processing apparatus 12 executes the process S202 and subsequent steps again. In this way, in the present processing example, the processes shown in S202 to S206 are repeatedly executed until the end of the meeting is accepted.

  Then, upon accepting the end of the conference in step S207, the information management apparatus 12 ends the provided information list generation process.

  Next, an example of the flow of the feature information association provision information generation process executed by the feature information association provision information generation unit 36 of the information management device 12 will be described with reference to the flowchart of FIG.

  First, when the information management device 12 accepts the end of the conference, the feature information association provision information generation unit 36 acquires the feature information list generated by the feature information generation unit 32 from the storage unit of the information management device 12 (S301). The provision information list generated by the provision information acquisition unit 34 is acquired (S302).

  In steps S204 to S206, the provision information is read from the provision information storage destination associated with the correspondence information in the provision information list generated by the provision information list generation unit 35 (S303), and the provision information is processed. The feature information list generated by the feature information generation unit 32 in S104 to S107 is associated (S304).

  Specifically, the feature information association provision information generation unit 36 embeds a feature information list in the provision information, for example, and the feature information association provision information as an encrypted new format file composed of the feature information list and the provision information. Is generated. In this case, in order to reduce the size of the provided information that is increased by embedding the feature information list in the provided information, the feature information list may be compressed and associated with the provided information.

  Then, the information management apparatus 12 determines whether or not the feature information list is associated with all the provision information corresponding to the correspondence information in the provision information list (S305). If all of them are not associated, the information management apparatus 12 executes step S303 and subsequent steps again. In this way, the processing shown in processing S303 to processing S305 is repeatedly executed until the feature information list is associated with all the provision information corresponding to the correspondence information existing in the provision information list.

  If it is determined in step S305 that the feature information list association process has been completed for all of the provided information lists, the feature information association provided information generation process ends.

  Next, an example of the flow from the provision destination candidate biometric information acquisition process to the feature information matching process executed by the information processing apparatus 13 in the first embodiment will be described with reference to the flowchart of FIG.

  First, when the provision destination candidate operates the information processing apparatus 13 and inputs a print instruction to print out the feature information association provision information stored in the storage unit of the information management apparatus 12, the characteristics of the information processing apparatus 13 are displayed. The information acquisition unit 40 acquires a feature information list associated with the provided information from the provided information stored in the storage unit of the information management device 12 (S401). Then, the provision destination candidate biometric information acquisition unit 42 of the information processing device 13 acquires the feature information of the provision destination candidate. Subsequently, the provision destination candidate feature information generation unit 44 generates provision destination candidate feature information based on the feature information of the provision destination candidate acquired by the provision destination candidate biometric information acquisition unit 42 (S402). Here, the feature information generation process is the same as the process executed by the biometric information acquisition unit 30 and the feature information generation unit 32 of the information management device 12, and thus the description thereof is omitted here because it is redundant.

  Next, the feature information matching unit 46 of the information processing device 13 includes the feature information list generated by the provision destination candidate feature information generating unit 44 in the process S402 and the feature information acquired by the feature information acquiring unit 40 in the process S401. Are collated (S403). Then, it is determined whether or not feature information whose difference is equal to or less than a predetermined threshold exists in the feature information list (S404).

  Specifically, the feature information collating unit 46 collates the feature information of the provision destination candidate with each feature information included in the feature information list shown in FIG. Here, it is verified whether or not each element included in the feature information matches each element included in the feature information of the candidate to be provided. Then, when the number of elements that do not match is equal to or less than a predetermined number, it is determined that the face feature information of the provision destination candidate exists in the face feature information list.

  If it is determined that the feature information of the candidate for providing does not exist in the feature information list, the information processing apparatus 13 displays an error notification indicating that printing cannot be performed (S405). If it is determined that it exists, the printing apparatus 14 receives a print instruction from the information processing apparatus 13 and prints out the provided information (S406).

[Second Embodiment]
In the first embodiment, the feature information of the participant 24 acquired during the conference is associated with the provided information. However, in the second embodiment, the provided information is further displayed. It is assumed that a word extracted by voice recognition processing is associated with the provided information as character feature information from the voice uttered from the participant 24 acquired in the meantime. The feature information matching unit 46 of the information processing device 13 performs matching using the character feature information in addition to the feature information. This prevents a person who has joined or left the conference halfway from printing information other than the provided information displayed on the screen 26 during the conference.

  In the second embodiment, the biological information acquisition unit 30 of the information management device 12 acquires sound collected by a microphone provided in the camera 20. Then, the sound collected by the camera 20 is transmitted to the information management device 12. The biological information acquisition unit 30 of the information management device 12 acquires the sound. The camera 20 may transmit the acquired sound to the information management apparatus 12 in real time. Alternatively, the camera 20 may record and store the acquired sound, and transmit the stored sound in response to a request from the information management apparatus 12.

  And in 2nd Embodiment, the feature information generation part 32 of the information management apparatus 12 extracts a word from the audio | voice which the biometric information acquisition part 30 acquired using the well-known voice recognition process, and the said word is character characteristic information. And

  Here, an example of the flow of the character feature information list generation process and the provided information list generation process executed by the information management apparatus 12 in the second embodiment will be described.

  First, an example of the flow of the character feature information list generation process will be described with reference to the flowchart of FIG.

  First, when the information management apparatus 12 accepts the start of a meeting, for example, when the operation terminal 16 in the meeting room 22 is turned on (S501), the microphone provided in the camera 20 is moved into the meeting room 22 Start collecting voice. Then, the collected sound is transmitted to the information management device 12 every predetermined time. The information management apparatus 12 executes the processes shown in the processes S502 to S507 in FIG. 10 based on the sound received every predetermined time.

  First, the biometric information acquisition unit 30 acquires from the camera 20 a speech voice uttered by the participant 24 in the conference room 22 and a speech time indicating the time when the speech voice is emitted (S502). Next, the feature information generation unit 32 generates character feature information (here, character feature information is used as feature information) from the speech of the participant 24 acquired by the biometric information acquisition unit 30 (S503). Here, the feature information generation unit 32 generates, as character feature information, a word extracted from the speech of the participant 24 acquired by the biometric information acquisition unit 30 using a known voice recognition process. When the character feature information is acquired, it is determined whether or not a character feature information list corresponding to the conference is stored in the storage unit of the information management device 12 (S504).

  If it is determined that the character feature information list does not exist, a character feature information list is created (S505).

  Subsequently, it is determined whether or not the character feature information generated by the feature information generating unit 32 in the process S503 exists in the character feature information list (S506).

  If it is determined that the character information does not exist, the character feature information is added to the character feature information list together with the utterance time indicating the time when the feature information was uttered as the utterance voice (S507). Then, the information management device 12 determines whether or not the end of the conference has been received (for example, whether or not the operation terminal 16 has been turned off) (S508). If not received, the information processing apparatus 12 executes step S502 and subsequent steps again. In this way, in the present processing example, the processes shown in S502 to S507 are repeatedly executed until the end of the conference is accepted.

  When the end of the meeting is received in step S508, the information management apparatus 12 ends the character feature information list generation process.

  Here, the character feature information list is the same as the face feature information list shown in FIG. 4, and an identification number indicating the order of generation given to each word generated by the feature information generation unit 32 and generated The word is managed in association with the utterance time when the word is uttered.

  And the process similar to the process which the biometric information acquisition part 30 and the characteristic information generation part 32 of 1st Embodiment perform is performed, and a face characteristic information list is also produced | generated.

  Next, an example of the flow of the provided information list generation process will be described with reference to the flowchart of FIG.

  First, when the information management device 12 accepts the start of a conference, for example, when the operation terminal 16 in the conference room 22 is turned on (S601), the provided information acquisition unit 34 stores the storage unit of the information management device 12 The corresponding information corresponding to the provided information displayed on the screen 26 is acquired together with the display start time indicating the time when the provided information is displayed on the screen 26 (S602).

  Then, when the provision information acquisition unit 34 acquires the correspondence information, the provision information list generation unit 35 determines whether the provision information list corresponding to the conference is stored in the storage unit of the information management apparatus 12 (S603). ).

  When it is determined that there is no provision information list, the provision information list generation unit 35 creates a provision information list (S604) and stores it in the storage unit of the information management apparatus 12.

  Subsequently, in step S602, the provision information list generation unit 35 determines whether the correspondence information acquired by the provision information acquisition unit 34 exists in the provision information list (S605).

  If it is determined that it does not exist, the provision information list generation unit 35 adds the correspondence information to the provision information list together with the display start time when the provision information corresponding to the correspondence information is displayed on the screen 26 (S606). Then, the information management device 12 determines whether or not the end of the conference is accepted (for example, whether or not the operation terminal 16 is turned off) (S607). If not received, the information processing apparatus 12 executes step S602 and subsequent steps again. In this way, in the present processing example, the processing shown in S602 to S606 is repeatedly executed until the end of the conference is received.

  Then, upon accepting the end of the conference in step S607, the information management apparatus 12 ends the provided information list generation process.

  Here, the provided information list includes, for each provided information, the file name of the provided information, the location information indicating the location where the provided information is stored, and the display start time indicating the time when the provided information is displayed on the screen 26. Are managed in association with each other.

  Next, an example of the flow of the feature information association provision information generation process executed by the feature information association provision information generation unit 36 of the information management device 12 will be described with reference to the flowchart of FIG.

  First, when the information management device 12 accepts the end of the conference, the feature information association provision information generation unit 36 acquires the feature information list generated by the feature information generation unit 32 from the storage unit of the information management device 12 (S701). The provision information list generated by the provision information list generation unit 35 is acquired (S702), and the character feature information list generated by the feature information generation unit 32 is acquired (S703).

  The feature information association provision information generation unit 36 then provides the provision information list and the character feature information list based on the display start time managed in the provision information list and the utterance time managed in the character feature information list. Are associated (S704). That is, the character feature information corresponding to the speech time included in the time between the display start time corresponding to one correspondence information in the provided information list and the display start time corresponding to the next correspondence information is represented by the one correspondence Associate with information. For example, the provided information list associates, for each provided information, the file name of the provided information, the location information indicating the location where the provided information is stored, the display start time, and the identification number of the associated character feature information. To be managed.

  Then, the feature information association provision information generation unit 36 reads the provision information from the provision information storage destination in the provision information list generated by the provision information list generation unit 35 in information processing S604 to S606 (S705). Next, based on the identification number of the character feature information list associated with the provision information read in step S705, the feature information association provision information generation unit 36 creates a character corresponding to the identification number from the character feature information list. Feature information is read (S706). The provision information association provision information generation unit 36 associates the feature information list acquired in step S701 and the character feature information read in step S706 with the provision information read in step S705 (S707).

  Specifically, the feature information association provision information generation unit 36 embeds a feature information list and character feature information in the provision information, for example, and creates an encrypted new format composed of the feature information list, character feature information, and provision information. Feature information association providing information is generated as a file. In this case, in order to reduce the size of the provided information that is increased by embedding the feature information list in the provided information, the feature information list and the character feature information may be compressed and associated with the provided information. Good.

  Then, the feature information association provision information generation unit 36 determines whether or not the feature information list is associated with all the provision information corresponding to the correspondence information in the provision information list (S708). If all of them are not associated, the information management apparatus 12 executes step S705 and subsequent steps again. In this way, the processing shown in processing S705 to processing S707 is repeatedly executed until the feature information list is associated with all the provision information corresponding to the correspondence information existing in the provision information list.

  When it is determined in step S708 that the feature information list association process has been completed for all of the provided information lists, the feature information association provision information generation unit 36 ends the feature information association provision information generation process.

  Next, an example of the flow from the provision destination candidate biometric information acquisition process to the feature information matching process executed by the information processing apparatus 13 in the second embodiment will be described with reference to the flowchart of FIG.

  First, processing S801 to processing S805 is the same as the processing performed from processing S401 to processing S405 in the flowchart of FIG. 9, and thus description thereof is omitted here because it is redundant.

  If it is determined in step S804 that feature information whose degree of difference is equal to or less than a predetermined threshold value is present in the feature information list, the provision destination candidate biometric information acquisition unit 42 operates the information processing device 13. In step S806, the speech information generated by the providing candidate who has input the print instruction to print out the feature information association providing information stored in the storage unit of the information management apparatus 12 is acquired. Here, when it is determined in step S804 that feature information whose degree of difference is equal to or less than a predetermined threshold value exists in the feature information list, a word related to the provision information to be printed out is issued. An instruction may be output to the previous candidate.

  Next, the provision destination candidate feature information generation unit 44 of the information processing device 13 uses a known speech recognition process to generate a word from the speech spoken by the provision destination candidate acquired by the provision destination candidate biometric information acquisition unit 42. And the word is used as the provision destination candidate character feature information (S807). Then, the feature information matching unit 46 reads the character feature information associated with the provided information by the feature information association providing information generating unit 36 from the storage unit of the information management device 12 (S808).

  Then, the feature information matching unit 46 collates the provision destination candidate character feature information with the character feature information read in step S808 (S809), and character feature information that matches the provision destination candidate character feature information. It is determined whether or not there exists (S810).

  If it is determined that the information does not exist, the information processing apparatus 13 displays an error notification indicating that printing cannot be performed (S811). If it is determined that it exists, the printing apparatus 14 receives a print instruction from the information processing apparatus 13 and prints out the provided information (S812).

[Third embodiment]
In the second embodiment described above, the feature information association provision information generation unit 36 extracts the voice uttered from the participant 24 and associates it with the provision information as character feature information. However, in the third embodiment, the provision information A word is extracted from the characters included in the character and is associated with the provided information as character feature information. The feature information matching unit 46 of the information processing device 13 performs matching using the character feature information. This prevents a person who has joined or left the conference halfway from printing information other than the provided information displayed on the screen 26 during the conference.

  An example of the flow of the character feature information list generation process in the third embodiment will be described with reference to the flowchart of FIG.

  First, the processing from S901 to S906 is the same as the processing performed from S201 to S206 in FIG.

  In step S906, the provision information is read from the provision information storage destination included in the correspondence information added to the provision information list, and a word is extracted from the characters included in the provision information to generate a character feature information list (S907). ). Here, the word to be extracted may be information previously described in the provided information before the start of the conference, or may be information added during the conference. Then, the information management device 12 determines whether or not the end of the conference is accepted (for example, whether or not the operation terminal is turned off) (S908). If not received, the information processing apparatus 12 executes step S902 and subsequent steps again. In this way, in the present processing example, the processing shown in processing S902 to S907 is repeatedly executed until the end of the conference is received.

  When the end of the conference is received in step S907 (S908), the information management apparatus 12 ends the character feature information list generation process.

  The association between the feature information list and the character feature information list with the provided information is the same as the process shown in the flowchart of FIG. Furthermore, since the flow from provision destination candidate biometric information acquisition to feature information matching processing executed by the information processing apparatus 13 in the third embodiment is the same as the processing shown in the flowchart of FIG. Since it overlaps, it abbreviate | omits here.

  In addition, this invention is not limited to the above-mentioned embodiment.

  Although the feature information in the first embodiment is the face feature information, it is not limited to the above example. For example, the voiceprint feature information of the participant 24 may be generated from the sound collected by the microphone described in the description of the biometric information acquisition unit 30 of the second embodiment and used as the feature information.

  In this case, the feature information generation unit 32 of the information management device 12 extracts the speech voices uttered by the participant 24 from the voices acquired from the biological information acquisition unit 30. Then, the feature information generation unit 32 performs A / D conversion on the acquired voice, and extracts the voice transition information associated with the acquired voice by extracting the temporal transition of the voice, the frequency of the voice, the strength of the voice, and the like. Is generated. The feature information generation unit 32 generates voiceprint information associated with the participant 24 for each participant 24 who speaks in the conference room 22 during the conference. Then, the feature information generation unit 32 generates voice print feature information corresponding to the participant 24 for each participant 24 who speaks in the conference room 22 during the conference.

  The feature information generation unit 32 generates a voice print information list including the voice print information of the participant 24 acquired during the conference, and stores it in the storage unit of the information management device 12. In this case, the voiceprint information list is the same as the face feature information list shown in FIG. 4, and an identification number indicating the detected order given to each detected participant 24 and the participant 24. Are managed in association with the voiceprint feature information associated with.

  The provision destination candidate biometric information acquisition unit 42 of the information processing device 13 acquires sound collected by a microphone included in a camera provided in the information processing device 13. Here, the microphone is the same as the microphone provided in the camera 20 described above. The provision destination candidate biometric information acquisition unit 42 of the information processing apparatus 13 acquires a speech voice uttered by the provision destination candidate who has input a print instruction in which the microphone operates the information processing apparatus 13 to print out the provision information. To do. Note that. The provision destination candidate biometric information acquisition unit 42 acquires the sound collected by the microphone when a print instruction is input to the information processing apparatus 13.

  The provision destination candidate feature information generation unit 44 of the information processing apparatus 13 extracts speech voices uttered by the provision destination candidate from the speech acquired by the provision destination candidate biometric information acquisition unit 42. Then, the provision destination candidate characteristic information generation unit 44, for example, performs A / D conversion on the acquired voice, and extracts the temporal transition of the voice, the frequency of the voice, the strength of the voice, and the like, thereby supporting the acquired voice. Generate voiceprint information to be attached. Then, voice print information corresponding to the provision destination candidate who has input a print instruction for printing out the provision information by operating the information processing device 13 is generated.

  The feature information matching unit 46 executes the same processing as in the flowchart of FIG.

  In the second embodiment, the biometric information acquisition unit 30 acquires the voice uttered by the participant 24 together with the utterance time indicating the time when the voice is uttered, but the face image is acquired from the face image. You may acquire with the acquisition time which shows the time. In this case, the feature information association provision information generation unit 36 obtains the acquisition time included in the time between the display start time corresponding to one correspondence information in the provision information list and the display start time corresponding to the next correspondence information. Corresponding feature information is associated with the one correspondence information. For example, the provided information list associates, for each provided information, the file name of the provided information, the location information indicating the location where the provided information is stored, the display start time, and the identification number of the related feature information. It will be managed.

  Further, in an example in which the information management system 10 shown in FIG. 2 is used, a camera may be further installed around the conference room 22 (hereinafter referred to as a peripheral camera). In this case, it is assumed that the peripheral camera always captures the periphery of the conference room 20 regardless of whether there is a conference. In 2nd Embodiment, the biometric information acquisition part 30 acquires the moving image image | photographed with the periphery camera further in the time slot | zone where the meeting is performed. Then, the feature information generation unit 32 generates a feature information list based on the moving image captured by the peripheral camera acquired by the biological information acquisition unit 30. Further, as described in the second embodiment, the feature information generation unit 32 generates feature information based on a moving image photographed by the camera 20 and is collected by a microphone provided in the camera 20. Character feature information is generated based on the voice. In addition to the processing described in the second embodiment, the feature information association provision information generation unit 36 also associates a feature information list generated based on a moving image photographed by the peripheral camera with the provision information. Then, the feature matching unit 46 of the information processing apparatus 13 includes feature information generated based on the moving image captured by the camera 20, feature information generated based on the moving image captured by the peripheral camera, and character feature information. And collating with each other. By doing so, the person who is in the vicinity of the meeting room 22 during the time of the meeting is authenticated, and the person who has participated in the meeting while the provided information is displayed on the screen 26 is authenticated. This improves authentication accuracy.

  In the second embodiment, after the feature information matching unit 46 of the information processing device 13 matches the offer destination candidate feature information with the feature information associated with the offer information, the offer destination candidate character feature information and The character feature information associated with the provided information is collated, but the present invention is not limited to such an example. For example, the process of collating the provision destination candidate character feature information with the character feature information associated with the provision information, except for the process of collating the provision destination candidate feature information with the feature information associated with the provision information. Just as good. Alternatively, the above-described two processes may be executed in parallel, and the provided information may be printed out when the collation is successful in the two processes, or when the collation is successful in any of the processes.

  Further, the biological information acquisition unit 30 of the information management device 12 may be built in the camera 20. In this case, feature information is generated based on the biological information acquired by the camera 20 and transmitted to the information management device 12. Then, the information management device 12 generates a feature information list based on the acquired feature information.

  Further, the division of roles between the information management device 12 and the information processing device 13 is not limited to the above example. For example, the information management device 12 may generate provision destination candidate feature information from the obtained provision destination candidate biometric information, and collate the feature information. Moreover, although the example in which the information management device 12 and the information processing device 13 are separate devices has been described, these may be integrated devices. Furthermore, the information processing apparatus 13 and the printing apparatus 14 may be an integrated apparatus.

  Further, the information management device 12 may be installed outside the conference room 22, for example, as a server. In addition, although an example in which the camera 20 and the microphone are an integrated device has been shown, these may be separate devices. That is, a separate microphone may be installed in the conference room 22 separately from the camera 20. Further, a display device using liquid crystal or CRT may be used instead of the projector 18. In addition, although provided information showed about the example memorize | stored in the memory | storage part of the information management apparatus 12, you may memorize | store in the memory | storage part of the operating terminal 16. FIG. In this case, the provision information acquisition unit 34 acquires correspondence information associated with the provision information displayed on the screen 26 from the storage unit of the operation terminal 16.

  DESCRIPTION OF SYMBOLS 10 Information management system, 12 Information management apparatus, 13 Information processing apparatus, 14 Printing apparatus, 16 Operation terminal, 18 Projector, 20 Camera, 22 Conference room, 24 Participant, 26 Projector, 28 Door, 30 Biometric information acquisition part, 32 Feature information generation unit, 34 Provision information acquisition unit, 35 Provision information list generation unit, 36 Feature information association provision information generation unit, 40 Feature information acquisition unit, 42 Provision destination candidate biometric information acquisition unit, 44 Provision destination candidate feature information Generation unit, 46 feature information collation unit, 48 print output unit.

Claims (11)

Feature information acquisition means for acquiring feature information representing the characteristics of a living body of a person;
Feature information associating means for associating the feature information of the plurality of persons with provision information provided to the plurality of persons;
An information management system comprising: The feature information association unit associates the feature information acquired by the feature information acquisition unit with the provision information while the provision information is displayed.
The information management system according to claim 1. The feature information acquisition means acquires face feature information generated based on a human face image,
The feature information associating means associates the face information of a plurality of persons to whom the provision information is provided with the provision information.
The information management system according to claim 1 or 2, characterized by the above. The feature information acquisition means acquires voiceprint feature information generated based on a voice uttered by a person,
The feature information association means associates the voice print feature information of a plurality of persons to whom the provision information is provided with the provision information.
The information management system according to claim 1 or 2, characterized by the above. Whether or not to provide the provision information to the provision candidate based on a comparison result between the feature information representing the biological characteristics of the provision candidate of the provision information and the feature information associated with the provision information A judgment means for judging
The information management system according to any one of claims 1 to 4, wherein Providing means for providing the provision information to the provision candidate when the judgment means determines to provide the provision information to the provision candidate.
The information management system according to claim 5. The feature information associating means associates the provided information with character information extracted from a voice uttered by any of a plurality of persons to whom the provided information is provided, or character information included in the provided information,
The determination means is extracted from a comparison result between feature information representing a biometric feature of the provision candidate of the provision information and the feature information associated with the provision information, and a voice uttered by the provision candidate. Based on the comparison result between the character information and the character information associated with the provision information, it is determined whether to provide the provision information to the provision candidate.
The information management system according to claim 5 or 6, characterized by the above. Including an information management device and an information providing device,
The information management device includes:
Feature information acquisition means for acquiring feature information representing the characteristics of a living body of a person;
Feature information association means for associating the feature information of the plurality of persons with provision information provided to the plurality of persons,
The information providing apparatus includes:
Whether to provide the provision information to the provision destination candidate based on the comparison result between the feature information representing the characteristics of the living body of the person who is the provision destination candidate of the provision information and the feature information associated with the provision information A determination means for determining whether or not,
Providing means for providing the provision information to the provision destination candidate when the judgment means determines to provide the provision information to the provision destination candidate;
An information management system characterized by that. Comparison result between feature information representing the biometric features of the plurality of persons and feature information representing the biometric features of the provision destination candidates of the provision information, which are associated with the offer information provided to the plurality of people A determination means for determining whether or not to provide the provision information to the provision destination candidate,
Providing means for providing the providing information to the providing candidate when the judging means determines to provide the providing information to the providing candidate;
An information providing apparatus comprising: Feature information acquisition means for acquiring feature information representing the characteristics of a living body of a person;
Feature information associating means for associating the feature information of the plurality of persons with provision information provided to the plurality of persons;
A program characterized by causing a computer to function. Feature information representing the biometric features of the plurality of persons associated with the provision information provided to the plurality of persons, and feature information representing the biometric characteristics of the person who is the provision destination candidate of the provision information. A determination means for determining whether to provide the provision information to a person who is a candidate for the provision destination based on a comparison result;
Provision means for providing the provision information to the provision destination candidate when the judgment means determines to provide the provision information to the person who is the provision destination candidate;
A program characterized by causing a computer to function.

Images