JP2013235449A - Information management apparatus, information management method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To manage electronic data corresponding to a printed matter on the basis of daily operations such as breaking an actually printed matter and throwing it into a trash box.SOLUTION: An information management apparatus 1 includes: a database 14 for accumulating electronic data corresponding to a printed matter 20; a printed matter identification unit 11 for acquiring location information of the electric data corresponding to the printed matter 20; a user behavior recognition unit 10 for recognizing a user behavior with respect to the printed matter 20; a printed matter state control unit 12 for, when the user behavior is recognized as a disposal action by the user behavior recognition unit 10, determining disposal processing of the electronic data corresponding to the printed matter 20; and data management unit 13 for deleting the electronic data corresponding to the printed matter 20, which is accumulated in the database 14, according to the determination of the printed matter state control unit 12.

Description

  The present invention relates to an information management apparatus, an information management method, and a program.

  A user creates document data (flyers, materials, etc.) composed of electronic data by an information processing apparatus such as a computer, a mobile phone, or a smartphone, and manages the document after printing and using the document data as a printed matter. In addition, it is stored in a binder or a box, or it is discarded when it is broken.

  At this time, the electronic data corresponding to the document data remains stored in a storage medium (memory, hard disk, etc.) in the information processing apparatus. Data management in an information processing apparatus cannot be performed in conjunction with user actions and actions, and must be performed by a management method unique to the information processing apparatus. In other words, the user needs to learn the management method and become familiar with it.

  For example, in Patent Document 1, in order to prove that the printed material has been securely discarded (presented to the user), identification information is printed at the time of printing, information extracted at the stage of cutting, and prior identification A method of collating with information has been proposed.

JP 2009-157516 A

  However, in the above-mentioned Patent Document 1, although the printed matter itself can be discarded, it is not intended to manage the electronic data. Therefore, it is not possible to discard the original electronic data in conjunction with the state of the discarded printed matter. There is a problem that you can not.

  The present invention has been made in consideration of such circumstances, and its purpose is to provide an electronic device corresponding to a printed material based on daily operations such as tearing a printed material actually printed or throwing it into a trash can. An object is to provide an information management apparatus, an information management method, and a program that can manage data.

  In order to solve the above-described problem, an information management apparatus according to an aspect of the present invention includes a database that stores electronic data corresponding to a printed material, and a printed material identification unit that acquires location information of the electronic data corresponding to the printed material. , A user behavior recognition unit that recognizes user behavior with respect to the printed matter, and a printed matter state that determines a disposal process of electronic data corresponding to the printed matter when the user behavior recognition unit recognizes that the user behavior is a discarding act An information management apparatus comprising: a control unit; and a data management unit that deletes electronic data corresponding to the printed matter stored in the database according to a determination made by the printed matter state control unit.

  In the information management apparatus, the printed matter identification unit is configured to obtain location information of electronic data corresponding to the printed matter based on the printed matter reading unit that reads the paper surface of the printed matter as image data and the image data read by the printed matter reading unit. You may make it provide the image recognition part to acquire.

  In the information management apparatus, the user behavior recognition unit determines whether the user behavior is a discarding action based on a photographing unit that photographs the user behavior with respect to the printed matter and a video photographed by the photographing unit. You may make it provide an identification part.

  In the information management apparatus, the user behavior identification unit includes an object for discarding the printed material based on the video imaged by the imaging unit, and the printed material is placed in the object. If the user action is recognized, the user action may be identified as a discard action.

  In the information management apparatus, the object may be a trash can or a shredder.

  In the information management apparatus, the user behavior identification unit is configured to determine a position of both hands of the user, a state of the printed material between both hands of the user, and a movement of both hands of the user with respect to the printed material based on the video imaged by the imaging unit. The user action may be identified as a discarding action based on any one of the state changes of the printed matter or a combination thereof.

  In the information management apparatus, the user behavior recognition unit is configured to determine the position of both hands of the user, the state of the printed matter between the two hands of the user, based on the video photographed by the photographing unit by the user behavior identification unit, When the movement of both hands of the user with respect to the printed matter, the state change of the printed matter, or a combination of these is identified, the speed of moving the user's hands is equal to or greater than a predetermined threshold, or the user A user behavior level determination unit that determines whether or not the number of times both hands have moved is equal to or greater than a predetermined threshold, and the printed material state control unit is configured such that the speed of moving both hands of the user by the user behavior level determination unit is a predetermined threshold value Or when it is determined that the number of times the user has moved both hands is equal to or greater than a predetermined threshold, the electronic data corresponding to the printed matter It may be determined the disposal process.

  In the information management apparatus, the user behavior recognition unit is configured to generate a sound recording unit that records a sound during user behavior and a sound when the printed material is broken by analyzing the sound captured by the sound recording unit. When it is recognized that there is a user action, a user action identification unit for identifying that the user action is a discarding action may be provided.

  In the information management apparatus, the user action recognition unit includes a sensor worn on a user's finger, a sensor signal acquisition unit that acquires a detection signal obtained from the sensor, and a detection signal acquired by the sensor signal acquisition unit. A user action identifying unit that analyzes and recognizes that the user action is a discarding action when the movement of the hand when the printed material is broken is recognized.

  In order to solve the above-described problem, an information management method according to another aspect of the present invention includes a step of storing electronic data corresponding to a printed matter in a database, and a step of acquiring location information of the electronic data corresponding to the printed matter. A step of recognizing a user action on the printed matter, a step of determining a discarding process of electronic data corresponding to the printed matter when the user behavior is recognized as a discarding action, And deleting the electronic data corresponding to the printed matter.

  In order to solve the above-described problem, a program according to another aspect of the present invention acquires, in a computer, a storage function for storing electronic data corresponding to a printed matter in a database, and location information of the electronic data corresponding to the printed matter. A printed matter identification function, a user behavior recognition function for recognizing a user behavior with respect to the printed matter, and a printed matter state control function for determining a discarding process of electronic data corresponding to the printed matter when the user behavior is recognized as a discarding action, According to the determination by the printed matter state control function, the program executes a data management function for deleting electronic data corresponding to the printed matter, which is stored in the database.

  According to the present invention, electronic data corresponding to a printed matter can be managed based on daily operations such as tearing a printed matter actually printed or throwing it into a trash can.

It is a block diagram which shows the structure of the information management apparatus 1 by 1st Embodiment. It is a flowchart for demonstrating operation | movement of the information management apparatus 1 by 1st Embodiment. It is a block diagram which shows the structure of the information management apparatus 1 by 2nd Embodiment. It is a flowchart for demonstrating operation | movement of the information management apparatus 1 by 2nd Embodiment. It is a block diagram which shows the structure of the information management apparatus 1 by 3rd Embodiment. It is a flowchart for demonstrating operation | movement of the information management apparatus 1 by 3rd Embodiment. It is a block diagram which shows the structure of the information management apparatus 1 by 4th Embodiment. It is a flowchart for demonstrating operation | movement of the information management apparatus 1 by 4th Embodiment. It is a block diagram which shows the structure of the information management apparatus (part) 1 by 5th Embodiment. It is a block diagram which shows the structure of the information management apparatus (part) 1 by 6th Embodiment.

  Hereinafter, each embodiment of the present invention will be described with reference to the drawings.

[First Embodiment]
FIG. 1 is a block diagram showing the configuration of the information management apparatus 1 according to the first embodiment. As shown in FIG. 1, the information management apparatus 1 includes a user action recognition unit 10, a printed material identification unit 11, a printed material state control unit 12, a data management unit 13, and a database 14. Note that the information management apparatus 1 (same in other embodiments) may be, for example, a personal computer, a tablet terminal, or the like.

  The user action recognition unit 10 recognizes actions and actions performed by the user 21 on the printed matter 20. The printed matter identification unit 11 acquires the location information given to the printed matter 20 as electronic data, and confirms the location of the electronic data corresponding to the printed matter 20 stored in the database 14 based on the location information.

  Based on the user behavior recognized by the user behavior recognition unit 10, the printed material state control unit 12 determines the state change content of the electronic data corresponding to the printed material 20 confirmed by the printed material identification unit 11, and the data management unit 13 is notified. More specifically, when the user 21 performs an operation or action for discarding the printed material 20, the data management unit 13 is notified to discard (or process as if the electronic data corresponding to the printed material 20 is discarded). .

  The data management unit 13 changes the management state of the electronic data stored in the database 14 based on the state change contents notified from the printed matter state control unit 12 (processes as being discarded or discarded). The database 14 corresponds to a storage medium such as a so-called hard disk, and holds electronic data corresponding to the printed matter 20. The location of electronic data is managed based on directories and folders. That is, the information processing apparatus 1 manages the location of electronic data by the path from the root directory.

  FIG. 2 is a flowchart for explaining the operation of the information management apparatus 1 according to the first embodiment. First, the user holds the printed material 20 to be discarded over the printed material identification unit 11 of the information processing apparatus 1. The printed matter identification unit 11 acquires the location information printed on the printed matter 20 as electronic data (step Sa1), and the location of the electronic data corresponding to the printed matter 20 stored in the database 14 based on the location information. Is confirmed (step Sa2).

  Next, the printed matter identification unit 11 determines whether there is electronic data with matching location information (step Sa3). If there is no electronic data with matching location information (step Sa3: NO), The process ends.

  On the other hand, when there is electronic data with matching location information (step Sa3: YES), the printed matter identification unit 11 acquires the location of the matched electronic data (step Sa4).

  The user holds the printed matter 20 to be discarded over the printed matter identification unit 11 of the information processing apparatus 1 and then breaks the printed matter 20 in front of the user action recognition unit 10. The user behavior recognition unit 10 analyzes the user behavior (step Sa5) and determines whether or not the operation is to break the printed matter 20 (step Sa6).

  If the user action is not an operation that broke the printed matter 20 (step Sa6: NO), the process is terminated.

  On the other hand, when the user action is an operation that broke the printed matter 20 (step Sa6: YES), the data management unit 13 follows the notification from the printed matter state control unit 12 and the electronic data stored in the database 14 Is discarded (step Sa7).

  More specifically, the printed material state control unit 12 performs data management such that the electronic data corresponding to the printed material 20 is discarded (or processed as being discarded) based on the user behavior recognized by the user behavior recognition unit 10. Notification to the unit 13. The data management unit 13 discards the electronic data stored in the database 14 in accordance with the notification from the printed material state control unit 12. Instead of actually discarding (deleting) the electronic data, the electronic data may be moved to the deleted storage area as being discarded, or a flag indicating that the electronic data is discarded may be set.

  According to the first embodiment described above, electronic data in the information management apparatus 1 corresponding to a printed matter can be managed based on daily operations such as breaking the actually printed matter.

[Second Embodiment]
FIG. 3 is a block diagram showing a configuration of the information management apparatus 1 according to the second embodiment. It should be noted that portions corresponding to those in FIG. In the second embodiment, the printed matter identification unit 11 includes a printing unit reading unit 111 and an image recognition unit 112.

  The information management apparatus 1 manages the location of electronic data based on the path from the root directory based on directories and folders. When printing the electronic data, the information processing apparatus 1 prints the location information (path information) indicating the location of the electronic data on the printed matter as a character string or a mark (such as a QR code (registered trademark)). It has become.

  The printing unit reading unit 111 reads location information printed as a character string or a mark (such as a QR code (registered trademark)) on the printed matter 20 as image data. That is, the printing unit reading unit 111 includes an imaging device such as a camera. The image recognition unit 112 recognizes the read image data by an image recognition technique, converts the image data into location information indicating the location of the electronic data, and confirms the location of the electronic data based on the location information.

  FIG. 4 is a flowchart for explaining the operation of the information management apparatus 1 according to the second embodiment. First, the user holds the printed matter 20 to be discarded over the printed matter reading unit 111 of the information processing apparatus 1. The printed material reading unit 111 reads location information printed as a character string or a mark (such as a QR code (registered trademark)) on the printed material 20 as image data (step Sb1). The image recognition unit 112 recognizes the read image data by image recognition technology, converts the image data into location information indicating the location of the electronic data (step Sb2), and confirms the location of the electronic data based on the location information (step Sb3). ).

  Next, the image recognition unit 112 determines whether or not there is electronic data that matches the location information (step Sb4). If there is no electronic data that matches the location information (step Sb4: NO), The process ends.

  On the other hand, when there is electronic data with matching location information (step Sb4: YES), the image recognition unit 112 acquires the location of the matched electronic data (step Sb5).

  The user breaks the printed matter 20 in front of the user action recognition unit 10 after holding the printed matter 20 to be discarded over the printed matter reading unit 111 of the information processing apparatus 1. The user behavior recognition unit 10 analyzes the user behavior (step Sb6) and determines whether or not the operation is to break the printed matter 20 (step Sb7).

  If the user action is not an operation that broke the printed matter 20 (step Sb7: NO), the process ends.

  On the other hand, when the user action is an operation that broke the printed material 20 (step Sb7: YES), the data management unit 13 follows the notification from the printed material state control unit 12 and the electronic data stored in the database 14 Is discarded (step Sb8). Instead of actually discarding (deleting) the electronic data, the electronic data may be moved to the deleted storage area as being discarded, or a flag indicating that the electronic data is discarded may be set.

  In the second embodiment, when a character string indicating location information or a mark (such as QR code (registered trademark)) is not printed on the printed matter 20, the entire reading surface is captured as image data, The location of the electronic data corresponding to the printed matter 20 may be acquired by searching for matching electronic data in the preview images of all the electronic data in the database 14 using a recognition technique. In the second embodiment, the information indicating the location information printed on the printed matter 20 may be a barcode. In this case, the printed matter reading unit 111 may be an imaging device such as a camera. A barcode reader dedicated to barcodes may be used.

  According to the second embodiment described above, electronic data in the information management apparatus 1 corresponding to a printed matter can be managed based on daily operations such as breaking the actually printed matter.

[Third Embodiment]
FIG. 5 is a block diagram showing a configuration of the information management apparatus 1 according to the third embodiment. It should be noted that portions corresponding to those in FIG. In FIG. 5, the user behavior recognition unit 10 includes a photographing unit 101 and a user behavior identification unit 102. The photographing unit 101 is a so-called camera device, photographs a user (operation) in a photographing range (which may be a still image or a moving image continuously shot), and supplies photographing data to the user action identifying unit 102.

  The user action identification unit 102 identifies the actions and actions performed by the user 21 on the printed matter 20 based on the captured data, and the user broke the printed matter. More specifically, the user action identification unit 102 identifies the shape of the user's hand and the skin color from the shooting data, determines that the left and right hands are connected by the color of the printed material, It is determined that the user has broken the printed material 20 by holding the printed material 20 in both hands and further identifying that the movements of the left and right hands have moved at a certain speed or higher in different directions. Alternatively, it may be determined that the user has broken the printed material by identifying a state in which the left and right hands are connected by the color of the printed material and are continuously divided.

  FIG. 6 is a flowchart for explaining the operation of the information management apparatus 1 according to the third embodiment. First, the user holds the printed material 20 to be discarded over the printed material identification unit 11 of the information processing apparatus 1. The printed matter identification unit 11 acquires the location information printed on the printed matter 20 as electronic data (step Sc1), and the location of the electronic data corresponding to the printed matter 20 stored in the database 14 based on the location information. Is confirmed (step Sc2).

  Next, the printed matter identification unit 11 determines whether there is electronic data with matching location information (step Sc3). If there is no electronic data with matching location information (step Sc3: NO), The process ends.

  On the other hand, when there is electronic data with matching location information (step Sc3: YES), the printed matter identification unit 11 acquires the location of the matched electronic data (step Sc4).

  The user holds the printed matter 20 to be discarded over the printed matter identification unit 11 of the information processing apparatus 1 and then breaks the printed matter 20 in front of the user action recognition unit 10. The photographing unit 101 of the user action recognizing unit 10 photographs a user (operation) in the photographing range (step Sc5). The user action identifying unit 102 identifies the operation and action performed by the user 21 for the printed matter 20 by analyzing the image of the captured data (step Sc6), and determines whether the action is to break the printed matter 20. (Step Sc7).

  In user behavior recognition, the shape of the hand and the color of the skin are identified using image analysis technology, and the user recognizes that the left and right hands are connected by the color of the printed material 20 so that the user can select the printed material 20. It is determined that it is held in both hands, and further, it is determined that the user has broken the printed matter 20 by recognizing that the movements of the left and right hands have moved at a certain speed or higher in separate vertical directions.

  If the user action is not an operation that has broken the printed matter 20 (step Sc7: NO), the process ends.

  On the other hand, when the user action is an operation that broke the printed material 20 (step Sc7: YES), the data management unit 13 follows the notification from the printed material state control unit 12 and the electronic data stored in the database 14 Is discarded (step Sc8). Instead of actually discarding (deleting) the electronic data, the electronic data may be moved to the deleted storage area as being discarded, or a flag indicating that the electronic data is discarded may be set.

  According to the third embodiment described above, electronic data in the information management apparatus 1 corresponding to a printed matter can be managed based on daily operations such as tearing the actually printed matter.

[Fourth Embodiment]
FIG. 7 is a block diagram showing a configuration of the information management apparatus 1 according to the fourth embodiment. It should be noted that portions corresponding to those in FIG. In FIG. 7, the user behavior recognition unit 10 includes a photographing unit 101, a user behavior identification unit 102, and a user behavior level determination unit 103. The user action level determination unit 103 determines the speed and the number of times the user's hands are moved as the user action level based on the action and the action identification result of the user 21 performed on the printed matter 20 by the user action identification unit 102. If the speed of movement is equal to or higher than a predetermined threshold or the number of times of movement is equal to or higher than the predetermined threshold, it is determined that the user has broken the printed material into an unrecoverable state.

  FIG. 8 is a flowchart for explaining the operation of the information management apparatus 1 according to the fourth embodiment. First, the user holds the printed material 20 to be discarded over the printed material identification unit 11 of the information processing apparatus 1. The printed matter identification unit 11 acquires the location information printed on the printed matter 20 as electronic data (step Sd1), and the location of the electronic data corresponding to the printed matter 20 stored in the database 14 based on the location information. Is confirmed (step Sd2).

  Next, the printed matter identification unit 11 determines whether there is electronic data with matching location information (step Sd3). If there is no electronic data with matching location information (step Sd3: NO), The process ends.

  On the other hand, when there is electronic data with matching location information (step Sd3: YES), the printed matter identification unit 11 acquires the location of the matched electronic data (step Sd4).

  The user holds the printed matter 20 to be discarded over the printed matter identification unit 11 of the information processing apparatus 1 and then breaks the printed matter 20 in front of the user action recognition unit 10. The photographing unit 101 of the user behavior recognizing unit 10 photographs the user (operation) in the photographing range (step Sd5). The user behavior identification unit 102 identifies the operation and behavior performed by the user 21 on the printed matter 20 by performing image analysis on the captured data (step Sd6). The user behavior recognition method is the same as in the third embodiment described above. However, in the fourth embodiment, at this point in time, the user's operation and action are identified, and it is not determined whether the printed matter 20 has been broken.

  Next, the user action degree determination unit 103 determines the user action degree based on the action and action identification result of the user 21 performed on the printed matter 20 by the user action identifying unit 102 (step Sd7), and the printed matter 20 is determined. It is determined whether or not the operation is a breaking operation (step Sd8). For example, when the speed of moving both hands of the user is equal to or higher than a predetermined threshold, or when the number of times of movement is equal to or higher than the predetermined threshold, it is determined that the user has broken the printed matter into an unrecoverable state.

  If the user action is not an operation that broke the printed matter 20 (step Sd8: NO), the process ends.

  On the other hand, when the user action is an operation that broke the printed material 20 (step Sd8: YES), the data management unit 13 follows the notification from the printed material state control unit 12 and the electronic data stored in the database 14 Is discarded (step Sd9). Instead of actually discarding (deleting) the electronic data, the electronic data may be moved to the deleted storage area as being discarded, or a flag indicating that the electronic data is discarded may be set.

  In the fourth embodiment described above, it is recognized that the user action is an action that broke the printed matter according to the degree of the user action, but the electronic data discard level is further changed according to the degree of the user action. It may be. The discard level refers to moving to a removable storage area that can be restored, moving to a deleted storage area that cannot be restored, and the like. For example, when the moving speed of a finger is equal to or higher than a predetermined threshold, or when the number of times the finger is moved is equal to or higher than a predetermined threshold within a certain time, the data is moved to a deleted storage area that cannot be restored. It may be.

  According to the above-described fourth embodiment, the electronic data in the information management apparatus 1 corresponding to the printed matter is surely obtained based on daily operations such as tearing the printed matter actually printed or throwing it into the trash can. Can be discarded. In addition, if the management level of electronic data is changed according to the level of user action when it is torn or thrown into the recycle bin, for example, if it is broken finely or thrown into the recycle bin vigorously, the electronic data is restored. More detailed management such as making it impossible is possible.

  The recognition of the act of throwing it into the trash can, for example, by recognizing that the user puts the printed matter in the trash after capturing the image of the trash and obtaining the location information of the electronic data corresponding to the printed matter from the printed matter. It will be realized.

[Fifth Embodiment]
FIG. 9 is a block diagram showing a configuration of the information management apparatus (part) 1 according to the fifth embodiment. In FIG. 9, only the configuration of the user action recognition unit 10 is shown, and other configurations are omitted. In FIG. 9, the user behavior recognition unit 10 includes a sound recording unit 104 and a user behavior identification unit 105. The sound recording unit 104 includes a so-called microphone, captures sounds around the information management apparatus 1, and supplies the captured sound data to the user action identification unit 105. The user action identification unit 105 performs spectrum analysis or the like using sound analysis technology based on the captured voice data, and determines the user's discard action by recognizing the sound when the user breaks the printed matter. The main operation of the information management apparatus 1 is the same as that in the first to fourth embodiments described above, and a description thereof will be omitted.

  According to the fifth embodiment described above, even in situations where it is difficult to recognize daily operations such as tearing a printed matter that is actually printed, it is based on the sound when the printed matter is torn. The electronic data in the information management apparatus 1 corresponding to the printed matter can be surely discarded.

[Sixth Embodiment]
FIG. 10 is a block diagram showing a configuration of an information management apparatus (part) according to the sixth embodiment. In FIG. 10, only the configuration of the user action recognition unit 10 is shown, and other configurations are omitted. In FIG. 10, the user behavior recognition unit 10 includes sensors 106 and 106, a sensor signal acquisition unit 107, and a user behavior identification unit 108. The sensors 106 and 106 include a triaxial acceleration sensor, a gyro sensor, and the like, and are attached to the user's finger. The sensors 106 supply a detection signal corresponding to the movement of the user's finger to the sensor signal acquisition unit 107. The sensor signal acquisition unit 107 acquires detection signals from the sensors 106 and 106, performs predetermined signal processing, and then supplies the detection signals to the user behavior identification unit 108. The user action identification unit 108 determines the user's discard action by using the detection signal from the sensor signal acquisition unit 107 and recognizing an operation in which the user holds the printed material with both hands and tears it up and down. The main operation of the information management apparatus 1 is the same as that in the first to fourth embodiments described above, and a description thereof will be omitted.

  According to the sixth embodiment described above, it is possible to more reliably recognize daily operations such as tearing a printed matter that has been actually printed, and electronic data in the information management apparatus 1 corresponding to the printed matter can be obtained. It can be reliably destroyed.

  In addition, although each said embodiment assumes the case where the electronic data corresponding to printed matter is destroyed based on the result of actually destroying printed matter, the electronic data of printed matter after discarding electronic data first If the location information is acquired, that is, if there is no electronic data with the same location information (eg, step Sa3: No in the first embodiment), there is electronic data corresponding to the discarded printed matter. It may be notified to the user that it has not been made (warning sound or message for prompting discard of the printed matter).

  In each of the above embodiments, after the user recognizes the discarding action and before discarding the electronic data (for example, immediately before step Sa7 in the first embodiment), the user is asked whether the electronic data can be actually discarded. You may make it add the alert process to confirm, and the message process notified to a user when the said electronic data are actually discarded. Further, when the discard action by the user is not recognized (for example, step Sa6: No in the first embodiment), the user is notified that the discard action has not been recognized or the electronic data is not discarded. Message processing may be added.

  As an example of the discarding action by the user, in the above embodiment, the act of breaking the printed matter and the act of discarding the printed matter in the trash can have been described. , An act of rounding the printed material small, an act of burning the printed material, and an act of painting the printed material).

  The act of putting the printed material into the shredder is realized by, for example, imaging the shredder and recognizing a temporal change in which the size of the target printed material gradually decreases and disappears at the position of the shredder. The act of rounding the printed material small is realized, for example, by recognizing the movement of the user's hand and the change in the shape of the printed material. The act of burning the printed material is realized, for example, by recognizing an image or temperature when the fire is burning with a camera or a temperature sensor. The act of painting a printed material is realized by recognizing a temporal color change in which, for example, a character string that was originally recognized is painted with the same color by a camera.

  In addition, as in the fourth embodiment, when changing the discard level according to the degree of user operation, a complicated or complex action (for example, an action of rolling a printed material and throwing it into the trash box) In this case, it may be moved to a deleted storage area that cannot be restored.

  Moreover, in each said embodiment, although the printed matter identification part 11 and the user action recognition part 10 were set as the separate structure, photography of printed matter (location information) is not restricted only to this with one imaging device (camera). It is also possible to take an image of the user's action and behavior with respect to the printed matter, acquire the printed matter (location information) based on the photographed video, and recognize the user's action and behavior with respect to the printed matter.

  Moreover, in each said embodiment, although the information management apparatus 1 demonstrated the structure provided with the printed matter identification part 11 and the action recognition part 10, the printed matter identification part 11 (the user action recognition part 10 is also the same) is a different body. Also good. For example, another device that can communicate with the information management device 1 may recognize a printed matter, or another device that can communicate with the information management device 1 may recognize a user action.

  Moreover, in each said embodiment, although the information management apparatus 1 demonstrated the structure provided with the database 14 which accumulate | stores the electronic data used as destruction object, the database 14 may be a different body. For example, another device that can communicate with the information management apparatus 1 may store electronic data to be discarded.

DESCRIPTION OF SYMBOLS 1 ... Information management apparatus 10 ... User action recognition part 101 ... Imaging | photography part 102 ... User action identification part 103 ... User action grade determination part 104 ... Sound recording part 106 ... Sensor 107 ... Sensor signal acquisition part 105, 108 ... User action recognition part DESCRIPTION OF SYMBOLS 11 ... Printed material identification part 111 ... Printed material reading part 112 ... Image recognition part 12 ... Printed material state control part 13 ... Data management part 14 ... Database 20 ... Printed material 21 ... User

Claims (11)

A database for storing electronic data corresponding to printed matter;
A printed matter identifying unit for obtaining location information of electronic data corresponding to the printed matter;
A user behavior recognition unit for recognizing user behavior with respect to the printed matter;
When the user behavior recognition unit recognizes that the user behavior is a discarding action, a printed matter state control unit that determines a discarding process of electronic data corresponding to the printed matter;
An information management apparatus comprising: a data management unit that deletes electronic data corresponding to the printed matter stored in the database according to the determination by the printed matter state control unit. The printed matter identification unit
A printed material reading unit that reads the paper surface of the printed material as image data;
The information management apparatus according to claim 1, further comprising: an image recognition unit that acquires location information of electronic data corresponding to the printed matter based on the image data read by the printed matter reading unit. The user action recognition unit
An imaging unit that captures user behavior with respect to the printed matter;
The information management apparatus according to claim 1, further comprising: a user behavior identifying unit that determines whether the user behavior is a discarding action based on the video photographed by the photographing unit. The user action identification unit
When the user recognizes that there is an object for discarding the printed matter and the printed matter is put in the object based on the video photographed by the photographing unit, the user action is a discarding action. The information management apparatus according to claim 3, wherein the information management apparatus is identified as being present. The object is
The information management apparatus according to claim 4, wherein the information management apparatus is a trash can or a shredder. The user action identification unit
Based on the image captured by the imaging unit, the position of the user's hands, the state of the printed material between the user's hands, the movement of the user's hands with respect to the printed material, the state change of the printed material, or any of these The information management apparatus according to claim 3, wherein the user action is identified as a discarding action based on a combined state. The user action recognition unit
Based on the image photographed by the photographing unit by the user action identifying unit, the position of both hands of the user, the state of the printed material between the user's hands, the movement of both hands of the user with respect to the printed material, the state change of the printed material Whether the speed of moving both hands of the user is equal to or higher than a predetermined threshold or the number of times the user has moved both hands is equal to or higher than the predetermined threshold A user action degree determination unit for determining
The printed matter state control unit
Corresponds to the printed matter when it is determined that the speed of moving both hands of the user is greater than or equal to a predetermined threshold or the number of times the user has moved both hands is greater than or equal to the predetermined threshold The information management apparatus according to claim 6, wherein the electronic data discarding process is determined. The user action recognition unit
A sound recording unit that records the sounds of user actions,
Analyzing a sound captured by the sound recording unit, and recognizing that the sound is a sound when the printed material is broken; The information management apparatus according to claim 1, further comprising: The user action recognition unit
A sensor worn on the user's finger;
A sensor signal acquisition unit for acquiring a detection signal obtained from the sensor;
A user action identifying unit that analyzes the detection signal obtained by the sensor signal obtaining unit and identifies the user action as a discarding action when a hand movement when the printed material is broken is recognized. The information management apparatus according to claim 1. Storing electronic data corresponding to printed matter in a database;
Obtaining location information of electronic data corresponding to the printed matter;
Recognizing user behavior for the printed matter;
Determining that the electronic data corresponding to the printed matter is to be discarded when the user action is recognized as a discarding action;
Deleting the electronic data corresponding to the printed matter stored in the database. On the computer,
Accumulation function for accumulating electronic data corresponding to printed matter in a database,
A printed matter identification function for obtaining location information of electronic data corresponding to the printed matter;
A user behavior recognition function for recognizing user behavior with respect to the printed matter;
When it is recognized that the user action is a discarding action, a printed matter state control function for determining a discarding process of electronic data corresponding to the printed matter;
A program for executing a data management function for deleting electronic data corresponding to the printed matter stored in the database according to the determination by the printed matter state control function.

Images