JP6649005B2 - Robot imaging system and image management method - Google Patents

Description

  The present invention relates to a robot imaging system and an image management method, and more particularly to a robot imaging system and an image management method including a robot and a server that manages an image captured by an imaging unit of the robot.

  2. Description of the Related Art Conventionally, there has been known a robot system which works on behalf of a person, or has a conversation and an action like a person. For example, Patent Literature 1 discloses a robot system capable of communicating using a communication function between a user holding a portable terminal and a robot.

JP 2013-169611 A

  The robot system described above, for example, from a portable terminal that has recorded gymnastics plan information indicating a gymnastics plan performed by the user, a robot receiving unit that receives gymnastics plan information, and performs gymnastics driving based on the received gymnastics plan information A control unit that controls to perform exercise, a robot recording unit that records gymnastics driving information indicating the result of gymnastics driving, and a robot transmission unit that transmits gymnastics driving information to a mobile terminal, so that the user can work together with the robot. The result of the gymnastic exercise can be fed back to the portable terminal, and the user holding the portable terminal can be encouraged to form and continue the exercise routine.

  However, such a robot system can provide the user with a robot drive that is individually tailored based on the detected movement and expression of the user, but the appearance of a person in a predetermined relationship with the user is not shown to the user. It did not provide clear information.

  In order to solve the above problems, a robot imaging system according to the present invention includes a robot having an imaging unit that captures a plurality of subjects existing in a predetermined area, the robot being connected to the robot via a network, and being imaged by the imaging unit. A server that manages captured images. The server includes an image receiving unit that receives the captured image, a captured image received by the image receiving unit, a master image including a specific subject among a plurality of subjects, and identification information of a specific subject associated with the master image. A storage unit for storing user information of a user having a predetermined relationship with a specific subject, and comparing a captured image and a master image stored in the storage unit to extract a captured image including the specific subject The identification unit that identifies the extracted captured image as being associated with the identification information and the user information, and stores the identification information, the user information, and the extracted captured image identified by the identification unit in the storage unit in association with each other. An information updating unit and a user terminal connected to a server via a network, wherein the information updating unit and a specific subject included in a captured image have a predetermined relationship. The user terminal of the user having, in which and a viewing management unit that allows viewing the captured image identification information and the user information is associated.

  In addition, the imaging unit generates a second captured image by performing temperature measurement imaging of the subject in addition to capturing a plurality of subjects, and the server receives the second captured image by the image receiving unit. The information may be received and stored in the storage unit.

  The photographing unit is for photographing a plurality of second photographed images as a moving image, and the specifying unit is further configured to perform health based on movement information of a subject included in the moving image and temperature measurement information included in the moving image. The robot may be one that specifies a specific subject to be checked, and the robot performs an output indicating the specific subject to be checked for the specified health.

  The storage unit records a master image including a specific subject different from the specific subject in addition to the master image including the specific subject. The image may be compared with a master image including another specific subject.

  Further, the robot includes a storage unit for storing a plurality of application software prepared for performing the robot's exercise action prepared in advance, and a control unit for controlling each part of the robot based on the application software. The server includes an image analysis unit that analyzes the user's taste based on the identified captured image and extracts the taste information, and the control unit determines a part of the robot based on the taste information. It may be controlled.

  Further, the robot includes a dialogue unit having a dialogue function, and the control unit selects the most appropriate application software from the application software stored in the storage unit based on the preference information, and selects the selected application software. The application software may be used to control any of the shooting timing of the shooting unit, the content of the dialogue by the dialogue unit, and the part of the robot.

  The browsing management unit enables the user to manage the predetermined area to view the captured image with respect to a user management terminal of the user. May be provided with a browsing setting unit that can set prohibition information that prohibits browsing in the browsing management unit.

  Further, the image analysis unit analyzes the photographed image which is not allowed to be browsed based on the prohibition information, and analyzes whether or not the new photographed image is unbrowsable. Alternatively, when the analyzed captured image cannot be browsed, the browsing setting may be such that new prohibition information can be set in the browsing management unit.

  In addition, the robot imaging system includes a new robot attached to the user terminal, and the browsing management unit determines whether the captured image being browsed by the user terminal includes another subject different from the subject. The identification information of another subject can be browsed together with the captured image, and the control unit of the new robot may control the part of the new robot based on the identification information of the other subject. .

  Further, in a robot photographing system including a robot having a photographing unit for photographing a plurality of subjects existing in a predetermined area, and a server connected to the robot via a network and managing a photographed image photographed by the photographing unit. An image management method, comprising: an image receiving step of receiving a captured image, a received captured image, a master image including a specific subject among a plurality of subjects, and identification information of a specific subject associated with the master image. A storage step of storing user information of a user having a predetermined relationship with a specific subject, and comparing the stored captured image and master image to extract a captured image including the specific subject, A specifying step of specifying the extracted captured image as identification information and user information to be associated with each other; An information updating step in which the identification information specified in the specifying step, the user information, and the extracted captured image are stored in association with each other; and a user terminal connected to the server via a network, wherein the specific subject included in the captured image is included. And a browsing management step of allowing a user terminal of a user having a predetermined relationship with the user terminal to browse a captured image associated with the identification information and the user information.

  ADVANTAGE OF THE INVENTION According to this invention, a user can know the state of a subject through a captured image by making it possible to browse the captured image containing a specific subject with respect to the user terminal of the user who has a predetermined relationship with the subject. Can be.

FIG. 1 is a diagram schematically showing an overview of a robot imaging system according to an embodiment. FIG. 2 is a block diagram illustrating a functional configuration of the robot imaging system according to the embodiment. FIG. 5 is a diagram showing an example of a master image registration screen available from a user terminal according to the embodiment. FIG. 4 is a conceptual diagram showing a comparison between a captured image and a master image according to the embodiment. FIG. 4 is a diagram illustrating an example of a captured image and user information stored in a storage unit of the server according to the embodiment. FIG. 4 is a diagram showing an example of a screen of a user terminal according to the embodiment. It is a conceptual diagram showing an example of temperature measurement photography concerning an embodiment. FIG. 3 is a block diagram illustrating a functional configuration of a photographing unit according to the embodiment. FIGS. 9A and 9B are diagrams illustrating an example in which control by the control unit and photographing by the photographing unit are performed in parallel. FIG. 5 is a diagram showing an example of a screen of the user management terminal according to the embodiment. It is a schematic diagram which shows an example which uses the new robot which concerns on embodiment. It is a figure showing an example using a picked-up image from a user terminal concerning an embodiment. FIG. 4 is a diagram illustrating an example in which the control unit according to the embodiment causes the robot to perform an exercise action. 5 is a flowchart illustrating a process performed by the server according to the embodiment.

  An outline of an embodiment of the present invention will be described. FIG. 1 is a diagram schematically illustrating an overview of a robot imaging system 1 according to an embodiment. The robot photographing system 1 includes a robot 100 that photographs a plurality of subjects existing in a predetermined area E, and a server 200 that is connected to the robot 100 via a network NT and manages photographed images. Further, the user terminal 10, the user management terminal 20, the robot 100, the server 200, and the like are connected by communication.

  The “predetermined area” E is a site area in which a facility or the like to which a plurality of persons belong is located, and the robot 100 photographs a plurality of persons existing in the site. For example, it is a site where facilities such as a kindergarten, a lesson classroom, and a nursing home are located. An example of a kindergarten will be described below as an embodiment. Further, in the present embodiment, the description will be made assuming that “user” is a parent of a kindergarten attending kindergarten and “user administrator” is a kindergarten nursery teacher.

  The user terminal 10 is a terminal used by a user, and the user logs in to the server 200 based on user information issued in advance by a user administrator. The user information indicates, for example, a user ID. The user manager issues one user ID to the family of the kindergarten for each kindergarten who attends kindergarten. The user terminal 10 is, specifically, a PC (Personal computer) having a wired or wireless communication function, a smartphone, a tablet, a phablet, or the like, and is a terminal that can display an image. The user terminal 10 is connected to the server 200 via the network NT, and can use the services of the server 200 with the authority within the range set for the user by the user administrator.

  The user management terminal 20 is a terminal used by the user manager, and the user manager manages data and settings on the server 200 regarding the kindergarten to which the user manager belongs. The user management terminal 20 is, specifically, a PC, a smartphone, a tablet, a phablet, or the like having a wired or wireless communication function. In addition, the user administrator may make settings related to the operation of the robot 100 for the robot 100 disposed in the predetermined area E by wire or wirelessly through the user management terminal 20.

  FIG. 2 is a block diagram illustrating a functional configuration of the robot imaging system 1 according to the embodiment. The robot 100 includes an imaging unit 110, a storage unit 120, a control unit 130, and a dialog unit 140. It is preferable that the robot 100 can move by self-propelled or remote control in order to photograph a plurality of subjects existing in the predetermined area E. Specifically, the robot 100 may be a walkable humanoid robot or a mobile robot to which a caster or the like is attached. Further, the robot 100 has a communication function, and the photographing unit 110 of the robot transmits a photographed image to the server 200. Specifically, the robot 100 accommodates a wireless transmission module such as a Wi-Fi module or a Bluetooth (registered trademark) module (not shown).

  The photographing unit 110 photographs a plurality of subjects existing in the predetermined area E. The imaging unit 110 specifically acquires image information by converting an optical signal into an electric signal by using a charge-coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). The imaging unit 110 may have the same function as a digital camera. For example, the imaging unit 110 may have a function of tracking a human face, moving a camera, and focusing on the human face. Further, the photographing unit 110 may have a function of recognizing a human expression and photographing. The storage unit 120, the control unit 130, and the dialogue unit 140 of the robot will be described later.

  The server 200 includes an image receiving unit 210, a storage unit 220, a specifying unit 230, an information updating unit 240, a browsing management unit 250, an image analyzing unit 260, and a browsing setting unit 270. The server 200 is specifically a computer provided on the network NT, and manages a captured image captured by the robot 100. The server 200 also provides the user terminal 10 and the user management terminal 20 connected to the server 200 via the network NT with functions, services, data, and the like of the server 200.

  The image receiving unit 210 receives a captured image captured by the robot 100. The image receiving unit 210 is specifically configured by a network module or the like.

  The storage unit 220 includes a captured image received by the image receiving unit 210, a master image including a specific subject among a plurality of subjects, identification information of the specific subject associated with the master image, and a specific The user information of the user having the relationship is stored. The plurality of subjects are, for example, persons existing in the predetermined area E. The “specific subject” indicates, for example, a child who is a target in which a master image is registered. The “predetermined relationship” indicates, for example, that the child has a family or close relationship with the child. Or, a person who is particularly concerned about and protects a specific subject.

  The master image and a method of registering the master image in the server 200 will be described with reference to FIG. FIG. 3 is a diagram showing an example of a master image registration screen that can be used from the user terminal 10 according to the embodiment. The “master image” is an image including a person belonging to the predetermined area E registered by the user in advance. The image including a person may be, for example, an image obtained by capturing a photograph that has already been taken by a scanner, or may be an image that has been taken by the user terminal 10. This is used by an identification unit 230 to be described later to perform an image search. The user logs in to the server 200 using the user information registered in advance by the user administrator in the server 200 and notifying the user. On the right side of the screen shown in FIG. 3, the user ID used for the current login and the kindergarten name, nickname, affiliation class, etc. of the kindergarten corresponding to the user ID are displayed. On the left side of the screen, an image captured as a master image of the child is displayed. The user may click the browse button and specify another image file as the image. Further, the user may select a part of the image on the display screen to extract the selected part and use it as a master image. Thus, even when the designated image includes many parts other than the face, erroneous recognition of a person by the identification unit 230 described later can be suppressed. When the user finally presses the registration button, the user terminal 10 transmits the selected image or a part of the image to the server 200 as a master image corresponding to the user ID. The storage unit 220 includes a user information list 221, and stores the identification information of the child, the user information, the master image, and the like in association with each child. "Kindergarten identification information" is, for example, a kindergarten name.

  The identification unit 230 compares the captured image and the master image stored in the storage unit 220 and extracts a captured image including a specific subject, thereby extracting the extracted captured image, identification information, and user information. Identify as relevant. The image extraction is realized, for example, by the CPU of the server 200 executing a search engine.

  The processing performed by the specifying unit 230 and the information updating unit 240 will be described with reference to FIGS. FIG. 4 is a conceptual diagram showing a comparison between a captured image and a master image according to the embodiment. The identification unit 230 compares the stored captured images (IMG1, IMG2, IMG3,...) With the master images (M1, M2, M3,...) To extract a captured image including a specific subject. I do. Specifically, for example, when detecting a portion similar to the master image M3 in the captured image IMG6, the specifying unit 230 measures the similarity between the similar portion and the master image M3, and based on the measurement result, determines the master image M3. It is determined whether or not the specific person A3 corresponding to the image M3 is included in the captured image IMG6. When determining that the specific person A3 is included in the captured image IMG6, the identification unit 230 extracts the captured image IMG6.

  FIG. 5 is a diagram illustrating an example of a captured image and user information stored in the storage unit 220 of the server 200 according to the embodiment. The specifying unit 230 refers to the user information list 221 of the storage unit 220 for the extracted captured image IMG6, and specifies the identification information A3 and the user information U3 related to the master image M3 used at the time of extraction.

  The information updating unit 240 stores the identification information specified by the specifying unit 230, the user information, and the extracted captured image in the storage unit 220 in association with each other. For example, the image specifying list 222 in FIG. 5 stores each captured image in association with identification information and user information specified for the captured image. In the example shown in FIG. 5, the identification information is a child name or a nickname, and the user information indicates a user ID.

  The browsing management unit 250 enables browsing of a captured image in which identification information and user information are associated with a user terminal 10 of a user having a predetermined relationship with a specific subject included in the captured image.

  FIG. 6 is a diagram illustrating an example of a screen of the user terminal 10 according to the embodiment. FIG. 6 is a screen in which a user logs in to the server 200 from the user terminal 10 using, for example, a user ID and browses a captured image in which a child is included as a subject. Further, the server 200 may have an invitation function. An upper limit may be set on the number of captured images that can be viewed by the user. For example, in FIG. 6, the server 200 selects and can view 10 captured images per day for one user ID. Further, as shown in FIG. 6, the user can input, via the user terminal 10, favorite information indicating that the user has liked the captured image, and comment information such as a description of the captured image and a diary. When receiving the information from the user terminal 10, the storage unit 220 of the server 200 stores the information in the image specification list 222 in association with the captured image. Further, the user may select and purchase or download a desired captured image.

  Thus, for example, the parent who is the user can know the recent state of the child while in the kindergarten. Also, the user can access and browse the server 200 at a convenient time. Furthermore, if the user has a conversation with the child based on the information obtained by browsing, it is possible to communicate with conversation contents based on more everyday life. In addition, even if the family is not at home due to a single transfer or a business trip, the user can log in to the server 200 via the user terminal 10 possessed by using the user information to know the recent state of the child while away. be able to. In addition, if the invitation function is used, the user can, for example, permit browsing to a distant grandparent and inform the state of his grandchild. Family members living apart can be more intimate.

  The photographing unit 110 generates a second photographed image by performing temperature measurement photographing of the object in addition to photographing a plurality of objects, and the server 200 transmits the second photographed image to the image receiving unit 210. May be received and stored in the storage unit 220.

  FIG. 7 is a conceptual diagram illustrating an example of temperature measurement imaging according to the embodiment. Specifically, the imaging unit 110 includes a thermography camera 110b including a sensor for measuring temperature, in addition to the camera 110a for acquiring image information by converting the above-described optical signal into an electric signal. In this specification, the “second photographed image” refers to an image obtained by performing temperature measurement photographing of a subject.

  FIG. 8 is a block diagram illustrating a functional configuration of the imaging unit 110 according to the embodiment. FIG. 8 illustrates an example in which the second captured image is a composite image obtained by combining the captured image and the thermographic image. A process for generating the second captured image will be described with reference to FIG. The photographing unit 110 executes a face detection engine that detects a human face in the photographed image separately from transmitting the photographed image photographed by the camera 110a to the server 200, and for example, detects a position on the detected image. Extract the position information shown. On the other hand, the thermographic camera 110b generates a thermographic image by performing a temperature calculation based on the output of the sensor. The imaging unit 110 analyzes the temperature distribution of the generated thermographic image based on the position information extracted from the captured image, and measures the temperature of the position on the thermographic image corresponding to the human face. In addition, the imaging unit 110 generates a second captured image when the measured temperature exceeds a predetermined value.

  FIG. 7 illustrates an example of the second captured image generated by the above-described processing. The conceptual diagram of the composite image displayed on the display of the user management terminal 20 is shown on the left side of FIG. The composite image may be, for example, an image created by translucently overlapping a captured image and a temperature measurement image as shown in FIG. For example, the captured image is displayed with a transparency of 70% and light, and the second image is displayed with a transparency of 30% and dark. By superimposing the two images translucently in this way, the nursery teacher can identify the child's face and further know the temperature of the child. Further, by the processing of the face detection engine, even when the captured image includes a subject other than a human face and the temperature of which exceeds a predetermined value, the possibility that the imaging unit 110 erroneously reports is suppressed.

  The user management terminal 20 may also present the result of the temperature measurement by the imaging unit 110 and the identification information of the subject stored in association with the above-described captured image to the user administrator. This can be used for the health management of individual children. Furthermore, if the storage unit 220 stores the result of the temperature measurement performed by the imaging unit 110 on a regular basis, it is possible to manage normal heat and changes in body temperature for each child. Further, since the photographing unit 110 can measure the temperature of a plurality of persons in one photographing, it is possible to efficiently obtain the temperature information of a plurality of subjects in the predetermined area E.

  Note that the face detection engine may be included in the server 200 instead of the robot 100. In this case, the specifying unit 230 may execute the face detection engine and transmit the extracted position information to the robot 100. In addition, the specifying unit 230 may transmit identification information of the specified subject to the robot 100 in addition to the extracted position information.

  The imaging unit 110 captures a plurality of second captured images as a moving image, and the specifying unit 230 further performs health based on movement information of a subject included in the moving image and temperature measurement information included in the moving image. The robot 100 may specify a specific subject to be checked, and the robot 100 may perform an output indicating the specified specific subject to check the health. Specifically, a thermographic camera or the like of the photographing unit 110 photographs a plurality of subjects as moving images. The identification unit 230 detects a high temperature child based on the second captured image, and analyzes the activity of the child before and after the image capturing based on the moving image. For example, it may be determined that there is no particular need to check the health of a subject having a high temperature but exercising vigorously immediately before. In addition, a subject having a high temperature and a slow movement may be determined as a target whose health should be confirmed. The robot 100 also receives this result and outputs an output indicating a subject whose health should be confirmed. The pointing output means, for example, an output by a voice of a robot or a sound of an alarm, or an output by a movement such as pointing. For the subject whose health is to be confirmed, the identification unit 230 identifies the identification information of the subject based on a normal photographed image, so that the name of the child can be provided together with the analysis result. Further, as shown in FIG. 7, the user management terminal 20 may display an image or a video including a subject whose health should be checked on a display screen to urge the nursery teacher or the like to check.

  From this, since the identification unit 230 can narrow down the persons whose health should be confirmed based on the movement information and the temperature measurement information, the nursery teacher can further confirm the health of the identified kindergarten. Can be performed.

  The storage unit 220 records, in addition to the master image including the specific subject, a master image including another specific subject different from the specific subject, and the specifying unit 230 is stored in the storage unit 220. The captured image may be compared with a master image including another specific subject.

  Returning to FIG. 5, description will be given using the image specifying list 222. For example, the storage unit 220 stores master images of objects such as balls and toys, in addition to master images of a plurality of children belonging to kindergarten. The identification unit 230 performs the same processing on the master image of the playground equipment as the master image of the specific subject, and the information updating unit 240 associates the extracted captured image with the identification information of the identified object. To remember. For example, the image specifying list 222 in FIG. 5 indicates that the photographed image IMG6 includes a ball as a subject in addition to the children A3 and A5.

  Thus, since the specifying unit 230 can specify information other than the kindergarten among the subjects included in the captured image, the server 200 can use the information for further services.

  The robot 100 includes a storage unit 120 that stores a plurality of application software for performing a motion of the robot 100 prepared in advance, and a control unit 130 that controls each part of the robot based on the application software. The server 200 includes an image analysis unit 260 that analyzes the user's taste based on the specified captured image and extracts the taste information, and the control unit 130 performs processing based on the taste information. The parts of the robot may be controlled.

  FIGS. 9A and 9B are diagrams illustrating an example in which the control by the control unit 130 and the imaging by the imaging unit 110 are performed in parallel. The control unit 130 controls the driving of the robot 100, and is configured by, for example, a CPU. For example, when the user selects a button such as “like” or “purchase” shown in FIG. 6 through the user terminal 10, the user's taste is stored in the server 200. The image analyzing unit 260 extracts a photographing method or the like for photographing a photographed image that the user likes by analyzing the above-described user operation and the related photographed image. The control unit 130 controls the movement of the robot 100 and the shooting of the shooting unit 110 based on the extracted shooting method. For example, when the user frequently selects “like” for the front image of the child, the robot 100 shakes his hand to draw the child's attention as shown in FIG. Obtain a captured image facing the front. Thus, since the imaging unit 110 indirectly reflects the user's preference, the possibility of providing a captured image that the user likes can be increased.

  The robot includes a dialogue unit 140 having a dialogue function. The control unit 130 selects an optimal application software from the application software stored in the storage unit 120 based on the preference information. Using the application software thus set, any one of the shooting timing by the shooting unit 110, the content of the dialogue by the dialogue unit 140, and the part of the robot 100 may be controlled. Specifically, the dialogue unit 140 includes a microphone and a speaker that perform voice input and output.

  FIG. 9A illustrates an example in which the robot 100 interacts with a child. For example, when the user frequently selects “like” for the captured image that the child is talking to, the control unit 130 sets the timing at which the robot 100 speaks to the child and the child answers accordingly. The photographing unit 110 is controlled to perform photographing.

  Thus, since the control unit 130 controls the movement, conversation, and shooting timing of the robot 100, it is possible to guide the attitude of the child reflecting the user's taste, and to increase the possibility of providing a shot image that the user likes. Can be.

  The browsing management unit 250 allows the user to manage the predetermined area E to view the captured image with respect to the user management terminal 20. The server 200 transmits the captured image to the user management terminal 20 via the user management terminal 20. Alternatively, a browsing setting unit 270 may be provided to allow the browsing management unit 250 to set prohibition information that the user terminal 10 cannot view.

  FIG. 10 is a diagram illustrating an example of a screen of the user management terminal 20 according to the embodiment. For example, in FIG. 10, a nursery teacher in a kindergarten logs in to the server 200 as a user administrator and performs censorship of a photographed image presented to a user. FIG. 10 shows a picture of two children quarreling and crying. The nursery teacher can exclude an inappropriate photographed image from the browsing target of the photographed image that is photographed on the day and is to be browsed by the user in the future. Specifically, the prohibition information is registered in the server 200 when the nursery teacher selects the photographed image via the user management terminal 20 and selects the “viewing prohibition” button for the displayed image. For example, prohibition information (not shown) is stored in the image specification list 222 in association with the captured image.

  Thus, the robot photographing system 1 of the present invention is different from a system that provides a monitor image in real time, to a limited user through steps for protecting the privacy and security of a person in the predetermined area E. Can provide family information.

  Based on the screen of FIG. 10, the server 200 provides a service for communicating with the family of the kindergarten to the user manager in addition to the above-described browsing setting. For example, the user manager can send a message to the user by using the “letter note” button from the user management terminal 20. Alternatively, a captured image may be selected and attached.

  The image analysis unit 260 analyzes the photographed image which is not allowed to be browsed based on the prohibition information, and analyzes whether or not the new photographed image is unbrowsable. If the analyzed captured image is not viewable, the view setting may be such that new prohibition information can be set in the view management unit 250. Specifically, the image analysis unit 260 has a learning function, acquires an image configuration or the like in which the prohibition information tends to be added based on the result determined by the user manager, and performs similarity in captured images captured in the next and subsequent times. If any of the above configurations are available, it is automatically disabled from being viewed. This allows the system to use the determination made by the user administrator for the next and subsequent browsing settings, so that the burden on the child censor who performs the censorship is gradually reduced.

  The robot photographing system 1 includes a new robot 400 attached to the user terminal 10. The browsing management unit 250 includes a photographed image browsed by the user terminal 10 that includes another subject different from the subject. In this case, the identification information of the other object can be browsed together with the captured image, and the control unit 410 of the new robot 400 determines the part of the new robot 400 based on the identification information of the other object. May be controlled.

  FIG. 11 is a schematic diagram illustrating an example of using a new robot 400 according to the embodiment. The new robot 400 may have the same function as the robot 100. The new robot 400 is connected to the user terminal 10 by wire or wirelessly. The new robot 400 may include a control unit 410, and the control unit 410 may select an appropriate application software from the held application software to move each part of the new robot 400 or provide a conversation content. In the example illustrated in FIG. 11, the new robot 400 acquires the name of a friend included in the captured image being browsed by the user, and talks to the user and the child based on the acquired information.

  Thus, the new robot 400 supports the conversation of the family, and the family can have a conversation based on the child's life in the kindergarten. In addition, since information about another subject is provided, the family can share information such as friends of the kindergarten and favorite playground equipment.

  FIG. 12 is a diagram illustrating an example of using a captured image from the user terminal 10 according to the embodiment. The example illustrated in FIG. 12 is a screen on which the user designates a period, and the user extracts and displays a captured image with favorite information in the past. Further, the user can select several images from the extracted captured images and collectively download them to the user terminal 10. In addition, an order can be placed to create the selected photographed image as a photo album.

  FIG. 13 is a diagram illustrating an example in which the control unit according to the embodiment causes the robot to perform an exercise action or a conversation. The control unit 130 controls each part of the robot 100 based on the application software stored in the storage unit 120, so that the robot 100 may execute a part of the work of the nursery teacher. Some of the tasks of the nursery teacher are, for example, dance and story-telling, and the robot 100 may take images in parallel. Thus, it is possible to obtain a picture of the child with a rich expression.

  Hereinafter, a usage example of the present embodiment will be described with reference to FIG. FIG. 14 is a flowchart illustrating a process performed by the server 200 according to the embodiment, with respect to the robot imaging system 1 and the image management method of the present invention. In FIG. 14, it is assumed that registration of user information by the user administrator and registration of the master image by the user have been completed. That is, the storage unit 220 stores the master image including the specific subject among the plurality of subjects, the identification information of the specific subject associated with the master image, and the user information of the user having a predetermined relationship with the specific subject. I remember.

  The photographing unit 110 of the robot 100 detects human faces for a plurality of subjects existing within a predetermined area (S101), photographs an image (S102), and transmits the photographed image to the server 200 via the network NT (S102). S103). The image receiving unit 210 of the server 200 receives an image captured by the robot 100 (S201). The storage unit 220 stores the received captured image in the storage unit 220 (S202). The specifying unit 230 compares the captured image and the master image stored in the storage unit 220 (S203), determines whether a specific subject is included in the captured image (S204), and, if so, determines the captured image. Is extracted (S205). The specifying unit 230 also specifies the captured image, the identification information, and the user information as being associated with each other by referring to the user information list 221 stored in the storage unit 220 based on the master image used at the time of extraction (S206). . The information updating unit 240 stores the identified identification information, user information, and the extracted captured image in the storage unit 220 in association with each other (S207). The browsing management unit 250 allows the user terminal 10 of a user having a predetermined relationship with a specific subject included in the captured image to browse the captured image in which the identification information and the user information are associated (S208).

  As described above, according to the embodiment, the user can browse the image of the family on a daily basis and can know the state of the family while they are away from each other. Conversations can be more everyday based. In addition, since the user can share recent information with a family living away, a more intimate relationship can be maintained. Further, a user administrator such as a nursery teacher can reduce the burden of creating an album, taking a photo at the time of an event, selecting photos, and performing accounting.

  The present invention has been described based on the embodiments. In the above embodiment, a kindergarten is taken as an example of the predetermined area E, but the present invention can be applied to facilities such as a learning classroom and a nursing home. For example, when used in an English conversation classroom or gymnastics classroom, a moving image is shot by the shooting unit 110a, the storage unit 210 extracts and stores a still image from the shot moving image as a shot image, and further stores the moving image for a predetermined time. The browsing management unit 250 may store the moving image for a predetermined period of time associated with the captured image that can be browsed, so as to be able to browse. Accordingly, the user can obtain information including the voice of the child's English conversation and the movement of gymnastics, and thus can know the progress of learning.

  The present invention has been described based on the embodiments. This embodiment is an exemplification, and it is understood by those skilled in the art that various modifications can be made to the combination of each component and each processing process, and that such modifications are also within the scope of the present invention. is there.

  In addition to the above-described embodiment, the robot imaging system 1 of the present invention may include the following. For example, the storage unit 220 includes time information as information accompanying the captured image. Thus, for example, for a birthday registered in advance, an image one year ago can be presented to the user together with the captured image of the day, and the change can be confirmed. In addition, together with the identification of the child by the identification unit 230 described above, allergy information or the like of the child may be registered and used for food education. Further, the robot 100 may receive and output the distributed emergency news and the like. Thus, it is possible to help secure a plurality of persons existing in the predetermined area E. Further, the user management terminal 20 may be provided with various communication functions so that communication between the facility side and the guardian side can be performed smoothly and centrally. The contact function indicates, for example, transmission / reception of an attendance report, report, emergency contact mail, and the like.

  1 Robot imaging system, 10 user terminals, 20 user management terminals, 100 robots, 110 imaging units, 120 storage units, 130 control units, 140 interactive units, 200 servers, 210 image reception units, 220 storage units, 230 identification units, 240 Information update unit, 250 viewing management unit, 260 image analysis unit, 270 viewing setting unit, 400 new robot, 410 control unit.

Claims (6)

A robot having a photographing unit for photographing a plurality of subjects existing in a predetermined area,
A server that is connected to the robot via a network and manages a captured image captured by the capturing unit;
A robot imaging system including
The server is
An image receiving unit that receives the captured image,
A captured image received by the image receiving unit, a master image including a specific subject among the plurality of subjects, and identification information of the specific subject associated with the master image and a predetermined relationship with the specific subject A storage unit for storing user information of a user having
By comparing the captured image and the master image stored in the storage unit and extracting a captured image including the specific subject, the extracted captured image is associated with the identification information and the user information. A specific part to identify as
An information updating unit that stores the identification information identified by the identifying unit, the user information, and the extracted captured image in the storage unit in association with each other;
A user terminal connected to the server via a network, wherein the identification information and the user information are associated with a user terminal of a user having a predetermined relationship with a specific subject included in the captured image. A browsing management unit that allows browsing of the photographed image,
The photographing unit, in addition to photographing a plurality of subjects, is to generate a second photographed image by performing temperature measurement photographing of the subject ,
The browsing management unit, the user management terminal of the user who manages the predetermined area, is to enable browsing the captured image,
The server, the image receiving unit receives the second captured image, the storage unit stores,
The robot photographing system , further comprising: a browsing setting unit configured to set, in the browsing management unit, prohibition information that the user terminal cannot view in the captured image via the user management terminal. . The photographing unit is for photographing the plurality of second photographed images as a moving image,
The specifying unit, further, based on the motion information of the subject included in the video, the temperature measurement information included in the video, to specify a specific subject to check the health,
The robot imaging system according to claim 1, wherein the robot performs an output indicating a specific subject whose health is to be confirmed. The storage unit, in addition to the master image including the specific subject, is to record a master image including another specific subject different from the specific subject,
3. The robot imaging system according to claim 1, wherein the identification unit compares the captured image stored in the storage unit with a master image including the another specific subject. 4. The robot photographing system includes an image analysis unit that analyzes a photographed image that is not browsed based on the prohibition information and analyzes whether a new photographed image is unbrowsable. ,
The browsing setting unit is configured to set new prohibition information in the browsing management unit when the analyzed captured image is not browsable. The robot imaging system according to any one of claims 1 to 3 . The robot imaging system,
A new robot attached to the user terminal,
The browsing management unit, when the captured image being viewed by the user terminal includes another subject different from the subject, enables browsing of the identification information of the other subject along with the captured image. So,
The robot imaging system according to claim 4 , wherein the control unit of the new robot controls a part of the new robot based on identification information of the another subject. A robot having a photographing unit for photographing a plurality of subjects existing in a predetermined area,
A server that is connected to the robot via a network and manages a photographed image photographed by the photographing unit; and
An image receiving step of receiving the photographed image,
The received captured image, a master image including a specific subject among the plurality of subjects, and identification information of the specific subject associated with the master image and a user having a predetermined relationship with the specific subject. A storage step in which the storage unit stores the user information;
By comparing the stored captured image and the master image and extracting a captured image including the specific subject, the extracted captured image is identified as being associated with the identification information and the user information. Specific steps to perform,
An information updating step of storing the identification information specified in the specifying step, the user information and the extracted captured image in association with each other,
A user terminal connected to the server via a network, wherein the identification information and the user information are associated with a user terminal of a user having a predetermined relationship with a specific subject included in the captured image. Performing a browsing management step of enabling the photographed image to be browsed ,
The browsing management step, for a user management terminal of a user who manages the predetermined area, allows the captured image to be browsed,
The imaging unit performs a step of generating a second captured image by performing temperature measurement imaging of the subject, in addition to imaging a plurality of subjects ,
The server receives the second captured image in the image receiving step, executes the step of storing the storage unit ,
The server executes, via the user management terminal, a browsing setting step of setting, in the browsing management step, prohibition information that the user terminal cannot view from among the captured images. Method.

Images