JP6792224B1 - Information processing system, information processing device, server device, program, or method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To increase opportunities for communication more appropriately by a system according to an embodiment of the present invention. An image pickup relating to a first transmission unit capable of transmitting a program that can be executed on a WEB browser of the first terminal device to a first terminal device according to the first user and the first terminal device. Using the image captured by the device, it is possible to acquire information including user attribute information related to the first terminal device generated by the machine-learned function in the program executed on the WEB browser. A system including an acquisition unit and a second transmission unit capable of transmitting information based on the user attribute information to a second terminal device different from the first terminal device, wherein the user attribute information is A system that includes information indicating the presence or absence of the first user in the image. [Selection diagram] Fig. 2

Description

The techniques disclosed in this application relate to information processing systems, information processing devices, server devices, programs, or methods.

In recent years, due to the liberalization of working styles and social circumstances, the number of people who work from home or in shared offices is increasing in addition to the traditional working styles of the company.

Icy Soft "Telework Dedicated Attendance Management" (https://www.ttc.cloud/telework) Cloco "Cloud Call Center System" (http://www.clocoinc.com/inbound) Sonic Garden "Virtual Office Remotty" (https://ja.remotty.net/?referrer=https%3A%2F%2Fwww.remotty.net%2F) Iguazu "Sococo" (http://www.iguazu-sococo.jp/) Canon IT Solutions "Telework Supporter" (https://www.canon-its.co.jp/products/telework/?1)

In this way, although there are various merits that individuals can freely promote their work, the opportunities for face-to-face communication are reduced as in the past because the places where individuals promote their work are diverse. It becomes. Therefore, there is a need for technology that improves communication opportunities while enabling privacy protection to some extent. Therefore, various embodiments of the present invention provide an information processing system, an information processing device, a server device, a program, or a method in order to solve the above problems.

The system according to the first embodiment of the present application is
A first transmission unit capable of transmitting a program that can be executed on the WEB browser of the first terminal device to the first terminal device related to the first user, and
User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the imaging device related to the first terminal device. With the acquisition unit that can acquire information including
A second transmission unit capable of transmitting information based on the user attribute information to a second terminal device different from the first terminal device, and
It is a system equipped with
The user attribute information includes information indicating the presence or absence of the first user in the image.
system.

The system according to the second embodiment of the present application is the system according to the first embodiment.
The machine-learned function in the program is machine-learned about the relationship between the image and the user attribute information, and can generate the corresponding user attribute information for the image.
The user attribute information does not include the image related to the first terminal device.
system.

The system according to the third embodiment of the present application is the system according to the first or second embodiment.
The program does not access the imaging device according to the first terminal device on which the program is executed for the first predetermined period after receiving the predetermined input to acquire the image.
system.

The system according to the fourth embodiment of the present application is the system according to any one of the first to third embodiments.
The program is an access for acquiring the image to the image pickup device related to the first terminal device in which the program is executed after the elapse of the first predetermined period after receiving the predetermined input. Do regularly,
system.

The system according to the fifth embodiment of the present application is the system according to any one of the first to fourth embodiments.
The information based on the user attribute information includes a time when the first user related to the user attribute information is continuously determined not to be included in the image.
system.

The system according to the sixth embodiment of the present application is the system according to any one of the first to fifth embodiments.
The information based on the user attribute information includes information indicating the situation of the first user.
system.

The system according to the seventh embodiment of the present application is the system according to any one of the first to sixth embodiments.
The information indicating the situation of the first user is information indicating a situation in which the first user is concentrated, information indicating that the first user is in a meeting, and / or the first use. Including the location information of the person
system.

The program according to the eighth embodiment of the present application is
System,
A first transmission means capable of transmitting a program that can be executed on the WEB browser of the first terminal device to the first terminal device according to the first user.
User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the imaging device related to the first terminal device. An acquisition method that can acquire information including
A second transmission means capable of transmitting information based on the user attribute information to a second terminal device different from the first terminal device,
It is a program to operate as
The user attribute information includes information indicating the presence or absence of the first user in the image.
program.

The program according to the ninth embodiment of the present application is the program according to the eighth embodiment.
A program executed by an arithmetic unit in the system.

The method according to the tenth embodiment of the present application is
the system,
A first transmission step of transmitting a program that can be executed on the WEB browser of the first terminal device to the first terminal device related to the first user.
User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the image pickup device related to the first terminal device. Get information, including information, get steps,
A second transmission step of transmitting information based on the user attribute information to a second terminal device different from the first terminal device.
Is a way to do
The user attribute information includes information indicating the presence or absence of the first user in the image.
Method.

The method according to the eleventh embodiment of the present application is the method according to the tenth embodiment.
A method performed by an arithmetic unit in the system.

The apparatus according to the twelfth embodiment of the present application is
The first acquisition unit, which can acquire a program that can be executed on the WEB browser of the first terminal device,
User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the imaging device related to the first terminal device. Transmitter, which can transmit information including
An acquisition unit that can acquire information based on user attribute information related to a second terminal device different from the first terminal device.
It is a first terminal device provided with
The user attribute information includes information indicating the presence or absence of the first user in the image.
First terminal device.

The apparatus according to the thirteenth embodiment of the present application is the apparatus according to the twelfth embodiment.
A first terminal device executed by an arithmetic unit in the first terminal device.

The program according to the 14th embodiment of the present application is
The first terminal device,
An acquisition means for acquiring an image captured by the imaging device according to the first terminal device,
A transmission means for transmitting information including user attribute information related to the first terminal device, which is generated by applying a machine learning function to the image, to the management device.
An acquisition means for acquiring information based on user attribute information related to a second terminal device different from the first terminal device.
A program that can be executed on the WEB browser of the first terminal device and has the machine-learned function.
The user attribute information includes information indicating the presence or absence of the first user in the image.
program.

The program according to the fifteenth embodiment of the present application is the program according to the fourteenth embodiment.
A program executed by an arithmetic unit in the first terminal device.

The method according to the 16th embodiment of the present application is
The first terminal device that has machine-learned functions and can be executed on a WEB browser
Acquisition step of acquiring an image captured by the imaging device according to the first terminal device,
A transmission step of transmitting information including user attribute information related to the first terminal device, which is generated by applying a machine learning function to the image, to the management device.
An acquisition step of acquiring information based on user attribute information related to a second terminal device different from the first terminal device.
Is a way to do
The user attribute information includes information indicating the presence or absence of the first user in the image.
Method.

The method according to the 17th embodiment of the present application is the method according to the 16th embodiment.
A method executed by an arithmetic unit in the first terminal device.

According to one embodiment of the present invention, opportunities for communication can be increased more appropriately.

FIG. 1 is a block diagram showing an overall configuration of one system according to one embodiment. FIG. 2 is a block diagram showing a function of one system according to one embodiment. FIG. 3 is an example of data included in one system according to one embodiment. FIG. 4 is an example of data included in one system according to one embodiment. FIG. 5 is an example of a screen displayed by one system according to one embodiment. FIG. 6 is an example of a screen displayed by one system according to one embodiment. FIG. 7 is an example of data possessed by one system according to one embodiment. FIG. 8 is an example showing the relationship of data possessed by one system according to one embodiment. FIG. 9 is an example of a screen displayed by one system according to one embodiment. FIG. 10 is an example of the configuration of one system according to one embodiment. FIG. 11 is an example of a flow related to one system according to one embodiment. FIG. 12 is an example of a flow related to one system according to one embodiment. FIG. 13 is an example of a flow related to one system according to one embodiment. FIG. 14 is an example of a flow related to one system according to one embodiment. FIG. 15 is an example of a screen related to one system according to one embodiment. FIG. 16 is an example of a screen related to one system according to one embodiment. FIG. 17 is an example of a screen related to one system according to one embodiment. FIG. 18 is an example of a screen related to one system according to one embodiment. FIG. 19 is an example of a screen related to one system according to one embodiment. FIG. 20 is an example of the configuration of one system according to one embodiment.

1. 1. Outline of the Invention The system of the embodiment according to the present invention communicates the situation of each user who uses the information processing device with each other and promotes the improvement of communication according to the situation under the protection of a certain degree of privacy. Related to technology. In the documents of the present application, the term "system" may consist of one or more information processing devices. For example, the system of one embodiment may be one or more terminal devices, one or more management devices, or one or more terminal devices and one or more management devices, which will be described later. It may be a device. The system of one embodiment is, for example, FIG. The user terminals 011 to 015 and the management devices 001 and 002 may be connected to each other. Here, the number of management devices may be one or a plurality. Further, the management terminals 001a and 002a may be connected to the management devices 001 and 002, respectively. The management device may be connected to one or more management terminals.

2. 2. Functions of the system according to one embodiment In the system of one example, a plurality of terminal devices that acquire an image and display information, and a plurality of terminals that acquire information obtained from a plurality of terminal devices, process information, and perform information processing. It may be equipped with a management system that transmits to the device. Hereinafter, the function on the terminal device side and the function on the management device side will be described separately. In the documents of the present application, a person who uses the terminal device is referred to as a "user", and a person who uses the management device is referred to as an "administrator".

2.1. Functions in the terminal device One embodiment according to the present invention includes an information generation unit for generating information, an information transmission unit, and an information display unit as functions in the terminal device.

One embodiment according to the present invention may be software executed in a terminal device. Further, one embodiment according to the present invention may be software executed on a WEB browser in the terminal device, or software downloaded to the terminal device and installed in the terminal device.

In the case of software executed on a WEB browser in a terminal device, there is an advantage that the burden of software development can be reduced. In other words, in the early days of information processing equipment, the information processing equipment used by each individual is uniform and the same, so the burden of developing software installed in the information processing equipment used by each individual is not great. It was. However, as in modern times, various information processing devices such as desktop PCs, laptop computers, smartphones, tablets, etc., and each information processing device are complicatedly diversified with different OSs and different versions. In addition, the types of information processing devices used by people engaged in business are diversifying due to the selection of information processing devices suitable for the intended business by individuals and companies. The burden of developing software suitable for various information processing devices is heavy. Therefore, the software executed on the above-mentioned WEB browser is software that can be executed in the WEB browser, and the difference between the individual information processing devices is absorbed by the WEB browser on which each information processing device is installed, and the WEB browser is used. It may be provided as software that supports only the type and version of. In this case, there is an advantage that the burden of creating software is much reduced as compared with creating software that can be installed in each information processing device.

On the other hand, the software of one embodiment according to the present invention may be installed in a terminal device. In this case, it is possible to create software optimized for execution in each information processing device, in which case the execution speed is increased and the memory and CPU of each information processing device are executed in the execution of the function according to the present invention. There is an advantage that the utilization rate of

The terminal device may be a mobile terminal device that can be used by users such as notebook PCs, tablet PCs, smartphones, and mobile phones in business, or may be a desktop personal computer, etc., as long as it is an information processing device. Good.

2.1.1. Information generation unit 211
The information generation unit has a function of generating information. More specifically, the information generation unit has a function of generating user attribute information from an image. Here, the term user attribute information does not include images such as still images and moving images obtained by capturing a user in real time by an imaging device related to a user terminal. As will be described later, the terminal device transmits information based on the user attribute information to the management device, but by not including the image itself related to the real-time user, the real-time privacy of the user who uses the terminal device. Has the advantage of being able to protect. In addition, as a subordinate concept of the term of user attribute information, there may be "user static attribute information" and "user dynamic attribute information", and the user attribute information generated by the information generation unit is It may be treated as user dynamic attribute information.

In the terminal device, the still image of the user's face and the moving image of the face acquired through the image pickup device are highly private information indicating the person himself / herself more directly than the name and address, and such a face. The inventors thought that the constant transmission of facial images, such as still images and moving images of the face, via a network would increase the mental burden on people. Similarly, in the case of working from home, in the terminal device, the image obtained through the image pickup device is an image in a person's residence, which is an extremely private image. The inventors thought that constant communication through the system would increase the mental burden on people as well as working hours.

Further, by not transmitting a still image or a moving image via a network, there is an advantage that the burden of transmitting the network can be reduced. In other words, with the improvement and spread of communication technology, high-speed networks are being provided even in households that are expected to work from home, but even so, it is always possible to transmit video on the network. Increase the burden on.

In particular, in recent years, due to the improvement of security awareness, there are many cases where important data is not stored in the terminal device but is stored in the management server or the cloud. In that case, it is often necessary for each terminal device to always access the data in these management servers and the cloud during business. Based on such a background of the times, it is extremely important not to increase the communication load of the network of each home in the technology for communication. However, in the present invention, the burden on the network is increased by not using the image. There is an advantage that it does not need to be increased.

As described above, in one embodiment of the present invention, the information generated from the image is generated from the image in order to transmit the information generated from the image from the terminal device to the management device without transmitting the image from the terminal device to the management device. It is configured to execute the function to be performed on the terminal device.

The function of acquiring an image possessed by the information generation unit may use an imaging device associated with the terminal device. The image pickup device associated with the terminal device may be an image pickup device provided inside the terminal device, or may be an image pickup device connected to the terminal device outside the terminal device. The image pickup device may be a WEB camera, a mobile terminal camera, or the like, as long as the image can be acquired by the image pickup function. In the documents of the present application, the image may be a still image or a moving image, and the term image is used as a term of a superordinate concept of the still image and the moving image.

The information generation unit may acquire user attribute information from the acquired image. The information generation unit may have a machine-learned function in which the relationship between the image and the user attribute information is machine-learned. The information generation unit may generate the corresponding image information for the newly captured and acquired image by using the machine-learned function.

Further, the above-mentioned machine-learned function in the information generation unit may be realized by the function of the machine-learned model. The machine-learned model may be a model capable of executing a machine-learned function in which the relationship between the image and the user attribute information is machine-learned, and the corresponding user corresponds to the newly captured image. It may be able to generate attribute information. Further, the machine-learned model may be software that can be executed by using the CPU and the memory in the information processing device.

The user attribute information may include information indicating the presence or absence of a human face in the captured image. In this case, the machine-learned function according to one embodiment has machine-learned the relationship between the image and the presence / absence of a person in the image, and information indicating the presence / absence of a person in the image for a new image. Can be generated. In this case, the machine-learned function according to the embodiment may generate information indicating that there is a human face in the image only when there is one human face in the image, or the image. When there is one or more human faces in the image, information indicating that there is a human face in the image may be generated.

The information generation unit may issue an alert for looking into the screen when a plurality of human faces are detected in the acquired image. Specifically, when the information generator in the program executed on the WEB browser in the first terminal device detects the faces of a plurality of people in the acquired image, the inside of the first terminal device. The display generation unit described later in the program executed on the WEB browser of the above may issue an alert so that the user related to the first terminal device notices the peek at the screen.

Further, the machine learning unit of the information generation unit in the program executed on the WEB browser in the first terminal device uses the directions of the lines of sight of a plurality of people's faces in the acquired captured image. When it is detected that a plurality of people are looking into the screen and a plurality of people are looking into the screen, it will be described later in the program executed on the WEB browser in the first terminal device. The display generation unit may issue an alert so that the user related to the first terminal device notices the peek at the screen. Such a machine learning unit may be, for example, machine-learned the relationship between an image and the direction of the line of sight of a person's face, and specifies the direction of the person's line of sight in the image for a new image. It may be something that can be done. Further, the machine learning unit may be one that machine-learns the relationship between the image and whether or not the direction of the line of sight of the human face is substantially the direction of the screen, and may be used for a new image. , It may be possible to specify whether or not the direction of the line of sight of a person in the image is substantially the direction of the screen. It should be noted that whether or not the direction of the screen is substantially the direction of the screen may be the direction of the image pickup device that has captured the image, or the direction of the screen in consideration of the displacement between the image pickup device that has captured the image and the screen. There may be.

The form of the alert that the user notices may be various. For example, the whole or part of the WEB browser may be expressed as "peeping detection" or "alert". There is an advantage that the user can immediately notice when the display is displayed in the entire browser. Further, even if it is a part of the browser, there is an advantage that the user can notice it when the display location is specified in advance. Further, such an alert may be an expression in a mode that cannot be understood by a third party without knowing it, and may be an expression in a mode that can be understood only by the user described in the manual of the system according to the present embodiment. In this case, only the user can notice the peeping, and there is an advantage that the user is given an opportunity to casually prevent such peeping. Further, such an alert may not only be displayed, or may emit a sound instead of the display. In this case, the sound has an advantage that the user can notice the peeping more.

Further, the information display unit may display such an alert in real time after the information generation unit detects it.

Further, when the above-mentioned alert is generated, the fact that the alert is generated may be transmitted to the management device via the information transmission unit. The management device may associate and store such alerts with the user. In this case, the management device generates statistical information about the total number of alerts generated by each user within a predetermined period, the average number within a predetermined period, and the like, transmits the statistical information to the administrator terminal, and displays the information on the administrator terminal. It may be possible. In this case, the administrator related to the administrator terminal has an advantage that the user can obtain information about how much the user is looking into and give advice on the user's working environment. ..

In addition, the user attribute information may include information indicating the presence or absence of the user's face that has been authenticated by using the information related to the user's face registered in advance in the captured image. In this case, the machine-learned function according to the embodiment has machine-learned the relationship between the image and the information indicating the human face in the image, and the face of the person in the image is obtained with respect to the new image. After generating the information indicating the above, the information generation unit determines whether the information indicating the face of the person is the face of the pre-registered user, and thus the presence or absence of the face of the pre-registered user. May be generated. Further, in place of or in addition to such a configuration, the machine-learned function according to one embodiment relates to an image and information indicating the presence or absence of a pre-registered user's face in the image. Has been machine-learned, and information indicating the presence or absence of a user's face registered in advance in the image may be generated for a new image. In this case, the machine-learned function according to the embodiment may generate information indicating that there is no user's face whenever there is no user's face in the image, or may be used in the image. Information indicating that there is no user's face may be generated only when there is no person's face and there is no other person's face. Information about the face of the user registered in advance used for authentication is stored in the cache in the terminal device in which the program executed on the WEB browser can be used, and is registered in advance in the cache in the terminal device. The face of the user and the face of the person in the captured image may be collated. In this case, since the information about the registered user's face stays in the terminal device and is not transmitted to the management device, there is an advantage that privacy is protected. Instead of the above-described aspect, the feature information that can uniquely identify the face of the user registered in advance used for authentication is transmitted from the terminal device to the management device, and the user's ID or the like is transmitted in the management device. In this case, the feature information for the human face in the captured image may be transmitted from the terminal device to the management device and collated in the management device. In this case, even if the information in the terminal device is deleted or a terminal device different from the usual one is logged in using the user's ID, there is an advantage that the same authentication can be performed.

In addition, the information generation unit may issue an alert for looking into the screen when a face different from the face of the user registered in advance is detected in the acquired image. Specifically, when the information generator in the program executed on the WEB browser in the first terminal device detects a face different from the user's face registered in advance in the acquired image, The display generation unit described later in the program executed on the WEB browser in the first terminal device may issue an alert so that the user related to the first terminal device notices the screen.

Further, the machine learning unit of the information generation unit in the program executed on the WEB browser in the first terminal device has a line of sight different from the user's face registered in advance in the acquired image. Using the direction of, it was detected whether or not the screen was looked into by a face different from the pre-registered user's face, and it was detected that the screen was looked into by a face different from the pre-registered user's face. In this case, the display generation unit described later in the program executed on the WEB browser in the first terminal device may issue an alert so that the user related to the first terminal device notices the screen. Such a machine learning unit may be, for example, machine-learning the relationship between the image and the direction of the line of sight related to the human face in addition to the determination for the above-mentioned authentication. It may be able to specify the direction of the line of sight of a person in the image. Further, the machine learning unit may be one that machine-learns the relationship between the image and whether or not the direction of the line of sight of the human face is substantially the direction of the screen, and may be used for a new image. , It may be possible to specify whether or not the direction of the line of sight of a person in the image is substantially the direction of the screen. It should be noted that whether or not the direction of the screen is substantially the direction of the screen may be the direction of the image pickup device that has captured the image, or the direction of the screen in consideration of the displacement between the image pickup device that has captured the image and the screen. There may be.

The form of the alert that the user notices may be various. For example, the whole or part of the WEB browser may be expressed as "peeping detection" or "alert". There is an advantage that the user can immediately notice when the display is displayed in the entire browser. Further, even if it is a part of the browser, there is an advantage that the user can notice it when the display location is specified in advance. Further, such an alert may be an expression in a mode that cannot be understood by a third party without knowing it, and may be an expression in a mode that can be understood only by the user described in the manual of the system according to the present embodiment. In this case, only the user can notice the peeping, and there is an advantage that the user is given an opportunity to casually prevent such peeping. Further, such an alert may not only be displayed, or may emit a sound instead of the display. In this case, the sound has an advantage that the user can notice the peeping more.

Further, the information display unit may display such an alert in real time after the information generation unit detects it.

Further, when the above-mentioned alert is generated, the fact that the alert is generated may be transmitted to the management device via the information transmission unit. The management device may associate and store such alerts with the user. In this case, the management device generates statistical information about the total number of alerts generated by each user within a predetermined period, the average number within a predetermined period, and the like, transmits the statistical information to the administrator terminal, and displays the information on the administrator terminal. It may be possible. In this case, the administrator related to the administrator terminal has an advantage that the user can obtain information about how much the user is looking into and give advice on the user's working environment. ..

Further, when the above-mentioned alert is generated, the information transmission unit transmits a face different from the face of the user registered in advance to the management device, further transmits it to the administrator terminal, and displays it on the administrator terminal. It may be possible. In addition, on the user terminal, only statistical information such as the total number of predetermined periods, the average value of the predetermined period, etc., in which a face different from the face of the pre-registered user is detected on the screen, or in advance A face different from the face of the registered user may be transmitted to the administrator terminal so that the face can be displayed on the administrator terminal.

In addition, the user attribute information may include the duration during which the human face is continuously in the image. The duration is continued from the time when the information generation unit generates the information that there is a human face in the image after the information that there is no human face in the image as the start point. It may be generated using the information of the elapsed time when the information that there is a face of is generated.

In addition, the user attribute information may include information indicating the degree of fatigue of the person in the image. In this case, the machine-learned function according to one embodiment has machine-learned the relationship between the image and the information indicating the degree of fatigue of the person in the image, and for a new image, the person in the image It may be possible to generate information indicating the degree of fatigue.

In addition, the user attribute information may include information indicating the degree of concentration of people in the image. In this case, the machine-learned function according to one embodiment has machine-learned the relationship between the image and the information indicating the degree of concentration of the person in the image, and for a new image, the person in the image It may be possible to generate information indicating the degree of concentration. Information indicating the degree of concentration may be specified using, for example, information such as eye movement, blink frequency, heart rate, respiration, and sigh frequency. Further, the machine-learned function according to the embodiment may generate information indicating the degree of concentration of the above-mentioned person based on the image and sound. In this case, the machine-learned function according to one embodiment has machine-learned the relationship between the image and the sound and the information indicating the degree of concentration of the person in the image, and the image for the new image and the sound. It may be possible to generate information indicating the degree of concentration of people within. Information indicating the degree of concentration may be specified using both image and sound information such as, for example, typing sound, eye movement, blink frequency, heart rate, respiration, and sigh frequency. For the heart rate measurement itself from the image, for example, a technique such as http://pacesync.com/ may be used.

When the information generated by the information generation unit indicating the degree of concentration of people indicates the degree of concentration equal to or higher than a predetermined value, the information may be automatically switched to the "concentration mode" described later. In addition, the information indicating the degree of concentration of such persons may be used as one of the statistical information of each user.

In addition, the user attribute information may include information indicating human health information in the image. In this case, the machine-learned function according to one embodiment has machine-learned the relationship between the image and the information indicating the health information of the person in the image, and for a new image, the person in the image It may be possible to generate information indicating health information. Health information may include, for example, the posture of the person and / or the distance to the person's imaging device.

In addition, the user attribute information may include information indicating the status of a person. In this case, the machine-learned function according to the embodiment has machine-learned the relationship between the image and / or the sound and the information indicating the status of the person, and the person with respect to the new image and / or the sound. It may be possible to generate information indicating the status of. The information including the status of the person may include information such as during a telephone call, a meal, or a break. The information including the status of such a person may be determined based on any information of image only, image and sound, and sound only, as in the information used in the above-mentioned machine learning.

In addition, the user attribute information may include information indicating the degree of trouble of a person in the image. In this case, the machine-learned function according to one embodiment has machine-learned the relationship between the image and the information indicating the degree of trouble of the person in the image, and for a new image, the person in the image. It may be possible to generate information indicating the degree of trouble. Here, the machine learning is performed by using the relationship between an image including, for example, a person's movement and / or a person's facial expression, and the degree of trouble felt by the person in the image. Good.

Further, the information generation unit may have a function of acquiring sound. The function of acquiring sound may be one using the inside of the above-mentioned imaging device, or may be different from the above-mentioned imaging device. When the information generation unit has a function of acquiring sound, the information generation unit has a machine learning unit in which the relationship between the sound and information for determining whether or not it can occur during work has been machine-learned. Good. The information generation unit may use the machine learning unit to generate information for determining whether or not the acquired sound is a sound generated during work. Note that the machine learning for determining whether or not the sound is generated during the work is, for example, information for determining that the sound is generated during the work with respect to the sound when a key in the keyboard is touched. , May include machine learning with associated teacher data. In this case, there is an advantage that it is possible to estimate that the business is performed by inputting to the keyboard, which is a typical business input device for the information processing device. Information including information for determining whether or not the sound is generated during business may be transmitted from the terminal device to the management device at a predetermined timing, but the acquired sound itself is within the program on the WEB browser. There is an advantage that the privacy of the user can be protected by processing and not transmitting from the terminal device to the management device. The information for determining whether or not the sound is generated during the above-mentioned work may be a subordinate concept of the user dynamic attribute information. In addition, the information for determining whether or not the sound is generated during such work may be stored in association with the time.

In addition, the information generation unit may generate "information indicating the situation" of the user, which is not related to the image. The information indicating such a situation may be a subordinate concept of the above-mentioned user attribute information. Further, the information indicating such a situation may be a subordinate concept of the above-mentioned user dynamic attribute information.

For example, the information generation unit may generate information based on the information obtained in cooperation with the software that manages the schedule in the terminal device. The software for managing the schedule may be, for example, software having a calendar function. For example, the information generation unit acquires information related to the user's schedule from software that manages the schedule in the terminal device, using information related to the time such as a predetermined time zone or time, and the user's schedule information. May be generated. The user's "schedule information" may be a subordinate concept of information indicating the user's situation. The user's schedule information may include information related to the user's meeting and / or user's work information. Information related to the meeting may include the presence or absence of the meeting, the attendees of the meeting, the distinction between internal and external meetings, the meeting place, the meeting form, and / or the scheduled end time of the meeting. The meeting format may be that the meeting is a WEB meeting, or the information related to the meeting may be only the information about the meeting at the current time, or is scheduled to be held in a predetermined period such as today, today and the next day. It may include information about the meeting.

In addition, the information generation unit may acquire information related to the current working status input by the user and generate information indicating the status. The information indicating the situation may include, for example, information indicating a "concentration mode", which is information indicating that the user intends to concentrate. There is an advantage that the user can input such information when he / she wants to concentrate, and by transmitting such information to other users, he / she can inform other users that he / she wants to concentrate. The "concentrated mode" may be a subordinate term of the information indicating the situation.

Further, as described later, the information generation unit identifies the latitude and longitude of the terminal device related to the user by using a known technique, and generates the latitude and longitude of the terminal device as a subordinate concept of the information indicating the situation. You may.

FIG. 3 shows an example of information generated by the information generation unit as user attribute information, particularly as user dynamic attribute information.

2.1.2. Information transmitter 212
The information transmission unit has a function of transmitting information. The information transmission unit may transmit a part or all of the information generated by the information generation unit to one or more management devices. The information transmission unit may transmit such information at various timings. For example, the information transmission unit may transmit information to one or more management devices every 30 seconds, every minute, every two minutes, every three minutes, every five minutes, every ten minutes, and so on.
In addition, the information transmission unit may transmit the information at different timings depending on the content of the information to be transmitted. In addition, even if the information to be transmitted is different from the previously transmitted information, only the information that the same information as the previously transmitted information is the same information is transmitted or the information is not transmitted. Good. Further, the information transmission unit may have different transmission timings depending on the management device of the transmission destination.

The information transmission unit may transmit the user attribute information generated by the information generation unit to one or more management devices.

2.1.3. Information display unit 213
The information display unit has a function of displaying information. The information display unit may display information based on the information acquired from the management device. The information display unit may acquire and display user attribute information for a plurality of users from the management device. An example of the mode of use will be described later.

2.2. Management device The management device has an information management unit and an information transmission unit.

2.2.1. Information Management Department 221
The information management unit has a function of acquiring and managing information from one or a plurality of terminal devices. The timing at which the information management unit acquires information may be the timing at which information is acquired from one or a plurality of terminal devices.

The information management unit may manage the information acquired from one or more terminal devices, for example, as shown in FIG. The information management unit may measure and manage the time in which the human face is not continuously included in the image captured by the image pickup device related to each terminal device in the management device. That is, information on whether or not a human face is included in the image is acquired from one or more terminal devices, and such information is used to start the first time when the human face is not included. As the time, the duration that does not continuously include the human face may be measured and managed.

In addition, the information management unit may generate information on the location of the terminal device by using the information acquired from one or a plurality of terminal devices. The information management unit may acquire the latitude and longitude of the terminal device and generate information on the location of the terminal device. The latitude and longitude related to the terminal device may be generated in the management device using the information acquired from the terminal device by using a known technique, or according to an embodiment in the terminal device related to the user. The system may acquire the latitude and longitude using a known technique, and the terminal device may transmit such information to the management device, so that the information management unit may acquire the latitude and longitude of the terminal device. .. The information management unit may specify the administrative division as the location of the terminal device related to the user by using the acquired latitude and longitude by using the rule indicating the relationship between the latitude and longitude and the administrative division. In this case, the administrative division has an advantage that the privacy of the user can be protected if the administrative division is limited to the prefecture and the municipality and the specific address is not specified. In addition, the information management department uses the acquired latitude and longitude by using the rules that show the relationship between the latitude and longitude and the name associated with each place in the organization to which the user belongs. You may specify the name associated with each location within the organization to which you belong. In this case, since the name is within the organization to which the user belongs, there is an advantage that the name is intuitively easier for people belonging to the organization to understand than the administrative division name.

Further, the information management unit may or may not have a statistical function. The statistical function when the information management unit has the statistical function will be described below.

The statistical function may include a function of performing statistical processing using information acquired from the terminal device. For example, the information management unit may perform statistical processing on user attribute information acquired from a plurality of terminal devices.

For example, for each person's user attribute information, the total of the predetermined period and / or the average of the predetermined period may be generated, or each person may generate a correlation for the user attribute information. For example, a time zone in which a specific user tends to be enrolled may be generated by statistically processing the correlation between the time zone and the presence / absence of a specific user. When the time zone in which the person tends to be present is displayed, there is an advantage that the meeting can be set according to the life rhythm of the specific user. Similarly, within a specific group within a group or within a group, the correlation between the time zone and the presence / absence of a user within a specific group or group within the group is statistically processed. , You may generate a time zone that is likely to be present. When such a time zone in which there is a high possibility of being present is displayed, there is an advantage that it can be used for setting a meeting according to a specific group of a group or a user's life rhythm within the group.

Further, for example, a time zone in which a specific user tends to concentrate may be generated by statistically processing the correlation between the time zone and the information indicating the degree of concentration of the specific user. When the time zone that tends to concentrate is displayed, there is an advantage that it can be used for setting a meeting according to the rhythm of concentration for such a specific user. Similarly, within a specific group within a group or within a group, similarly, statistically process the correlation between the time zone and information indicating the degree of concentration of users within a specific group or group within the group. , May generate time zones with high or low likelihood of concentration. When such a time zone with high or low possibility of concentration is displayed, there is an advantage that it can be used for setting a meeting according to a specific group of a group or a rhythm of concentration of users in the group.

In addition, time zone, information indicating the degree of fatigue of a specific user, information indicating the degree of health, information indicating the degree of worries, information indicating the status of a person, and / or information indicating the degree of concentration of a person. By statistically processing the correlation of ,, a specific user may generate a specific tendency regarding the degree of fatigue / degree of health / degree of worries / degree of concentration. By displaying such a specific tendency to the user, there is an advantage that the user can acquire information that can understand his / her own state.

In addition, in order to acquire the relationship of each user when the contact means for contacting each user is used to have a chat, etc., and to measure the presence or absence of the relationship between the users and the frequency of the relationship. It may be used as information.

2.2.2. Information transmitter 222
The information transmission unit has a function of transmitting information. The information transmission unit may transmit a part or all of the information managed by the information management unit to one or more terminal devices. The information transmission unit may transmit such information at various timings. For example, the information transmission unit may transmit information to the terminal device every 30 seconds, every minute, every two minutes, every three minutes, every five minutes, every ten minutes, and so on. Further, the transmission timing may be the same or different depending on the target of the information. In addition, the information transmission unit may transmit the information at a different frequency depending on the target of the information. For example, the information transmission unit periodically transmits the user dynamic attribute information, while the user emotional attribute information is transmitted only when the user logs in, and then transmitted unless otherwise requested. You may not do it. Further, the timing at which the information transmitting unit transmits information may be the same or different for each terminal device.

The management device may be a business information processing device such as a server or a cloud, but information on a mobile terminal device that can be used by a user such as a notebook computer, tablet PC, smartphone, or mobile phone in business. It may be a processing device.

3. 3. Example
3.1. Embodiment 1
In the first embodiment, the flow of use by the user will be described using the screen of the system according to the first embodiment.

First, the user accesses the URL of the system according to the embodiment. For example, a screen as shown in FIG. 5 may be shown. In addition, the user may register as a user before such a screen. A user ID, an e-mail address, a password, etc. may be set in the user and user registration, and these user registrations may be general.

Next, when the user logs in, the screen as shown in FIG. 6 may be displayed. An item entitled Employee List 01 may be displayed on the screen. The system of one embodiment may operate so that information indicating a user can be displayed via a WEB browser.

The system of one embodiment may operate so that the additional button 02, which functions so that the information indicating the user can be additionally displayed on the WEB browser, can be displayed via the WEB browser. When the user inputs to such an additional button, the system of one embodiment operates so that information indicating the displayed user candidate can be displayed by a dialog or the like separately displayed via the WEB browser. You can. When the user selects the information to be displayed as the information indicating each user, the system of one embodiment can display the information selected by the user as the information indicating each user via the WEB browser. It may work.

Further, the system of one embodiment may operate so that the display target determination button 03, which indicates the target to which the information indicating the user is displayed, can be displayed via the WEB browser. When the user selects the display target determination button 03, the system of one embodiment may operate so that information indicating an index to be displayed can be displayed via a WEB browser. The information indicating the index to be displayed may be, for example, information indicating a predetermined set or information indicating a predetermined order. Information indicating an index to be displayed may be simply referred to as a "label" in the documents of the present application.

The information indicating a predetermined set may be information indicating a set playing a predetermined role, information indicating the current situation, or other information. Information indicating a set that plays a predetermined role is, for example, a department such as a sales department, a development department, a research department, an accounting department, or a legal department of an organization within a corporation when the user is an employee of the corporation. You can. In this case, as information indicating the index to be displayed, the information may be displayed so that each department such as the sales department, the development department, the research department, the accounting department, the legal department, etc. can be selected in parallel. Such a department name may match the name in the corporation. Further, the information indicating the set that plays a predetermined role is not limited to the organization within the corporation, and may be the information that indicates the set that plays a predetermined role in any organization to which the user belongs. Also, as the department, the department to which the logged-in user himself belongs may be displayed at the beginning of the selection candidates. In this case, there is an advantage that the information in the department to which the user belongs can be accessed quickly. In addition, the department to which the logged-in user himself belongs may be set as the default of the displayed target. In this case, there is an advantage that the user can support communication with a person in the department to which the user belongs.

The information indicating the current situation may be described later. For example, if you select the case where you are seated, have no meeting, and are not in intensive work as the information indicating the current situation, the person who is seated instead of in the meeting or intensive work is displayed. There is an advantage that it can be used such as searching for a person who can do it.

The information indicating the predetermined order may be, for example, the character order of the user's name (aiueo order, alphabetical order, etc.) or the number order uniquely assigned to the user.

In addition, the target person of the information indicating the user displayed in the WEB browser may be set by the user himself / herself, and for the information set by the user himself / herself indicating a plurality of users. , You may set the label. With such a setting, the user selects, for example, a close friend as a chat partner when he / she is tired from work, and a colleague who promotes the same or similar research as a partner who can be inspired or consulted during research and development. There is an advantage that the chat partner can be set as a target person who can be displayed in one WEB browser for each user, such as. In addition to such chat partners, it is possible to selectively set people who can be related to the user himself, such as the user's boss and subordinates, and both the chat partner and business personnel can be displayed in one WEB browser. There is an advantage that it can be set as a possible target person. In this case, for example, the user selects a plurality of information indicating the user, and the name selected by the display target determination button 03, for example, assuming that the information indicating the plurality of selected users is displayed. It may be set as a label such as "normal use 1". The system of one embodiment may associate and store a plurality of target persons of information indicating the user selected by the user and labels indicating the plurality of target persons. Further, a plurality of target persons of the information indicating the user may be one group, a plurality of groups, and when there are a plurality of groups, each of them may be associated and stored. For example, when one user is involved in a plurality of projects, such a list may be created for each project. For example, FIG. 7 is an example of storing a plurality of labels set by one user and information indicating a user stored in association with each label. The storage location may be a cache in the WEB browser used by the user, or may be stored in association with the user in the storage device in the management device.

In addition, the information indicating the user, which is classified by the above-mentioned display target determination button 03, may be displayed separately on the screen in the WEB browser. For example, the information indicating the user related to the project 1 is displayed in the first column of the screen in the WEB browser, and the information indicating the user related to the project 2 is displayed in the second column of the screen in the WEB browser. Information indicating a user displayed in one WEB browser may be classified into a plurality of groups and displayed. By being displayed separately in a plurality of groups, the user has an advantage that he / she can immediately respond to other users who want to know the situation. Further, in the mode in which the information indicating the users in each group is displayed separately in the plurality of groups, the information indicating the users in each group may be exclusive or may be partially duplicated.

The system of one embodiment may operate so that each user can display the information 04 indicating the current situation, which is the information indicating the current situation, via the WEB browser. As the information indicating the current status, the information indicating the status of the user may be displayed in characters. For example, it may be in the presence (seated), away from the seat, offline, intensive mode, and the like. Further, the information indicating the current situation may display information indicating the current situation of each user in addition to the characters or by color instead of the characters. For example, FIG. 8 shows a relationship in which color information displayed in association with information acquired by the system of one embodiment is stored. Such a relationship may be remembered. In this figure, it is shown that each color is set to be displayed according to various information. For example, the status and color to be displayed are set according to the presence / absence of login, the presence / absence of intensive mode, the presence / absence of input of the WEB meeting button, the degree of leaving time, and / or the presence / absence of a meeting. More specifically, if there is no login, it is displayed as "offline" and grayed out. Assuming that you are logged in, in the case of intensive mode, "Intensive work" is displayed and the color is orange. Then, assuming that the centralized mode is off, if there is an input to the WEB conference button, it is shown in red. Further, on the premise that the input to the WEB conference button is off, the display and the color may be changed and displayed according to the elapsed time. In particular, when the leaving time is displayed according to the elapsed time, there is an advantage that the user can understand how much time he / she is away from.

In addition, the system of one embodiment may operate so that each user can display information 05 indicating the current location, which is information indicating the current location, via the WEB browser. The information indicating the current location may be information indicating a location in the group to which the user belongs and / or information indicating a predetermined administrative division. The information indicating the location in the group to which the user belongs may be, for example, the name, abbreviation, or the like of each office, each factory, each branch, each sales office, etc. within the organization such as the corporation to which the user belongs. .. When such information is displayed, the user has an advantage that it can be understood by information that is easier to understand within an organization such as a corporation to which the user belongs. In addition, the information indicating the administrative division may be abstracted within a predetermined range. For example, information indicating a municipality may be included, but numerical information that is more specific than a municipality may not be included. In such a case, there is an advantage that the privacy of the user can be protected.

Further, the system of one embodiment may operate so that the static attribute information 06, which is the static attribute information of each user, can be displayed via the WEB browser. The static attribute information includes, for example, an icon indicating the user himself / herself, a user's name, a user's management number, a user's department name, a user's status, a user's related project, and the like. May include. By displaying such static attribute information, there is an advantage that it is possible to understand at a glance what kind of person it is. The icon indicating the user himself / herself may include a fixed image of the user captured in the past or an image of an avatar based on the user's real-time image from the viewpoint of identifying the user. , Does not include images that capture the user in real time. By not displaying the image that captures the user in real time, there is an advantage that the privacy of each user can be protected even during work even if it is unknown what the user is doing in real time. is there. As for the above-mentioned avatar, for example, a program on the WEB browser related to the user terminal that has acquired such an image based on an image that captures the user in real time generates the movement of the corresponding avatar, and the real time of the avatar It may be realized by transmitting the movement to the management terminal, and the management terminal transmits the real-time movement of the avatar to each user terminal and displays the real-time movement of the avatar on each user terminal. In particular, the program running on the WEB browser can generate the movement of the avatar according to the real-time movement of the user, which has the advantage of being able to share the movement with other users while protecting the privacy of the user. is there. As for the movement of the avatar described above, the movement of the skeleton of the specified person may be reflected in the movement of the avatar by specifying the movement of the skeleton of the person in the image of the person by the machine learning unit.

On the other hand, unlike the above, the program executed on the WEB browser transmits the image itself acquired from the imaging device to the management device from one terminal terminal, not as information in the user attribute information, and the management device. May be configured to transmit the image to each terminal device other than the one terminal device so that the real-time image of one user can be viewed on the WEB browser related to each terminal device. In this case, there is an advantage that a real-time image of one user can be seen by each user.

In addition, the system of one embodiment may operate so as to be able to display the contact providing means 07, which provides the means for making contact with each user via the WEB browser. The contact providing means 07 may cooperate with another application to activate a means capable of contacting a user associated with the contact providing means 07. For example, the contact providing means is a terminal device that creates and activates a new e-mail addressed to a user associated with the display in software that can send and receive e-mail installed in the terminal device. Create and activate a new one addressed to the user associated with the display in the software that can execute voice and / or chat installed in, and / or make a call that can be executed on the terminal device. It may be something that can activate a phone with the user associated with the display in the function as the call destination. The system itself of one embodiment does not have to have a constant voice conversation function as a tool for communication means. As a result, the user can obtain a sense of security that voice conversation is not always performed, and can activate the voice conversation function by another application only when necessary, so that privacy can be further protected. There are advantages.

In addition, the system of one embodiment may operate so as to be able to display "WEB conference" 08, which temporarily relinquishes the control authority of the imaging device related to the user, via the WEB browser. When the user inputs the WEB conference 08, the system of one embodiment may suspend the access for acquiring the image from the image pickup device related to the user terminal for the first predetermined period. By suspending the access for acquiring the image during the first predetermined period, the system of one embodiment tries to access the image pickup device related to the user terminal again before the user starts the WEB conference. It is possible to prevent deprivation of the authority of the image pickup device. That is, by entering the WEB conference with the grace period of the first predetermined period, the user has an advantage that the application related to the WEB conference can have the access authority of the imaging device related to the user. In general, in an information processing device, there is often one image pickup device capable of capturing a user's face, and thus there is an advantage that competition between the one image pickup device can be prevented. Further, even when there are a plurality of internal image pickup devices or a plurality of image pickup devices related to one information processing device via an external terminal such as a USB, a smartphone, a tablet PC, or the like has an image pickup direction of one image pickup device. Is the same as the display direction of the display device of the information processing device, and there is often a human face on the side opposite to the display direction of the display device. Therefore, the image pickup device has the same image pickup direction as the display direction of the display device. There is an advantage that the same image pickup device can be prevented from competing with each other. Further, after the elapse of the first predetermined period, the system of one embodiment has a function of attempting access for acquiring an image from the image pickup device related to the user terminal every second predetermined period. You can. With the function that automatically tries to access to acquire an image in this way, even if the user forgets to set the image pickup device to be used by the system according to the embodiment after a WEB conference or the like, one implementation is performed. There is an advantage that the system according to the form can automatically use the imaging device.

Further, the system of one embodiment may operate so that the button 09 for accepting the input for entering the centralized mode can be displayed by the user via the WEB browser. In this case, since the user entering the centralized mode is transmitted to the terminal device of another user as in the embodiment described later, there is an advantage that the intention of the user can be respected.

In addition, the system of one embodiment may have a chat function. The chat function may be a normal chat function, or may be a chat function having one or more of the following functions in place of the normal chat function.

The chat function according to one embodiment is activated by inputting to the call function call icon 01 associated with each user, which is displayed on the panel indicating each user, for example, as shown in FIG. Good. The activation may be a chat function destined for the user associated with the icon. FIG. 16 shows an example of a screen after the icon is selected by clicking or the like, and is an example in which a chat message to the other party is displayed so that it can be input. The user may input a message to the other party user in such a box and select "Send" to send a message addressed to the user associated with the call icon 01.

Further, in the chat function according to the embodiment, for example, as shown in FIG. 17, a notification icon 01 for notifying the reception of a chat message may be displayed at the upper part of the screen. The notification icon may be associated and displayable, for example, with the number of messages received when a chat message to the user is received. In addition, when such an icon is selected by a user by clicking or the like, a part or all of a part or all of the received messages may be a user related to the sender of each message. It may be associated with the indicated information and displayed as a received message 02. Here, the message 03 related to each user may be limited to a predetermined number of characters in advance. In that case, there is an advantage that the displayed space is limited to a predetermined range and the list of received messages can be understood first. In this figure, it is an example that a message is received from each of three users. The user may respond to these messages with a negative response of "I'm sorry" 04, or may respond to each message with a specific message of "Reply" 05. Good. In addition, since the message 03 related to each user is a part of the received message (a part of the user and / or a part of the received message), the whole can be seen. Click "More" 06 to display the entire received message (including the list of all received users and / or the limited range of messages related to one received user). You can do it.

FIG. 18 is an example of a screen when "Reply" is selected. If you select "Reply" for only one message among the messages for multiple users who have received the message, the message for the selected user is displayed and you can reply. It may be configured as follows. Here, a chat screen between the selected user and himself / herself is displayed, and the history of past message exchanges may or may not be retained.

Further, FIG. 19 is an example of a screen when "more" is selected. On such a screen, one or more messages including the received message may be displayed simultaneously in the same window. If it can be displayed in the same window, there is an advantage that you can understand the message including yourself at a glance. In addition, it may be provided with a function that enables input of messages addressed to a plurality of destinations within the same display for a part or all of a plurality of messages displayed as messages including oneself. In this case, for each message addressed to you, part or all of the messages addressed to you within the specified period are displayed at the same time without taking steps such as displaying, replying, and inputting the message. There is an advantage that you can enter the reply information. This has an advantage that the individual time used for sending an e-mail can be shortened when the business is carried out such that the e-mail processing time is collectively set when exchanging a large number of messages. In particular, compared to the case where a window is displayed in each of a plurality of steps of displaying, replying, and inputting an email to an individual destination on a WEB browser, an input message for each destination is temporarily displayed for input to a plurality of destinations. Even if they are different, there is an advantage that the processing speed is improved because each message for a plurality of destinations can be input in one displayed window.

Here, for each received message 01, the message 02 may be individually input as a reply to reply 03. Further, instead of such a response, it may be possible to reply by the fixed phrase 04. By using a fixed phrase, there is an advantage that the processing burden on the user can be reduced, for example, it is possible to input a reply sentence only by clicking. The fixed phrase as a specific character string may be one that the user usually uses. Further, the fixed phrase may be the same character string for all users, or may be a different character string for each user. In the latter case, a fixed phrase used by each user may be set. Each fixed phrase set by each user may be stored in the cache in the WEB browser related to each user, or may be stored as a fixed phrase in association with each user in the management device. There are two or more such fixed phrases, and when a fixed phrase is selected by the user, two or more candidates for the fixed phrases that can be sent are displayed, and a reply can be made by the fixed phrase selected from the candidates. You can. In this case, there is an advantage that a fixed phrase can be selected according to the intention of the user. Further, instead of such a configuration, there is only one fixed phrase, and since it is selected as a fixed phrase by the user, only one fixed phrase may be used. In this case, there is an advantage that the burden of selecting a fixed phrase is also reduced.

In addition, the chat function may be accompanied by "OK" and "I'm sorry" buttons that simply convey Yes / No to the message as an input function. In this case, there is an advantage that the reply to the message can be easily performed. In this figure, only "I'm sorry" is displayed, but the "OK" button may be displayed together with or in place of such a display.

Further, although the chat function is not specified in the drawing as a transmission function, an icon for activating a function capable of creating the same message may be displayed for a plurality of users. Further, the same message may be transmitted at the same time according to a transmission instruction. A plurality of users as destinations of a message may be specified from various viewpoints, and a plurality of users may be specified by a predetermined filter. For example, it may be specified based on the user emotional attribute information of the user, may be specified based on the user dynamic attribute information of the user, the user dynamic attribute information of the user, and the user dynamic attribute information. It may be specified based on user emotional attribute information. When based on user emotional information, for example, it may be a user who belongs to the same group as the group to which the user belongs, or a user who belongs to the same group as the group within the group to which the user belongs. You may. The former is, for example, a message to everyone in the corporation, and the latter is a message to users who belong to the same group such as the same department or project. In addition, when based on user dynamic attribute information, for example, as multiple users as the other party of a message, only the currently present user, only the person currently in the predetermined office, the location in the predetermined range. Only those who are currently in the meeting, only those who are not currently in the meeting, only those who are not currently in the intensive mode, only those who are not currently in the meeting and are not currently in the intensive mode, and so on. In such a case, there is an advantage that a message can be made according to the current specific situation of the user. For example, as multiple users, if you are in the office to which you belong, or if you are in a certain range of places, there is an advantage that you can use it when inviting lunch together. .. In addition, there is an advantage that only those who are not currently in a meeting and who are not currently in the intensive mode can use it when inviting brainstorming.

Further, there may be a function of displaying the history of past messages or a function of not displaying the history of past messages for the other party when sending a chat or receiving a chat. In the former case, the display of the past history may disappear after a predetermined time has passed. In the latter case, there is an advantage that the screen space can be effectively used by not displaying the history of past messages.

In addition, the system according to the embodiment may have a function of determining whether or not the received message has been read based on the image captured by the user. Such a function has a machine learning unit that machine-learns the relationship between an image, information related to a received message, and whether or not it has been read, and the machine learning unit that has already machine-learned has a newly acquired image. Whether or not the message has been read may be determined based on the information related to the received message. The information relating to the message may include the display position of one or more received messages and / or the display timing of the message. Further, the display position of the received one or more messages may be the case where the whole of the one message is displayed, or the stage where only a part of the one message is displayed. In addition, whether or not all the displayed messages have been read for the display position of the displayed one or more messages is determined as to whether or not all the messages have been displayed for the entire displayed one or more messages. It may be one, or it may be one that determines whether or not each message of the displayed one or a plurality of messages has been read. In the former case, the presence or absence of the judged read is generated for the entire displayed one or more messages, but in the latter case, each message of the displayed one or more messages is generated. The determined read presence / absence may be generated for. In such a configuration, for example, the image may use the direction of the line of sight of a person in the image, but is not limited to this. In addition, information determined to be read and / or unread for all or each of the received messages is transmitted to the user terminal related to the sender of each message via the management device. Then, the read or unread information of each message may be displayed on the user terminal. In this case, there is an advantage that the sender of the message can understand whether or not the message has been read even when the user does not specifically click based on the image of the user. Such a function may coexist with a function in which information viewed by a user by clicking each message is displayed at the source of the message, or may have only such a function.

Further, the system according to the embodiment may have a WEB call function. The WEB call may have a normal voice function, but may have a function different from the normal voice function. At this time, the system according to one embodiment may acquire information indicating the stress status of the user in real time based on the acquired image. Here, the information indicating the stress situation may be, for example, a numerical value indicating the degree of stress or a rank. The numerical value may be, for example, a numerical value between 1 and 100 when the stress-free state is 0 and the stress is strong as 100, and the rank is among a plurality of stresses such as low, medium, and strong. It may be the one to which one is specified. The information indicating the stress status is obtained by the system according to the embodiment having a machine learning unit in which the relationship between the image and the information indicating the stress status has been machine-learned and newly acquired during a WEB call. On the other hand, it may be generated by applying such a machine learning unit. Such a machine learning unit can be obtained from an image during a WEB call, for example, behavior such as the user looking at the upper left / upper right, scratching the chin / forehead / head, increasing / decreasing the number of blinks, increasing / decreasing the heart rate, etc. Such information may be acquired and recorded, and based on such a state, information indicating the stress status of the user in the image may be generated. The generated information indicating the stress situation may be transmitted to other users who are using the WEB call function. That is, the information indicating the stress status may be displayed on the WEB browser of the user terminal related to another user via the management device. With such a configuration, the user has an advantage of being able to communicate according to the subtleties of the other party, especially when the image of the other party of the WEB call cannot be viewed in real time. Further, even if the user can see the image of the other party in real time, there is an advantage that it is possible to communicate according to the subtleties of the other party by referring to the information indicating stress. In addition, the information indicating the stress status is stored as statistical information in the management device as an average value of the information indicating the stress within a predetermined period, and is transmitted to the terminal device related to the user, so that the user himself / herself It has the advantage of being available as objective information about stress. Similarly, when the information indicating stress as statistical information in the management device satisfies a predetermined condition, a warning is sent to the terminal device related to the user and the stress of oneself is sent on the terminal device related to the user. Since the degree of is displayed as satisfying a predetermined condition, there is an advantage that the user himself / herself can understand the degree of his / her own stress. In addition, when the information indicating such stress indicates a predetermined condition, it is expected to grasp the stress status of the administrator terminal and the user related to the management device (referred to as "supervisor" in the documents of the present application). It may be possible for the user related to the supervisor to grasp the degree of stress of the user related to the employee by being transmitted to and displayed on the terminal device according to (may). In this case, the prescribed conditions for the user to grasp the degree of his / her own stress and the prescribed conditions for the user related to the user's supervisor to grasp the degree of stress of the user related to the employee. The conditions may be the same or different. If they are different, for example, the predetermined conditions for the user related to the supervisor to grasp the degree of stress of the user related to the employee are the predetermined conditions for the user himself / herself to grasp the degree of stress of himself / herself. In comparison, the degree of stress may be set higher. In this case, at the stage of low stress level, the user can grasp by himself / herself and have an opportunity to deal with it by reviewing the life, etc., while at the stage of high stress level, the user related to the supervisor When the contact is notified to, there is an advantage that it is possible to realize a situation in which the user related to the supervisor can grasp the situation only when there is a possibility that the user himself / herself cannot respond. In the above, the supervisor may be the employer of the employee or the person in charge of the personnel affairs of the employee. Further, in the above description, the stress state has been described as an example, but the description is not limited to this, and it may be used to generate information indicating the degree of interest such as the presence or absence of concentration on WEB calls and the presence or absence of interest. good. For example, a system according to an embodiment related to a program executed on a WEB browser related to a user terminal has a machine learning unit in which the relationship between an image and information indicating the degree of interest has been machine-learned. By applying the machine learning unit to the newly acquired image during the WEB call, information indicating the degree of interest in the WEB call may be generated. The information indicating the degree of interest may include, for example, a numerical value indicating the degree of interest or a rank. The numerical value may be, for example, a numerical value between 1 and 100 when the state of no interest is 0 and the state of interest is 100, and the rank indicates the degree of interest. It may be one in which one of a plurality of such as strong is specified. The information indicating the degree of interest may be processed in the same manner as the information processing for the information indicating the stress situation described above. For example, in a terminal device related to one user, information on the degree of interest such as concentration and interest in a web call generated based on an image captured by the image pickup device is information on the other party of the web call. A web call is made by displaying information on the degree of interest that is transmitted to the terminal device related to the user via the management device and executed on the web browser related to the terminal device related to the other party of the web call. There is an advantage that the user related to the other party of the WEB call can understand the degree of interest of one user and can communicate according to the subtleties of the other party.

The system of one embodiment may be, for example, the one shown in FIG. 9 as another screen example displayed on each terminal device.

Further, in the system of one embodiment, an example of the data possessed by the management device 01 and the terminal device 02 may be shown as shown in FIG. Here, although only one management device is shown, there may be a plurality of management devices. Further, the management device shows an example of being executed on the cloud, but is not limited to this. In addition, the management device may have the current information as a database about the information indicating the situation of each user. In addition, past information may be included in the information indicating the situation of each user. In addition, as basic information, information such as contact information and name of each user may be included. The information in these databases may be appropriately accessible from the terminal device. For example, when one user uses a means of contacting another user, the terminal device also obtains information such as an e-mail address and a telephone number of the other user from such a database. You may get it. Further, as these databases, various types of databases such as a relational database and an object-oriented database may be used, and the format and type thereof are not limited.

3.2. Embodiment 2
In the second embodiment, when the first user who uses the system according to the embodiment according to the present application moves from the imaging field of view of the imaging device according to the first terminal device according to the first user to the outside of the imaging field of view. The flow of the above will be described with reference to FIG.

In the embodiment using the present embodiment, in the first user, the first imaging device related to the first terminal device related to the first user is imaging the first user, and the image is taken from the first imaging device. The acquired program executed on the WEB browser in the first terminal device generates information indicating that there is a human face in the imaging field of view of the first imaging device, and indicates that there is such a person's face. The information was transmitted to the management device as one piece of information in the user dynamic attribute information. In addition, the management device acquires information indicating that there is a human face as one piece of user dynamic attribute information, which is one piece of user attribute information acquired from the first terminal device. I remember. Further, the management device transmits information including information indicating that the person has a face to the second terminal device different from the first terminal device, and executes the information on the WEB browser in the second terminal device. The program being executed acquires such information, and the first user is seated using the information indicating that there is a human face about the first user on the WEB browser in the second terminal device. Displaying information.

Step 1.
The face of the first user comes out of the imaging field of view of the first imaging device. In this case, the program executed on the WEB browser related to the first terminal device, which has acquired the image not including the face of the first user from the first imaging device, has no human face based on the image. Generate information that indicates that. The timing at which the program acquires an image from the first imaging device may always be acquired as a moving image, or may be acquired at predetermined intervals.

Step 2.
Such a program transmits information including information indicating that there is no human face to the management device at a predetermined timing. When the predetermined timing is acquired in a relatively short period of time, for example, every 30 seconds, every 1 minute, every 2 minutes, every 3 minutes, every 5 minutes, every 10 minutes, the presence or absence of seating of the user is more real-time. Has the advantage of being able to send information to the management device.

Step 3.
The management device stores information indicating that there is no human face for the first user, and at a predetermined timing, the management device transfers the information to a plurality of terminal devices including the second terminal device different from the first terminal device. Send information, including information indicating that there is no face. When the management device changes from the information indicating that there is a human face to the information indicating that there is no human face for the first time, the measurement of the elapsed time in the state of leaving the seat may be started, and the elapsed time is calculated as described above. It may be transmitted to a plurality of terminal devices. The management device may or may not transmit the information to the first terminal device in the same manner.

Step 4 .
The program executed on the WEB browser related to the second terminal device acquires information including information indicating that there is no human face related to the first terminal device, and associates it with the first user, for example, while away from the desk. As certain information, it operates so that it can be displayed on a WEB browser. It should be noted that such a program is the elapsed time after acquiring the information indicating that there is no human face. When the information on the elapsed time of the absentee state is received from the terminal device, the program is the first user. It may operate so that the elapsed time required in association with can be displayed on the WEB browser.

Step 5 .
The second user related to the second terminal device has an advantage that he / she can see the display that the first user is away from his / her seat and can consider communication with the second user based on such a state. Further, when the elapsed time of leaving the seat of the first user is displayed on the WEB browser related to the second terminal device, the second user can estimate the situation of the first user and consider communication. There is. For example, if the first user's leave time is 60 minutes at the stage of 1 hour after the start of work, a business trip, flex, or a break can be considered, but if it is within 15 minutes, a break can be considered. .. Similarly, at noon, if the first user's leaving time is 30 minutes or more, it is possible that he went out for a meal, but if the first user's leaving time is within 15 minutes, it is possible that the time has passed. Depending on the situation, there is a possibility that it will come back soon.

3.3. Embodiment 3
In the third embodiment, the flow in which the first user who uses the system according to the one embodiment according to the present application holds a WEB conference using the image pickup device according to the terminal device according to the first user is shown in the figure. 12 will be described. It is assumed that the present embodiment is also in the same state as the above-described second embodiment.

Step 1
First, the first user inputs an input to the WEB conference button displayed on the WEB browser related to the first terminal device at the stage immediately before the WEB conference time. The program executed on the browser related to the first terminal device receives the input of the WEB conference button, stops the access to the first image pickup device, and stops the acquisition of the image from the first image pickup device. Such a program starts measuring the time at the same time as accepting the input of the WEB conference button. The measurement of such time is used to determine the conditions for resuming access to the first imaging device. Such a program suspends access to the first imaging device until the elapse of a first predetermined time, which is a condition for resuming access to the first imaging device. During this first predetermined time, the application in the first terminal device can acquire access to the first imaging device, so that the first user has a grace period for preparing for the WEB conference at least for the first predetermined period. There is.

Step 2
The first user starts a WEB conference. At this time, since the above-mentioned program does not access the first imaging device, any application in the first imaging device including the application related to the WEB conference can access the first imaging device. In the documents of the present application, the fact that the imaging device can be accessed may mean that the imaging device has the authority to control the imaging device. As will be described later, since the above-mentioned program attempts to access the first imaging device every second predetermined period after the lapse of the first predetermined period, the first user will try to access the first predetermined period. If the WEB conference has not been started, or if the first user has not started the WEB conference after the lapse of the first predetermined period and the second predetermined period, the above program has the access authority of the first imaging device. In such a case, the first user who plans to start the WEB conference needs to return to step 1 described above and input to the WEB conference button again.

Step 3
The program attempts to access the first imaging device every second predetermined period after the lapse of the first predetermined period. The above-mentioned program acquires the authority if the access is possible, that is, the authority to control the first imaging device is obtained.

Step 4
The first user ends the WEB conference. With the termination of the WEB conference, the application related to the WEB conference relinquishes the access authority to the first imaging device. Therefore, after the lapse of the above-mentioned first predetermined period, at the timing of each second predetermined period. The above-mentioned program acquires the access authority related to the first imaging device. Even if the program attempts to access the first imaging device every second predetermined period, even if the first user forgets to set the first imaging device to be used in the above program, it is automatically performed. Therefore, there is an advantage that the above-mentioned program can attempt to access the first imaging device and acquire it so that the seated or unoccupied state of the first user can be detected.

Note that FIG. 13 is an example diagram illustrating a logic in which the above-mentioned program attempts to access the first imaging device. The above program (1) confirms the connection status of the camera to the first image pickup device every second predetermined period, (2) initializes the image pickup device if it is not connected, and (3) succeeds in initialization. When and if it is already connected, AI processing is performed on the image, and (4) if initialization fails (for example, when another WEB conference application uses the first imaging device), this is performed. Processing such as recording and returning to (1) may proceed.

3.4. Embodiment 4
In the fourth embodiment, the flow when the first user who uses the system according to the one embodiment according to the present application wants to concentrate will be described with reference to FIG.
It is assumed that the present embodiment is also in the same state as the above-described second embodiment.

Step 1.
First, when the first user wants to concentrate, he / she inputs to the centralized mode displayed on the WEB browser related to the first terminal device. The program executed on the browser related to the first terminal device accepts the input of the centralized mode.

Step 2.
Such a program transmits information including information indicating that it is in the centralized mode to the management device at a predetermined timing. When the predetermined timing is transmitted in a relatively short period of time, for example, every 30 seconds, every 1 minute, every 2 minutes, every 3 minutes, every 5 minutes, every 10 minutes, the first user is in the centralized mode. There is an advantage that the information can be transmitted to the management device in more real time.

Step 3.
The management device stores information indicating that the first user is in the centralized mode, and at a predetermined timing, the first user sends the first user to a plurality of terminal devices including the second terminal device different from the first terminal device. Sends information, including information indicating that is in centralized mode. The management device may or may not transmit the information to the first terminal device in the same manner.

Step 4.
The program executed on the WEB browser related to the second terminal device acquires information including information indicating that the centralized mode is related to the first terminal device, and associates it with the first user, for example, information in the centralized mode. As a result, it operates so that it can be displayed on the WEB browser.

3.5. Embodiment 5
The fifth embodiment is another embodiment. For example, in the above, the case where the user belongs to one specific group has been described, but the situation is not limited to one specific group, and one or more users belong to each of a plurality of specific groups. The system of one embodiment may be used among the users in the above. In this case, the user may be a user who belongs to a part of a plurality of organizations. In particular, in relation to an organization other than a specific organization, there is an advantage that synergies are increased when the members of each organization actively engage in daily conversation and ordinary chat. Examples of cases in which each user in a plurality of organizations interacts with each other may be, for example, an exchange including a chat between researchers in joint research, or a related person who is concluding a business alliance.

In addition, the user may also use the system of one embodiment in a real space such as a shared office. For example, in a shared office, while each person is working using an information processing device, as described above, one of the information processing devices related to each user is, for example, WIFI technology related to the wireless communication. The specific position can be specified by using. Therefore, for example, while displaying the position of each user in the shared office, the affiliation and specialty of each user can be disclosed within a certain range, shared among each user, and information can be obtained from each other. It may be. In the case of such a configuration, in a real space such as a shared office, it is found that other users who have an industry or specialty of interest are nearby, so each user has the advantage of being able to take advantage of opportunities such as business alliances. is there. In this case, as information about each user, information that can be disclosed externally or in such a shared office may be registered and shared. Information that can be disclosed includes the user's name, specialty, range of interest, and the like. By disclosing this information in a predetermined range such as in a shared office and making it accessible, there is an advantage that the opportunity for access from other users can be increased.

The system of one embodiment may have a function of sharing information information that one user desires to communicate with. More specifically, one user may input information indicating that he / she wants to communicate with the above-mentioned program on the WEB browser. The above-mentioned program may accept input of information indicating that such communication is desired and transmit it to the management device at a predetermined timing. The management device may transmit information requesting communication associated with such one user to a terminal device within a predetermined range. The predetermined range may be, for example, one shared office, a part thereof, or a plurality of shared offices. It may be separated by floor or room in the shared office. The information that desires communication associated with such one user may be displayed by the operation of the above-mentioned program executed in the WEB browser on the user terminal within the above-mentioned predetermined range. Therefore, the user within the predetermined range may understand that one of the above-mentioned users desires communication. Thereby, the person who desires may start the communication using the system of one embodiment, or may directly communicate in the real space. In addition, in relation to the above-mentioned desire for communication, for example, it is possible to select whether to desire only communication in the virtual space, only communication in the real space, or either of these. Yes, and such information may also be shared so that it can be displayed on other user terminals. Similarly, communication targets and comments may also be associated. The object of communication may be, for example, a topic related to a specific business or a topic related to a specific research field.

In addition, the system according to one embodiment may have a matching function between users. The matching function may perform matching based on information indicating the current situation of the user. Further, in such a case, the information indicating the current situation may be, for example, information indicating that communication is desired. As described above, the information desired to be communicated may be input at each user terminal and transmitted to the management terminal. In such a management terminal, matching may be performed between users who desire communication by associating users who are associated with information that they desire communication. When such matching is performed, it is displayed to each user to be matched that they want to communicate with each other by the operation of the program executed on the WEB browser of each user terminal. You can do it. In this case, another communication tool such as SNS may be further operated to provide a dedicated communication method between users who desire communication.

4. Hardware Configuration of System The system according to the present invention may be composed of one or a plurality of information processing devices. As shown in FIG. 20, the information processing device 10 according to the present invention may include a bus 15, an arithmetic device 11, a storage device 12, and a communication device 16. Further, the information processing device 10 in one embodiment may include an input device 13 and a display device 14. It is also directly or indirectly connected to the network 17.

The bus 15 may have a function of transmitting information between the arithmetic unit 11, the storage device 12, the input device 13, the display device 14, and the communication device 16.

An example of the arithmetic unit 11 is a processor. This may be a CPU or an MPU. Further, the arithmetic unit in one embodiment may include a graphics processing unit, a digital signal processor, and the like. In short, the arithmetic unit 12 may be any device capable of executing program instructions.

The storage device 12 is a device that records information. This may be either an external memory or an internal memory, and may be either a main storage device or an auxiliary storage device. Further, a magnetic disk (hard disk), an optical disk, a magnetic tape, a semiconductor memory, or the like may be used. Further, it may have a storage device via a network or a storage device on the cloud via a network.

In this block diagram, the registers, L1 cache, L2 cache, etc. that store information at a position physically close to the arithmetic unit may be included in the arithmetic unit 11, but in the design of the computer architecture, As a device for recording information, the storage device 12 may include these. In short, the arithmetic unit 11, the storage device 12, and the bus 11 may be configured to cooperate with each other to execute information processing.

The storage device 12 may include a part or all of a program capable of executing the process according to the present invention. In addition, data necessary for executing the process according to the present invention can be appropriately recorded. The storage device 12 in one embodiment may also include a database.

Further, the above describes the case where the arithmetic unit 12 is executed based on the program provided in the storage device 13, but it is one of the forms in which the bus 11, the arithmetic unit 12 and the storage device 13 are combined. As a result, part or all of the information processing according to the present invention may be realized by a programmable logic device capable of changing the hardware circuit itself or a dedicated circuit in which the information processing to be executed is determined.

The input device 13 inputs information, but may have other functions. Examples of the input device 14 include an input device such as a keyboard, a mouse, a touch panel, or a pen-type instruction device.

The display device 14 has a function of displaying information. For example, a liquid crystal display, a plasma display, an organic EL display, and the like can be mentioned, but in short, any device capable of displaying information may be used. Further, the input device 13 may be partially provided like a touch panel.

The network 17 transmits information together with the communication device 16. That is, it has a function of enabling information of 10 information processing devices to be transmitted to other information terminals (not shown) via the network 17. The communication device 16 may use any connection type, such as IEEE1394, Ethernet (registered trademark), PCI, SCSI, USB, 2G, 3G, 4G, 5G, and the like. The connection to the network 17 may be either wired or wireless.

The information processing device according to the present invention may be a general-purpose type or a dedicated type. Further, the information processing device may be a workstation, a desktop personal computer, a laptop personal computer, a laptop computer, a PDA, a mobile phone, a smartphone or the like.

Although described as one information processing device 10 in this figure, the system according to the present invention may be composed of a plurality of information processing devices. The plurality of information processing devices may be internally connected or may be externally connected.

Further, the system according to the present invention may be of various types of devices. For example, the system according to the present invention may be a stand-alone system, a server-client system, a peer-to-peer system, or a cloud system. The system according to the present invention may be a stand-alone information processing device, may be composed of a part or all of the information processing device of the server-client type, or may be a part or all of information processing of the peer-to-peer type. It may be composed of devices, or may be composed of some or all information processing devices in cloud format.

Further, when the system according to the present invention is composed of a plurality of information processing devices, the owner and the manager of each information processing device may be different.

Further, the information processing device 10 may be a physical existence or a virtual one. For example, the information processing device 10 may be virtually realized by using cloud computing.

In the above description, the configurations implemented by the system of this example have been described, but these may be configurations implemented by one or more information processing devices in the system.

It goes without saying that the invention examples described in the examples of the documents of the present application are not limited to those described in the documents of the present application, and can be applied to various examples within the scope of the technical idea. For example, the term "button" in the documents of the present application may be a physical button, or may be a display that is displayed on a display device that can accept input such as a touch screen and can accept input. .. Further, when the management device acquires information from a plurality of terminal devices, the timing of acquisition from each terminal device may be acquired at the same time or at different times. Further, when the management device transmits information to a plurality of terminal devices, the information may be transmitted to each terminal device at the same time or at different times. Further, the program according to one embodiment may itself have an instruction for transmitting and / or receiving information, and sets the information so that another program can transmit and / or receive the information. May be only.

In addition, the processes and procedures described in the documents of the present application may be feasible not only by those explicitly described in the embodiments, but also by software, hardware or a combination thereof. Further, the processes and procedures described in the documents of the present application may be able to be implemented by various computers by implementing the processes and procedures as a computer program. In particular, some or all of the functions realized by the term "system" as used in the documents of the present application may be realized by a program that can be executed on such an information processing device. Further, these computer programs may be stored in a storage medium. Also, these computer programs may be stored on a non-transient or temporary storage medium.

10 Information processing device 11 Arithmetic logic unit 12 Storage device 13 Input device 14 Display device 15 Bus 16 Communication device 001, 002 Management device 001a, 002a Administrator terminal 011 to 015 User terminal

Claims (17)

A first transmission unit capable of transmitting a program that can be executed on the WEB browser of the first terminal device to the first terminal device related to the first user, and
User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the imaging device related to the first terminal device. With the acquisition unit that can acquire information including
A second transmission unit capable of transmitting information based on the user attribute information to a second terminal device different from the first terminal device, and
It is a system equipped with
The user attribute information includes information indicating the presence or absence of the first user in the image.
The program is used to avoid conflict of access to the image pickup device with respect to the image pickup device according to the first terminal device in which the program is executed for a first predetermined period after receiving a predetermined input. , Do not access to acquire the image,
system. The program is an access for acquiring the image to the image pickup device related to the first terminal device in which the program is executed after the elapse of the first predetermined period after receiving the predetermined input. Do regularly,
The system according to claim 1. The machine-learned function in the program is machine-learned about the relationship between the image and the user attribute information, and can generate the corresponding user attribute information for the image.
The user attribute information does not include the image related to the first terminal device.
The system according to claim 1 or 2 . The information based on the user attribute information includes a time when the first user related to the user attribute information is continuously determined not to be included in the image.
The system according to any one of claims 1 to 3 . The information based on the user attribute information includes information indicating the situation of the first user.
The system according to any one of claims 1 to 4. The information indicating the situation of the first user is information indicating a situation in which the first user is concentrated, information indicating that the first user is in a meeting, and / or the first use. Including the location information of the person
The system according to claim 5 . The system comprises memory.
The system according to any one of claims 1 to 6. System,
A first transmission means capable of transmitting a program that can be executed on the WEB browser of the first terminal device to the first terminal device according to the first user.
User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the imaging device related to the first terminal device. An acquisition method that can acquire information including
A second transmission means capable of transmitting information based on the user attribute information to a second terminal device different from the first terminal device,
It is a program to operate as
The user attribute information includes information indicating the presence or absence of the first user in the image.
The program that can be executed on the WEB browser is the image pickup device for the image pickup device related to the first terminal device in which the program is executed for a first predetermined period after receiving a predetermined input. Do not access to acquire the image in order to avoid access conflicts
program. The program according to claim 8, which is executed by the arithmetic unit in the system. the system,
A first transmission step of transmitting a program that can be executed on the WEB browser of the first terminal device to the first terminal device related to the first user.
User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the imaging device related to the first terminal device. Get information, including information, get steps,
A second transmission step of transmitting information based on the user attribute information to a second terminal device different from the first terminal device.
Is a way to do
The user attribute information, see contains information, indicating the presence or absence of the first user in the image,
The program that can be executed on the WEB browser is the image pickup device for the image pickup device related to the first terminal device in which the program is executed for a first predetermined period after receiving a predetermined input. Do not access to acquire the image in order to avoid access conflicts
Method. The method according to claim 10, wherein the arithmetic unit in the system executes. The first acquisition unit, which can acquire a program that can be executed on the WEB browser of the first terminal device,
User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the imaging device related to the first terminal device. Transmitter, which can transmit information including
An acquisition unit that can acquire information based on user attribute information related to a second terminal device different from the first terminal device.
It is a first terminal device provided with
The user attribute information, see contains information, indicating the presence or absence of the first user in the image,
The program that can be executed on the WEB browser is the image pickup device for the image pickup device related to the first terminal device in which the program is executed for a first predetermined period after receiving a predetermined input. Do not access to acquire the image in order to avoid access conflicts
First terminal device. The first terminal device according to claim 12, which is executed by the arithmetic unit in the first terminal device. The first terminal device,
An acquisition means for acquiring an image captured by the imaging device according to the first terminal device,
A transmission means for transmitting information including user attribute information related to the first terminal device, which is generated by applying a machine learning function to the image, to the management device.
An acquisition means for acquiring information based on user attribute information related to a second terminal device different from the first terminal device.
A program that can be executed on the WEB browser of the first terminal device and has the machine-learned function.
The user attribute information, see contains information, indicating the presence or absence of the first user in the image,
For the first predetermined period after receiving a predetermined input, the image is displayed with respect to the image pickup device related to the first terminal device on which the program is executed in order to avoid conflict of access to the image pickup device. Do not access to get,
program. The program according to claim 14, which is executed by the arithmetic unit in the first terminal device. The first terminal device , which has a machine-learned function and executes a program that can be executed on a WEB browser,
Acquisition step of acquiring an image captured by the imaging device according to the first terminal device,
A transmission step of transmitting information including user attribute information related to the first terminal device, which is generated by applying a machine learning function to the image, to the management device.
An acquisition step of acquiring information based on user attribute information related to a second terminal device different from the first terminal device.
Is a way to do
The user attribute information, see contains information, indicating the presence or absence of the first user in the image,
The program that can be executed on the WEB browser is the image pickup device for the image pickup device related to the first terminal device in which the program is executed for a first predetermined period after receiving a predetermined input. Do not access to acquire the image in order to avoid access conflicts
Method. The method according to claim 16, which is executed by the arithmetic unit in the first terminal device.