JP7179384B1 - Server, information processing method and program - Google Patents

Abstract

A server capable of easily grasping the states of users participating in a web conference is provided. A server (1) for conducting a web conference between two or more user terminals (2), and an information receiving section (100) for receiving images transmitted from each of the two or more user terminals during the web conference. and an information acquisition unit 102 that acquires one or more user's vital information in association with the image from the user's person area included in one or more images among the two or more images received by the information reception unit 100. and an information transmission unit 107 that transmits information corresponding to the vital information acquired by the information acquisition unit 102 to one or more user terminals 2 out of the two or more user terminals 2 during the web conference. prepared. [Selection drawing] Fig. 1

Description

The present invention relates to servers and the like used for web conferences.

2. Description of the Related Art A web conference system is known that uses a plurality of terminals connected via a network to hold a virtual conference (see, for example, Patent Document 1).

Japanese Patent Application Laid-Open No. 2019-117998 (page 1, FIG. 1, etc.)

In such a web conference system, unlike when users meet face-to-face, it is difficult to see and talk about the state of users in detail, and it is difficult to understand the state of users participating in the web conference (for example, health conditions). There is a problem that it is difficult to easily grasp the state, etc.).

SUMMARY OF THE INVENTION It is an object of the present invention to provide a server or the like that can easily ascertain the states of users participating in a web conference.

A server of the present invention is a server that conducts a web conference between two or more user terminals, and includes an information receiving unit that receives images transmitted from each of the two or more user terminals during the web conference. an information acquisition unit that acquires vital information of one or more users in association with the images from the person regions of the users included in the one or more images among the two or more images received by the information reception unit; and a web conference. and an information transmitting unit configured to transmit information corresponding to the vital information acquired by the information acquiring unit to one or more user terminals among the two or more user terminals while the information acquiring unit is performing.

With such a configuration, it is possible to easily grasp the status of users participating in the web conference.

Further, in the server of the present invention, in the server, the information acquisition unit is an image among two or more images received by the information reception unit, and the user information included only in the image transmitted from the predetermined user terminal is selected. Vital information of one or more users may be acquired from the person area.

With such a configuration, it is possible to selectively and easily grasp the states of predetermined users among the users participating in the web conference.

Also, in the server of the present invention, the information transmission unit transmits the vital information only to one or more other user terminals excluding the user terminal that transmitted the image from which the vital information was acquired. may

With such a configuration, it is possible not to provide vital information to a user who provides vital information. As a result, for example, information corresponding to vital information can be provided only to users who prefer to grasp the user's condition, etc., using vital information.

Further, the server of the present invention further comprises a determination unit for determining whether or not the vital information acquired by the information acquisition unit matches the output condition in the server, and the information transmission unit determines whether the determination unit meets the output condition Only the information corresponding to the vital information determined to match the above may be transmitted.

With this configuration, it is possible not to transmit information corresponding to vital information that does not meet the output conditions, for example, it is possible to prevent transmission of vital information that does not require observation or confirmation. For example, with such a configuration, it is possible not to transmit information regarding normal vital information.

Further, in the server of the present invention, in the server, the information acquisition unit obtains vital information of one or more users from a person region of the user included in one or more images among the two or more images received by the information reception unit. and a screen image including two or more user areas including the image received by the information receiving unit, wherein the user area including the image in which the vital information satisfying the condition of interest is obtained by the information obtaining unit is another user A configuration unit that configures a screen image that is visually distinguishable from the area may be further provided, and the information transmission unit may transmit the screen image configured by the configuration unit.

With such a configuration, it is possible to visually indicate a user whose vital information is preferable to pay attention to. For example, it is possible to visually indicate a user whose vital information is not normal.

Further, the server of the present invention refers to the proposal storage unit in which one or more pieces of proposal information having insurance conditions using vital information and insurance information related to proposed insurance are stored in the server, and the information acquisition unit acquires An insurance information acquiring unit that determines the insurance conditions that the vital information obtained from the acquired vital information satisfies and acquires insurance information paired with the insurance conditions from the proposal storage unit; and an insurance information transmission unit that transmits the image to the user terminal that transmitted the image.

With such a configuration, it is possible to present appropriate insurance information to the user according to the vital information.

Further, in the server of the present invention, in the server, the information acquisition unit acquires vital information from each time-series image received from one or more specific user terminals, and the time-series information acquired by the information acquisition unit An accumulation unit for accumulating vital information may be further provided.

With such a configuration, it is possible to acquire chronological vital information from images used in web conferences.

Further, in the server of the present invention, in the server, the information acquisition unit acquires vital information from each time-series image received from each of two or more user terminals, and associates it with each of two or more user terminals. , an accumulation unit for accumulating the time-series vital information acquired by the information acquisition unit.

With such a configuration, it is possible to acquire time-series vital information about two or more users from images used in a web conference.

In the server of the present invention, the storage unit may store time-series vital information in association with each time-series image received by the information reception unit.

With this configuration, by accumulating time-series vital information in association with the image from which it was acquired, it is possible to check the user's condition and the like by referring to the time-series vital information and image.

According to the server or the like according to the present invention, it is possible to easily grasp the states of the users participating in the web conference.

Block diagram of a web conference system according to an embodiment of the present invention Flowchart explaining the operation of the server of the web conferencing system Flowchart explaining the operation of the server of the web conferencing system Schematic diagram showing the configuration of a specific example of the web conferencing system Diagram showing the specific information management table of the server of the same web conference system A diagram showing an output condition management table of the server (Fig. 6(a)) and a diagram showing a view condition management table (Fig. 6(b)) A diagram showing a proposal information management table of the same server (Fig. 7(a)) and a diagram showing insurance transmission management information (Fig. 7(b)) Diagram showing the vital information management table of the server of the same web conference system Diagrams for explaining screen images configured by the server (Figs. 9(a) to 9(d)) Diagrams for explaining screen images configured by the same server (FIGS. 10(a) to 10(c)) Diagrams showing examples of display by a user terminal of the same web conference system (FIGS. 11(a) and 11(b)) Diagrams showing examples of display by a user terminal of the same web conference system (FIGS. 12(a) and 12(b)) A diagram showing an example of the appearance of a computer system according to the same embodiment. Diagram showing an example of the configuration of the same computer system

Embodiments of a server and the like will be described below with reference to the drawings. It should be noted that, since components denoted by the same reference numerals in the embodiments perform similar operations, repetitive description may be omitted.

(Embodiment)
FIG. 1 is a block diagram of a web conference system 1000 according to this embodiment.

A web conference system 1000 includes a server 1 and one or more user terminals 2 . The server 1 and one or more user terminals 2 are connected via a network such as the Internet so that information can be transmitted and received. Note that FIG. 1 shows, as an example, a case where the web conference system 1000 includes three or more user terminals 2 .

The server 1 includes an information receiving unit 100, a specific information storage unit 101, an information acquisition unit 102, an output condition storage unit 103, a target condition storage unit 104, a determination unit 105, a configuration unit 106, an information transmission unit 107, an accumulation unit 108, a vital An information storage unit 109 , a proposal storage unit 110 , an insurance information acquisition unit 111 and an insurance information transmission unit 112 are provided.

The server 1 is a cloud server or an application server. The server 1 is, for example, a server that provides web conferences. The web conference here is a concept that includes seminars, classes, etc. that are held using a plurality of terminals connected via a network. The server 1 is implemented by, for example, a computer or the like.

The information receiving unit 100 receives images transmitted from each of two or more user terminals 2 during a web conference. The image received by the information receiving unit 100 from the user terminal 2 is, for example, an image of a user participating in the conference (for example, an area including the user's face). The image received by the information receiving section 100 may be a moving image or a still image. The images received by the information receiving unit 100 are, for example, time-series images. The time-series images may be, for example, moving images or a plurality of still images transmitted in time series. However, the image received by the information receiving unit 100 is preferably an image from which vital information can be acquired. The information receiving unit 100 normally receives images associated with the user terminal 2 . For example, the information receiving section 100 receives an image associated with the terminal identifier of the user terminal 2 . The terminal identifier may be, for example, the name of the user terminal 2 , a code assigned to the user terminal 2 , or address information such as the IP address of the user terminal 2 . Also, a session identifier or the like may be used as a terminal identifier. Also, the user identifier of the user who uses the user terminal 2 may be used as the terminal identifier. The information receiving unit 100 normally receives audio as well as images.

The information receiving unit 100 is normally realized by wireless or wired communication means. The information receiving section 100 may or may not include a communication device.

The specific information storage unit 101 stores specific information that designates a specific user terminal 2 . The specific information is, for example, the terminal identifier of the user terminal 2 . The specific information is, for example, information specifying the user terminal 2 from which vital information is to be obtained. Further, the specific information is information that designates the user terminal 2 to which the information corresponding to the vital information is to be sent. The identification information may further include information that designates what kind of target the user terminal 2 is identified as.

The specific information storage unit 101 is preferably a non-volatile recording medium, but can also be realized with a volatile recording medium. The same applies to other storage units.

The information acquisition unit 102 acquires one or more user's vital information from the person region of the user included in one or more images out of the two or more images received by the information reception unit 100, in association with the image. The two or more images received by the information receiving unit 100 are images transmitted from each of the two or more user terminals 2 . The person area of the user included in the image is, for example, an area in which the user appears in the image. The user's person region is preferably a region containing the user's face. Vitals include pulse, respiration, body temperature, blood pressure, level of consciousness, and the like. Vitals are also called vital signs. The vital information is, for example, information representing vitals such as respiration rate and pulse rate. The vital information here may be information obtained by processing one or more vital information such as heart rate variability, sympathetic nerves, parasympathetic nerves, LF (low frequency)/HF (high frequency), and the like. LF/HF is information used as an index of stress, for example. The information acquisition unit 102 may acquire different types of vital information for each user. Acquiring vital information in association with an image may be considered to acquire vital information in association with the user terminal 2 that has transmitted the image. For example, the information acquisition unit 102 acquires vital information from images received within a predetermined period (for example, time-series images). Since the technique of acquiring the user's vital information from the user's person area included in the image is a known technique, detailed description thereof will be omitted here. As a technique for acquiring such vital information, for example, the technique described in the following URL can be used (URL: https://sensing-art.com/#tech-feature). However, the technique of acquiring vital information from the person area of the image used here is not limited to the above technique.

The information acquisition unit 102 extracts one image from the user's person region, which is an image among the two or more images received by the information reception unit 100, and is included only in the image transmitted from one or more predetermined user terminals 2. The vital information of the above users is acquired. A user included in the image transmitted from the user terminal 2 is, for example, a user participating in the web conference using the user terminal 2 .

The information acquisition unit 102 may acquire vital information from each time-series image received from one or more specific user terminals 2, for example. A specific user terminal 2 is, for example, a user terminal 2 used by a specific user. Specific users are, for example, patients, students, and employees. In addition, the information acquisition unit 102 may acquire vital information from each time-series image received from each of two or more user terminals. A specific user terminal 2 from which vital information is to be acquired is specified by specific information stored in the specific information storage unit 101, for example.

It does not matter when the information acquiring unit 102 acquires vital information from each time-series image received by the information receiving unit 101 from one or more user terminals 2 . For example, the information acquisition unit 102 acquires vital information from each image at regular or arbitrary time intervals. In addition, in response to an instruction received by the information receiving unit 100 from the user terminal 2 as a transmission destination of information corresponding to the vital information, the information acquiring unit 102 obtains vital information from images received from one or more specific user terminals 2. may be obtained. This instruction may further include information designating the user terminal 2 that transmits the image for acquiring vital information.

The output condition storage unit 103 stores one or more output conditions. The output condition is a condition for determining whether the vital information acquired by the information acquisition unit 102 may be transmitted. The output condition is, for example, a condition regarding one or more pieces of vital information of the user acquired by the information acquisition unit 102 . The user's vital information is, for example, the vital information of the user using the user terminal 2 obtained from the image received from the user terminal 2 .

The output condition is, for example, a threshold for vital information represented by a numerical value or index. For example, the output condition is a condition that the heart rate is equal to or greater than a threshold, a condition that the respiration rate is equal to or greater than the threshold, or a condition that the stress index value indicated by LF/HF is equal to or greater than the threshold. The output condition storage unit 103 may store different output conditions for each type of vital information. For example, output conditions for one or more different vital information may be stored in the output condition storage unit 103 in association with vital identifiers that identify types of vital information. The vital identifier may be, for example, a vital name, a code assigned to the vital, or the like. The output condition may be a combination of conditions for multiple types of vital information (for example, AND conditions, OR conditions, etc.).

The condition-of-interest storage unit 104 stores one or more conditions of interest. The condition of interest is a condition relating to one or more pieces of vital information of the user, and it is determined whether the configuration unit 106 configures a screen image in which the user area corresponding to the user is visually distinguishable from other user areas. It is a condition for

The condition of interest is, for example, a threshold for vital information represented by a numerical value or index. For example, the condition of interest is, for example, the condition that the heart rate is equal to or greater than the threshold, the condition that the respiratory rate is equal to or greater than the threshold, or the condition that the stress indicator value indicated by LF/HF is equal to or greater than the threshold. be. The condition-of-interest storage unit 104 may store different conditions of interest for each type of vital information. The condition-of-interest storage unit 104 may store, for example, conditions of interest for one or more different vital information in association with vital identifiers. The condition of interest may be a combination of conditions for multiple types of vital information (for example, AND conditions, OR conditions, etc.).

In this embodiment, a case where the server 1 has the output condition storage unit 103 and the target condition storage unit 104 will be described. It may be held by another accessible device or the like.

The same condition as the output condition may be used as the condition of interest. In this case, the condition of interest and the condition of interest storage unit 104 may be omitted, and the output condition may be used in the process using the condition of interest.

The determination unit 105 determines whether the vital information acquired by the information acquisition unit 102 matches the output conditions stored in the output condition storage unit 103 . When output conditions for a plurality of types of vital information are stored in the output condition storage unit 103, the determination unit 105 determines that the plurality of vital information acquired by the information acquisition unit 102 are output conditions corresponding to the respective types. You can decide whether you are satisfied. When the output condition is a combination of a plurality of conditions, the determination unit 105 determines whether the vital information corresponding to each of the plurality of conditions satisfies each condition, and the combination of the determination results satisfies the output condition. You can judge whether

The constructing unit 106 constructs a screen image including one or more, preferably two or more user areas including the image received by the information receiving unit 100 . One user area is, for example, an area that includes an image received by the information receiving unit 100 from one user terminal 2 (for example, an area in which an image is arranged). The configuration unit 106 configures a screen image including one or more user areas (including the image received by the information receiving unit 100). The screen image configured by the configuration unit 106 may be, for example, a screen image in which all of the images received by the information receiving unit 100 from two or more user terminals are arranged in tiles. good.

The configuration unit 106 may configure a different screen image for each user terminal 2 to which the screen image is to be sent, or may configure the same screen image. For example, the configuration unit 106 may configure a screen image in which the user area of the user corresponding to the user terminal 2 that is the transmission destination of the screen image is made smaller than the other user areas. Further, for example, the configuration unit 106 selects the user area of the user corresponding to the user terminal from which the information receiving unit 100 received the voice, other than the user corresponding to the user terminal 2 to which the screen image is transmitted, from other user areas. A screen image that is also enlarged may be constructed.

The configuration unit 106 configures a screen image corresponding to the vital information acquired by the information acquisition unit 102 . The screen image corresponding to vital information may be, for example, a screen image in which vital information is arranged. For example, the configuration unit 106 configures a screen image in which one or more pieces of vital information acquired by the information acquisition unit 102 are arranged in a user area including the image from which each vital information is acquired. Further, the configuration unit 106 configures a screen image in which graphs, marks, and symbols corresponding to one or more pieces of vital information acquired by the information acquisition unit 102 are arranged in the user area including the image in which each vital information is acquired. You may

For example, the configuration unit 106 configures a screen image in which the vital information acquired by the information acquisition unit 102 is in a mode corresponding to the image from which the vital information is acquired. This screen image may also be considered as a screen image corresponding to vital information. The screen image in which the vital information is in a form corresponding to the image from which the vital information is acquired may be, for example, a screen image in which the vital information acquired by the information acquiring unit 102 is embedded. The screen image may be a screen image in which the vital information acquired by 102 is arranged at a predetermined position (for example, the lower part or the upper part of the user area) in the user area including the image from which the vital information is acquired. In addition, a screen image in which the vital information is in a mode corresponding to the image from which the vital information is acquired is, for example, the vital information acquired by the information acquisition unit 102 and the user area including the image from which the vital information is acquired. Even if it is a screen image placed in a position overlapping the user's person area (preferably a person's face or forehead area) or a position adjacent to the person area (for example, next to the face, above the head, etc.) good. For example, the user's person area, face, head, etc. can be realized by image recognition processing.

The configuration unit 106 is, for example, a screen image including two or more user areas including the image received by the information receiving unit 100, and the user area including an image obtained by the information obtaining unit 102 with vital information satisfying the condition of interest. constitutes a screen image that is visually distinguishable from other user areas. The visually distinguishable screen information may be, for example, a screen image in which the frame of the user area including the image from which the vital information satisfying the attention condition is acquired is highlighted. A screen image in which a user area including an image from which information is acquired is displayed larger than other user areas may be used. Note that the embodiment is not limited to the above, as long as the user area including the image from which the vital information that satisfies the condition of interest is acquired can be visually distinguished. The condition of interest here is, for example, the condition of interest stored in the condition-of-interest storage unit 104 .

A screen image is, for example, an image displayed on the screen of the user terminal 2 . The screen images are, for example, time-series images such as moving images. However, the screen image may be one or more still images. Note that the screen image may be, for example, information that enables the above-described image to be displayed on the screen of the user terminal 2 as a result. For example, the screen image includes images arranged in one or more user areas of the screen (for example, moving images received by the information receiving unit 100 from each user terminal 2) and data described in HTML or the like indicating the structure of the screen. , or information obtained by adding data indicating a layout or style such as a CSS file to these. Further, each user terminal 2 may have at least part of the data indicating the structure of the screen and the data indicating the layout and style. The screen image may be, for example, information having vital information displayed on the screen as described above, and may further have information designating the position where this vital information is arranged. In addition, the screen image may have information specifying the display mode of the user area in which the vital information satisfying the condition of interest is arranged to be different from the other display modes, and the information specifying the display mode may be included in the screen image. may have.

The information transmission unit 107 transmits the screen image configured by the configuration unit 106 to two or more user terminals 2 . Further, the information transmitting section 107 may transmit the audio received by the information receiving section 100 to two or more user terminals 2 in association with the screen image.

The information transmission unit 107 transmits information corresponding to the vital information acquired by the information acquisition unit 102 to one or more of the two or more user terminals 2 during the web conference. The information transmitting unit 107 may transmit the vital information acquired by the information acquiring unit 102 as the information corresponding to the vital information, and the information corresponding to the vital information in the screen image configured by the configuration unit 106 is arranged. You may send the screen image that has been displayed.

The information transmitting unit 107 may transmit the vital information acquired by the information acquiring unit 102 in a manner corresponding to the image from which the vital information is acquired. For example, the vital information may be embedded in the image from which the vital information is acquired and transmitted. A screen image arranged at a predetermined position within the user area including the original image to be acquired may be transmitted.

The information transmission unit 107 transmits information corresponding to the vital information acquired by the information acquisition unit 102 to one or more predetermined user terminals 2, for example. For example, the information transmitting unit 107 transmits information corresponding to vital information only to one or more user terminals 2 other than the user terminal 2 that transmitted the image from which the vital information was obtained. The other user terminal 2 in this case may be a predetermined user terminal 2 . The predetermined user terminals are, for example, user terminals used by medical personnel such as doctors and nurses, and user terminals used by administrators who manage the health of employees and the like in companies.

The information transmission unit 107 may transmit only information corresponding to vital information determined by the determination unit 105 to match the output condition. For example, the information transmitting unit 107 may determine whether the vital information received by the information receiving unit 100 from a plurality of user terminals 2 meets the output condition, and may transmit only information corresponding to the vital information satisfying the output condition. good. Further, for example, the information transmitting unit 107 determines whether the different types of vital information acquired by the information acquiring unit 102 for one user terminal meet the vital conditions corresponding to the respective types, and the type of vital signs satisfying the vital conditions. Only information corresponding to information may be transmitted.

The accumulation unit 108 accumulates the time-series vital information acquired by the information acquisition unit 102 in the vital information storage unit 109 . For example, the accumulation unit 108 accumulates time-series vital information acquired from each time-series image received from each of the two or more user terminals 2 by the information acquisition unit 102 in association with each of the two or more user terminals 2. . For example, the storage unit 108 may store time-series vital information acquired from each time-series image in association with each time-series image received by the information reception unit 100 .

The storage unit 108 may store the time-series vital information acquired by the information acquisition unit 102 in association with the time-series images from which the vital information is acquired.

The vital information storage unit 109 stores time-series vital information. For example, time-series vital information obtained from each time-series image received from one or more user terminals 2 is stored in association with the corresponding one or more user terminals 2 . Further, for example, time-series vital information acquired from each time-series image may be stored in association with each time-series image received by the information receiving unit 100 from one or more user terminals 2. .

One or more pieces of proposal information are stored in the proposal storage unit 110 . Proposal information is information having insurance conditions and insurance information.

Insurance information is information about insurance. The insurance here is, for example, insurance related to one or more types of vital information acquired by the information acquisition unit 102 . The information related to the vital information includes, for example, hospitalization insurance, outpatient insurance, life insurance, etc., which are proposed in relation to the health condition of the user indicated by the vital information. Also, information related to vital information may be, for example, insurance against a specific disease that can be detected by one or more types of abnormality in vital information (for example, cancer insurance, etc.). The insurance information is, for example, information indicating the insurance proposed to the user (for example, insurance name, insurance identifier, etc.) and information indicating the compensation content of the insurance. Also, the insurance information may be information such as an application form for taking out insurance, or information indicating a website for making an application. The information indicating the website is, for example, the name of the website, the URL of the website, etc.) The insurance information indicates the information indicating the company that provides insurance, and the website for introducing the company and insurance. It may be information.

The insurance conditions are conditions related to the user's vital information used for determining whether to transmit the corresponding insurance to the user terminal 2 . The insurance condition is, for example, a threshold for vital information represented by a numerical value. The insurance conditions are, for example, a condition that the heart rate is equal to or higher than a threshold, a condition that the respiration rate is equal to or higher than the threshold, or a condition that a stress index value indicated by LF/HF is equal to or higher than the threshold. The vital information storage unit 109 may store different insurance conditions for each type of vital information. The vital information storage unit 109 may store, for example, insurance conditions for one or more different vital information in association with vital identifiers. The insurance conditions may be a combination of conditions (for example, AND conditions, OR conditions, etc.) for multiple types of vital information.

In the present embodiment, a case where the server 1 has the proposal storage unit 110 will be described. may have.

In addition, the same condition as the output condition or the target condition may be used as the insurance condition. Insurance terms may be used.

The insurance information acquisition unit 111 refers to the proposal storage unit 110 , determines insurance conditions satisfied by the vital information acquired by the information acquisition unit 102 , and acquires insurance information paired with the insurance conditions from the proposal storage unit 110 .

The insurance information transmission unit 112 transmits the insurance information acquired by the insurance information acquisition unit 111 to the user terminal 2 that transmitted the image from which the vital information was acquired.

The insurance information transmission unit 112 is normally realized by wireless or wired communication means. Insurance information transmission unit 112 may or may not include a communication device.

The user terminal 2 is a device used by a user. The user terminal 2 can be realized by a computer, a multifunctional mobile phone such as a so-called smart phone, a tablet terminal, or the like. Also, the user terminal 2 may be a terminal device or the like dedicated to a web conference.

The user terminal 2 includes, for example, a camera (not shown) capable of photographing the user, a terminal transmission unit (not shown) for transmitting an image photographed by the camera to the server 1, and a screen image transmitted from the server 1. A terminal receiving unit (not shown) for receiving, a terminal display unit (not shown) for displaying an image such as a screen image received by the terminal receiving unit, and a terminal receiving unit (not shown) for accepting an operation from a user and a processing unit (not shown) that executes processing according to the received operation (for example, processing for starting or ending a web conference, processing for setting a web conference, etc.). The terminal display unit may have a display device (not shown) such as a monitor. The user terminal 2 may further include a microphone (not shown) capable of acquiring the user's voice, and the terminal transmission section may transmit the voice acquired by the microphone to the server 1 . In addition, the terminal reception unit further receives the audio transmitted from the server 1, and the user terminal 2 has an audio output unit (not shown) for outputting the audio received by the terminal reception unit. good too. The audio output section may have an audio output device (not shown) such as a speaker.

Next, an example of the operation of the server 1 of the web conference system 1000 will be described using the flowchart of FIG.

(Step S101) The server 1 determines whether to start a web conference. For example, when the scheduled time comes, the processing unit (not shown) of the server 1 or the like may decide to start. Also, when the information receiving unit 100 or the like receives an instruction to start a web conference from one or more user terminals 2, the web conference may be started. If it is determined to start the web conference, start the web conference and proceed to step S102; otherwise, return to step S101.

(Step S102) The information receiving unit 100 starts receiving images from each user terminal 2 participating in the web conference. Then, the information receiving unit 100 receives images transmitted from each user terminal 2, for example. The images to be received are, for example, time-series images such as moving images. Receipt of images from a plurality of user terminals 2 may be performed, for example, by parallel processing or by time division, and how the images are received is not limited to these. The information receiving section 100 may also receive voice. The information receiving unit 100 receives, for example, an image associated with the terminal identifier.

(Step S103) The information acquisition unit 102 determines whether it is time to acquire vital information from each image received in step S102. For example, it may be determined that it is time to acquire vital information every time a certain period of time has elapsed after the start of image reception. Also, a predetermined time or a randomly determined time may be determined as the time to acquire vital information. It doesn't matter how you decide when to get it. In addition, the length of the acquisition period is not a concern. If it is the acquisition time, the process proceeds to step S104, and if it is not the acquisition time, the process proceeds to step S115.

(Step S104) The information acquisition unit 102 substitutes 1 for the value of the counter n.

(Step S105) The information acquisition unit 102 determines whether or not there is a user terminal 2 from which the n-th vital information is to be acquired among the user terminals 2 participating in the web conference. The user terminal 2 from which vital information is to be obtained is a user terminal that transmits an image from which vital information is to be obtained. The user terminal 2 to be acquired is detected using specific information stored in the specific information storage unit 101, for example. If there is, the process proceeds to step S106; otherwise, the process proceeds to step S115.

(Step S106) The information acquisition unit 103 acquires one or more types of predetermined vital information from the user's person area included in the image received from the n-th user terminal 2 in step S102. The information acquisition unit 103 acquires vital information from time-series images, for example.

(Step S<b>107 ) The accumulation unit 108 accumulates the vital information acquired in step S<b>106 in the vital information storage unit 109 . For example, the information may be stored in chronological order of acquisition, or may be stored in association with the time of acquisition. For example, the storage unit 108 may store the acquired vital information by associating the image received in step S102 with the transmitted user terminal 2 . Further, the storage unit 108 may store, for example, the different types of acquired vital information in association with a type identifier or the like indicating the type of vital information. Further, the storage unit 108 may store the time-series vital information acquired in step S106 in association with each time-series image received by the information reception unit 100 . For example, among the received time-series images, the images within the period used to acquire the vital information may be stored in association with the acquired vital information. In addition, while accumulating the received time-series images, the information specifying the part of the image used to acquire the vital information in step S106 (for example, the start time and end time of the time code) is used as the vital information. They may be associated and stored.

(Step S108) The determination unit 105 determines whether the vital information acquired in step S106 meets the output conditions. For example, when the acquired vital information is a plurality of different types of vital information, the determination unit 105 may determine whether the corresponding output condition is satisfied for each type. If they match, the process proceeds to step S109, and if they do not match, the process proceeds to step S110. The case of matching may be considered to be, for example, the case in which there is one or more matching vital information, and the case of non-matching may be considered to be the case in which there is no matching vital information.

(Step S109) The determination unit 105 determines to transmit information corresponding to vital information that matches the output condition. For example, the vital information that matches the output conditions acquired in step S106 and the terminal identifier of the n-th user terminal 2 are associated and stored in a storage unit (not shown) or the like. It should be noted that information indicating the type of matching vital information may be further associated and accumulated.

(Step S110) The configuration unit 106 determines whether the vital information acquired in step S106 matches the condition of interest. If they match, the process proceeds to step S111, and if they do not match, the process proceeds to step S112.

(Step S111) The configuration unit 106 determines to configure a screen image in which the user area including the image from which the vital information is acquired can be visually distinguished from other user areas. The configuration unit 106 stores, for example, terminal identifiers of user terminals 2 corresponding to visually distinguishable user areas in a storage unit (not shown) or the like.

(Step S<b>112 ) The insurance information acquisition unit 111 determines whether the vital information acquired in step S<b>106 matches the insurance conditions stored in the proposal storage unit 110 . For example, it is determined whether the plurality of types of vital information acquired in step S104 meet the insurance conditions corresponding to each type. If the insurance conditions are met, the process proceeds to step S113; otherwise, the process proceeds to step S114. The case where the insurance conditions are met may be considered, for example, when there is one or more types of vital information that match the insurance information. You can think of it.

(Step S113) The insurance information acquisition unit 111 determines to transmit the insurance information corresponding to the insurance conditions that match the vital information. For example, a set of insurance information corresponding to insurance conditions that match the vital information and the terminal identifier of the n-th user terminal 2 is associated and stored in a storage unit (not shown) or the like. For example, the insurance information acquisition unit 111 acquires insurance information corresponding to insurance conditions that match the vital information from the proposal storage unit 110, associates the acquired insurance information with the terminal identifier of the n-th user terminal 2, and stores the information in the storage unit. (not shown) or the like. The insurance information corresponding to the insurance conditions matching the vital information is, for example, insurance information included in the same proposal information as the insurance information matching the vital information. In addition, if information that associates the same insurance information with the user terminal 2 is already stored in a storage unit (not shown), it is not necessary to newly store information that associates the insurance information with the user terminal 2. Also, it is not necessary to acquire new insurance information.

(Step S114) The information acquisition unit 102 increments the value of the counter n by one. Then, the process returns to step S105.

(Step S115) The server 1 constructs a screen image using the image received in step S102. Then, the configured screen image is transmitted to two or more user terminals 2 . In addition, for example, the voice received when receiving the image is also transmitted. Details of the processing in step S115 will be described later. Then, the process proceeds to step S116.

(Step S116) The server 1 determines whether to end the web conference. For example, when the information receiving unit 100 receives an instruction to end the web conference from one or more user terminals 2, the server 1 determines to end the web conference. Alternatively, it may be determined to end the web conference at a predetermined time or the like. When it ends, it progresses to step S117, and when it does not end, it returns to step S103.

(Step S117) The server 1 ends the web conference. Also, image reception and the like are terminated.

(Step S118) The insurance information acquisition unit 111 determines whether there is a user terminal 2 to which the insurance information is to be sent. For example, the insurance information acquisition unit 111 determines whether one or more pairs of the insurance information and the user terminal associated and accumulated in step S113 are stored in a storage unit (not shown), and if so, , it is determined that there is a user terminal 2 to which the insurance information is to be sent, and the process proceeds to step S119. If not stored, it is determined that there is no user terminal 2 to which the insurance information is to be sent, and the process returns to step S101. .

(Step S119) The insurance information acquisition unit 111 acquires the insurance information accumulated in association with the user terminal 2 in step S113. The acquisition here may be performed by reading from a storage unit (not shown) such as a memory in which the insurance information is stored in association with the terminal identifier.

(Step S120) The insurance information transmission unit 112 transmits each insurance information acquired in step S119 to the user terminal 2 associated with each insurance information in step S113. Then, the process returns to step S101.

In the flowchart of FIG. 2, the case where the insurance information is transmitted immediately after the end of the web conference has been described, but the timing of transmitting the insurance information does not have to be immediately after the end of the web conference. It may be transmitted, or may be transmitted at any time after the end of the web conference.

Note that in the flowchart of FIG. 2, the process ends when the power is turned off or when the process ends.

Next, an example of processing in which the server 1 composes a screen image and transmits it to two or more user terminals 2 will be described with reference to the flowchart of FIG. Note that this process corresponds to an example of the process of step S115 in FIG.

(Step S201) The configuration unit 106 configures a screen image by arranging a plurality of user areas including the images respectively received from the plurality of user terminals 2 in step S102. For example, the configuration unit 106 configures a screen image by arranging a plurality of user areas each containing a moving image received from a plurality of user terminals 2 and synchronized by a time code or the like included in the moving image. do. For example, a screen image is configured by arranging a plurality of user areas in tiles.

(Step S202) The information transmission unit 107 transmits the screen image configured in step S201 to user terminals 2 other than the user terminals 2 predetermined as transmission destinations of the information corresponding to the vital information. For example, the information transmission unit 107 uses the specific information stored in the specific information storage unit 101 to determine a user terminal 2 other than the predetermined user terminal 2 as a transmission destination of information corresponding to vital information.

(Step S203) The configuration unit 106 determines whether or not there is vital information determined to transmit information corresponding to the vital information in step S109. If so, go to step S204; if not, go to step S205.

(Step S204) The configuration unit 106 associates the screen image configured in step S201 with each terminal identifier in the user area corresponding to the terminal identifier that the configuration unit 106 accumulated in step S109 in association with the output condition. One or more pieces of vital information that match the output conditions stored with attachments are respectively arranged. For example, the vital information is arranged in a manner corresponding to the images included in each user area.

(Step S205) The configuration unit 106 determines whether or not there is a user area determined to be output in a visually distinguishable manner in step S111. If there is, proceed to step S206; otherwise, proceed to step S207.

(Step S206) The configuration unit 106 uses the terminal identifier of the user terminal 2 corresponding to the user area acquired in step S111 and determined to be output in a visually distinguishable manner, using the screen image configured in step S201, or In step S204, the screen image on which the vital information is arranged is changed so that the user area corresponding to this terminal identifier can be visually distinguished.

(Step S207) The information transmission unit 107 uses the specific information stored in the specific information storage unit 101 to display the screen image configured in step S201, which has undergone processing according to the determinations in steps S204 and S206. A screen image (for example, a screen image in which vital information is arranged, a user area is changed according to the judgment result, a screen image in which a change is desired, etc.) is sent to the destination of the information corresponding to the vital information. is transmitted to a predetermined user terminal 2. Then, it returns to the upper processing.

Next, operation of the user terminal 2 will be briefly described. The terminal transmission unit transmits to the server 1 the image captured by the camera of the user terminal 2 and the sound acquired by the microphone. In addition, the terminal reception unit of the user terminal 2 receives the screen image and sound transmitted from the server 1, the terminal display unit displays the received screen image on a monitor or the like, and the received sound is output to the speaker or the sound output unit. Output from an audio output device such as headphones.

A specific operation of the web conference system 1000 according to this embodiment will be described below with an example.

FIG. 4 is a schematic diagram showing a specific example of the web conference system 1000. As shown in FIG. Here, an example in which all of the user terminals 2 are computers will be described. Also, here, the four user terminals 2 are represented as user terminals 2a to 2d. However, the user terminals 2a to 2d may be referred to as user terminals 2 without distinguishing between them.

Here, it is assumed that the server 1 has started the web conference, and four users are participating in the web conference using the user terminals 2, respectively. One of the four users is an industrial physician who manages the health of employees in a company, and the other three are employees working in the company. In order to manage the user terminals 2 participating in the web conference, for example, terminal identifiers corresponding to the participating user terminals 2a to 2d, the conference name of the web conference, the code assigned to the web conference, etc. Identifiers are associated with each other and stored in a storage unit such as a memory (not shown).

FIG. 5 is a specific information management table for managing specific information stored in the specific information storage unit 101. As shown in FIG. The specific information management table has attributes of "terminal ID" and "specified". “Terminal ID” is a terminal identifier of the user terminal 2. Here, it is assumed that the user terminals 2 corresponding to the four terminal identifiers from “U001” to “U004” are participating in the web conference. do. “Specification” is information specifying whether or not the user using the user terminal 2 is a user for whom vital information is to be obtained, and whether or not the user is a transmission destination of information corresponding to the vital information. The value "1" indicates that the user is the target of acquisition of vital information, and the value "2" indicates that the user is the destination of information corresponding to the vital information. , the value "0" indicates that the user is neither of these. Assume that the terminal identifier of the user terminal 2a is "U001", the terminal identifier of the user terminal 2b is "U002", the terminal identifier of the user terminal 2c is "U003", and the terminal identifier of the user terminal 2d is "U004".

FIG. 6A is an output condition management table for managing the output conditions stored in the output condition storage unit 103. FIG. The output condition management table has attributes of "output vital ID" and "output condition". The “output vital ID” is an identifier indicating the type of vital information to be output when the corresponding output condition is satisfied, and is assumed here to be the type name. "Output condition" is an output condition for outputting the corresponding vital information. It is assumed that the output conditions such as X ₁ -X ₃ are predetermined values. This is the same for X4 of the condition of _interest , _X5 of the insurance condition, and the like.

FIG. 6B is a condition-of-interest management table for managing the conditions of interest stored in the condition-of-interest storage unit 104 . In the viewing condition management table, the attribute “viewing condition” indicates the viewing condition.

7A is a proposal information management table for managing proposal information stored in the proposal storage unit 110. FIG. In the proposal management table, the attribute "insurance information" is insurance information, and here indicates the file name of the insurance information. The attribute “insurance conditions” indicates insurance conditions.

In FIGS. 6A, 6B, and 7, the output condition, the condition of interest, and the insurance condition are expressed in natural language. It may be composed of one or more functions corresponding to the language, method names, control syntax indicated by "if", "then", and the like. Further, these conditions may be algorithms for performing judgment processing and the like corresponding to these natural languages.

When the web conference is started, the four user terminals 2a to 2d provide the server 1 with moving images, which are time-series images taken by each user, and voices acquired by each user terminal, in association with the terminal identifiers of the own terminals. Send sequentially.

Here, for example, assume that the information acquisition unit 102 determines that it is time to acquire vital information. For example, the information acquisition unit 102 performs a process of acquiring vital information every time a certain period of time has elapsed since the start of image reception, and a predetermined amount of time has elapsed since the previous acquisition of vital information. Suppose

First, the information acquisition unit 102 uses the specific information management table shown in FIG. To detect. For example, the information acquisition unit 102 determines that the value of "terminal ID" in the specific information management table shown in FIG. In the record (row) that is either, detect the record whose "specified" value is "1", which indicates that the vital information is to be acquired, and the "terminal ID" value of the detected record A certain terminal identifier is acquired as the terminal identifier of the user terminal 2 from which vital information is to be acquired. Here, it is assumed that terminal identifiers "U003" and "U004" are acquired.

By preventing vital information from being acquired from the image transmitted by the user terminal 2 whose corresponding “designation” value is “0”, for example, among users other than the transmission destination of the information corresponding to the vital information However, predetermined users can be excluded from acquisition targets of vital information. As a result, for example, it is possible to set whether or not to acquire vital information while respecting the user's intention, and to selectively acquire vital information from a user who needs to observe the user's condition. .

Next, the information acquisition unit 102 extracts the first terminal identifier “U003” from among the acquired terminal identifiers, and acquires vital information from the image transmitted in association with the terminal identifier “U003”. For example, the vital information is acquired from the images that have been transmitted until a certain period of time elapses from the time when the vital information is acquired. Note that the order of extracting terminal identifiers from the obtained terminal identifiers may be assigned in any order.

For example, the information acquisition unit 102 acquires the pulse rate, the heart rate, and the LF/HF value as predetermined vital information. For example, in a moving image of a predetermined length received by the information receiving unit 100, a person area in which the user is photographed is detected, and the above three types of vital information are obtained from this person area. For example, assume that the acquired pulse rate is x ₁₁₀ , the heart rate is x ₂₁₀ , and the LF/HF value is x ₃₁₀ . It is also assumed that the time at which these values are acquired is _t6 . It is assumed that x ₁₁₀ , x ₂₁₀ , x ₃₁₀ , t ₆ and the like are each specific values.

The storage unit 108 associates each piece of vital information acquired by the information acquisition unit 102 with the type name of each piece of vital information, the terminal identifier “U003”, and the acquisition time, and stores them in the vital information storage unit 109 . Further, here, a file "0035.mp4" obtained by clipping an image (here, a part of a moving image) used when obtaining vital information is associated with the vital information, and stored in the vital information storage unit 109. accumulate in

FIG. 8 is a vital information management table for managing vital information accumulated in the vital information storage unit 109. As shown in FIG. The vital information storage unit 109 has attributes of "time", "terminal ID", "pulse rate", "heart rate", "LF/HF", and "image". “Time” is the time when vital information is acquired, and t ₁ , t ₂ , etc. are different specific times. "Terminal ID" is a terminal identifier. The “pulse rate” is the pulse rate, the “heart rate” is the heart rate, and the “LF/HF” is the LF/HF value. “Image” is the file name of the image file from which vital information is acquired. This image is, for example, a moving image file of a predetermined length used to acquire vital information.

Next, the determination unit 105 determines whether the vital information obtained by the information acquisition unit 102 for the first terminal identifier “U003” matches the output condition. Specifically, the determination unit 105 determines the output indicated by the “output condition” of each record (row) of the output condition management table that manages the output conditions stored in the output condition storage unit 103 shown in FIG. Determine whether the vital information obtained above matches the conditions. If they match, it decides to transmit the information corresponding to the type of vital information indicated by the "output vital ID" of the same record.

First, the determination unit 105 determines that the value of the “output condition” in the _first record (row) from the top of the output condition management table shown in FIG. ”, and determines whether the vital information obtained above matches this output condition, specifically, whether the pulse rate x ₁₁₀ , which is one of the vital information obtained above, is X ₁ or more times. . Here, if x ₁₁₀ is a value equal to or greater than X ₁ , the determining unit 105 determines that this output condition is met, and sends information corresponding to the pulse rate x ₁₁₀ , which is the acquired vital information. decide.

Also, read out the value of "output condition" in the _second record (row) from the top of the output condition management table shown in FIG. It is determined whether the respiratory rate x ₂₁₀ , which is one of the vital information acquired in step 1, is X ₂ times or more. Here, it is determined not to transmit the information corresponding to this respiratory rate x ₂₁₀ because it is not x ₂ times or more.

Also, read out the value of "output condition" in the _third record (row) from the top of the output condition management table shown in FIG. It is determined whether the LF/HF value x ₃₁₀ , which is one of the obtained vital information, is X ₃ times or more. Here, since x is ₃ times or more, it is determined to transmit information corresponding to this respiratory rate x ₃₁₀ .

Then, the pulse rate x ₁₀₁ and the LF/HF value x ₃₀₁ , which are vital information determined to transmit the corresponding information, are associated with the terminal identifier "U003", and stored in a storage unit such as a memory (not shown). etc.).

Next, the configuration unit 106 determines whether the vital information acquired by the information acquisition unit 102 matches the condition of interest stored in the condition-of-interest storage unit 104 . Specifically, the configuration unit 106 _sets the condition of interest managed by the condition of interest management table shown in FIG. "Yes" is read out, and it is determined whether or not the vital information obtained above matches the condition of interest. For example, the configuration unit 106 first determines whether the respiratory rate x ₂₁₀ in the vital information acquired above is 24 times or more, and if it is 24 times or more, it determines that the conditions are met. Here, it is assumed that this condition is not met because it is not 24 times or more. In this case, it is further determined whether the LF/HF value x ₃₁₀ in the vital information obtained above is X ₄ or more, and if X ₄ or more, it is determined that this condition is met. Here, if it is X ₄ or more, the condition that the value of LF/HF is X ₄ or more is met, so the configuration unit 106 determines that the acquired vital information meets the condition of interest. Therefore, the configuration unit 106 determines to configure a screen image that allows the user area including the image received from the user terminal 2 identified by the terminal identifier “U003” to be visually distinguishable from other user areas. do. Then, the terminal identifier "U003" is temporarily stored in a storage unit (not shown) such as a memory as a terminal identifier that makes the corresponding user area a visually distinguishable user area.

Next, the insurance information acquisition unit 111 determines whether the vital information acquired by the information acquisition unit 102 matches the insurance conditions of each piece of proposal information stored in the proposal storage unit 110 . Then, the insurance information of the proposal information having matching insurance conditions is determined as the insurance information to be transmitted to the user terminal 2 corresponding to the acquired vital information.

For example, the insurance information acquisition unit 111 first obtains the "value of LF/HF" which is the "insurance conditions" of the proposal information in the first record (row) from the top of the proposal information management table shown in FIG. is X ₅ or more”, and determine whether the vital information obtained above matches the insurance conditions obtained. Here, assuming that the value x ₃₁₀ of LF/HF of the vital information acquired above is X ₅ or more, the insurance condition is satisfied, so the insurance information acquisition unit 111 proposes the record in the first row from the top. The insurance information whose file name is "F001.htm" indicated by the "insurance information" value of the information is determined as the insurance information to be transmitted to the user terminal 2 identified by the terminal identifier "U003". Then, the insurance information file name "F001.htm" is associated with the terminal identifier "U003" as insurance transmission management information for managing the transmission of the insurance information. ). If insurance transmission management information having the same set of insurance information file name and terminal identifier is already stored, there is no need to store new insurance transmission management information. The transmission management information may be overwritten with new insurance transmission management information.

FIG. 7B is a diagram showing insurance transmission management information stored in a storage unit (not shown). The insurance transmission management information has attributes of "insurance information", which is the file name of the insurance information, and "terminal ID", which is the terminal identifier. Here, information having the insurance information "F002.htm" and the terminal ID "U004" has already been accumulated, and the above insurance information and the like are newly accumulated.

Similarly, the information acquisition unit 102 sequentially acquires vital information for images transmitted from the second and subsequent user terminals 2 among the user terminals 2 for which vital information is to be acquired, and The determination unit 105, the configuration unit 106, the insurance information acquisition unit 111, and the like determine whether the sequentially acquired vital information matches the output conditions, the conditions of interest, and the insurance information. etc. are processed. Here, the vital information obtained from the image with the terminal identifier "U004" is processed in the same manner as described above, and as a result, none of the output condition, the attention condition, and the insurance condition is satisfied. do.

Then, after performing the process of acquiring the vital information and the like for the image transmitted from the user terminal 2, which is the acquisition target of the vital information, the configuration unit 106 determines the output conditions determined by the determination unit 105, the configuration unit 106 A screen image having a user area including the image received by the information receiving unit 100 is constructed according to the determination result of the condition of interest.

FIGS. 9A to 9D and 10A to 10C are diagrams showing examples of screen images for explaining screen images configured by the configuration unit 106. FIG.

For example, the information receiving unit 100, at the same timing, from the user terminals 2 whose terminal identifiers are "U001" to "U004" participating in the same web conference, When such images 71-74 are received, the configuration unit 106 generates a screen image 1005 as shown in FIG. Configure. Note that the sizes and resolutions of the images 71 to 74 and the screen image 1005 do not matter. For example, all of them may be the same, or at least some of them may be different.

Then, the information transmitting unit 107 selects the terminal identifiers associated with each of the four user terminals 2 that have transmitted the images having the terminal identifiers "U001" to "U004" according to the specific information management table shown in FIG. The screen image configured above is transmitted to the user terminal 2 other than the user terminal 2 whose value of "specified" is the value "2" indicating the transmission destination of the vital information. Here, since only the value of "specified" corresponding to the terminal identifier "U001" is "2", the information transmitting unit 107 detects the terminal identifier "U001" except the user terminal 2a whose terminal identifier is "U001" The screen image 1005 acquired above is transmitted to the user terminals 2b to 2d of "U002" to "U004". In addition, the voice received as described above is also transmitted in association with the image 1005 .

For example, when the user terminal 2b whose terminal identifier is "U002" receives this screen image 1005 and voice through a terminal reception unit (not shown), the terminal display unit (not shown) displays this screen image 1005 to the user terminal. 2 is displayed on the monitor. Also, an audio output unit (not shown) outputs the received audio.

FIG. 11(a) is a diagram showing a display example of a screen image 1005 by the user terminal 2b. The user terminals 2c and 2d also display a similar screen image 1005. FIG.

Further, here, the vital information acquired from the image received by the user terminal 2c whose terminal identifier is "U003" matches one or more output conditions as described above, and the pulse rate x ₁₁₀ which is the vital information , and the LF/HF value x ₃₁₀ are associated with the terminal identifier "U003" and are temporarily stored in a storage unit (not shown) such as a memory. is displayed in the user area 1003 corresponding to the terminal identifier " _U003 " in the screen image 1005 constructed above as shown in FIG. x ₃₁₀ and . Here, as a mode corresponding to the image from which the vital information is acquired, the read vital information is arranged next to the person area in the image in the user area. If vital information that meets the output conditions cannot be acquired from the image transmitted by the user terminal 2c whose terminal identifier is "U003", the above vital information is not arranged in the user area 1003. FIG.

Further, here, the vital information acquired from the image received by the user terminal 2 with the terminal identifier "U003" matches the condition of interest as described above, and the terminal identifier "U003" is set to the corresponding user area. is temporarily stored in a storage unit (not shown) such as a memory as a terminal identifier that is a visually distinguishable user area, so the configuration unit 106 reads this terminal identifier and configures it as described above. The user area 1003 corresponding to the terminal identifier "U003" in the screen image 1005 as shown in FIG. 10B is changed so as to be visually distinguishable from other user areas. As shown in FIG. 10C, here, the screen image 1005 is changed to a screen image 1005 in which the user area 1003 is highlighted (for example, a frame line of a highlight color is arranged) and a frame 50 is arranged. Note that if vital information that matches the condition of interest cannot be acquired from the image transmitted by the user terminal 2c whose terminal identifier is "U003", the user area 1003 is visually distinguishable as described above. Not changed.

Then, the screen image 1005a configured as described above and the voice as shown in FIG. 10C are associated with the terminal identifier according to the specific information management table shown in FIG. is transmitted to the user terminal 2a whose terminal identifier is "U001".

When the terminal reception unit (not shown) of this user terminal 2a receives the screen image 1005a and voice as shown in FIG. 10(c), the terminal display unit (not shown) monitors the received screen image 1005a. to display. Also, an audio output unit (not shown) outputs the received audio.

FIG. 11(b) is a diagram showing a display example of a screen image 1005a by the user terminal 2a whose terminal identifier is "U001".

As shown in FIG. 11(b), in the screen image displayed on the predetermined user terminal 2a, the user area of the user of the other user terminal 2 is visually identifiably shown according to the vital information. Therefore, for example, the user of the user terminal 2a can take appropriate action according to the status of other users in the web conference. For example, it becomes possible to pay attention to a user who is in poor physical condition.

Further, when a lecture or the like is given using the web conference system 1000, a lecturer using a predetermined user terminal 2a refers to the visually identifiable displayed user area and, for example, states It is possible to avoid appointing unfavorable users as much as possible.

As for the images received by the information receiving unit 100 at times other than when vital information is acquired or during acquisition of vital information, the configuration unit 106 arranges the images transmitted by each user terminal 2 in a tiled manner in the same manner as described above. A screen image is constructed, and the information transmission unit 107 transmits this screen image to the user terminals 2b to 2d whose terminal identifiers are "U002" to "U004". In addition, as the screen image to be transmitted to the user terminal 2a whose terminal identifier is "U001", if the vital information most recently acquired from the image transmitted by one user terminal 2 matches the output condition, The configuration unit 106 transmits, to the user terminal 2a, a screen image in which the images transmitted by the user terminals 2 configured in the same manner as described above are arranged in tiles, and in which the vital information is arranged in the user area including this image. If the vital information most recently acquired from the image transmitted by one user terminal 2 matches the condition of interest, the configuration unit 106 generates an image transmitted by each user terminal 2 configured in the same manner as described above. are arranged in tiles, and the screen image in which the user area including this image is visually identifiable is transmitted to the user terminal 2a. In addition, when the vital information most recently acquired from the image transmitted by one user terminal 2 does not match the output condition and the target condition, the same screen image as the screen image transmitted to the user terminals 2b-2d is displayed. to the user terminal 2a.

Here, if the server 1 terminates the web conference according to an instruction or the like transmitted from the user terminal 2a or the like, the insurance information acquisition unit 111 determines that the transmission destination of the insurance information acquired according to the vital information is determine if there is Specifically, it is determined whether the insurance transmission management information having the terminal identifier of the user terminal 2 to which the insurance information acquired according to the vital information is transmitted is stored in a storage unit (not shown). Here, as shown in FIG. 7(b), two pieces of insurance transmission management information are stored in the storage unit, so it is determined that there is a transmission destination of insurance information. For this reason, the insurance information acquisition unit 111 reads a set of the file name of the insurance information and the terminal identifier to be the transmission destination of the insurance information from the two pieces of insurance information management information shown in FIG. For each group, the insurance information indicated by the file name is acquired from the proposal storage unit 110 and transmitted to the corresponding terminal identifier.

For example, the insurance information acquisition unit 111 acquires the file name "F002.htm" which is the value of "insurance information" and the value "U003" of "terminal ID" from the first record from the top shown in FIG. is read from the proposal storage unit 110 and transmitted to the user terminal 2c whose terminal identifier is "U003".

When the terminal receiving unit (not shown) of the user terminal 2c whose terminal identifier is "U003" receives the insurance information file whose file name is "F002.htm", the terminal display unit (not shown) This insurance information is displayed on the monitor.

FIG. 12(a) is a diagram showing a display example of insurance information displayed by the user terminal 2b. Here, for example, information about cancer insurance shall be displayed on the monitor of the user terminal 2c.

Also, for example, the insurance information acquisition unit 111 acquires the file name "F001.htm", which is the value of "insurance information", and the value " U004", reads the insurance information file with the file name "F001.htm" from the proposal storage unit 110, and transmits it to the user terminal 2d with the terminal identifier "U004".

When the terminal receiving unit (not shown) of the user terminal 2c whose terminal identifier is "U004" receives the insurance information file whose file name is "F001.htm", the terminal display unit (not shown) This insurance information is displayed on the monitor.

FIG. 12(b) is a diagram showing a display example of insurance information displayed by the user terminal 2d. Here, for example, information about medical insurance shall be displayed on the monitor of the user terminal 2d.

As described above, according to the present embodiment, by transmitting the information corresponding to the vital information acquired from the image transmitted from the user terminal, it is possible to easily grasp the state of the user participating in the web conference. .

In each of the above embodiments, each process (each function) may be implemented by centralized processing by a single device (system), or may be implemented by distributed processing by a plurality of devices. may be

Further, in each of the above-described embodiments, two or more communication means (information transmission unit, insurance information transmission unit, etc.) existing in one device may be physically realized by one medium. .

Further, in each of the above embodiments, each component may be configured by dedicated hardware, or components that can be realized by software may be realized by executing a program. For example, each component can be realized by reading and executing a software program recorded in a recording medium such as a hard disk or a semiconductor memory by a program execution unit such as a CPU. During execution, the program execution unit may execute the program while accessing a storage unit (for example, a recording medium such as a hard disk or memory).

The software that implements the server in each of the above embodiments is the following program. In other words, this program is a server that performs a web conference between two or more user terminals, and information for receiving images transmitted from each of the two or more user terminals during the web conference. a receiving unit; and an information acquiring unit that acquires one or more user's vital information from the user's person region included in one or more of the two or more images received by the information receiving unit, in association with the image. A program for functioning as an information transmission unit that transmits information corresponding to vital information acquired by the information acquisition unit during a web conference to one or more user terminals out of two or more user terminals. be.

In the program, the functions realized by the program do not include functions that can be realized only by hardware. For example, functions that can be realized only by hardware such as modems and interface cards, such as an acquisition unit that acquires information and an output unit that outputs information, are not included in the functions realized by the above program.

Also, the number of computers executing this program may be singular or plural. That is, centralized processing may be performed, or distributed processing may be performed.

FIG. 13 is a schematic diagram showing an example of the appearance of a computer that implements the server according to the embodiment by executing the program. The above embodiments can be implemented by computer hardware and computer programs executed thereon.

In FIG. 13, computer system 900 comprises computer 901 including CD-ROM (Compact Disk Read Only Memory) drive 905 , keyboard 902 , mouse 903 and monitor 904 .

FIG. 14 is a diagram showing the internal configuration of the computer system 900. As shown in FIG. In FIG. 14, a computer 901 includes a CD-ROM drive 905, an MPU (Micro Processing Unit) 911, a ROM 912 for storing programs such as a boot-up program, and a ROM 912 for storing programs such as a boot-up program. A RAM (Random Access Memory) 913 that temporarily stores and provides a temporary storage space, a hard disk 914 that stores application programs, system programs, and data, a bus 915 that interconnects the MPU 911, ROM 912, etc. Prepare. Note that computer 901 may include a network card (not shown) that provides connection to a LAN.

A program that causes computer system 900 to execute the functions of the server or the like according to the above embodiments may be stored in CD-ROM 921 , inserted into CD-ROM drive 905 , and transferred to hard disk 914 . Alternatively, the program may be transmitted to computer 901 via a network (not shown) and stored in hard disk 914 . Programs are loaded into RAM 913 during execution. The program may be loaded directly from the CD-ROM 921 or network.

The program does not necessarily include an operating system (OS), a third party program, or the like that causes the computer 901 to perform the functions of the server according to the above embodiments. A program may contain only those portions of instructions that call the appropriate functions (modules) in a controlled manner to produce the desired result. How the computer system 900 operates is well known and will not be described in detail.

It goes without saying that the present invention is not limited to the above-described embodiments, and that various modifications are possible and are also included within the scope of the present invention.

As described above, the server or the like according to the present invention is suitable as a server or the like used in a web conference system.

1 server 2, 2a-2d user terminal 100 information receiving unit 101 specific information storage unit 102 information acquisition unit 103 output condition storage unit 104 target condition storage unit 105 determination unit 106 configuration unit 107 information transmission unit 108 accumulation unit 109 vital information storage unit 110 Proposal storage unit 111 Insurance information acquisition unit 112 Insurance information transmission unit 1000 Web conference system

Claims (10)

A server for conducting a web conference between two or more user terminals,
an information receiving unit that receives images transmitted from each of the two or more user terminals during the web conference;
an information acquisition unit that acquires one or more user's vital information in association with the image from the user's person region included in one or more images among the two or more images received by the information reception unit;
Information transmission for transmitting the vital information acquired by the information acquiring unit or a screen image on which the vital information is arranged during the web conference to one or more user terminals among the two or more user terminals. and
The information acquisition unit acquires the vital information from each time-series image received from one or more user terminals,
An accumulation unit for accumulating the vital information acquired by the information acquisition unit in association with the time-series images received by the information reception unit and within the period used to acquire the vital information. A server further comprising : The information acquisition unit is an image among the two or more images received by the information reception unit, and is an image of one or more users from a user's person region included only in an image transmitted from a predetermined user terminal. The server according to claim 1, which acquires the vital information. wherein the information transmission unit transmits the vital information or a screen image in which the vital information is arranged only to one or more other user terminals other than the user terminal that transmitted the image from which the vital information was obtained. 3. The server according to item 2. further comprising a judgment unit for judging whether the vital information acquired by the information acquisition unit matches an output condition,
4. The information transmission unit according to claim 2 or 3, wherein the determination unit transmits only the vital information determined to match the output condition, or only a screen image on which the vital information determined to match the output condition is arranged. server. The information acquisition unit acquires the vital information of one or more users from a person region of the user included in one or more images among the two or more images received by the information reception unit;
A screen image including two or more user areas including the image received by the information receiving section, wherein the user area including the image obtained by the information obtaining section is the other user area. further comprising a configuration unit that configures a screen image that is visually distinguishable from
The visually distinguishable screen image is a screen image in which a frame of a user area including an image from which the vital information satisfying the attention condition is acquired is highlighted, or a screen image from which the vital information satisfying the attention condition is acquired. is a screen image in which the user area including the image displayed is displayed larger than the other user areas,
5. The server according to any one of claims 1 to 4, wherein the information transmission unit transmits a screen image configured by the configuration unit. Determine insurance conditions satisfied by the vital information acquired by the information acquisition unit by referring to a proposal storage unit that stores one or more pieces of proposal information having insurance conditions using the vital information and insurance information related to proposed insurance. and an insurance information acquisition unit that acquires insurance information paired with the insurance conditions from the proposal storage unit;
An insurance information transmission unit that transmits the insurance information acquired by the insurance information acquisition unit to a user terminal that transmitted an image from which the vital information was acquired. The server according to paragraph 1. The information acquisition unit
Obtaining the vital information from each time-series image received from each of two or more user terminals,
The storage unit is
The server according to any one of claims 1 to 6, wherein the time-series vital information acquired by the information acquiring unit is stored in association with each of the two or more user terminals. 8. The vital information according to any one of claims 1 to 7, wherein the vital information is respiration, body temperature, blood pressure, level of consciousness, heart rate variability, sympathetic nerves, parasympathetic nerves, or LF (low frequency)/HF (high frequency). server. An information processing method performed using a server having an information receiving unit, an information acquiring unit, an information transmitting unit, and a storing unit, and performing a web conference between two or more user terminals,
an information receiving step in which the information receiving unit receives images transmitted from each of the two or more user terminals while the web conference is being held;
The information acquisition unit acquires one or more user's vital information from the user's person region included in one or more images among the two or more images received in the information receiving step, in association with the image. an information acquisition step;
The information transmission unit sends the vital information acquired in the information acquisition step or a screen image on which the vital information is arranged to one or more users of the two or more user terminals during the web conference. and an information transmission step for transmitting to the terminal ,
The information acquisition step acquires the vital information from each time-series image received from one or more specific user terminals;
A time-series image obtained by the accumulation unit in the information receiving step from the time-series vital information obtained in the information obtaining step, the image being a time-series image within a period used to obtain the vital information. The information processing method further comprising an accumulation step of accumulating in association with . the computer,
A server for conducting a web conference between two or more user terminals,
an information receiving unit that receives images transmitted from each of the two or more user terminals during the web conference;
an information acquisition unit that acquires one or more user's vital information in association with the image from the user's person region included in one or more images among the two or more images received by the information reception unit;
Information transmission for transmitting the vital information acquired by the information acquiring unit or a screen image on which the vital information is arranged during the web conference to one or more user terminals among the two or more user terminals. function as a department ,
The information acquisition unit acquires the vital information from each time-series image received from one or more specific user terminals,
The time-series vital information acquired by the information acquisition unit is stored in association with the time-series images received by the information reception unit and within the period used to acquire the vital information. A program for functioning as a storage unit for

Images