JP7041046B2 - Group estimation device and group estimation method - Google Patents

Description

The present invention relates to a group estimation device and a group estimation method.

Conventionally, it has been performed to identify a group to which a plurality of people belong. For example, Patent Document 1 discloses a technique for detecting an activity as a group by analyzing the center of gravity of an active group and the position coordinates of an individual.

Japanese Unexamined Patent Publication No. 2013-232243

The conventional technique disclosed in Patent Document 1 detects the activity as a group mainly by analyzing the center of gravity of the group and the position coordinates of the individual who are active while moving in the city or in a shopping mall. be. Therefore, in the conventional technique, there is a problem that the group cannot be estimated in a state where the person is basically seated in a conference room or the like and the person is not moving.

Therefore, the present invention has been made in view of these points, and an object of the present invention is to provide a group estimation device and a group estimation method capable of estimating a group even when a person is not moving. ..

The group estimation device according to the first aspect of the present invention has a gaze area that exists in a predetermined area and indicates an area in which each of a plurality of subjects who may belong to the group gazes at each time included in the predetermined period. Based on the gaze area specifying part and the gaze area of each of the plurality of subjects specified by the gaze area specifying part, a group including at least a part of the target persons is estimated. A group estimation unit is provided, and an output unit that outputs information indicating the group estimated by the group estimation unit is provided.

The group estimation unit may estimate the group composed of a plurality of subjects having a common gaze area.
The group estimation device further includes a target person information acquisition unit that acquires target person information including position information indicating the position of each of the plurality of target persons, and the group estimation unit is provided to each of the plurality of target persons. The group may be estimated based on the relationship between the position indicated by the corresponding subject information and the gaze area of each of the plurality of subjects.

The group estimation unit associates a target person who gazes at the gaze area with a target person whose position is included in the gaze area, and sets the group composed of a plurality of subjects who are associated with each other. You may estimate.

The group estimation unit sets an area including the positions of any plurality of target persons, and when the gaze area of the plurality of target persons in the predetermined period is included in the area, the group estimation unit is composed of the plurality of target persons. The group may be estimated.

The group estimation unit sets a target person area, which is an area including the positions of a plurality of target persons included in the estimated group, and among the target persons different from the plurality of target persons, the gaze area is set in the target person area. The subject including the may be presumed to belong to the presumed group.

The group estimation device corresponds to each of the plurality of target persons, and has an operation information acquisition unit that acquires a plurality of operation information indicating the operation of the target person at each time included in the predetermined period, and the plurality of target persons. The group estimation unit further includes an interlocking specific unit that identifies a plurality of target persons performing related operations as interlocking persons based on the operation indicated by the operation information corresponding to each of the above. A group including some of the subjects may be estimated from the plurality of subjects based on the frequency of occurrence of the related movements of the person.

The group estimation device further includes an utterance information acquisition unit that corresponds to each of the plurality of subjects and acquires a plurality of utterance information indicating the contents of the utterances of the subject at each time included in the predetermined period. The interlocking identification unit selects a plurality of subjects who are performing related actions and utterances based on the action indicated by the motion information corresponding to each of the plurality of subjects and the utterance indicated by the utterance information. Identifying as the interlocking person, the group estimation unit estimates a group including some of the target persons among the plurality of target persons, based on the related movement of the interlocking person and the frequency of occurrence of the utterance. You may.

The group estimation device corresponds to each of the plurality of target persons, and has an operation information acquisition unit that acquires a plurality of operation information indicating the operation of the target person at each time included in the predetermined period, and the plurality of target persons. An interlocking specific unit that identifies a plurality of target persons performing related operations as an interlocking person based on the operation indicated by the operation information corresponding to each of the above, and a plurality of groups included in the group estimated by the group estimation unit. Further includes an interaction degree specifying unit that specifies the degree of interaction of a plurality of subjects included in the group based on the interlocking status of the interlocking person, and the output unit is a plurality of objects included in the group. Information indicating the degree of interaction between the persons may be output.

The group estimation device corresponds to each of the plurality of target persons, and has an operation information acquisition unit that acquires a plurality of operation information indicating the operation of the target person at each time included in the predetermined period, and the plurality of target persons. Based on the operation indicated by the operation information corresponding to each of the above, the interlocking specific unit that identifies a plurality of target persons performing the related operations as the interlocking person, and the plurality of groups estimated by the group estimation unit, respectively. Further includes an interaction degree specifying unit that specifies the degree of interaction of the plurality of groups based on the interlocking status of the plurality of interlocking persons included in the above, and the output unit is a unit of the specified plurality of groups. Information indicating the degree of interaction may be output.

The group estimation method according to the second aspect of the present invention is an area executed by a computer, in which each of a plurality of subjects existing in a predetermined area and possibly belonging to a group pay attention to each time included in a predetermined period. A step of specifying a gaze area showing the above, and a step of estimating a group including at least a part of the gaze areas among the plurality of subjects based on the gaze area of each of the specified gaze areas. , A step of outputting information indicating the estimated group.

According to the present invention, there is an effect that the group can be estimated even when the person is not moving.

It is a figure which shows the outline of the group estimation apparatus which concerns on this embodiment. It is a figure which shows the structure of the group estimation apparatus which concerns on this embodiment. It is a figure which shows an example of the joint gaze area which concerns on this embodiment. It is a figure explaining the example which the group estimation part which concerns on this embodiment estimates a group based on the relationship between the position of a subject and a gaze area. It is a figure explaining another example (the 1) which the group estimation part which concerns on this embodiment estimates a group based on the relationship between the position of a subject and a gaze area. It is a figure explaining another example (the 2) which the group estimation part which concerns on this embodiment estimates a group based on the relationship between the position of a subject and a gaze area. It is a figure which shows the example which newly belongs a subject to the group estimated by the group estimation unit which concerns on this embodiment. It is a flowchart which shows the processing flow of the group estimation apparatus which concerns on this embodiment.

[Overview of Group Estimator 1]
FIG. 1 is a diagram showing an outline of the group estimation device 1 according to the present embodiment. The group estimation device 1 is a computer that estimates a group including at least a part of the plurality of subjects who may belong to the group in a predetermined area. Here, the predetermined area is, for example, a floor such as a conference room or a hall. In the example shown in FIG. 1, the target persons P1 to P6 exist as a plurality of target persons in the predetermined area.

The group estimation device 1 sets a gaze area indicating an area to be gazed by each of a plurality of subjects based on the gaze information associated with the position of the subject at each time included in a predetermined period and the gaze direction of the subject. Identify. As shown in FIG. 1, the group estimation device 1 specifies gaze areas A1 to A3 as gaze areas of the subjects P1 to P6 based on the position of the subject and the gaze directions D1 to D6 of the subject. do.

The group estimation device 1 estimates a group including at least a part of the plurality of subjects based on the gaze area specified for each of the plurality of subjects. For example, the group estimation device 1 estimates a group composed of a plurality of subjects having a common gaze area, or a relationship between the positions of a plurality of subjects and a gaze area specified for the plurality of subjects. Estimate the group based on. As shown in FIG. 1, for example, the group estimation device 1 identifies a group G1 to which the subjects P1 to P3 belong and a group G2 to which the subjects P4 to P6 belong. In this way, the group estimation device 1 estimates the group based on the gaze area specified for each of the plurality of subjects, so that the group can be estimated even when the person is not moving. ..

[Configuration of group estimation device 1]
Subsequently, the configuration of the group estimation device 1 will be described. FIG. 2 is a diagram showing a configuration of a group estimation device 1 according to the present embodiment. As shown in FIG. 2, the group estimation device 1 includes a storage unit 11 and a control unit 12.

The storage unit 11 is a storage medium including a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. The storage unit 11 stores a program executed by the control unit 12. For example, the storage unit 11 uses the group estimation device 1 as a target person information acquisition unit 121, a gaze area identification unit 122, an operation information acquisition unit 123, an utterance information acquisition unit 124, an interlocking identification unit 125, a group estimation unit 126, and an interaction. It stores a group estimation program that functions as a degree identification unit 127 and an output unit 128.

The control unit 12 is, for example, a CPU (Central Processing Unit). By executing the group estimation program stored in the storage unit 11, the control unit 12 executes the target person information acquisition unit 121, the gaze area identification unit 122, the operation information acquisition unit 123, the utterance information acquisition unit 124, and the interlocking identification unit 125. , The group estimation unit 126, the interaction degree specifying unit 127, and the output unit 128.

The target person information acquisition unit 121 corresponds to each of a plurality of target persons who may belong to a group in a predetermined area, and is included in the target person identification information for identifying the target person and a predetermined period (for example, 5 seconds). A plurality of target person information in which the position information indicating the position of the target person at each time and the line-of-sight direction information indicating the line-of-sight direction of the target person are associated with each other is acquired. The target person information is stored in, for example, the storage unit 11, and the target person information acquisition unit 121 acquires the target person information stored in the storage unit 11.

The gaze area specifying unit 122 specifies a gaze area indicating an area in which each of the plurality of subjects gazes at each time included in a predetermined period. For example, the gaze area specifying unit 122 has a plurality of gaze area specifying units 122 based on the position information indicating the position of the target person included in the target person information acquired by the target person information acquisition unit 121 and the line-of-sight direction information indicating the line-of-sight direction of the target person. Identify the gaze area corresponding to each of the subjects. For example, when another target person exists within a predetermined range in the line-of-sight direction of the target person from the position of the target person, the gaze area specifying unit 122 specifies the position of the other target person as the gaze area. Further, for example, when there is no other target person within a predetermined range in the line-of-sight direction of the target person from the position of the target person, the gaze area specifying unit 122 is separated from the position of the target person by a predetermined distance in the line-of-sight direction of the target person. Specify the position as the gaze area.

The gaze area specifying unit 122 may specify the gaze area based on the line of sight of the subject detected by the line of sight detection device (not shown) that detects the line of sight. Further, the gaze area specifying unit 122 may specify the gaze area of the target person by analyzing the captured image including the target person, which is an image captured by capturing the predetermined area in a predetermined period.

The operation information acquisition unit 123 corresponds to each of the plurality of target persons, and acquires a plurality of operation information indicating the operation of the target person at each time included in the predetermined period. Target person identification information is associated with the operation information. For example, the motion information acquisition unit 123 acquires motion information generated by a motion capture device (not shown) that identifies the motion of the target person, or is based on information indicating the motion of a person detected by an infrared sensor (not shown). You may acquire the operation information. Further, the operation information acquisition unit 123 performs image processing such as continuous wavelet transform on a plurality of captured images captured in a predetermined area in a predetermined period, and calculates the amount of change in pixels included in the image to obtain operation information. You may get it. Here, the movement of the subject includes the movement of hitting an aizuchi and the movement of nodding.

The utterance information acquisition unit 124 corresponds to each of the plurality of target persons, and acquires a plurality of utterance information indicating the contents of the utterances of the target person at each time included in the predetermined period. Target person identification information is associated with the utterance information.

The interlocking identification unit 125 identifies a plurality of target persons performing related operations as interlocking persons based on the operations indicated by the operation information corresponding to each of the plurality of target persons acquired by the operation information acquisition unit 123. Further, the interlocking specific unit 125 is based on the operation indicated by the operation information corresponding to each of the plurality of target persons acquired by the operation information acquisition unit 123 and the utterance indicated by the utterance information acquired by the utterance information acquisition unit 124. Identify multiple subjects who are performing related actions and utterances as interlockers.

For example, the interlocking identification unit 125 identifies the target person identification information corresponding to a plurality of target persons whose positions of the target persons indicated by the target person information are within a predetermined range. Then, the interlocking specific unit 125 interlocks based on the operation indicated by the operation information associated with the specified target person identification information and the utterance indicated by the utterance information associated with the specified target person identification information. Identify multiple subjects who are uttering words that indicate nodding behavior or aizuchi as interlockers.

The group estimation unit 126 estimates a group including at least a part of the plurality of subjects existing in the predetermined area based on the respective gaze areas of the plurality of subjects specified by the gaze area identification unit 122. do.

The group estimation unit 126 estimates a group composed of a plurality of subjects having a common gaze area. FIG. 3 is a diagram showing an example of a joint gaze area according to the present embodiment. In the example shown in FIG. 3, since the gaze areas of the plurality of subjects P1 to P3 existing in the predetermined area are all gaze areas A1, the group estimation unit 126 specifies the gaze area A1 as the joint gaze area. do. For example, in the group estimation unit 126, a gaze area common to a plurality of subjects is set as a joint gaze area, and these plurality of subjects form a group based on the time when the plurality of subjects gaze at the joint gaze area. Determine if it is formed. In the example shown in FIG. 3, the group estimation unit 126 estimates that a group composed of a plurality of subjects P1 to P3 having a joint gaze area A1 is formed.

Further, the group estimation unit 126 estimates the group based on the relationship between the position of the target person indicated by the target person information corresponding to each of the plurality of target persons and the gaze area of each of the plurality of target persons. Specifically, the group estimation unit 126 associates a target person who gazes at the gaze area with a target person whose position is included in the gaze area, and is a group composed of a plurality of subjects who are associated with each other. To estimate.

FIG. 4 is a diagram illustrating an example in which the group estimation unit 126 according to the present embodiment estimates a group based on the relationship between the position of the subject and the gaze area. In the example shown in FIG. 4, the subject P6 is located in the gaze area A2 of the subject P4 and the subject P5. Further, the subject P4 is located in the gaze area A3 of the subject P6. Therefore, the group estimation unit 126 associates the target person P4 with the target person P6 and also associates the target person P5 with the target person P6. Since the target person P4 and the target person P5 are associated with each other via the target person P6, the group estimation unit 126 forms a group composed of a plurality of the target persons P4 to P6 having the association. Presumed to be.

When another target person is located in each of the plurality of gaze areas corresponding to one target person, the group estimation unit 126 forms a group including the one target person and the other target person. It may be presumed that it has been done. FIG. 5 is a diagram illustrating another example (No. 1) in which the group estimation unit 126 according to the present embodiment estimates a group based on the relationship between the position of the subject and the gaze area. In the example shown in FIG. 5, it can be confirmed that the other subject P4 and the other subject P5 are located in each of the gaze area A3 and the gaze area A4 of the subject P6. In this case, the group estimation unit 126 estimates that a group composed of the subjects P4 to P6 is formed.

Further, in the group estimation unit 126, when the gaze area of the plurality of subjects is included for a predetermined time or more in the area surrounded by the positions of any plurality of subjects in a predetermined period, the group estimation unit 126 may use the plurality of subjects. It may be presumed that a constituent group is formed.

FIG. 6 is a diagram illustrating another example (No. 2) in which the group estimation unit 126 according to the present embodiment estimates a group based on the relationship between the position of the subject and the gaze area. The subjects P1 to P10 are displayed as shown in FIG. 6A. In this case, the group estimation unit 126, as an arbitrary plurality of subjects, from these plurality of subjects, depending on the positions of the subjects P1, P2, P6, P7, P9, as shown in FIG. 6 (b). The area GA1 to be surrounded is specified, and the area GA2 surrounded by the positions of the subjects P3, P4, P5, P8, and P10 is specified.

In this case, the gaze positions of the subjects P1, P2, P6, P7, and P9 exist inside the region GA1. The group estimation unit 126 may, for example, have a plurality of subjects P1, P2, P6, P7 when all of the gaze positions of the subjects P1, P2, P6, P7, and P9 are included in the region GA1 for a predetermined time or longer. , It is presumed that a group composed of P9 is formed. Further, the gaze positions of the subjects P3, P4, P5, P8, and P10 exist inside the region GA2. The group estimation unit 126 may, for example, have a plurality of subjects P3, P4, P5, P8 when all of the gaze positions of the subjects P3, P4, P5, P8, and P10 are included in the region GA2 for a predetermined time or longer. , It is presumed that a group composed of P10 is formed.

Further, the group estimation unit 126 sets a target person area which is an area including the positions of a plurality of target persons included in the group estimated by itself, and among the target persons different from the plurality of target persons, the target person area. A subject whose gaze area is included in may be estimated to belong to the estimated group.

FIG. 7 is a diagram showing an example in which a subject is newly assigned to a group estimated by the group estimation unit 126 according to the present embodiment. In the example shown in FIG. 7, as the region of the group composed of the subjects P1 to P3, the group region GA including the subjects P1 to P3 and the joint gaze region A1 is shown. In the example shown in FIG. 7, since the gaze region A5 of the subject P7 is included in the group region GA, the group estimation unit 126 determines that the subject P7 belongs to the group composed of the subjects P1 to P3. presume. By doing so, the group estimation device 1 makes the subject belong to the group even when the subject does not directly gaze at another subject or gaze at the joint gaze area. Can be made to.

The group estimation unit 126 is a group including at least a part of the plurality of subjects existing in the predetermined area based on the respective gaze areas of the plurality of subjects specified by the gaze area identification unit 122. However, if the group is estimated based only on the gaze area, there is a problem that the estimation accuracy of the group is lowered. Therefore, the group estimation unit 126 estimates a group including a part of the target persons among the plurality of target persons, based further on the occurrence frequency of the related actions and utterances of the interlocking person specified by the interlocking specific unit 125.

Specifically, when a plurality of subjects are gazing at the joint gaze area for a predetermined time or longer, the group estimation unit 126 is used as a set of a plurality of subjects who are gazing at the joint gaze area. On the other hand, a specific index value used for determining whether or not a group is formed is calculated. Then, the group estimation unit 126 assigns the calculated specific index value to the plurality of target persons. For example, the group estimation unit 126 calculates the specific index value so that the longer the gaze time of the joint gaze region is, the higher the specific index value is.

Further, the group estimation unit 126 associates the target person who gazes at the gaze area with the target person whose position is included in the gaze area, and sets a specific index for a set of a plurality of subjects who are associated with each other. Calculate the value. Then, the group estimation unit 126 assigns the calculated specific index value to the plurality of target persons. The group estimation unit 126 calculates the index value so that, for example, the longer the gaze time of another target person by the target person, the higher the specific index value.

Further, the group estimation unit 126 calculates a specific index value based on the time in which the gaze area of the plurality of subjects is included in the region surrounded by the positions of the plurality of subjects. The group estimation unit 126 assigns the calculated specific index value to the plurality of subjects. For example, the group estimation unit 126 calculates the index value so that the longer the gaze time inside the area surrounded by the positions of the plurality of subjects by the subject, the higher the specific index value.

Further, the group estimation unit 126 calculates the identification index value for a set of a plurality of target persons corresponding to the interlocking person specified by the interlocking specific unit 125. Then, the group estimation unit 126 assigns the calculated identification index value to the set of a plurality of target persons as the plurality of interlockers specified by the interlocking specific unit 125. The group estimation unit 126 calculates the specific index value so that the more the interlocking movements of the plurality of interlocking persons are, the higher the specific index value is. The group estimation unit 126 calculates the specific index value so that the more utterances linked to the nodding motion in the plurality of interlockers, the higher the specific index value.

The group estimation unit 126 integrates a plurality of identification index values given to a set of a plurality of subjects. For example, the group estimation unit 126 is gazing at the joint gaze area when a specific index value is given to a subset that belongs to a set of a plurality of subjects who are gazing at the joint gaze area. The specific index value is integrated by adding the specific index value corresponding to the subset to the specific index value given to the set of a plurality of subjects.

Similarly, the group estimation unit 126 has a plurality of related targets when a specific index value is given to a subset that belongs to a set of a plurality of related subjects. The specific index value is integrated by adding the specific index value corresponding to the subset to the specific index value given to the set of persons.

Then, the group estimation unit 126 estimates that a set of a plurality of subjects whose integrated specific index value exceeds a predetermined threshold value is a group formed by the plurality of subjects. By doing so, the group estimation device 1 can accurately estimate the group formed by the plurality of subjects.

The interaction degree specifying unit 127 specifies the degree of interaction of a plurality of subjects included in the group based on the interlocking status of the plurality of interlockers included in the group estimated by the group estimation unit 126. Specifically, the interaction degree specifying unit 127 identifies an interlocking person who is interlocking with each other from a plurality of subjects included in the group estimated by the group estimation unit 126. The interaction degree specifying unit 127 calculates the interaction degree of a plurality of subjects included in the estimated group based on the interlocking situation of the interlocking person specified in the interlocking specific unit 125. For example, the interaction degree specifying unit 127 increases the degree of interaction as the interlocking person specified in the interlocking specifying unit 125 is interlocked. By doing so, the group estimation device 1 can determine whether or not the estimated group is active.

Further, the interaction degree specifying unit 127 specifies the interaction degree of the plurality of groups based on the interlocking status of the plurality of interlockers included in each of the plurality of groups estimated by the group estimation unit 126. Specifically, the interaction degree specifying unit 127 identifies an interlocking person that is interlocked with each other beyond the group from among a plurality of subjects included in the plurality of groups estimated by the group estimation unit 126. The interaction degree specifying unit 127 calculates the estimated degree of interaction between a plurality of groups based on the interlocking situation of the interlocking person specified in the interlocking specific unit 125. For example, the interaction degree specifying unit 127 increases the degree of interaction between a plurality of groups as the interlocking person specified in the interlocking specifying unit 125 is interlocked. By doing so, the group estimation device 1 can determine whether or not there is active discussion among the estimated plurality of groups.

The output unit 128 outputs information indicating the group estimated by the group estimation unit 126 and information indicating the degree of interaction of a plurality of subjects included in the group specified by the interaction degree specifying unit 127. For example, the output unit 128 provides group identification information for identifying the group estimated by the group estimation unit 126, target person identification information corresponding to each of a plurality of target persons belonging to the group, and information indicating the degree of interaction. The associated information is output to the storage unit 11 as estimation group information.

Further, the output unit 128 outputs information indicating the degree of interaction of a plurality of groups specified by the degree of interaction specifying unit 127. For example, the output unit 128 outputs information in which the group identification information corresponding to each of the plurality of groups and the information indicating the degree of interaction of the plurality of groups are associated with each other as the intergroup interaction degree information to the storage unit 11. ..

[Processing flow of group estimation device 1]
Subsequently, the processing flow of the group estimation device 1 will be described. FIG. 8 is a flowchart showing a processing flow of the group estimation device 1 according to the present embodiment.

First, the target person information acquisition unit 121 acquires the target person information (S1).
Subsequently, the gaze area specifying unit 122 identifies each gaze area of the plurality of subjects (S2).

Subsequently, the operation information acquisition unit 123 acquires the operation information (S3).
Subsequently, the utterance information acquisition unit 124 acquires the utterance information (S4).
The target person information, the operation information, and the utterance information are not limited to the order shown in FIG. 8, and may be acquired in another order.

Subsequently, the interlocking identification unit 125 identifies the interlocking person based on the acquired operation information and utterance information (S5).
Subsequently, the group estimation unit 126 estimates a group including at least a part of the plurality of subjects based on the gaze area of each of the identified plurality of subjects and the identified interlocking person. (S6).

Subsequently, the interaction degree specifying unit 127 specifies the interaction degree of the plurality of subjects included in the group based on the interlocking status of the plurality of interlockers included in the estimated group (S7).
Subsequently, the interaction degree specifying unit 127 specifies the interaction degree of the plurality of groups based on the interlocking status of the plurality of interlockers included in each of the plurality of groups estimated by the group estimation unit 126 (S8). ..

Subsequently, the output unit 128 estimates that the group identification information for identifying the estimated group, the target person identification information corresponding to each of the plurality of subjects belonging to the group, and the information indicating the degree of interaction are associated with each other. In addition to outputting the group information, the group identification information corresponding to each of the plurality of groups and the information indicating the interaction degree of the plurality of groups are associated with each other, and the interaction degree information between the groups is output (S9).

[Effects in this embodiment]
As described above, the group estimation device 1 according to the present embodiment has specified and specified a gaze area indicating an area to be gazed by each of a plurality of subjects who are present in a predetermined area and may belong to the group. Based on the respective gaze areas of the plurality of subjects, a group including at least a part of the subjects is estimated. By doing so, the group estimation device 1 can estimate the group even when the person is not moving.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various changes or improvements can be made to the above embodiments. Further, in particular, the specific embodiment of the distribution / integration of the apparatus is not limited to those shown above, and all or a part thereof may be arbitrary according to various additions or the like, or according to the functional load. It can be functionally or physically distributed / integrated in units.

1 ... Group estimation device, 11 ... Storage unit, 12 ... Control unit, 121 ... Target person information acquisition unit, 122 ... Gaze area identification unit, 123 ... Operation information acquisition unit, 124 ... Speaking information acquisition unit, 125 ... Interlocking specific unit, 126 ... Group estimation unit, 127 ... Interaction degree identification unit, 128 ... Output unit

Claims (10)

A gaze area specifying unit that specifies a gaze area indicating an area to be gazed at each time included in a predetermined period by each of a plurality of subjects who are present in a predetermined area and may belong to a group.
A target person information acquisition unit that acquires target person information including position information indicating the position of each of the plurality of target persons, and a target person information acquisition unit.
Based on the position indicated by the target person information corresponding to each of the plurality of target persons, an area including the positions of any plurality of target persons is set, and the plurality of target persons specified by the gaze area specifying unit. When the gaze area of a plurality of subjects in which the area is set is included in the area, a group composed of a plurality of subjects in which the area is set is formed . Group estimation unit to estimate and
An output unit that outputs information indicating the group estimated by the group estimation unit, and an output unit.
A group estimator equipped with. A gaze area specifying unit that specifies a gaze area indicating an area to be gazed at each time included in a predetermined period by each of a plurality of subjects who are present in a predetermined area and may belong to a group.
A target person information acquisition unit that acquires target person information including position information indicating the position of each of the plurality of target persons, and a target person information acquisition unit.
Based on the position indicated by the subject information corresponding to each of the plurality of subjects and the gaze area of each of the plurality of subjects specified by the gaze area specifying unit, the plurality of subjects of the plurality of subjects. Of these, the group estimation unit that estimates the group including at least some of the subjects,
An output unit that outputs information indicating the group estimated by the group estimation unit, and an output unit.
Equipped with
The group estimation unit sets a target person area, which is an area including the positions of a plurality of target persons included in the estimated group, and among the target persons different from the plurality of target persons, the gaze area is set in the target person area. Estimate that the subject containing is in the estimated group,
Group estimator. A gaze area specifying unit that specifies a gaze area indicating an area to be gazed at each time included in a predetermined period by each of a plurality of subjects who are present in a predetermined area and may belong to a group.
A group estimation unit that estimates a group including at least a part of the plurality of subjects based on the gaze area of each of the plurality of subjects specified by the gaze area specifying unit.
An operation information acquisition unit that corresponds to each of the plurality of target persons and acquires a plurality of operation information indicating the operation of the target person at each time included in the predetermined period.
An interlocking identification unit that identifies a plurality of target persons performing related operations as interlocking persons based on the operation indicated by the operation information corresponding to each of the plurality of target persons.
An interaction degree specifying unit that specifies the degree of interaction of the plurality of groups based on the interlocking status of the plurality of interlockers included in each of the plurality of groups estimated by the group estimation unit.
An output unit that outputs information indicating the group estimated by the group estimation unit and information indicating the degree of interaction of the specified plurality of groups.
A group estimator equipped with. The group estimation unit estimates the group composed of a plurality of subjects having a common gaze area.
The group estimation device according to any one of claims 1 to 3 . An operation information acquisition unit that corresponds to each of the plurality of target persons and acquires a plurality of operation information indicating the operation of the target person at each time included in the predetermined period.
An interlocking identification unit that identifies a plurality of target persons performing related operations as interlocking persons based on the operation indicated by the operation information corresponding to each of the plurality of target persons.
Further prepare
The group estimation unit estimates a group including a part of the target persons among the plurality of target persons, based on the frequency of occurrence of the related movements of the interlocking person.
The group estimation device according to any one of claims 1 to 4 . Further, it is provided with an utterance information acquisition unit that corresponds to each of the plurality of target persons and acquires a plurality of utterance information indicating the contents of the utterances of the target person at each time included in the predetermined period.
The interlocking specific unit is a plurality of target persons who perform related actions and utterances based on the operation indicated by the motion information corresponding to each of the plurality of subjects and the utterance indicated by the utterance information. As the interlocking person,
The group estimation unit estimates a group including a part of the plurality of subjects among the plurality of subjects, based on the related movements of the interlocking person and the frequency of occurrence of the utterances.
The group estimation device according to claim 5 . An operation information acquisition unit that corresponds to each of the plurality of target persons and acquires a plurality of operation information indicating the operation of the target person at each time included in the predetermined period.
An interlocking identification unit that identifies a plurality of target persons performing related operations as interlocking persons based on the operation indicated by the operation information corresponding to each of the plurality of target persons.
An interaction degree specifying unit that specifies the degree of interaction of a plurality of subjects included in the group based on the interlocking status of the plurality of interlocking persons included in the group estimated by the group estimation unit.
Further prepare
The output unit outputs information indicating the degree of interaction of a plurality of subjects included in the group.
The group estimation device according to any one of claims 1 to 6 . Computer runs,
A step of identifying a gaze area indicating an area of gaze at each time included in a predetermined period for each of a plurality of subjects who are present in a predetermined area and may belong to a group.
A step of acquiring target person information including position information indicating each position of the plurality of target persons, and
Based on the position indicated by the target person information corresponding to each of the acquired plurality of target persons, an area including the positions of any plurality of target persons is set, and each of the specified plurality of target persons. When the gaze area of a plurality of subjects in which the area is set is included in the area, a group composed of a plurality of subjects in which the area is set is estimated. Steps and
A step to output information indicating the estimated group, and
Group estimation method with . Computer runs,
A step of identifying a gaze area indicating an area of gaze at each time included in a predetermined period for each of a plurality of subjects who are present in a predetermined area and may belong to a group.
A step of acquiring target person information including position information indicating each position of the plurality of target persons, and
Of the plurality of subjects, based on the position indicated by the subject information corresponding to each of the acquired plurality of subjects and the gaze area of each of the identified plurality of subjects. Steps to estimate a group that includes at least some of the subjects,
A step to output information indicating the estimated group, and
Have,
In the step of estimating the group, the computer sets a target area which is an area including the positions of a plurality of target persons included in the estimated group, and among the target persons different from the plurality of target persons, the target person is concerned. It is estimated that the subject whose gaze area is included in the person area belongs to the estimated group.
Group estimation method. Computer runs,
A step of identifying a gaze area indicating an area of gaze at each time included in a predetermined period for each of a plurality of subjects who are present in a predetermined area and may belong to a group.
A step of estimating a group including at least a part of the plurality of subjects based on the gaze area of each of the plurality of identified subjects.
A step of acquiring a plurality of operation information indicating the operation of the target person at each time included in the predetermined period corresponding to each of the plurality of target persons, and
A step of identifying a plurality of target persons performing related operations as interlocking persons based on the operation indicated by the operation information corresponding to each of the plurality of target persons.
A step of specifying the degree of interaction of the plurality of groups based on the interlocking status of the plurality of interlockers included in each of the estimated plurality of groups, and a step of specifying the degree of interaction of the plurality of groups.
A step of outputting information indicating the estimated said group and information indicating the degree of interaction of the specified plurality of groups.
Group estimation method with.

Images