JPWO2022137502A5 - - Google Patents
Download PDFInfo
- Publication number
- JPWO2022137502A5 JPWO2022137502A5 JP2022515724A JP2022515724A JPWO2022137502A5 JP WO2022137502 A5 JPWO2022137502 A5 JP WO2022137502A5 JP 2022515724 A JP2022515724 A JP 2022515724A JP 2022515724 A JP2022515724 A JP 2022515724A JP WO2022137502 A5 JPWO2022137502 A5 JP WO2022137502A5
- Authority
- JP
- Japan
- Prior art keywords
- video meeting
- evaluation
- user
- video
- biological reaction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000011156 evaluation Methods 0.000 claims 42
- 238000006243 chemical reaction Methods 0.000 claims 16
- 230000008451 emotion Effects 0.000 claims 6
- 230000001815 facial effect Effects 0.000 claims 2
Claims (13)
前記動画像を取得する取得手段と、
取得した動画像に含まれるユーザの生体反応の変化を解析する解析部と、
前記解析によって得られた情報に基づいて、表示オブジェクトを生成するオブジェクト生成手段と、
生成した前記表示オブジェクトを当該動画像に重畳して表示する表示制御手段と、を備えるビデオミーティング評価端末であって、
前記表示オブジェクトは、前記動画像において認識した顔の部分を示すオブジェクトと、前記評価した内容を示す情報が含まれる、
ビデオミーティング評価端末。 Display means for displaying at least a moving image obtained from a video meeting with another terminal;
acquisition means for acquiring the moving image;
an analysis unit that analyzes changes in the user's biological reactions contained in the acquired video images;
object generation means for generating a display object based on the information obtained by the analysis ;
A video meeting evaluation terminal comprising: display control means for superimposing and displaying the generated display object on the video image,
The display object includes an object indicating a face part recognized in the video image and information indicating the evaluated content.
Video meeting evaluation terminal.
前記動画像内に含まれる少なくとも顔画像を所定のフレーム単位ごとに識別する識別手段と、
識別した前記顔画像に関する評価値を算出する評価手段と、
ビデオミーティング評価端末。 The video meeting evaluation device according to claim 1,
Identification means for identifying at least a face image included in the moving image for each predetermined frame unit;
evaluation means for calculating an evaluation value regarding the identified face image;
Video meeting evaluation terminal.
前記動画像内に含まれる少なくとも顔画像を所定のフレーム単位ごとに識別する顔画像識別手段と、
前記動画像内に含まれる少なくとも音声を取得する音声取得手段と
識別した前記顔画像及び前記音声の双方に基づいて評価値を算出する評価手段と、
ビデオミーティング評価端末。 The video meeting evaluation device according to claim 1,
face image identification means for identifying at least a face image included in the moving image for each predetermined frame;
an audio acquisition unit that acquires at least audio included in the moving image; an evaluation unit that calculates an evaluation value based on both the identified facial image and the audio;
Video meeting evaluation terminal.
ビデオミーティング評価端末は、前記評価値の時系列によるグラフ情報を提供する、
ビデオミーティング評価端末。 The video meeting evaluation terminal according to any one of claims 1 to 3,
The video meeting evaluation terminal provides graph information based on time series of the evaluation value.
Video meeting evaluation terminal.
前記ビデオミーティング評価端末は、前記顔画像を複数の異なる観点によって評価した複数の評価値を算出する、
ビデオミーティング評価端末。 The video meeting evaluation terminal according to any one of claims 1 to 4,
The video meeting evaluation terminal calculates a plurality of evaluation values obtained by evaluating the facial image from a plurality of different viewpoints.
Video meeting evaluation terminal.
前記ビデオミーティング評価端末は、前記動画像に含まれる音声と共に前記評価値を算出する、
ビデオミーティング評価端末。 The video meeting evaluation terminal according to any one of claims 1 to 5,
The video meeting evaluation terminal calculates the evaluation value together with the audio included in the moving image.
Video meeting evaluation terminal.
前記ビデオミーティング評価端末は、前記動画像内に含まれる前記顔画像以外の対象物と共に前記評価値を算出する、
ビデオミーティング評価端末。 The video meeting evaluation terminal according to any one of claims 1 to 6,
The video meeting evaluation terminal calculates the evaluation value together with objects other than the face image included in the video image.
Video meeting evaluation terminal.
前記動画像に関連付けられた識別子を生成する識別子生成手段と、
前記識別子及び前記前記評価値を対応付けて共有する共有手段をさらに有する、
ビデオミーティング評価端末。 The video meeting evaluation terminal according to any one of claims 1 to 7,
Identifier generation means for generating an identifier associated with the moving image;
further comprising a sharing means for associating and sharing the identifier and the evaluation value;
Video meeting evaluation terminal.
前記解析部は、前記ユーザが顔を相手ユーザに表示していない場合であったとしても、カメラ部によって取得した当該ユーザの顔画像の前記生体反応の変化を解析する、 The analysis unit analyzes changes in the biological reaction of the user's face image acquired by the camera unit even if the user is not displaying his or her face to the other user.
ビデオミーティング評価システム。Video meeting evaluation system.
前記生体反応の変化に基づいて、複数のユーザ間で平準化された評価基準に従って前記ユーザの感情の度合いを評価する感情評価部を更に備え、 further comprising an emotion evaluation unit that evaluates the degree of emotion of the user according to evaluation criteria leveled among a plurality of users based on changes in the biological reaction,
前記感情評価部は、平常時の生体反応に対する現在の生体反応の違いの大きさに基づく感情の程度であって、前記ユーザによる同じ感情の生起しやすさに応じて調整された感情の度合いを評価する、 The emotion evaluation unit determines the degree of emotion based on the magnitude of the difference between the current biological reaction and the normal biological reaction, and the degree of emotion is adjusted according to the ease with which the same emotion occurs by the user. evaluate,
ビデオミーティング評価システム。Video meeting evaluation system.
前記解析部は、一のビデオミーティングに関してユーザについて解析された前記生体反応の変化が前記一のビデオミーティングより時間的に前のビデオミーティングに関して前記ユーザについて解析された前記生体反応の変化と比べて特異的か否かを判定し、特異的であると判定された生体反応の変化の内容および以前からの変化の大きさに基づいて前記生体反応の変化パターンをクラスタリングする、 The analysis unit determines that the change in the biological reaction analyzed for the user regarding one video meeting is unique compared to the change in the biological reaction analyzed for the user regarding a video meeting temporally earlier than the one video meeting. clustering the change pattern of the biological reaction based on the content of the change in the biological reaction determined to be specific and the magnitude of the change from before;
ビデオミーティング評価システム。Video meeting evaluation system.
前記解析部は、前記複数のユーザのそれぞれについて前記目線の動きを解析して目線の方向を示すヒートマップを生成し、生成されたヒートマップと他のユーザについて生成されたヒートマップとの対比により、前記ユーザについて解析された前記生体反応の変化が、前記他のユーザについて解析された前記生体反応の変化と比べて特異的か否かを判定する、 The analysis unit analyzes the movement of the line of sight for each of the plurality of users to generate a heat map indicating the direction of the line of sight, and compares the generated heat map with heat maps generated for other users. , determining whether the change in the biological reaction analyzed for the user is specific compared to the change in the biological reaction analyzed for the other user;
ビデオミーティング評価システム。Video meeting evaluation system.
前記解析部は、前記ユーザについて解析された前記生体反応の変化が他の前記ユーザについて解析された前記生体反応の変化と比べて特異的か否かを判定し、前記ユーザに特異的であると判定された生体反応の変化が起きたときに前記ユーザ、他の前記ユーザ又環境の少なくとも１つに関して発生している事象を特定し、前記ユーザの前記生体反応の変化と前記事象との相関の程度を解析し、前記相関が一定レベル以上であると判定された場合にその相関の解析結果に基づいて前記ユーザ又は前記事象をクラスタリングする、 The analysis unit determines whether the change in the biological reaction analyzed for the user is specific compared to the change in the biological reaction analyzed for other users, and determines whether the change in the biological reaction analyzed for the user is specific to the user. Identifying an event occurring with respect to at least one of the user, another user, or the environment when the determined change in the biological reaction occurs, and correlating the change in the biological reaction of the user with the event. analyzing the extent of the correlation, and clustering the users or the events based on the analysis result of the correlation if it is determined that the correlation is at a certain level or higher;
ビデオミーティング評価システム。Video meeting evaluation system.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/JP2020/048710 WO2022137502A1 (en) | 2020-12-25 | 2020-12-25 | Video meeting evaluation terminal, video meeting evaluation system, and video meeting evaluation program |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| JPWO2022137502A1 JPWO2022137502A1 (en) | 2022-06-30 |
| JPWO2022137502A5 true JPWO2022137502A5 (en) | 2023-12-28 |
| JP7477909B2 JP7477909B2 (en) | 2024-05-02 |
Family
ID=82157633
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2022515724A Active JP7477909B2 (en) | 2020-12-25 | 2020-12-25 | Video meeting evaluation terminal, video meeting evaluation system and video meeting evaluation program |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JP7477909B2 (en) |
| WO (1) | WO2022137502A1 (en) |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003244425A (en) | 2001-12-04 | 2003-08-29 | Fuji Photo Film Co Ltd | Method and apparatus for registering on fancy pattern of transmission image and method and apparatus for reproducing the same |
| JP2004178163A (en) | 2002-11-26 | 2004-06-24 | Matsushita Electric Ind Co Ltd | Image processing method and device |
| JP6023685B2 (en) * | 2013-10-09 | 2016-11-09 | 日本電信電話株式会社 | Emotion information display control device, method and program thereof |
| JP6524049B2 (en) * | 2016-10-28 | 2019-06-05 | 株式会社東芝 | Emotion estimation device, emotion estimation method, emotion estimation program, and emotion counting system |
| JP2019058625A (en) * | 2017-09-26 | 2019-04-18 | 株式会社エモスタ | Emotion reading device and emotion analysis method |
-
2020
- 2020-12-25 JP JP2022515724A patent/JP7477909B2/en active Active
- 2020-12-25 WO PCT/JP2020/048710 patent/WO2022137502A1/en active Application Filing
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP4622702B2 (en) | Video surveillance device | |
| US9224037B2 (en) | Apparatus and method for controlling presentation of information toward human object | |
| JP4934861B2 (en) | Display system, display method, display effect measurement system, and display effect measurement method | |
| US8724845B2 (en) | Content determination program and content determination device | |
| KR101766347B1 (en) | Concentrativeness evaluating system | |
| US9639770B2 (en) | System and method for improving communication productivity | |
| US20140270483A1 (en) | Methods and systems for measuring group behavior | |
| KR20150036713A (en) | Determining user interest through detected physical indicia | |
| JP4704174B2 (en) | Status identification device, program, and method | |
| KR101835578B1 (en) | Concentrativeness evaluating system | |
| US9710708B1 (en) | Method and apparatus for autonomously recognizing at least one object in an image | |
| US9361705B2 (en) | Methods and systems for measuring group behavior | |
| JP2010211485A (en) | Gaze degree measurement device, gaze degree measurement method, gaze degree measurement program and recording medium with the same program recorded | |
| JP6214334B2 (en) | Electronic device, determination method and program | |
| JP2015230616A (en) | Image processing method and image processor | |
| JP2007172378A (en) | Apparatus for specifying object to be gazed at | |
| JP2010204823A (en) | Line-of-sight recognition device | |
| JP5272214B2 (en) | Advertisement effect index measuring device, advertisement effect index measuring method and program | |
| JP5115763B2 (en) | Image processing apparatus, content distribution system, image processing method, and program | |
| JPWO2022137502A5 (en) | ||
| WO2012054048A1 (en) | Apparatus and method for evaluating an object | |
| JP2003216938A (en) | Information collecting device | |
| JP2021047538A (en) | Image processing device, image processing method, and program | |
| JPWO2022113248A5 (en) | ||
| JP2019152734A (en) | Digital information display system |