JPH11282921A - Sensitivity information acquiring method and systematic device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a method and a systematic device capable of objectively, accurately and immediately acquiring the sensitivity information of a testee. SOLUTION: This device is constituted of a sensitivity information source input device 5 capable of automatically inputting a sensitivity information source which is the source of the sensitivity information of the testee A, a sensitivity information judgement device 3 for mapping the inputted sensitivity information source with the sensitivity information, a mapping information data base 4 for storing information required for performing mapping by the sensitivity information judgement device 3 and a video presentation device 1 for changing video images to be presented to the testee A following the sensitivity information from the sensitivity information judgement device 3 and presenting them. Thus, by just providing the data base for mapping the sensitivity information and acquiring the sensitivity information source of the testee, the sensitivity information of the testee is quickly, objectively and accurately acquired. Accompanying that, the excellent effects of changing the video images to be presented to the testee following the change of the sensitivity of the testee or the like are demonstrated. Also, it is utilized in video on-demand or the like and the excellent effects of immediately coping with the desire of a user or the like are demonstrated.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method and system for acquiring kansei information, particularly kansei information relating to a person's direct reaction expression when viewing a video. It is used for a system that presents a video according to information, and can be used for video on demand and the like.

[0002]

2. Description of the Related Art FIG. 2 shows an example of a conventional sentiment information acquisition system device α. In the figure, A is a subject, B is an interviewer, 1 is a video presenter for presenting a video to the subject A, and 2 is a sentiment information input device which is a means for inputting sentiment information of the subject A. The figure shows the minimum required.

[0003] A conventional procedure for acquiring sensibility information will be described with reference to FIG. First, the video presenter 1 is a subject A
The video is presented to. Then, the interviewer B interviews the subject A who has viewed the presented video, and hears the kansei information of the subject A regarding the video. next,
By inputting the emotion information of the subject A from which the interviewer 2 is obtained directly to the emotion input device 2, the emotion information acquisition system apparatus can indirectly acquire emotion information.

[0004]

However, in the conventional system apparatus, since the interviewer B is interposed between the subject A and the system apparatus, there is room for the subjectivity of the interviewer B to enter the sensitivity information. There is much.

[0005] If interviewer B is different, the same subject A
However, there is a risk that different sentiment information may be input to the system device even if the sentiment information is the same at the same time, and objective and accurate sentiment information cannot be obtained. In addition, the emotion information acquisition system apparatus obtains different emotion information depending on the emotion of the interviewer B at the time of the interview or the manner in which the interviewer B interviews the subject A.

[0006] That is, the personal attributes of interviewer B (for example, education, specialty, academic experience, background, hobby, age,
Gender, personality cultivated from the place of birth, etc.) and indirect emotional input influenced by the current environmental conditions, etc., must be subjective.

Also, the interviewer B uses the sentiment information input device 2
In this case, it is necessary to input the sentiment information one by one, and it takes time to input the sentiment information. Therefore, the sentiment information acquisition system itself cannot directly and directly acquire the sentiment information. For this reason, there was a problem that the affective information acquisition system device could not cope with the ever-changing affective information of the subject A.

Here, the main objects to be solved by the present invention are as follows.

[0009] A first object of the present invention is to provide a method and a system device which enable objectively acquiring sensitivity information of a subject.

[0010] A second object of the present invention is to provide a method and a system device that enable accurate acquisition of kansei information of a subject.

[0011] A third object of the present invention is to provide a method and a system device which enable immediate acquisition of kansei information of a subject.

A fourth object of the present invention is to provide a method and a system device which enable direct acquisition of the subject's emotional information.

[0015] A fifth object of the present invention is to provide a method and a system device capable of acquiring emotional information from a facial expression of a subject.

[0014] A sixth object of the present invention is to provide a method and a system apparatus which enable objective emotional information to be obtained by mechanical analysis by direct emotion input of visual behavior expression.

[0015] Other objects of the present invention will become apparent from the description of the specification, drawings, and particularly the claims.

[0016]

In order to solve the above-mentioned problems, the method of the present invention automatically obtains a sentiment information source which is a source of the sentiment information of a subject, and determines the correspondence between the sentiment information source and the sentiment information. It has a feature that a technique is adopted in which sensibility information on the subject is obtained by mapping in a short time with mapping information that has been made into a database in advance.

In order to solve the above-mentioned problems, the system apparatus of the present invention has a sensitivity information source input device capable of automatically obtaining a sensitivity information source which is a source of sensitivity information of a subject, and a sensitivity sensor for mapping the sensitivity information source and sensitivity information. It has a feature of providing at least a means for determining information.

More specifically, in solving the problem, the present invention achieves the above object by adopting a novel characteristic configuration method or means ranging from a high-level concept to a low-level concept listed below. It is done as follows.

The first feature of the method of the present invention resides in the adoption of a configuration of a sensitivity information acquisition method which senses a subject's situation, maps the situation, and acquires sensitivity information in a sufficiently short time.

According to a second feature of the method of the present invention, the mapping in the first feature of the method of the present invention is a method in which the mapping is performed by comparing the previously stored sentiment information with information on the correspondence between the sentiment information and the situation of the subject. It consists in adopting the configuration of the acquisition method.

According to a third aspect of the method of the present invention, the mapping in the first aspect of the present invention is characterized in that the mapping is performed by using a communication line or a communication network to store information on the correspondence between previously stored kansei information and the situation of the subject. And a configuration of a method for acquiring affective information obtained by comparing the information with the information.

A fourth feature of the method of the present invention resides in the adoption of a configuration of a feeling information acquiring method in which the situation of the subject in the first, second or third feature of the method of the present invention is a response to video presentation. .

A fifth feature of the method of the present invention resides in that the image presentation in the fourth feature of the method of the present invention adopts a configuration of a sensitivity information acquiring method in which an image to be presented can always be selected from the result of the mapping. is there.

According to a sixth aspect of the method of the present invention, in the fourth aspect of the method of the present invention, the presented video is provided with a video providing service and a communication line or a sentiment information acquiring method obtained via a communication line. is there.

A seventh feature of the method of the present invention resides in the adoption of a configuration of a method for acquiring affective information in which the video is accompanied by audio in the fifth or sixth feature of the method of the present invention.

An eighth feature of the method of the present invention is that the situation in the first, second, third, fourth, fifth, sixth or seventh feature of the above-described method of the present invention is that image information relating to a line of sight is included. The present invention resides in the adoption of a configuration of a certain emotion information acquisition method.

A ninth feature of the method of the present invention is that the situation in the first, second, third, fourth, fifth, sixth or seventh feature of the above-described method of the present invention is that image information relating to a pupil is obtained. The present invention resides in the adoption of a configuration of a certain emotion information acquisition method.

A tenth feature of the method of the present invention is that the situation in the first, second, third, fourth, fifth, sixth or seventh feature of the method of the present invention is that the image information relating to the blink This is in the adoption of the configuration of the feeling information acquisition method.

On the other hand, the first feature of the system apparatus of the present invention is that a sentiment information source input device for obtaining the condition of the subject and the sentiment information of the subject are mapped by mapping the inputted condition of the subject with a mapping information database. And a sentiment information acquiring system device comprising

A second feature of the system apparatus of the present invention is that an image presenter for presenting an image to a subject, a sentiment information source input device for inputting the status of the subject, and a mapping information database for inputting the status of the subject. And a sentiment information determining system that obtains sentiment information of the subject by mapping the sentiment information.

A third feature of the system device of the present invention is that the mapping information database in the first or second feature of the system device of the present invention is connected to a sentiment information determiner via a communication line or a communication line network. The present invention resides in the adoption of a configuration of a sentiment information acquisition system device.

A fourth feature of the system device of the present invention is that the video presenter in the second or third feature of the system device of the present invention is connected to a video providing service via a communication line or a communication line network. The present invention resides in the adoption of a configuration of a sensitive information acquisition system device.

A fifth feature of the system device of the present invention is that the video presenter according to the third or fourth feature of the above-described system device of the present invention instantaneously switches a video to be presented based on an output result of the sentiment information determiner. The present invention resides in adoption of a freely-configured emotion information acquisition system apparatus.

A sixth feature of the system device of the present invention is that the video presenter in the second, third, fourth or fifth feature of the system device of the present invention is provided with a sound generating means for sound accompanying the video. The present invention resides in the adoption of a configuration of a sensitive information acquisition system device.

A seventh feature of the system device of the present invention is that the sensibility information source input device in the first, second, third, fourth, fifth or sixth feature of the above-described system device of the present invention is related to a line of sight. The present invention resides in adoption of a configuration of a sensitivity information acquisition system device which is an imaging means capable of freely capturing image information.

An eighth feature of the system device of the present invention is that the sensibility information source input device in the first, second, third, fourth, fifth or sixth feature of the system device of the present invention is related to a pupil. The present invention resides in adoption of a configuration of a sensitivity information acquisition system device which is an imaging means capable of freely capturing image information.

A ninth feature of the system device of the present invention is that the emotion information source input device according to the first, second, third, fourth, fifth or sixth feature of the system device of the present invention is characterized in that: The present invention lies in the configuration and adoption of a sensitivity information acquisition system device which is an imaging means capable of freely taking image information related to.

The tenth feature of the system device of the present invention is the same as the first, second, third, fourth, fifth, sixth, seventh, eighth or ninth feature of the system device of the present invention. A video presenter is configured as a sentiment information acquisition system device integrated with the sentiment information source input device and the sentiment information determination device.

[0039]

BRIEF DESCRIPTION OF THE DRAWINGS FIG.
An embodiment of the present invention will be described with respect to an example of an apparatus and an example of a method.

(Example of Apparatus) FIG. 1 is a block diagram showing a configuration of a sentiment information acquisition system apparatus β which is an example of the present apparatus.

The sentiment information acquisition system device β is the subject A
Presenter 1 for presenting an image to the subject, and emotional information determiner 3 for determining what kind of emotional state the subject A has from the emotional information source
A mapping information database 4 in which information necessary for mapping for obtaining kansei information from the kansei information source is stored; and a kansei information source input device 5 for inputting the kansei information source of the subject A, for example, as an imaging unit And

In the present example of the apparatus, the sentiment information source is information that is a source of sentiment information. For example, image information related to the facial expression of the subject A, such as the line of sight, the pupil, and blinks, is a good example. .

That is to say, the fact that the eye reaction expression was captured by the emotional information source is, as the ancient saying goes, even if it is silent, the movement of the mind and emotions of a person who says, "Eyes say more than mouths" It uses the physical behavior of human beings to appear, for example, in the presence of a sword, it is acknowledged that Kensei is looking ahead and looking ahead, and other sources of sentiment information Expressions of the entire face, movements of the head, and the like can be cited. By combining and superimposing them, more accurate sensibility information can be obtained.

The communication control function is provided to the sentiment information judging unit 3 and the mapping information database 4 so that the sentiment information judging unit 3 and the mapping information database 4 are connected by using a communication line or a communication line network 6. It may have, or may be an integral structure. Further, the video presenter 1 and the sentiment information source input device 5 may have an integrated structure. Further, the video presenter 1, the affective information determiner 3, and the affective information source input device 5 may be integrated.

The video presenter 1 stores videos that can be presented and has a search function such as searching for a video similar or dissimilar to the video currently being presented. Is also good. Further, it may be connected to an image providing service via a communication line or a communication line network 6 and may appropriately provide an image.

In the case of the provided video, for example, classified by genre, for example: sports, music, news, drama, event, experience report, comedy program, etc. For classified music: singing, instrumental music; , Popular songs, classical songs, operas, pops, Latin, Hawaiian, jazz, rock, chanson, etc., or put them in a file so that they can respond immediately to the judgment information of the emotion information judgment unit 3 and put them on video. Easy to use.

The video presenter 1 may include a sound generator for presenting audio information along with the video. As described above, various changes can be made in implementation.

(Example of Method) Hereinafter, an execution procedure of the example of the method applied to the example of the present apparatus will be described. The video information to be presented to the video presenter 1 will be described as being built-in, but the video presented to the video presenter 1 from a video providing service connected via a communication line or a communication line network is obtained. Is also good.

First, an image is presented from the image presenter 1 to the subject A. Next, the situation of the subject A who has viewed the presented video is automatically input from the emotion information source input device 5. Here, the situation is reaction / emotional image information such as a gaze, a pupil, a blink, etc. of the subject A, and the emotional information source input device 5 automatically detects emotional information sources that can determine emotional information from the image information. Get to.

The sentiment information judging unit 3 obtains sentiment information from the sentiment information source in a sufficiently short time using the mapping information database 4 based on the obtained situation change of the subject A. In the mapping information database 4, the correspondence between the kansei information sources and the kansei information is empirically and standardized into a database and stored as mapping information.

For example, if image information in which the line of sight follows the line of sight symmetrically and blurring of the line of sight is reduced, or image information in which the pupil is opened or image information in which blinking is reduced, is directly input as the emotional information source, The sentiment information determiner 3 obtains sentiment information indicating that there is interest.

By doing so, there is no need to ask the subject A for sensitivity information. Also, since the sentiment information obtained at this time is not passed through the interviewer, there is no difference in the sentiment information due to the difference in the interviewer, and there is no room for the subjectivity of the interviewer. Get information.

Further, it is possible to obtain kansei information in a short time, and the video presenter 1 can immediately change the video to be presented to the subject A in accordance with the kansei information obtained by the kansei judgment device 3.

For example, when the subject A shows a change in gaze that can be determined to be interested in the video presented, the video presenter 1 can automatically present a similar video and show it. When the video search of the video presenter 1 is used, a plurality of similar videos to the video that the subject A has shown can be presented, and the subject A shows interest from a large amount of videos held by the video presenter 1. The time required to search for a video can be reduced.

When the video presented by the video presenter 1 is obtained by communication with the video providing service, the subject A must be interested in the video currently presented by the video presenter 1 in the video providing service. The video providing service searches for a video similar to the video presented by the video presenter 1 and transmits it to the video presenter 1, and the video presenter 1 presents it to the subject A.

In this case, information on the video presented by the subject A between the video presenter 1 and the video providing service,
For example, by exchanging information such as whether or not the subject is interested, the video providing service searches for a video similar to the subject when the subject is interested, and searches for a dissimilar video when the subject is not interested. It goes without saying that the video needs to be transmitted to the video presenter 1.

By repeating the above operations, the present sensitivity information acquisition system apparatus β can sequentially present images showing the interest of the subject A, and can navigate through the images shown to the subject A.

Although the embodiments of the present invention have been described with reference to the example of the apparatus and the example of the method, the present invention is not necessarily limited to the above-mentioned items, and achieves the objects of the present invention and has the effects described below. Changes can be made as appropriate within the scope.

[0059]

As described above, according to the present invention,
It has a database for mapping sensibility information, and it is possible to obtain kansei information of the subject quickly, objectively, and accurately only by obtaining the sensibility information source of the subject. Along with this, an excellent effect is achieved such that the video presented to the subject can be changed following the change in the sensitivity of the subject.

Further, the present invention is used for video-on-demand and the like, and exhibits excellent effects such as being able to immediately respond to a user's request.

[Brief description of the drawings]

FIG. 1 shows an embodiment of a sentiment information acquisition system device which is a system device of the present invention.

FIG. 2 is an example of a conventional sensitivity information acquisition device.

[Explanation of symbols]

 α, β ... Kansei information acquisition system device 1 ... Video presenter 2 ... Kansei information input device 3 ... Kansei information judgment device 4 ... Mapping information database 5 ... Kansei information source input device A ... Subject B ... Interviewer

Claims (20)

[Claims] 1. A method for acquiring emotional information, comprising: sensing a situation of a subject; mapping the situation; and acquiring emotional information in a sufficiently short time. 2. The method according to claim 1, wherein the mapping is performed by comparing information stored in advance with information on a correspondence relationship between the sensitivity information and the situation of the subject. 3. The method according to claim 1, wherein the mapping obtains information on the correspondence between the previously stored kansei information and the subject's situation via a communication line or a communication line network and compares the information with the information. 1. The method for acquiring sensitivity information according to item 1. 4. The sensibility information acquisition method according to claim 1, wherein the subject's situation is a response to video presentation. 5. The sensibility information acquisition method according to claim 4, wherein in the video presentation, a video to be presented can always be selected from a result of the mapping. 6. The sensibility information acquiring method according to claim 4, wherein the presented video is obtained through a communication line or a communication line with a video providing service. 7. The method according to claim 5, wherein the video is accompanied by a sound. 8. The system according to claim 1, wherein the situation is image information on a line of sight.
Sensitivity information acquisition method described in. 9. The system according to claim 1, wherein the condition is image information on a pupil.
Sensitivity information acquisition method described in. 10. The system according to claim 1, wherein the situation is image information relating to blinking.
Sensitivity information acquisition method described in. 11. A sentiment information source input device for obtaining a subject's situation, and a sentiment information determining device for obtaining sentiment information of the subject by mapping the inputted subject's situation with a mapping information database. A kansei information acquisition system device, characterized in that: 12. An image presenter for presenting an image to a subject, a sentiment information source input device for inputting the condition of the subject, and a sensitivity of the subject by mapping the input condition of the subject with a mapping information database. A sentiment information acquisition system device, comprising: an emotion information judgment unit that obtains information. 13. The sentiment information acquiring system according to claim 11, wherein the mapping information database is connected to a sentiment information judging device via a communication line or a communication line network. 14. The sensibility information acquisition system apparatus according to claim 12, wherein the video presenter is connected to a video providing service via a communication line or a communication line network. 15. The apparatus for acquiring a sentiment information according to claim 13, wherein the picture presenter is configured to be able to instantaneously switch a picture to be presented based on an output result of the sentiment information determiner. . 16. The sensibility information acquisition system apparatus according to claim 12, wherein the video presenter comprises a sound generating means for sound accompanying the video. 17. The apparatus according to claim 11, wherein said sensitivity information source input device is an imaging means capable of capturing image information relating to a line of sight.
Or the affective information acquisition system device according to 16. 18. The sensibility information source input device is an imaging means capable of freely taking image information on a pupil.
Or the affective information acquisition system device according to 16. 19. The sensibility information source input device is an imaging means capable of freely capturing image information relating to blinks.
Or the affective information acquisition system device according to 16. 20. The apparatus according to claim 11, wherein the image presenter is integrated with the emotion information source input device and the emotion information judgment device.
The sensibility information acquisition system device according to 5, 16, 17, 18 or 19.