JPH0923451A - Sensitivity response controller - Google Patents

Abstract

PROBLEM TO BE SOLVED: To detect sensitivity information and to control the response of a unit. SOLUTION: A first sensor 4 detecting the skin temperature of the forehead and a second sensor 5 detecting the skin temperature of the nose are respectively provided for glasses for stereoscopic picture. An exciting degree is outputted from an exciting degree data conversion circuit 9 based on the detection outputs. A second sensor 7 detecting blinks is provided for the glasses for solid video view and a fatigue degree is outputted from a fatigue degree data conversion circuit 10 based on the detection output. A three-dimensional effect emphasis degree is outputted from a three-dimensional effect emphasis degree control circuit 11 based on the exciting degree and the fatigue degree. Thus, the delay quantity of a field memory 14 in a stereoscopic television receiver executing two-dimensional/three-dimensional conversion is controlled by the three- dimensional effect emphasis degree.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a sensory response control device whose output is controlled according to sensory information such as excitement and fatigue.

[0002]

2. Description of the Related Art A conventional stereoscopic image reproducing apparatus using glasses with shutters alternately reproduces images for the right and left eyes on a monitor screen and closes a shutter for the left eye while reproducing an image for the right eye. In order to adopt a configuration in which the shutter for the right eye is closed during playback of the left-eye image, a shutter control light emitter is provided in the stereoscopic image playback device body, and the shutter drive state of the glasses is controlled in synchronization with this light emitter. doing.

[0003]

However, it is generally said that the eyes tend to get tired when watching a stereoscopic image for a long time as compared with the case of watching a normal image. Therefore, when the degree of excitement of the user increases, it is necessary to emphasize the degree of stereoscopicity, and when the degree of fatigue increases, it is necessary to suppress or eliminate the degree of stereoscopicity.

[0004]

The present invention is characterized by detecting sensitivity information and controlling response output, and the sensitivity information to be detected is, for example, excitement degree information or fatigue degree information. Is characterized by. The excitement information should be detected based on the temperature difference between the forehead and the nose, the temperature of the forehead and the nose should be detected by a sensor attached to the glasses, and the glasses should be stereoscopic image viewing glasses that open and close in synchronization with the image. The feature is that the degree of emphasis of a stereoscopic image is controlled.

The fatigue information is detected based on the blink frequency of the eyes, the blink is detected by a sensor attached to the glasses, and the glasses are stereoscopic images for opening and closing in synchronization with the image. Is controlled.

[0006]

BEST MODE FOR CARRYING OUT THE INVENTION The present invention will be described below with reference to an illustrated embodiment. In this embodiment, the present invention is applied to a stereoscopic television receiver that converts a two-dimensional image into a stereoscopic image and displays the stereoscopic image. The output state of the stereoscopic image that is detected by detecting the kansei information of the user is displayed. It is characterized by controlling.

In this embodiment, the degree of excitement of the user is detected as the sensitivity information. The relationship between the degree of excitement and the forehead and nose temperatures of the user's forehead is shown in the graphs of FIGS. 2 and 3. The graph of FIG. 2 shows the temporal changes in the average skin temperature of the forehead and the average skin temperature of the nose for 40 minutes for the subjects who watch TV, and the graph of FIG. 3 corresponds to FIG. 2 and self-reports the degree of excitement. Values are given as a percentage. As is clear from both figures, there is a correlation between the degree of excitement and the temperature difference between the forehead and the nose. When the correlation is mathematically expressed, the excitement degree K is K =
It was confirmed to be expressed as 33.59 (skin temperature of nose-forehead skin temperature). However, the condition that this equation holds is when the forehead skin temperature is 34 to 35 ° C.

Further, in this embodiment, the degree of fatigue of the user is detected as the sensitivity information. The relationship between the fatigue level and the blink frequency of the user's forehead is shown in the graphs of FIGS. 4 and 5.
The graph of FIG. 4 shows the number of blinks per minute (blink frequency) of a subject watching television for 40 minutes, and shows the change in blink frequency over time. The graph of FIG. 5 corresponds to FIG. 4 and shows the self-reported value of fatigue level in percent. As is clear from both figures, there is a correlation between the degree of fatigue and the blink frequency. It was confirmed that the degree of fatigue G was expressed as G = 2.08 (blink frequency) when the correlation was mathematically expressed.

In order to detect the above-mentioned sensitivity information, in this embodiment, a sensor is incorporated in stereoscopic image viewing glasses as shown in FIG. As is apparent from FIG. 1, a light receiving element 1 for receiving the light of an infrared lamp for switching control on the stereoscopic television receiver side is provided on the front side of the spectacles, and in synchronization with the output of the light receiving element 1. , The shutters 2 and 3 of the glasses are alternately opened and closed.

In the present embodiment, in addition to the above-mentioned structure, a contact type first temperature sensor 4 and a second temperature sensor 5 which come into contact with the forehead part and the nose part on the back side of the center of the spectacles are provided.
Both sensor outputs are input to the temperature difference data conversion circuit 6. This temperature difference data conversion circuit 6 converts the temperature difference into temperature difference data which is a digital value based on the outputs of the first and second sensors, and then excites the temperature difference data by the excitement degree data conversion circuit 9 in the next stage. Converted to degree data K.

On the other hand, below the right-eye shutter 2, a non-contact third sensor 7 that allows a small CCD camera is provided toward the lower eyelid of the right eye, and the light reception output of the third sensor 7 is provided. It is input to the blink frequency data generation circuit 8. This blink frequency data generation circuit calculates and counts the number of blinks per minute to convert it into blink frequency data, and then converts the blink frequency data into fatigue level data G in the fatigue level data conversion circuit 10 in the next stage. .

In the present embodiment, these excitement degree data K and fatigue degree data G are supplied to the stereo enhancement degree control circuit 11. The stereo enhancement degree control circuit 11 switches the stereo enhancement degree from four levels of 0 to 3 based on both data. For example, when the fatigue level data G is less than 60, the excitement level data K
If is 50 or more, the degree of stereo enhancement is 3, and the excitement degree data K is 5
When the degree of fatigue data G is 60 or more, the degree of stereoscopic emphasis is set to 2 when the degree of fatigue data G is 60 or more, and when the degree of excitement data K is 50 or more, the degree of stereoscopic emphasis is 1, and when the degree of excitement data K is less than 50 It is preset so that the degree is set to 0 (that is, two-dimensional image display) (see FIG. 6).

Regarding the preset mentioned above, for example,
Only when the fatigue level data G is less than 60 and the excitement level data K is 50 or more, the stereoscopic emphasis level is continuously changed in the range of 0 to 3 according to the excitement level, and the viewing period of the stereoscopic video is limited. Thus, the user's impression may be more strongly appealed (see FIG. 7). In this embodiment, the boundary value 50 of the excitement level data K and the boundary value 6 of the fatigue level data G described above are used.
The setting of 0 is set so that it can be changed and set from the outside together with the degree of stereoscopic emphasis depending on the preference of the user and individual differences.

The stereoscopic television receiver portion for controlling the stereo enhancement will be described below. When a two-dimensional image is input to the input terminal IN, it is supplied to the image switching circuit 17 and the field memory 14. The field memory 14 delays the input two-dimensional video by a predetermined field and outputs it.
It is supplied to the video switching circuit 17. The delay amount of the field memory 14 is variably controlled by the memory control circuit 16 in units of fields.

The video switching circuit 17 switches between two types of input video, delayed and non-delayed video, to the left-eye video L and the right-eye video according to the moving direction of the object. Further, the two-dimensional video input from the input terminal IN is also input to the motion vector detection circuit 13, and after the motion vector according to the motion between fields of the video is detected, the CP
Supplied to U15.

The CPU 15 extracts the horizontal component of the detected motion component and controls the memory control circuit 16 according to the extracted horizontal component. That is, when the motion of the subject is large and the motion vector is large, the delay amount of the field memory 14 is controlled to be small, and conversely, when the motion of the subject is small or the motion vector is small as in slow motion reproduction. , The field memory 14 is controlled so as to increase the delay amount.

In the present embodiment, the stereo enhancement degree information is also input to the CPU 15, and the delay amount described above is increased or decreased in accordance with the stereo enhancement degree information that changes in the range of 0 to 3. Further, the CPU 15 sets the delayed image as the right-eye image when the direction of the motion vector is from left to right, and the delayed image as the left-eye image when the direction of the motion vector is from right to left. Then, the video switching circuit 17 is controlled.

Therefore, in a scene in which a subject moves horizontally in a two-dimensional image, parallax occurs according to the speed of movement. Then, the left and right images are output as stereoscopic images from the pair of output terminals and input to the combining circuit 18 in the next stage. The synthesizing circuit 18 compresses the right-eye image and the left-eye image in half along the time axis, and then alternately switches and synthesizes them at a field cycle to output a 1-channel stereoscopic image having a field cycle of 120 Hz. This stereoscopic image is
Each field is composed of 262.25 lines so that 1/4 line interlaced reproduction is performed. Regarding the synthesis of this 1/4 interlaced video, Japanese Patent Laid-Open No. 6-58242
This is a well-known technique disclosed in Japanese Patent Laid-Open No. 1-212190, and a detailed description thereof will be omitted.

At the same time, the synthesizing circuit 18 supplies a switching signal in synchronism with the stereoscopic image switching / combining to the infrared lamp 12 in order to control the shutter of the stereoscopic image viewing spectacles so that the lamp blinks at 60 Hz. . The synthesizing circuit 18 supplies the synthesized stereoscopic image to a monitor 19 having a doubled vertical synchronizing frequency, and the monitor 19 alternately outputs left and right images.

In conjunction with this switching, the shutters of the stereoscopic image viewing spectacles are also switched so that the right eye is provided with the image for the right eye and the left eye is provided with the image for the left eye.
In the above-described embodiment, the glasses and the stereoscopic television receiver are connected by wire, but if the glasses are provided with a transmitting means to make them wireless, the operability is further improved. Further, although the above-described embodiment shows an embodiment in which the present invention is applied to a stereoscopic video reproducing apparatus, the invention according to claim 1 can be applied to various devices, particularly, an air conditioner, It is suitable for use in devices that require adjustment with a remote control during use, such as electric fans, lighting, and radio-cassettes.It detects various sensitivity information such as temperature, brightness, sound quality, and image quality, and is comfortable for users. It controls equipment to provide the environment.

The invention of the second aspect uses the sensitivity information as the excitement degree information, and not only the temperature difference between the nose and the forehead,
It is sensitivity information that can be detected from an electroencephalogram or an electrocardiogram. Further, in the invention of the third aspect, the degree of excitement is detected by the sensor of the forehead and the skin temperature of the nose, but the sensor may be a contact sensor or a non-contact sensor, for example, an infrared camera. The skin temperature may be obtained by analyzing the image taken in.

Further, in the fourth aspect of the invention, the spectacles are provided with the sensor, and the excitement degree may be measured not only by the stereoscopic spectacles but also by the ordinary spectacles. Furthermore, the fifth and sixth terms
In the invention of the item, the stereoscopicity is switched to binary or multivalued according to the degree of excitement, but both of these switchings may be arbitrarily set depending on the combination situation.

The invention according to the seventh aspect uses the sensitivity information as the fatigue level information, and is the sensitivity information that can be detected not only by the blink but also by the swing of the pupil. Furthermore, in the invention of the ninth aspect, the sensor is provided in the eyeglasses, and the fatigue degree may be measured not only in the stereoscopic eyeglasses but also in ordinary eyeglasses. Furthermore, in the inventions of the 10th and 11th aspects,
Although the stereoscopicity is switched between binary and multi-valued according to the degree of fatigue, both of these switchings may be arbitrarily set depending on the combination situation.

[0024]

As described above, according to the present invention, the device is controlled to a desired state according to the sensitivity of the user, and ideal control is realized. Further, the present invention controls the device by detecting the degree of excitement and the degree of fatigue as the sensitivity information,
It is possible to provide the user with optimal impression without fatigue.

Further, according to the present invention, since the spectacles are provided with the sensors to detect the sensitivity information, the operability can be improved. Further, according to the present invention, a sensor is provided on the stereoscopic viewing glasses to control the stereoscopicity, so that it is possible to detect the necessary affective information without giving the user an extra sense of discomfort.

[Brief description of drawings]

FIG. 1 is a circuit block diagram of a stereoscopic television receiver showing an embodiment of the present invention.

FIG. 2 is a graph showing changes over time in skin temperature of the nose and forehead.

FIG. 3 is a graph showing a change over time in the self-reported value of the degree of excitement corresponding to FIG.

FIG. 4 is a graph showing changes in blink frequency over time.

FIG. 5 is a graph showing a change over time in a self-reported value of fatigue level corresponding to FIG.

FIG. 6 is a diagram showing a first example of a degree of stereo enhancement corresponding to a degree of fatigue and a degree of excitement.

FIG. 7 is a diagram showing a second example of the degree of stereo enhancement corresponding to the degree of fatigue and the degree of excitement.

[Explanation of symbols]

 4 1st sensor 5 2nd sensor 7 3rd sensor 11 3D emphasis control

Claims (11)

[Claims] 1. A kansei response control device characterized by detecting kansei information and controlling a response output. 2. The affective response control device according to claim 1, wherein the affective information is excitement degree information. 3. The excitement degree information is detected based on a difference in skin temperature between the user's forehead and nose.
The emotional response control device described. 4. The user's forehead and nose skin temperature are detected by a sensor provided on eyeglasses worn by the user,
The sensory response control device according to claim 3, characterized in that. 5. The glasses are glasses having a shutter function that opens and closes in synchronization with a stereoscopic image, the response output is a stereoscopic image and a two-dimensional image, and the control is a skin temperature difference between a user's nose and a forehead. The emotional response control device according to claim 4, wherein the two-dimensional image is switched to a three-dimensional image in accordance with the above. 6. The glasses are glasses having a shutter function of opening and closing in synchronization with a stereoscopic image, the response output is a stereoscopic image and a two-dimensional image, and the control is a skin temperature difference between a user's nose and a forehead. The sensitivity response control device according to claim 4, wherein the stereoscopicity of the stereoscopic image is emphasized in accordance with. 7. The affective response control device according to claim 1, wherein the affective information is fatigue level information. 8. The emotional response control device according to claim 7, wherein the fatigue level information is detected based on a blink frequency of the user. 9. The emotional response control device according to claim 8, wherein the blink of the user is detected by a sensor provided on the glasses worn by the user. 10. The eyeglasses are eyeglasses having a shutter function of opening and closing in synchronization with a stereoscopic image, the response output is a stereoscopic image and a two-dimensional image, and the control outputs the stereoscopic image according to a blink frequency. The sensory response control device according to claim 9, wherein switching to a two-dimensional image is performed. 11. The glasses are glasses having a shutter function that opens and closes in synchronization with a stereoscopic image, the response output is a stereoscopic image and a two-dimensional image, and the control is a stereoscopic image of the stereoscopic image according to a blink frequency. The sensitivity response control device according to claim 9, wherein the sensitivity is suppressed.