JP2000092523A - Image display device provided with image pickup function - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display device with an image display and an image pickup, to allow the image pickup to pick up the eyes of a user viewing a picture displayed by the image display and to accurately specify the user viewing the picture or confirm his (or her) intention based on an image pickup output obtained from the image pickup part. SOLUTION: The image display device is provided with the image pickup 23 for picking up an iris pattern image or a blinking state of the eyes of a user viewing a picture displayed by the image display 21 while the eyes of the user viewing the picture are illuminated by light from the screen of the image display 21. The device is also provided with an operation control 26 for obtaining an iris signal expressing the iris pattern image of the eyes or a blinking signal expressing the blinking of the eyes based on an image pickup output signal extracted from the image pickup 23 by an image pickup output signal processing 38 under the control of an image pickup output extraction control 37 and specifying the user viewing the picture based on the iris signal or the blinking signal or confirming the intention of the user viewing the picture.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION The invention described in the claims of the present application displays an image based on a video signal on a screen, captures the eyes of a person viewing the screen, and uses the captured output based on the captured output. The present invention relates to an image display device having an imaging function capable of obtaining data on the person.

[0002]

2. Description of the Related Art With the development of television broadcasting technology and data communication technology, information exchange via a television receiver has been performed in various forms. For example, a pay-broadcast program system that enables a broadcast program signal from a specific television broadcast station to be effectively received only by a television receiver for which a reception contract has been previously made, an image provided by the television receiver, 2. Description of the Related Art Electronic commerce systems and the like in which viewers conduct commercial transactions such as product purchases according to audio information have been put to practical use. Also, audience rating survey systems for estimating and investigating individual audience ratings for specific broadcast programs through reception of specific broadcast program signals by a television receiver have been used for various purposes.

[0003] In a pay-broadcast program system, a receiving contract is made for a television receiver. Therefore, according to a television receiver for which a receiving contract has been made, broadcasting can be performed regardless of who the viewer is. The program signal is effectively received. Therefore, for example, depending on the audience, a receiving contract is made for each individual, and when the subscriber is a viewer, or only when a plurality of persons including the subscriber are viewers, There is also a system that enables a television receiver to receive a broadcast program signal effectively.
This is what we want. In such a case, it is necessary that a device for individually specifying a viewer of the television receiver be provided at or near the television receiver.

[0004] Further, even in the electronic commerce system, it is necessary that viewers who conduct commerce be individually specified. In such a case, a method of identity verification using a credit card is usually employed. . However, in consideration of the problem of credit card plagiarism, etc., a device for individually identifying the viewer of the television receiver is provided at or near the television receiver, and the personal identification information obtained thereby is used as a counterpart of the commercial transaction. It is desired to be transmitted to the side.

[0005] Further, in the audience rating survey system,
To improve the reliability of the survey results, the broadcast program provider
It is necessary to know exactly who the viewer is for the television receiver that is reproducing the information content of the specific broadcast program. Therefore, a device for individually specifying the viewer of the television receiver is provided at or near the television receiver, and the personal identification information obtained thereby is transmitted to the broadcast program provider side. It is desired.

[0006]

As described above, from various viewpoints, it is required that a device for individually specifying a viewer of the television receiver be provided at or near the television receiver. However, in such a device, in specifying the viewer, for the specified viewer, for example, an operation on an operation unit provided in the television receiver, or a remote controller attached to the television receiver It is desirable that no burden is imposed on operations and the like. Therefore, an apparatus has been proposed in which imaging means is provided in association with a television receiver, and the viewer is specified based on an imaging output signal for the viewer obtained from the imaging means. For example, JP-A-7-2
Japanese Patent Application Publication No. 3012 and Japanese Patent Application Laid-Open No. Hei 7-222208 also disclose devices intended to identify or identify an individual by capturing a viewer of a television receiver with a camera (imaging means). .

However, in an apparatus for individually specifying a viewer for a television receiver using a conventionally proposed imaging means, illumination light for imaging the viewer is required, and illumination for that purpose is required. It is necessary to provide a means, and there is a problem that the viewer feels annoying that the illumination light is applied. Further, when the viewer is imaged, there is a disadvantage that light from the image screen of the television receiver is reflected on the viewer, making it difficult to accurately capture the image of the viewer. Further, in the television receiver, a horizontal scanning period and a horizontal blanking period and a vertical scanning period and a vertical blanking period are set for forming each image screen. However, due to the influence of the horizontal blanking period and the vertical blanking period in the television receiver, a problem arises in that a good image pickup output signal cannot be obtained. Any of these inconveniences may result in an inability to accurately identify a viewer for the television receiver.

In view of the above, the invention described in the claims of the present application includes an image display unit for displaying an image based on a video signal on a screen, and an image pickup unit arranged in association with the image display unit. The eye of the person watching the screen displayed by the unit is imaged by the imaging unit, whereby the individual identification or intention confirmation of the person watching the screen can be accurately performed based on the imaging output obtained from the imaging unit. And an image display device having an imaging function.

[0009]

An image display apparatus having an image pickup function according to the invention described in any one of claims 1 to 3 of the present application is capable of displaying an image based on a video signal. An image display unit for sequentially displaying a screen on a frame screen basis, a video signal supply unit for selectively supplying a video signal to the image display unit, and an iris pattern image of an eye of a person who views a screen displayed by the image display unit Alternatively, an image pickup unit that picks up an image of a blinking state while the eyes of a person watching the screen is illuminated by light from the screen displayed by the image display unit, and an image pickup output signal obtained from the image pickup unit is selectively extracted. An imaging output signal processing unit, an imaging output extraction control unit that controls an extraction state of an imaging output signal obtained from the imaging unit by the imaging output signal processing unit, and an imaging output signal under control of the imaging output extraction control unit. Based on the imaging output signal extracted by the control unit, an iris signal representing a pattern image of an iris in the eyes of the person viewing the screen or a blink signal representing a blinking state in the eyes of the person watching the screen is obtained. An operation control unit that identifies an individual who views the screen or confirms the intention of the person who views the screen.

An image display apparatus having an image pickup function according to any one of claims 4 to 8 of the present application provides an image based on a video signal on a frame screen basis. An image display unit for sequentially displaying a screen, a video signal selection unit for selectively supplying a video signal to the image display unit, and an iris pattern image of an eye of a person who views a screen displayed by the image display unit. An image pickup unit that picks up an image while being illuminated by light from a screen displayed by an image display unit, an image pickup output signal processing unit that selectively extracts an image pickup output signal obtained from the image pickup unit, and an image pickup output signal processing unit Output control section for controlling the output state of the imaging output signal obtained from the imaging section, and causing the video signal selection section to assume a specific signal supply state for supplying the video signal for the imaging screen to the image display section. At the same time, the imaging output extraction control unit controls the imaging output signal processing unit to extract an imaging output signal obtained from the imaging unit in synchronization with the specific signal supply state, and the imaging output signal processing unit extracts the imaging output signal processing unit. An operation control unit that obtains an iris signal representing a pattern image of an iris in the eyes of the person viewing the screen based on the imaging output signal, and specifies an individual of the person viewing the screen based on the iris signal. It is composed.

[0011] In the image display apparatus having an image pickup function according to any one of the first to third aspects of the present invention configured as described above, an image display is provided. The image or blinking state of the iris in the eyes of the person viewing the screen displayed by the image display unit is displayed by the image display unit by the imaging unit provided in association with the unit. An image is captured while being illuminated by light from the screen, and an imaging output signal obtained from the imaging unit is transmitted to the imaging output signal processing unit by the imaging output extraction control unit, for example, of the imaging output signal obtained from the imaging unit. Under the control of causing the image to be taken out in synchronization with horizontal scanning and vertical scanning for forming each frame screen in the image display unit, the image is taken out by the imaging output signal processing unit, and the operation is performed. An iris signal representing a pattern image of an iris in the eyes of the person viewing the screen or a blink representing a blinking state in the eyes of the person viewing the screen, based on the imaging output signal extracted by the imaging output signal processing unit. A signal is obtained, and based on the signal, individual identification of the person who views the screen or confirmation of the intention of the person who views the screen is performed.

Further, in the image display device having an image pickup function according to the invention according to any one of claims 4 to 8 in the claims of the present application configured as described above, An image of an iris in the eyes of a person viewing the screen displayed by the image display unit is illuminated by light from the screen where the iris is displayed by the image display unit by an imaging unit provided in association with the image display unit. The imaging output signal obtained from the imaging unit is captured by the imaging output signal processing unit by the imaging output extraction control unit.For example, the extraction of the imaging output signal obtained from the imaging unit is performed by the image display unit. Under the control of performing the control in synchronization with the horizontal scanning and the vertical scanning for forming each frame screen, the operation is controlled by the operation control unit while being extracted by the imaging output signal processing unit. The video signal selecting unit is caused to take a specific signal supply state for supplying the video signal for the imaging screen to the image display unit, and is illuminated with light from the imaging frame screen obtained on the image display unit according to the video signal for the imaging screen. In addition to the above, the imaging unit picks up an image of the iris pattern image in the eyes of the person who views the screen, and specifies the image output selection unit to use the image signal selection unit as the image output signal processing unit. Control is performed to take out an imaging output signal obtained from the imaging unit in synchronization with the signal supply state, and
An iris signal representing a pattern image of an iris in the eyes of a person viewing the screen is obtained based on the imaging output signal extracted by the imaging output signal processing unit, and an individual person viewing the screen based on the iris signal is obtained. Identification is performed.

According to the image display device having the image pickup function according to any one of the first to third aspects of the present invention, the image is displayed by the image display unit. The imaging unit captures an image of the iris pattern image or the blinking state in the eyes of the person viewing the screen under a state where a high quality imaging output signal is obtained, and also extracts an imaging output signal obtained from the imaging unit. Is performed without being affected by the horizontal blanking period and the vertical blanking period that occur in connection with the formation of each image screen in the image display unit, and as a result, the individual who views the screen or looks at the screen The intention of the person is confirmed accurately.

According to the image display device having the image pickup function according to any one of claims 4 to 8 in the claims of the present application, the screen displayed by the image display unit The image of the iris pattern image in the eyes of the person watching the image is captured by the imaging unit. And the extraction of the imaging output signal obtained from the imaging unit is adversely affected by the horizontal blanking period and the vertical blanking period that occur in connection with the formation of each image screen in the image display unit. As a result, personal identification of a person who looks at the screen is accurately performed.

[0015]

FIG. 2 shows an external view of an example of an image display device having an imaging function according to the invention described in any one of claims 1 to 8 of the present application. .

The example shown in FIG. 2 includes a main body 11 functioning as a color television receiver, and an adapter 12 attached to the main body 11 and disposed on a cabinet of the main body 11, for example. The main body 11 has a cathode ray tube (CRT) for image display having a face plate portion 13 facing the outside, and the cathode ray tube for image display sequentially displays a color image based on a video signal on a frame image unit. A screen (color screen) that forms an image display section and displays a color image is obtained in the face plate section 13. Further, the main body 11 is provided with a pair of left and right speaker covers 14 which cover a speaker section including a plurality of speakers built therein.

The adapter 12 has a built-in image pickup unit for performing an image pickup operation on a subject to obtain an image pickup output signal, and an optical system 15 for projecting a subject image on the image pickup unit faces the outside. In the imaging unit incorporated in the adapter 12, a subject to be subjected to an imaging operation listens to a sound from a speaker unit incorporated in the main body 11 as necessary, and an image display cathode ray included in the main body 11. A situation that is set as an eye 16 of a person (viewer) who views the color screen obtained in the face plate portion 13 of the tube is set. Under such a condition, the imaging unit incorporated in the adapter 12 may be configured to provide a pattern image of the iris 17 in the viewer's eye 16 or a blinking state of the viewer's eye 16 as shown in FIG. Is imaged. The iris 17 in the viewer's eye 16 has a pattern unique to the viewer.

FIG. 1 shows an image having an appearance as shown in FIG. 2 and provided with an image pickup function according to any one of the first to eighth aspects of the present invention. 2 shows a configuration example of a display device.

The configuration shown in FIG. 1 includes an image display section 21 formed by an image display cathode ray tube having a face plate section 13, a speaker section 22 covered by a speaker cover section 14, and an optical system 15. The imaging unit 23 is included. Further, the configuration shown in FIG. 1 includes a signal processing unit 25 and an operation control unit 26 that controls the operation of the signal processing unit 25.

The signal processing unit 25 includes a television signal SRP reproduced by a video tape recorder (VTR) or a video disk player, a television signal STV under terrestrial television broadcasting, and
Television signal SB under satellite television broadcasting
S is provided via terminals 27, 28 and 29, respectively, and a television signal SCA provided by the cable television system is provided via terminal 30
Further, it is supplied through the transmission / reception sharing unit 31. The signal processing unit 25 responds to the control signal CS from the operation control unit 26 to control the television signals SRP, STV, SBS, and SC.
A is selected, the selected television signal SRP, STV, SBS, or SCA is subjected to various processing such as amplification processing, demodulation processing, color signal processing, etc., and selected. Television signals SRP, ST
A video signal SV and an audio signal SA based on any of V, SBS, and SCA are obtained.

Further, display data DD for displaying characters, graphics, and the like on the image display unit 21 is supplied from the operation control unit 26 to the signal processing unit 25 as needed. The display data DD from the operation control unit 26 is superimposed on the video signal SV in the signal processing unit 25.

The audio signal SA obtained from the signal processing unit 25
Is supplied to the speaker unit 22 through the audio signal amplifying unit 32. Thereby, reproduced sound based on the audio signal SA is obtained from the speaker unit 22.

The video signal SV obtained from the signal processing unit 25 or the video signal S on which the display data DD is superimposed.
V (SV + DD) is supplied to the video signal selection unit 33 and the video synchronization signal separation unit 34. The video signal selecting unit 33 is also supplied with a video signal SVP for a captured screen from a video signal forming unit 35 for a captured screen described later.

The video signal selection section 33 responds to the control signal CV from the operation control section 26 by using the video signal SV from the signal processing section 25 or the video signal SV on which the display data DD is superimposed and the video signal for imaging screen. The video signal SVP or the video signal SVP on which the display data DD is superimposed is selected by selecting one of the video signal SVP for the imaging screen from the unit 35 and the selected video signal SV or the video signal SVP for the imaging screen. The image data is supplied to the image display unit 21 through 36.
As a result, in the image display unit 21, the face plate unit 13 of the image display cathode-ray tube forming the image display unit 21 is provided with a color screen for displaying an image based on the video signal SV or a character based on the display data DD on an image based on the video signal SV. , A color image based on the video signal SVP for the imaging screen, or a color screen displaying a superimposed image, graphic, or the like is obtained.

In the video synchronizing signal separation section 34, the video signal SV from the signal processing section 25 or the display data DD
Is included in the video signal SV on which the
And the vertical synchronizing signal VS. Then, the horizontal synchronizing signal HS and the vertical synchronizing signal VS obtained from the video synchronizing signal separating unit 34 are supplied to the imaging screen video signal forming unit 35 and the imaging output extracting control unit 37.

The operation control unit 26 includes the input operation unit 4
3 is connected to the input operation unit 43, for example, by performing a keyboard operation, or
A command signal CX generated when a memory card is mounted and data is read from the memory card is
It is supplied to the operation control unit 26. The operation control unit 26 performs operation control according to the command signal CX from the input operation unit 43.

Under these circumstances, a person who views a color screen obtained by the imaging unit 23 on the face plate unit 13 of the image display cathode ray tube forming the image display unit 21;
That is, an image of the pattern image of the iris 17 in the viewer's eye 16 or the blinking state in the viewer's eye 16 is captured. In the imaging by the imaging unit 23, light from the color screen obtained in the face plate unit 13 of the image display cathode ray tube forming the image display unit 21 is used as illumination light for the eyes 16 of the viewer. Done in

When the light from the color screen obtained in the face plate section 13 is used as illumination light for the viewer's eyes 16, an image of the pattern image of the iris 17 in the viewer's eyes 16 is taken by the imaging section 23. In this case, the video signal S for the imaging screen from the imaging screen video signal forming unit 35 in the face plate unit 13
When only the imaging screen which is a color screen obtained based on the VP is used to provide illumination light to the viewer's eyes 16, and the imaging unit 23 captures an image of a blinking state in the viewer's eyes 16. A color screen sequentially obtained based on the video signal SV or the video signal SV on which the display data DD is superimposed on the face plate portion 13 is used as it is to provide illumination light to the viewer's eyes 16 as it is. As a result, the imaging output signal for the pattern image of the iris 17 in the viewer's eye 16 from the imaging unit 23 is substantially equivalent to the imaging screen video signal SVP from the imaging screen video signal forming unit 35 in the face plate unit 13. Is extracted only when an imaging screen based on the image is obtained.

The imaging by the imaging unit 23 is performed, for example, by inputting an image of the pattern image of the iris 17 in the viewer's eye 16 by the imaging unit 23 from the input operation unit 43 or by using the imaging unit 23. This is performed by supplying the operation control unit 26 with a command signal CX instructing that imaging in the blink state of the image 16 should be performed.

First, from the input operation unit 43 to the operation control unit 26
In addition, the iris 17 in the viewer's eye 16 by the imaging unit 23
When the command signal CX instructing that the imaging of the pattern image should be performed is supplied, the operation control unit 26 receiving the instruction signal CX sends the imaging screen video signal SVP to the imaging screen video signal forming unit 35. Control signal C for transmission
In addition to supplying P, the control signal CV is supplied to the video signal selection unit 33 and the imaging output extraction control unit 37.

The video signal SVP for the imaging screen transmitted from the video signal forming unit 35 for the imaging screen in response to the control signal CP from the operation control unit 26 includes the horizontal synchronization signal HS and the vertical synchronization signal obtained from the video synchronization signal separation unit 34. Synchronized with the signal VS, the video signal is supplied to the image display unit 21 through the video signal selection unit 33 and the video signal amplification unit 36, and the face plate unit 13 of the cathode ray tube for image display forming the image display unit 21 is, for example, As shown conceptually in FIG. 4, a specific color frame screen FP replacing one of the color frame screens FV sequentially obtained according to the video signal SV or the video signal SV on which the display data DD is superimposed. Is to be obtained. That is, the imaging screen obtained based on the imaging screen video signal SVP is:
It is assumed that the specific color frame screen FP does not have a plurality of continuous color frame screens.

The control signal C sent from the operation control unit 26
P is different between the case where the imaging unit 23 is a color imaging unit that can obtain an imaging output signal representing a color image and the case where the imaging unit 23 is a monochrome imaging unit that can obtain an imaging output signal representing a monochrome image. It is said.

When the imaging unit 23 is a color imaging unit, the operation control unit 26 controls the imaging screen video signal forming unit 35
The video signal SVP for the imaging screen is transmitted to the image display unit 21 through the video signal selection unit 33 and the video signal amplification unit 36.
The specific color frame screen FP obtained in the face plate section 13 of the cathode ray tube for image display forming the image display section 21 is supplied to, for example, FIG.
, A control signal CP to be generated as what is to be an intermittently obtained white frame screen FW and black frame screen FB is supplied. At this time, the interval between the white frame screen FW and the black frame screen FB is determined based on the image displayed on the color frame screen FW sequentially obtained according to the video signal SV or the video signal SV on which the display data DD is superimposed. It does not impair visual continuity. At this time, the operation control unit 26 also causes the video signal selection unit 33 to output the video signal S for the imaging screen from the video signal forming unit 35 for the imaging screen.
The specific color frame screen FP is obtained as a white frame screen FW and a black frame screen FB that appear intermittently in the face plate section 13 of the image display cathode ray tube forming the image display section 21 by the VP. Control signal CV to be selected and taken out
Supply.

As a result, in the face plate section 13 of the cathode ray tube for image display forming the image display section 21, the colors successively arranged to display an image based on the video signal SV or the video signal SV on which the display data DD is superimposed. A state where the white frame screen FW and the black frame screen FB based on the imaging screen video signal SVP from the imaging screen video signal forming unit 35 intermittently intersect with the frame screen is obtained.

Under these circumstances, the imaging output extraction control unit 37, to which the horizontal synchronization signal HS and the vertical synchronization signal VS from the video synchronization signal separation unit 34 and the control signal CV from the operation control unit 26 are supplied, Sync signal HS and vertical sync signal VS
In a period determined according to the control signal CV and the control signal CV, the imaging output signal processing unit 38 that extracts the imaging output signal SI obtained from the imaging unit 23 and performs a predetermined process on the imaging output signal SI obtained from the imaging unit 23 A control signal CT for performing the extraction is supplied. The control signal CT from the imaging output extraction control unit 37 is supplied to the imaging output signal processing unit 38,
Accordingly, the imaging unit 2 by the imaging output signal processing unit 38
3, the image display unit 21 is formed during a period in which the image signal selection unit 33 based on the control signal CV extracts the image signal SVP from the image signal generation unit 35. This is performed in synchronization with horizontal scanning and vertical scanning for forming each frame screen in the face plate section 13 of the image display cathode-ray tube to be performed. During the period in which the imaging output signal processing section 38 takes out the imaging output signal SI from the imaging section 23, the video signal selection section 33 based on the control signal CV uses the imaging screen video signal forming section 35 from the imaging screen video signal forming section 35. The image display unit 21 during the period in which the video signal SVP is taken out
Plate portion 1 of a cathode ray tube for image display for forming an image
3 in synchronization with the horizontal scanning and vertical scanning for forming each frame screen in the horizontal video signal SVP extracted by the video signal selecting unit 33 based on the horizontal synchronizing signal HS and the vertical synchronizing signal VS. This is a period excluding the ranking period and the vertical blanking period.

As a result, in the image pickup output signal processing section 38, the image signal selection section 33 takes out the image display screen image signal SVP from the image pickup screen image signal formation section 35, and thus forms the image display section 21. In the face plate section 13 of the cathode ray tube for image display to be performed, the video signal SV for the imaging screen extracted by the video signal selecting section 33
During the period in which the white frame screen FW and the black frame screen FB based on P are obtained, the imaging output signal SI from the imaging unit 23 is adversely affected by the horizontal blanking period and the vertical blanking period in the imaging screen video signal SVP. Taken out without.

In the face plate section 13 of the cathode ray tube for image display forming the image display section 21, a white frame screen FW and a black frame screen FB based on the image signal SVP for the imaging screen extracted by the image signal selection section 33.
Are obtained, the white frame screen FW obtained on the face plate unit 13 by the imaging unit 23 is displayed.
And the iris 17 in the viewer's eye 16 under the condition that light from each of the black frame screen FB and the black frame screen FB is used as illumination light.
Is picked up, and an image pickup output signal SI obtained thereby is sent from the image pickup unit 23. Therefore, in the imaging output signal processing unit 38, the imaging unit 23
White frame screen F obtained on face plate section 13
An image of the pattern image of the iris 17 in the viewer's eye 16 illuminated by the light from each of the W and black frame screens FB is captured, and the resulting imaging output signal SI is extracted from the imaging unit 23. .

In the imaging output signal processing section 38, the iris signal SIR representing the pattern image of the iris 17 in the viewer's eye 16 based on the imaging output signal SI extracted from the imaging section 23 as described above. Is formed, and the iris signal SIR is supplied to the operation control unit 26.

The iris signal S from the imaging output signal processing section 38
In the operation control unit 26 to which the IR is supplied, the white frame screen component SIRW formed under the condition that the white frame screen FW is obtained on the face plate unit 13 in the iris signal SIR is converted into the face plate unit 13 in the iris signal SIR. An operation (SIRW-SIRB) for subtracting the black frame screen component SIRB formed under the condition that the black frame screen FB is obtained is performed. As a result, the iris 17 in the viewer's eye 16 is changed to the face plate section 13.
In addition to the light from the white frame screen FW, the influence of being illuminated by the ambient light mainly including sunlight and the electric offset and the like are removed and the face plate portion 13 is obtained. Iris 1 in viewer's eye 16 illuminated by light from white frame screen FW
A corrected iris signal appropriately representing the pattern image of No. 7 is obtained. Then, based on the corrected iris signal, accurate iris data for the viewer is formed.

Subsequently, the operation control unit 26 reads the iris data DIC for verification stored in advance from the data memory unit 39, and iris data of the viewer is collated with the iris data DIC for verification. . Then, personal identification of the viewer is performed based on the collation result.

As described above, the result of the individual identification of the viewer performed by the operation control unit 26 is provided as display data DD representing the result and supplied from the operation control unit 26 to the signal processing unit 25. Face plate portion 13 of a cathode ray tube for image display forming image display portion 21
And the specified result data DII representing the result is converted into a voice signal by the telephone modem unit 40, transmitted to the telephone line through the telephone line connection unit 41, and transmitted to a predetermined destination.

When the image pickup section 23 is a monochrome image pickup section, the operation control section 26 controls the image signal forming section 3 for the image pickup screen.
5, the image signal SVP for the imaging screen is transmitted to the image display unit 2 through the image signal selection unit 33 and the image signal amplification unit 36.
1, the specific color frame screen FP obtained in the face plate section 13 of the image display cathode ray tube forming the image display section 21 is intermittently, for example, as conceptually shown in FIG. A white frame screen FW, a complementary color frame screen FC for red,
A control signal CP to be generated as what is to be the complementary green color frame screen FM and the complementary blue color frame screen FY is supplied. At that time, the white frame screen FW,
The interval between each of the complementary color frame screen FC for red, the complementary frame frame for green color FM, and the complementary frame frame for blue color FY is determined by a color frame sequentially obtained according to the video signal SV or the video signal SV on which the display data DD is superimposed. The visual continuity of the image displayed on the screen FV is not impaired. At this time, the operation control unit 2
6, the image signal selecting unit 33 receives the image signal SVP from the image signal forming unit 35, and the image display cathode-ray tube face plate unit 13 forming the image display unit 21. A specific color frame screen FP appears intermittently as a white frame screen FW, a complementary color frame screen for red FC, and a complementary color frame screen F for green.
M and a control signal CV which is selected and taken out so as to be obtained as a complementary color frame screen FY for blue is supplied.

As a result, in the face plate section 13 of the cathode ray tube for image display forming the image display section 21, the color signals successively displayed to display an image based on the video signal SV or the video signal SV on which the display data DD is superimposed. On the frame screen, a white frame screen FW, a complementary color frame screen FC, a complementary green frame screen FM and a complementary blue frame screen FY blue based on the image signal SVP for the image screen from the image signal forming unit 35 are intermittently displayed. Thus, a state of being mixed in is obtained.

Under these circumstances, the imaging output extraction control unit 37 to which the horizontal synchronization signal HS and the vertical synchronization signal VS from the video synchronization signal separation unit 34 and the control signal CV from the operation control unit 26 are supplied, Sync signal HS and vertical sync signal VS
In a period determined according to the control signal CV and the control signal CV, the imaging output signal processing unit 38 which extracts the imaging output signal SI obtained from the imaging unit 23 and performs a predetermined process is provided to the imaging output signal processing unit 38 for the imaging output signal SI obtained from the imaging unit 23. A control signal CT for performing the extraction is supplied. The control signal CT from the imaging output extraction control unit 37 is supplied to the imaging output signal processing unit 38,
Accordingly, the imaging unit 2 by the imaging output signal processing unit 38
During the period in which the image pickup output signal SI is taken out from
The video signal SV for the imaging screen from the video signal forming unit 35 for the imaging screen by the video signal selecting unit 33 based on the control signal CV.
A period excluding the horizontal blanking period and the vertical blanking period in the video signal SVP for the imaging screen extracted by the video signal selection unit 33 based on the horizontal synchronization signal HS and the vertical synchronization signal VS during the period in which P is extracted; Is done.

As a result, in the image pickup output signal processing section 38, the image signal selection section 33 takes out the image display screen image signal SVP from the image pickup screen image signal formation section 35, and thus forms the image display section 21. In the face plate section 13 of the cathode ray tube for image display to be performed, the video signal SV for the imaging screen extracted by the video signal selecting section 33
In a period in which a white frame screen FW, a complementary color frame screen for red FC, a complementary frame frame for green color FM, and a complementary frame frame for blue color FY based on P are obtained, the imaging output signal SI from the imaging unit 23 is used as the image for imaging screen. Signal S
The VP is extracted without being adversely affected by the horizontal blanking period and the vertical blanking period.

In the face plate section 13 of the cathode ray tube for image display forming the image display section 21, a white frame screen FW based on the image signal SVP for the imaging screen extracted by the image signal selection section 33 and a complementary color frame screen FC for red. , During the period in which the complementary green color frame screen FM and the complementary blue color frame screen FY are obtained,
3, the light from each of the white frame screen FW, the complementary color frame screen FC for red, the complementary frame frame for green color FM, and the complementary frame frame for blue color FY obtained on the face plate unit 13 is used as illumination light. The imaging of the pattern image of the iris 17 in the viewer's eye 16 is performed, and the obtained imaging output signal SI is output to the imaging unit 23.
Sent from. Therefore, in the imaging output signal processing unit 38, the white frame screen FW, the complementary red frame screen FC, the complementary green frame screen FM, and the complementary blue frame screen FY obtained on the face plate unit 13 are captured by the imaging unit 23. The pattern image of the iris 17 in the viewer's eye 16 illuminated by the light from each of the above is taken, and the resulting imaging output signal SI is extracted from the imaging unit 23.

In the imaging output signal processing section 38, the iris signal SIR representing the pattern image of the iris 17 in the viewer's eye 16 based on the imaging output signal SI extracted from the imaging section 23 as described above. Is formed, and the iris signal SIR is supplied to the operation control unit 26.

The iris signal S from the imaging output signal processing section 38
In the operation control unit 26 to which the IR is supplied, the white frame screen component SIRW formed under the condition that the white frame screen FW is obtained on the face plate unit 13 in the iris signal SIR is converted into the face plate unit 13 in the iris signal SIR. Complementary red color frame screen component SIRC formed upon obtaining complementary red color frame screen FC
(SIRW-SIRC), a green complementary color frame screen component SI formed on the face plate portion 13 in the iris signal SIR from the white frame screen component SIRW under the condition that the green complementary frame screen FM is obtained.
An operation of subtracting RM (SIRW-SIRM), and a complementary blue color frame screen component formed on the face plate unit 13 in the iris signal SIR from the complementary white color frame image FY in the iris signal SIR from the white frame screen component SIRW Operation for subtracting SIRY (SIRW-SIRY)
Is performed. As a result, the face plate portion 1 is substantially
The pattern image of the iris 17 in the viewer's eyes 16 corresponding to the state of being illuminated by the light from the red frame screen obtained in step 3 is obtained by removing the influence of ambient light mainly including sunlight, electrical offset, and the like. Modified iris signal, properly represented as the actual, substantially faceplate part 1
The pattern image of the iris 17 in the viewer's eye 16 corresponding to the state illuminated by the light from the green frame screen obtained in step 3 is removed from the influence of ambient light mainly including sunlight, electrical offset, and the like. The pattern of the iris 17 in the viewer's eye 16 corresponding to the corrected iris signal appropriately represented and the state substantially illuminated by the light from the blue frame screen obtained on the face plate portion 13 Assuming that the image has been removed from the influence of ambient light mainly including sunlight, an electric offset, and the like, a corrected iris signal that appropriately represents the image is obtained. And
Based on these modified iris signals, accurate iris data for the viewer is formed.

Subsequently, in the operation control section 26, the collation iris data DIC stored in advance from the data memory section 39 is read, and the iris data of the viewer is collated with the collation iris data DIC. . Then, personal identification of the viewer is performed based on the collation result.

As described above, the result of the individual identification of the viewer performed by the operation control unit 26 is provided as display data DD representing the result and supplied from the operation control unit 26 to the signal processing unit 25. Face plate portion 13 of a cathode ray tube for image display forming image display portion 21
Also, for example, the specified result data DII representing the result is converted into a voice signal by the telephone modem unit 40, transmitted to the telephone line through the telephone line connection unit 41, and transmitted to a predetermined destination. .

Next, from the input operation unit 43 to the operation control unit 26
Is supplied with a command signal CX that instructs the imaging unit 23 to perform imaging of the blinking state in the viewer's eye 16, the operation control unit 26 that receives the instruction signal CX receives the instruction signal CX.
The control signal CV is supplied to the video signal selection unit 33 and the imaging output extraction control unit 37 without transmitting the control signal CP.

At this time, the control signal CV sent from the operation control unit 26 is supplied to the video signal selection unit 33 by the signal processing unit 2.
5 and the video signal SV on which the display data DD is superimposed, is continuously extracted, and the imaging output extraction control unit 37 causes the horizontal synchronization signal HS and the vertical synchronization signal VS from the video synchronization signal separation unit 34 to be output. In the period determined according to the image output signal processing unit 38, the imaging unit 23
The control signal CT for causing the image pickup output signal SI obtained from to be extracted is transmitted. The control signal CT from the imaging output extraction control unit 37 is supplied to the imaging output signal processing unit 38, and accordingly, the period during which the imaging output signal processing unit 38 extracts the imaging output signal SI from the imaging unit 23 is performed. A period based on the horizontal synchronization signal HS and the vertical synchronization signal VS, excluding the horizontal blanking period and the vertical blanking period in the video signal SV extracted by the video signal selection unit 33 or the video signal SV on which the display data DD is superimposed. Is done.

As a result, in the imaging output signal processing section 38, the video signal SV or the video signal SV on which the display data DD is superimposed from the signal processing section 25 is continuously extracted by the video signal selecting section 33. Therefore, in the face plate section 13 of the image display cathode ray tube forming the image display section 21, the video signal SV or the display data DD extracted by the video signal selection section 33.
, A color frame screen corresponding to the video signal SV on which is superimposed is sequentially obtained, and the imaging output signal SI from the imaging unit 23 includes the video signal SV or the display data DD.
Are extracted without being adversely affected by the horizontal blanking period and the vertical blanking period in the video signal SV on which the image signal SV is superimposed.

At this time, in the image pickup section 23, the video signal SV or the display data D is displayed on the face plate section 13 of the image display cathode ray tube forming the image display section 21.
D are superimposed sequentially on the color frame screen corresponding to the video signal SV on which the D is superimposed, and the light from each of the color frame screens is used as illumination light.
An image of the blinking state in is taken, and an imaging output signal SI obtained thereby is transmitted from the imaging unit 23. Therefore, in the imaging output signal processing unit 38, the imaging unit 23 captures an image of the blink state in the eye 16 of the viewer illuminated by light from each of the color frame screens sequentially obtained on the face plate unit 13. The imaging output signal SI obtained as a result is
The video signal SV on which V or the display data DD is superimposed is taken out from the imaging unit 23 without being affected by the horizontal blanking period and the vertical blanking period.

In the imaging output signal processing section 38, a blink signal SIW indicating a blink state in the viewer's eye 16 is formed based on the imaging output signal SI extracted from the imaging section 23 as described above. , The blink signal SIW is supplied to the operation control unit 26.

In the operation control section 26, accurate blink state data on the viewer is formed based on the blink signal SIW from the imaging output signal processing section 38. And
Based on the blink state data, for example, the intention of the viewer is confirmed from the number of blinks within a predetermined time of the viewer who is consciously blinking.

As described above, the result of the confirmation of the viewer's intention performed by the operation control unit 26 is supplied as display data DD representing the result to the signal processing unit 25 from the operation control unit 26. Face plate portion 13 of a cathode ray tube for image display forming image display portion 21
In addition, for example, the confirmation result data DWI representing the result is converted into a high-frequency signal by a radio frequency modem (RF modem) unit 42,
1 and transmitted to the cable television signal line and transmitted to the cable television system side.

In the example shown in FIG. 1, the operation control section 26 is constituted by using a microcomputer.
When the imaging of the pattern image of the iris 17 in the viewer's eyes 16 is performed by 3, for the control operation,
For example, a program represented by the flowchart shown in FIG. 7 is executed.

In the program represented by the flowchart of FIG. 7, after the start, in step 51, the image pick-up taken out by the video signal selecting section 33 is inserted into the face plate section 13 of the cathode ray tube for image display forming the image display section 21. A white frame screen FW based on the screen video signal SVP is obtained, and the imaging output signal SI obtained from the imaging unit 23 at that time is output to the imaging output signal processing unit 3.
8 for the control signal CP
And the CV are supplied to the imaging screen video signal forming unit 35, the video signal selecting unit 33, and the imaging output extraction control unit 37, and as a result, the iris signal SIR obtained from the imaging output signal processing unit 38 is acquired.

Next, in step 52, the size of the viewer's eye 16 represented by the captured iris signal SIR is detected, and in the following step 53, based on the detection result in step 52, the viewer It is determined whether the distance to the eye 16 is appropriate. As a result, the imaging unit 23
If the distance from to the viewer's eyes 16 is not appropriate,
In step 54, display data DD for displaying a display urging the viewer to move to the imaging unit 23 is sent to the signal processing unit 25 on the face plate unit 13 of the cathode ray tube for image display forming the image display unit 21. , And sends a control signal CV for causing the video signal selection unit 33 to extract the display data DD.

Thereafter, after a predetermined waiting time has been spent in step 55, the process returns to step 51, and step 5
Steps 1 to 53 are repeated.

As a result of the determination in step 53, the imaging unit 23
If the distance from to the viewer's eyes 16 is appropriate,
In step 56, the video signal SV for the picked-up screen extracted by the video signal selection unit 33 is supplied to the face plate unit 13 of the cathode ray tube for image display forming the image display unit 21.
A control signal CP and a control signal CV for causing the imaging output signal processing section 38 to extract the imaging output signal SI obtained from the imaging section 23 at the same time as obtaining the white frame screen FW based on P Signal formation unit 35, video signal selection unit 33, and imaging output extraction control unit 3
7 and, as a result, the imaging output signal processing unit 3
The iris signal SIR obtained from 8 is fetched and stored.

Subsequently, at step 57, the image pickup unit 2
It is determined whether 3 is a color imaging unit. as a result,
If the imaging unit 23 is a color imaging unit, step 5
8, the video signal selection unit 33 is attached to the face plate unit 13 of the cathode ray tube for image display forming the image display unit 21.
A control signal for obtaining a black frame screen FB based on the video signal SVP for the imaging screen extracted by the imaging output signal processing section 38 while obtaining the imaging output signal SI obtained from the imaging section 23 at that time. The CP and the CV are converted into image signal forming units 35 and 3 for the imaging screen.
The iris signal is supplied to the image signal selection unit 33 and the imaging output extraction control unit 37, and as a result, the iris signal SIR obtained from the imaging output signal processing unit 38 is acquired and stored.

If the result of the judgment in step 57 is that the image pickup section 23 is not a color image pickup section but a black-and-white image pickup section, in step 59 the image display cathode ray tube forming the image display section 21 is set. The face plate section 13 includes a complementary color frame screen FC for red, a complementary frame frame for green color FM, and a complementary frame frame for blue color FY based on the image signal SVP for the imaging screen extracted by the image signal selection section 33.
Are sequentially obtained at a predetermined frame interval, and a complementary frame frame FC for red and a frame frame F for green are displayed.
The control signals CP and CV for causing the imaging output signal processing section 38 to extract the imaging output signal SI derived from the imaging section 23 when the M and the complementary blue frame screen FY for blue are obtained, respectively. Video signal forming unit 35, video signal selecting unit 33, and imaging output extraction control unit 3
7 and, as a result, the imaging output signal processing unit 3
8, the complementary frame frame FC for red, the frame frame FM for green and the frame frame FY for blue
The iris signal SIR from each of the above is obtained and stored, and the process proceeds to step 60.

In step 60, the iris signal SIR from which the white frame screen FW captured in step 56 is obtained and the iris signal SIR from which the black frame screen FB captured in step 58 is obtained. Or the iris signal SIR obtained when the white frame screen FW captured in step 56 is obtained and the complementary color frame screen F captured in step 59
C, a corrected iris signal is calculated based on the iris signal SIR from which each of the green-color complementary frame screen FM and the blue-color complementary frame screen FY is obtained, and further according to the corrected iris signal Iris data is formed.

Next, in step 61, the iris data obtained in step 60 is collated with the iris data for collation read from the data memory unit 39, and the individual of the viewer is specified based on the collation result. Subsequently, in step 62, display data DD for displaying the identification result in step 61 on the face plate unit 13 of the cathode ray tube for image display forming the image display unit 21 is sent to the signal processing unit 25, and the image data is displayed. A control signal CV for causing the signal selecting section 33 to extract the display data DD is transmitted, and further, specific result data DII representing the specific result in step 61 is transmitted to the telephone modem section 40.
Quit the program.

[0067]

As is apparent from the above description, according to the image display device having the image pickup function according to the invention according to any one of claims 1 to 3 of the present application, The imaging unit captures an image of the iris pattern image or the blinking state in the eyes of the person who views the screen displayed by the image display unit in a state where a high quality imaging output signal is obtained. Extraction of the obtained imaging output signal is performed without being adversely affected by the horizontal blanking period and the vertical blanking period that occur in connection with the formation of each image screen in the image display unit. Individual identification or confirmation of the intention of the person watching the screen is performed accurately.

According to the image display device having the image pickup function according to any one of claims 4 to 8 in the claims of the present application, the screen displayed by the image display unit The iris in the eye of the person viewing the screen is properly illuminated by the light from the imaging frame screen, and the image of the iris pattern image in the eye of the person watching the screen is appropriately illuminated by the light from the imaging frame screen. Influence that the iris is illuminated by ambient light mainly including sunlight in addition to light from the imaging frame screen,
And, in a state where an electrical offset or the like is removed and a high quality image output signal is obtained, extraction of the image output signal obtained from the image pickup unit is performed in forming each image screen in the image display unit. This is performed without being adversely affected by the associated horizontal blanking period and vertical blanking period, and as a result, the individual who views the screen can be accurately identified.

[Brief description of the drawings]

FIG. 1 is a block connection diagram showing a configuration of an example of an image display device having an imaging function according to the invention described in any one of claims 1 to 8 of the present application.

FIG. 2 is a perspective view showing an external appearance of an example of an image display device having an imaging function according to the invention described in any one of claims 1 to 8 in the claims of the present application.

FIG. 3 is a conceptual diagram explaining a target imaged by an imaging unit in the examples shown in FIGS. 1 and 2;

FIG. 4 is a conceptual diagram serving to explain an operation in the example shown in FIG. 1;

FIG. 5 is a conceptual diagram serving to explain the operation in the example shown in FIG. 1;

FIG. 6 is a conceptual diagram serving to explain an operation in the example shown in FIG. 1;

FIG. 7 is a flowchart showing an example of a program executed by the microcomputer constituting the operation control unit in the example shown in FIG. 1 at the time of specific operation control.

[Explanation of symbols]

11 ... body, 12 ... adapter, 13 ... face plate, 14 ... speaker cover, 15
..Optical system, 16 ... viewer's eyes, 17 ... iris,
21: image display unit, 22: speaker unit, 23
..Imaging unit, 25 ... Signal processing unit, 26 ... Operation control unit, 31 ... Communication unit, 33 ... Video signal selection unit, 34 ... Video synchronization signal separation unit, 35 ..Imaging screen video signal forming section, 37 ... Imaging output extraction control section,
38: imaging output signal processing unit, 39: data memory unit, 40: telephone modem unit, 41: telephone line connection unit, 42: RF modem unit, 43: input operation unit

Claims (8)

[Claims] An image display unit for sequentially displaying an image based on a video signal on a frame screen basis; a video signal selection unit for selectively supplying a video signal to the image display unit; An imaging unit for imaging the pattern image or the blinking state of the iris in the eyes of the person watching the screen while the eyes of the person watching the screen are illuminated by light from the screen displayed by the image display unit An imaging output signal processing unit that selectively extracts an imaging output signal obtained from the imaging unit; and an imaging output extraction control unit that controls an extraction state of the imaging output signal obtained from the imaging unit by the imaging output signal processing unit. And a pattern image of an iris in the eyes of a person viewing the screen based on the imaging output signal extracted by the imaging output signal processing unit under the control of the imaging output extraction control unit. An iris signal, or a blink signal representing a blinking state in the eyes of the person viewing the screen, and personal identification of the person viewing the screen based on the iris signal or the blink signal or a person who views the screen An image display device having an imaging function configured to include an operation control unit for confirming intention. 2. An image pickup output extraction control section in which an image pickup output signal processing section synchronizes extraction of an image pickup output signal obtained from the image pickup section with horizontal scanning and vertical scanning for forming each frame screen in an image display section. The image display device having an imaging function according to claim 1, wherein the image display device performs the image processing. 3. An image pickup output extraction control section controls an image pickup output signal processing section to output an image pickup output obtained from the image pickup section in a horizontal blanking period and a vertical blanking period related to horizontal scanning and vertical scanning in the image display section. 3. The image display device having an imaging function according to claim 2, wherein the signal is not taken out. 4. An image display unit for sequentially displaying an image based on a video signal on a frame screen basis, a video signal selection unit for selectively supplying a video signal to the image display unit, and a video signal displayed by the image display unit. An imaging unit that captures a pattern image of an iris in the eyes of a person viewing a screen while the iris is illuminated by light from a screen displayed by the image display unit; and an imaging unit that is obtained from the imaging unit. An imaging output signal processing unit that selectively extracts an output signal; an imaging output extraction control unit that controls an extraction state of an imaging output signal obtained from the imaging unit by the imaging output signal processing unit; A specific signal supply state for supplying a video signal for an imaging screen to the image display unit is set, and the imaging output extraction control unit sets the imaging output signal processing unit in synchronization with the specific signal supply state. A control is performed to extract an imaging output signal obtained from the imaging unit, and based on the imaging output signal extracted by the imaging output signal processing unit, a pattern image of an iris in the eyes of a person viewing the screen is displayed. An image display device having an imaging function configured to include an operation control unit that obtains an iris signal and specifies an individual who views the screen based on the iris signal. 5. A video signal for displaying an image frame screen by an image display unit under a specific signal supply state in a video signal selection unit, as a video signal for an imaging screen. The image display device provided with an imaging function according to claim 4, wherein the image display device is supplied to the image display device. 6. A video signal selecting section for supplying a video signal for an imaging screen to an image display section in such a manner that a specific frame screen is displayed on the image display section without being continuous. An image display device having an imaging function according to claim 5. 7. An imaging output extraction control section synchronizes an extraction of an imaging output signal obtained from the imaging section with a horizontal scanning and a vertical scanning for forming each frame screen in an image display section. 7. The image display device having an image pickup function according to claim 4, wherein the image display device is provided with the image pickup function. 8. An image pickup output control unit, in an image pickup output signal processing unit, in a horizontal blanking period and a vertical blanking period relating to horizontal scanning and vertical scanning in an image display unit, an image pickup output obtained from the image pickup unit. The image display device having an imaging function according to claim 7, wherein a signal is not taken out.