JP2000105583A - Interactive display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To quantitatively judge a set advertising board or judge the effectiveness of advertising by judging the character attribute related to an audience on the basis of a video signal to generate the attribute judgment result information, cutting out the character image on the basis of the information, and accumulating the result of a content. SOLUTION: An image input devices 101 photographs the audience of a content and outputs it as a video signal 101a based on the format of a transfer bucket regulated by IEEE 1394. An attribute judging means 102 detects that the movement of the image of a moving object formed on the basis of the video signal 101a is minimized, and then judges the character attribute related to the audience to generate attribute judgment result information 102a. The character image is cut out on the basis of the attribute judgment result information 102a. A log memory means 103 accumulates the temporal history of the character attribute judgment processing in the attribute judging means 102 together with time data.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

TECHNICAL FIELD The present invention relates to a display board for advertisement,
The present invention relates to a display device used for a guide board installed in a street, a shopping mall, or a department store. In particular, a center system, a display board on a terminal side, and a communication line connecting them are provided, and according to an input (demand) from a user, A center system or a display panel interactively changes and displays the distribution and display of content represented by still images, character information, and moving images.
e) an interactive display system with functions.

[0002]

2. Description of the Related Art Generally, a conventional display board used for a display board for an advertisement, a guide board installed in a street, a shopping mall, or a department store, as shown in FIG. A translucent panel (panel made of acrylic, etc.) with lighting means installed and printed with advertising information such as shop names and photographs and guidance information using a transparent ink on the surface is fixed to the front of the frame by covering it Hardware configuration.

[0003] However, such a display board has a problem in that it is not possible to quantitatively determine the installed advertisement board (that is, whether it is useful to a viewer) or to have an advertising effect.

[0004] To solve such a conventional problem, as shown in FIG. 21, a television camera (image input means in FIG. 21) is provided above the advertisement board, and the advertisement board is processed by image processing. Viewers (ie those who see the billboard)
The prior art for counting the number is known.

[0005] However, in such a conventional technique, there is a problem that judging the attribute of a person with a television camera requires a large-scale device.

As a display device which solves such a conventional problem, for example, as disclosed in Japanese Patent Application Laid-Open No. Hei 7-160883 (first conventional technology, claims 1, 2, and 3), the stride and the length for men and women are disclosed. There is a person attribute detection device that focuses on the difference in footsteps (first prior art, see FIG. 22).

That is, the first prior art person attribute detecting device includes a sensor for detecting a specific moment of landing of a foot in a person's walking motion, and a sensor for receiving a trigger signal from the sensor.
Means for capturing the leg image with the legs open, means for extracting the shape feature or color feature of the leg from the leg image, and means for identifying the attribute by comparing the feature with the leg image matching data. And the basic configuration.

Further, in the above basic configuration, means for extracting a characteristic of the intensity or spectrum of footsteps during walking taken by a sensor for detecting a specific moment of foot landing in a person's walking motion, and the extracted features Integrating the identification information with the identification information that has identified the attribute by comparing the identification information and the feature extracted from the leg image with the leg image comparison data. In a hardware configuration to which a means for identifying the attribute of a person is added, a feature is extracted from a leg image in which differences in the attribute of the person often appear by image processing, and the extracted feature is compared with the leg image collation data. Identify the attribute. Here, by capturing the leg image with a trigger signal based on the detection of a specific moment of landing of the foot, a normalized unblurred leg image in a constant state in which one foot is in a landing state and two legs are open is obtained. It is disclosed that image processing can be simplified and image processing can be performed so that characteristics of a person always appear stably in a specific area in an image.

Further, in the first prior art person attribute detecting device, the basic structure described above has a temporal change in foot pressure during walking captured by a sensor that detects a specific moment of landing of a foot in a walking operation of a person. Means for extracting the features of the superimposed image of the image, means for identifying the attribute by comparing the extracted features with the foot pressure matching data, and comparing the identification information and the features extracted from the leg images with the leg image matching data. Means for identifying the attribute of a person by integrating the identification information that has identified the attribute by performing the above operation. It is disclosed that an attribute is identified by comparing the attribute with data, and the attribute is integrated with the identification result from the feature of the leg image to enhance the accuracy of the identification.

Further, as disclosed in Japanese Patent Application Laid-Open No. Hei 8-249444 (second prior art, claims 1, 2, 3), an object attribute detection for patterning a motion of a person by image input and collating with a collation data. There is a method (second prior art, see FIG. 23).

That is, the second prior art object attribute detection method is an object attribute detection method for detecting an attribute of an object in an image, and extracts a region corresponding to an object to be identified from an input image as a shape figure. Process, performing a morphological process on the shape figure, obtaining a trajectory figure for each size of the structuring element, and expressing the relationship between the size of each structuring element and each of the trajectory figures as a pattern spectrum, Identifying the attribute by comparing the shape of the pattern spectrum with the shape of the pattern spectrum for comparison.

In addition, as described in Japanese Patent Application Laid-Open No. 7-302328 (third prior art, claims 1, 2, and 3), an object such as a person is extracted in a place where lighting fluctuations occur, such as outdoors. There is a moving object region extraction method using background subtraction (third method).
Conventional technology, see FIG. 24).

That is, in the moving object region extraction method of the third prior art, when an image changes, the change is caused by a change in lighting conditions, a slow background change, or the appearance or passage of a moving object. In order to detect the occurrence of the background image in a statistical manner and to appropriately update the background image only in the case of lighting fluctuations or slow background fluctuations, first, a small area including the position in each frame image is targeted. , And accumulates the time change of the numerical value of the optical characteristic parameter of each small area. Then, the time change of the numerical value is statistically processed at predetermined time intervals, and when the statistic satisfies an illumination variation estimation condition estimated to be caused by illumination variation,
The numerical value of the small area within a predetermined time is replaced with the numerical value of the same small area of the background image, and held as a new background image. The background image desired region is updated by executing such a background image small region updating process on the entire screen or on each position of a predetermined screen desired region. Using the background image that is sequentially updated in this manner, a difference process with respect to the input image is performed for the desired region. A binarization process is performed on the resulting difference processed image, and the obtained region is extracted as a moving object region. Specifically, for a small area including the position in each frame image input via the image input unit, the time change of the numerical value of the optical feature parameter of each small area is stored in the image storage unit, Statistical processing of the accumulated time change of the numerical value is performed at predetermined time intervals by the pixel value statistical processing unit of the background value updating unit, and when the statistic satisfies the illumination variation estimation condition estimated to be caused by the illumination variation, the The numerical value of the small area within a predetermined time is replaced with the numerical value of the same small area of the background image and held as a new background image. By performing the background image small area update processing by the statistical value determination unit, the mode value (average value) calculation unit, and the background value replacement unit for the entire screen or each position of a predetermined screen desired area, A desired area of the background image is updated.Next, using the background image sequentially updated by the background value updating unit, an input image input through the image input unit with respect to the desired area by the difference processing unit. Is performed. The resulting difference processed image is binarized by
The binarization process is performed, and the obtained region is extracted and output as a moving object region by a moving object region output unit.

Further, Japanese Patent Application Laid-Open No. 8-77334 (4th edition)
There is a face image feature point automatic extraction method for extracting features from a face image in an optimal detection order as shown in the prior art (claims 1, 2, 3) (fourth prior art, see FIG. 25).

[0015] That is, in the fourth conventional technique for automatically extracting feature points of a face image, the feature points of the face image include a head vertex, a right eyebrow left end point, a right eyebrow right end point, a right eyebrow upper end point, a right eyebrow lower end point, Left eyebrow left end point, left eyebrow right end point, left eyebrow upper end point, left eyebrow lower end point, right eye left end point, right eye right end point, right eye upper end point, right eye lower end point, left eye left end point, left eye right end point, left eye upper end point, left eye lower end Point, nose left end point,
Nose right end point, Nose bottom point, Lip left end point, Lip right end point, Lip top end point,
Using the lip center point, lip bottom point, nose left profile contour point, nose right profile profile point, lip left profile profile point, lip right profile profile point, chin left profile profile point, chin right profile profile point, chin lower profile point, In obtaining these feature points, binarization processing is performed in each candidate area in the order of lips, eyes, and eyebrows, and feature points are extracted from the extracted target area. With a configuration in which feature points are determined by edge processing, a feature point detection algorithm is changed depending on a face part, and detection is performed in an optimal detection order.

Also, Japanese Patent Publication No. 5-75124 (No. 5)
There is an image input / output system in which a CRT display or a plasma display or an LCD is used for a display panel and commands are input using a touch panel on the surface of the display panel (fifth prior art, see FIG. 26). ).

That is, in the fifth prior art image input / output system, characters and graphics are input as image information by drawing with a finger. A transparent conductive film is printed on both the front and back surfaces of the glass so that the resistivity is uniform. A high-resolution touch panel configured as described above is arranged on the screen of the display device, and a coordinate detection device that converts a touch position of the touch panel with a finger into X and Y coordinate values, and a coordinate signal transmitted from the coordinate detection device. Characters and figures drawn on the touch panel
The display device has a CPU for displaying correspondingly on the display device, and the screen of the display device is composed of a combination of an image input / output surface and a menu surface, and the image input / output surface is drawn using a finger on the touch panel. The menu surface is provided with a plurality of operation keys, and the keys are used to input commands to the CPU.

An information providing system using a plurality of monitors as disclosed in Japanese Patent Publication No. 2-3224 (sixth prior art, claim 4) has been proposed (sixth prior art, see FIG. 27). ).

That is, the information providing system according to the sixth prior art includes one CRT each displaying a menu including a plurality of options, two monitor receivers each displaying a moving image or a still image, and an operation. A plurality of terminal device groups including an input device for inputting start or menu selection, a still image reproducing unit for reproducing a plurality of still images, a moving image reproducing unit for reproducing a plurality of types of moving images, and an input device. Menu display means for displaying a menu of a type corresponding to the input on the CRT of the terminal equipment group where the input has been made, and still image reproduction means for each of the two monitor receivers of the terminal equipment group reproduced according to the input. An image display means for displaying a still image or a moving image reproduced by the moving image reproducing means in response to an input.

Further, as a display device used in the above display technology, an LED in which light emitting diodes (LEDs) are two-dimensionally arranged in a matrix (square matrix arrangement).
Displays are commonly used. That is, a molded light emitting display element (see FIG. 19) in which LEDs for emitting red (Red), green (Green), and blue (Blue) are formed in one mold is formed into a square as shown in FIG. A plurality of molded light emitting element integrated display panels are arranged.

Further, as shown in JP-A-7-104961 (seventh prior art, claim 6), the display order is determined in advance by a time table, the display contents are performed by a time table, and the time table is further remote-controlled. A switching display system has been proposed (seventh prior art, FIG. 28).
reference).

That is, the display system creates a news image to be displayed on the display terminal device for a news provider in order to display news, commercials, and the like on a plurality of display terminal devices installed on the street or in public facilities. A news image producing device for sending to a center, a data receiving device for receiving image data from the news image producing device to a center, a display image producing device for producing a commercial or an announcement image, etc., and the produced image data. A data recording device for recording a program, a program creation device for creating a schedule for displaying the created image on the display terminal device, and transmitting the schedule and image data created by the program creation device to each display terminal device. The image data transferred from the center is recorded in the data transmitting device and the display terminal device. It includes an image data recording unit, and a control unit for displaying on the image data recording unit according to a schedule that is recorded in said schedule recording unit. In addition, in a system for displaying news, commercials, and the like, a plurality of display terminal devices installed on a street or a public facility create a news image to be displayed on a display terminal device before a news image creation device installed on a news provider. The image data transferred from the news image creation is received by the data receiving device, the display image creation device creates a commercial or a notification image, and the created image data is sent to the data recording device. Recording a schedule to be displayed on the display terminal device for an image created by the program organizing device, transmitting a schedule and image data created by the program organizing device to each terminal display device by a data transmitting device, The device records the image data transferred from the center in the image data recording unit, Is recorded transmission schedule to the schedule recording unit, adapted to be displayed on the display unit reads from the image data the image data recording unit which corresponds reads the schedule control unit.

[0023]

However, the first prior art described above has a problem that it is intended for a person who walks around and cannot be applied to a person who is almost stationary.

Further, the above-mentioned second conventional technique has a problem that when detecting a person attribute, it cannot be applied to attribute detection in a state where the person is stopped at a free position.

Further, the above-mentioned third conventional technique is suitable for extracting a moving object, but has a problem that it is difficult to apply in a situation where the moving object enters a target area and then stands still. Was.

In the fifth prior art, the effective display area with respect to the screen is limited, and as a result, there is a problem that much information cannot be displayed.

Further, in the above-mentioned fourth prior art, although the attribute of the head appears in the hairstyle and eyebrows, there is a problem that conditions such as a high-definition input image and a direction are narrowed only by the head (face). was there.

Also, in the square matrix arrangement in the above-described conventional display technology (claim 5), it is necessary to form a fixed gap between the molded light emitting display elements,
There is a problem in that a large gap is created between the pieces, and the degree of integration does not increase as a whole.

Also, in the above-mentioned seventh prior art, there is a problem that the attributes and movements of the viewer are ignored in the same manner as the general TV broadcast (ON-AIR), and there is no advertising effect. Was.

An object of the present invention is to solve such a conventional problem. First, a quantitative judgment for an installed advertising board (that is, whether or not it is useful to a viewer) or an advertising The effect of the advertisement can be measured, and in addition to the viewers who walk around, the viewers in a stationary state can be targeted for attribute determination. Attribute can be detected for the viewer in the area, and in addition to the viewer as a moving object, the attribute can be extracted for the viewer who enters the target area and then stands still, and further, the hairstyle,
Although the attribute of the head appears in the eyebrows, the attribute can be extracted using not only the head (face) but also multiple parts, and the degree of freedom for the shooting conditions such as the resolution condition of the input image and the orientation of the viewer It is an object of the present invention to realize an interactive display device capable of increasing the number of images.

Second, it is possible to interactively display a large amount of information while avoiding a case where the effective display area of the display panel with respect to the screen is limited. It is an object of the present invention to realize an interactive display device in which the gap between the molded light emitting display elements (molded light emitting display elements) is reduced and the intermediate gap between four adjacent light emitting elements is reduced to improve the degree of integration of the light emitting elements.

It is an object of the present invention to realize an interactive display device capable of displaying, on a display board, a content having a high advertisement effect and a high degree of viewer satisfaction that matches the attributes and movements of the viewer at the best timing.

Third, it is possible to automatically monitor for breakage accidents, such as when the display board is kicked off, graffitied, damaged, or about to be taken away. Further, since the storage means stores (records) the video signal from the image input means, the display board is kicked off,
Evidence of damage accidents, such as graffiti, damage, or attempts to take away, can be automatically recorded, and the causal relationship and history of the damage accident can be recorded, and later verification, etc. It is an object of the present invention to realize an interactive display device that can be used as a powerful situation evidence photographing record at the time of.

Fourthly, as a result of judging a failure of the display means or the image input means for displaying on the display panel or a failure caused by the adhesion of dirt on the front surface of the display panel and outputting the fact, the electric means is output. In the display panel whose display contents can be changed, it is possible to detect a failure such that display is not performed due to some cause of the system, a failure such as improper display color balance, and a failure such as dirt attached to the front surface. It is an object of the present invention to realize an interactive display device capable of correctly operating a computer.

[0035]

According to a first aspect of the present invention, there is provided a display board for an advertisement, installed in a street, a shopping mall, or a department store to guide content viewing. An interactive display device used for a board, comprising: a display board for displaying to a viewer who is a person who has viewed the content; image input means for photographing the person who has viewed the content and outputting the video signal as a video signal; Attribute determining means for determining attribute of a person related to a viewer based on a video signal to generate attribute determination result information, and extracting a person image based on the attribute determination result information; and attribute determination relating to the content viewer. And an accumulating means for accumulating the result of (1).

According to the first aspect of the present invention, since a video signal is used as the image input means for photographing a person who has viewed the content, no preprocessing for image processing is required.

After the attribute determining means detects that the movement of the image of the moving object formed based on the video signal has decreased, the attribute determining means determines the attribute of the person related to the viewer and generates attribute determination result information. Therefore, in addition to the viewers walking around, the viewers in the stationary state can also be targeted for the attribute determination.

Further, when detecting the attribute of a person, the attribute can be detected even for a viewer who is in a free position and is in a stationary state. In addition, it becomes possible to extract attributes for a viewer who enters the target area and then stands still.

Thus, a quantitative determination for the installed advertising board (that is, whether it is helpful to the viewer),
Alternatively, the advertising effect can be measured.

According to a second aspect of the present invention, in the interactive display device according to the first aspect, the attribute determining means reduces the movement of the image of the moving object formed based on the video signal. After detecting
Using a template of a person shape prepared in advance,
Pattern matching with the moving object is performed in order from a person template having a small size to a person template having a large size, and the attribute of the viewer is determined based on the result of the pattern matching, and attribute determination result information is obtained. An interactive display device having a hardware configuration that generates and cuts out a human image based on the attribute determination result information.

According to the invention of claim 2, according to claim 1,
In addition to the effect described in the above, when detecting the attribute of the person, the attribute determination means, after detecting that the movement of the image of the moving object formed based on the video signal is reduced, the person prepared in advance Using the shape template, pattern matching with the moving object is performed in order from the small-sized person template to the large-sized person template, so that in addition to walking viewers, stationary viewers are also subject to attribute determination. It can be.

After detecting that the movement of the image of the moving object formed based on the video signal has decreased, the attribute determining means determines the personal attribute of the viewer based on the result of the pattern matching. Since attribute determination result information is generated and a person image is cut out based on the attribute determination result information, the attribute can be detected even for a viewer at a free position and in a stationary state. In addition, in addition to the viewer as a moving object, it is possible to extract attributes for a viewer who enters the target area and then stands still.

According to a third aspect of the present invention, in the interactive display device according to the first aspect, the attribute determining means uses a feature of a plurality of parts of the person as the person template and expresses each of the parts. The pattern matching with the moving object is performed in order from the person template of the small size to the person template of the large size with respect to the template, and the person related to the viewer is determined based on the result of the pattern matching for the person template for each part. An interactive display device with a hardware configuration that determines attribute and generates attribute determination result information and cuts out a human image based on the attribute determination result information.

According to the invention described in claim 3, according to claim 1
In addition to the effects described in the above, when detecting the attribute of the person, the attribute determining means uses the features of a plurality of parts of the person as the person template, and reduces the size of the person template from the smaller size to the person template representing each part. Since the pattern matching with the moving object is executed in order toward the person template having the largest size, not only viewers walking around but also viewers in a stationary state can be subjected to the attribute determination.

After the attribute judging unit detects that the movement of the image of the moving object formed based on the video signal has decreased, the attribute judging unit determines the movement of the image of the moving object based on the pattern matching result with respect to the person template for each part. The attribute determination result information is generated by determining the attribute of the person, and the person image is cut out based on the attribute determination result information. Can be detected, and
In addition to the viewer as a moving object, it is possible to extract attributes for viewers who enter the target area and then stand still, and although hairstyles and eyebrows show attribute features of the head, Attributes can be extracted using not only the head (face) but also a plurality of parts, and the degree of freedom for shooting conditions such as the resolution condition of the input image and the orientation of the viewer can be increased.

According to a fourth aspect of the present invention, there is provided an interactive display device installed in a display board for advertisement, a street, a shopping mall, or a department store and used as a guide board for supporting the viewing of the content. A display board to be displayed to a viewer who is a viewer, a display control means for performing display control relating to virtual display using a plurality of layers as subframes, and interactively changing contents on the center system side or the display board side Command input means for receiving a command or a virtual display command for instructing subframe display from a viewer, and analyzing the instruction content of the input command, and that the analyzed command is the virtual display command. If it is determined, a virtual display instruction using the subframe is issued. Command analysis means for outputting that as analysis information, content storage means for storing various types of content, reading and outputting content corresponding to the output request when a content output request is received, and the analysis information Display selection means for instructing the content storage means to read a content corresponding to the plurality of layers in response to the request and outputting the content corresponding to the plurality of layers received from the content storage means to the display control means The display control unit is a hardware-structured interactive display device that executes sub-frame display control using content corresponding to the plurality of layers on the entire display area of the display panel.

According to the fourth aspect of the present invention, the command input means transmits a command for interactively changing the content on the center system side or the display panel side or a virtual display command for instructing subframe display from the viewer. Receiving, in response thereto, the command analysis means analyzes the instruction content of the input command, and when it is determined that the analyzed command is a virtual display command, a virtual display instruction using a subframe is generated. Is output as analysis information, and the display control means responds accordingly.
Since display control relating to virtual display using a plurality of layers as subframes is performed on the display panel, it is possible to avoid a case where the effective display area of the display panel on the screen is limited, and as a result, a large amount of information It can be displayed interactively.

According to a fifth aspect of the present invention, there is provided an interactive display device installed on a display board for advertisement, a street, a shopping mall, or a department store and used as a guide board for assisting viewing of contents, wherein a mold light emitting device is provided. A display panel for displaying to a viewer who is a person who has viewed the content, and a display control means for controlling the display of the display panel, wherein the display panel includes the mold light emitting element. This is an interactive display device having a hardware configuration that is arranged in a diamond shape.

According to the fifth aspect of the present invention, since the light emitting elements forming the display surface of the display panel are arranged in a diamond shape,
As compared with the square matrix arrangement described above, the gap between each light emitting element (mold light emitting display element) can be reduced, and the gap between the four adjacent light emitting elements can be reduced, thereby improving the integration degree of the light emitting element. Will be able to do that.

According to a sixth aspect of the present invention, there is provided an interactive display device installed in a display board for advertisement, a street, a shopping mall, or a department store and used as a guide board for supporting content viewing. A display board for displaying to a viewer who is a viewing person, image input means for photographing a person who has viewed the content and outputting it as a video signal, and viewing using an image formed based on the video signal. Attribute determination means for determining attribute of a person and generating attribute determination result information, and extracting a person image based on the attribute determination result information; and at least one of a still image and a moving image. Content storing means for storing content in the form of viewer attribute classification data previously classified for each viewer attribute; Depending on the cross-sectional result information, an interactive display device of a hardware configuration that includes a selection means for the content to be displayed from among the viewer attribute classification data is selected and read from the content storage means.

According to the invention described in claim 6, the attribute determining means determines the personal attribute of the viewer by using the image formed based on the video signal, based on the attribute determination result information generated. In accordance with the attribute determination result information, the selection unit should display the person image from among the viewer attribute division data stored in the content storage unit (that is, the detected person attribute is Since the (appropriate) content is selected and read from the content storage means, unlike a general TV broadcast (ON-AIR), it matches the viewer's attributes and movements (ie,
It is possible to display content with high advertising effect and viewer satisfaction) on the display board at the best timing.

According to a seventh aspect of the present invention, there is provided an interactive display device installed on a display board for advertisement, a street, a shopping mall, or a department store and used as a guide board for supporting content viewing. A display plate for displaying to a viewer who is a viewing person, and an impact detection sensor that monitors whether an impact force is applied to the display plate and generates an impact detection signal when the impact force is detected. Image input means for photographing the vicinity of the display panel and outputting the video signal as a video signal; storage means for storing the video signal; and storage means for storing the video signal before and after the timing at which the shock detection signal is received. Attribute determining means for executing control for monitoring the state of breakage of the display panel by accumulating and storing the information on the display panel. They are parts display device.

According to the seventh aspect of the invention, the impact detection sensor monitors whether or not an impact force is applied to the display panel, and generates an impact detection signal when the impact force is detected. In response to this, the image input means takes an image of the vicinity of the display panel and outputs it as a video signal. This makes it possible to automatically monitor for breakage accidents, such as the display board being kicked off, scribbled, damaged, or about to be taken away. Further, the storage means stores (records) the video signal from the image input means.
So that the signboard is kicked off, graffitied,
Evidence of damage, such as being hurt or about to be taken away, can be automatically left. Further, the attribute determining means has a function of storing and storing the video signal before and after the timing of receiving the shock detection signal in the storage means and executing a control for monitoring the damage state of the display panel, so that the occurrence of a breakage accident occurs. The causal relationship and the history can be kept as a record, and can be used as a powerful situation evidence photographing record for later verification and the like.

The invention according to claim 8 is an interactive display device which is installed in a display board for advertisement, a street, a shopping mall, or a department store and is used for a guide board for supporting the viewing of the content. A display means for displaying to the viewer who is the viewer and a wide-angle lens capable of photographing the viewer and the display plate itself are attached, and the display plate and an object located in front of the display plate are simultaneously displayed. Image input means for capturing and outputting as a video signal, and performing a masking process on a video signal relating to an image of an object in front of the display plate from among the captured images, and Mask means for cutting out a video signal relating to a portion; comparison data which should be correctly displayed on the display panel; and video data relating to an image portion of the display panel. The signal is compared with a signal, and when the comparison result exceeds a predetermined threshold value regarding a mismatch, a failure in either the display unit or the image input unit, or a failure due to dirt attached to the front surface of the display plate. And an image comparing means for outputting the result.

According to the eighth aspect of the present invention, the camera of the image input means is provided with a wide-angle lens capable of photographing the viewer and the display panel itself. The image input means to which such a wide-angle lens is attached simultaneously captures an image of a display plate and an object located in front of the display plate, and outputs a video signal. In response to this, the masking unit performs a masking process on a video signal related to an image of an object in front of the display panel from among the images captured by the image input unit, and based on the result of the mask, performs masking on the display panel. Cut out the video signal for the image part. In response, the image comparison means compares the comparison data, which should be correctly displayed on the display panel, with the video signal relating to the image portion of the display panel. Specifically, when a wide-angle lens capable of photographing the viewer and the display plate itself is attached, the display plate and the object in front of the display plate can be simultaneously photographed. Can be masked and compared with the comparison data that should be correctly displayed on the display panel. As a result, when the threshold value exceeds the mismatch threshold, it can be determined that a failure has occurred. Further, by providing the image comparing means, when the comparison result at this time exceeds a predetermined threshold value regarding the mismatch, a failure in the display means, the display driving circuit, the image input means, or contamination on the front surface of the display plate. As a result, it is determined that a failure is caused by a failure of the display panel due to some cause of the system, and a display color is out of balance. It is possible to detect a failure such as a failure or a stain on the front surface, and correct operation of the display panel becomes possible.

[0056]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Various embodiments of the present invention will be described below with reference to the drawings.

(First Embodiment) An interactive display device 10 according to a first embodiment relates to the first, second, third, and fourth prior arts described above. It is intended to solve each of the technical problems described above.

FIG. 1 is a functional block diagram for explaining the entire system of the interactive display device 10 of the first embodiment.

The overall system shown in FIG. 1 has a center system (distribution management host computer 208) and a display board 106 (C) on the terminal side (interactive display device 10).
An RT display device 106B) and a communication line (public network 206) connecting them are provided, and input (demand) from the viewer 30 is provided.
In response, the distribution management host computer 208 or the display board 106 interactively changes and displays the distribution and display of the content (particularly, multimedia advertisement) 40 represented by the still image, the character information, and the moving image. 1) An interactive media distribution / display system having a function, and a display board 10 for advertisement.
6. Installed in streets, shopping malls, department stores,
It is used for a guide board that supports viewing of the content 40.

On the terminal side, an interactive display device 10 having a CRT (plasma display described later), a touch panel 106 attached to the front of a display panel 106
6. A touch panel 1066 and a coordinate detection device 1067 for detecting a position where the viewer 30 pressed a finger, a storage device (hard disk) 204 for storing various data, reading it out at appropriate times, and outputting the data, and collectively managing these. A controlling CPU (personal computer (PC)) 203 is provided.

Each of these devices is equipped with a high-speed serial communication interface represented by IEEE (American Electrical and Electronic Engineers Association) 1394 or a parallel communication interface represented by SCSI, and is interconnected. In this way, data is shared.

The CPU (PC) 203 has a public network 206
A communication interface (communication I / F) 205 for performing data communication (transmission / reception of the content 40) with the distribution management host computer 208 via the Internet, and a wireless card for managing security relating to the right to use the terminal using an ID card ID recognition device 202, image recognition device 200 for identifying specific image information from an input image from an image input device (image input means 101, video camera described later)
(Specifically, an attribute determination unit 102 and an image comparison unit 180 described later) are connected.

The wireless card ID recognizing device 202 is provided with an antenna 201 for transmitting and receiving data for managing security.

In this embodiment, the contents 40 are exchanged with the distribution management host computer 208 via the Internet (public network 206) using an ISDN line.
Therefore, a communication modem for ISDN line or DS
A line control device such as U is used as the communication interface (communication I / F) 205 described above.

The interactive display device 10 incorporated in such a network configuration has a hardware configuration mainly including a display panel 106, an image input unit 101, an attribute determination unit 102, and a storage unit 150 described later.

Here, the display board 106 has a function of displaying the content 40 to the viewer 30 who is the person who has viewed the content 40, and uses various display devices such as a CRT, a plasma display, an LED display, and a liquid crystal display. Can be.

The image input means 101 has a function of photographing the viewer 30 of the content 40 and outputting it as a video signal 101a conforming to a transfer packet format specified by IEEE (American Institute of Electrical and Electronics Engineers) 1394. Specifically, an IEEE 1394 digital video camera is used.

IEEE 1394 (also called FireWire) is an interface standard for connecting a PC to peripheral devices, and is applicable not only to personal computer peripheral devices such as a hard disk and a printer, but also to home appliances such as video cameras and audio products. It plays a role in integrating personal computers and home appliances. Three types of transmission speeds, 100 MB / sec, 200 MB / sec, and 400 MB / sec, are defined. It supports hot plug-in that can be connected while the PC is turned on, up to 63 units can be connected, and has a plug-and-play function. In data transfer, there are two transfer systems, ie, an isochronous transfer and an asynchronous (asynchronous) transfer. Since the isochronous transfer can transmit data (packets) in real time, it is expected as an interface for transmitting data such as images and sounds. On the other hand, in the asynchronous transfer, since data is divided and sent, it is used for data transfer of a hard disk or a printer.

The IEEE 1394 digital video camera converts the image of the viewer 30 into such an IEEE 1394 digital video camera.
Is converted into a digital signal conforming to the format of the transfer packet specified in
An IEEE 1394 digital video signal 101a) is generated.

IEEE 1394 digital video signal 1
01a will be packet-transferred to the information equipment connected to this digital bus by isochronous transfer.

Therefore, there is an advantage that an image processing mechanism for converting an analog image signal into a digital signal need not be provided on the interactive display device 10 side. By diverting a highly versatile interface such as IEEE 1394, digital cameras 21
2 (to be described later) or image data from an AV device such as a DVD, thereby improving the flexibility of the system and achieving high compatibility with existing information resources.

The storage means 150 stores the content viewer 30
It has a function of accumulating the result 102b of the attribute determination regarding the use of a hard disk. Specifically, using a hard disk is advantageous in terms of cost performance.

FIG. 2 shows a plasma display 106A in the interactive display device 10 according to the first embodiment.
IEEE139 is provided on the display panel 106 for performing electrical display such as
4 digital video camera 101, attribute determination means 10
2 is a configuration diagram to which a log storage unit 103 is added.

The attribute judging means 102 is an IEEE 1394
A function of detecting that the movement of an image of a moving object formed based on the digital video signal 101a has become small. After detecting that the movement of an image of a moving object has become small, the personal attribute of the viewer 30 is determined. It has a function of generating attribute determination result information 102a and a function of cutting out a person image based on the attribute determination result information 102a, and is realized by the above-described PC.

The log storage unit 103 stores the attribute determination unit 10
2 has a function of accumulating a time history of the person attribute determination processing together with time data as a database, and is realized by the above-described PC and hard disk.

FIG. 3 is an overall configuration diagram of a specific system of the interactive display device 10 according to the first embodiment of FIG.

The overall system shown in FIG. 3 includes a distribution server 211 (distribution management host computer 208), a cache server 210, and an ISDN line 20 connecting them.
6 to distribute and display a content (especially a multimedia advertisement) 40 represented by a still image, character information, and a moving image in response to an input (demand) from the viewer 30.
Dialogue displayed by the distribution server 211 or the display panel 106 while changing interactively.
v) An interactive media distribution / display system having a function, which is installed on an advertisement display board 106, a street, a shopping mall, or a department store, and is used as a guide board for supporting the viewing of the content 40.

A plurality of interactive display devices 10,..., 10 (specifically, a wall type interactive display device 10A and a floor type interactive display device) are connected to the cache server 210 via a digital bus such as an Ethernet line. 10B) are connected.

Wall-type interactive display device 1
0A or floor type interactive display device 10B
Does not go through the cache server 210,
Direct distribution server 211 via ISDN line 206
It may be a connection form that allows access to.

The presentation data 200a, which is the content of the content 40, and the content 4 are stored in the cache disk of the distribution server 211.
Schedule data 200b, which is a distribution schedule of 0 (distribution destination and distribution time), is stored.

For this reason, the distribution server 211 converts the presentation data 200a into the cache server 210 and the interactive display devices 10,..., 10 ( It is transmitted to the interactive display device 10A of the wall type or the interactive display device 10B of the floor type.

FIG. 4 illustrates a high school girl looking at the display board 106 in the interactive display device 10 of the first embodiment.

The display board 106 displays the content “weather forecast”
"Yokohama" (weather information near Yokohama) 40 is displayed for high school girls 32 passing by. The IEEE 1394 digital video camera converts an image of a high school girl 32 passing by into a digital signal conforming to a transfer packet format defined in IEEE 1394, and
An E1394 digital video signal 101a is generated. IEEE 1394 digital video signal 101a
Are transferred to information equipment connected to the digital bus by isochronous transfer. The accumulation unit 150 accumulates the attribute determination result 102b for the high school girl 32 passing by.

The attribute judging means 102 is an IEEE 1394
After detecting that the movement of the image of the passing high school girl 32 formed based on the digital video signal 101a is reduced, the personal attribute of the passing high school girl 32 is determined to generate attribute determination result information 102a, A person image is cut out based on the attribute determination result information 102a. The log storage unit 103 includes the attribute determination unit 1
02 has a function of accumulating a time history of the person attribute determination process together with time data as a database, and is realized by the above-described PC.

FIG. 5 is a conceptual diagram of feature extraction in the interactive display device 10 of the first embodiment.

It is known that attribute characteristics appear on the head and hairstyle and eyebrows. However, it is also known in the related art that conditions such as a high-definition input image and the direction of the head become narrower only with the head (face) alone.

Therefore, the attribute determining means 102 of this embodiment
As shown in FIG. 5, as the second feature point of the person, determination centering on the distinction of wearing trousers and skirts on the knees, and as the third feature point, the characteristics of footwear, that is, from the ground Judge based on the distance of the ankle.

More specifically, the attribute of a high school girl is
It uses whether a skirt is worn (whether barefoot or not), loose socks, uniforms, and a bag.

In FIG. 5, the high school girl wears a skirt (circle in the figure), loose socks (circle in the figure), does not wear uniforms (x in the figure), and has a bag (handbag).
(○ in the figure), the determination of the attribute of the high school girl person is skirt (ス カ ー ト), loose socks (○), uniform (×), and bag (handbag) (○). As a result, after detecting that the movement of the image of the high school girl 32 passing by has decreased, the attribute determining means 102 determines the personal attribute of the high school girl 32 passing by, and determines the personal attribute by using a skirt (（). ), Loose socks (O), uniform (X), bag (handbag) (O), and the like, and attribute determination result information 102a is generated. Log storage means 1
03 is a temporal history of the person attribute determination processing in the attribute determination means 102, that is, when the skirt (○),
Loose socks (○), uniforms (×), bags (handbags)
Whether a high school girl with a personal attribute such as (（) stopped in front of the display board 106 is stored as a database.

FIG. 6 shows a first example of the screen configuration of the display panel 106 in the interactive display device 10 according to the first embodiment.

The content 40 distributed from the distribution management host computer 208 to the wall type interactive display device 10A or floor type interactive display device 10B via the ISDN line 206 includes:
For example, multimedia information such as special events, event guides, advertisements, department store guides, and news provided by newspaper companies (information that combines still images, text information, moving images, and audio)
Is prepared.

As shown in FIG. 6, the information on the department store is as follows: “BF famous store street”, “1F cosmetics and shoes”, “2F Women's clothing, specialty store”, and so on.
There is information on "3F clock / glasses, stationery / books" and information on "4F restaurant area".

The interactive display device 10 receives an input (demand) from the viewer 30 via the touch panel 1066 attached to the front surface of the display panel 106, and pushes the viewer's 30 finger with the coordinate detection device 1067. The distribution management host computer 208 or the display board 106 interactively distributes or displays the content (particularly, multimedia advertisement) 40 represented by a still image, character information, or a moving image in accordance with the detected position. The contents 40 are displayed interactively while changing, to support the viewing of the contents 40.

For example, the interactive display device 10
Is input (demand) from the viewer 30 via the touch panel 1066 attached to the front of the display panel 106.
Is received, and the viewer 30
Is the position you pressed with your finger ("When you touch your finger on the screen, a mark appears. Please knock lightly on the place you want to see."
), And in response to this, multimedia information such as special events, event guides, advertisements, department store guides, and news provided by newspaper companies is displayed.

When the viewer 30 designates an object on each floor of the department store, as shown in FIG. 6, guidance for “BF famous store street”, “1F cosmetics,
Information for "Shoes", Information for "2F Ladies' Clothing, Specialty Store", "3F
Information on "clocks, glasses, stationery and books", information on "4F restaurant area", and the like are displayed.

FIG. 7 is a second example of the screen configuration of the display panel 106 in the interactive display device 10 of the first embodiment.

In the same manner, the viewer 30 touches the screen with a finger on the touch panel 1066 indicating "Tap your finger on the screen. A mark appears. Please lightly knock on the place you want to see." By touching, weather forecast information, movie / product advertisements, notices from government agencies, and the like are displayed on the display panel 106 in an interactive manner.

FIG. 8 illustrates how the attribute is determined for each part of the head, knee, and footwear in the interactive display device 10 of the first embodiment. Also, FIG.
In the interactive display device 10 according to the first embodiment, an operation of applying person templates 1021 and 1022 from a small range when a person is cut out from an image is described.

The attribute determining means 102 uses the features of a plurality of parts of a person as a person template (for example, a male template 1021 or a female template 1022, which will be described later). In contrast to the person template 1022, the person templates 1021 and 1022 of large size are used from the person templates 1021 and 1022 of small size.

In the present embodiment, as shown in FIG. 8, the feature extraction of a plurality of parts of a person (judgment of a person attribute) includes the extraction of features of a person's head, the extraction of features of a person's knees, and the extraction of a person's footwear. The three feature extractions are performed together. As shown in FIG. 9, a male template 1021 and a female template 1022 are used as the person templates. In the male template 1021, a male template 1021 having a large size and a male template 1021 having a large size are used for the male template 1021 representing the head, knees, and footwear of a male. Similarly, in the female template 1022, the female template 1022 expressing the head, knees, and footwear of a male
In contrast, a female template 1022 having a large size and a female template 1022 having a large size are used. As a result, after the movement of the moving object is reduced (it is always in a still state in an image frame, but there is no image blur), the previously prepared person template 10
A person image is cut out by cutting out a person with a smaller size of 21, 1022.

As a result, the attribute judging means 102 changes the size of the male template 1021 (female template 1022) from the male template 1021 (female template 1022) of the small size to the male template 1021 (female template 102) of the large size.
22) Function to execute pattern matching with the moving body in order toward the male template 1021 for each part
The function of determining the personal attribute of the viewer 30 based on the result of the pattern matching for the (female template 1022) to generate the attribute determination result information 102a, and cut out the personal image based on the attribute determination result information 102a.

That is, when detecting a person attribute, the attribute determining means 102 sets the person templates 1021 and 102
2, the features of a plurality of parts of the person are used, and the person templates 1021 and 1022 representing the respective parts are compared with the moving objects in order from the person templates 1021 and 1022 of small size to the person templates 1021 and 1022 of large size. Since the pattern matching is performed, the viewer 3 in the stationary state is added to the viewer 30 walking around.
0 can also be a target of attribute determination.

The attribute determining means 102 determines that the
After detecting that the movement of the image of the moving object formed based on the 394 digital video signal 101a is reduced, the person templates 1021 and 1022 for each part are detected.
The attribute determination result information 10 is obtained by determining the personal attribute of the viewer 30 based on the result of the pattern matching for
2a is generated and a person image is cut out based on the attribute determination result information 102a, so that the attribute can be detected even for a viewer 30 who is in a free position and is still. In addition, in addition to the viewer 30 as a moving object, it is possible to extract attributes of the viewer 30 who enters the target area and then stands still. Although features appear, attributes can be extracted using not only the head (face) but also a plurality of parts, and the degree of freedom for shooting conditions such as the resolution condition of the input image and the orientation of the viewer 30 can be increased. Become like

As described above, according to the first embodiment, the IEEE 1 is used to photograph a person who has viewed the content 40.
IEEE 394 Digital Video Camera 101
Since the IEEE 1394 digital video signal 101a based on the 1394 format is used, no pre-processing of image processing is required.

The attribute determining means 102 determines that the
After detecting that the movement of the image of the moving object formed based on the 394 digital video signal 101a is reduced, the personal attribute of the viewer 30 is determined and the attribute determination result information 102a is generated. In addition to the viewer 30, the viewer 30 in a stationary state can be a target of the attribute determination.

Further, when detecting the attribute of a person, the attribute can be detected even for a viewer 30 who is at a free position and is in a stationary state. In addition to 30, the attribute can be extracted for the viewer 30 who enters the target area and then stands still.

As a result, it is possible to quantitatively determine the installed advertising board (that is, whether it is helpful to the viewer 30) or to measure the advertising effect.

(Second Embodiment) The interactive display device 10 of the second embodiment relates to the fifth embodiment described above.
An object of the present invention is to solve each technical problem described in the related art and the sixth related art.

FIG. 10 is a functional block diagram of the interactive display device 10 according to the second embodiment, and is a functional block diagram for controlling a sub-frame according to an input command. Note that the same parts as those already described in the first embodiment are denoted by the same reference numerals, and redundant description will be omitted.

The interactive display device 1 shown in FIG.
Reference numeral 0 denotes an interactive display device 10 which is installed in an advertising display board 106, a street, a shopping mall, or a department store and used as a guide board for supporting content viewing, as described above, and performs virtual display control. Is characterized in that a sub-frame is displayed on the display surface and the display effective area is enlarged, and the display panel 106 and the display control
5, command input means 107, command analysis means 10
8, content storage means 130, display selection means 1010
Hardware configuration.

The display control means 105 has a function of performing display control on virtual display using a plurality of layers as subframes.

The command input means 107 outputs the content 4
0 for interactively changing 0 on the center system 208 side or the display panel 106 side, or a virtual display command 107a for instructing subframe display.
From the viewer 30 and is realized by the touch panel 1066 and the coordinate detection device 1067 described above.

The command analysis means 108 analyzes the instruction content of the input command, and when it determines that the analyzed command is the virtual display command 107a, the instruction of the virtual display using the sub-frame is generated. Is output as analysis information, and is realized by the above-described PC.

The content storage means 130 stores various types of content 40, has a function of reading out and outputting the content 40 according to the output request when receiving the output request of the content 40, and using the above-mentioned hard disk. Has been realized.

The display selection means 1010 has a function of instructing the content storage means 130 to read out the content 40 corresponding to a plurality of layers in accordance with the analysis information, and the function of instructing the content storage means 130 to receive the content 40 corresponding to the plurality of layers received from the content storage means 130. To the display control means 105, and is realized by the above-mentioned PC.

In the present embodiment, each of the plurality of layers
Layer 1 display memory 1062, Layer 2 display memory 10
63, and are stored in each of the layer 3 display memories 1064.

In such a hardware configuration, the display control means 105 executes sub-frame display control using the content 40 corresponding to a plurality of layers on the entire display area of the display panel 106.

More specifically, the display control means 105 holds the content 40 corresponding to the layer held in the layer 1 display memory 1062 and the layer 2 display memory 1063 with respect to the entire display area of the display panel 106. 40, layer 3 display memory 1 corresponding to the layer being displayed
0 corresponding to the layer held in 064
The sub-frame display control using 0 is executed.

FIG. 11 illustrates an operation of displaying a sub-frame on the display panel 106 in the interactive display device 10 according to the second embodiment.

[0120] As shown in FIG.
The viewer 30 touches the touch command input unit 1061 provided on the touch panel 1066 in response to the message “Please click here for details” displayed below the touch panel 1066 attached to the front of the When pressed, the aforementioned coordinate detection device 1067 detects the pressed position.

In response, the command analysis means 108
Analyzes the instruction content of the input command based on the position data from the coordinate detection device 1067, and determines that the analyzed command is the virtual display command 107a. The fact that the instruction has occurred is output as analysis information.

In response, display selection means 1010
As shown in FIG. 11B, the content 40 corresponding to the layer held in the layer 1 display memory 1062 and the layer held in the layer 2 display memory 1063 according to the analysis information from the command analysis means 108. 40 or the layer 3 display memory 10 corresponding to
64 corresponding to the layer held in 64
Request to the content storage means 130 to read
Furthermore, the corresponding content 40 (subframe display target content 4
0) is output to the display control means 105.

In response to this, as shown in FIG. 11 (b), the display control means 105 sets the subframe display target content 40 (in the figure, "first floor men's shoes", "second floor ready-to-wear", "third floor". Children's clothing, Kitchen equipment on the 4th floor, 5
Floor restaurant area) on the display screen (female screen in the figure). Here, the sub-frame display means one form of multi-window display used in PCs and the like.

As described above, according to the second embodiment, the command input means 107 instructs a command or subframe display for interactively changing the content 40 on the center system 208 side or the display panel 106 side. Viewer 3
0, and the command analysis means 108
Analyzes the instruction content of the input command, and when it is determined that the analyzed command is the virtual display command 107a, outputs that the virtual display instruction using the sub-frame is generated as analysis information. In this case, the display control means 105 performs display control on the display panel 106 for virtual display using a plurality of layers as sub-frames in accordance with the above-described case. Can be avoided, and as a result, much information can be displayed interactively.

(Third Embodiment) FIG. 14 is a functional block diagram of an interactive display device 10 according to a third embodiment, and shows how the content 40 to be displayed is changed according to the attribute determination result. Note that the same parts as those already described in the first or second embodiment are denoted by the same reference numerals, and redundant description will be omitted.

An interactive display device 1 shown in FIG.
0 solves the technical problem described in the seventh related art with respect to claim 6, and selects the content 40 from the determination result based on the attribute as shown in FIG. It is characterized in that it displays various contents, and the above-described display board 106, the above-mentioned IEEE 1394 digital video camera 101, the above-mentioned attribute judging means 102, and in addition, the hardware centering on the content storing means 130 and the selecting means 110 It has a hardware configuration.

The attribute determining means 102 has an IEEE 1394 digital video signal 101a in addition to the above functions.
A function of determining attribute of the person related to the viewer 30 by using an image formed based on the attribute determination information 102a and a function of extracting a person image based on the attribute determination result information 102a. .

The content storage means 130 has a function of storing the content 40 including at least one of a still image and a moving image as viewer attribute classification data 110a classified in advance for each viewer attribute. Specifically, it is realized by the above-mentioned hard disk.

The selecting means 110 outputs the attribute judgment result information 10
2a, the content 40 to be displayed is selected from the viewer attribute classification data 110a by the content storage unit 130.
It has a function to select and read from the PC, and is specifically realized by the above-described PC.

FIG. 12 is a view showing the storage of the viewer attribute classification data 110a used in the interactive display device 10 of the third embodiment.

In the interactive display device 10 according to the third embodiment, contents 40 are prepared in advance for each attribute by using the attribute of the viewed person, as shown in FIG.

Here, as shown in FIG. 12, the viewer attribute division data 110a of the present embodiment includes a male content table 111 and a female content table 1a.
12 are prepared.

The viewer attributes constituting the content table 111 for men are, as shown in FIG. 5, whether or not a skirt is worn and whether or not socks are worn on bare feet.

On the other hand, the content table 112 for women
The viewer attributes that make up are whether they wear skirts as shown in FIG. 5 and whether they wear socks on bare feet.

In this case, the content storage means 130
The content 40 including at least one of a still image and a moving image is stored in advance as a content table 111 for men and a content table 112 for women classified into men and women.

As described above, the attribute determining means 102
Using an image formed based on the IEEE 1394 digital video signal 101a, a person attribute (male, female) of the viewer 30 (male or female) is determined to generate attribute determination result information 102a, and the attribute determination result information 102a Is performed on the basis of.

The selecting means 110 outputs the attribute judgment result information 10
In accordance with 2a, content 40 relating to men's ties, polo shirts or belts to be displayed or content 40 relating to lipsticks, blouses or belts for women is stored from the content table 111 for men and the content table 112 for women. Select and read from the means 130.

FIG. 13 shows a time table 20 used in the interactive display device 10 of the third embodiment.
Reference numeral 9 denotes a state in which display is performed.

[0139] In addition to the contents 40 described above, the time table 2
Various routinely displayed contents 40 corresponding to 09 are also stored.

As shown in FIG. 13, the contents 40 displayed routinely include, for example, [contents 40 # 101 = “time signal” displayed at time (6: 59.55)], [Display content 40 # 1 = “weather forecast Yokohama”) at time (7: 00.00)],
[At time (7: 00.05) (content 40 # 2 =
"Weather forecast Tokyo")], [Time (7: 0
0.10) (content 40 # 3 = “weather forecast Shizuoka”)], [content 40 # 4 = “Chinese food xx breakfast”] at time (7: 0.15) , ..., [content 40 # 101 = "time signal" displayed at time (23: 59.55)].

Therefore, the interactive display device 10
Displays (content 40 # 101 = “time signal”) at time (6: 59.55) according to the time, and then displays (content 40 # 1 = “weather” at time (7: 00.00) Forecast Yokohama ”), and then the time (7: 00.0
5), (Content 40 # 2 = “Weather Forecast Tokyo”) is displayed, and then, at time (7: 0.10.), (Content 40 # 3 = “Weather Forecast Shizuoka”) is displayed. At time (7: 0.15), (content 40 # 4 = “Chinese food ○ breakfast”) is displayed, and ..., time (23: 5)
9.55) (content 40 # 101 = "time signal") is displayed routinely.

As described above, according to the third embodiment, the attribute determining means 102 determines and generates the personal attribute of the viewer 30 using the image formed based on the IEEE 1394 digital video signal 101a. The person image is cut out based on the attribute determination result information 102a obtained, and the selection unit 110 responds to the clipping of the person image based on the viewer attribute classification data 110a stored in the content storage unit 130 according to the attribute determination result information 102a. Should be displayed from inside (ie, appropriate for the detected person attribute)
Since the content 40 is selected and read from the content storage means 130, a general TV broadcast (ON-AIR)
Unlike the above, the content 40 that matches the attributes and movements of the viewer 30 (that is, has high advertising effect and viewer satisfaction)
Then, the display can be performed on the display board 106 at the best timing.

(Fourth Embodiment) FIG. 15 is a functional block diagram of an interactive display device 10 according to a fourth embodiment, and shows a state in which a vandal is recorded by an impact detection sensor 160. Note that the same parts as those already described in the first to third embodiments are denoted by the same reference numerals, and redundant description will be omitted.

In the interactive display device 10 according to the fourth embodiment, the shock detection sensor 160 is
A point at which the image from the time Δt before the detected time is continuously taken from the buffer area (frame skipping is also possible) into the storage means 140 and the state of damage of the display board 106 is monitored (identifies a damaged person). The display panel 106, the impact detection sensor 160, and the I
The hardware configuration includes the IEEE 1394 digital video camera 101, the storage means 150 described above, and the attribute determination means 102 described above.

The impact detection sensor 160 has a function of monitoring whether or not an impact force is applied to the display panel 106 by the vandal performer 31, and a function of generating an impact detection signal (trigger) 160a when the impact force is detected. Has,
Specifically, this is realized using an acceleration sensor.

The IEEE 1394 digital video camera 101, in addition to the above-described various functions, captures an image of the vicinity of the display panel 106 and outputs the IEEE 1394 digital video signal 10
1a.

The storage means 150 has a function of storing the IEEE 1394 digital video signal 101a in addition to the above-described functions.

The attribute judging means 102, in addition to the above-mentioned functions, accumulates and saves the IEEE 1394 digital video signal 101a before and after the timing of receiving the shock detection signal in the accumulating means, and stores the state of damage of the display board (the vandal actor 31) has a function of executing control for monitoring, and is specifically realized by using the PC described above.

As described above, according to the fourth embodiment, the impact detection sensor 160 monitors whether or not an impact force has been applied to the display plate 106 by the vandal performer 31. Upon detection, an impact detection signal (trigger) 160a is generated. In response, IE
The EE1394 digital video camera 101 captures an image of the vicinity of the display board 106 (the vandal actor 31) and performs the IEEE
It is output as an E1394 digital video signal 101a. As a result, the display board 1 is
06 can be automatically monitored for damage accidents, such as being kicked, graffitied, hurt, or about to be taken away. Further, storage means 1
50 is an IEEE 1394 digital video camera 10
IEEE 1394 digital video signal 101 from
Since a is stored (recorded), evidence of a damage accident such as the display board 106 being kicked off, graffitied, damaged, or about to be taken away by the vandalist 31 can be automatically left. become. Further, the attribute determination means 102 receives an impact detection signal (trigger).
IEEE before and after receiving 160a
E1394 digital video signal 101a storing means 1
Display board 1 stored and stored in 50 and executed by vandal performer 31
Since it has a function to execute the control to monitor the damage situation of 06, the causal relationship and the history of the occurrence of the damage accident can be recorded as a record, and it can be used as a powerful situation evidence recording record at the time of later verification etc. Can be used.

(Fifth Embodiment) FIG. 16 is a functional block diagram of an interactive display device 10 according to a fifth embodiment, and shows a state in which a self-display image is self-diagnosed with an image input from the IEEE 1394 digital video camera 101. ing. FIG. 17 is a functional block diagram of the interactive display device 10 according to the fifth embodiment.
06 shows an image input unit attached to the upper part. In addition,
The same portions as those already described in the first to fourth embodiments are denoted by the same reference numerals, and duplicate description will be omitted.

The interactive display device 10 according to the fifth embodiment is based on claim 8, and mainly includes the display plate 106, the IEEE 1394 digital video camera 101, the display control unit 105, the mask unit 170, and the image comparison unit 180. Hardware configuration.

The display panel 106 whose display contents can be changed by an electric means may not be displayed for some reason of the system, that is, a so-called failure may occur.

Therefore, in the interactive display device 10 of the fifth embodiment, as shown in FIG.
When a wide-angle lens capable of photographing the viewer 30 and the display plate 106 is mounted on the upper part of the image input means 101, the display plate 106 and the front object are simultaneously photographed as shown in FIG. From this, the object image on the front is masked 190 and compared with the comparison data 180a that should be correctly displayed on the display panel 106. At this time, if the threshold value of the mismatch is exceeded, it can be determined that a failure has occurred. When the balance of the display color is out of order or when the front surface becomes dirty,
Detection can be performed in a similar manner, and correct operation of the display board 106 can be performed.

The IEEE 1394 digital video camera 101 has, in addition to the above-described various functions, a wide-angle lens capable of photographing the viewer 30 and the display panel 106 itself (mounted), and the display panel 106 and the front surface thereof. It has a function of simultaneously photographing a located object (an object located in the upper and lower visual field ranges shown in FIG. 17) and outputting it as an IEEE 1394 digital video signal 101a.

The mask means 170 is an IEEE related to the image of the object in front of the display panel 106 from the captured images.
It has a function of performing a mask process on the E1394 digital video signal 101a and a function of cutting out the IEEE 1394 digital video signal 101a related to the image portion of the display panel 106. Specifically, the function is realized by using the PC described above. I have.

The image comparison means 180 compares the comparison data 180a, which should be correctly displayed on the display panel 106, with the display panel 1
06 is compared with the IEEE 1394 digital video signal 101a related to the image portion of the image No. 06, and when the comparison result exceeds a predetermined threshold value for mismatch, the display panel 106
Has a function of judging a failure caused by an improper balance of display colors displayed on the display panel or a failure caused by dirt adhering to the front surface of the display plate 106, and outputting the fact. Is realized using the aforementioned PC.

As described above, according to the fifth embodiment, the IEEE 1394 digital video camera 101 is provided with a wide-angle lens capable of photographing the viewer 30 and the display panel 106 itself. The IEEE 1394 digital video camera 101 to which such a wide-angle lens is attached simultaneously shoots the display board 106 and the viewers 30 (the viewers 30 located in the upper and lower visual field ranges shown in FIG. 17) located in front of the display board 106 and IEEE 1394. It is output as a digital video signal 101a. In response to this, the masking unit 170 selects the display board 10 from the image captured by the IEEE 1394 digital video camera 101.
6, a mask process is performed on the IEEE 1394 digital video signal 101a relating to the image of the object in front, and based on the result of the mask 190, the IEEE 1394 digital video signal 101a relating to the image portion of the display panel 106 is cut out. In response, the image comparing means 18
0 indicates the comparison data 180a that should be correctly displayed on the display panel 106 and the IE related to the image portion of the display panel 106.
Compare with the EE1394 digital video signal 101a. Specifically, when a wide-angle lens capable of photographing the viewer 30 and the display plate 106 is attached, the display plate 106
And the object in front of it can be photographed at the same time.
By setting the value to 0, it is possible to compare with the comparison data 180a that should be correctly displayed on the display panel 106, and as a result, it is possible to determine that a failure has occurred when the threshold value exceeds the mismatch threshold. Further, by providing the image comparing means 180, if the comparison result at this time exceeds a predetermined threshold value for mismatch, a failure caused by an imbalance in display colors displayed on the display panel 106 or a display error As a result of determining that a failure is caused by dirt attached to the front surface of the plate 106 and outputting the fact, the display plate 106 whose display content can be changed by an electric means is not displayed for some reason of the system. It is possible to detect a failure, a failure such as an improper balance of display colors, or a failure such as dirt attached to the front surface, so that the display panel 106 can be correctly operated.

(Sixth Embodiment) The interactive display device 10 according to the sixth embodiment relates to the first embodiment.
Used in each of the fifth to fifth embodiments.

FIG. 18A shows a conventional display panel 106.
FIG. 4B shows a rectangular matrix arrangement of three-color light-emitting elements of a display panel 106 used in the first embodiment. FIG. 3B shows a display panel 1 used in the interactive display device 10 according to the first to fifth embodiments.
11 shows a rhombic arrangement of three color light emitting elements.

As shown in FIG. 18B, the display panel 106 is configured by integrating the molded light emitting elements 1065 in a rhombic arrangement.

FIG. 19 illustrates a structure of a three-color light emitting element of the display panel 106 used in the interactive display device 10 of the first to fifth embodiments.

A molded light emitting device 1065 shown in FIG.
There is a display element in which a light emitting diode (LED) emitting each color of red (R), green (G), and blue (B) is formed in one mold. By arranging many of them, an integrated display panel 106 can be formed as shown in FIG.

In this case, conventionally, a method of arranging them in a square as shown in FIG. However, in this case, it is necessary to form a constant gap between each of the molded light emitting elements 1065, so that four molded light emitting elements 1
A large gap is created in the middle of 065, and the degree of integration does not increase as a whole.

As a solution for this, if the molded light emitting element 1065 is arranged and formed in a triangular shape, it becomes the same as the one in which the molded light emitting element 1065 is arranged in a diamond shape (FIG. 18B), and has a square shape. Can be arranged with a higher density than the formation of As a result, higher-luminance and finer color expression can be achieved.

The molded light emitting device 10 shown in FIG.
As shown in FIG. 19, each of the red light emitting elements R
(LED), green light-emitting element G (LED), and blue light-emitting element B (LED) are connected by a common cathode, and sealed (molded) with a resin having transparency in a visible light wavelength range. The molded light emitting element 1065 emits red light by applying a voltage between the anode and cathode of the red light emitting element R, emits green light by applying a voltage between the anode and cathode of the green light emitting element G, and emits blue light. When a voltage is applied between the anode and the cathode of the element B, the element B emits blue light.

As described above, according to the sixth embodiment, the light emitting elements R, G,
Since B is arranged in a diamond shape, the gap between each light emitting element R, G, B (mold light emitting display element (R, G, B)) can be reduced as compared with the above-described square matrix arrangement, and four adjacent four light emitting elements can be formed. Of the light emitting elements R, G, and B can be reduced, and as a result, the degree of integration of the light emitting elements R, G, and B can be improved.

[0167]

According to the first aspect of the present invention, a viewer in a stationary state can be a target of attribute determination in addition to a viewer walking around. Also, when detecting person attributes,
Attributes can be detected even for a viewer who is at a free position and is still, and in addition to the viewer as a moving object, enters the target area and then stops. , The attribute of the viewer can be extracted. As a result, it is possible to quantitatively determine the installed advertising board (that is, whether it is useful to the viewer) or to measure the advertising effect.

According to the invention described in claim 2, according to claim 1
In addition to the effects described in (1), when detecting the attribute of a person, in addition to the viewer walking around, a viewer in a stationary state can be a target of the attribute determination. In addition, it is possible to detect attributes even for a viewer who is in a free position and is still, and in addition to the viewer as a moving object, enters the target area and then stops. Attributes can be extracted for viewers who are in a situation of

According to the invention described in claim 3, according to claim 1
In addition to the effects described in (1), when detecting the attribute of a person, in addition to the viewer walking around, a viewer in a stationary state can be a target of the attribute determination. In addition, it is possible to detect attributes even for a viewer who is in a free position and is still, and in addition to the viewer as a moving object, enters the target area and then stops. Attribute can be extracted for viewers who are in a situation where the hairstyle and eyebrows have attribute features of the head, but the attribute can be extracted using not only the head (face) but also a plurality of parts. This makes it possible to increase the degree of freedom for shooting conditions such as the resolution condition of the input image and the orientation of the viewer.

According to the fourth aspect of the present invention, it is possible to avoid a case where the effective display area of the display panel with respect to the screen is limited, and as a result, a large amount of information can be displayed interactively. Become.

According to the fifth aspect of the present invention, since the light emitting elements forming the display surface of the display panel are arranged in a diamond shape,
As compared with the square matrix arrangement described above, the gap between each light emitting element (mold light emitting display element) can be reduced, and the gap between the four adjacent light emitting elements can be reduced, thereby improving the integration degree of the light emitting element. Will be able to do that.

[0172] According to the invention of claim 6, the attribute determining means determines the personal attribute of the viewer by using the image formed based on the video signal, based on the attribute determination result information generated. In accordance with the attribute determination result information, the selection unit should display the person image from among the viewer attribute division data stored in the content storage unit (that is, the detected person attribute is Since the (appropriate) content is selected and read from the content storage means, unlike a general TV broadcast (ON-AIR), it matches the viewer's attributes and movements (ie,
It is possible to display content with high advertising effect and viewer satisfaction) on the display board at the best timing.

According to the seventh aspect of the invention, the impact detection sensor monitors whether or not an impact force is applied to the display panel, and generates an impact detection signal when the impact force is detected. In response to this, the image input means takes an image of the vicinity of the display panel and outputs it as a video signal. This makes it possible to automatically monitor for breakage accidents, such as the display board being kicked off, scribbled, damaged, or about to be taken away. Further, the storage means stores (records) the video signal from the image input means.
So that the signboard is kicked off, graffitied,
Evidence of damage, such as being hurt or about to be taken away, can be automatically left. Further, the attribute determining means has a function of storing and storing the video signal before and after the timing of receiving the shock detection signal in the storage means and executing a control for monitoring the damage state of the display panel, so that the occurrence of a breakage accident occurs. The causal relationship and the history can be kept as a record, and can be used as a powerful situation evidence photographing record for later verification and the like.

According to the eighth aspect of the present invention, the image input means is provided with a wide-angle lens capable of photographing the viewer and the display panel itself. The image input means to which such a wide-angle lens is attached simultaneously captures an image of a display plate and an object located in front of the display plate, and outputs a video signal. In response to this, the masking unit performs a masking process on a video signal related to an image of an object in front of the display panel from among the images captured by the image input unit, and based on the result of the mask, performs masking on the display panel. Cut out the video signal for the image part. In response, the image comparison means compares the comparison data, which should be correctly displayed on the display panel, with the video signal relating to the image portion of the display panel. Specifically, when a wide-angle lens capable of photographing the viewer and the display plate itself is attached, the display plate and the object in front of the display plate can be simultaneously photographed. Can be masked and compared with the comparison data that should be correctly displayed on the display panel. As a result, when the threshold value exceeds the mismatch threshold, it can be determined that a failure has occurred. Further, by providing the image comparison means, when the comparison result at this time exceeds a predetermined threshold value for mismatch, a failure due to an imbalance in display colors displayed on the display panel, or a failure of the display panel As a result of judging that it is a failure caused by dirt attached to the front and outputting that fact,
With a display panel whose display contents can be changed by electrical means, it is now possible to detect failures such as display not being performed for some reason in the system, failures such as imbalanced display colors, and failures such as dirt attached to the front. Thus, correct operation of the display panel is enabled.

[Brief description of the drawings]

FIG. 1 is a functional block diagram for explaining an entire system of an interactive display device according to a first embodiment.

FIG. 2 is a configuration diagram of the interactive display device according to the first embodiment, in which an image input unit, an attribute determination unit, and a log storage unit are added to a display plate for performing electrical display such as a plasma display.

FIG. 3 is an overall configuration diagram of a specific system of the interactive display device according to the first embodiment of FIG. 1;

FIG. 4 illustrates a high school girl looking at a display board in the interactive display device of the first embodiment.

FIG. 5 is a conceptual diagram of feature extraction in the interactive display device of the first embodiment.

FIG. 6 is a first example of a screen configuration of a display panel in the interactive display device of the first embodiment.

FIG. 7 is a second example of the screen configuration of the display panel in the interactive display device of the first embodiment.

FIG. 8 illustrates how the attribute is determined by the head, knee, and footwear in the interactive display device of the first embodiment.

FIG. 9 illustrates an operation of applying a person template from a small range when cutting out a person from an image in the interactive display device of the first embodiment.

FIG. 10 is a functional block diagram of the interactive display device according to the second embodiment, and is a functional block diagram for controlling a sub-frame according to an input command.

FIG. 11 illustrates an operation of displaying a sub-frame on a display panel in the interactive display device according to the second embodiment.

FIG. 12 is a storage diagram of viewer attribute-divided data used in the interactive display device of the third embodiment.

FIG. 13 shows how a display is performed using a time table used in the interactive display device of the third embodiment.

FIG. 14 is a functional block diagram of the interactive display device according to the third embodiment, showing how to change the content to be displayed according to the result of attribute determination.

FIG. 15 is a functional block diagram of the interactive display device according to the fourth embodiment, showing a state where a vandal is recorded by an impact detection sensor.

FIG. 16 is a functional block diagram of the interactive display device according to the fifth embodiment, showing a state in which a self-diagnosis image is self-diagnosed with an image input from an image input unit.

FIG. 17 is a functional block diagram of the interactive display device according to the fifth embodiment, showing an image input unit attached to an upper portion of a display panel.

FIG. 18A shows a square matrix arrangement of three-color light emitting elements of a display panel used for a conventional display panel, and FIG. 18B shows an interactive display device of a sixth embodiment. FIG. 9 is a diagram illustrating a rhombic arrangement of three-color light emitting elements of a display panel used in the interactive display devices of the first to fifth embodiments.

FIG. 19 illustrates a structure of a three-color light emitting element of a display panel used in the interactive display device according to the first to fifth embodiments.

FIG. 20 is a configuration diagram illustrating an embodiment of a conventional glowing advertising board.

FIG. 21 is a configuration diagram for explaining an embodiment in which an image input unit is added to the glowing wide signboard of FIG. 20;

FIG. 22 is a diagram illustrating a first related art.

FIG. 23 is a view for explaining a second related art.

FIG. 24 is a diagram for explaining a third conventional technique.

FIG. 25 is a diagram for explaining a fourth conventional technique.

FIG. 26 is a diagram for explaining a fifth related art.

FIG. 27 is a view for explaining a sixth related art.

FIG. 28 is a view for explaining a seventh related art.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 10 ... Interactive display apparatus 10A ... Wall type interactive display apparatus 10B ... Floor type interactive display apparatus 101 ... Image input means (video camera) 101a ... Video signal 102 ... Attribute determination means 102a ... Attribute determination result information (result of attribute determination) 1021 ... male template 1022 ... female template 103 ... log storage means 105 ... display control means 106 ... display panel 106A ... plasma display (display panel) 106B ... CRT display device (display panel) 106C ... molded light emitting element integrated display panel 1061 ... Touch command input unit 1062 Layer 1 display memory 1063 Layer 2 display memory 1064 Layer 3 display memory 1065 Mold light emitting element 1066 Touch panel (display panel) 1067 Coordinate detection device Display board) 107 Command input unit 107a Virtual display command 108 Command analysis unit 1010 Display selection unit 110 Selection unit 110a Viewer segmentation data 111 Male content table 112 Female content table 130 Content storage Means 150: Accumulation means 160: Shock detection sensor 160a: Shock detection signal (trigger) 170: Mask means 180a: Comparison data 180: Image comparison means 190: Mask 200: Image recognition device 200a: Presentation data 200b: Schedule data 201 ... Antenna 202 ... Wireless card ID recognition device 203 ... CPU (personal computer) 204 ... Storage device (hard disk) 205 ... Communication I / F 206 ... Public network 208 ... Distribution management host Computer 209 timetable 210 cash server 211 distribution server 212 digital camera 30 viewer 31 vandalist 32 high school girl passing by 40 content data R red LED G green LED B … Blue-emitting LED

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5B057 BA23 DA06 DA12 DC33 5C054 DA09 FA00 FC01 FC12 FC13 FE13 GB01 GB15 HA14 5C082 AA03 AA24 AA27 AA34 AA36 BA20 BA41 CB01 MM05 5G435 AA00 BB02 BB06 CC01 CC13 DD01

Claims (8)

[Claims] 1. An interactive display device installed on a display board for advertisement, a street, a shopping mall, or a department store and used for a guide board for supporting content viewing, wherein the viewer is a person who has viewed the content. A display board for displaying the content, image input means for photographing a person who has viewed the content and outputting the video signal as a video signal, and generating attribute determination result information by determining a personal attribute of the viewer based on the video signal. An interactive display device comprising: an attribute determination unit that cuts out a person image based on the attribute determination result information; and a storage unit that stores the result of the attribute determination on the content viewer. 2. The image processing apparatus according to claim 1, wherein the attribute determining unit converts the image of the moving object formed based on the video signal from a small-sized person template to a large-sized person template using a prepared person-shaped template. In order to execute pattern matching with the moving object in order, determine the attribute of the person related to the viewer based on the result of the pattern matching, generate attribute determination result information, and determine the person based on the attribute determination result information. The interactive display device according to claim 1, wherein an image is cut out. 3. The attribute determining means uses features of a plurality of parts of a person as the person template, and sequentially sorts the person templates representing the respective parts from a person template having a smaller size to a person template having a larger size. Performing pattern matching with the moving object, generating attribute determination result information by determining a personal attribute of the viewer based on the result of the pattern matching on the human template for each part, and generating the attribute determination result information. The interactive display device according to claim 1, wherein a human image is cut out based on the image. 4. An interactive display device installed on an advertising display board, a street, a shopping mall, or a department store and used as a guide board for supporting content viewing, wherein the viewer is a person who has viewed the content. A display panel for displaying, a display control means for performing display control relating to virtual display using a plurality of layers as subframes, and a command or subframe display for interactively changing content on the center system side or the display panel side Command input means for receiving a virtual display command from the viewer from the viewer, and analyzing the instruction content of the input command,
Command analysis means for outputting as analysis information that a virtual display instruction using the sub-frame has occurred when it is determined that the analyzed command is the virtual display command; and various contents are stored. A content storage unit that reads and outputs a content corresponding to the output request when a content output request is received, and sends a request to read the content corresponding to the plurality of layers to the content storage unit according to the analysis information. Display selection means for instructing and outputting the content corresponding to the plurality of layers received from the content storage means to the display control means, wherein the display control means Executing subframe display control using the content corresponding to the plurality of layers. Interactive display device characterized. 5. An interactive display device installed on a display board for advertisement, a street, a shopping mall, or a department store and used for a guide board for supporting content viewing and listening, comprising an integrated mold light emitting element, A display plate for displaying to a viewer who is a person who has viewed the content, and display control means for controlling display of the display plate, wherein the display plate is configured such that the mold light emitting elements are arranged in a diamond shape. Interactive display device. 6. An interactive display device installed in a display board for advertisement, a street, a shopping mall, or a department store and used for a guide board for supporting the viewing of content, wherein the viewer is a person who has viewed the content. A display panel for displaying the content, image input means for photographing a person who has viewed the content, and outputting the video signal as a video signal, and determining a personal attribute of the viewer by using an image formed based on the video signal. An attribute determining unit that generates attribute determination result information and cuts out a human image based on the attribute determination result information; and a content that includes at least one of a still image and a moving image is stored in advance for each viewer attribute. Content storage means for storing as viewer attribute classification data classified into Interactive display device, wherein a content to be displayed from among the audience attribute classification data and a selection means for reading selected from the content storage means. 7. An interactive display device installed on an advertisement display board, a street, a shopping mall, or a department store and used for a guide board for supporting the viewing of content, wherein the viewer is a person who has viewed the content. A display plate for displaying, an impact detection sensor that monitors whether or not an impact force is applied to the display plate, and generates an impact detection signal when the impact force is detected, and an image of the vicinity of the display plate. Image input means for outputting the video signal as a video signal; storage means for storing the video signal; storing and storing the video signal in the storage means before and after the timing at which the shock detection signal is received; An attribute determining means for executing control for monitoring a damage state of the interactive display. 8. An interactive display device installed in a display board for advertisement, a street, a shopping mall, or a department store and used for a guide board for supporting the viewing of content, wherein the viewer is a person who has viewed the content. In a state in which a display means for displaying the image and a wide-angle lens capable of photographing the viewer and the display plate itself are attached, the display plate and an object located in front of the display plate are simultaneously photographed and output as a video signal. Image input means, and mask means for performing a masking process on a video signal relating to an image of an object in front of the display plate from the captured image and cutting out a video signal relating to an image portion of the display plate And comparing the comparison data that should be correctly displayed on the display panel with the video signal related to the image portion of the display panel, If the comparison result exceeds a predetermined threshold value for mismatch, a failure caused by the image input means or the display means or a failure caused by dirt attached to the front surface of the display plate is determined and output to that effect. An interactive display device, comprising: