JP2011227510A - Display control device, display control method, display control program, and display - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide usability to users and to efficiently manage a display with low cost.SOLUTION: A display control device controls a display 20. The display control device includes: an image acquisition unit 110 acquiring an image in front of the display; an object detection unit 111 detecting whether an object exists in front of the display; and an output change processing unit 112 performing processing of output form change of a content 30 on the display 20, which is triggered by the existence of the object detected by the object detection unit 111, when an image acquired by the image acquisition unit 110 is an image of a predetermined object.

Description

  The present invention relates to a display control device, a display control method, a display control program, and a display.

  Conventionally, large high-definition displays are installed in streets, shopping malls, and department stores and used as bulletin boards for advertisements. Various techniques relating to such display control have been proposed.

  For example, in order to provide more detailed information related to an advertisement displayed on the display, the display means displaying the advertisement and the contact number, and accessing the contact number after seeing the advertisement and the contact number There has been proposed an advertising device (see Patent Document 1) having a management means for supplying digital information corresponding to the advertisement to the mobile terminal of the advertisement recipient.

  In addition, as a technique for preventing display deterioration due to contact with the user, for example, a video camera captures the user, and the position pointed to by the user using the body part in the imaging space or the actual object An interface method for recognizing a body, wherein a plurality of video cameras including a reference camera are used to input an image obtained by photographing a real space; distance information from the reference camera to a photographed object; Generating using the stereo method used, generating a voxel space using the distance information from a reference image that is an image captured by the reference camera, and a user's body on the captured image from the reference camera Detecting two predetermined parts of the image as a start point and an end point, calculating their two-dimensional coordinates on the image, the distance information, Calculating the three-dimensional coordinates of the start point / end point in real space from the two-dimensional coordinates on the point / end point image, calculating direction information on the real space indicated by the user, and the generated Registering a part or the whole of three-dimensional position information and its additional information, which is information of a real object existing in the real space, in an arbitrary three-dimensional position on the voxel space, and the real space indicated by the user The intersection between the extension line in the direction pointed to by the user, which is the three-dimensional pointed position information pointed by the operator, by collating the above direction information with the three-dimensional position information of the registered object, and the registered object And a step of superimposing and displaying the generated voxel space, the registration process and result, the three-dimensional indication direction information, and the information of the indicated object and the photographed image. Interface method (see Patent Document 2) are proposed.

  In addition, as a technique for identifying the presence of a person from an image photographed by a camera, for example, in an apparatus that detects the movement of a face from a moving image including a human face, the image photographed at a certain time is converted into a luminance / color difference expression. A first luminance / color difference converting means, a skin color area threshold processing means for determining a skin color area by threshold processing from the luminance / color difference expressed image taken at a certain time, and a luminance of the image taken at the next time The amount of movement only in the skin color area from the second luminance / color difference conversion means for converting to color difference expression, the luminance component of the image taken at the certain time and the luminance component of the image taken at the next time There has been proposed a human motion region detection apparatus (see Patent Document 3) characterized by comprising a mask region luminance difference calculation means for calculating an image representing

  In addition, as a similar technique, for example, when an image of a person's face is taken in the vertical direction of the image, the brightness changes from light to dark and light, and the brightness changes from dark to light. Means for detecting a region sandwiched between, a means for extracting from the region a shape feature of the region and a region whose luminance feature is close to the eyes of a person as an eye candidate region, and a shape feature of the region from the region And a means for extracting a region whose luminance feature is close to a person's mouth as a mouth candidate region, and two of the eye candidate regions and one of the mouth candidate regions may be arbitrarily combined without overlapping, and it may be a human face There has been proposed a face detection device (see Patent Document 4) characterized by having means for taking out a combination of arrangement and detecting it as a face candidate region.

  In addition, a technique has been proposed in which a display is placed in a glass case (show window) in order to prevent the display from being deteriorated or damaged, and a sound generated by a user or the like is analyzed and recognized as an input signal. Non-patent document 1).

JP 2002-32652 A JP 2004-272515 A Japanese Patent No. 2663878 JP 7-311833 A

Joseph A. Paradiso, “TRACKING CONTACT AND FREE GESTURE ACROSS LARGE INTER-RACTIVE SURFACES”, Vol. 46, no. 7 COMMUNICATIONS OF THE ACM, July 2003

  However, in the related art, when providing the user with detailed information related to the content displayed on the display, the user is required to own or operate the specific device, which imposes a burden on the user side. there were. In addition, there is a problem that the display area on the display cannot be effectively used, for example, it is necessary to display the user who is shooting on the display screen. In addition, the conventional technique for preventing display deterioration and damage due to a user's contact operation has a problem in that it is complicated and requires an increase in cost.

  SUMMARY OF THE INVENTION The present invention has been made in view of the above-described problems, and has as its main objects to improve the convenience for the user and enable efficient and low-cost management of the display.

  The display control device of the present invention that solves the above problems is a device that controls a display, a video acquisition unit that acquires a video in front of the display, an object detection unit that senses the presence or absence of an object in front of the display, An output change processing unit that executes processing for changing the output form of the content on the display triggered by the presence detection of the object in the object detection unit when the video obtained by the video acquisition unit is a video of a predetermined object; Is provided.

  In the display control apparatus of the present invention, the output change processing unit recognizes the presence of the object in the previous object detection unit as the presence of a person when the video obtained by the video acquisition unit is a human video, It is preferable that the content output form changes on the display.

  In the display control device of the present invention, the output change processing unit may detect the previous object when the video obtained by the video acquisition unit is a human video and the human video is a face video facing the display. It is preferable that the presence detection of the object in the unit is recognized as the presence of a person who turns his face to the display and is used as a trigger for a change in the output form of the content on the display.

  In the display control apparatus of the present invention, the object detection unit senses the presence / absence and location of an object in front of the display, and the output change processing unit receives a predetermined image obtained by the image acquisition unit. When the object is detected by the object detector in the case of an image of the object, the information on the position of the object is checked against a display table that defines a change in the output form of the content according to the object position. It is preferable that the process of changing the output form of the content on the display according to the position information is executed.

  In the display control device of the present invention, it is preferable that the object detection unit is an infrared sensor or an ultrasonic sensor.

  The display control method of the present invention is a method for controlling a display by a computer, acquires an image in front of the display, senses the presence or absence of an object in front of the display, and the image in front of the display is a predetermined object. In the case of the video, the processing for changing the output form of the content on the display is executed with the detection of the presence of the object.

  The display control program of the present invention is a program for causing a computer to execute a display control method, the step of acquiring an image in front of the display, the step of sensing the presence or absence of an object in front of the display, And a step of executing content output form change processing on the display in response to sensing of the presence of the object in the object detection unit when the video information obtained by the video acquisition unit is a video of a predetermined object.

  The display according to the present invention includes a video acquisition unit that acquires a video in front of the display, an object detection unit that detects presence or absence of an object in front of the display, and video information obtained by the video acquisition unit is a video of a predetermined object. In some cases, the apparatus includes a display control device having an output change processing unit that executes processing for changing the output form of content on the display in response to sensing of the presence of an object in the object detection unit.

  The display control device of the present invention is a display control device that executes processing in response to an input to a prompt displayed on a display, and includes a video acquisition unit that acquires a video in front of the display, and an object in front of the display An object detection unit that detects the object, and a processing unit that executes processing in response to an input to the prompt corresponding to the detection of the object of the object detection unit, the processing unit obtained from the video acquisition unit When the video is a video of a predetermined object, the detection of the object by the object detection unit is validated.

  The display control device of the present invention includes a display that displays a prompt, a video acquisition unit that acquires a video in front of the display, an object detection unit that detects an object in front of the display, and the object in the object detection unit. A processing unit that executes a process in response to an input to the prompt corresponding to the detection of the image, and the processing unit detects the object when the video obtained from the video acquisition unit is a video of a predetermined object. Enables the detection of the object.

  According to the present invention, the convenience of the user can be achieved, and the display can be managed efficiently and at low cost.

It is a figure which shows the outline | summary of the display and display control apparatus of this embodiment. It is a block diagram of the display and display control apparatus of this embodiment. It is a figure which shows the outline | summary of the ultrasonic sensor of this embodiment. It is a figure which shows the output characteristic of the ultrasonic sensor of this embodiment. It is a figure which shows the example of a data structure of the display table in this embodiment. It is a figure showing a screen transition when a user accesses the display of this embodiment. It is a flowchart which shows operation | movement of the display control apparatus of this embodiment. It is a figure which shows the still image of a certain time T image | photographed with the camera of this embodiment. It is a figure which shows the image which extracted the skin color area | region from the still image of the certain time T image | photographed with the camera of this embodiment. It is a figure which shows the image which filled the micro area | region in the skin color area | region with the skin color from the still image of the certain time T image | photographed with the camera of this embodiment. It is a figure which shows the image which deleted the skin color area | region where the pixel number is smaller than a certain fixed value from the still image of the certain time T image | photographed with the camera of this embodiment. It is a figure which shows the image which detected eyes from the still image of the certain time T image | photographed with the camera of this embodiment. It is a figure which shows the image which deleted the skin color area | region where two eyes do not exist from the still image of the certain time T image | photographed with the camera of this embodiment. It is a flowchart which shows the face detection operation | movement in the display control apparatus of this embodiment.

--- Examples of display installation mode ---
Embodiments of the present invention will be described below in detail with reference to the drawings. FIG. 1 is a diagram showing a display control apparatus 10 and a display 20 according to the present invention. The display 20 to be controlled by the display control device 10 of the present invention can be assumed to be installed in a department store or a shopping mall, for example, and used as a display board for in-store shop guidance. On such a display board, summary display information indicating the outline of the store, such as the name of the store on each floor, the product attributes handled, and the atmosphere, is displayed as the content 30. In the example shown in FIG. 1, for example, for each floor of a department store, stores 1-A, 1-B, 1-C, 1-D on the first floor, stores 2-A, 2-B, 2-C on the second floor, 2-D,... And general display information 31 are displayed.

  The display control apparatus 10 includes a video camera 101 for photographing the front of the display 20 serving as the display board, and an ultrasonic wave for detecting the presence / absence and position of a user who performs an input or selection instruction in front of the display 20. Sensors 104 to 107 are provided. The video camera 101 and the ultrasonic sensors 104 to 107 are connected via the interface bus 102.

  The video camera 101 is, for example, located at the top 21 of the display 20 with the front of the display 20 as the shooting direction, and the width and height of the screen of the display 20 at a position about 30 cm away from the screen 22 of the display 20. It is assumed that the range 108 corresponding to is set so that it can be photographed. Further, the ultrasonic sensors 104 to 107 correspond to the arrangement matrix 33 of the outline display information 31 corresponding to each store, and at least one for each column of the arrangement matrix 33, near the top portion 21 of the display 20. Installed. An area where an object such as a person can be detected near the screen 22 of the display 20 by the ultrasonic sensors 104 to 107 is a range 109 shown in FIG.

--- System configuration example ---
FIG. 2 is a block diagram of the display 20 and the display control device 10 of the present embodiment. The display control device 10 includes a CPU 201 that executes arithmetic processing, a large display panel 20 as a display, a memory 203, a storage device 204 such as a magnetic disk, and the like, which are connected by an internal bus 205. The internal bus 205 is connected to the interface bus 102 for connecting to the video camera 101 and the IF (interface) conversion 206 for converting between the internal bus 205 and the control board 210 of the ultrasonic sensors 104 to 107. An IF (interface) conversion 207 for converting between the interface bus 209 and the internal bus 205 is connected.

  The large display panel as the display 20 is included in the display control device 10 (display control device 10 surrounded by a solid line in the figure) and not included (display control device 10 surrounded by a broken line in the drawing). Both can be assumed. Further, as the display control device 10, an example in which the video camera 101 and the ultrasonic sensors 104 to 107, the control base 210 attached thereto, and the interface signal lines 215 to 218 are not included can be assumed. In this case, the display control device 10 is a device that acquires and uses the video in front of the display control device 10 and the detection information of the presence / absence of an object from the video camera 101 and the ultrasonic sensors 104 to 107.

  Next, functional units included in the display control apparatus 10 of the present invention will be described. The control board 210 is connected to a plurality of ultrasonic sensors 104 to 107 via interface signal lines 215 to 218, reads output values of the respective ultrasonic sensors, and performs IF (interface) conversion 207 and internal bus 205. The reading value is transmitted to the CPU 201 via the CPU 201.

  The display control apparatus 10 reads the program 12 stored in the program database 11 such as a rewritable memory to the memory 203 and executes it by the CPU 201 as an arithmetic unit so as to realize the function of executing the display control method of the present invention.

  The display control device 10 will be described with respect to functional units configured and held based on the program 12, for example. The display control apparatus 10 includes a video acquisition unit 110 that acquires a video in front of the display, and an object detection unit 111 that senses the presence or absence of an object in front of the display.

  Further, the display control device 10 outputs the content 30 on the display 20 when the object obtained by the object detection unit 111 is detected when the image obtained by the image acquisition unit 110 is an image of a predetermined object. An output change processing unit 112 that executes change processing is provided.

  In the display control device 10, the output change processing unit 112 recognizes the presence detection of the object in the previous object detection unit 111 as the presence of a person when the video obtained by the video acquisition unit 110 is a human video. However, it is preferable that the display 20 is triggered by a change in the output form of the content 30.

  In the display control device 10, the output change processing unit 112 determines that the video obtained by the video acquisition unit 110 is a person video and the person video is a face video facing the display 20. It is preferable that the presence detection of the object in the object detection unit 111 is recognized as the presence of a person facing his face to the display 20 and is used as a trigger for the change in the output form of the content 30 on the display 20.

  Further, in the display control device 10, when the object detection unit 111 senses the presence / absence and position of an object in front of the display, the output change processing unit 112 is obtained by the video acquisition unit 110. When the image is an image of a predetermined object, when the object detection unit 111 senses the presence of the object, the information on the position of the object is displayed, and the display table 125 that defines the change in the output form of the content 30 according to the object position. It is preferable to execute processing for changing the output form of the content 30 on the display 20 according to the information on the presence position.

  Further, it can be assumed that the object detection unit 111 is either an infrared sensor or an ultrasonic sensor.

  The display control device 10 is a device that executes processing in response to an input to a prompt displayed on the display 20 (a symbol, a character, an image, or the like displayed in a command waiting state by the computer). In this case, similarly to the above, the image acquisition unit 110 and the object detection unit 111 are provided, and a processing unit that executes a process in response to an input to the prompt corresponding to the detection of the object by the object detection unit 111 is provided. . This processing unit can be handled by the output change processing unit 112. In this case, when the video obtained from the video acquisition unit 110 is a video of a predetermined object, the processing unit validates the detection of the object by the object detection unit 111.

  Note that each of the functional units 110 to 112 in the display control apparatus 10 described so far may be realized as hardware, or as a program stored in an appropriate storage device such as a memory or an HDD (Hard Disk Drive). It is good. In this case, the CPU 104 reads the corresponding program 102 from the storage device to the memory 103 and executes it in accordance with the program execution.

--- Outline of ultrasonic sensor ---
FIG. 3 shows a schematic diagram of the ultrasonic sensors 104 to 107. The ultrasonic sensors 104 to 107 here have a structure in which an ultrasonic oscillation element 302 and a reception element 303 are attached to a base 301. The base 301 has a function of changing a time from when an ultrasonic wave is oscillated from the oscillating element 302 until the reflected wave of the ultrasonic wave reaches the receiving element 303 to a voltage, and supplying the voltage to the signal line 305. The ultrasonic sensors 104 to 107 are supplied with power from the power supply voltage 304 and are given level positions at the ground level 306. Further, the signal line 305 is combined with the power supply voltage 304 and the ground level 306 to form interface signal lines 215 to 218.

  FIG. 4 shows output characteristics of the ultrasonic sensors 104 to 107. Assuming that the distance between the ultrasonic sensors 104 to 107 and the detection target 401 is L, the output value is a constant value of Amin when L <Lmin. When Lmin <L <Lmax, the output value increases on a straight line. When L> Lmax, the output value is Amax, which is a constant value. In the present embodiment, the distance from the lower end 25 of the screen 22 of the display 20 to the ultrasonic sensor is set to Lmax.

---- Table structure ---
Next, the structure of the table used by the display control apparatus 10 in this embodiment will be described. FIG. 5 is a diagram showing an example of the data structure of the display table in the present embodiment. The display table 125 is a table that defines a change in the output form of content according to an object presence position in front of the display 20 (eg, a position where the user is about to touch the general display information 31 output from the display 20). Yes, for example, a record that associates information such as the summary display information 31 associated with the ID 601 and the detailed display information 32 thereof with the ID 601 of the summary display information 31 displayed (should) displayed near the object location as a key It is an aggregate of. The detailed display information 32 is more detailed information related to the store corresponding to the general display information 31, and a pseudo touch of the user to the general display information 31 (the ultrasonic sensors 104 to 107 can detect the actual display before the touch). Therefore, the display control apparatus 10 outputs information to the display 20 in accordance with the screen 22 (see FIG. 6). The display table 125 may be stored in the storage device 204 of the display 20.

--- Processing flow example ---
Hereinafter, the actual procedure of the display control method in the present embodiment will be described with reference to FIG. Various operations corresponding to the display control method described below are realized by the program 12 that the display control apparatus 10 reads out to the memory 203 and executes. And this program 12 is comprised from the code | cord | chord for performing various operation | movement demonstrated below.

  In this flow, after the power is turned on, the display control device 10 takes out, for example, four pieces from the head of each department store floor from the store display information 125 in the display table 125 in the storage device 204, The image is displayed on the large display panel 20 (step 701). For example, for the first floor of the department store, four outline display information 31 of 1-A, 1-B, 1-C, 1-D is displayed (see FIG. 1).

  The summary display information 31 can be said to be a prompt (symbol, character, image, etc. displayed by the computer in a command waiting state) displayed on the display 20. In this case, the display control device 10 is a device that performs processing in response to various inputs by the person via the ultrasonic sensors 104 to 107 and the like with respect to the outline display information 31, that is, prompts. That is, the display control apparatus 10 detects the object by the object detection unit 111 such as the ultrasonic sensors 104 to 107 when the image obtained from the image acquisition unit 110 is an image of a predetermined object such as a person. It will be activated.

  Next, the display control apparatus 10 captures an image taken in front of the large display panel 20 from the video camera 101 via the interface bus 102, IF conversion 206, and internal bus 205 (step 702).

  Next, the display control apparatus 10 cuts out a still image at a certain time T from the image obtained from the video camera 101 (step 703). Further, the display control apparatus 10 extracts a skin color region and a region corresponding to human eyes from the still image cut out at time T (step 704). At this time, if a skin color area having a size equal to or larger than a certain size and including two parts that can be recognized as human eyes in the skin color area, the still image includes a human skin facing the front. The display control apparatus 10 determines that a face image is included (step 705). The operation of Steps 704 and 705 will be described in more detail with reference to FIGS.

  For example, it is assumed that the still image extracted by the display control apparatus 10 at time T is an image group 800 shown in FIG. Since the large display panel 20 of this embodiment is installed in a department store, a shopping center, or the like, an unspecified number of people exist in front of the large display panel 20, and as shown in an image group 800 in FIG. It is assumed that many people are photographed. As an example of such a person, for example, a person who is looking at the large display panel 20 from a distance as shown in an image 801 in the image group 800, or a person who crosses the front of the large display panel 20 as shown in an image 802, or As shown in the image 803, there are various people such as a person who is approaching the large display panel 20 and is trying to access something.

  The video camera 101 detects, for example, whether or not there is a person holding his / her hand in a region where the ultrasonic sensors 104 to 107 react, that is, a range 109 in which an object can be detected by the ultrasonic sensors 104 to 107. Therefore, a person who can hold his / her hand over the region 109 to which the ultrasonic sensors 104 to 107 react should be sufficiently close to the large display panel 20, and the video camera 101 shoots a person image shown in an image 803. The image appears larger than a certain size. That is, the skin color area becomes larger than a predetermined value.

  Next, an operation for extracting a human face from the image group 800 will be described. FIG. 14 is a flowchart showing a face detection operation in the display control apparatus 10 of the present embodiment. As shown in FIG. 9, the display control apparatus 10 extracts only the skin color region 810 from the still image group 800 of FIG. 8 (step 1401). Next, the display control apparatus 10 paints a region 804 (for example, hitting an eye or a mouth) that is surrounded by the skin color region 810 and has a color different from the skin color region 810 with a skin color (step 1402). FIG. 10 shows an example of an image in which different color areas 804 surrounded by the skin color area 810 such as eyes and mouth are filled with the skin color. The skin color area is recognized separately for each of the images 801, 802, and 803 and the predetermined area.

  Next, as shown in FIG. 11, the display control apparatus 10 compares the number of pixels of the skin color region 810 in each of the images 801 to 803 with a constant value α, and an image 801 of the skin color region 810 having a smaller number of pixels than α is obtained. It is deleted (step 1403). The constant value α is a value stored in the storage device 204, for example, and is read from the storage device 204 and used when the display control device 10 uses it.

  The constant value α is a value determined by the installation location of the video camera 101, the angle at which the video camera 101 can shoot, and the like. As this α, for example, when installing the large display panel 20, a plurality of persons are placed in the detection range 109 of the ultrasonic sensors 104 to 107 in front of the large display panel 20, and the pixels of the skin color area of each person measured here are measured. A value obtained by subtracting a constant value γ from the minimum number can be used. The fixed value α thus determined is stored in the storage device 204, for example.

  In this way, by deleting the image of the minute skin color area having the number of pixels equal to or less than the predetermined value α, an image of a person looking at the large display panel 20 from a distance like the image 801 is accessed to the large display panel 20. Can be excluded in advance from the category of the person who is doing.

Next, as shown in FIG. 12, the display control apparatus 10 extracts a part corresponding to the eye from the images 802 and 803 (step 1404). Specifically, a black region whose luminance is a certain value β or less is extracted from the camera image 800 shown in FIG. The constant value β is also stored in the storage device 204, for example, as with the constant value α, and is read from the storage device 204 and used when the display control device 10 uses it. Here, among the black areas detected by the display control apparatus 10, an area in the skin color area 810 of the images 802 and 803 in FIG. 11 is detected as the eye 811. In order to avoid erroneous detection of eyebrows and eyes, when a plurality of black areas exist in one skin color area 810, the eyes are detected under the following three conditions.
(1) The number of eyes in the skin color area is within two.
(2) The eyes must be laterally separated by at least a quarter of the face width.
(3) The horizontal shift of the second eye is larger than the vertical shift.
The display control apparatus 10 performs eye detection under the above three conditions. FIG. 12 shows an image in which the eyes 811 are detected in the skin color area 810.

  The display control apparatus 10 that has extracted a black region whose luminance is a certain value β or less next deletes the image 802 of the skin color region 810 that does not have two eyes 811 as shown in FIG. 13 (step 1405). End the flow. Thereby, an image of a person who crosses the front of the large display panel 20 like the image 802, that is, a person who does not face the large display panel 20 can be deleted.

  In this way, the display control device 10 detects a person who is directly facing the large display panel 20 and within a certain distance. Hereinafter, the flow description returns to the flow of FIG. In the case of the still image 800 in the present embodiment, the number of persons who are near the large display panel 20 and facing the front is “1”.

  When the number of persons near the large display panel 20 and facing the front is “0” (step 705: NO), the display control apparatus 10 returns the process to step 701. Thus, when the person who is near the large display panel 20 and facing the front is “0”, the process immediately returns to step 701 to newly enter the predetermined range in front of the large display panel 20. When there is a person who has moved, it is possible to quickly accept and process access by the person.

  When a person is present near the large display panel 20 and the person facing the front of the screen 22 of the large display panel 20 is “1” or more (step 705: YES), the display control apparatus 10 The recognition processing of the image input from the video camera 101 is temporarily suspended, and the output values of the ultrasonic sensors 104 to 107 via the interface signal lines 215 to 218, the control board 210, the interface bus 209, the IF conversion 207, and the internal bus 205. Is read (step 706).

  When a person watching the large display panel 20 does not bring his hand close to the screen 22 of the large display panel 20, the output values of the ultrasonic sensors 104 to 107 are all “Amax” (see FIG. 4). In this case, assuming that the output values of the ultrasonic sensors 104 to 107 are not included in the corresponding value of the detection range 109 (step 707: NO), the process returns to step 701. As described above, when the process immediately returns to step 701 in this step, the person in front of the large display panel 20 accesses the detection range 109 of the ultrasonic sensors 104 to 107 immediately after the process of step 707. Quick response is possible.

  On the other hand, when a person watching the large display panel 20 brings his hand close to the screen 22 of the large display panel 20, only the ultrasonic sensor installed above the hand outputs a predetermined output value. In this case, the output values of the ultrasonic sensors 104 to 107 are values corresponding to the distance between the ultrasonic sensor and the person's hand. For example, when a person watching the screen 22 of the large display panel 20 brings his hand close to the general display information 31 of the store “4-A” on the “fourth floor” shown in FIG. The output value 104 is an output value range 405 (see FIG. 4) that is not less than “A4L” and not more than “A4H”. The output values of the ultrasonic sensors 105 to 107 remain “Amax”. As shown in FIG. 4, the output value ranges corresponding to the other floors: 1st to 3rd floors are output value ranges 402, 403, and 404, respectively.

  In this case, the CPU 201 of the display control device 10 determines that a person's hand has approached the general display information 31 of the store “4-A” on the fourth floor (step 707: YES), and responds from the display table 125 of the storage device 204. The detailed display information 32 of the store “4-A” to be read is read, and the detailed display information 32 is displayed in the area 501 on the screen of the large display panel 20 shown in FIG. 6 (step 708).

  After the display control device 10 has started displaying the detailed display information 32 and a predetermined time has passed since the person (user) has set a sufficient time to view the detailed display information 32 (step 709), the display control device 10 The output of the detailed display information 32 displayed in the area 501 and the area 501 is terminated (step 710), and the process returns to step 701.

  If a person watching the screen 22 of the large display panel 20 accesses (operates) the large display panel 20, it is assumed that the video camera 101 does not perform recognition processing of the captured image. The CPU load at 10 can be reduced, and malfunctions such as a transition of the display to a screen unintended by the user during the display of the detailed display information 32 are unlikely to occur.

  Further, when two or more ultrasonic sensors simultaneously output an output value of “A4L” or more and “A4H” or less, two or more persons may be accessing the large display panel 20 at the same time. . In that case, the display control device 10 extracts and displays a predetermined warning message such as “Please do not access by two or more people simultaneously” from the storage device 204 or the like. Further, the display control device 10 may display the detailed display information 32 corresponding to access from either one of the persons who have accessed at the same time. Alternatively, the display area on the screen 22 is divided by the total number of detailed display information 32 corresponding to each instruction corresponding to the instructions of all persons who have accessed at the same time, and the detailed display information 32 is displayed in each display area. Also good. In this case, the display control apparatus 10 permits access by a plurality of people.

  The display control apparatus 10 that has returned the processing to step 701 redisplays the general display information 301 regarding the store on each floor in the department store as described above. Thereafter, as shown in step 702, an image input from the video camera 101 is captured, and the process of recognizing the suspended person is resumed. Thereafter, the above steps are repeated until the operation of the large display panel 20 is stopped.

  As described above, according to the present invention, by using a combination of a sensor such as an ultrasonic sensor and a photographing unit such as a video camera, for example, an approach to an ultrasonic sensor detection area by an insect other than a human being, You can cancel the process of changing the display on the display due to the entry to the ultrasonic sensor detection area by a person who only crosses the front of the display (such as an arm or clothes) Efficient display control can be realized.

  Moreover, an ultrasonic sensor or the like used for such processing is relatively inexpensive, and the CPU burden related to data processing can be reduced. Therefore, for example, it is possible to configure a display control apparatus that is low in cost and has high processing efficiency as compared with a conventional method that processes images captured by two or more cameras.

  Therefore, convenience for the user can be achieved, and efficient and low-cost management of the display becomes possible.

  As mentioned above, although embodiment of this invention was described concretely based on the embodiment, it is not limited to this and can be variously changed in the range which does not deviate from the summary.

DESCRIPTION OF SYMBOLS 10 Display control apparatus 11 Program database 12 Program 20 Display 21 Display top part 22 Screen 25 Bottom of screen 30 Content 31 Outline display information 32 Detailed display information 33 Arrangement matrix 101 Video camera 102 Interface bus 104-107 Ultrasonic sensor 108 Camera imaging range 109 Detection range of ultrasonic sensor 110 Image acquisition unit 111 Object detection unit 112 Output change processing unit 125 Display table 201 CPU
203 Memory 204 Storage Device 205 Internal Bus 206 IF Conversion 207 IF Conversion 209 Interface Bus 210 Ultrasonic Sensor Control Base 215-218 Interface Signal Line 301 Ultrasonic Sensor Base 302 Ultrasonic Transmitter 303 Ultrasonic Receiver 304 VCC
305 Signal line 306 GND

Claims (10)

A device for controlling a display,
A video acquisition unit that acquires the video in front of the display;
An object detection unit that senses the presence or absence of an object in front of the display;
An output change processing unit that executes processing for changing the output form of the content on the display triggered by the presence detection of the object in the object detection unit when the video obtained by the video acquisition unit is a video of a predetermined object;
A display control device comprising: In claim 1,
When the video obtained by the video acquisition unit is a human video, the output change processing unit recognizes the presence detection of the object in the previous object detection unit as the presence of a person, and triggers a change in the output form of the content on the display. A display control device characterized by that. In claim 2,
When the video obtained by the video acquisition unit is a human video and the human video is a face video facing the display, the output change processing unit detects the presence of an object in the previous object detection unit on the display. A display control apparatus that recognizes the presence of a person facing the camera and triggers a change in the output form of content on the display. In any one of Claims 1-3,
The object detection unit senses the presence / absence and position of an object in front of the display,
When the video obtained by the video acquisition unit is a video of a predetermined object, the output change processing unit, when sensing the presence of the object in the object detection unit, information on the location of the object according to the object location A display control apparatus, wherein the content output form change is collated with a predetermined display table, and the process of changing the content output form on the display according to the information on the existing position is executed. In any one of Claims 1-4,
The display control apparatus, wherein the object detection unit is an infrared sensor or an ultrasonic sensor. A method of controlling a display with a computer,
Get the video in front of the display,
Sense the presence or absence of objects in front of the display,
A display control method, wherein when the image in front of the display is an image of a predetermined object, the process of changing the output form of content on the display is executed upon detection of the presence of the object. A program for causing a computer to execute a display control method,
Obtaining a video in front of the display;
Sensing the presence or absence of an object in front of the display;
When the video information obtained by the video acquisition unit is a video of a predetermined object, the process of changing the output form of the content on the display triggered by the presence detection of the object in the object detection unit;
Display control program including A video acquisition unit that acquires the video in front of the display;
An object detection unit that senses the presence or absence of an object in front of the display;
An output change processing unit that, when the video information obtained by the video acquisition unit is a video of a predetermined object, executes a process of changing the output form of content on the display triggered by the presence detection of the object in the object detection unit; ,
A display comprising a display control device. In a display control device that executes processing in response to an input to a prompt displayed on a display,
A video acquisition unit for acquiring a video in front of the display;
An object detection unit for detecting an object in front of the display;
A processing unit that executes processing in response to an input to the prompt corresponding to the detection of the object by the object detection unit;
The display control apparatus, wherein the processing unit validates the detection of the object by the object detection unit when the video obtained from the video acquisition unit is a video of a predetermined object. A display that displays prompts;
A video acquisition unit for acquiring a video in front of the display;
An object detection unit for detecting an object in front of the display;
A processing unit that executes processing in response to an input to the prompt corresponding to the detection of the object by the object detection unit;
The display control apparatus, wherein the processing unit validates the detection of the object by the object detection unit when the video obtained from the video acquisition unit is a video of a predetermined object.