JP2013080135A - Image display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display device that displays an image that is related to a passenger being in front of a display screen, and attracts interest of the passenger.SOLUTION: An image display device 1 includes: a display 4 that displays a display image; a camera 2 that picks up an image of the front of the display 4; and a PC 3 that controls the display image. The PC 3 displays a picked-up image that is picked up by the camera 2 on the display 4. The PC 3 executes predetermined part detection processing for detecting a predetermined part of a user 20, and displays a decorative image displayed with the detected predetermined part as an original point together with the picked-up image picked up by the camera 2 on the display 4 as a display image.

Description

  The present invention relates to an image display device that displays an image on a display surface.

  In recent years, as an image display device installed in a vehicle or a store for displaying an advertisement or the like, a device that can display a moving image is often used. As such an image display apparatus, an apparatus capable of displaying a moving image or the like (hereinafter referred to as “image”) that can effectively attract the attention of a passerby is preferable.

  For example, Patent Document 1 discloses an image display device that can display an image controlled by a computer on a display. According to such an image display device, it is possible to gather a certain amount of attention of passersby by distributing continuous video to a plurality of displays arranged at the same place.

Japanese Patent Laid-Open No. 2003-157036

  However, such a conventional image display device only displays a predetermined image that is not related to a passerby who passes in front of the image display device. For this reason, the image displayed on such an image display device is only lacking in change and novelty for passers-by, and it is difficult to effectively gather the attention of passers-by using this image. there were.

  The present invention has been made in view of such circumstances, and provides an image display device that displays an image that is related to a passerby located in front of the display surface and can attract the passerby's interest. For the purpose.

  A first aspect of the present invention is an image display device comprising display means for displaying a display image on a display surface, image pickup means for picking up the front of the display surface as a picked-up image, and control means for controlling the display image. The control means executes an image display process for displaying a decoration image in a predetermined area set starting from a position where a predetermined part of the user is displayed in the captured image, and the decoration image is displayed on the captured image. In addition, the display image is displayed on the display surface.

  In the same configuration (the image display device according to the first aspect), the control device displays a decoration image in a predetermined area starting from a position where the predetermined part of the user is displayed in the captured image obtained by imaging the front of the display surface. To do. And this decoration image and a captured image are displayed on a display surface as a display image. For this reason, the decoration image is displayed on the display surface starting from the predetermined part of the user, together with the image in front of the display surface. According to the configuration, by displaying the decoration image at the position related to the user as described above, the display image related to the user can be displayed on the display surface. Therefore, an image that can attract the interest of a passerby who is a user can be displayed on the display surface.

  A second aspect of the present invention is the image display device according to the first aspect, wherein the control means detects a change between a previous captured image and a current captured image having different imaging times as white pixels. The position where the predetermined part is displayed is detected based on the position where the white pixel is displayed.

  A third aspect of the present invention is the image display device according to the first aspect or the second aspect, wherein the imaging means determines that the user is not located within a predetermined range from the display surface. Execution of the image display process is prohibited.

  According to the same configuration (the image display device according to the third aspect), since the execution of the image display process is prohibited when the user is not located within a predetermined range from the display surface, the user is placed in front of the display surface. Thus, it is possible to prevent the image display process from being executed until there is no need to display a decorative image on the display surface.

  A fourth aspect of the present invention is the image display device according to the second aspect or the third aspect, wherein the control means includes a virtual dividing line that divides the captured image into an upper region and a lower region in the captured image. And when the white pixel is detected in the lower region, the user is positioned within a predetermined range from the display surface when the white pixel is continuously detected up to the virtual partition line. It is characterized by being judged.

  When the imaging unit is arranged so that the whole body of the user located in front can be imaged, the floor surface in front of the imaging unit is displayed in the lower region of the captured image captured by the imaging unit. A space on the floor is displayed in the upper area of the captured image. For this reason, when the user is positioned in front of the imaging means, the user's foot on the floor is detected as a white pixel in the lower region, and the user's lower limbs are continuously connected to the virtual partition line. Thus, it is detected as a white pixel.

  In the same configuration (the image display device according to the fourth aspect), when white pixels are detected in the lower region in this way, the white pixels are continuously detected up to the virtual partition line, so that a predetermined range from the display surface is obtained. Therefore, it can be suitably determined whether or not the user is located within a predetermined range from the display surface.

  A fifth aspect of the present invention is the image display device according to any one of the second aspect to the fourth aspect, wherein the control means is an area where the white pixel is displayed as the predetermined area where the decoration image is displayed. It is characterized in that it is set based on the size of.

  According to the same configuration (the image display device according to the fifth aspect), the predetermined area for displaying the decoration image can be set based on the moving speed of the user, so the decoration image can be set based on the movement aspect of the user. Can be displayed.

  A sixth aspect of the present invention is the image display device according to any one of the first aspect to the fourth aspect, wherein the control means changes between a previous captured image and a current captured image having different imaging times. Minutes are detected as white pixels, the centroid positions of the areas where the white pixels are displayed are calculated, and the predetermined area is set based on the moving direction of the centroid position.

  According to the same configuration (the image display device according to the sixth aspect), it is possible to set a predetermined area for displaying the decorative image based on the moving direction of the predetermined part. It can be displayed on the display surface.

A seventh aspect of the present invention is the image display device according to any one of the first to sixth aspects, wherein the position where the predetermined part of the user is displayed is (x ′, y ′). The predetermined area is based on w _x , w _y , v _x , v _y , w ₁ , w ₂ , w ₃ , w ₄ , A, B, C, and D, which are predetermined constants, and the following formula: It is characterized by being set.
_{X = (w x + v x} ) t + Asin (w 1 t) + Bsin (w 2 t) + x'
Y = (w _y + v _y ) t + C cos (w ₃ t) + D cos (w ₄ t) + y ′

  ADVANTAGE OF THE INVENTION According to this invention, the image display apparatus which displays the image which is related with the passerby located ahead of a display surface, and can attract a passerby's interest can be provided.

(A) is a schematic block diagram of the image display apparatus concerning 1st embodiment of this invention, (b) is explanatory drawing for demonstrating the predetermined site | part detection process concerning the embodiment. 6 is a flowchart showing a display image processing method according to the embodiment. The flowchart which shows the process sequence of the predetermined part detection process concerning the embodiment. 6 is a flowchart showing a processing procedure for image display processing according to the embodiment; (A) is a schematic block diagram of the image display apparatus by which the display image concerning the embodiment is displayed, (b) is a display screen figure of the display which shows an example of the display image concerning the embodiment. (A) is explanatory drawing for demonstrating the predetermined site | part detection process concerning other embodiment, (b) is a schematic block diagram of the image display apparatus by which the display image concerning the embodiment is displayed. The flowchart which shows the processing method of the display image concerning 2nd embodiment of this invention. (A) is the schematic which shows the image display apparatus and user concerning the embodiment, (b) is explanatory drawing for demonstrating the position detection process concerning the embodiment. 6 is a flowchart showing a processing procedure of position detection processing according to the embodiment. (A) ~ (d) is a third embodiment in accordance initial velocity v _x, v explanatory diagram for explaining a method of calculating _y of the present invention. (A) is a schematic block diagram of the image display apparatus concerning 4th embodiment of this invention, (b) is explanatory drawing for demonstrating the predetermined site | part detection process concerning the embodiment. 6 is a flowchart showing a display image processing method according to the embodiment; The flowchart which shows the process sequence of the distance judgment process concerning the embodiment. The flowchart which shows the process sequence of the predetermined part detection process concerning the embodiment. The schematic block diagram of the image display apparatus by which the display image concerning the embodiment is displayed. (A) is explanatory drawing for demonstrating the predetermined site | part detection process concerning other embodiment, (b) is a schematic block diagram of the image display apparatus by which the display image concerning the embodiment is displayed. The flowchart which shows the processing method of the display image concerning 5th embodiment. The flowchart which shows the process sequence of the predetermined part detection process concerning the embodiment. The schematic block diagram of the image display apparatus by which the display image concerning the embodiment is displayed. (A) is explanatory drawing for demonstrating the predetermined site | part detection process concerning other embodiment, (b) is a schematic block diagram of the image display apparatus by which the display image concerning the embodiment is displayed. (A) is a schematic block diagram of the image display apparatus concerning 6th embodiment of this invention, (b) is explanatory drawing for demonstrating the predetermined site | part detection process concerning the embodiment. The flowchart which shows the process sequence of the predetermined part detection process concerning the embodiment. The schematic block diagram of the image display apparatus by which the display image concerning the embodiment is displayed. (A) is explanatory drawing for demonstrating the predetermined site | part detection process concerning other embodiment, (b) is a schematic block diagram of the image display apparatus by which the display image concerning the embodiment is displayed. The flowchart explaining the process sequence of the image display process concerning 7th embodiment. (A) ~ (d), the initial velocity _v x according to the embodiment, _v explanatory diagram for explaining a calculation method of _y. (A) And (b) is a display screen figure of the display which shows an example of the display image concerning the embodiment. The schematic block diagram of the image display apparatus concerning other embodiment. The schematic block diagram of the image display apparatus concerning other embodiment.

(First embodiment)
Hereinafter, a first embodiment embodying the present invention will be described with reference to FIGS.
First, a schematic configuration of the image display apparatus 1 according to the present embodiment will be described with reference to FIG.

  As shown in FIG. 1A, an image display device 1 includes a camera 2 (corresponding to “imaging means” of the invention) and a PC 3 (personal computer of the invention) connected to the camera 2. And a display 4 (corresponding to the “display surface” of the present invention) connected to the PC 3. The camera 2 and the display 4 are preferably installed in a vehicle, a store, or the like through which many passersby (hereinafter “users”) pass.

The camera 2 is disposed at the upper center of the display 4 and images the front of the display 4.
Here, the imaging range of the camera 2 may be a range in which the whole body of the user 20 standing in front of the display 4 can be accommodated.

  Note that the connection method between the camera 2 and the PC 3 and the connection method between the PC 3 and the display 4 are not particularly limited, and may be connected via, for example, a wired or wireless network.

  In the image display device 1 configured as described above, image information of an image in front of the display 4 (hereinafter, “captured image”) captured by the camera 2 is output to the PC 3. The camera 2 images the front of the display 4 any number of times from 5 to 30 times per second. When the number of captured images is less than 5 times per second, it is difficult to appropriately capture the movement of the user 20. On the other hand, if the number of captured images exceeds 30 times per second, the amount of image to be processed by the PC 3 becomes too large.

  On this captured image, as shown in FIG. 1B, the PC 3 displays the horizontal direction as the X axis, the direction perpendicular to the horizontal direction as the Y axis, the lower left corner as (0, 0), and the upper right corner as ( Set coordinates as W, H). Then, the decoration image is superimposed on the captured image in which the coordinates are set to form a display image, and the image information of the display image is output to the display 4. Details will be described below.

  First, a display image processing method in this embodiment will be described with reference to FIG. As shown in FIG. 2, when this process is started, the PC 3 first executes a predetermined part detection process (step S100). And the image display process (step S101) which displays a decoration image in the area | region set from the detected predetermined site | part as a starting point is performed.

Hereinafter, the predetermined part detection process and the image display process will be described in detail.
First, the predetermined part detection process will be described in detail with reference to FIG.
As shown in FIG. 3, when this process is started, first, the PC 3 acquires image information of the captured image from the camera 2 (step S200), and the captured image is divided into white and black gradations. Binarization processing for conversion is performed (step S201).

  And a difference process is performed with respect to the captured image which performed this binarization process (step S202). Specifically, between the captured image acquired from the camera 2 and binarized in the previous control cycle and the captured image acquired from the camera 2 and binarized in the current control cycle To generate a difference image. When there is a change between the captured image acquired in the previous control cycle and the captured image acquired in the current control cycle, white pixels are displayed at the coordinates where the change is located in the difference image.

  Next, the PC 3 stores the captured image obtained from the camera 2 and subjected to binarization processing in the current control cycle (step S203). Then, the PC 3 determines whether or not the gradation value of the coordinate f (x, y) is greater than or equal to the reference value C in the difference image (step S204). The reference value C is preferably set to a value of “200” or more, and more preferably set to a value of “250” or more. In the present embodiment, “255” is set in advance for the purpose of stable detection of a predetermined part.

  When it is determined that the gradation value of the coordinate f (x, y) is greater than or equal to the reference value C (step S204; YES), a white pixel is displayed at the coordinate f (x, y). That is, the image displayed at the coordinate f (x, y) of the captured image acquired in the previous control cycle and the image displayed at the coordinate f (x, y) of the captured image acquired in the current control cycle are as follows. Is different.

  In the present embodiment, such a change is caused by the movement of the user 20 standing in front of the display 4, and a predetermined part is located at the coordinates f (x, y). Judge that Therefore, the coordinate f (x, y) is set as a motion detection point (step S209).

  On the other hand, when it is determined that the gradation value of the coordinate f (x, y) is less than the reference value C (step S204; NO), the x coordinate value of the coordinate f (x, y) is incremented (x = x + 1) (step S205). Then, it is determined whether or not the x coordinate value of the coordinate f (x, y) is equal to or greater than a predetermined value W (the right end value of the x coordinate set in the captured image) (step S206).

When it is determined that the x coordinate value of the coordinate f (x, y) is less than the predetermined value W (step S206; NO), the processes of steps S204 and S205 are repeated.
On the other hand, when it is determined that the x coordinate value of the coordinate f (x, y) is greater than or equal to the predetermined value W (step S206; YES), the y coordinate value of the coordinate f (x, y) is incremented (y = y + 1). (Step S207), it is determined whether or not the y coordinate value of the coordinate f (x, y) is equal to or greater than a predetermined value H (the value of the upper end of the y coordinate set in the captured image) (Step S208).

When it is determined that the y coordinate value of the coordinate f (x, y) is less than the predetermined value H (step S208; NO), the processes of steps S204 to S207 are repeated.
On the other hand, when it is determined that the y-coordinate value of the coordinate f (x, y) is greater than or equal to the predetermined value H (step S208; YES), and as described above, the coordinate f (x, y) is used as the motion detection point. After (step S209), the x-coordinate value and the y-coordinate value of the coordinate f (x, y) are set to x = “0” and y = “0” (step S210), respectively, and the predetermined part detection process is temporarily ended.

Next, image display processing will be described in detail with reference to FIG.
As shown in FIG. 4, the present process is started, first, PC3 sets the initial velocity _v x, _{v y} (step S300).
The initial velocity v _x The first moving speed in the x-axis direction of the decoration image, the initial velocity v _y is the first moving speed in the y-axis direction of the decoration image. These initial velocities v _x and v _y may be set to predetermined values in advance, or may be set to different values at the start of this process. In the present embodiment, a predetermined value is set in advance.

Next, the PC 3 determines whether or not the initial speed v _x is “0” or more (step S301). When it is determined that the initial speed v _x is “0” or more (step S301; YES), the initial speed v _x is corrected based on the equation (1) (step S302). Here, the deceleration rate V _x may be preset to a predetermined value may be set according to the speed or the like of movement of the predetermined part.

v _x = v _x −V _x (1)

On the other hand, when it is determined that the initial speed v _x is less than “0” (step S301; NO), the initial speed v _x is set to “0” (step S303).

Then, PC3, the initial velocity _{v y} is equal to or greater than or equal to "0" (step S304). If the initial velocity _{v y} is determined to be "0" or more (step S304; YES), it is corrected based on the initial velocity _{v y} in equation (2) (step S305). Here, the deceleration speed V _y may be set to a predetermined value in advance, or may be set according to a moving speed of a predetermined part. In the present embodiment, the deceleration speeds V _x and V _y are set to predetermined values in advance.

v _y = v _y −V _y (2)

Thus the initial velocity v _x, v by correcting the _y, can be a decoration image is displayed so as to move while decelerating in the x-axis and y-axis directions.
On the other hand, if the initial velocity _{v y} is determined to be less than "0" (step S304; NO), the initial velocity _{v x} = a "0" (step S306).

Next, coordinates g (x, y) for displaying the decoration image are calculated using the following equations (3) and (4) (step S307). In this coordinate calculation, the x-coordinate value and the y-coordinate value of the coordinates f (x, y) at which the detected predetermined part is located are “x ′” and “y ′”, respectively.

x = (w _x + v _x ) t + Asin (ω ₁ t) + Bsin (ω ₂ t) + x ′ (3)
y = (w _y + v _y ) t + C cos (ω ₃ t) + D cos (ω ₄ t) + y ′ (4)

The angular velocities ω ₁ , ω ₂ , ω ₃ , ω ₄ and the constants A, B, C, D are predetermined values determined in advance through experiments or the like. Also, the time t starts counting from when the main image display process is started.

In the present embodiment, the decoration image is displayed so as to flow in the x-axis direction mainly by the wind blowing in the x-axis direction. Therefore, winds flowing in the x-axis direction and the y-axis direction are incorporated in the equations (3) and (4) as wind speeds w _x and w _y , respectively. Note that the wind speeds w _x and w _y may be predetermined speeds set in advance, or may be set to different values at the start of this process.
In the present embodiment, the wind speeds w _x and w _y are set to predetermined values in advance. The wind speed w _x is set to a value larger than the wind speed w _y .

  The PC 3 displays the decoration image at the coordinates g (x, y) calculated based on the formulas (3) and (4) (step S308), and increments the display count n (n = n + 1) (step S309).

  Next, it is determined whether or not the display number n is a predetermined number N or more (step S310). When it is determined that the display number n is less than the predetermined number N (step S310; NO), the processes after step S301 are repeated. On the other hand, when it is determined that the display number n is equal to or greater than the predetermined number N (step S310; YES), the display number n is set to “0” (step S311), and this process is temporarily ended. The predetermined number N is the number of times of calculating the coordinates g (x, y) for displaying the decoration image in one second, and is preferably set to 5 to 30 times, and is set to 15 to 30 times. It is more preferable.

  FIG. 5A shows an image display device 1 that displays a display image at coordinates calculated through the above-described processing. FIG. 5B shows a display screen diagram of the display 4 that displays a display image through the above-described processing.

As shown in FIG. 5B, the decoration image is displayed so as to move mainly in the x-axis direction from the position where the foot of the user 20 is displayed. In FIG. 5B, all decoration images displayed from the start to the end of the image display process are shown. Actually, the decoration image is first displayed at the same position as the position where the predetermined part (in this embodiment, the foot) of the user 20 is displayed. Then, starting from the position where the predetermined part is displayed, the user 20 moves away from the position where the predetermined part of the user 20 is displayed as time passes.
As described above, in the present embodiment, the decoration image is displayed in the area A starting from the predetermined part of the user 20 as shown in FIG.

According to the said embodiment, there can exist an effect described below.
(1) In the present embodiment, the PC 3 is displayed in the captured image in order to detect the position where the predetermined part of the user 20 is displayed based on the change between two captured images having different imaging times. Among them, the one that moves in front of the display 4, that is, the user 20 can be detected appropriately. For this reason, the position where the predetermined part of the user 20 is displayed in the captured image can be detected appropriately.

  (2) Further, the display 4 displays the decoration image together with the image in front of the display 4 and the image of the user 20 from the position where the predetermined part of the user 20 is displayed. Thus, according to this embodiment, since a decoration image can be displayed on the part relevant to the user 20, an image that can attract the interest of a passerby as a user is displayed on the display 4. be able to.

  (3) Since the predetermined area is set starting from the position where the predetermined part is displayed, the decoration image is displayed so as to move from the position where the predetermined part is displayed to another position. The In this way, since the decoration image is displayed so as to move to another position starting from the position where the predetermined part is displayed, an image that can favorably attract the interest of a passerby who is a user can be obtained. It can be displayed on the display.

(Other embodiments)
Hereinafter, another embodiment in which the present invention is embodied will be described based on FIG. 6 with a focus on differences from the first embodiment. In FIG. 6, the same elements as those described in the first embodiment are denoted by the same reference numerals, and redundant descriptions of these elements are omitted.

  As shown in FIG. 6A, the image display device 1 according to the present embodiment has a horizontal direction as an X axis, a direction perpendicular to the horizontal direction as a Y axis, and the upper left corner as an origin ( 0,0) and coordinates with the lower right corner at (W, H) are set.

  In the image display device 1 according to the present embodiment, as shown in FIG. 6 (b), the PC 3 displays a predetermined part with coordinates for displaying the uppermost part (here, the top of the head) of the user 20. The decoration image is displayed so as to flow mainly in the x-axis direction starting from this coordinate as a starting point.

According to the said embodiment, in addition to the effect demonstrated in the said embodiment, there can exist the effect described below.
(4) According to the present embodiment, it is possible to display a decoration image starting from the top of the head, which is a part that is likely to attract the user's 20 attention. For this reason, the image which can attract a passerby's interest more appropriately can be displayed.

(Second embodiment)
Hereinafter, a second embodiment embodying the present invention will be described based on FIGS. 7 to 9 with a focus on differences from the first embodiment. 7 to 9, the same elements as those described in the first embodiment are denoted by the same reference numerals, and redundant description of these elements is omitted.

  In the present embodiment, it is determined whether or not the user 20 is located in front of the display 4. Then, only when the user 20 is located within a predetermined range from the display 4, a predetermined part detection process for detecting the predetermined part of the user 20 is executed.

  In this embodiment, as described in the first embodiment, the PC 3 sets the horizontal direction on the captured image as the X axis and the direction perpendicular to the horizontal direction as the Y axis, and the upper left corner of the captured image. Is set to the origin (0, 0), and the coordinate with the lower right corner of the captured image as (W, H) is set. In addition, since the processing content of the predetermined part detection processing and the entire image processing method in the present embodiment are the same as the processing content described in the first embodiment, detailed description thereof is omitted.

  As shown in FIG. 7, in the present embodiment, after executing the predetermined part detection process (step S400), the PC 3 determines whether the user 20 is located in front of the display 4 (step S401). When the user 20 determines that the user 20 is not located in front of the display 4 (step S401; NO), the predetermined part detection process (step S400) is executed again. On the other hand, when it is determined that the user 20 is located in front of the display 4 (step S401; YES), an image display process is executed (step S402).

  Next, position detection processing for determining whether or not the user 20 is located within a predetermined range will be described with reference to FIGS. 8 and 9. Here, the “predetermined range” refers to a range captured by the camera 2 disposed on the display 4 in front of the display 4 as an imaging range, and between the display 4 and the user in the imaging range. The range in which the distance between them is less than the distance D is shown.

  In the present embodiment, it is determined that the user 20 is located in front of the display 4 when the user 20 is located within a predetermined range from the display 4. In the following description, a user who is located within a predetermined range from the display 4 is displayed as “user 20”, and a user who is not located within the predetermined range from the display 4 is displayed as “user 23”. .

  Further, since the camera 2 is disposed at the upper center of the display 4, the distance between the camera 2 and the users 20 and 23 is substantially equal to the distance between the display 4 and the users 20 and 23. For this reason, in this embodiment, the distance between the users 20 and 23 and the display 4 is calculated using a captured image captured through the camera 2.

  As described above, in the present embodiment, the camera 2 is disposed at a position where the whole body of the user 20 located in front of the display 4 can be imaged. For this reason, the floor surface F is displayed below the captured image captured through the camera 2, and the space on the floor surface F is displayed above the captured image. Furthermore, as shown in FIG. 8B, the upper limit of the floor image F displayed in the captured image (for example, the position where the horizon is displayed or the position where the indoor floor surface edge is displayed) is y. Assuming that the coordinate value is “F1”, the floor surface away from the display 4 is displayed as the y coordinate value increases in a range where 0 ≦ y ≦ F1.

  In the present embodiment, in a captured image, an area from a display 4 to a position “Y1” where a floor surface at a predetermined distance D (see FIG. 8A) is displayed in a range of 0 ≦ y ≦ F1. Let (0 ≦ y <Y1) be the lower region, and regions other than this lower region (Y1 ≦ y ≦ H) be the upper region. The predetermined range may be set in advance or may be set each time according to the installation location or the like. Note that “Y1” in the present embodiment corresponds to a “virtual lane marking” in the present invention.

As shown in FIGS. 8A and 8B, when the user 20 is located within a predetermined range from the display 4, the user's 20 foot 21 and the lower limb extending from the foot 21 upward. 22 is displayed in the lower area described above. For this reason, when the user 20 walks within a predetermined range, the foot 21 of the user 20 is detected in the lower region, and the lower limb 22 of the user 20 is continuously detected in a manner extending from the foot 21. Is done.
On the other hand, when the user 23 is not located within the predetermined range, it is displayed only in the upper region as shown in FIG. 8B.

  Therefore, in the present embodiment, when coordinates f (x, y) having a gradation value equal to or greater than the reference value C are detected through the predetermined part detection process described in the first embodiment, FIG. 8B shows. Thus, it is determined whether or not white pixels are continuously displayed in the y-axis direction from the coordinates f (x, y) to the coordinates f (x + n, Y1). The user 20 is located within a predetermined range when it is determined that white pixels are continuously displayed in the y-axis direction from the coordinate f (x, y) to the coordinate f (x + n, Y1). Judge. Note that “n” is set in advance to a value slightly smaller than the width of the white pixel area displayed in the difference image in the X-axis direction when the user 20 moves in front of the display 4 at a general speed. ing. Specifically, “n” is preferably set in the range of 5 to 20 pixels, and more preferably set in the range of 5 to 10 pixels.

Next, the processing procedure of the position detection process will be described in detail with reference to FIG.
Note that the PC 3 starts the position detection process when the coordinate f (x, y) having the gradation value equal to or higher than the reference value C is detected in the lower region through the predetermined part detection process described above.

As shown in FIG. 9, when the position detection process is started, first, the y coordinate value of the coordinate f (x, y) is incremented (y = y + 1) (step S410).
Next, coordinates f (x, y), coordinates f (x + 1, y), coordinates f (x + 2, y)... Whether coordinates f (x + n, y) are all equal to or higher than the reference value C Is determined (step S411).

  Coordinate f (x, y), coordinate f (x + 1, y), coordinate f (x + 2, y) ... When it is determined that all the gradation values of the coordinate f (x + n, y) are equal to or greater than the reference value C ( Next, it is determined whether or not the y coordinate value of the coordinate f (x, y) is “Y1” or more (step S412).

When it is determined that the y-coordinate value of the coordinate f (x, y) is less than “Y1” (step S412; NO), the processes of step S410 and step S411 are repeated.
On the other hand, when it is determined that the y-coordinate value of the coordinates f (x, y) is equal to or greater than “Y1” (step S412; YES), it is determined that the user 20 is located within a predetermined range from the display 4 ( Step S413). That is, in this case, since the white pixels are continuously detected in the y-axis direction from the coordinate f (x, y) to the coordinate f (x + n, Y1), it is determined that the user 20 is located in a predetermined range. (Step S413).

  On the other hand, any one of the gradation values of the coordinate f (x, y), the coordinate f (x + 1, y), the coordinate f (x + 2, y),..., The coordinate f (x + n, y) is a reference value C. If it is determined that the value is less than (step S411; NO), this process is temporarily terminated. In this case, it is determined that the user 20 is not located within the predetermined range.

According to the said embodiment, in addition to the effect demonstrated in the said embodiment, there can exist the effect described below.
(5) According to the present embodiment, since the image display process is executed when the user 20 is located within the predetermined range, the image display process is performed when the user 20 is not located within the predetermined range. It can be suppressed from being executed.

(Third embodiment)
Hereinafter, a third embodiment of the present invention will be described based on FIG. 10 with a focus on differences from the first embodiment. In addition, in these FIG. 10, the same code | symbol is shown about the same element as each element demonstrated in 1st embodiment, The overlapping description about these elements is omitted.

In the first embodiment, it was set initial velocity v _x, the v _y in advance to a predetermined speed. In contrast, in the present embodiment, the rate at which the user 20 moves, i.e., the area where the white pixels are displayed size Based on the initial velocity v _x, to set the v _y. Hereinafter, the initial velocity _v x in this embodiment, the method of setting _{v y,} will be described in detail with reference to FIG. 10 (a) ~ (d) .

In this embodiment, as described in the first embodiment, the PC 3 sets the horizontal direction on the captured image as the X axis and the direction perpendicular to the horizontal direction as the Y axis, and the upper left corner of the captured image. Is set to the origin (0, 0), and the coordinate with the lower right corner of the captured image as (W, H) is set.
In addition, since the processing content of the predetermined part detection processing and the entire image processing method in the present embodiment are the same as the processing content described in the first embodiment, detailed description thereof is omitted.

In FIG. 10A, when the user 20 moves slowly in front of the display 4, the user 20 captured by the camera 2 in the previous control cycle and displayed in the captured image is indicated by X1. In addition, the user 20 captured by the camera 2 in the current control cycle and displayed in the captured image is indicated by X2.
FIG. 10B shows a difference image generated based on the captured image shown in FIG. In the difference image, white pixels are displayed in the hatched area.

In FIG. 10C, when the user 20 moves in front of the display 4 at a high speed, the user 20 captured by the camera 2 in the previous control cycle and displayed in the captured image is displayed at X1. In addition, the user 20 captured by the camera 2 and displayed in the captured image in the current control cycle is indicated by X2.
FIG. 10D shows a difference image generated based on the captured image shown in FIG. In the difference image, white pixels are displayed in the hatched area.

As shown in FIGS. 10B and 10D, when the user 20 moves slowly in front of the display 4, the area where white pixels are displayed becomes smaller than when moving at a high speed.
Therefore, in the present embodiment, the white pixels based on the region displayed estimates the speed of movement of the user 20, as when the user 20 moves fast, set the initial velocity v _x, the v _y to a large value I am doing so. That is, as the time that region the white pixels are displayed is large, and to set the initial velocity v _x, the v _y to a large value.

According to the said embodiment, in addition to the effect demonstrated in said each embodiment, there can exist the effect described below.
(7) According to this embodiment, to set the initial velocity v _x, v _y depending on the speed of movement of the user 20, it can be displayed according to the movement mode of the user 20 the decoration image. For this reason, it is possible to display the decoration image in a manner more related to the user 20, and thus it is possible to display an image that can further attract the interest of the passerby who is the user.

(Fourth embodiment)
Hereinafter, a fourth embodiment embodying the present invention will be described based on FIGS. 11 to 15 with a focus on differences from the first embodiment. In addition, in these FIGS. 11-15, the same code | symbol is shown about the element same as each element demonstrated in 1st embodiment, The overlapping description about these elements is omitted.

  As shown in FIG. 11 (a), the image display device 1 of the fourth embodiment includes a central camera 7 (book) disposed at the upper center of the display 4 (corresponding to the “display surface” of the present invention). In addition to the “imaging means” of the present invention, an end camera 8 (corresponding to the “imaging means” of the present invention) disposed on one upper side of the display 4 is provided.

  The central camera 7 and the end camera 8 are arranged so that the imaging range is a range in which the whole body of the user 20 standing in front of the display 4 can be accommodated. Further, the central camera 7 and the end camera 8 image the front of the display 4 a predetermined number of times (in this embodiment, an arbitrary number of 5 to 30 times per second) and output it to the PC 3 respectively. .

  As shown in FIG. 11 (b), the PC 3 has an X-axis in the horizontal direction, a Y-axis in a direction perpendicular to the horizontal direction, (0, 0) in the lower left corner, and (W in the upper right end on the captured image. , H) is set. Then, the decoration image is superimposed on the captured image in which the coordinates are set to form a display image, and the image information of the display image is output to the display 4. Details will be described below.

Next, an image processing method in the present embodiment will be described with reference to FIG.
As shown in FIG. 12, the PC 3 (corresponding to “display means” of the present invention) first determines whether the user 20 and the display 4 are based on image information output from the central camera 7 and the end camera 8. A distance determination process is performed to calculate a distance between them and determine whether or not the user 20 is located in the assumed range (step S500). Then, after completing the distance determination process, a predetermined part detection process (step S501) and then an image display process (step S502) are executed.

  In the present embodiment, the assumed range is a range in which the user 20 standing in front of the display 4 is displayed on the display 4 with a sufficient size. Specifically, assuming that a range captured by the central camera 7 and the end camera 8 disposed on the display 4 in front of the display 4 is an imaging range, the display 4 and the user in the imaging range. A range in which the distance between them is less than the assumed distance D1 is shown. The assumed distance D1 may be set in advance or may be set each time according to the installation location or the like.

Next, a distance determination process for calculating the distance D2 and determining whether the distance D2 is equal to or greater than the assumed distance D1 will be described with reference to FIG.
As shown in FIG. 12, when this distance determination process is started, first, an assumed distance D1 is set using the PC 3 (step S600).

Next, the PC 3 executes the processes of steps S611 to S620 described below in parallel with the processes of steps S601 to S610 described below.
First, the processing of steps S601 to S610 will be described. As described above, after setting the assumed distance D1 (step S600), the PC 3 acquires image information of a captured image (center image) captured by the center camera 7 (step S601). Then, a binarization process is performed on the captured image to convert it into two gradations of white and black (step S602).

  The difference image between the captured image obtained from the central camera 7 and binarized in the previous control cycle and the captured image obtained from the central camera 7 and binarized in the current control cycle. Is generated (step S603). As described in the first embodiment, when there is a change between the captured image acquired in the previous control cycle and the captured image acquired in the current control cycle, the change is located in the difference image. The coordinates are displayed with white pixels.

  Next, the captured image obtained from the central camera 7 and subjected to the binarization processing in the current control cycle is stored (step S604). Then, the PC 3 determines whether or not the gradation value of the coordinate f (x1, y1) of the difference image is greater than or equal to the reference value C (step S605).

  When it is determined that the gradation value of the coordinate f (x1, y1) is greater than or equal to the reference value C (step S605; YES), as described above, the coordinate f (x1, y1) is set as a motion detection point (step S610). ).

  On the other hand, when it is determined that the gradation value of the coordinate f (x1, y1) is less than the reference value C (step S605; NO), the x coordinate value of the coordinate f (x1, y1) is incremented (x1 = x1 + 1) (step S606). Then, it is determined whether or not the x coordinate value of the coordinate f (x1, y1) is equal to or greater than a predetermined value W (step S607).

When it is determined that the x-coordinate value of the coordinates f (x1, y1) is less than the predetermined value W (step S607; NO), the processes of steps S605 and S606 are repeated.
On the other hand, when it is determined that the x coordinate value of the coordinate f (x1, y1) is equal to or greater than the predetermined value W (step S607; YES), the y coordinate value is incremented (y1 = y1 + 1) (step S608), and the coordinate f ( It is determined whether or not the y coordinate value of x1, y1) is greater than or equal to a predetermined value H (step S609).

  When it is determined that the y-coordinate value of the coordinate f (x1, y1) is less than the predetermined value H (step S609; NO), the processing of steps S605 to S608 is repeated.

  Next, the processing of steps S611 to S620 will be described. As described above, after setting the assumed distance D1 (step S600), the PC 3 acquires image information of a captured image (end-side image) captured by the end-side camera 8 (step S611). Then, a binarization process is performed on the captured image to convert it into two gradations of white and black (step S612).

Then, a captured image obtained from the end camera 8 in the previous control cycle and subjected to binarization processing, and a captured image obtained from the end camera 8 in the current control cycle and subjected to binarization processing. A difference image is generated (step S613).
Next, the captured image obtained from the end camera 8 and subjected to the binarization process in the current control cycle is stored (step S614). Then, the PC 3 determines whether or not the gradation value of the coordinate f (x2, y2) of the difference image is greater than or equal to the reference value C (step S615).

  When it is determined that the gradation value of the coordinate f (x2, y2) is greater than or equal to the reference value C (step S615; YES), the coordinate f (x2, y2) is set as a motion detection point (step S620).

  On the other hand, when it is determined that the gradation value of the coordinate f (x2, y2) is less than the reference value C (step S615; NO), the x coordinate value of the coordinate f (x2, y2) is incremented (x2 = x2 + 1) (step S616). Then, it is determined whether or not the x coordinate value of the coordinate f (x2, y2) is equal to or greater than a predetermined value W (step S617).

When it is determined that the x-coordinate value of the coordinates f (x2, y2) is less than the predetermined value W (step S617; NO), the processes of steps S615 and S616 are repeated.
On the other hand, when it is determined that the x coordinate value of the coordinate f (x2, y2) is equal to or greater than the predetermined value W (step S617; YES), the coordinate f (x2, y2) y coordinate value is incremented (y2 = y2 + 1) ( In step S618), it is determined whether or not the y-coordinate value of the coordinate f (x2, y2) is equal to or greater than a predetermined value H (step S619).

  When it is determined that the y-coordinate value of the coordinate f (x2, y2) is less than the predetermined value H (step S619; NO), the processing of steps S615 to S618 is repeated.

  On the other hand, when it is determined that the y coordinate value of the coordinate f (x1, y1) is greater than or equal to the predetermined value H (step S609; YES), and the y coordinate value of the coordinate f (x2, y2) is the predetermined value H. If it is determined that the above is true (step S619; YES), the PC 3 calculates the distance D2 between the user 20 and the display 4 based on the coordinates f (x1, y1) and the coordinates f (x2, y2). (Step S621). Then, it is determined whether or not the assumed distance D1 is equal to or greater than the distance D2 (step S622).

When it is determined that the assumed distance D1 is greater than or equal to the distance D2 (step S622; YES), the x-coordinate value and the y-coordinate value of the coordinate f (x1, y1) and the coordinate f (x2, y2) are x1 = “0”, respectively. , Y1 = “0”, x2 = “0”, y2 = “0” (step S623), and the process is temporarily terminated.
On the other hand, when it is determined that the assumed distance D1 is less than the distance D2 (step S622; NO), the processing after S601 and the processing after S611 are executed again. Thus, in this distance determination process, when the assumed distance D1 is less than the distance D2, that is, when it is determined that the user 20 is not located at the assumed distance D1, this process is repeated and this process is performed. It doesn't end.

Next, the predetermined part detection process according to the present embodiment will be described in detail with reference to FIG.
As shown in FIG. 14, the PC 3 executes the processes of steps S710 to S719 described below in parallel with the processes of steps S700 to S709 described below.

  First, the processing in steps S700 to S709 will be described. First, the PC 3 acquires image information of a captured image (center image) captured by the center camera 7 (step S700). Then, a binarization process for converting the captured image into two gradations of white and black is performed (step S701), and a difference process is executed on the captured image subjected to the binarization process (step S702). .

  Next, the captured image obtained from the central camera 7 and subjected to the binarization process in the current control cycle is stored (step S703). Then, the PC 3 determines whether or not the gradation value of the coordinate f (x1, y1) of the difference image is greater than or equal to the reference value C (step S704).

  When it is determined that the gradation value of the coordinate f (x1, y1) is greater than or equal to the reference value C (step S704; YES), the coordinate f (x1, y1) is set as a motion detection point (step S709).

  On the other hand, when it is determined that the gradation value of the coordinate f (x1, y1) is less than the reference value C (step S704; NO), the x coordinate value of the coordinate f (x1, y1) is incremented (x1 = x1 + 1) (step S705). Then, it is determined whether or not the x coordinate value of the coordinate f (x1, y1) is equal to or greater than a predetermined value W (step S706).

When it is determined that the x-coordinate value of the coordinate f (x1, y1) is less than the predetermined value W (step S706; NO), the processes of steps S704 and S705 are repeated.
On the other hand, when it is determined that the x coordinate value of the coordinate f (x1, y1) is equal to or greater than the predetermined value W (step S706; YES), the y coordinate value is incremented (y1 = y1 + 1) (step S707), and the coordinate f ( It is determined whether or not the y coordinate value of x1, y1) is greater than or equal to a predetermined value H (step S708).

  When it is determined that the y-coordinate value of the coordinate f (x1, y1) is less than the predetermined value H (step S708; NO), the processing of steps S704 to S707 is repeated.

  Next, processing in steps S710 to S719 will be described. First, the PC 3 acquires image information of a captured image (end-side image) captured by the end-side camera 8 (step S710). Then, a binarization process for converting the captured image into two gradations of white and black is performed (step S711), and a difference process is performed on the captured image subjected to the binarization process (step S712). .

  Next, the captured image obtained from the end camera 8 and subjected to the binarization process in the current control cycle is stored (step S713). Then, the PC 3 determines whether or not the gradation value of the coordinate f (x2, y2) of the difference image is greater than or equal to the reference value C (step S714).

  When it is determined that the gradation value of the coordinate f (x2, y2) is greater than or equal to the reference value C (step S714; YES), the coordinate f (x2, y2) is set as a motion detection point (step S719).

  On the other hand, when it is determined that the gradation value of the coordinate f (x2, y2) is less than the reference value C (step S714; NO), the x coordinate value of the coordinate f (x2, y2) is incremented (x2 = x2 + 1) (step S715). Then, it is determined whether or not the x coordinate value of the coordinate f (x2, y2) is equal to or greater than a predetermined value W (step S716).

When it is determined that the x coordinate value of the coordinate f (x2, y2) is less than the predetermined value W (step S716; NO), the processes of steps S714 and S715 are repeated.
On the other hand, when it is determined that the x coordinate value of the coordinate f (x2, y2) is equal to or greater than the predetermined value W (step S716; YES), the y coordinate value is incremented (y2 = y2 + 1) (step S717). Then, it is determined whether or not the y-coordinate value of the coordinate f (x2, y2) is greater than or equal to a predetermined value H (step S718).

  When it is determined that the y-coordinate value of the coordinate f (x2, y2) is less than the predetermined value H (step S718; NO), the processing of steps S714 to S717 is repeated.

  When it is determined that the y coordinate value of the coordinate f (x1, y1) is greater than or equal to the predetermined value H (step S708; YES), and the y coordinate value of the coordinate f (x2, y2) is determined to be greater than or equal to the predetermined value H. If yes (step S718; YES), the PC 3 calculates the distance D2 between the user 20 and the display 4 based on the coordinates f (x1, y1) and the coordinates f (x2, y2) (step S720). . Then, the x coordinate value and the y coordinate value of the coordinate f (x1, y1) and the coordinate f (x2, y2) are x1 = “0”, y1 = “0”, x2 = “0”, y2 = “0”, respectively. (Step S721), the process is terminated.

  As shown in FIG. 12, after completing the distance determination process and the predetermined part detection process, the PC 3 executes an image display process for displaying an image on the display 4 (step S502). Note that the processing content of this image display processing is the same as the image display processing described in the first embodiment, and thus detailed description thereof is omitted.

FIG. 15 shows the display 4 on which a display image is displayed through the above-described processing.
In the area A shown in FIG. 15, the decoration image is displayed so as to move mainly in the x-axis direction from the position where the foot of the user 20 is displayed. In FIG. 15, all areas in which the decorative image is displayed from the start to the end of the image display process are shown. Actually, the decoration image is first displayed at the same position as the position where the predetermined part (in this embodiment, the foot) of the user 20 is displayed. Then, starting from the position where the predetermined part is displayed, the user 20 moves away from the position where the predetermined part of the user 20 is displayed as time passes.

  Further, as shown in FIG. 15, the PC 3 displays the decorative image only in a region starting from a predetermined part of the user 20 located in the assumed range. That is, the decoration image is not displayed in a region starting from a predetermined part of the user 23 that is not located in the assumed range.

According to the said embodiment, in addition to the effect demonstrated in said each embodiment, there can exist the effect described below.
(6) According to the present embodiment, since the plurality of cameras 7 and 8 are used, the distance D2 between the user 20 and the display 4 can be calculated more accurately.

(Other embodiments)
Hereinafter, another embodiment embodying the present invention will be described based on FIG. 16 with a focus on differences from the fourth embodiment. In FIG. 16, the same elements as those described in the fourth embodiment are denoted by the same reference numerals, and redundant descriptions of these elements are omitted.

  As shown in FIG. 16 (a), the image display device 1 of the present embodiment has, on the display image, the horizontal direction as the X axis, the direction perpendicular to the horizontal direction as the Y axis, and the upper left corner as the origin ( 0,0) and coordinates with the lower right corner at (W, H) are set.

In the image display device 1 according to the present embodiment, as shown in FIG. 16B, the PC 3 recognizes the uppermost part (here, the parietal part) of the user 20 located in the assumed range as a predetermined part. A decoration image is displayed starting from the top of the head.
Further, as described in the fourth embodiment, the PC 3 does not display a decoration image in an area starting from a predetermined part of the user 23 that is not located in the assumed range.
According to this embodiment, the effect according to the effect demonstrated in the said embodiment can be show | played.

(Fifth embodiment)
Hereinafter, a fifth embodiment embodying the present invention will be described with reference to FIGS. 17 to 19 with a focus on differences from the first embodiment. 17 to 19, the same elements as those described in the first embodiment are denoted by the same reference numerals, and redundant descriptions of these elements are omitted.

  In the first embodiment, only one coordinate f (x, y) displayed with white pixels is detected. On the other hand, in the present embodiment, n coordinates displayed by white pixels are detected.

Next, an image processing method according to this embodiment will be described with reference to FIG.
As shown in FIG. 17, in this embodiment, the PC 3 first executes a predetermined part detection process (step S800), and then executes an image display process (step S801).

Next, the predetermined part detection processing according to the present embodiment will be described in detail with reference to FIG.
As shown in FIG. 18, when this process is started, first, the PC 3 acquires image information of a captured image captured by the camera 2 (step S900). Next, the PC 3 performs binarization processing for converting the captured image into white and black gradations (step S901), and executes difference processing on the captured image subjected to the binarization processing. (Step S902).

  Next, the PC 3 stores the captured image obtained from the camera 2 and subjected to binarization processing in the current control cycle (step S903). Then, the PC 3 determines whether or not the gradation value of the coordinate f (x, y) of the difference image is greater than or equal to the reference value C (step S904).

  When it is determined that the gradation value of the coordinate f (x, y) is greater than or equal to the reference value C (step S904; YES), the value of the number n is incremented (n = n + 1) (step S905). Then, the coordinates f (x, y) are stored as the nth motion detection point (step S906).

  After the coordinate f (x, y) is set as the nth motion detection point (step S906), or in step S904, it is determined that the gradation value of the coordinate f (x, y) is less than the reference value C. In the case (step S904; NO), the x coordinate value of the coordinate f (x, y) is incremented (x = x + 1) (step S907). Then, it is determined whether or not the x coordinate value of the coordinate f (x, y) is greater than or equal to a predetermined value W (step S908).

When it is determined that the x coordinate value of the coordinate f (x, y) is less than the predetermined value W (step S908; NO), the processing of steps S904 to S907 is repeated.
On the other hand, if it is determined that the x coordinate value of the coordinate f (x, y) is equal to or greater than the predetermined value W (step S908; YES), the y coordinate value is incremented (y = y + 1) (step S909), and the coordinate f ( It is determined whether or not the y coordinate value of x, y) is greater than or equal to a predetermined value H (step S910).

When it is determined that the y-coordinate value of the coordinate f (x, y) is less than the predetermined value H (step S910; NO), the processing of steps S904 to S909 is repeated.
On the other hand, when it is determined that the y coordinate value of the coordinate f (x, y) is equal to or greater than the predetermined value H (step S910; YES), the x coordinate value and the y coordinate value of the coordinate f (x, y) are respectively set as x = “0” and y = “0” are set (step S911), and this process is temporarily terminated.

  After completing the predetermined part detection process (step S800) in this way, the PC 3 next executes an image display process for displaying a decoration image, starting from each of the detected n coordinates f (x, y). (Step S801). In addition, since the processing content of the image display process in this embodiment is the same as the processing content demonstrated in 1st embodiment, detailed description is omitted.

FIG. 19 shows a display 4 on which a display image is displayed through the above-described processing.
In the areas A to N shown in FIG. 19, the decoration image is displayed so as to move mainly in the x-axis direction from the position where the user 20 is displayed. Note that FIG. 19 shows all the areas where the decorative image is displayed from the start to the end of the image display process. Actually, the decoration image is first displayed at the same position as the position where the predetermined part (in this embodiment, the foot) of the user 20 is displayed. Then, starting from the position where the predetermined part is displayed, the user 20 moves away from the position where the predetermined part of the user 20 is displayed as time passes.

According to the said embodiment, in addition to the effect demonstrated in said each embodiment, there can exist the effect described below.
(8) According to this embodiment, since a decoration image can be displayed in a wide range, an image that can further attract the interest of a passerby as a user can be displayed on the display 4.

(Other embodiments)
Hereinafter, another embodiment of the present invention will be described based on FIG. 20 with a focus on differences from the fifth embodiment. In FIG. 20, the same elements as those described in the fifth embodiment are denoted by the same reference numerals, and redundant descriptions of these elements are omitted.

  As shown in FIG. 20 (a), the image display device 1 of the present embodiment has, on the display image, the horizontal direction as the X axis, the direction perpendicular to the horizontal direction as the Y axis, and the upper left corner as the origin ( 0,0) and coordinates with the lower right corner at (W, H) are set.

In the image display device 1 according to the present embodiment, as shown in FIG. 20B, the PC 3 has n predetermined parts located above the captured image including the uppermost part (here, the top of the head). Decorative images are displayed starting from.
According to this embodiment, the effect according to the effect demonstrated in the said embodiment can be show | played.

(Sixth embodiment)
Hereinafter, a sixth embodiment of the present invention will be described based on FIG. 2 and FIGS. 21 to 23 with a focus on differences from the first embodiment. 2 and FIGS. 21 to 23, the same elements as those described in the first embodiment are denoted by the same reference numerals, and redundant descriptions of these elements are omitted.

  In the first embodiment, a predetermined part is detected based on a captured image made of visible light. However, in this embodiment, a predetermined part is made based on an image made of infrared light (hereinafter referred to as “infrared light image”). Detect the site.

  As shown in FIG. 21 (a), the image display device 1 of the sixth embodiment includes the first camera 10 (the book) disposed at the upper center of the display 4 (corresponding to the “display surface” of the invention). In addition to the “imaging means” of the invention and the second camera 11 (corresponding to the “imaging means” of the invention), an infrared light 13 for irradiating infrared light is provided.

  The first camera 10 and the second camera 11 are arranged so that the imaging range is a range in which the whole body of the user 20 standing in front of the display 4 can be accommodated. A filter 12 that transmits only infrared light is attached to the light receiving portion of the first camera 10. For this reason, the 1st camera 10 will image the infrared light image which consists only of infrared light.

  The first camera 10 and the second camera 11 image the front of the display 4 a predetermined number of times (in this embodiment, an arbitrary number of 5 to 30 times per second), and display image information of the captured image. Each is output to the PC 3 (corresponding to “display means” of the present invention).

  Furthermore, in this embodiment, as shown in FIG. 21B, the PC 3 sets the horizontal direction on the captured image as the X axis and the direction perpendicular to the horizontal direction as the Y axis, and the lower left corner of the captured image. Is set to the origin (0, 0), and the upper right end of the captured image is set to (W, H).

  In the present embodiment, as described in the first embodiment (see FIG. 2), the PC 3 first executes a predetermined part detection process (step S100), and then executes an image display process (step S101). In the present embodiment, the PC 3 performs a predetermined part detection process based on the image information of the captured image output from the first camera 10.

Next, the predetermined part detection process according to the present embodiment will be described in detail with reference to FIG.
When this process is started, first, the PC 3 acquires image information of a captured image (visible light image) made of visible light through the second camera 11 and displays it on the display 4 (step S1000).
Next, the PC 3 acquires image information of a captured image (infrared light image) made up of only infrared light through the first camera 10 (step S1001).

  Next, the PC 3 performs a binarization process for converting the infrared light image into two gradations of white and black (step S1002). Then, a difference process is executed on the infrared image that has been subjected to the binarization process (step S1003).

  Next, the PC 3 stores the infrared light image acquired through the first camera 10 and subjected to the binarization process in the current control cycle (step S1004). Then, the PC 3 determines whether or not the gradation value of the coordinate f (x, y) of the difference image is greater than or equal to the reference value C (step S1005).

  When it is determined that the gradation value of the coordinate f (x, y) is greater than or equal to the reference value C (step S1005; YES), the coordinate f (x, y) is set as a motion detection point (step S1010).

  On the other hand, when it is determined that the gradation value of the coordinate f (x, y) is less than the reference value C (step S1005; NO), the x coordinate value of the coordinate f (x, y) is incremented (x = x + 1) (step S1006). Then, it is determined whether or not the x coordinate value of the coordinate f (x, y) is greater than or equal to a predetermined value W (step S1007).

When it is determined that the x coordinate value of the coordinate f (x, y) is less than the predetermined value W (step S1007; NO), the processes of steps S1005 and S1006 are repeated.
On the other hand, when it is determined that the x coordinate value of the coordinate f (x, y) is greater than or equal to the predetermined value W (step S1007; YES), the y coordinate value of the coordinate f (x, y) is incremented (y = y + 1). (Step S1008), it is determined whether or not the y-coordinate value of the coordinate f (x, y) is greater than or equal to a predetermined value H (Step S1009).

When it is determined that the y coordinate value of the coordinate f (x, y) is less than the predetermined value H (step S1009; NO), the processing of steps S1005 to S1008 is repeated.
On the other hand, when it is determined that the y-coordinate value of the coordinate f (x, y) is greater than or equal to the predetermined value H (step S1009; YES), and the coordinate f (x, y) is set as a motion detection point (step S1010). Thereafter, the x-coordinate value and the y-coordinate value of the coordinate f (x, y) are set to x = “0” and y = “0”, respectively (step S1011), and this process is temporarily ended.

FIG. 23 shows the display 4 on which a display image is displayed through the above-described processing.
In the area A shown in FIG. 23, the decoration image is displayed so as to move mainly in the x-axis direction from the position where the foot of the user 20 is displayed. In FIG. 15, all areas in which the decorative image is displayed from the start to the end of the image display process are shown. Actually, the decoration image is first displayed at the same position as the position where the predetermined part (in this embodiment, the foot) of the user 20 is displayed. Then, starting from the position where the predetermined part is displayed, the user 20 moves away from the position where the predetermined part of the user 20 is displayed as time passes.

  (9) According to this embodiment, in order to detect the predetermined part of the user 20 using the infrared light image, the one that reflects the infrared light among those displayed in the captured image, that is, the user 20 is appropriately selected. Can be detected. For this reason, the position where the predetermined part of the user 20 is displayed in the captured image can be detected more accurately.

(Other embodiments)
Hereinafter, another embodiment in which the present invention is embodied will be described based on FIG. 24 with a focus on differences from the sixth embodiment. Note that, in FIG. 24, the same elements as those described in the sixth embodiment are denoted by the same reference numerals, and redundant description of these elements is omitted.

  As shown in FIG. 24 (a), in this embodiment, the PC 3 sets the horizontal direction on the display image as the X axis, the direction perpendicular to the horizontal direction as the Y axis, and the upper left corner as the origin (0, 0) Set coordinates with the lower right corner as (W, H).

  Then, as shown in FIG. 24B, the PC 3 detects the uppermost part (here, the top of the head) of the user 20 as a predetermined part, and displays a decoration image starting from this top.

  According to this embodiment, the effect according to the effect demonstrated in the said embodiment can be show | played.

(Seventh embodiment)
The seventh embodiment embodying the present invention will be described below with reference to FIGS. 25 to 27 with a focus on differences from the first embodiment. In addition, in these FIGS. 25-27, the code | symbol same about each element same as each element demonstrated in 1st embodiment is each shown, and the overlapping description about these elements is omitted.

In the first embodiment, a preset initial speed v _x, the v _y to a predetermined value. In contrast, in the present embodiment, to calculate the initial velocity v _x, v _y on the basis of the center of gravity of the region in which white pixels are displayed in the difference image.
Further, in the above-described first embodiment, if the initial velocity v _x, v _y is a negative value, and the initial velocity v _x, v _y to respectively become "0". In contrast, in the present embodiment, regardless of the polarity of the initial velocity v _x, v _y, calculated initial velocity v _x, it is to set the area for displaying the ornamental image using v _y.

  In this embodiment, as described in the first embodiment, the PC 3 sets the horizontal direction on the captured image as the X axis and the direction perpendicular to the horizontal direction as the Y axis, and the upper left corner of the captured image. Is set to the origin (0, 0), and the coordinate with the lower right corner of the captured image as (W, H) is set.

  Next, image display processing according to the present embodiment will be described in detail with reference to FIG. Note that the display image processing method and the processing content of the predetermined part detection processing in this embodiment are the same as the processing content described in the first embodiment, and thus detailed description thereof is omitted.

As shown in FIG. 25, when the process starts, PC3 first calculates the initial velocity v _x, v _y on the basis of the gravity center position of the region where white pixels are displayed in the difference image (step S1100 ).

Here, the calculation method of the barycentric position of the area where the white pixels are displayed in the difference image will be described in detail with reference to FIGS.
In FIG. 26 (a), the user who is captured by the camera 2 in the previous control cycle (t-2) and displayed in the captured image is indicated by X1, and the previous control cycle (t-1). The user 20 captured by the camera 2 and displayed in the captured image is denoted by X2.
FIG. 26B shows a difference image generated based on the captured image shown in FIG. In the difference image, white pixels are displayed in the hatched area.

In FIG. 26C, the user who is captured by the camera 2 in the previous control cycle (t-1) and displayed in the captured image is indicated by X2, and the current control cycle (t). The user 20 captured by the camera 2 and displayed in the captured image is indicated by X3.
FIG. 26D shows a difference image generated based on the captured image shown in FIG. In the difference image, white pixels are displayed in the hatched area.

First, the PC 3 detects the position P shown in FIG. 26B as a position where the predetermined part is displayed through the predetermined part detection process. In the present embodiment, the PC 3 captures coordinates with the horizontal direction as the X axis, the direction perpendicular to the horizontal direction as the Y axis, the upper left corner as the origin (0, 0), and the lower right corner as (W, H). It is set on the image.
Then, the PC 3 sets a predetermined area centered on the position P as the gravity center position calculation area r. The center-of-gravity position calculation region r is preferably set in the range of 10 to 50 pixels vertically and horizontally with the position P as the center, and more preferably in the range of 10 to 20 pixels.

  Next, as shown in FIG. 26B, the PC 3 displays the center of gravity position g (x (t−t−) of the portion displayed in the center of gravity position calculation region r in the region where white pixels are displayed in the difference image. 1), y (t-1)) is calculated. Note that the center of gravity position g (x (t−1), y (t−1)) can be calculated by a known method, and thus detailed description thereof is omitted.

Similarly, as shown in FIG. 26D, the PC 3 detects the position P as the position where the predetermined part is displayed, and sets the center-of-gravity position calculation region r around the position P.
Then, the center-of-gravity position g (x (t), y (t)) of the part displayed in the center-of-gravity position calculation area r is calculated among the areas where white pixels are displayed in the difference image.

Next, the PC 3 calculates the gravity center position g (x (t−1), y (t−1)) and the gravity center position g (x (t), y () based on the following equations (5) and (6). The difference from t)) is obtained.

Gx (t) = gx (t−1) −gx (t) (5)
Gy (t) = gy (t−1) −gy (t) (6)

Then, based on the following equation (7) and (8) to calculate the initial velocity _v x, _{v y.}

v _x = A × Gx (t) (7)
v _y = A × Gy (t) (8)

A and B are predetermined constants determined in advance.

PC3, the initial velocity _v x calculated in this way, to set the _{v y} (step S1100), the coordinates g (x, y) the following equation that describes in a first embodiment (3 for displaying an ornamental image ) And (4) (step S1101). In this coordinate calculation, the x coordinate value and the y coordinate value of the position P are “x ′” and “y ′”, respectively.

x = (w _x + v _x ) t + Asin (ω ₁ t) + Bsin (ω ₂ t) + x ′ (3)
y = (w _y + v _y ) t + C cos (ω ₃ t) + D cos (ω ₄ t) + y ′ (4)

As described in the first embodiment, the angular velocities ω ₁ , ω ₂ , ω ₃ , ω ₄ , and the constants A, B, C, D are predetermined values determined in advance through experiments or the like. Furthermore, the time t starts counting from when the main image display process is started.
On the other hand, the wind speed w _x, for w _y, whereas if the initial velocity v _x, v _y is a negative value is set to a negative value, if the initial velocity v _x, v _y is a positive value positive Set to the value of.

Then, the decoration image is displayed at the coordinates g (x, y) (step S1102).
Next, the display count n is incremented (n = n + 1) (step S1103).
Thereafter, it is determined whether or not the display count n is equal to or greater than the predetermined count N (step S1104). When it is determined that the display count n is less than the predetermined count N (step S1104; NO), the processing after step S1101 is performed. repeat. On the other hand, when it is determined that the display number n is equal to or greater than the predetermined number N (step S1104; YES), the display number n is set to “0” (step S1105), and this process is temporarily terminated.

FIG. 27 shows the display 4 on which a display image is displayed through the above-described processing.
When the user 20 moves in the direction indicated by the arrow A in FIG. 27A, the barycentric position of the difference image also moves in the direction indicated by the arrow. At this time, since Gx (t) is a positive value (see Expression (5)), the decoration image is displayed so as to flow in the direction indicated by S1 in FIG. )reference). In addition, as when the moving speed of the user 20 is high, the difference between the position of the center of gravity G1 and the position of the center of gravity G2 Gx (t), Gy ( t) for the greater initial velocity _v x, _{v y} also increases.

On the other hand, when the user 20 moves in the direction indicated by the arrow in FIG. 27B, the barycentric position of the difference image also moves in the direction indicated by the arrow. At this time, since G (t) is a negative value (see Expression (5)), the decoration image is displayed so as to flow in the direction indicated by S2 in FIG. 27B (Expression (3)). reference). At this time, as when the moving speed of the user 20 is high, the difference between the position of the center of gravity G1 and the position of the center of gravity G2 Gx (t), Gy ( t) for the greater initial velocity _v x, _{v y} also increases.

According to the said embodiment, there can exist an effect described below.
(10) In the above embodiment, since the initial velocity v _x, the v _y such that each time calculated, it is possible to change the area for displaying the ornamental image in response to movement of the user 20. Compared to the case where the area for displaying the decoration image is within a certain range regardless of the movement of the user 20, the decoration image can be displayed in a manner that attracts the user 20 more.

(11) Further, the initial velocity v _x based on the center of gravity of the difference _image, because you have to calculate the v _y, be set based on the area for displaying the ornamental image in the direction of movement of the user 20 it can.

  (12) Also, the center of gravity position G1 of the difference image of the portion displayed in the center of gravity position calculation region r in the difference image is calculated. For this reason, the area | region which displays a decoration image based on the motion of only the predetermined | prescribed site | part of the user 20 and its periphery site | part can be set. That is, the decoration image can be displayed in a manner in line with the intention of the user 20.

(Other embodiments)
Note that the image display apparatus 1 according to the present invention is not limited to the configuration exemplified in the above embodiment, and can be implemented as, for example, the following form in which the embodiment is appropriately changed. The following modifications are not applied only to the above-described embodiment, and different modifications can be combined with each other.

In the third embodiment, the difference image calculation region r1 is set around the coordinate f (x, y) where the predetermined part is displayed, and the difference image calculation is performed among the regions where white pixels are displayed in the difference image. based on the area of the portion to be displayed in the region r1, may be changed to the initial velocity v _x, v _y. According to this modification, the display area of the decoration image can be changed according to the speed of movement of only the predetermined part and its peripheral part.

  In the first embodiment, the camera 2 is arranged at the upper center of the display 4. However, the arrangement of the camera 2 is not limited to this, and as shown in FIG. May be disposed at a position facing the front of the display 4. In this modification, the display image output from the camera 2 to the PC 3 is displayed on the screen 15 using the projector 14. Also in the present invention, it is possible to achieve the operational effects according to the above operational effects.

  In the second embodiment, the central camera 7 and the end camera 8 are used, but the present invention is not limited to this. For example, as shown in FIG. 29, the end cameras 8 are arranged on the left and right ends of the display 4, and the distance between the display 4 and the user 20 is calculated using these end cameras 8. May be. According to the present embodiment, since the distance between the end cameras 8 is increased, the distance between the user 20 and the display 4 can be calculated with high accuracy.

  In the second embodiment, the decoration image display area is constant regardless of the distance D2 between the display 4 and the user 20, but the decoration image display area is not limited to this. You may change based on the distance D2. That is, the region A may be set to be larger as the distance D2 is larger, that is, as the user 20 is away from the display 4. According to this modification, even the user 20 located at a location away from the display 4 can recognize the decorative image displayed on the display 4.

In the above embodiment, the decoration image is displayed so as to flow mainly in the x-axis direction, but the present invention is not limited to this. Wind speed w _y is set to a value greater than the wind speed w _x, may primarily be displayed so as to flow in the y-axis direction. Alternatively, the wind speed w _y and the wind speed w _x may be set to substantially equal values and displayed so as to flow in the x-axis direction and the y-axis direction.

DESCRIPTION OF SYMBOLS 1 ... Image display apparatus 2 ... Camera 3 ... PC
4 ... Display 7 ... Central camera 8 ... End camera 10 ... First camera 11 ... Second camera 12 ... Filter 13 ... Infrared light 14 ... Projector 15 ... Screen 20 ... User 21 ... Foot 22 ... Lower limb 23 ... User

Claims (7)

An image display device comprising: display means for displaying a display image on a display surface; imaging means for imaging the front of the display surface as a captured image; and control means for controlling the display image,
The control means executes an image display process for displaying a decoration image in a predetermined area that is set starting from a position where a predetermined part of the user is displayed in the captured image, and displays the decoration image together with the captured image. An image display device, wherein the image is displayed on the display surface as an image. The image display device according to claim 1,
The control means detects a change between a previous captured image and a current captured image having different imaging times as a white pixel, and the predetermined portion is displayed based on a position where the white pixel is displayed. An image display device characterized by detecting a position. The image display device according to claim 1 or 2,
The image display device, wherein the image display unit prohibits execution of the image display process when it is determined that the user is not located within a predetermined range from the display surface. The image display device according to claim 2 or 3,
The control means sets a virtual lane marking in the captured image that partitions the captured image into an upper region and a lower region,
When the white pixel is detected in the lower region, it is determined that the user is located within a predetermined range from the display surface when the white pixel is continuously detected up to the virtual partition line. An image display device characterized by that. The image display device according to any one of claims 2 to 4,
The control means sets the predetermined area for displaying the decoration image based on a size of an area where the white pixel is displayed. The image display device according to any one of claims 1 to 4,
The control means detects a change between a previous captured image and a current captured image having different imaging times as white pixels, calculates a centroid position of an area where the white pixel is displayed, The predetermined area is set based on the moving direction of the image display device. The image display device according to any one of claims 1 to 6,
When the position where the predetermined part of the user is displayed is (x ′, y ′),
The predetermined area is based on predetermined constants w _x , w _y , v _x , v _y , w ₁ , w ₂ , w ₃ , w ₄ , A, B, C, and D, and the following formulas: An image display device characterized by being set.
_{X = (w x + v x} ) t + Asin (w 1 t) + Bsin (w 2 t) + x'
Y = (w _y + v _y ) t + C cos (w ₃ t) + D cos (w ₄ t) + y ′

Images