JP2014232288A - Image display device and image display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem in which, since an output direction of an image is made stationary, a picture is not viewed when a viewer moves.SOLUTION: An image display device comprises: a position detection part that detects a position of a person; an image generation part that generates an image corresponding to the person; and an output direction control part that outputs the image toward the position of the person detected by the position detection part. The position detection part detects a position of a plurality of persons, respectively, and the image generation part generates a plurality of images corresponding to the plurality of persons, respectively. The output direction control part outputs a corresponding image of the plurality of images toward the position of the plurality of persons, respectively.

Description

  The present invention relates to an image display device and an image display method.

An image display apparatus that displays a plurality of videos for a plurality of viewers is known. (For example, refer to Patent Document 1).
[Prior art documents]
[Patent Literature]
[Patent Document 1] JP-A-6-236152

  However, since the output direction of the image is fixed, there is a problem that when the viewer moves, the video cannot be seen.

  In the first aspect of the present invention, a position detection unit that detects the position of a person, an image generation unit that generates an image corresponding to the person, and an image toward the position of the person detected by the position detection unit. An image display device comprising an output direction control unit for outputting is provided.

  In the second aspect of the present invention, a position detection stage for detecting the position of the person, an image generation stage for generating an image corresponding to the person, and an image for the position of the person detected by the position detection stage. An image display method including an output direction control step for outputting is provided.

  It should be noted that the above summary of the invention does not enumerate all the necessary features of the present invention. In addition, a sub-combination of these feature groups can also be an invention.

The structure of the image display apparatus provided in the train is shown typically. The functional block diagram of an image display apparatus is shown. It is the schematic of the structure of a display part. It is sectional drawing which showed the structure of the sub pixel typically. The structure of an opening unit is shown typically. An example of a position database is shown. An example of pixel allocation is shown. Another example of pixel allocation is shown. It is a flowchart explaining the operation | movement process of an image display apparatus. It is a figure explaining operation | movement of the opening unit corresponding to a motion of a person. It is sectional drawing which showed the structure of the other sub pixel typically. The structure of another opening unit is shown typically. It is sectional drawing which showed the structure of the other sub pixel typically. The structure of another opening unit is shown typically. It is sectional drawing which showed the structure of the other sub pixel typically. It is a figure explaining the trapezoid correction process of an image. An example of an image that can be seen by a person before keystone correction is shown. An example of a keystone correction image An example of the image seen by a person after keystone correction is shown. It is a figure explaining the example of using an image display apparatus in a movie theater.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

  FIG. 1 schematically shows a configuration of an image display device 20 provided in a train. The image display device 20 is provided in the center of the ceiling in the train and displays an image such as an advertisement corresponding to a person. The image display device 20 is not limited to a moving body such as a train, and may be provided indoors or outdoors.

  The image display device 20 includes an imaging unit 22 and a display unit 24. The imaging unit 22 captures the inside of the train and generates a parallax image including a pair of left and right images. An example of the imaging unit 22 is a binocular stereo camera in which a pair of imaging elements such as a CCD or a CMOS is provided for each of the binocular lens and the binocular lens. The lens of the imaging unit 22 is preferably wide-angle. If the imaging unit 22 images the inside of the train shown in FIG. 1, a parallax image including the person 10 and the person 12 is generated.

  The image display device 20 calculates position data indicating the position of the person based on the parallax image of the imaging unit 22. As shown in FIG. 1, when two persons 10 and 12 are included in the captured image, position data indicating the positions of the two persons 10 and 12 is calculated. The image display device 20 reads out images corresponding to the persons 10 and 12, and displays the images on the display unit 24 toward the persons 10 and 12.

  FIG. 2 is a functional block diagram of the image display device 20. The image display device 20 includes the imaging unit 22, a position detection unit 54, a recording unit 56, an image generation unit 58, and an output direction control unit 62.

  The position detection unit 54 detects the positions of the plurality of persons 10 and 12 based on the parallax images acquired from the imaging unit 22. The position detection unit 54 further creates classification data for classifying each of the plurality of persons 10 and 12. The classification data includes, for example, data for identifying the sex of a person and whether it is an adult or a child.

  The recording unit 56 stores a position database 64 in which position data of a plurality of persons 10 and 12 are recorded. The recording unit 56 further stores an advertisement image and an advertisement moving image in association with the classification data.

  The image generation unit 58 generates a plurality of images corresponding to each of a plurality of persons. The image generation unit 58 includes a data generation unit 60 in addition to the display unit 24. The data generation unit 60 refers to the classification data and selects and reads out an image that matches the classification data from among the images recorded in the recording unit 56. The data generation unit 60 assigns a plurality of pixels constituting the display unit 24 to a plurality of pixel groups corresponding to a plurality of persons. The data generation unit 60 associates the plurality of pixel groups with the image read from the recording unit 56.

  Note that the functions of the position detection unit 54, the image generation unit 58, and the output direction control unit 62 read out a program stored in the recording unit 56 and store the program in an MPU (Micro-Processing Unit) included in the image display device 20. It may be demonstrated by executing.

  The output direction control unit 62 dynamically directs and outputs the plurality of images to the positions of the plurality of persons at the positions of the detected plurality of persons. The output direction control unit 62 includes opening masks 46 and 52 corresponding to the pixels, and driving units 42 and 48 for driving them.

  FIG. 3 is a schematic diagram of the configuration of the display unit 24. The display unit 24 includes a plurality of pixels 26 that are repeatedly arranged in a two-dimensional direction. Each pixel 26 has red (R), green (G), and blue (B) sub-pixels 28.

  FIG. 4 is a cross-sectional view schematically showing the configuration of the sub-pixel 28. The backlight 29 is arranged over the entire display area for displaying an image in the display unit 24. The backlight 29 irradiates light from the rear of the display unit 24 toward the front region. The transparent common electrode 30 is disposed on the front side of the backlight 29 and over the entire display area. The liquid crystal layer 32 is disposed on the front side of the common electrode 30 and over the entire display area.

  The individual electrode 34 is disposed on the front side of the liquid crystal layer 32 and demarcates the region of the sub-pixel 28 in the liquid crystal layer 32. The liquid crystal orientation of the liquid crystal layer 32 for each sub-pixel 28 is controlled according to the voltage applied between the individual electrode 34 and the common electrode 30, thereby controlling the transmittance of light transmitted through the liquid crystal layer 32. . Further, the color filter 36 is a filter that transmits one of red (R), green (G), and blue (B), and is disposed on the front side of the individual electrode 34. As described above, the sub-pixel 28 includes one individual electrode 34, one color filter 36, and a region portion corresponding to the individual electrode 34 in the backlight 29 and the liquid crystal layer 32.

  The support wall 39 is formed in a lattice shape over the entire display area. Each of the opening positions of the lattice of the support wall 39 is arranged so as to be at the position of the corresponding individual electrode 34.

  The opening masks 46 and 52 are disposed on the front side of the color filter 36 and supported by the support wall 39. The opening masks 46 and 52 change the position of the opening region 37 in the region of the sub-pixel 28.

  The microlens 40 is disposed in front of the opening masks 46 and 52 and is supported by the support wall 39. A microlens 40 is provided in front of the opening region 37, and the output direction of light emitted from the backlight 29 and transmitted through the liquid crystal layer 32 is changed by changing the position of the opening region 37. In the example shown in FIG. 3, the light that has passed through the opening region 37 on the right side is output in the left direction by the microlens 40. The microlens 40 is preferably a microlens with corrected aberration, and is preferably a bonded or aspherical lens.

  FIG. 5 schematically shows the configuration of the output direction control unit 62. The opening mask 46 and the opening mask 52 of the output direction control unit 62 are arranged forward and backward.

  The opening mask 46 is provided on the color filter 36 side, and shields light other than the opening 44 extending in the vertical direction. The driving units 42 are provided at both ends of the opening mask 46 in the left-right direction, and move the position of the opening 44 in the left-right direction by physically driving the opening mask 46 in the left-right direction.

  The opening mask 52 is provided on the microlens 40 side, and shields light incident on other than the opening 50 extending in the left-right direction. The drive unit 48 is provided on both ends of the opening mask 52 in the front-rear direction, and moves the position of the opening 50 in the vertical direction by physically driving the opening mask 52 in the vertical direction.

  FIG. 6 shows an example of the position database 64. The position database 64 includes a person ID field for identifying a person, a position data field, and a classification data field.

  In the person ID column, the identification numbers of the persons recognized in the parallax image are recorded from the top in the order closer to the imaging unit 22. The identification number is a number assigned by the image display device 20, for example.

  In the position data column, position data corresponding to the person ID is recorded. In the example illustrated in FIG. 6, the position data has an X coordinate, a Y coordinate, and a Z coordinate in an XYZ coordinate system with the center of the display unit 24 of the image display device 20 as the origin.

  Classification data is recorded in the classification data column. In the example shown in FIG. 6, the classification data M1 indicates an adult male, and the classification data F1 indicates an adult female.

  FIG. 7 is an example of assignment in which a plurality of pixels 26 are assigned when there are two persons. The data generation unit 60 assigns the plurality of pixels 26 so that the pixels 26 assigned to two persons in the left-right direction and the up-down direction are staggered. Accordingly, for example, the pixel group 66 in FIG. 7 is assigned to the person 10, and the pixel group 67 is assigned to the person 12.

  FIG. 8 shows an allocation example in which a plurality of pixels 26 are allocated when there are three persons. The data generation unit 60 allocates the plurality of pixels 26 so that the pixels allocated to the three persons in the horizontal direction and the vertical direction are repeated in a certain order. Thus, for example, the pixel group 66 in FIG. 8 is assigned to the person 10, the pixel group 67 is assigned to the person 12, and the pixel group 68 is assigned to another person.

  FIG. 9 is a flowchart for explaining the operation process of the image display device 20. The operation starts when the image display device 20 is activated by the user.

  The imaging unit 22 captures the front surface of the image display device 20 and acquires a parallax image (S101). The position detection unit 54 acquires a parallax image from the imaging unit 22 and detects the position of each person included in the parallax image (S102). In this case, for example, the position detection unit 54 scans the parallax image with a window of a specific size, and performs pattern matching that matches the image in the window with the template image indicating the person, so that It may be determined whether an image is included.

  When the position detection unit 54 determines that a person image is included in the parallax image, the position of the person in the parallax image, for example, the position of the person's eyes, the position of the person's face, or the standing position of the person Based on the above, the direction of the person with respect to the imaging unit 22 is specified. Further, the position detection unit 54 performs pattern matching on the persons included in the pair of left and right images in the parallax image, and obtains a difference in the position of the person between the pair of left and right images, that is, the parallax. The distance from 54 to the person is calculated. The position detection unit 54 creates position data represented by the X, Y, and Z coordinates in the XYZ coordinate system with the origin of the center of the display unit 24 for each person from the distance and direction. The position detector 54 assigns a person ID to each person, and records the person ID and position data in the position database 64.

  In the image display device 20, an upper limit of the number of images that can be displayed at one time may be set. In this case, when the number of recognized persons reaches the upper limit in step 102, the subsequent person position detection process may be terminated and the process may proceed to step S103.

  The position detection unit 54 creates classification data for each person included in the parallax image (S103). In this case, the position detection unit 54 specifies a feature point for performing classification based on the classification data for each person. The characteristic points for classifying the gender of a person are, for example, the length of hair, the color of lips, and the color of clothes. The feature point for classifying the adult or child is, for example, height.

  The position detection unit 54 classifies the person by specifying the feature point from the image of each person in the parallax image and calculating an evaluation value by weighted addition of the feature points. The position detection unit 54 creates a symbol indicating the classification data corresponding to the classification, and records the symbol in the position database 64. Corresponding to FIG. 1, in the example shown in FIG. 6, classification data M <b> 1 indicating an adult male is recorded in the position database 64 for the person 10, and classification data F <b> 1 indicating an adult female is recorded for the person 12. Has been.

  The data generation unit 60 refers to the classification data recorded in the position database 64, and for each person recorded in the position database 64, the image associated with the classification data is stored in the recording unit 56. The image is selected from the recorded images (S104). For example, an image associated with the classification data M1 for the person 10 is selected. The image associated with the classification data M1 includes an advertisement image for adult men, for example, an advertisement image of an information magazine for men. On the other hand, for the person 12, an image associated with the classification data F1 is selected. The image associated with the classification data F1 includes an advertisement image for adult women, for example, a cosmetic advertisement image.

  The data generation unit 60 assigns the selected pixel group to each person ID (S105). In this case, the data generation unit 60 reads the number of persons from the position database 64 and determines which of the plurality of pixels 26 is assigned to which person. For example, when there are two persons, pixels are allocated as shown in FIG. 8, and when there are three persons, pixels are allocated as shown in FIG.

  The data generation unit 60 specifies the positions of the opening regions 37 corresponding to the assigned pixels (S106). In this case, the data generation unit 60 refers to the position database 64, calculates direction data from the center of the display unit 24 toward each person's position, and applies the direction data to the pixel group assigned to the person. The data are output to the drive units 42 and 48 in association with each other.

  The driving units 42 and 48 store a table in which the direction data and the position of the opening region 37 are associated with each other. When acquiring the direction data from the data generation unit 60, the drive units 42 and 48 refer to the table and specify the position of the opening region 37 of each sub-pixel 28 from the direction data.

  The drive units 42 and 48 move the opening masks 46 and 52 (S107), and align the opening region 37 at the specified position. Further, the display unit 24 displays a corresponding image on each of the plurality of pixel groups (S108). For example, an advertisement image for adult men to the person 10 is displayed in the pixel group 66 of FIG. 7, and an advertisement image for adult women to the person 12 is displayed in the pixel group 67. In the middle of moving the opening masks 46 and 52, light may not be transmitted from the liquid crystal layer 32 so that an image is not displayed.

  The imaging unit 22 determines whether the end of the image display device 20 has been selected by the user (S109). If the imaging unit 22 determines that the user has not selected termination of the image display device 20 (S109: No), the imaging unit 22 returns the process to step S101. On the other hand, when the imaging unit 22 determines that the end of the image display device 20 has been selected by the user (S109: Yes), the imaging unit 22 ends the image display device 20 and performs an operation process of the image display device 20. Ends.

  FIG. 10 is a diagram for explaining that an image is dynamically directed following the movement of a person by the operation of the flowchart. It is assumed that the person 10 is at the position of the solid line in FIG. In this case, by the operation of the flowchart, the driving unit 42 moves the opening mask 46 corresponding to the sub-pixel 28 assigned to the person 10 in the left direction, and moves the opening region 37 to the left side. The light that has passed through the opening region 37 is output to the right by the microlens 40, and the person 10 can see the light, but other persons at positions different from the person 10 see the light. I can't. That is, the person 10 in the right direction can see the image corresponding to the person 10 composed of the light, but the other person at a position different from the person 10 sees the image corresponding to the person 10. I can't. As a result, the image is directed from the sub-pixel 28 toward the person 10 in the right direction.

  When the person 10 moves to the left as indicated by the broken line, the driving unit 42 moves the opening mask 46 corresponding to the sub-pixel 28 to the right and moves the opening area 37 to the right by the operation of the flowchart. I will stop. The light that has passed through the opening area 37 is output in the left direction by the microlens 40, and the person 10 that has moved in the left direction can see an image composed of the light. Accordingly, the image is directed from the sub-pixel 28 toward the person 10 in the left direction. As described above, the image display device 20 can move the opening area 37 to dynamically direct the moved person to output an image.

  According to the image display device 20, even if each of the plurality of persons 10 and 12 moves, the image selected corresponding to each of the persons 10 and 12 can be displayed on the moved persons 10 and 12. Thereby, the persons 10 and 12 can view the selected image without being limited to the fixed place. Also. The image display device 20 can select and display an image to be displayed on the persons 10 and 12.

  7 and 8, the plurality of pixels 26 are spatially evenly assigned to the pixel group. Instead of this, the number of pixels 26 to be assigned to the pixel group for a person far from the image display device 20 is assigned. It may be reduced. As the person leaves the image display device 20, the person cannot recognize the roughness of the pixel 26. For example, a person with a visual acuity of 1.5 can recognize an image break of 0.9 mm at a distance of 3 m, but cannot recognize a cut of 0.9 mm at a distance of 5 m, and recognizes only a break of 1.5 mm. Can not. Therefore, it is difficult for a person who is away from the image display device 20 to perceive deterioration of the image even if the number of allocated pixels 26 is reduced. Therefore, the pixel group of the person farther from the image display device 20 can display more images on a larger number of people without causing the person to feel image degradation by reducing the amount of allocation to the pixels 26. .

  7 and 8, the plurality of pixels 26 of the display unit 24 are allocated to pixel groups corresponding to the number of persons recognized from the parallax image. Alternatively, the plurality of pixels 26 may be divided into a predetermined number of pixel groups regardless of the number of recognized persons, and the pixel groups may be sequentially assigned to the number of recognized persons. .

  As the number of persons to which the pixels 26 are assigned increases, the light emission amount of the backlight 29 may be increased and the light amount of each pixel 26 may be increased. This makes it difficult for the person to feel that the brightness of the image has changed even if the number of pixels 26 for one image increases or decreases by increasing or decreasing the number of persons to which the pixels 26 are assigned. Can do.

  In the present embodiment, the example in which the output direction control unit 62 is arranged corresponding to the sub-pixel 28 has been described. However, the pixel 26 including the red (R), green (G), and blue (B) sub-pixels 28. The output direction control unit 62 may be arranged corresponding to each. In this case, similarly to the output direction control unit 62, the microlens 40 is also preferably arranged corresponding to each pixel 26 composed of the red (R), green (G), and blue (B) sub-pixels 28. .

  In the present embodiment, the position detection unit 54 creates classification data for each person included in the parallax image, and the data generation unit 60 selects the recording unit 56 as an image associated with the classification data. The selection method is not limited to this. As another method, the position detection unit 54 identifies each person included in the parallax image, acquires the purchase history or the net search history of the person, and the data generation unit 60 determines based on the purchase history or the net search history. An image may be generated.

  In this case, the position detection unit 54 generates face data of each person included in the parallax image, and compares the face data provided in the network including the cloud to identify the person. Further, the position detection unit 54 stores the real name, nickname, description content in the blog, net shopping history, or net search history of each identified person in the face database or other databases provided in the network. Get from. The position detecting unit 54 records the acquired description content in the blog of each person in the position database 64. The data generation unit 60 may outsource an image based on the description content in each person's blog recorded in the position database 64 and display the obtained image on the display unit. Note that the face database provided in the network includes a face photo database of profiles registered in the social network service (SNS).

  FIG. 11 is a cross-sectional view schematically showing the configuration of another sub-pixel 70. In FIG. 11, the same reference numerals are assigned to elements common to the other drawings, and redundant description is omitted. The sub-pixel 70 includes an output direction control unit 74 instead of the individual electrode 34 and the output direction control unit 62 shown in FIG.

  The output direction control unit 74 includes the common electrode 30, the liquid crystal layer 32, and the individual electrode 72. A plurality of individual electrodes 72 are arranged in a two-dimensional direction in a region corresponding to the sub-pixel 28 on the front side of the liquid crystal layer 32.

  FIG. 12 schematically shows the configuration of the output direction control unit 74. The individual electrode 72, together with the common electrode 30, applies a voltage to the liquid crystal layer 32 to improve the light transmittance of the liquid crystal layer 32 and form the opening region 76. In the example shown in FIG. 12, the liquid crystal layer 32 functions as an opening mask.

  The four individual electrodes 78 slightly closer to the upper left of the center apply a voltage to the liquid crystal layer 32 at positions corresponding to the four individual electrodes 78 to increase the light transmittance of the liquid crystal layer 32. Thus, the four individual electrodes 78 electrically open the liquid crystal layer 32 functioning as an opening mask to form an opening region 76. By changing the position and number of the individual electrodes 72 to be applied, the position of the opening region 76 can be changed in the vertical and horizontal directions and the size thereof can be changed. Therefore, in the sub-pixel 70, it can be said that the individual electrode 72 has a role of generating an image and a role of a driving unit that changes the position and size of the opening region 76.

  FIG. 13 is a cross-sectional view schematically showing the configuration of another sub-pixel 80. In FIG. 13, the same reference numerals are assigned to elements common to the other drawings, and redundant description is omitted. The sub-pixel 80 includes a light emitting unit 84 instead of the backlight 29, the common electrode 30, the individual electrode 34, and the output direction control unit 62 shown in FIG.

  The light emitting unit 84 includes a plurality of light emitting elements 82 arranged in the two-dimensional direction on the rear side of the color filter 36. An example of the light emitting element 82 is an LED that emits light by applying a voltage.

  FIG. 14 schematically shows the configuration of the light emitting unit 84. The image display device 20 forms a light emitting region 86 by applying a voltage to the light emitting element 82 to cause the light emitting element 82 to emit light. The image display device 20 can quickly change the position of the light emitting region 86 in the vertical and horizontal directions by changing the position of the light emitting element 82 to be applied. In the light emitting unit 84, it is not necessary to provide an opening mask. In the sub-pixel 80, it can be said that the light emitting unit 84 plays a role of generating an image and a role of an output direction control unit for directing the image.

  FIG. 15 is a cross-sectional view schematically showing the configuration of another sub-pixel 88. In FIG. 15, the same reference numerals are assigned to elements common to the other drawings, and redundant description is omitted.

  The support wall 41 drives the microlens 40 in the front-rear direction to move the microlens 40 in the front-rear direction. The output light from the microlens 40 can be expanded by moving the microlens 40 backward. When the output light from the microlens 40 is spread, a person who sees an image made of the light adjusts the crystalline lens in accordance with the spread of the output light, and feels the distance to the image from the degree of adjustment. That is, when the output light from the microlens 40 is parallel, the person feels an image composed of the light at infinity. However, when the output light from the microlens 40 is greatly spread, the person feels an image made of the light closer to infinity. Thus, by driving the microlens 40 in the front-rear direction, it is possible to give a sense of perspective to an image formed by corresponding pixels.

  Further, the spread of the output light may be adjusted by moving the microlens 40 according to the distance to the person detected by the position detection unit 54. In this case, the spread when the output light reaches the distance of the person's face is preferably about the same as the size of the face. Regardless of the distance of the person from the image display device 20, the image can be displayed with the same perspective by making the output light spread to the same extent when it reaches the face of the person. Further, by moving the microlens 40 in the backward direction and expanding the output light from the microlens 40, the output direction of the image can be easily followed by the movement of the person.

  FIG. 16 is a diagram for explaining the trapezoidal correction process for an image. FIG. 17 shows an example of an image 90 that looks like a person before keystone correction.

  When the person 10 is diagonally to the right with respect to the display unit 24 of the image display device 20, when a rectangular image is displayed on the display unit 24, a trapezoidal image 90 as shown in FIG. Looks. Therefore, it is preferable that the data generation unit 60 performs keystone correction on the corresponding image 90 among the plurality of images in accordance with the direction expected by the data generation unit 60 of the plurality of persons. The direction expected by the data generation unit 60 is, for example, the direction of the person from the center of the display unit 24 calculated by the data generation unit 60.

  If the position of the person 10 is P and the center of the display unit 24 is Q, the data generation unit 60 defines a virtual plane 91 that is perpendicular to a line connecting the position to the center of the display unit 24. The data generation unit 60 specifies the size of a rectangular image to be displayed on the person 10 on the virtual plane 91. The data generation unit 60 calculates four points at which lines connecting the four corner points of the rectangular image and the point P intersect the plane of the display unit 24.

  FIG. 18 shows an example of a trapezoidal correction image 92, and FIG. 19 shows an example of an image 94 that looks like a person after trapezoidal correction. A shape connecting four points on the display unit 24 is a shape for correcting the trapezoid, and an image having the shape is a trapezoid correction image 92. That is, when the trapezoidal correction image 92 is displayed on the display unit 24, it appears to the person 10 as the image 94. The image 94 is the same image as the rectangular image specified on the virtual plane 91 by the data generation unit 60.

  Further, even if the person 10 moves, the image display device 20 can perform the same trapezoidal correction on the moved person by calculating the position data of the moved person 10. In addition, when performing trapezoidal correction on a plurality of persons at the same time, it is conceivable that image information concentrates on either the left or right pixel. In that case, the data generation unit 60 may adjust the size of the rectangular image to be displayed on the person 10 so that the competition is reduced as much as possible. In addition, when the conflict cannot be avoided, the trapezoidal correction of the person close to the image display device 20 may be given priority, and the trapezoidal correction of the person away from the image display device 20 may display an image whose position is shifted. . By using the image display device 20, it is possible to provide an image with little distortion even when viewed obliquely.

  FIG. 20 is a diagram illustrating an example in which the image display device 100 is used in a movie theater. In FIG. 20, the image display apparatus 100 is arranged at a position where a screen is provided in a movie theater. The image display apparatus 100 can display different movies for each of the persons 102, 104, 106, and 108.

  The persons 102, 104, 106, and 108 can select a movie to be viewed from a plurality of movies when purchasing a ticket for the movie theater. The image display device 100 displays the selected movie on the person based on the information for identifying the person watching the movie. The information for identifying the person who watches the movie may be, for example, a person's face image or an IC tag. Further, if a seat is designated, a movie may be displayed toward the position of the seat. Thus, by using the image display device 100 in a movie theater, a movie corresponding to a person can be displayed at the position of the person.

  Even when the person 106 moves to the next seat, the imaging unit 22 captures a parallax image of the person 106 after movement and detects the position of the person 106 after movement. The image display apparatus 100 displays the movie selected by the person 106 on the person 106 based on the detected position of the person 106. Thus, even if the person 106 moves, the image display apparatus 100 can dynamically direct the movement and display the movie on the person 106 after the movement.

  Instead of displaying an image in association with the position data on the display unit 24, an image may be displayed for a certain person but not displayed for another person. . In this case, for example, a white or black image is associated with the classification data M1 in the recording unit 56, and the classification data is displayed while displaying an advertisement image for the person 12 of FIG. 1 having the classification data F1. A white or black image may be displayed for the person 10 having M1. Instead, all of the plurality of pixels 26 are assigned to a specific person, and the output direction control unit 62 directs all of the plurality of pixels 26 to the specific person, so that an image can be displayed to another person. You may make it not display.

  As another example, an image corresponding to the person may be displayed for a certain person, and other images may be displayed without specifying the position of the person other than the person. In this case, an image that does not specify a target is stored in the recording unit 56. For example, when a person is first specified, the corresponding image is directed to the person using one pixel group. An image that does not specify a target may be displayed using another pixel group in a direction other than the direction of the person. In this case, the output direction control unit shown in FIGS. 11 to 14 can be used. For example, the opening area 76 shown in FIG. 12 is set for the person 10, and the opening area obtained by inverting the opening / closing of the opening area 76 in FIG. 12 can be set for the area other than the person 10.

  In the present embodiment, an example in which a plurality of images are displayed toward a plurality of people by providing the microlens 40 and controlling the position of the opening region of the sub-pixel 28 has been described. Instead, a prism may be provided. By providing a prism at a position corresponding to the microlens 40 of each sub-pixel 28 and controlling the prism position, the light output direction of the plurality of sub-pixels 28 is changed without controlling the position of the opening area of the sub-pixel. Thus, a plurality of images may be displayed at the positions of a plurality of persons.

  In the present embodiment, an example in which a plurality of images are displayed toward a plurality of people by providing the microlens 40 and controlling the position of the opening region of the sub-pixel 28 has been described. Instead, a micromirror may be provided. By providing a micromirror at a position corresponding to the microlens 40 of each subpixel 28 and controlling the reflection surface of the micromirror, the light of the plurality of subpixels 28 is controlled without controlling the position of the opening area of the subpixel 28. The output direction may be changed to display a plurality of images at positions of a plurality of persons.

  Moreover, in the said embodiment, the some pixel 26 is divided into the pixel group matched with the person, and each image is displayed. Instead, the data generation unit 60 sequentially generates a plurality of images in a time division manner, and the output direction control unit 62 synchronizes the timings of the time divisions with the corresponding plurality of images. The position may be oriented and displayed.

  For example, assuming that the time-division frame rate is 1/30 second, the data generation unit 60 assigns an image corresponding to the person 10 to all of the plurality of pixels 26 and the person for all of the plurality of pixels 26. A frame assigned with an image corresponding to 10 is switched every 1/30 seconds and displayed on the display unit 24. Further, the output direction control unit 62 directs all of the plurality of pixels 26 to the person 10 while a frame to which an image corresponding to the person 10 is assigned is displayed. Similarly, the output direction control unit 62 directs all of the plurality of pixels 26 to the person 12 while a frame to which an image corresponding to the person 12 is assigned is displayed. Thereby, the image display apparatus 20 can display a plurality of images with a resolution maintained on a plurality of persons.

  An opening that moves in synchronization with the opening region 37 may be provided on the front side of the microlens 40. By providing the opening, the range in which the output light from the microlens 40 spreads is limited so that an image made of the light is not shown to other people.

  In the present embodiment, an example in which the backlight 29 is provided has been described, but a laser may be used as the light source. Thereby, the light quantity of a light source can be increased and an image can be displayed also to a person away from the image display device 20.

  In the present embodiment, an example in which a two-lens stereo camera is used as the imaging unit 22 has been described. However, a camera that can obtain a parallax image with one eye may be used. As yet another example, the imaging unit 22 changes the focus distance and performs multiple imaging, and the position detection unit 54 acquires the position data of the persons 10 and 12 from the contrast and the focus distance of the generated image. Also good. As another example, an infrared output unit is provided, or the infrared ray for AF is used to scan the infrared ray in the object field, so that the position detection unit 54 has a time difference between the infrared output and the incident reflected light. Position data may be obtained from Instead of scanning the object scene, position data may be acquired by outputting infrared rays in a mesh shape and analyzing reflected light.

  In the present embodiment, the example in which the image display device 20 is installed alone has been shown, but a plurality of image display devices 20 may be installed. In this case, the image display device 20 that previously displayed an image on a certain person uses the position, movement direction, movement speed, or classification data of the person as the other image display device 20, for example, the person. Alternatively, the image may be delivered to the image display device 20 arranged in the moving direction. Accordingly, the other image display device 20 can quickly detect the person, and thus can display an image for the person without interruption between the plurality of image display devices 20.

  In the present embodiment, the microlens 40 has an example having the same size as each pixel, but a lens smaller than each pixel may be used. For example, the microlens 40 uses a lens having an F value (F number) such as F5 or F8. In this case, a lens having a small size may be used, and the size of the lens is about the same as that of each pixel, and a diaphragm is provided at least one of the front and rear of the lens to limit light incident on the pixel. You may comprise as follows. Thereby, the brightness of the lens can be arbitrarily set. In addition, when the size of the microlens 40 is smaller than each pixel, a lens driving unit that drives the microlens 40 may be provided so that the position of the microlens 40 can be adjusted.

  In the present embodiment, the sub-pixel 28 has been shown to display a single color, but may be configured to display a plurality of colors. Thereby, a vivid image can be expressed.

  In the present embodiment, a speaker may be further provided, and sound corresponding to an image, a movie, or the like shown to each person may be controlled to be output to the position of each person detected by the position detection unit 54. For example, by driving a directional speaker to output a sound following the movement of each person, or by controlling the volume, frequency, time, timing, etc. of the sound output from a plurality of speakers, For example, outputting a voice to be heard at each person's position. As a result, it is possible to output sound adapted to each person.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  The order of execution of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before” or “prior to”. It should be noted that the output can be realized in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first”, “next”, etc. for convenience, it means that it is essential to carry out in this order. It is not a thing.

10, 12 persons, 20, 100 image display device, 22 imaging unit, 24 display unit, 26 pixels, 28, 70, 80, 88 sub-pixels, 29 backlight, 30 common electrode, 32 liquid crystal layer, 34, 72, 78 Individual electrode, 36 Color filter, 37, 76 Aperture area, 39, 41 Support wall, 40 Micro lens, 42, 48 Drive unit, 44, 50 Aperture, 46, 52 Aperture mask, 54 Position detection unit, 56 Recording unit, 58 Image generating unit, 60 data generating unit, 62, 74 output direction control unit, 64 position database, 66, 67, 68 pixel group, 82 light emitting element, 84 light emitting unit, 86 light emitting region, 90, 94 image, 91 virtual plane, 92 Corrected images, 102, 104, 106, 108 people

Claims (9)

A position detector for detecting the position of the person;
An image generator for generating an image corresponding to the person;
An image display device comprising: an output direction control unit that outputs the image toward the position of the person detected by the position detection unit. The position detection unit detects the positions of a plurality of persons,
The image generation unit generates a plurality of images corresponding to each of the plurality of persons,
The output direction control unit
The image display device according to claim 1, wherein the corresponding image among the plurality of images is output toward each position of the plurality of persons. The image generation unit
A plurality of pixel groups for generating the image corresponding to each of the plurality of persons;
The image display apparatus according to claim 2, wherein the output direction control unit outputs the image corresponding to each of the plurality of persons toward each position of the plurality of persons for each of the plurality of pixel groups. .   4. The image generation unit according to claim 3, wherein the image generation unit selects a smaller number of pixels included in the plurality of pixel groups as a pixel group corresponding to the person far from the image generation unit among the plurality of persons. Image display device. The image generation unit sequentially generates the plurality of images in a time division manner,
The output direction control unit corresponds to each of the plurality of persons toward each position of the plurality of persons in synchronization with each timing at which the plurality of images are generated in the image generation unit. The image display device according to claim 2, wherein the image display device outputs an image. The image generation unit includes a plurality of pixels,
The output direction control unit
A plurality of aperture masks arranged corresponding to the front surfaces of the plurality of pixels;
The image display apparatus according to claim 1, further comprising: a driving unit that physically drives positions of the plurality of aperture masks. The image generation unit includes a plurality of pixels,
The output direction control unit has a plurality of microlenses arranged corresponding to the front surfaces of the plurality of pixels,
The image display device according to claim 1, wherein a light emission position of the pixel with respect to the plurality of microlenses corresponding to each of the plurality of pixels is controlled. A position detection stage for detecting the position of a person;
An image generation stage for generating an image corresponding to the person;
An image display method comprising: an output direction control step of outputting the image toward the position of the person detected by the position detection step. The position detecting step detects a moving direction and a moving speed of the person,
The image display method according to claim 8, further comprising a transfer step of transferring at least one of the position, moving direction, and moving speed of the person to another image display device.

Images