JP7041211B2 - Image display control device, image display system and program - Google Patents

Description

The present invention relates to an image display control device and the like.

There are "signboards", "warning lamps", "marks", etc. as means for guiding people. Recently, an image display system that displays various information by using an image display device such as a large liquid crystal display is known for this signboard or the like.

A mechanism for guiding a target person (user of a facility, etc.) by using such an image display system is disclosed (see, for example, Patent Document 1).

Further, various inventions of such an image display system are disclosed in relation to a subject who needs information. For example, an invention that displays an image only when the subject is present (see, for example, Patent Document 2), an invention that displays an image only when the subject is visually observing (see, for example, Patent Document 3), and the like are known. ..

In addition, there is an information display screen in the horizontal direction, and the screen is divided into two areas in advance, the position of a person in the vicinity of the display device is determined by a sensor, and when there are a plurality of people in the vicinity, the information display screen is provided. Disclosed is an invention in which video information is rotated and displayed on a horizontal information display screen so as to be oriented appropriately when viewed from a direction with a large number of people (see, for example, Patent Document 4).

Japanese Unexamined Patent Publication No. 6-325265 Japanese Unexamined Patent Publication No. 2002-278536 Japanese Unexamined Patent Publication No. 2004-185139 Japanese Unexamined Patent Publication No. 2011-192030

In facilities, etc., various information is displayed to guide the target person. For example, various information such as guiding, guiding, and warning the target person is displayed. However, there are various people who use the facilities as the target people. For example, since the height of the line of sight differs between adults and children, there is a problem that information that adults can easily recognize is overlooked by children.

Further, in the above-mentioned conventional technique, the display position where the information is displayed is predetermined. That is, it is necessary to arrange the image display device at a predetermined position and the user to see the information displayed on the image display device. Therefore, if there is nothing displayed in the direction the subject was looking at and the display was not noticed, it could not be said that the information could be provided appropriately.

In addition, since the displayed images (messages) are displayed uniformly, there may be a problem that the message cannot be read when the child sees it, for example.

In view of the above-mentioned problems, an object of the present invention is an image display control capable of appropriately presenting information by displaying an image of contents according to the characteristics at a position according to the characteristics of the subject. It is to provide equipment and the like.

In order to solve the above-mentioned problems, the image display control device of the present invention is used.
An image display device that can display images at multiple display positions,
Characteristic determination means for determining the characteristics of the subject,
A display position determination means for determining a display position corresponding to the characteristics of the target person determined by the characteristic determination means, and a display position determination means.
An image display control means that controls display / non-display of an image at a display position determined by the display position determination means, and an image display control means.
It is characterized by having.

The image display system of the present invention is
In an image display system including a plurality of image display devices, a recognition device, and a control device for displaying and controlling an image on the image display device.
The control device is
Determine the characteristics of the subject and
An image display device for displaying an image is determined from the determined characteristics of the subject, and the image is determined.
It is characterized in that control of displaying / not displaying an image on the determined image display device is performed.

The program of the present invention
To a computer connected to an image display device that can display images at multiple display positions,
A characteristic judgment function that judges the characteristics of the target person, and
A display position determination function for determining a display position corresponding to a person's characteristics determined by the characteristic determination function, and a display position determination function.
An image display control function that controls display / non-display of an image at a display position determined by the display position determination function, and an image display control function.
It is characterized by realizing.

The image display control device of the present invention is a device that controls the display of an image displayed on an image display device capable of displaying an image at a plurality of display positions, and at a display position corresponding to the characteristics of a determined person. You can show or hide the image. Therefore, it is possible to select a display device to display an image according to characteristics such as the size and age of the target person and the movement of the target person.

It is a figure for demonstrating the whole in 1st Embodiment. It is a figure for demonstrating the functional composition in 1st Embodiment. It is a figure for demonstrating the recognition method of a human body in 1st Embodiment. It is a figure for demonstrating the display area in 1st Embodiment. It is a figure for demonstrating an example of arrangement of a display device and a display area in 1st Embodiment. This is an example of the data structure of the display position table in the first embodiment. It is a flowchart for demonstrating an example of processing in 1st Embodiment. It is a figure for demonstrating the application example in 1st Embodiment. This is an example of the data structure of the display position table in the second embodiment. It is a flowchart for demonstrating an example of the process in 2nd Embodiment. This is an example of the data structure of the display position table in the third embodiment. It is a flowchart for demonstrating an example of the process in 4th Embodiment. This is an example of the data structure of the display position table in the fourth embodiment. This is an example of the data structure of the display position table in the fourth embodiment. This is an example of the data structure of the display position table in the fifth embodiment. It is a figure for demonstrating the application example in 5th and 6th Embodiment. It is a flowchart for demonstrating an example of the process in 6th Embodiment.

Hereinafter, the best mode for carrying out the present invention will be described with reference to the drawings. The following embodiment is an example to which the image display system of the present invention is applied, and it goes without saying that the content of the invention is not limited to the present embodiment.

[1. First Embodiment]
[1.1 System appearance]
The entire image display system 1 according to the first embodiment will be described with reference to FIG. As shown in FIG. 1, the image display system 1 has a recognition device 20 for recognizing a user P and an image display device 30 for displaying an image, and these are a control device 10 (image display control device). It is connected to the.

In the present embodiment, as an example of the image display device 30, the image display device 32 and the image display device 34 are included. The image display device may be, for example, a display using a liquid crystal display or the like, or an image may be projected by a projector or the like.

Here, in the present specification, displaying an image includes not only displaying the image on an image display device such as a display but also projecting the image by a projection device such as a projector. That is, it is described as an image display device that displays an image by projecting an image on the projector.

For example, the image display device 32 in FIG. 1 is a display, and the image display device 34 is a projector. The image display device 34 projects an image on the area R30 (R34) as a display position. Here, the number of image display devices 30 may be one or a plurality. That is, it is sufficient that the configuration is such that it can be displayed at a plurality of display positions. Details of each device will be described in the following functional configuration.

Further, the image display device 30 may be configured to be movable. For example, in the case of a projector, the projector mounting portion may be configured to be movable so that the lens direction can be freely moved in the projection direction of the projector. Further, in the case of a display, the mounting portion is movable and may be configured to move to a place to be displayed.

In this embodiment, the recognition device 20, the image display device 30, and the control device 10 are connected in the same premises (for example, they are connected to the same network or are locally connected such as a USB connection. However, it may be connected via an external network.

That is, the control device 10 is a server connected to the Internet, and processes are executed on the server. Then, the recognition device 20 and the image display device 30 may be connected via the Internet. In this case, the administrator on the server side can perform a plurality of controls even at a remote location.

[1.2 Function configuration]
Subsequently, the functional configuration of each device constituting the image display system 1 in the present embodiment will be described with reference to FIG.

As shown in FIG. 2, the recognition device 20 and one or more image display devices 30 are connected to the control device 10.

Further, the control device 10 includes a control unit 110, a recognition unit 120, an image display control unit 130, and a storage unit 140.

The control unit 110 is a functional unit for controlling the entire control device 10. The control unit 110 realizes various functions by reading and executing various programs stored in the storage unit 140, and is configured by, for example, a CPU (Central Processing Unit) or the like.

The recognition unit 120 is a functional unit for inputting and processing information based on the human body of the user recognized by the recognition device 20. That is, it is a functional unit that recognizes the characteristics of the target person by using the technology (image processing, thermostat, position sensor, pressure sensor) for sensing the movement of a person in the space in the recognition device 20.

Here, the characteristic of the target person (person) is a concept including the attributes and actions of the target person. The attribute of the target person is such that the target person can be determined by the recognition device 20, such as height and physique. Furthermore, by recognizing the size and facial expression of a person, it is possible to recognize whether the person is a man or woman, an adult, a child, has a white cane, uses a wheelchair, or is a healthy person. be able to.

In addition, the movement of the target person is to determine the movement of the target person, such as the direction and speed in which the target person is moving, the posture such as whether the target person is standing up, or the subject person's movement. You can recognize things like movement.

Here, the mechanism by which the recognition device 20 and the recognition unit 120 recognize a person (human body) in the space will be described with reference to FIG. Here, various devices can be considered as the recognition device 20, and as an example, a method using Kinect (registered trademark) manufactured by Microsoft Corporation will be described.

By using Kinect, the human skeleton can be grasped as a stick picture (Fig. 3 (a)). That is, the feature points of each joint of the human body and the line connecting the feature points are detected.

Based on this feature point, it becomes possible to recognize the orientation of a person's face and the orientation of the body. For example, in order to obtain the orientation of the face and the orientation of the body, as shown in FIG. 3B, the feature points of each joint are used for recognition. In FIG. 3B, the (x, y, z) coordinates of the feature point P01 and the feature point P02 are detected, respectively. Then, the orientation of the face is recognized by calculating the angle between the straight line connecting the two coordinates and the reference plane.

Further, the (x, y, z) coordinates of the feature point P03 and the feature point P04 are detected, respectively, and the direction of the body (direction and inclination) from the position of the virtual line L01 connecting the feature point P03 and the feature point P04 with a straight line. ) Is recognized.

Thereby, for example, the area for displaying the image can be specified from the direction in which the user is facing. For example, as shown in FIG. 3C, the angle with respect to the central axis is calculated from the feature point P01 and the feature point P02, thereby calculating the face angle (angle facing the user) θ1. Will be done.

Further, it is possible to obtain the position where the line of sight reaches the ground line L04 from the height L02 of the viewpoint of the human body (for example, approximately the height of the feature point P02) and the normal direction L03 of the angle of the face. (For example, height L02 × approximation θ1). Then, the image can be displayed with this position as the display area R01.

In addition, as a method of recognizing a human body, another method may be used. For example, an image processing technique using a camera, a recognition technique using thermography or infrared rays may be used, or a pressure sensor may be placed on the floor to recognize a person in the direction of the foot and the direction of the load. Further, the line of sight may be detected by using the line of sight detection technique.

Here, as for the recognition of the orientation of the user P (human body), the priority is higher in the order of the direction of the line of sight, the orientation of the face, and the orientation of the body. That is, if the direction of the line of sight can be recognized, the direction of the line of sight is recognized, if the direction of the face can be detected, the direction of the face is recognized, and if not, the direction of the body is recognized. You may recognize a plurality of these, or you may recognize the direction independently.

Subsequently, the image display control unit 130 is a functional unit for controlling the display of an image with respect to one or a plurality of connected image display devices 30. Here, the displayed image can be displayed at a plurality of display positions. The display position is determined by the display area that can be switched by one image display device 30, or is determined by switching the image display device to be displayed. That is, a plurality of display positions may be configured by combining the display area and the image display device.

Here, the image display device 30 is a device capable of displaying an image such as a display device such as a liquid crystal display or an organic EL display, or a projection device such as a projector. The image in the present embodiment is a concept including not only still images such as characters, figures, and photographs, but also moving images. In FIG. 2, the image display device 32 and the image display device 34 are connected to each other.

Here, the image display control method of the control device 10 using the image display device 30 will be described with reference to FIGS. 4 and 5. FIG. 4 is a diagram when the image display device 30 has a wide displayable area such as a projector.

That is, the area R30 is secured as a displayable area for the projector. This area R30 can be set in a place such as a wall surface or a floor surface, and any display area can be set as a display position as long as it is a displayable area. For example, when three areas such as the display area R30a, the display area R30b, and the display area R30c are set, the image is displayed in the display area R30a in the direction in which the user P faces.

The displayable area can be similarly realized by dividing the display screen into a plurality of areas, for example, in the case of a large liquid crystal display.

Further, in the present embodiment, as shown in FIG. 4, the display area corresponding to the display position is set in advance, but any coordinates may be used. That is, any position in the displayable area may be set as the display position by specifying the vertex coordinates, the size, and the like of the display area.

FIG. 5 is an example of a case where a plurality of image display devices and display areas are combined and set as display positions. For example, as the image display device 30, the image display devices 32 and 34, which are projectors, are connected, and the image display device 36, which is a liquid crystal display, is further connected.

Further, the image display device 32 can display in a plurality of display areas such as the display area R32a and the display area R32b, and the image display device 34 can display an image in the display area R34 as a display position. Further, the image can be displayed on the image display device 36 as well. That is, the image can be displayed at the four display positions of the display areas R32a, R32b, R34, and the image display device 36. This makes it possible to appropriately display the image at the display position in the direction in which the user P faces.

The storage unit 140 is a functional unit that stores various programs and various data necessary for the operation of the control device 10. The storage unit 140 is composed of, for example, a semiconductor memory, an HDD (Hard Disk Drive), or the like.

Further, the display position table 142 is stored in the storage unit 140. Here, an example of the display position table 142 is shown in FIG.

The display position table 142 is a table in which the characteristics of the subject (for example, the attribute of the human body in the present embodiment) and the display position are stored in association with each other. For example, when the human body attribute is "160 cm or more", the display position is R32a. Here, the human body attribute is information about the recognized human body. For example, it may be tall or physique (eg, "slender") as shown in this embodiment. Further, it may be information such as "male", "female", "children", "adults", or "wearing a hat". That is, the information may be recognizable by the control device 10 via the recognition unit 120 (recognition device 20).

Further, the display position table 142 may also store the display position. For example, the coordinates in the space are set, and the location where the display position in the space is provided is stored in the coordinates. As a result, for example, it is possible to determine the display position corresponding to the direction in which the user P is facing, and it is possible to specify the image display device 30 corresponding to the display position.

[1.3 Processing flow]
Subsequently, the flow of processing in this embodiment will be described. First, when the human body is detected (step S102; Yes), the human body recognition process is executed (step S104). In the present embodiment, the feature points corresponding to the joints and the like are detected by the human body recognition process, and the orientation of the human body and the like are recognized.

Subsequently, after each feature point is recognized, the characteristic determination process is executed (step S106). In the present embodiment, the attribute of the human body is determined as one of the characteristics, and the height is mainly determined. Since it is sufficient that the height can be finally determined, a device that can recognize only the height by, for example, an infrared sensor may be used.

Subsequently, the display position determination process is executed from the height determined by the characteristic determination process (step S108). The display position determination process determines the area in which the image is displayed. Then, the image is displayed in the determined display area (step S110).

Here, the display position determination process can determine the display position based on the height of the determined user (human body).

The human body recognition process (step S104) and the characteristic determination process (step S106) may be executed once at the timing when the user is detected, or the interrupt process may be performed by a predetermined timer. It may be executed at any time (for example, every 3 seconds or every 5 seconds).

[1.4 Application examples / effects]
For example, FIG. 8 will be described as an example. The image display device 32 can display an image on the display area R32a and the display area R32b. Here, the area may be switched by changing the area displayed by the image display device 32, or by physically moving the image display device 32 to switch the display area.

Here, as shown in FIG. 8A, when the user P1 enters the detection area, the height is determined to be L1. For example, when L1 is 170 cm, an image is displayed in the display area R32a. As a result, the image is displayed in the display area R32a corresponding to the position of the line of sight of the user P1, and the user can easily visually recognize the image.

Further, as shown in FIG. 8B, when the user P2 enters the detection area, the height is recognized as L2. For example, when L2 is 150 cm, an image is displayed in the display area R32b. As a result, the image is displayed in the display area R32b corresponding to the position of the line of sight of the user P2, and the user P2 can easily visually recognize the image.

As described above, according to the present embodiment, it is possible to change the display position of the image according to the human body attribute as the characteristic of the determined target person. This can solve the problem that, for example, a user with a short stature is often a child, and then it is difficult to see the image even if the image is displayed at a position that can be recognized by an adult.

Further, in the present embodiment, the recognition of the human body attribute (height) is described as two stages for convenience of explanation, but it may be further set to a plurality of stages. Further, when the display area is variable (for example, set by coordinates), it is possible to display the image at a more appropriate position by calculating the coordinates based on the height.

[2. Second Embodiment]
Subsequently, the second embodiment will be described. The second embodiment is an embodiment in which the display message is changed based on the human body attribute determined as the characteristic of the subject.

[2.1 Functional configuration]
First, the functional configuration in this embodiment will be described. Since the system configuration and the functional configuration in the present embodiment are the same as those in the first embodiment, detailed description thereof will be omitted. The difference from the first embodiment is that the data contents stored in the display position table 142 are different as shown in FIG.

FIG. 9 is an example of data stored in the display position table 142 in the present embodiment. As shown in FIG. 9, the display position (for example, "R32a") and the display message (for example, "Please prepare an admission ticket") correspond to the human body attribute (for example, "adult"). I remember it.

In addition, as the display message here, words such as sentences and words may be displayed, and signs such as symbols and arrows are also included. In addition, animation display, moving image display, and other information to be notified to the user are included.

Here, the attributes of "adult" and "child" may be determined by, for example, height. For example, a height of "160 cm or more" is determined as an "adult", and a height of "less than 160 cm" is determined as a "child". Further, by executing the face recognition process, it may be determined more accurately as "adult" or "child". Further, as in the first embodiment, the display position and the display message may be simply associated with the human body attribute such as height and stored.

[2.2 Processing flow]
Subsequently, FIG. 10 will explain the flow of processing in this embodiment. The process of FIG. 10 is a process in which FIG. 7 in the first embodiment is adapted to the present embodiment. Common processing is designated by a common reference numeral, and the description thereof will be omitted.

That is, by executing the processes up to step S108, the display position is determined based on the human body attribute of the user recognized by the human body recognition process. Here, the display message determination process in which the display message is determined is executed (step S202). Then, the process displayed in step S110 is executed based on the display position determined in step S108 and the display message determined in step S202.

[2.3 Application examples / effects]
An application example of this embodiment will be described with reference to FIG. FIG. 8A is a case where the user P1 is determined to be an adult. In this case, referring to the display position table 142 of FIG. 9 in the present embodiment, "Please prepare an admission ticket" is displayed as a display message at the display position of R32a.

Further, FIG. 8B shows a case where the user P2 is determined to be a child. In this case, referring to the display position table 142 of FIG. 9 in the present embodiment, "Enter with the person who is hogosha" is displayed as a display message at the display position of R32b.

As described above, according to the present embodiment, not only the image including the display message is displayed at an appropriate position according to the target person, but also the content of the displayed image (content of the display message) can be changed. It becomes.

This makes it possible to display a message according to the human body attribute. For example, in the case of a child, it is possible to convey the message more appropriately by notating the content of the message according to the child (for example, hiragana notation).

[3. Third Embodiment]
Subsequently, the third embodiment will be described. The third embodiment describes an embodiment in which a display message is displayed as needed in the second embodiment.

That is, in the operation flow of FIG. 10, the image (display message) is stored only when the display message corresponding to the characteristic (human body attribute) determined in step S106 is stored in the display position table 142, that is, when the condition is satisfied. Is output.

FIG. 11 shows the display position table 142 in the present embodiment. For example, in the case of "hat" as a human body attribute, a display position (for example, "R32") and a display message (for example, "please take off the hat") are stored.

In this case, the message is displayed only when a person wearing a hat (hat) is recognized as a human body attribute. When a plurality of human body attributes are stored, the corresponding messages may be combined and output as an image, or only high-priority messages may be output.

Further, a plurality of display positions may be specified. For example, as shown in FIG. 11, when it is determined that the person is less than 140 cm, a warning "I cannot ride this vehicle!" Is displayed. At this time, for example, by designating the display positions as R32a and R32b, it is possible to display the display message (image) at a plurality of display positions.

Further, display effects such as adding an effect to the screen (for example, the screen blinks or displaying large characters) or outputting a sound may be stored together.

[4. Fourth Embodiment]
Subsequently, the fourth embodiment will be described. The fourth embodiment is an embodiment of the second embodiment in which a motion, which is a movement of a person, is further recognized as a characteristic, and a display message or a display position is changed according to the motion.

The operation flow of this embodiment is shown in FIG. The operation flow of FIG. 12 is obtained by adding step S302 to the operation flow of the second embodiment shown in FIG. The same reference numerals are given to the common processes, and the description thereof will be omitted.

Here, the motion recognition process (step S302) is a process of recognizing the motion of the target person as motion information. For example, in the present embodiment, the moving speed and the moving direction of the target person are recognized as motion information. This is calculated based on the information recognized in the human body recognition process (step S104). The human body recognition process (step S104) and the motion recognition process (step S302) are processes that are repeatedly executed by a predetermined timer. For example, it is a process that is executed every 0.5 seconds or every 1 second, or is executed by executing an interrupt process at a timing when an operation is detected.

Then, the recognized human body attribute and motion information are determined as the characteristics of the target person (step S106).

FIG. 13 shows the display position table 142 in the present embodiment. For example, as an example of the characteristics, the movement speed (for example, "0 km / h to 5 km / h"), the display position (for example, "R32a"), and the display message (for example, "Welcome!"), Which are operation information, are displayed. It is associated and memorized.

As a result, for example, a message is displayed when approaching the display area R32a, but a message according to the speed (for example, a message that displays "Please enter without rushing because it is too fast" and calls attention). Is displayed or it is operating in the opposite direction (it recognizes that the moving direction is opposite because the moving speed is negative), so the exit message (for example, "Thank you") is displayed in a different display position. It is also possible to display it on (R34).

Further, as shown in FIG. 14, by storing a combination of human body attributes as a characteristic, for example, the message may be further displayed as a different message based on the human body attributes.

Specifically, if it is determined that the subject is "adult" or "moving speed is 5 km / h or more", "Please enter without rushing" is displayed. In addition, when it is determined that the subject is "children" or "moving speed is 5 km / h or more", "If you do it, it will not be dangerous!" Is displayed.

In this way, if the target person is a child, for example, if the message "Please enter without rushing" is displayed, the target child may not be able to read (or make an instant judgment). However, it is possible to display an appropriate message to the target person by displaying the message "If you do it, it will not be dangerous!" According to the characteristics of the determined target person.

[5. Fifth Embodiment]
Subsequently, the fifth embodiment will be described. A fifth embodiment will be described with respect to the first embodiment and the fourth embodiment in which the direction of the line of sight is recognized as a characteristic of the subject.

That is, in the motion recognition process (step S302) of FIG. 12, the direction in which the user is facing is recognized. Then, a message (image) is displayed in the display area in the direction in which the user is facing.

FIG. 15 shows the display position table 142 in the present embodiment. For example, as a characteristic, the image display device and the display area are stored in correspondence with each other in correspondence with the human body attribute of the target person and the direction of the line of sight of the target person. Although not shown in FIG. 15, display messages may be stored respectively.

For example, as shown in FIG. 16, if the human body attribute of the user P1 is less than 160 cm and the facing direction is the X1 direction, a message (image) is displayed in the display area R32b of the image display device 32. Further, if the human body attribute of the user P2 is 160 cm or more and the facing direction is the X3 direction, a message (image) is displayed on the image display device 34 (display area R34).

As described above, according to the present embodiment, the message is displayed at an appropriate position. Further, by further storing the message content, it becomes possible for the user to display an appropriate message at an appropriate position.

[6. 6th Embodiment]
Subsequently, the sixth embodiment will be described. The sixth embodiment is an embodiment when a plurality of users are detected. For example, FIG. 16 has been described using users P1 and P2, but this is an embodiment when they are in the same area. Here, the recognition device 20 and the recognition unit 120 can detect a plurality of users (humans).

In the present embodiment, each characteristic (for example, human body attribute, motion information) of the users P1 and P2 is detected. As a result, the message (image) viewed by the user P1 is displayed on R32a, and the message (image) viewed by the user P2 is displayed on R34. When the above-mentioned Kinect is used, up to 6 people can be detected at the same time.

In the operation flow of FIG. 17, first, when the human body is detected (step S102; Yes), the human body recognition process is executed (step S104). Here, if there is another human body to be detected, all human body recognition processing is performed (step S402; Yes → step S104).

When all the detected human bodies are recognized (step S402; No), the motion recognition process of all the detected human bodies is executed (step S404). Then, the characteristic determination process of all the subjects is executed based on the recognized human body and the motion information (step S406). Here, characteristics (human body attributes, motion information) are required for all the subjects.

Next, the display position is determined based on the determined characteristics (human body attribute, motion information) (step S108). An image (message) is displayed based on the determined display position (step S110). The process of displaying this image is performed for the detected human body (step S408; Yes). Then, when all the processes are completed, this process is terminated (step S408; No).

It should be noted that this process may be executed once or may be executed a plurality of times. That is, it may be repeatedly executed as a loop process, or may be periodically executed using a timer. Further, the screen displayed in step S110 may be a screen corresponding to the user.

Further, as the characteristic of the target person, only one process (for example, only the human body attribute) may be performed.

[7. Seventh Embodiment]
Subsequently, the seventh embodiment will be described. The above-described embodiment has described an embodiment in which the display position is changed, but the seventh embodiment describes an embodiment in which the means for outputting a message is changed.

Specifically, when a special characteristic (special attribute) is recognized in the characteristic determination process, the display position is not determined, and a notification means other than the display means such as a speaker is selected. Then, for example, instead of displaying in step S110 of FIG. 7, the message content is notified by the notification means.

For example, if the white cane is determined as a special attribute, it is determined that the user is visually impaired. In this case, the message is output by voice by the speaker instead of displaying (or at the same time).

[8. Modification example]
Although the embodiment of the present invention has been described in detail with reference to the drawings, the specific configuration is not limited to this embodiment, and the design and the like within a range not deviating from the gist of the present invention are also within the scope of claims. include.

In addition, although each of the above-described embodiments is described separately for convenience of explanation, it is needless to say that they may be operated in combination within a possible range.

Further, the program that operates in each device in the embodiment is a program that controls a CPU or the like (a program that causes a computer to function) so as to realize the functions of the above-described embodiment. Then, the information handled by these devices is temporarily stored in a temporary storage device (for example, RAM) at the time of processing, and then stored in various ROM or HDD storage devices, and is read and corrected by the CPU as necessary. -Writing is performed.

Here, as the recording medium for storing the program, a semiconductor medium (for example, ROM, a non-volatile memory card, etc.), an optical recording medium / magneto-optical recording medium (for example, a DVD (Digital Versatile Disc), MO (Magneto Optical, etc.)). It may be any of Disc), CD (Compact Disc), BD, etc.), magnetic recording medium (for example, magnetic tape, flexible disk, etc.) and the like. In addition, by executing the loaded program, not only the functions of the above-described embodiment are realized, but also by processing in collaboration with the operating system or other application programs based on the instructions of the program, the present invention In some cases, the function of the invention is realized.

Further, in the case of distribution to the market, the program can be stored and distributed in a portable recording medium, or transferred to a server computer connected via a network such as the Internet. In this case, it goes without saying that the storage device of the server is also included in the present invention.

Further, a part or all of each device in the above-described embodiment may be realized as an LSI (Large Scale Integration) which is typically an integrated circuit. Each functional block of each device may be individually chipped, or a part or all of them may be integrated into a chip. Further, the method of making an integrated circuit is not limited to the LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI appears due to advances in semiconductor technology, it is of course possible to use an integrated circuit based on this technology.

1: Image display system 10: Control device 110: Control unit 120: Recognition unit 130: Image display control unit 140: Storage unit 142: Display position table 20: Recognition device 30 to 36: Image display device

Claims (7)

Each joint of the subject is detected as a feature point, and the direction in which the subject is facing, which is recognized based on the feature point, is the orientation of the subject's body, the orientation of the subject's face, or the subject. A determination unit that determines as a characteristic of the subject based on either the height of the viewpoint of the subject and the direction of the line of sight of the subject specified from the angle of the face of the subject.
A control unit that controls the display of an image in the direction in which the target person is facing , which corresponds to the characteristics of the target person determined by the determination unit among a plurality of positions.
Equipped with
The direction in which the subject is facing has higher priority in the order of the direction of the subject's line of sight, the direction of the subject's face, and the direction of the subject's body.
The control unit is a control device, characterized in that, when displaying an image in the direction of the line of sight of the target person, the control unit displays the image at a position where the line of sight of the target person reaches . It also has a display unit consisting of a movable projector.
The control unit moves the display unit to change the position where the image is displayed.
The control device according to claim 1, wherein the control unit divides a displayable area into a plurality of areas and controls the display of the image in the area. The position where the line of sight of the subject reaches is the height of the viewpoint of the subject multiplied by the reciprocal of tan θ as the angle θ of the subject's face with respect to the vertical axis of the subject. The control device according to claim 1 or 2, wherein the control device is characterized. The characteristics of the subject include the moving speed of the subject, and the characteristics of the subject include the moving speed of the subject.
The image contains a display message and
The control unit is characterized in that it controls to select and display different display messages for the same position according to the movement speed of the target person determined by the determination unit. The control device according to any one of the above. It further has a recognition unit that recognizes the movement of the target person as movement information, and has a recognition unit.
The recognition unit recognizes the movement of the subject using thermography or infrared rays, and recognizes the movement of the subject.
The control device according to any one of claims 1 to 4, wherein the determination unit further determines the operation information as a characteristic of the target person. In an image display system including a plurality of image display devices, a recognition device, and a control device for displaying and controlling an image on the image display device.
The control device is
Each joint of the subject is detected as a feature point, and the direction in which the subject is facing, which is recognized based on the feature point, is the orientation of the subject's body, the orientation of the subject's face, or the subject. Based on either the height of the viewpoint of the subject and the direction of the line of sight of the subject specified from the angle of the subject's face, it is determined as a characteristic of the subject.
A control is performed to display an image on an image display device in a direction in which the target person is facing , which corresponds to the determined characteristic of the target person among a plurality of positions.
The orientation of the subject has higher priority in the order of the direction of the subject's line of sight, the orientation of the subject's face, and the orientation of the subject's body.
When displaying an image in the direction of the target person's line of sight, the image is displayed at a position where the target person's line of sight reaches.
An image display system characterized by that. On the computer
Each joint of the subject is detected as a feature point, and the direction in which the subject is facing, which is recognized based on the feature point, is the orientation of the subject's body, the orientation of the subject's face, or the subject. A determination function for determining as a characteristic of the subject based on either the height of the viewpoint of the subject and the direction of the line of sight of the subject specified from the angle of the face of the subject.
A control function that controls the display of an image in the direction in which the target person is facing , which corresponds to the characteristics of the target person determined by the determination function among a plurality of positions.
It is a program to realize
The direction in which the subject is facing has higher priority in the order of the direction of the subject's line of sight, the direction of the subject's face, and the direction of the subject's body.
The control function is a program characterized in that, when displaying an image in the direction of the line of sight of the target person, the image is displayed at a position where the line of sight of the target person reaches.

Images