JP2024032778A - Display device etc. - Google Patents

Abstract

The present invention provides a display device and the like that can provide high visibility of displayed images. A display device (1) includes a housing (10), an image display section (20), and a dimming member (30). The housing 10 is provided with an opening 5 for viewing an image in the first direction in a light-shielded internal space 100, and the image display section 20 is disposed in the internal space 100. The light attenuation member 30 is arranged closer to the first direction than the image display section 20 and spaced apart from the image display section 20 . [Selection diagram] Figure 6

Description

For example, the present invention relates to a display device capable of displaying images.

There is a display device that has an image display section and displays a two-dimensional image or a three-dimensional image on the image display section. For example, Patent Document 1 discloses a display device that displays a three-dimensional image on an image display section.

Japanese Patent Application Publication No. 2003-295113

However, in the display device described in Patent Document 1 etc., depending on the configuration of the display device, for example, the image light from the image display unit and external light may combine, resulting in a decrease in the visibility of the displayed image. The inventor of the present application has obtained the knowledge that there is.

One of the objects of the present invention is to provide a display device and the like that can obtain high visibility of displayed images.

The purpose of the present invention is not limited to this, and we intend to acquire rights through divisional applications, amendments, etc. for structures that aim to obtain effects from the parts of the structures disclosed in this specification, drawings, etc. For example, the present specification discloses a problem in which the phrase ``can be done'' is replaced with ``the problem is.'' Each issue is described as an independent entity, and we intend to acquire rights to the structure for solving each issue individually through divisional applications, amendments, etc. Even if the problem is implicitly understood from the description of the specification, the present applicant has the intention of claiming a part of the structure described in the specification in an amendment or divisional application. The company also discloses a structure that solves a problem that combines these independent problems, and has the intention to acquire the rights to it.

The object of the present invention can be achieved, for example, by the following embodiments (1) to (23).

(1) A display device for displaying an image, comprising: a housing provided with an opening for viewing the image in a first direction in a light-shielded interior space; and an image display section disposed in the interior space. The display device may further include a light attenuating member disposed closer to the first direction than the image display section and spaced apart from the image display section.

In this way, it is possible to suppress external light from entering the internal space of the casing, and it is also possible to suppress image light from the image display section from directly reaching the viewer's eyes. Therefore, it is possible to suppress the image light from the image display section and the outside light from making it difficult to see the image recognized in the internal space of the casing, and to obtain a display device that can obtain high visibility of the displayed image. can be provided.

(2) The light attenuation member may be disposed between the opening and the image display section.

In this way, a spatial region is formed inside the housing on the side where the image is viewed rather than the light attenuation member, so that the spatial region can be used for a predetermined purpose.

(3) The surface of the light attenuation member on the first direction side may be inclined with respect to the display surface of the image display section.

In this way, when the viewer views the image display section through the light attenuation member, it is possible to reduce the possibility that the viewer's face is reflected on the light attenuation member.

(4) The image display unit preferably displays a first image that is recognized as being at least partially located closer to the opening than the light attenuation member, as the image that is recognized as a three-dimensional image.

In this way, the viewer can feel as if he or she can touch an image that can be recognized as a three-dimensional image.

(5) The image display unit displays the first image and a second image on the first direction side or opposite to the first direction side from the first image as images recognized as three-dimensional images. It is preferable to selectively display any one of a plurality of images including a second image recognized to exist on the direction side.

In this way, it is possible to selectively display one of the plurality of images including the first image and the second image in different positions where the image recognized as a three-dimensional image by the viewer is recognized as existing. Therefore, the three-dimensional effect given to the viewer can be changed.

(6) The casing further includes an audio output unit provided in the casing, and the audio output unit is arranged in the first direction from the light attenuation member on a first surface facing the internal space of the casing. It is preferable that the light attenuating member be provided at a position where the distance from the light attenuation member is smaller than the distance from the opening.

In this way, since the sound output by the sound output section may be reflected by the light reduction member and transmitted to the viewer, it is possible for the viewer to hear the sound output from the image itself displayed on the image display section. It can make you feel like you can hear the voice. Furthermore, by arranging the audio output section in a position that is difficult for the viewer to see, the design of the display device can be improved.

(7) The upper end of the opening is provided further above the upper end of the display surface of the image display section, and the upper surface of the internal space extends from the upper end of the opening to the upper end of the display surface. It is preferable that it slopes downward toward the lower part.

In this way, the image displayed on the image display section can be viewed while looking down, making it easier for the viewer to view the image in a natural posture.

(8) The image display section preferably includes a light source and a display body that modulates light from the light source to display an image.

In an image display unit that modulates the light from a light source to display an image, the light from the light source leaks out and the position of the light source is recognized by the viewer, causing the image to appear in the internal space. There is a risk that the floating feeling of being in a room will be lost. The presence of the light attenuation member makes it difficult for the light leaking from the light source to be visually recognized, making it possible to give the image a more floating feeling.

(9) The upper end of the opening may protrude more toward the first direction than the lower end of the opening.

In this way, it is possible to prevent the visibility of the image on the image display section from being reduced due to reflection of light from above the display device by the light attenuation member.

(10) The casing has a cover part on the top surface of the casing, and has an accommodation space between the cover part and the top surface of the inner circumferential surface of the casing, and controls the display device. A portion may be disposed in the accommodation space.

In this way, maintenance of the control section related to the display device can be performed by removing the cover section provided on the top surface of the casing. Therefore, maintainability of the display device can be improved.

(11) A power supply unit is provided below the internal space of the casing, and a connection cord that electrically connects the power supply unit and the control unit is connected to an outer peripheral wall of the casing and the internal space. It is preferable that the wiring be routed through a gap area provided between the two.

In this way, the power supply section can be disposed in a less conspicuous position, and the center of gravity of the display device can be lowered, making it easier to stabilize its posture. Further, the connection cord connecting the power supply section and the control section can be wired so as not to come into contact with the viewer's eyes.

(12) The cover portion is attached to the main body portion of the casing at a plurality of attachment positions, and the cover portion and the main body portion are connected to the first direction side of the plurality of attachment positions. At the first mounting position, the display device is coupled using a first fixture at a position inside the outer peripheral wall of the casing, and at a position opposite to the first direction from the first mounting position of the display device. At the second attachment position on the two-direction side, it is preferable that the housing be coupled from the outside of the outer peripheral wall of the housing using a second fixture.

In this way, in the second mounting position that is difficult for viewers to see, the cover part and the main body part can be attached from the outside of the outer peripheral wall of the casing using the second fixing device that can be attached and detached from the outside of the outer peripheral wall. At the first mounting position, which is easily visible to the viewer, the cover part and the main body part are joined using the first fixing tool at a place that is difficult to see by the viewer, so that the display is not visible. The design of the device can be improved.

(13) The display device may further include an operation section provided in a lower part of the casing on a side in the first direction of the casing.

In this way, when the viewer operates the operation section, for example, the viewer's hand does not overlap the display image on the image display section, and the viewer operates the operation section while looking at the display image on the image display section. can be operated. Therefore, it becomes easier for the viewer to operate the operation unit, so that the operability of the display device can be improved.

(14) It is preferable that a plurality of the light attenuation members are detachably provided.

In this way, the brightness of the image displayed on the image display section can be adjusted without providing a separate adjustment member.

(15) A specific character is displayed on the image display section, and includes a motion detection means capable of detecting the viewer's motion, and an operation for controlling the motion of the specific character according to a detection result by the motion detection means. The display device may further include a control means.

In this way, when the viewer's motion is detected, the specific character moves in accordance with the detection result, making it possible to reproduce the communication between the viewer and the specific character.

(16) The motion detection means is preferably a behavior detection sensor capable of detecting the behavior of an object, and the behavior detection sensor is preferably arranged to detect a gesture performed in the internal space of the casing. .

In this way, the behavior detection sensor can detect the gesture of the viewer in the internal space of the housing, for example. Therefore, compared to the case where the behavior detection sensor is arranged on the outer peripheral surface of the housing, it is possible to suppress a decrease in the sensitivity of the behavior detection sensor.

(17) The behavior detection sensor may be disposed on an upper surface of the inner peripheral surface of the housing.

In this way, the behavior detection sensor is provided on the inner circumferential surface of the casing where light from the outside is less likely to enter, so it is possible to suppress a decrease in the sensitivity of the behavior detection sensor.

(18) The behavior detection sensor detects the gesture by emitting light and receiving the reflected light, and is provided in the direction in which the light is emitted, and the emitted light is received by the behavior detection sensor. The display device may further include a member that suppresses

In this way, it becomes difficult to receive reflected light from a portion of the casing that exists in the light emission direction of the behavior detection sensor, so it is possible to further suppress a decrease in the sensitivity of the behavior detection sensor.

(19) A smell sensor that detects a smell, a display output operation that displays on the image display section an image of a character making a movement according to the detection result of the smell sensor, and a display output operation that displays a sound according to the detection result of the smell sensor. It is preferable that the image display device further includes an operation control means for performing at least one of a voice output operation and a voice output operation that is output as a voice uttered by the character displayed on the image display section.

In this way, it is possible to reproduce the communication regarding smell between the character displayed on the image display section of the display device and the user. For example, when a smell is detected by a smell sensor, the system is controlled so that an audio output operation in which the character makes a sound such as "something smells" or an image display output operation in which the character performs an action to sniff the odor is performed. obtain. Therefore, more diverse communication can be achieved between the character and the user.

(20) The display output operation is an operation of displaying on the image display section an image of the character making a movement according to the type of detected odor, and the audio output operation is an operation according to the type of detected odor. It is preferable that the action outputs the corresponding sound as the sound uttered by the character.

In this way, communication regarding the type of smell can be reproduced between the character displayed on the image display section and the user. For example, when the smell of cigarettes is detected, a display output operation may be performed to display an image of a character making a smoke-like motion, or an audio output operation may be performed to utter words that concern the user's health. Furthermore, when the smell of a fragrance such as aroma oil is detected, an audio output operation that asks a question regarding the fragrance may be performed. By performing such control, the range of communication between the character displayed on the image display section and the user can be expanded, and the user's attachment to the character can be increased.

(21) Further comprising a voice detection means capable of detecting voice and a detection means capable of detecting the presence of a person in the detection target area, the voice detection means detecting the presence of a person in the detection target area. It is preferable to enable voice recognition for interacting with the character displayed on the image display section.

In this way, when the user interacts with the character displayed on the image display section, the user does not need to utter a trigger word to enable voice recognition, for example, and communication can occur more naturally. .

(22) a wind detection means for detecting wind; a display output operation for displaying on the image display section an image of a character moving in accordance with the detection result by the wind detection means; and a display output operation in accordance with the detection result by the wind detection sensor. It is preferable to further include an operation control means for performing at least one of a voice output operation of outputting the voice produced by the character displayed on the image display section as a voice uttered by the character.

In this way, it is possible to reproduce the communication regarding the wind applied to the display device between the character displayed on the image display section and the user. The wind may be generated artificially by the user, for example, by moving a body part such as waving a hand toward the display device, or by blowing on the user's breath.

(23) The operation control means may perform the display output operation or the audio output operation in response to the user's breath based on the detection result by the wind detection means.

In this way, it is possible to reproduce communication between the character displayed on the image display unit and the user according to the breath blown onto the display device.

According to the present invention, it is possible to provide a display device and the like that can obtain high visibility of displayed images.

Note that the effects of the invention of the present application are not limited to these, and the effects achieved from the parts of the configuration disclosed in the present specification, drawings, etc. are also disclosed, and the configuration that provides the effects can also be obtained through divisional applications, amendments, etc. Have the intention to acquire the rights. For example, in this specification, passages such as "can be done," "is possible," etc. are descriptions that clearly indicate the effect to be achieved, and even if there is no description such as "can be done," or "it is possible," the effect can be obtained. There is a part shown. Further, even without such a description, there are effects that can be understood from the configuration.

FIG. 1 is a perspective view showing a display device according to an example of the present invention. (A) A front view showing a display device according to an example of the present invention, and (B) a rear view showing a display device according to an example of the present invention. (A) A right side view showing a display device according to an example of the present invention, and (B) a left side view showing a display device according to an example of the present invention. (A) A plan view showing a display device according to an example of the present invention, and (B) a bottom view showing a display device according to an example of the present invention. FIG. 1 is an exploded perspective view showing a display device according to an example of the present invention. FIG. 2 is a cross-sectional view taken along line AA in FIG. 2(A). FIG. 3 is a perspective view illustrating the display device with the top cover section removed. It is a figure showing the back side of a top cover part. FIG. 2 is a control block diagram in a display device according to an example. FIG. 1 is a diagram illustrating an overview of a display device according to an example. FIG. 1 is a diagram illustrating an overview of a display device according to an example. FIG. 3 is a diagram illustrating a character according to an example. It is a diagram showing a state in which a 3D character is viewed stereoscopically. (A) A flowchart for reproducing communication regarding smells, and (B) a diagram showing a voice management table regarding smells. This is a flowchart for reproducing communication regarding the frequency of stay. (A) A flowchart for reproducing communication regarding the place of stay, and (B) a diagram showing a voice management table regarding the frequency of stay. (A) A flowchart for reproducing communication regarding the number of stays, and (B) a diagram showing a voice management table regarding the number of stays. (A) A flowchart for reproducing communication regarding stay time, and (B) a diagram showing a voice management table regarding stay time. (A) A flowchart for reproducing communication related to behavior patterns, and (B) a diagram showing a voice management table related to behavior patterns. It is a flowchart for reproducing operations related to suspicious person detection. (A) A diagram showing a state where the 3D character exists on the rear side of the light attenuation member, and (B) a diagram showing a state where the 3D character exists on the front side of the light attenuation member. FIG. 3 is a diagram illustrating an example of an image displayed on a display device according to an example. FIG. 3 is a diagram illustrating an example of an image displayed on a display device according to an example. FIG. 3 is a diagram illustrating an example of an image displayed on a display device according to an example. FIG. 3 is a diagram illustrating an example of an image displayed on a display device according to an example. FIG. 3 is a diagram illustrating an example of an image displayed on a display device according to an example. FIG. 3 is a diagram illustrating an example of an image displayed on a display device according to an example. FIG. 3 is a diagram illustrating an example of an image displayed on a display device according to an example. FIG. 3 is a diagram illustrating an example of an image displayed on a display device according to an example. FIG. 3 is a diagram illustrating an example of an image displayed on a display device according to an example. FIG. 3 is a diagram illustrating an example of an image displayed on a display device according to an example. FIG. 3 is a diagram illustrating an example of an image displayed on a display device according to an example. FIG. 3 is a diagram illustrating an example of an image displayed on a display device according to an example. FIG. 3 is a diagram illustrating an example of an image displayed on a display device according to an example. FIG. 3 is a diagram illustrating an example of an image displayed on a display device according to an example. FIG. 3 is a diagram illustrating an example of an image displayed on a display device according to an example.

[Schematic configuration of display device]
FIG. 1 is a perspective view showing a display device 1 according to an example of the present invention. FIG. 2(A) is a front view showing the display device 1 according to an example of the present invention, and FIG. 2(B) is a back view showing the display device 1 according to the example of the present invention. FIG. 3(A) is a right side view showing the display device 1 according to an example of the present invention, and FIG. 3(B) is a left side view showing the display device 1 according to the example of the present invention. FIG. 4(A) is a plan view showing the display device 1 according to an example of the present invention, and FIG. 4(B) is a bottom view showing the display device 1 according to the example of the present invention. FIG. 5 is an exploded perspective view showing a display device 1 according to an example of the present invention. FIG. 6 is a cross-sectional view taken along line AA in FIG. 2(A). Hereinafter, a schematic configuration of a display device 1 according to an example of the present invention will be described with reference to FIGS. 1 to 6.

In each figure, the left-right direction of the display device 1 is the X direction, and the direction from the left side to the right side of the display device 1 is the +X direction (positive direction of the X direction). Further, the front-rear direction (depth direction) of the display device 1 is defined as the Y direction, and the direction from the front side (front side) to the back side (rear side) of the display device 1 is defined as the +Y direction (positive direction in the Y direction). . Further, the vertical direction of the display device 1 is defined as the Z direction, and the direction from the bottom surface side to the top surface side of the display device 1 is defined as the +Z direction (positive direction of the Z direction).

The display device 1 is used for various purposes. For example, the display device 1 may be used for commercial purposes (for example, for attracting customers or advertising), for entertainment purposes (for entertaining people), for toys, or the like. For example, in the case of commercial or recreational use, the display device 1 may be installed in a public place such as a store or other commercial facility. The display device 1 is used at a venue such as a product or service exhibition to attract customers and entertain visitors by displaying an image in which a specific character introduces or advertises a product or service. Good. Alternatively, the display device 1 may be installed in various amusement facilities and used to entertain visitors to the amusement facilities. In the case of a toy, the display device 1 is installed at the user's home or the like. Further, when a three-dimensional image is displayed on the display device 1 as described later, it may be used to entertain the viewer by allowing the viewer to experience stereoscopic vision of the displayed object. The viewer is, for example, a user who uses the display device 1.

As shown in FIG. 5, the display device 1 includes a housing 10, an image display section 20 capable of displaying an image of a display target, and a light reduction member 30.

The housing 10 is a box-shaped member that forms the outer shape of the display device 1 . The housing 10 has a length (maximum length) ratio of approximately 1:1 in the width direction (also referred to as the left-right direction), the height direction (also referred to as the up-down direction), and the depth direction (also referred to as the front-back direction). :1. However, this length ratio is just an example, and at least a portion thereof may be different. The housing 10 has rounded corners. For example, when viewing the display device 1 from the front side, each of the four corners of the housing 10 is rounded. The housing 10 is preferably sized to accommodate the image display section 20 of a predetermined size (for example, 17 inch size) therein.

The housing 10 has an opening 5 on the front side of the display device 1 (−Y side in each figure). The front side of the display device 1 corresponds to the side where a viewer views the image displayed by the display device 1. The opening 5 is formed on the front side of the display device 1 in the internal space of the housing 10 . For example, the opening 5 is formed into a rectangular shape when viewed from the front side of the display device 1, as shown in FIG. 2(A). The housing 10 has an internal space 100. The internal space 100 is a space inside the housing 10 in which images are displayed. A portion of the internal space 100 other than the opening 5 is surrounded by a light-shielding member (see FIG. 6). External light does not enter the internal space 100 through the members that constitute the housing 10. Therefore, the entire casing 10 may be formed of a material that blocks external light, but the outer surface or the surface facing the internal space 100 may be covered with a material that blocks light. good. In FIG. 6, the internal space 100 is indicated by a chain double-dashed line, and two spatial regions 101 and 102 obtained by dividing the internal space 100 by the light attenuation member 30 are indicated by a chain double-dashed line. The spatial region 101 is a space on the back side of the light attenuation member 30. The space area 101 has a larger dimension in the height direction toward the back, and decreases as it moves toward the front. The spatial region 102 is a space on the front side of the light attenuation member 30. The spatial region 102 has a smaller dimension in the height direction toward the back, and increases as it moves toward the front. In this embodiment, the opening 5 is specified by a planar region that communicates the spatial region 101 with the external space. Therefore, the opening 5 may be read as an opening surface. The internal space 100 has a certain area in the depth direction (front-back direction) of the casing 10, and the casing 10 has a length in the depth direction toward the top end, as shown in the YZ cross section of FIG. is longer than the bottom edge. For example, the interior space 100 may be recognized by the viewer as a living space of a character displayed stereoscopically.

For example, the casing 10 is formed of a resin member or the like, and a dark-colored (e.g., black) rubber coating is applied to its surface (e.g., at least one of the outer circumferential surface and the inner circumferential surface). . Thereby, the configuration is such that light does not enter the internal space 100 of the housing 10 from any part other than the opening 5. Note that it is not essential that the interior space 100 be surrounded by a light-shielding member in all parts other than the opening 5, and it is only necessary that the interior space 100 be surrounded by a light-shielding member so that the interior space 100 is somewhat dark. . The housing 10 may be made of a material other than resin material, such as metal or other materials. Further, the color of the outer surface of the housing 10 does not matter, but it may be white or black, which gives off a sense of luxury or simplicity, for example. The surface of the casing 10 may be treated with a matte finish to give it a textured appearance.

Further, as shown in FIG. 5, the housing 10 includes a main body part 11, a top cover part 12, a placement part 13 for the dimming member 30, a bottom cover part 14, and a back cover part 15. ing. Note that each of the members 12 to 15, except for a portion of the top cover portion 12 (described later), is attached to the main body portion 11 using fixing devices such as screws.

Next, the image display section 20 will be explained. The image display section 20 is a display section that has a light source. An example of the image display section 20 is a liquid crystal display. In this case, the image display section 20 includes a backlight, which is an example of a light source, and a display body 28 (see FIG. 5) in which liquid crystal elements, which are examples of display elements, are two-dimensionally arranged. The light source is, for example, a white light source. A liquid crystal element modulates light from a backlight on a pixel-by-pixel basis. A liquid crystal element has, for example, a structure in which liquid crystal molecules are sandwiched between a pixel electrode provided for each pixel and a common electrode common to a plurality of pixels. The image display section 20 displays a color (multicolor) image based on three primary colors: red (R), green (G), and blue (B). In this embodiment, the image display unit 20 displays the image so that it is recognized as a three-dimensional image. The image display section 20 is a 17-inch liquid crystal display in this embodiment.

The image display unit 20 is preferably configured to be able to display a three-dimensional image of the display target, and may be a display capable of stereoscopic display with the naked eye. Further, it is preferable that the image display unit 20 is configured to be able to switch between a three-dimensional image and a two-dimensional image. For example, it is preferable that the image display section 20 displays an image of a display target such as a specific character (for example, a person or an animal). For example, the display of the humanoid character 1000 may be controlled on the image display unit 20 so that the viewer can see it stereoscopically as shown in FIG. 13. The character 1000 here is a character modeled after a historical figure, but it may also be a female character, an animal (for example, a cat) character, or any other character. The image display unit 20 may display various images without being limited thereto. Furthermore, in the following, a character that is stereoscopically displayed (an example of a displayed object) is also referred to as a "3D character" or the like. A 3D character is an example of a 3D object.

In this way, the display device 1 is preferably a device that can reproduce stereoscopic display with the naked eye. Such a display device 1 is also called, for example, an “autoscopic stereoscopic display device”.

Autostereoscopic display may be reproduced by using, for example, a lenticular lens type image display section 20. For example, the display surface 29 of the image display section 20 is provided with a lenticular lens in which a plurality of semi-cylindrical lenses are arranged, and the image display section 20 displays a plurality of image columns interlaced with respect to three-dimensional images. A group of image rows (also called lenticular images, etc.) formed by the combination is displayed. Then, when a viewer views the group of image rows from an appropriate position through a lenticular lens, the three-dimensional image appears stereoscopic due to an optical illusion caused by the parallax between both eyes.

As shown in FIG. 6 and the like, the image display unit 20 is arranged in the internal space 100 of the housing 10 so that the image can be viewed through the opening 5 provided on the front side of the display device 1. For example, the image display section 20 is arranged along the back surface (inner wall surface) of the inner peripheral surface of the housing 10 . In this embodiment, as shown in FIG. 6, the back surface of the inner peripheral surface of the casing 10 is provided approximately perpendicular to the bottom surface of the casing 10, and the image display section 20 is also provided on the inner peripheral surface of the casing 10. It is provided approximately perpendicular to the bottom surface.

Next, the light attenuation member 30 will be explained. The light attenuation member 30 is an optical member that reduces external light entering the internal space 100 through the opening 5. The light attenuation member 30 is a plate-shaped (including panel-shaped) or film-shaped member. Further, the light reduction member 30 can reduce the amount of light from the image display section 20 (for example, light from the backlight of the image display section 20). The light reduction member 30 is provided to maintain the interior space 100 in a dark state. The reason will be explained later. Further, the light attenuation member 30 suppresses the occurrence of reflection in which the viewer viewing the image through the opening 5 is reflected in the light attenuation member 30, and prevents components inside the interior space 100 from being visually recognized. It also contributes to making it more difficult. The light attenuation member 30 may be a member called a smoke panel, a smoke film, or the like. Since the light attenuation member 30 transmits at least the image light from the image display section 20 to the front side, it can be said to be an optically transparent member. Examples of the light attenuation member 30 include a dark panel member having a predetermined light transmittance (for example, about 6%). Note that the light attenuation member 30 is not limited to this, and may be, for example, a dark-colored film having a predetermined light transmittance attached to a colorless and transparent panel member. The light attenuation member 30 is a member of a dark color such as black, but may be of a blue or other color.

The light attenuation member 30 is arranged in the internal space 100 of the housing 10 on the front side of the image display section 20 with a space therebetween. In this embodiment, it is arranged between the opening 5 and the image display section 20 so as to have a spatial region 101 (FIG. 6) between the opening section 5 and the image display section 20 .

As described above, since the casing 10 has the light-shielded internal space 100, it is possible to suppress external light from entering the internal space 100 of the casing 10, and for example, the front side of the image display section 20 is Furthermore, by arranging the light attenuation member 30 apart from the image display section 20, the image light from the image display section 20 is suppressed from directly reaching the viewer's eyes. Therefore, it is possible to prevent the image recognized in the internal space 100 of the housing 10 from becoming difficult to see due to the combination of image light from the image display section 20 and external light, and it is possible to obtain high visibility of the displayed image. A display device 1 can be provided.

Further, since the light attenuation member 30 is disposed between the opening 5 and the image display unit 20, a spatial area (for example, a space area 102 (for example, a spatial area 102) (see FIG. 6)), the spatial region can be used for a predetermined purpose.

Here, if there is no light attenuation member 30 and the viewer views the image display section 20 itself on which the three-dimensional image of the display object is displayed, the light from the light source will leak out and the position of the light source will be is recognized by the viewer, so that the viewer can recognize that "the display target object is reflected on the image display section 20." As a result, it may not be possible to obtain a sufficient floating feeling as if the display object image is floating in the interior space 100.

On the other hand, when the light attenuation member 30 is provided as described above, the amount of image light emitted from the peripheral area of the display target in the image display unit 20 is suppressed by the light attenuation member 30, and the visual This makes it difficult for people to see the surrounding area. As a result, the viewer does not feel that the displayed object is reflected on the image display section 20, and can get the feeling that the displayed object is floating. Therefore, the visibility of the displayed image of the display target can be improved.

Furthermore, for example, when a viewer views the image display unit 20 itself on which a three-dimensional image of a display target is displayed, even though the display target appears three-dimensionally to the viewer, the display target is Blurred images may appear around objects. In such a case, the viewer may find it difficult to see the three-dimensional image of the displayed object.

On the other hand, when the light attenuation member 30 is provided as described above, the amount of light emitted from the image display section 20 is reduced by the light attenuation member 30, and the blur around the displayed object is reduced. The image light of the image is reduced by the light attenuation member 30. As a result, the blurred image becomes less visible to the viewer, and the displayed object becomes easier to recognize as a three-dimensional image. Furthermore, the provision of the light attenuation member 30 makes it difficult for the parts present in the interior space 100 to be visually recognized, so that it is less likely that the viewer will be disturbed by the visibility of such parts.

[Detailed configuration of each element]
Next, the detailed configuration of each element 10, 20, and 30 will be explained.

The light attenuation member 30 has a front surface inclined with respect to the vertical direction. In this embodiment, as shown in FIG. 6, the light attenuation member 30 is placed on the opening 5 side (the front side of the display device 1) from the upper end 31 to the lower end 32, for example, on the bottom surface of the housing 10. It is provided so as to be inclined at a predetermined angle (for example, an angle of about 50 degrees). For example, as shown in FIG. 5, the upper surface of the placement section 13 of the light attenuation member 30 is inclined at a predetermined angle with respect to the bottom surface of the housing 10, and the light attenuation member 30 are placed.

In this way, the optical path of the reflected light of the light incident on the light attenuation member 30 will exist in a direction different from the viewer's eyes (or face) side. Therefore, when a viewer views the image display section 20 through the light attenuation member 30, it is possible to prevent the viewer's face from being reflected in the light attenuation member 30. As long as this purpose can be achieved, the angle and direction of inclination of the light attenuation member 30 can be modified in various ways. Therefore, a display device 1 with higher visibility can be provided.

Furthermore, inside the housing 10, a space region 102 (see FIG. 6) into which a viewer's hand can be inserted can be provided closer to the opening 5 than the light attenuation member 30.

In the image display unit 20, the display is controlled such that at least a portion of the display object (for example, a part of the body of a specific character) that is viewed stereoscopically by the viewer is located at the position where the light reduction member 30 is arranged. It is good. In this way, by putting their hand into the spatial area 102 on the side of the opening 5 relative to the light attenuation member 30, the viewer can see the displayed object (for example, , a humanoid character 1000 (see FIG. 13), etc. (an example of the first image)). Therefore, for example, a display device that is highly entertaining can be provided.

Further, by providing the space area 102 as described above, it is possible to increase the degree of freedom in the arrangement position of a gesture sensor 63, etc., which will be described later.

As shown in FIG. 2(A) and FIG. 6, the housing 10 further includes a speaker 62 (an example of an audio output section). The speaker 62 is located on the front side of the light attenuation member 30 on the surface facing the internal space 100 of the housing 10 and at a position where the distance from the light attenuation member 30 is smaller than the distance from the opening 5. provided. In this embodiment, the speaker 62 is located on the upper surface 85 of the internal space 100 of the casing 10, and the light attenuation member 30 side (back side of the housing 10).

In this way, since the sound output by the speaker 62 may be reflected by the light reduction member 30 and transmitted to the viewer, it is possible for the viewer to understand, for example, the display target displayed on the image display unit 20. It can be made to feel like the sound is coming from the object itself (for example, a particular character). This effect is particularly effective when the display is controlled so that at least a part of the display object (for example, a part of the body of a specific character) that is stereoscopically viewed by the viewer is located at the position where the light reduction member 30 is arranged. It is valid. Furthermore, by arranging the speaker 62 in a position that is difficult for the viewer to see, the design of the display device 1 can be improved.

Further, as shown in FIG. 6, the upper end 51 of the opening 5 is provided above the upper end 21 of the image display section 20 (specifically, the display surface 29), and The upper surface 85 of the space 100 is provided so as to be inclined downward (in the -Z direction in FIG. 6) as it goes from the upper end 51 of the opening 5 toward the upper end 21. In this way, the image displayed on the image display section 20 can be viewed from a position higher than the upper end 21 of the image display section 20 while looking down. Therefore, it is possible to make it easier for the viewer to view the image in a natural posture. For example, the display device 1 is placed on a desk. On the front side (front side) of the display device 1, there is a viewer standing or sitting on a chair. It is assumed that the position of the viewer's eyes is higher than the top surface of the display device 1. Therefore, the viewer visually recognizes the display device 1 by looking down at the angle θ. The angle θ is the angle between the horizontal direction and the direction of the viewer's line of sight. The angle θ is assumed to be, for example, 15 degrees, but it varies depending on the usage situation of the display device 1. Based on this assumption of the angle θ, the inclination angle of the upper surface 85 is determined so that the viewer can see the entire display surface of the image display unit 20 or the entire display area of the image that the viewer should see. good. Furthermore, a relatively large space area 110 for a control unit, which will be described later, can be secured.

Further, as shown in FIG. 6, the upper end 51 of the opening 5 of the housing 10 is provided to protrude further toward the front side (an example of the first direction side) than the lower end 52 of the opening 5. This protruding part is also called an eave. In this way, it is possible to prevent the visibility of the image on the image display section 20 from decreasing due to light from above the display device 1 being reflected by the light reduction member 30.

As shown in FIGS. 1 and 6, a diagonal portion 84 is provided on the opening 5 side (front side) in the lower portion of the housing 10. The side portion 53 (see FIG. 3) of the opening 5 is inclined at a predetermined angle from the upper end 51 of the opening 5 toward the vicinity of the upper portion 88 of the oblique portion 84. For example, the side portion 53 of the opening 5 is provided so as to be inclined substantially perpendicular to the light attenuation member 30 .

Further, as shown in FIG. 6, the upper part 88 of the oblique part 84 is provided above the lower end part 22 of the image display part 20, and the lower surface 86 of the internal space 100 of the housing 10 is It is provided so as to be inclined downward as it goes from the upper part 88 of the diagonal part 84 to the lower end part 22 of the image display part 20 .

Here, regarding autostereoscopic display, the larger the so-called 3D feeling (three-dimensional effect) is, the smaller the displayed object stereoscopically viewed by the viewer may become. By tilting the lower surface 86 of the internal space 100 as described above, even when the 3D feeling is increased, the lower part of the display object to be displayed stereoscopically (for example, the feet of a specific character) can be It can be displayed near the upper portion 88 of the oblique portion 84 .

Further, as shown in FIG. 1, the display device 1 includes an operation unit 40 that receives operations on the display device 1. For example, the display device 1 includes an operation unit 41 for performing voice input (also referred to as instructing to start voice recognition), and an operation unit 41 for changing display settings regarding three-dimensional images (for example, setting values regarding parallax). Two operating units 40 are provided, including an operating unit 42 .

These operation parts 40 (41, 42) are provided in the lower part of the housing 10 on the front side (an example of the first direction side) of the housing 10 with respect to the opening 5. In detail, as shown in FIG. 1, these operation parts 40 (41, 42) are arranged in a diagonal part 84 provided on the opening 5 side in the lower part of the housing 10. In this way, when the viewer operates the operation unit 40, for example, the viewer's hand does not overlap the display image on the image display unit 20, and the viewer can view the display image on the image display unit 20. The operation unit 40 can be operated while Therefore, it becomes easier for the viewer to operate the operation unit 40, so that the operability of the display device 1 can be improved. Furthermore, since the operating section 40 is provided in the oblique section 84, a viewer can easily find the operating section 40.

Next, various sensors provided in the display device 1 will be explained.

The display device 1 further includes two motion detection units (an example of motion detection means capable of detecting the viewer's motion): a microphone 61 and a gesture sensor 63 (see FIG. 6). Note that it is not essential that both of these two members 61 and 63 be provided in the display device 1, and only one of the microphone 61 and the gesture sensor 63 can be used as a motion detection means in the display device 1. may be provided.

The microphone 61 is configured as a voice detection means capable of detecting the voice (for example, voice input operation) of a viewer such as a user. The microphone 61 is arranged, for example, in the above-mentioned diagonal portion 84 (see FIG. 1). Note that, for the voice input using the microphone 61, a voice recognition process is executed by, for example, a general control unit 73 (described later), and a voice recognition result expressed as, for example, text data is obtained. Note that the voice recognition process may be executed by a voice recognition device separately provided within the display device 1, or may be executed by an external server or the like that is separate from the display device 1.

The gesture sensor 63 (an example of an object detection sensor) is configured to be able to detect the behavior of an object. Examples of the gesture sensor 63 include an infrared sensor. The gesture sensor 63 has a light (for example, infrared light) emitting section and a light receiving section. Light emitted (also referred to as irradiation) from the emitting part of the gesture sensor 63 hits the object to be detected, is reflected, and is received by the light receiving part. Then, the gesture sensor 63 detects the behavior of the object to be detected based on the light (reflected light) received by the light receiving section. For example, if the same behavior as a specific behavior registered in advance in the gesture sensor 63 is detected, it is determined that the specific behavior has been performed by the viewer.

For example, the gesture sensor 63 has a function (also referred to as a wave detection function) that can detect whether or not the gesture is a predetermined behavior according to the movement of the hand. For example, when the viewer performs a waving motion ("Bye-bye") or a stroking motion ("Nade-nade") within the detection range of the gesture sensor 63, the gesture sensor 63 detects the wave motion and displays the "Bye-bye" or It is best to judge it as "Nadenade".

The gesture sensor 63 detects the position of the detection target in the direction of approach and departure from the gesture sensor 63 (for example, the Z direction in FIG. 2A) and the plane whose normal is the direction of approach and departure (for example, in FIG. In A), it is preferable that the position of the object to be detected on the XY plane) be detectable. For example, the plane may have four quadrants with the light receiving portion of the gesture sensor 63 as the origin. At this time, the X-axis is preferably set parallel to the left and right sides of the front surface of the housing 10.

As shown in FIG. 2(A), the gesture sensor 63 is installed at a substantially central position on the inner peripheral surface of the housing 10 in the left-right direction (X direction in FIG. 2(A)).

Further, as shown in FIG. 6, the gesture sensor 63 (specifically, the detection surface of the gesture sensor 63) is arranged on the inner peripheral surface of the housing 10 toward the inside of the housing 10. The detection direction of the gesture sensor 63 is directed inward of the housing 10. In this way, the gesture of the viewer is detected, for example, in the internal space 100 of the housing 10, in the spatial region 102 in this embodiment. Therefore, compared to the case where the gesture sensor 63 is arranged on the outer peripheral surface of the housing 10, it is possible to suppress a decrease in the sensitivity of the gesture sensor 63.

Further, when the gesture sensor 63 is arranged on the outer peripheral surface of the housing 10, for example, even if a person passes around the display device 1, the gesture sensor 63 may detect the behavior of the object to be detected. On the other hand, when the gesture sensor 63 is disposed on the inner peripheral surface of the housing 10 toward the inside of the housing 10, such erroneous detection can be prevented.

In particular, the gesture sensor 63 is preferably disposed on the upper surface 85 of the inner peripheral surface of the housing 10 toward the lower surface 86, as shown in FIG. In this way, the gesture sensor 63 is provided on a surface of the inner peripheral surface of the housing 10 into which light from the outside is difficult to enter. Therefore, compared to the case where the gesture sensor 63 is provided on a surface other than the top surface 85, a decrease in the sensitivity of the gesture sensor 63 can be further suppressed.

Furthermore, the gesture sensor 63 is located on the upper surface 85 of the inner circumferential surface of the housing 10 at a position opposite to the boundary position 202 (see FIG. 6) between the upper part 88 of the diagonal part 84 and the lower end part 32 of the dimming member 30. It would be good if it was placed. Then, the display may be controlled so that the feet of a specific character are displayed three-dimensionally on the surface of the light reduction member 30. In this way, the viewer can feel as if he or she can touch the entire (whole body) of the specific character that appears three-dimensionally and appears on the surface of the light attenuation member 30. Note that the display control as described above may be reproduced by, for example, changing the parallax setting value in a 3D application regarding three-dimensional display.

Further, on the inner circumferential surface of the housing 10, a region existing in the direction of light emitted by the gesture sensor 63, for example, a region 202 facing the arrangement position of the gesture sensor 63, includes a region 202 where the light emitted from the gesture sensor 63 (e.g. , infrared light) from being received by the gesture sensor 63. In this way, the amount of light reflected in or around the area 202 and received by the gesture sensor 63 is reduced, so it is possible to further suppress a decrease in the sensitivity of the gesture sensor 63. Examples of the "member that suppresses light reception by the gesture sensor 63" include a light absorbing member that can absorb light from the gesture sensor 63, a member that diffusely reflects light from the gesture sensor 63, and the like. Examples of the "light absorbing member" include black paper, a member coated with rubber, or a member made of an infrared absorbing material (an infrared reflection prevention sheet, etc.).

In the display device 1, a predetermined process according to the detection result by the motion detection means (for example, the microphone 61 and the gesture sensor 63) as described above is executed as a motion of a specific character displayed on the image display section 20. It is good. Such control may be performed, for example, by a control unit 70, which will be described later.

In this way, when the viewer's motion is detected, the specific character moves in accordance with the detection result, making it possible to reproduce the communication between the viewer and the specific character. A function that reproduces communication between a viewer and a specific character, or a function that reproduces pseudo communication between a viewer and a specific character, is referred to as a "communication function." Therefore, for example, a highly entertaining display device 1 can be provided.

For example, when a viewer utters "Bye-bye", the microphone 61 detects the viewer's voice "Bye-bye", and the control unit 70 determines the action of a specific character based on the voice recognition result "Bye-bye". Note that in the display device 1, specific words and actions corresponding to the specific words are registered in advance in a data table or the like in association with each other. Then, the control unit 70 executes processing corresponding to the determined operation. For example, at least one of an audio output process that causes the speaker 62 to output a voice saying "Bye-bye" and a display output process that displays and outputs a video of a specific character waving on the image display unit 20 is executed. be done. In this way, the viewer feels that the specific character displayed on the image display section 20 has responded to the voice uttered by the viewer. Therefore, for example, a highly entertaining display device 1 can be provided.

Further, for example, when the viewer puts his hand into the internal space 100 and waves his hand, the gesture sensor 63 detects the viewer's gesture "Bye-bye", and the control unit 70, based on the gesture detection result "Bye-bye", Determine the behavior of a particular character. Note that in the display device 1, a specific action and an action corresponding to the specific action are registered in advance in a data table or the like in association with each other. Then, the control unit 70 executes processing corresponding to the determined operation. For example, similar to the above, an audio output process that causes the speaker 62 to output a voice saying "Bye-bye," and a display output process that causes the image display unit 20 to display and output a video of a specific character waving. At least one of these is executed. In this way, the viewer feels that the specific character displayed on the image display section 20 has responded to the gesture he/she performed. Therefore, for example, a highly entertaining display device 1 can be provided.

The display device 1 further includes a human sensor 64 (see FIG. 6) that can detect the presence of a person within a predetermined range (for example, also referred to as a detection target space) with the display device 1 as a reference. . Examples of the human sensor 64 include a Doppler sensor (for example, a microwave Doppler sensor) that can detect the presence of an object based on the speed of the moving object and the presence or absence of a Doppler signal.

The human sensor 64 is arranged near the upper end 51 of the opening 5 toward the front side of the display device 1, and the detection target area of the human sensor 64 is provided on the front side of the display device 1. . In this way, the presence of a person in front of the display device 1 can be detected more reliably.

In detail, the human sensor 64 is arranged on the front side (front side) of an arrangement area 110 (see FIG. 7), which will be described later, at an interval that is sufficient to avoid contact with the outer circumferential wall 80 on the front side of the housing 10. ing.

In the display device 1, the display image on the image display unit 20 is controlled to be switched to a three-dimensional image on the condition that the human sensor 64 detects that a person has approached within the predetermined range. It would be good if it were done. Note that at other times, a two-dimensional image may be displayed, or the display image on the image display section 20 may be hidden. In this way, for example, while a person is in a position where the display target (for example, a specific character) on the image display unit 20 cannot be viewed stereoscopically, the three-dimensional image will not be displayed on the image display unit 20, and the display target When a person approaches an object within a range where it can be viewed stereoscopically, a three-dimensional image is displayed on the image display section 20. Therefore, it is possible to avoid surrounding people losing interest in the display device 1 due to viewing the display target from a position where the display target cannot be viewed stereoscopically.

[Configuration regarding arrangement space of control unit, etc.]
The display device 1 includes a control section 70. For example, the display device 1 includes a power supply control unit 71 that controls the power supply of the display device 1, a display control unit 72 that controls the display image displayed on the image display unit 20, and a control unit that controls these control units 71, 72, etc. It has a plurality of control units 70 including a control unit 73 and the like (see FIG. 7). Note that FIG. 7 is a perspective view illustrating the display device 1 with the top cover portion 12 removed. In this embodiment, each of the plurality of control units 70 may be mounted on a different board, but two or more control units 70 may be mounted on a single board. Accordingly, the arrangement position of each control section 70 may be changed as appropriate.

As shown in FIG. 5, the housing 10 has a top cover portion 12. As shown in FIG. Further, as shown in FIG. 6 , the housing 10 has a space region 110 between the upper surface cover portion 12 and the upper surface 85 of the inner circumferential surface of the housing 10 . Then, the control unit 70 is arranged in the spatial area 110. In this way, maintenance of the control section 70 that controls the display device 1 can be performed by removing the top cover section 12 provided on the top surface of the housing 10. Therefore, the maintainability of the display device 1 can be improved. Note that the spatial area 110 is also referred to as an accommodation space that accommodates the control unit 70 and the like.

While the control unit 70 is provided on the top surface of the housing 10, the power supply section 90 of the display device 1 is provided on the bottom surface 14 of the housing 10 (see FIG. 4(B)).

A connection cord 91 (see FIG. 7) that connects the power supply unit 90 and the control unit 70 (specifically, the power supply control unit 71) is connected to the outer circumferential wall 80 of the housing 10 (for example, the left side wall of the housing ) and the internal space 100 so as to pass through a gap region 89. In this way, the power supply unit 90 can be placed in an inconspicuous position, and the connection cord 91 that connects the power supply unit 90 and the control unit 70 can be connected from the outside and the internal space 100 side (opening 5 side). Wiring can be done so that it is not visible to the viewer. Therefore, the design of the display device 1 can be improved. Furthermore, since the power supply unit 90 is located below the internal space 100, the power supply unit 90 is placed in a less conspicuous position, and the center of gravity of the display device 1 can be lowered, making it easier to stabilize its posture. Can be done.

Furthermore, a ventilation hole 99 (see FIG. 4(B)) is provided on the bottom surface of the display device 1. The ventilation hole 99 communicates with the space below the interior space. Further, this space spatially communicates with a space region 110 above the internal space 100 via a gap region 89 where the connection cord 91 is wired. Therefore, even when the spatial region 110 is blocked by the top cover portion 12, the heat generated within the spatial region 100 can be released to the outside through the ventilation hole 99. Note that a vent for discharging heat generated in the spatial region 110 to the outside may be provided in the top cover portion 12, or a heat sink or other heat absorbing or heat dissipating member may be provided in the spatial region 110 or other locations. It's okay to be hit.

Further, the top cover portion 12 is attached to the main body portion 11 of the housing 10 at a plurality of attachment positions (for example, nine attachment positions 211 to 219). For example, the top cover part 12 is attached to the housing 10 at two mounting positions 211 and 212 on the front side (front side) of the housing 10, and at two mounting positions 213 and 214 on the right side of the housing 10. It is attached to the main body 11 of the housing 10 at two attachment positions 215 and 216 on the left side of the housing 10, and at three attachment positions 217 to 219 on the rear side (back side) of the housing 10.

For example, as shown in FIGS. 7 and 8, at the mounting positions 211 and 212 on the front side of the display device 1 (an example of a first mounting position) among the plurality of mounting positions 211 to 219, the top cover part 12 and the main body portion 11 of the housing 10 are coupled using a first fixture at a position inside the outer peripheral wall 80 of the housing 10. Examples of the "first fixture" include a fitting member 95 and a receiving member 96 configured to allow the fitting member 95 to be attached and removed. Note that FIG. 8 is a diagram showing the back surface of the top cover portion 12. As shown in FIG. For example, the fitting member 95 is formed in a convex shape, and the receiving member 96 is formed into which the convex fitting member 95 can be freely inserted.

On the other hand, at the mounting positions 217 to 219 (an example of a second mounting position) on the back side of the display device 1 (see FIG. 7) among the plurality of mounting positions 211 to 219, the main body 11 of the housing 10 and the top cover The portion 12 is coupled to the outer circumferential wall 80 of the housing 10 using a second fixture at a position outside the outer peripheral wall 80 of the housing 10 . An example of the "second fixture" is a screw 98 (see FIG. 8).

In this way, at the second mounting positions (for example, the mounting positions 217 to 219) that are difficult to see by the viewer, the outer circumferential wall 80 of the housing 10 can be The top cover portion 12 and the main body portion 11 are coupled from the outside. On the other hand, at the first mounting position (for example, mounting positions 211 and 212) that is easily visible to the viewer, the first fixture (for example, the fitting member 95 and the receiving member 96), the top cover portion 12 and the main body portion 11 are coupled. Therefore, the design of the display device 1 can be improved.

Further, the first fixture (for example, the fitting member 95 and the receiving member 96) is more easily attachable and detachable than the second fixture (for example, the screw 98), and by using the first fixture, the display device 1, maintainability can be improved. Furthermore, the top cover part 12 and the main body part 11 are not connected using the first fixing tool at all the mounting positions 211 to 219, but at some of the plurality of mounting positions 211 to 219. , the top cover portion 12 and the main body portion 11 are coupled using a second fixture. Therefore, while improving the maintainability of the display device 1, it is also possible to prevent the top cover portion 12 from being removed by a third party.

In the display device 1 according to the present embodiment, among the plurality of mounting positions 211 to 219, the mounting positions 213 to 216 on the side of the housing 10 are attached to the top surface as well as the mounting positions 211 and 212 on the front side. The cover portion 12 and the main body portion 11 of the housing 10 are coupled using a first fixture. However, the present invention is not limited to this, and with regard to the mounting positions 213 to 216 on the side side of the housing 10, similarly to the mounting positions 217 to 219 on the rear side, the top cover part 12 and the main body part 11 of the housing 10 are They may be joined using two fasteners.

[About the detailed configuration of the control unit]
FIG. 9 is a control block diagram of the control unit 70 included in the display device 1 according to one embodiment. As described above, the control section 70 includes the overall control section 73. The overall control unit 73 is a controller that includes a CPU 701 that functions as an arithmetic processing device that executes arithmetic processing, etc., and a memory that includes a RAM 703 used as a work area and a ROM 702 that stores control programs and the like. Various programs are stored in the ROM 702, and the overall control unit 73 reproduces various functions by executing these programs. For example, the ROM 702 stores a voice recognition application (an application having a voice recognition engine function) for reproducing the interaction between the user and the character, and the overall control unit 73 controls the various sensors 61, 63, 64. , 65, or the like, or based on input signals from the GPS receiver 60, etc., the dialogue between the user and the character is reproduced. The overall control unit 73 (an example of an operation control unit) also includes a display control circuit 704 (for example, a display control unit 72, etc.) that controls images displayed on the image display unit 20, and audio output from the speaker 62. and an audio control circuit 705 that controls the. Furthermore, the overall control unit 73 communicates with other devices (for example, an external voice recognition server (also referred to as a voice recognition engine) not shown, an external dialogue server (also referred to as a dialogue engine) not shown), etc. It has a communication control circuit 706 that controls communication. Further, the overall control unit 73 controls the power state of the display device 1 based on an input signal from the power supply control unit 71 that controls the power supply of the display device 1 .

[About the characters displayed on the display device]
Here, before explaining the control contents by the general control section 73 of the control section 70, characters that can be displayed on the image display section 20 of the display device 1 will be explained with reference to FIGS. 10 to 12.

FIG. 10 is a diagram illustrating an overview of the display device 1 according to an embodiment, and in detail is a diagram illustrating a state in which a 3D character 1100 is displayed on the display device 1. 3D character 1100 is a female character. The display device 1 (specifically, the general control unit 73) further displays a stage image 2100 representing a stage below the 3D character 1100. The stage image 2100 here shows a magic circle. The viewer who sees this display can get the impression that the 3D character 1100 is standing on the stage. The colors of the 3D character 1100 and the stage image 2100 are not particularly limited. For example, the skin of the 3D character 1100 is flesh-colored. The hair color and upper body costume of the 3D character 1100 are a relatively light blue color (e.g., light blue), and the accessories on the knees are a darker blue color (e.g., blue), skirt, and shoes. is white. The stage image 2100 is a relatively dark blue color (for example, dark light blue). Note that FIG. 10 and FIG. 11, which will be described below, show views looking down into the inside of the casing 10 from slightly above the front of the display device 1.

FIG. 11 is a diagram illustrating an overview of the display device 1 according to an embodiment, and in detail is a diagram showing a state in which a 3D character 1200 is displayed on the display device 1. The 3D character 1200 is a cat character. In the case shown in FIG. 11B, the display device 1 displays a 3D character 1200 and a stage image 2200 indicating a stage below the 3D character 1200. In the stage image 2200, a character string "Yupiteru" and a character string indicating "Juno" (referred to as "Yuno"), which is the name of the 3D character 1200, are alternately arranged along the outer periphery of a circular stage. It is written in . The colors of the 3D character 1200 and the stage image 2200 are not particularly limited.

Here, the 3D character 1200 and the stage image 2200 will be described in more detail with reference to FIG. 12. The 3D character 1200 is roughly divided into a character body 1210 and a collar 1220. The character body 1210 is the cat character itself. The character main body 1210 includes parts of the body shown in white, such as the area between the eyebrows, around the nose and mouth, the abdomen, and the front side of the legs. Among the body parts of the character body 1210, the parts shown in light gray are relatively light brownish colors (for example, ocher), such as the parts above and beside the eyes of the face, This applies to the upper part of the torso and parts other than the front side of the legs. Among the body parts of the character body 1210, the parts shown in darker gray are in a darker brown color (for example, brown), and are shown by thin lines on the face, head, torso, and legs, for example. This corresponds to the area with the striped pattern. The collar 1220 refers to a collar displayed at the neck position of the character body 1210. Collar 1220 has a red color (for example, red). A tag 1221 is attached to the collar 1220 below the face of the character body 1210. The tag 1221 is circular and has a predetermined sign written on it. The sign is a sign with a "●" (circle with a filled-in inside) placed below a "V"-shaped symbol, each of which is written in a red color (for example, red). . The mark written on the tag 1221 may function as a trademark indicating the origin of the display device 1. The stage image 2200 as a whole is a brown color, the circle and character string are a relatively dark brown color (for example, brown), and the image imitating smoke inside the circle is a lighter brown color (for example, yellow ocher).

In FIGS. 10 to 12, the backgrounds of the 3D characters 1100 and 1200 are shown in black, but the backgrounds are not limited to pure black, and may also be relatively dark backgrounds (for example, black or other dark colors). good.

Note that the characters shown in FIGS. 10 to 12 are examples. When the display device 1 displays a humanoid character, the display device 1 is not limited to displaying a female character, and may display a male character (for example, character 1000 (see FIG. 13)). The display device 1 displays characters of real people (e.g., family members), people who actually existed in the past (e.g., historical figures), and fictional characters (e.g., characters appearing in works of fiction such as manga and anime). etc.) may be displayed. When displaying non-humanoid animal characters, the display device 1 is not limited to cat characters, but also animal characters that can be kept at home such as dogs and hamsters, and other animal characters such as horses and cows. Also, any of the fictional animal characters (for example, characters appearing in manga, anime, and other works of fiction) may be displayed. Further, the display device 1 may display another character having a collar 1220.

The display device 1 (specifically, the general control unit 73) moves the body parts of the character and outputs sounds imitating the character's speech based on the communication function. The communication function is a function that reproduces communication between the viewer and the character, or a function that reproduces pseudo communication. In the communication function, the character moves in response to the viewer's behavior (for example, speech or body movements). For example, the 3D character 1100 performs actions that reproduce actions that humans normally perform, such as moving the entire body, such as dancing, and changing facial expressions (for example, expressing emotions of happiness, anger, sadness, and happiness). For example, the 3D character 1200 moves in a manner that reproduces actions that animals normally perform (eg, yawning, moving its tail, walking, etc.). Further, the display device 1 outputs a singing sound as if the 3D character 1100 is singing, or outputs a sound related to a dialogue with a viewer, for example, in accordance with the movement of the 3D character 1100. For example, the display device 1 outputs a sound representing a cat's meow or a sound related to a dialogue with a viewer in accordance with the movement of the 3D character 1200. The output of such video and audio is not limited to the communication function, and may be performed using various functions that the display device 1 has.

Note that the interaction with the user in the communication function is reproduced, for example, by a voice recognition application stored in the ROM 702 of the general control unit 73, and the external voice recognition server and dialogue server described above. For example, when the operation unit 40 is pressed by the user, the overall control unit 73 starts a voice recognition application. This enables voice recognition for interacting with the character. Then, the voice uttered by the user (also referred to as user voice) is transmitted from the communication control circuit 706 of the central control unit 73 to the voice recognition server, and the voice recognition server executes voice recognition processing on the user voice to create a voice. The recognition result is output. In the dialogue server, sounds (also referred to as character sounds) emitted by characters displayed on the image display section 20 (for example, 3D character 1100) are registered in advance in association with each other for each character string that can be input. Then, the voice recognition result (for example, the voice recognition result indicated by a character string) by the voice recognition server is input to the dialogue server, and the character voice corresponding to the voice recognition result is transmitted from the dialogue server to the display device 1. . Then, the overall control unit 73 outputs the character voice received from the dialogue server from the speaker 61 of the display device 1. In this way, the response process to the user's voice is executed, and the interaction between the user and the character is reproduced.

<About the communication function related to 3D character 1100>
Below, various controls for reproducing communication between the 3D character 1100 and the user will be explained in order with reference to FIGS. 14 to 20.

<1. About the communication function related to smell>
For example, an odor sensor 65 (see FIG. 9) that detects odor is provided in the display device 1, and the general control unit 73 outputs a voice according to the detection result by the odor sensor 65 as the character voice of the 3D character 1100. It is a good idea to perform an output operation. The odor sensor 65 may, for example, output a signal that changes depending on the intensity of a certain odor, or output a signal that changes depending on the component contained in the odor (smell component). The odor sensor 65 outputs a signal that changes depending on the type of odor, for example. The odor sensor 65 is configured to be able to detect the concentration of specific odor components (tar, ammonia, alcohol, carbon dioxide, etc.) using, for example, a deodorizing filter. In this way, the general control unit 73 can reproduce the communication regarding smell between the character displayed on the image display unit 20 of the display device 1 and the user, and the communication between the character and the user can be improved. It is possible to reproduce various types of communication. Note that the odor sensor 65 is preferably provided on the outer peripheral surface of the display device 1, for example, on the oblique portion 84 of the housing 10 of the display device 1.

For example, the overall control unit 73 may perform an audio output operation that outputs audio according to the type of detected odor as the character audio of the 3D character 1100. Note that a single sensor capable of identifying multiple types of odor components may be configured as an odor sensor, and a plurality of sensors capable of discriminating different types of odor components may be configured as an odor sensor. good.

FIG. 14(A) is a flowchart for reproducing communication regarding smells, and FIG. 14(B) is a diagram showing a voice management table regarding smells (also referred to as a voice management table). The voice management table is stored, for example, in the overall control unit 73 of the display device 1 or in the dialogue server. As shown in FIG. 14(B), the audio management table lists odors that mainly contain the odor components for each type of odor component (also referred to as odorant substance) that can be detected by the odor sensor 65. The type and the voice emitted by the 3D character 1100 (referred to as character voice) are registered in advance. For example, in the voice management table, cigarette odor, which mainly contains tar, is registered in association with tar, and when cigarette odor is detected, a character voice saying ``Smoking too much is not good.'' Words that express concern for the user's health, such as "", are registered.

First, in step S11, the overall control unit 73 determines whether an odor component has been detected. For example, when the concentration of an odor component detected by the odor sensor 65 exceeds a predetermined threshold value (reference value) regarding a specific odor, the overall control unit 73 determines that the odor component has been detected. In step S12, the overall control unit 73 determines the type of odor registered in the audio management table in association with the detected odor component. For example, if tar is detected at a concentration exceeding a predetermined threshold, it is determined that cigarette odor has been detected. Then, the overall control unit 73 outputs a character voice from the speaker 62 according to the type of detected odor. For example, when it is determined that a cigarette odor has been detected, the general control unit 73 outputs a voice that expresses concern for the user's health (here, "Smoking too much cigarettes is not good") as a character voice. Execute an output operation. Note that other examples include the following. For example, if the concentration of a specific main component contained in a fragrance such as aroma oil or food exceeds a predetermined reference value, the integrated control unit 73 determines that the odor of the fragrance or food has been detected, and the source of the odor is detected. A voice asking a question about something is output as a character voice. Additionally, if alcohol exceeding a predetermined standard value is detected, the general control unit 73 determines that an alcohol odor has been detected, and issues messages such as, "You taste like alcohol," or "You've been drinking again. Don't worry about it." etc. is output as the character voice of the 3D character 1100. Further, when a component of bad breath (for example, hydrogen sulfide, methyl mercaptan, dimer sulfide, etc.) exceeding a predetermined standard value is detected, the general control unit 73 determines that bad breath has been detected and says, ``I have a bit of bad breath.'' , ``Are you brushing your teeth?'' and ``Apply alveolar pyorrhea.'' are output as character voices of the 3D character 1100. Furthermore, when an odor component contained in gas fuel such as tert-butyl mercaptan, dimethyl sulfide, or tetrahydrothiophene is detected, the general control unit 73 determines that the odor of gas fuel has been detected and says, ``It smells like gas. !” is output as the character voice of the 3D character 1100.

In this way, the overall control unit 73 preferably executes control to output a sound according to the type of detected odor as the character sound of the 3D character 1100. By performing such control, the range of communication between the character displayed on the image display section 20 and the user can be expanded, and the user's attachment to the character can be increased.

The display device 1 is not limited to one that specifies the audio to be output based on the audio management table. For example, the display device 1 may specify the audio to be output according to a scenario in which the content of the character's utterance changes based on the content of past dialogues (history of dialogues). This scenario may define a branching scenario in which data specifying voices output by characters is managed in a tree structure.

Here, an audio output operation of a voice according to a detection result by the smell sensor 65 is illustrated, but the present invention is not limited to this; A display output operation for displaying the video on the image display section 20 may also be performed. For example, similar to the audio management table, a display management table (not shown) is provided in advance, and the overall control unit 73 displays an image of the 3D character 1100 making a movement according to the type of detected odor on the image display unit 20. It is recommended to perform a display output operation to display the The display management table may be, for example, a table in which data defining the 3D character 1100 is registered in association with odor components and odor types. The data specifying the 3D character 1100 may be data indicating an image of the 3D character 1100 to be displayed, or may be data specifying the content of the movement of the 3D character 1100. For example, when some odor component is detected, the overall control unit 73 may display an image of the 3D character 1100 performing a sniffing motion on the image display unit 20. Further, when the general control unit 73 determines that a cigarette odor is detected, for example, it is preferable that the image display unit 20 displays an image in which the 3D character 1100 performs a motion similar to that of smoking. Note that at this time, the overall control unit 73 may display an image simulating smoke on the image display unit 20. Furthermore, the overall control unit 73 may perform both the audio output operation and the display output operation as described above. For example, when some odor component is detected by the odor sensor 65, the general control unit 73 displays an image of the 3D character 1100 performing a sniffing motion on the image display unit 20, and displays a message such as "something smells". The sound may be output from the speaker 62 as the character sound of the 3D character 1100.

Furthermore, the overall control unit 73 may control the reaction of the 3D character 1100 to change depending on the concentration (also referred to as detection intensity) of the odor component detected by the odor sensor 65. For example, the general control unit 73 may display images of a plurality of movements provided in stages according to the concentration of odor components (for example, "make a grimace (make a disgusted expression)", "break into a cold sweat", It is preferable to selectively display one of the words "to turn pale" and "to faint", etc.

The display device 1 uses, for example, a smoke sensor that detects smoke, a camera image (for example, an image taken by the photographing unit 227), and a thermo camera image as a method for distinguishing between cigarette odor and odors other than cigarette odor. It may be possible to detect that the user is smoking in combination with another sensor.

When the general control unit 73 detects that the user is smoking, it superimposes on the 3D character 1100 (in front of the 3D character 1100) an image that imitates smoke (smoke appearing in thick slivers). You may also display a video that reproduces the At this time, the general control unit 73 may push the face of the 3D character 1100 forward, close up the face, or make the 3D character 1100 look disgusted. The overall control unit 73 may display a display that changes the degree to which the 3D character 1100 dislikes the user, depending on the degree of intimacy that is the degree of intimacy between the user and the 3D character 1100. For example, if the degree of intimacy is above a predetermined value, the general control unit 73 makes the 3D character 1100 have an expression that says I love you and will forgive you, and if it is less than the predetermined value, the 3D character 1100 has an unpleasant expression. That is, to make it . The overall control unit 73 may, for example, specify the degree of familiarity according to the usage history of the display device 1 by the user (for example, past usage time and past conversation content). The algorithm for determining intimacy is not limited to this.

<2. Regarding the communication function based on user location information>
Further, for example, the display device 1 may include a GPS (Global Positioning System) receiver 60 (see FIG. 9), and the following control may be executed based on the user's position information. Note that here, it is assumed that the display device 1 is a portable type. Then, for example, the overall control unit 73 acquires the position information of the display device 1 carried by the user (portable) as the user's own position information based on the signal from the GPS receiver 60, and the acquired position information It is recommended to perform the following control based on the following.

For example, it may be controlled so that a voice corresponding to the frequency of stays (also referred to as visit frequency) of the user at a location specified based on the user's location information is output as the character voice. FIG. 15 is a flowchart for reproducing communication regarding the frequency of stay.

For example, in step S21, the overall control unit 73 determines whether the user's location information has been received from the GPS receiver 60. When the user's location information is received, in step S22, the central control unit 73 determines that the frequency of stays at which the user stayed at the location specified based on the user's location information is equal to or greater than a predetermined value (for example, "2"). Determine whether or not. Note that the stay frequency is the number of times the user stayed at one place during a predetermined period (for example, one day or one week). For example, the overall control unit 73 uses a network or the like to search and specify the user's place of stay based on the location information acquired from the GPS receiver 60 (for example, the user's current location information). Then, the overall control unit 73 calculates the frequency of stay of the user based on the number of times the user stayed at the specified location, and determines whether the frequency of stay of the user is equal to or higher than a predetermined value. For example, if the frequency of stay of the user is equal to or higher than the predetermined value, in step S23, the overall control unit 73 controls the speaker 62 to output a predetermined character voice registered in advance regarding the frequency of stay of the user. For example, if the user goes to the same place twice on the same day, the general control unit 73 determines that the user's frequency of stay is equal to or higher than a predetermined value, and outputs a character voice such as "Oh, I went there a while ago." Output.

Further, it is preferable that the overall control unit 73 outputs, as the character voice of the 3D character 1100, a voice corresponding to the location specified based on the acquired position information. FIG. 16(A) is a flowchart for reproducing communication regarding the place of stay, and FIG. 16(B) is a diagram showing a voice management table of character voices regarding the place of stay.

For example, in step S31, the overall control unit 73 determines whether the user's location information has been received from the GPS receiver 60. When the user's location information is received, in step S32, the overall control unit 73 uses a network or the like to search and specify the user's place of stay based on the user's location information. Then, in step S33, the overall control unit 73 outputs a character voice corresponding to the specified location from the speaker 62 based on the voice management table of FIG. 16(B). For example, when the user goes to the supermarket, the general control unit 73 generates a character voice such as "What are you going to make for dinner tonight?" or when the user goes to the hospital, the voice prompts "Are you okay? Are you feeling unwell?" Outputs character voices such as. Further, the overall control unit 73 outputs a character voice such as "You had a lot of fun" when the user goes to an amusement park, for example.

Further, the general control unit 73 outputs a sound corresponding to the number of stays (also referred to as the number of visits) of the user at the specified location based on the acquired location information as the character sound of the 3D character 1100. Good to control. FIG. 17(A) is a flowchart for reproducing communication regarding the number of stays, and FIG. 17(B) is a diagram showing a voice management table of character voices regarding the number of stays.

Steps S41 and S42 in FIG. 17(A) are the same as steps S31 and S32 in FIG. 16(A), so a description thereof will be omitted. In step S43, the overall control unit 73 obtains the number of times the user has stayed at the location specified in step S42. Then, in step S44, the overall control unit 73 outputs a character voice from the speaker 62 according to the number of times the user has stayed, based on the voice management table of FIG. 17(B). For example, when the user goes to a certain game center for the first time, the general control unit 73 outputs a character voice such as "That game was fun." Then, when the user goes to the certain game center again, the general control unit 73 outputs a character voice such as "I wanted to go again." Furthermore, when the user has visited a particular game center a predetermined number of times or more (for example, 10 times or more), the general control unit 73 outputs a character voice such as "Are you going to play the game again?"

Further, it is preferable that the overall control unit 73 outputs, as the character voice of the 3D character 1100, a voice corresponding to the user's stay time at the location specified based on the acquired location information. FIG. 18(A) is a flowchart for reproducing communication regarding stay time, and FIG. 18(B) is a diagram showing a voice management table of character voices regarding stay time.

Steps S51 and S52 in FIG. 18(A) are the same as steps S31 and S32 in FIG. 16(A), so a description thereof will be omitted. In step S53, the overall control unit 73 acquires the user's stay time at the location specified in step S52. Then, in step S54, the overall control unit 73 outputs a character voice corresponding to the user's stay time from the speaker 62 based on the voice management table of FIG. 18(B). For example, when the user's stay at the convenience store is less than 5 minutes, the general control unit 73 outputs a character voice such as "That was early. I'm glad I waited." Further, when the user's stay time at the convenience store is 5 minutes or more and less than 10 minutes (5 to 10 minutes), the overall control unit 73 outputs a character voice such as "What did you buy?". Further, when the user's stay time at the convenience store exceeds 10 minutes, the general control unit 73 outputs a character voice such as "You're late. I was worried."

The overall control unit 73 may perform the above-described control based on the user's position information acquired using the GPS receiver 60 or the like. In this way, the user can feel that the character has responded in accordance with his or her actions, and the user's attachment to the character increases.

Note that although the portable display device 1 is illustrated above, the display device 1 may be a stationary display device 1, for example. For example, the overall control unit 73 (specifically, the communication control circuit 706) communicates with a user's smartphone (smartphone equipped with a GPS receiver), etc., and communicates with the user's location information (smartphone that the user owns) while out and about. location information). Then, when the user communicates with the 3D character 1100 after returning home, etc., it is preferable that the overall control unit 73 performs control so that the above operations are executed. Note that the content of the character's voice and movement at this time may be changed as appropriate.

<3. About the communication function regarding user behavior patterns>
Further, when it is determined that the user's behavior pattern matches a predetermined behavior pattern, control may be performed such that a voice corresponding to the predetermined behavior pattern is output as the character voice of the 3D character 1100. FIG. 19(A) is a flowchart for reproducing communication regarding behavior patterns, and FIG. 19(B) is a diagram showing a voice management table of character voices regarding behavior patterns.

For example, in the general control unit 73, the days of the week (for example, Monday to Friday) that the user works, the time of work (for example, 8:30), and the specific route that the user uses when going to work are set as a "behavior pattern when going to work". Registered in advance by a user or the like. For example, when the user's location information is received from the GPS receiver 60 (step S61), the overall control unit 73 determines whether the user's behavior pattern matches a predetermined behavior pattern based on the user's location information. It is determined whether or not (step S62). For example, if the user passes through a specific route at 8:30 on Tuesday, the overall control unit 73 determines that the user's behavior pattern matches the "behavior pattern when going to work." Then, in step S63, the overall control unit 73 uses the voice management table shown in FIG. ”) is output from the speaker 62 as the character voice of the 3D character 1100. In this way, the user's attachment to the character can be increased by having the character respond in accordance with the user's actions. Note that it is not essential that a predetermined behavior pattern (for example, a behavior pattern when going to work) is registered in advance by the user; for example, the overall control unit 73 has a learning function and can learn the user's behavior pattern. By doing so, a predetermined behavior pattern may be registered.

<4. About the communication function related to suspicious person detection>
Furthermore, when it is determined that the person detected in the detection target space is a suspicious person, a predetermined action may be performed. Then, when the user of the display device 1 is detected after the predetermined operation is executed, the sound related to the detection of a suspicious person may be output as the character sound of the 3D character 1100. FIG. 20 is a flowchart for reproducing operations related to suspicious person detection.

For example, in the display device 1, a photographing unit (for example, a camera) (not shown) for photographing a viewer (user, etc.) is provided on the front side of the display device 1. It is preferable that a sensor having a sensor) is used as a detection means for detecting the presence of a person in a detection target space. The "detection target space" includes, for example, the viewing angle range (shootable range) of the imaging unit in the space where the display device 1 is placed (for example, the user's home). The photographing unit includes, for example, a lens and an image sensor (for example, a CCD or CMOS), and photographs a multicolor image. The lens of the photographing unit is provided at a position where it can photograph the viewer (particularly the face). For example, the lens of the photographing unit is provided near the center of the upper end portion 51 in the width direction of the display device 1 . The photographing section outputs image signals of each color component of R, G, and B to the control section 70, for example. The overall control unit 73 processes this image signal to generate a photographed image.

The overall control unit 73 monitors the detection target space using the imaging unit (step S71). Then, when the presence of a person is detected in the detection target space, the overall control unit 73 performs user authentication such as face authentication in step S72, and in step S73, the detected person is a registered user of the display device 1. Determine whether or not. For example, if the overall control unit 73 determines that the person photographed by the photographing unit is a registered user of the display device 1, the central control unit 73 determines that the person is not a suspicious person. On the other hand, if the person photographed by the photographing unit is determined to be an unregistered user, in step S74, the overall control unit 73 determines that the person is a suspicious person, and executes a predetermined operation. Examples of the "predetermined action" include an action to start recording by the imaging unit, an action to issue an alarm at a relatively loud volume, an action to notify a pre-registered security company, and the like. Alternatively, the "predetermined action" may be an action in which the 3D character 1100 calls out to a suspicious person (for example, "Who is it? Say a password!"). Then, if there is no reply from the person who is determined to be a suspicious person, or if the password is incorrect, the above recording start operation, etc. may be executed. In addition, when the password is wrong, the general control unit 73 outputs a voice such as "No!? Say it again" as the character voice of the 3D character 1100, and when it is determined that the password is wrong again. , the above recording start operation, etc. may be executed. By doing so, for example, a suspicious person can be made to retreat from the detection target space, and crime prevention in the detection target space can be improved.

Then, when the user of the display device 1 is detected after performing the predetermined operation, the overall control unit 73 may output a sound related to the detection of a suspicious person as the character sound of the 3D character 1100. Examples of the "voice related to suspicious person detection" include "I was scared." In this way, the user's attachment to the character displayed on the image display section 20 can be increased.

Further, when the detection target space is monitored using the display device 1, the following operations may be performed in addition to the detection of a suspicious person.

For example, the display device 1 may be placed in a reception space of a company, and the 3D character 1100 may be displayed to perform reception work as a so-called receptionist. Specifically, when a microwave Doppler sensor (an example of a detection means) detects the approach of a person in a detection target space (for example, a reception space), the general control unit 73 issues a message saying, ``Welcome. Which department are you working for?'' It is preferable to output a voice such as "Is that right?" as the character voice of the 3D character 1100. Then, it is preferable that the overall control unit 73 performs control to make a call to the desired department of the visitor based on the response from the detected person (visitor).

<5. Regarding the communication function regarding the startup time of the display device 1>
In addition, the general control unit 73 determines whether the wording in the character voice of the 3D character 1100 is communicated according to the startup time (for example, cumulative startup time) of the display device 1 from a predetermined point (for example, the first startup time). It is better to control the content so that it changes. For example, as described below, the overall control unit 73 may control the 3D character 1100 to speak to the user using familiar language as the startup time of the display device 1 increases.

For example, for the various character voices mentioned above, three patterns of character voices are registered in advance in the voice management table: honorific tone, tone that indicates a friend relationship with the user, and tone that indicates a relationship between the user and a lover. It would be good if it were done. For example, if the startup time of the display device 1 from a predetermined point of time is less than 100 hours, the overall control unit 73 selects a polite character voice among the three patterns of character voices registered in the voice management table. Output. In addition, when the activation time is 100 hours or more and less than 1000 hours, the general control unit 73 selects a character voice that has a tone of voice that is friends with the user among the three patterns of character voices registered in the voice management table. Output audio. Furthermore, when the startup time exceeds 1000 hours, the overall control unit 73 outputs a character voice with a tone that suggests that the user is in a romantic relationship with the user, out of the three patterns of character voice registered in the voice management table.

In this way, the user can feel that the relationship (for example, intimacy) with the character has changed due to the change in the character's wording toward the user himself/herself.

Note that the overall control unit 73 may perform control to reduce the intimacy of the 3D character 1100 with the user depending on the time that has passed since the previous activation. For example, even if the cumulative activation time of the display device 1 exceeds 100 hours, if one week has passed since the last activation, the general control unit 73 may not speak in a tone that is equal to the user. A character voice with a polite tone may be output. In this way, the user comes into contact with the character displayed on the image display section 20 as close as possible to the character in order to maintain intimacy with the character, thereby further increasing the user's attachment to the character. be able to.

In addition, the general control unit 73 outputs a greeting voice such as "Nice to meet you" as a character voice at the time of first startup, and when a predetermined period (for example, a well-defined period such as one month) has elapsed from the time of first startup. At this point, it is preferable to output a voice indicating the anniversary (for example, "It's been a month since we met") as the character voice. In this way, attachment to the 3D character 1100 can be further increased.

<6. Regarding communication functions by linking with other devices>
Further, for example, in the stationary display device 1, the following operations may be performed in cooperation with other devices. For example, when a user visits a place where a device that can communicate with the display device 1 (hereinafter referred to as other device) is installed, the control unit (CPU, etc.) of the other device performs the following steps. , the user may be identified and information suitable for the user (for example, gourmet information or event information) may be automatically provided. For example, a face image of a user who uses a system for linking a display device and other devices and a display device owned by the user (eg, IP address, etc.) are associated and registered in advance in an external server or the like. For example, when a person is detected by a sensor included in a photographing unit provided in the other device, the control unit of the other device collects the face image of the person detected in the captured image and the user registered on the external server. The user of the display device 1 is identified by comparing the face image of the user with the face image of the user. Then, the control unit of the other device identifies the display device 1 registered in association with the user in the external server (for example, the IP address of the display device 1, etc.), and detects the user of the display device 1. The display device 1 transmits information indicating that the In the overall control unit 73 of the display device 1, “information suitable for the user” (for example, gourmet information and event information) is registered in advance, and the overall control unit 73 responds to signals received from other devices. and sends the registered "information suitable for the user" to the other device. Then, the control unit of the other device outputs (for example, outputs audio) the "information suitable for the user" received from the display device 1. Note that when providing guidance on "information suitable for the user," the other device may display the 3D character 1100 on its display screen. Further, it is preferable that the information and the like guided to the user be transmitted from the other device to the display device 1 and stored as user information in the overall control unit 73 of the display device 1. For example, when the display device 1 is installed at the user's home, when the user's return home is detected, the central control unit 73 outputs a voice such as "You went to **, how was it?" It is preferable to output the character voice of the 3D character 1100. In this way, the user's attachment to the character displayed on the image display section 20 can be increased.

<7. About other communication functions＞
Furthermore, the following control may be performed based on detection results from various sensors.

For example, a wind detection means (for example, a wind sensor) capable of detecting wind (for example, wind speed) is provided near the lower end 52 of the opening 5 of the display device 1, and the following is performed based on the detection result by the wind sensor. Control may also be performed. The wind is often generated artificially by the user, such as wind generated by moving a body part such as waving a hand toward the display device 1, or wind generated by blowing breath (exhalation). It is good to do this. For example, when a wind sensor detects wind having a wind speed equal to or higher than a predetermined value, the overall control unit 73 controls the hair (e.g., hair) and clothing (for example, of the character (e.g., 3D character 1100) displayed on the image display unit 20). For example, it is preferable to display and output an image of a waving skirt. Further, for example, when an image of a lit candle is displayed on the image display unit 20, if wind is detected by the wind sensor, the general control unit 73 may switch to an image of the candle extinguishing. . Furthermore, when the detected wind is stronger than a predetermined threshold (wind speed is greater than a predetermined threshold), the overall control unit 73 controls the strength of the detected wind (for example, the clothes of the 3D character 1100 flutters more strongly). , wind speed).

Further, for example, an object detection means (for example, an ultrasonic sensor) capable of detecting the presence or absence (presence or absence) of a target object and the distance to the target object is located inside the housing 10 on the inner peripheral surface of the housing 10 of the display device 1. The ultrasonic sensor may be installed facing toward the side, and the following control may be performed based on the detection result by the ultrasonic sensor. For example, if the overall control unit 73 determines that the viewer's hand is touching the 3D character 1100 displayed stereoscopically in the housing 10 based on the detection result by the ultrasonic sensor, the 3D character 1100 It is best to display and output a video showing the reaction. Further, the overall control unit 73 may perform display control so as to show different reactions depending on the part of the 3D character 1100 touched by the viewer. The parts of the 3D character 1100 that can be touched by the viewer may be, for example, body parts such as the head, chest, abdomen, buttocks, or legs. Furthermore, the parts of the 3D character 1100 that can be touched by the viewer may be clothes (for example, clothes, skirts) or accessories (for example, accessories) of the 3D character 1100.

Further, for example, the display device 1 is provided with an earthquake detection means (for example, a seismic sensor) capable of sensing an earthquake and measuring the seismic intensity, and when an earthquake is detected by the seismic sensor, the central control unit 73 detects an earthquake. It is a good idea to raise the alarm.

Further, for example, a weather sensor capable of measuring the weather may be provided in the display device 1, and the overall control unit 73 may notify weather changes, weather forecasts, etc. based on the measurement results by the weather sensor. Note that the weather sensor preferably includes, for example, an air pressure sensor, a temperature sensor, and a humidity sensor, and is configured to be able to measure the weather based on the detection results of each sensor.

Further, the general control unit 73 changes the facial expression and movement (also referred to as motion) of the character displayed on the image display unit 20 in accordance with the temperature detected by the temperature sensor and/or the humidity detected by the humidity sensor. It would be better to display the video.

The overall control unit 73 also controls the facial expressions and movements of the character displayed on the image display unit 20 according to the detection results (for example, the distance between the display device 1 and the viewer) by a human sensor such as a microwave Doppler sensor. It is best to display images that change.

Further, the overall control unit 73 may use a humidity sensor to determine whether or not the user has blown on the air. Furthermore, the overall control unit 73 may also use a temperature sensor to determine the type of breath blown by the user. Note that these sensors may be provided near the lower end 52 of the opening 5 of the display device 1, for example.

Here, there are two types of breaths that can be blown by the user: a ``huh'' breath and a ``ha'' breath. In general, when blowing cold breath, the person blows quickly with a "huh" sound, so here, the breath that is blown with a "huh" is referred to as "cold breath." In addition, generally when blowing warm breath, the person blows slowly with a "ha" sound, so here, the breath that is blown with a "hah" is referred to as "warm breath."

Regarding these two types of breath, the inventor of the present application obtained the following findings through experiments and the like. In detail, first, regarding humidity, if you blow your breath toward the temperature/humidity sensor (e.g., a sensor that is a combination of a temperature sensor and a humidity sensor) at a predetermined distance from the sensor. The measurement results showed that immediately after that, the humidity suddenly rose from a steady state. Furthermore, the measurement results showed that the humidity increases monotonically while blowing, and when the blowing is stopped, it takes several tens of seconds to return to the original steady state. Similar measurement results were obtained when breathing into the temperature and humidity sensor under the same conditions. On the other hand, when it comes to temperature, it has been determined that when a person blows a 'huh' sound, the temperature drops slightly from the steady state or stays at about the same level, and when a person blows a 'hah' sound, the temperature rises. The results were obtained. Note that the breath that the user blows on the display device 1 is an example of the wind that hits the display device 1.

Taking such knowledge into consideration, for example, in the display device 1 provided with a humidity sensor, when the humidity sensor detects that the humidity has suddenly increased from a steady state, the overall control unit 73 It is a good idea to judge (also called a decision) that the breath has been blown on. Furthermore, if a monotonous increase in humidity is no longer detected thereafter, the overall control unit 73 may determine that the blowing of breath has been stopped. Alternatively, when a predetermined period of time (for example, the time required to exhale normally (for example, about 3 seconds)) has elapsed after a sudden rise in humidity was detected, the central control unit 73 detects the humidity at that point. Regardless of the outcome, it is best to assume that breathing has stopped.

Further, when the humidity sensor detects a sudden increase in humidity and the temperature sensor detects that the temperature has increased from a steady state (for example, at approximately the same timing), the overall control unit 73 It is a good idea to determine that the type of breath blown is "warm breath." Conversely, when the humidity sensor detects a sudden increase in humidity and the temperature sensor detects that the temperature has not changed from the steady state or has decreased from the steady state, the central control unit 73 , it is preferable to determine that the type of breath blown by the viewer is "cold breath."

Then, the overall control unit 73 preferably outputs video and audio in response to the detection of the breathing as the movement of the character displayed on the image display unit 20 and character audio. Further, the overall control unit 73 may output video and audio corresponding to the type of breath blown as the movement of the character displayed on the image display unit 20 and character audio. For example, if the type of breath blown by the viewer is "cold breath," the general control unit 73 displays and outputs an image of the character's clothes fluttering, and if the type of breath blown by the viewer is "cold breath," If it is "warm breath," it is recommended to display and output an image in which the character moves to avoid the breath.

The inventor of the present application also obtained the following findings using various gas sensors. In detail, when you blow into the gas sensor at a predetermined distance (for example, about 10 cm) from the gas sensor, the output value of the gas sensor immediately decreases, and when you finish blowing, immediately after The measurement results showed that the output value of the gas sensor started to increase. Conversely, the measurement results show that when you blow into the gas sensor, the output value of the gas sensor increases immediately after that, and immediately after you finish blowing, the output value of the gas sensor starts to decrease. was gotten. In addition, measurement results have been obtained that, for example, when the wind from a blower (for example, an electric fan) hits the gas sensor, the output value of the gas sensor decreases, and when the wind from the fan stops hitting the gas sensor, the output value of the gas sensor increases. It was done.

Taking such findings into consideration, the overall control unit 73, for example, in the display device 1 equipped with a gas sensor, when the output value of the gas sensor suddenly decreases from a steady state, the overall control unit 73 detects the type of breath blown by the viewer. It is best to judge that this is "cold breath." Conversely, if the output value of the gas sensor suddenly increases from a steady state, the overall control unit 73 may determine that the type of breath blown by the viewer is "warm breath."

It is also possible to adopt a configuration in which breath is detected using a wind sensor. The inventor of this application found that, according to wind sensors, it is possible to detect relatively weak winds that are as strong as looking up at a piece of paper, and when the wind sensor blows on the wind sensor, the wind reaches its peak immediately, and the responsiveness is good when the wind starts blowing. It was confirmed. However, if you keep breathing, it will quickly fall from its peak. If there is a strong wind that blows, the heater may cool down and take time to recover.

In relation to the configuration of detecting breath using a wind sensor, the following configuration may be used.

When the wind sensor continuously detects a predetermined amount of air, the overall control unit 73 may perform processing in a direction other than the state in which air is being blown. The processing in the direction in which the breath is not being blown is, for example, the processing in which it is determined that the breath is not being blown. In this case, when the time from the start to the end of wind detection by the wind sensor is within the time during which breathing is possible, the overall control unit 73 processes the direction in which the wind is being blown. It is recommended that you do this.

In this case, the wind sensor may be a sensor that detects wind by electrically measuring heat removed by receiving wind. In this sensor, the wind that is received by the sensor corresponds to the amount of air that is blown onto the sensor. This sensor is set so that when the wind received by the sensor lasts for a time equivalent to the time when the breath is blown, the wind volume falls to a value lower than the actual air volume during the duration. However, it is preferable that the setting is such that this drop is less likely to occur when the volume of air is smaller than the amount of air blown.

In the display device 1, a plurality of wind sensors may be provided with a flow path through which air flows through a common breath inflow path. The flow path may be configured to allow wind to enter different wind sensors at a predetermined ratio other than 1:1. The overall control unit 73 may determine the magnitude and duration of the blowing based on the ratio and the difference in characteristics of the plurality of wind sensors. The display device 1 is equipped with a plurality of wind sensors that drop to a value smaller than the actual airflow volume at different times during the duration period, and the integrated control unit 73 determines the volume of blowing based on the outputs of the plurality of wind sensors. It is a good idea to determine the length and time. The display device 1 may include at least a wind sensor that is not a gas sensor and a waste sensor as the plurality of wind sensors.

Further, it is preferable to use a gas sensor for detecting a predetermined gas as the wind sensor. The wind sensor may be a gas sensor for detecting a predetermined gas, and may include a heater. In this case, the gas sensor equipped with the heater outputs an output in the direction of increasing the detected amount of gas (as a result of detecting gas contained in the breath) when the degree of blowing is relatively small; It is preferable to use one that has a characteristic of outputting in a direction that reduces the detected amount of gas (due to cooling of the heater by the airflow) when the degree of spraying is relatively large.

When the general control unit 73 determines that breath is being blown and the strength of the blow is relatively large (for example, when the air volume is above a threshold value), it creates an animation that moves the clothes, hair, etc. of the 3D character 1100. However, if the strength is relatively small, it is preferable to display an animation different from the animation that moves the clothes, hair, etc. of the 3D character 1100.

By the way, when a gas sensor is used to detect breath, the gas sensor outputs the above-mentioned output value in response to components (for example, carbon dioxide) contained in human breath. The reason why the output value of the gas sensor is different depending on whether the breath is blown "whoo" or "haa" is that when the breath "whoo" is blown, On the other hand, when a breath is blown, the speed of the blown breath is low and the gas is easily dispersed into the surrounding area after colliding with the gas sensor. This is thought to be due to the fact that breath components tend to remain in the field.

Further, the overall control unit 73 preferably determines whether the detected wind is caused by a viewer's breath or by a blower, for example, also using the humidity detection result by a humidity sensor. . For example, in the display device 1, when the humidity sensor detects that the output value of the gas sensor has suddenly decreased from the steady state and the humidity has suddenly increased from the steady state, the overall control unit 73 may cause the user to It is best to judge that it has been sprayed. On the other hand, when the output value of the gas sensor suddenly drops from the steady state, but the humidity remains in the steady state, the overall control unit 73 may determine that air is being blown by the blower. Furthermore, the overall control unit 73 may also use the temperature detection result by the temperature sensor to determine the type of breath when it is determined that the user has breathed on the user. Further, if the output value of the gas sensor repeatedly increases and decreases within a relatively short fixed period, the overall control unit 73 may determine that the wind from the oscillating fan is hitting the sensor.

Note that a wind sensor, a humidity sensor, a temperature sensor, a temperature/humidity sensor, and a gas sensor used to detect wind are examples of wind detection means. The display device 1 may include an atmospheric pressure sensor as a sensor for detecting wind. This is because changes in atmospheric pressure can occur depending on the generation and strength of wind.

Various controls such as those described above may be executed. Note that the above control may be performed not only for the 3D character 1100 but also for communication functions related to other characters (for example, the 3D character 1200).

[Display example of three-dimensional images, etc.]
In the display device 1 having the above-described configuration, the following display may be performed regarding a three-dimensional image (particularly, for example, a three-dimensional image displaying a 3D character). The following display may be executed as an example of the above-mentioned "communication function", for example. Note that the following display may be reproduced, for example, by the overall control unit 73 executing a 3D application in the ROM 702.

For example, although not shown, the overall control unit 73 may change the perspective (for example, also referred to as a perspective image) of the character when a part of the character's body moves. In this way, it is possible to give a sense of dynamism to the character.

For example, although not shown, when a conversation between a character and a viewer causes the character to become angry and the character throws a punch, the general control unit 73 may place the character's hand in front of the camera in the 3D application. It is preferable to control the camera position so that the image is displayed, and to change the perspective to a state that is more emphasized than the normal state, at least during the punching period. Then, the general control unit 73 preferably controls the perspective to return to the normal state when the character finishes punching.

Furthermore, when adjusting the interval between the left and right cameras (for example, the interval setting value in a 3D application) so that the 3D character appears to pop out in front of the light reduction member 30 in autostereoscopic viewing, if the degree of protrusion is increased, There is a problem in that the 3D character appears to be elongated in the front and back direction. In consideration of such problems, it is preferable for the general control unit 73 to perform image processing so as to compress the 3D character in the front and rear directions as the degree of protrusion increases (for example, as the distance between the left and right cameras increases). In particular, it is preferable that the amount of squeezing be set according to the degree of protrusion, such that the more the 3D character pops out to the front, the greater the amount of squeezing becomes.

Further, although not shown, the overall control unit 73 may display various parts of the 3D character's body (for example, the chest, etc. in the case of a female character) so as to sway. In this case, in order to further emphasize the three-dimensional effect of the 3D character, for example, it is preferable to display an image in which the 3D character faces diagonally forward rather than in front.

Further, if the general control unit 73 sets various parameters in the 3D application (degree of separation of the camera, direction, distance to the display target, etc.) to appropriate values according to the character displayed on the image display unit 20. good. In addition to the automatic setting by the general control unit 73, the housing 10 is provided with a physical slider that can adjust various parameters in the 3D application described above, so that a viewer or the like can adjust various parameters while viewing the 3D character. It may be possible to make it easier to do so.

Further, although not shown, the overall control unit 73 may display a predetermined object (for example, a plate, etc.) so that it is drawn at the same position as the light attenuation member 30. In this way, the presence of the light attenuation member 30 can be notified to the viewer through an image, and when the viewer puts his/her hand into the spatial area 102 (FIG. 6), the viewer's hand Collision with the light attenuation member 30 can be suppressed. Note that it is preferable that the display device 1 is provided with a function of calibrating various parameters so that the predetermined object and the light attenuation member 30 are in the same position.

In addition, there is an image in which the 3D character protrudes to the front side of the light reduction member 30 (toward the opening 5), and a state in which the 3D character protrudes only to the rear side of the light reduction member 30 (toward the image display unit 20 side). It is preferable to provide images in advance so that different actions are performed in each state. For example, although not shown, when the general control unit 73 displays an image in which a 3D character jumps out to the front on the image display unit 20, the 3D character actively interacts with the viewer, such as asking for a handshake. It is preferable that the image display unit 20 display a video of the 3D character performing an action that causes the user to touch the 3D character. In the opposite case, it is preferable to display an image in which such an action is not performed. Further, it is preferable that the overall control unit 73 displays an image of a slide on the surface of the obliquely arranged light attenuation member 30, and draws an image of the character sliding on the slide (on the front side).

Further, the overall control unit 73 causes the image display unit 20 to selectively display one of a plurality of images including the first image and the second image described below as an image recognized as a three-dimensional image. You can also do this. The first image is an image that can be stereoscopically viewed by a viewer (3D character 1000 in FIG. 21(B) (see). The second image may be an image that is recognized to exist on the front side or the back side of the first image. For example, in the image display unit 20, the viewer A second image that can be viewed stereoscopically (see FIG. 21(A)) is visually observed so that the part above the feet of the 3D character 1000 is located in front of the light reduction member 30 (on the opening 5 side). It is preferable that the first image (see FIG. 21B) which can be viewed stereoscopically be switched and displayed depending on the person. Note that the first image may be an image that can be stereoscopically viewed by the viewer such that the entire portion of the 3D character 1000 is located in front of the light reduction member 30. In this way, it is possible to selectively display one of the plurality of images including the first image and the second image in different positions where the image recognized as a three-dimensional image by the viewer is recognized as existing. Therefore, the three-dimensional effect given to the viewer can be changed. As a result, for example, viewers can be more entertained. Note that the image of the 3D character 1000 itself is displayed on the display screen of the image display section 20, and in FIG. 1000 is shown.

For example, the general control unit 73 determines whether the 3D character 1000 (all or part of the 3D character 1000) is It is preferable to switch the displayed image on the image display unit 20 by transitioning to an image that extends to the front side of the light attenuation member 30 (see FIG. 21(B)). The position at which the three-dimensional image is recognized may be switchable by the viewer's operation of the operation unit 40 or other operations. The viewer may operate the image so that the image is displayed at a position where the three-dimensional image can be viewed stereoscopically. Further, the number of positions at which the three-dimensional image can be switched may be three or more. This is because whether a three-dimensional image looks three-dimensional or not depends on individual differences.

In addition, when the display transitions between the first image and the second image, the overall control unit 73 causes the 3D character 1000 to move from the rear side of the light attenuation member 30 to the front side (or from the back side of the light attenuation member 30 An image (video) of a movement process that gradually moves (from the front side to the rear side) may be displayed.

At the time of such image transition, it is preferable that the overall control unit 73 displays, on the image display unit 20, an image in which a 3D character performs an action indicating the presence of the light reduction member 30, for example. For example, when a 3D character hits the light attenuation member 30 from the rear side of the light attenuation member 30, an image with a hole is placed at the same position as the light attenuation member 30, and the 3D character jumps out of the hole to the front. It would be good if an image that appears to move to the side is displayed.

[Specific example of video displayed on display device 1]
Next, specific examples of images displayed on the display device 1 will be described with reference to FIGS. 22 to 36. 22 to 36 are diagrams showing examples of characters (images including the 3D character 1200 described in FIGS. 11 and 12) displayed on the display device 1 according to this embodiment. Each of the images shown in FIGS. 22 to 36 is an image that is displayed on the display device 1 and can be seen by the viewer through the opening 5. Note that although the stage image 2200 is displayed in FIGS. 22 to 36, the 3D character 1200 may be displayed instead.

The display device 1 (specifically, the general control unit 73) displays images of the 3D character 1200 shown in FIGS. 22 to 28 regularly or randomly during a period of waiting for the viewer's actions based on the communication function. Switch and display. The display device 1 (specifically, the overall control unit 73) changes the display of the 3D character 1200 based on the communication function. For example, as shown in FIG. 22(A), the 3D character 1200 is displayed in a standing posture facing the front side (image viewing side) of the display device 1. The display device 1 may use this posture as a basic posture, and may display a period in which communication based on the communication function is not performed. For example, as shown in FIG. 22(B), the 3D character 1200 makes an action such as licking its own front paw. For example, as shown in FIGS. 22(C) and 23(A), the 3D character 1200 behaves as if it looks alternately at its left and right sides. For example, as shown in FIG. 23(B), the 3D character 1200 moves to face the ground. For example, as shown in FIG. 23(C), the 3D character 1200 moves as if stretching while sitting. For example, as shown in FIG. 24(A), the 3D character 1200 behaves as if it were looking into the ground. Further, for example, as shown in FIGS. 24(B) and 24(C), the 3D character 1200 makes a motion of walking toward the front. For example, as shown in FIG. 25(A), the 3D character 1200 moves as if looking into its own abdomen. For example, as shown in FIG. 25(B), the 3D character 1200 makes an action of tilting its head. For example, as shown in FIG. 25(C), the 3D character 1200 makes an action of rubbing its own eyes. For example, as shown in FIG. 26(A), the 3D character 1200 makes a yawning motion. For example, as shown in FIG. 26(B), the 3D character 1200 makes a motion of licking its own front paw while sitting. For example, as shown in FIG. 26(C), the 3D character 1200 moves to look in front of it to the left. For example, as shown in FIG. 27(A), the 3D character 1200 moves to look in front of itself to the right. As shown in FIG. 27(B), the 3D character 1200 makes a stretching motion. For example, as shown in FIG. 27(C), the 3D character 1200 behaves as if it were looking into the ground. For example, as shown in FIG. 28(A), the 3D character 1200 faces diagonally forward to the right of the display device 1, and then faces forward as shown in FIG. 28(B). As shown in FIG. 28(C), the 3D character 1200 makes a motion of licking its own front paw.

29 to 36 are examples of the display of the 3D character 1200 that the display device 1 (specifically, the general control unit 73) performs based on the communication function during dialogue processing. The character strings shown in FIGS. 29 to 36 are character strings that can be recognized by voice recognition and are displayed above the 3D character 1200. FIG. 29(A) is displayed when the display device 1 recognizes the viewer's utterance, ``Come on, come on~'', and a voice is output in response to this. 29(B) to FIG. 30(B) are displayed when the display device 1 recognizes the viewer's utterance of “sit down”, and a voice is output in response to this. FIG. 30(C) is displayed when the display device 1 recognizes the viewer's utterance, ``I wonder if I'm hungry,'' and a voice is output in response. FIG. 31(A) is displayed when the display device 1 recognizes the viewer's utterance of "police officer," and a voice is output in response. FIGS. 31B and 31C are displayed when the display device 1 recognizes the viewer's utterance, ``It's snack time,'' and a voice is output in response. FIG. 32(A) is displayed when the display device 1 recognizes the viewer's utterance of "hand", and a voice is output in response to this. 32(B) to FIG. 33(B) are displayed when the display device 1 recognizes the viewer's utterance, ``You're cute,'' and a voice is output in response. FIG. 33(C) is displayed when the display device 1 recognizes the viewer's utterance of "Hello," and a voice is output in response. FIG. 34(A) is displayed when the display device 1 recognizes the viewer's utterance of "I'm going to eat," and a voice is output in response to this. FIGS. 34(B) and 34(C) are displayed when the display device 1 recognizes the viewer's utterance "Is it a girl?" and a voice is output in response. FIG. 35(A) is displayed when the display device 1 recognizes the viewer's utterance of "wait," and a voice is output in response. FIG. 35(B) is displayed when the display device 1 recognizes the viewer's utterance, ``You're a good boy.'' In response, a voice is output. FIGS. 35(C) and 36 are displayed when the display device 1 recognizes the viewer's utterance of "Yuno," and a voice is output in response.

<More detailed description of 3D character 1200>
The 3D character 1200 described in FIGS. 22 to 36 will be described in more detail. In the following description, descriptions in which the display device 1 is the main processing body may be performed by the control unit 70 (more specifically, the overall control unit 73). It is particularly advantageous if the 3D character 1200 is drawn approximately three-dimensionally. It has been found that by doing so, the sense of depth is particularly emphasized. The display device 1 displays a 3D character so that the head occupies approximately one third of the height, the torso occupies one third, and the feet occupy one third in the vertical direction when viewed from the side (lateral side). It is better to draw 1200. The display device 1 preferably draws the 3D character 1200 so that, except for the tail, the head occupies approximately one-third and the body occupies two-thirds in the left-right direction when viewed from the side.

The display device 1 has a function of displaying images that are mutually displaced between a state in which the tail is not visible and a state in which the tail is visible when the face is in front of the person, and a state in which the tail is visible and a state in which the tail is not visible. It is recommended that the time be shorter than that of . The tail is drawn further back than the head, but by seeing the tail from time to time, you can feel a larger three-dimensional effect, and constantly feeling a larger three-dimensional effect can cause eye and head fatigue. can be prevented. In particular, it is preferable that the display device 1 performs such a drawing process while in a standby state for voice recognition. The display device 1 may have a function of drawing the tail so that it appears from the top of the head when the tail is displaced to a visible state. By doing this, the tail suddenly pops out above the head from the center of the eyes of the face, where the viewer's line of sight is usually directed, which can give surprise and interest.

The display device 1 may preferably provide a flat portion at the top of the head of the 3D character 1200 when viewed from the front, and in particular, the portion of the head between the left and right ears may be rendered flat when viewed from the front. In this way, a tail with a three-dimensional effect suddenly appears above the head from the top of the flat head, which has a weak three-dimensional effect, making it more surprising and interesting. Further, the display device 1 may draw the tail so that it appears from above, and then move the portion of the tail closer to the tip. In this way, the viewpoint can be focused on the tail part on the back side of the face, giving a more three-dimensional effect. The display device 1 may similarly draw the tail so that it appears from the left and right sides of the torso. In the display device 1, when the tail appears from the left and right sides, the length and/or time during which the tail appears may be made shorter than when the tail appears from above. In the case where the display device 1 makes the images appear from the left and right, it is preferable to draw the images so that they appear flickeringly. The display device 1 may be configured to sometimes draw the line of sight to the back, which can give a more three-dimensional effect. It is preferable that the display device 1 performs rendering such that the tail appears from above the cat's head during voice recognition, and that the tail appears from either the left or right direction when outputting voice from the cat. In the display device 1, it is preferable that the tail is provided with portions having a drawing mode different from other portions at predetermined intervals in the length direction. For example, it is preferable to apply patterns having a predetermined width in an annular or arc shape on the cylindrical surface of the tail at regular intervals. The inventors have found that by doing this, the tail movement feels more dynamic in three-dimensional space.

The display device 1 performs drawing to change the current posture to the same posture when there is a change from a state not in voice recognition to a state in which voice recognition is in progress so that the same posture is maintained during voice recognition. Good. It is preferable that the display device 1 causes the user to utter "chatting" before starting voice recognition. The display device 1 preferably has a function (for example, a sensor or a switch) that detects the viewer's motion, and has a function that utters "What?" when detecting the viewer's motion. It is best to perform both functions in succession in the form of "What's that?" and "Talk to me," and then enter the speech recognition state.

The display device 1 is preferably provided with information on complimentary words such as "You're cute" as speech recognition words, and changes the body posture when recognizing the complimentary words. It is even better if you move the cat's position, such as by walking. In this way, the viewer wants to see the changes in the cat's posture and movement, so they will use words and actions that praise the cat, and the excellent effects of therapy, such as improving the cat's behavior and words, can be obtained.

It is preferable that the display device 1 is provided with a voice recognition phrase corresponding to "to feed", and when the phrase is recognized, the display device 1 is depicted wagging its tail faster than in other cases. In this way, the viewer can feel as if the cat is actually alive.

The display device 1 preferably renders the outline of the cat's eyes as approximately circular, and the iris as a vertically elongated ellipse. In the display device 1, it is preferable that the iris part be drawn with a gradation of shading in the vertical direction, and the iris should be drawn in a brighter color as it goes downward. In the display device 1, it is preferable that the center part of the iris has a blacker part than the generally circular or elliptical periphery. The display device 1 preferably provides a crescent-shaped or half-moon-shaped white region along the outer edge of the iris in the outer part of the face above the iris. In contrast, it is preferable that the display device 1 draw a circular white area at a position near the center of the face below the iris. The display device 1 preferably continues to draw this white area even when there is a change in the position of the 3D character 1200 (such as a change in posture) or a change in the position of the camera or light. Usually, highlights are often added by calculation as reflections of light or the like. However, by doing this, it is possible to emphasize the cat's individuality in the eyes, which are most visible when speaking with voice recognition, and give an impression as a cat with a unique personality in a short time during voice recognition. be able to.

The display device 1 takes a state where the face is facing forward and a state where the face is facing downward. When the face is facing forward, the outline of the eyes is drawn in a generally circular shape, while when the face is facing downward, When the character is facing towards the camera, it is best to draw the eyes as horizontally elongated ellipses.

The display device 1 has two states: the top of the face is above the top of the body, and the top of the face is below the top of the body, and when the top of the face is above the top of the body, the eyes are While the outline is generally drawn in a circular shape, if the upper end of the face is lower than the upper end of the body, it is better to draw the eyes in a horizontally elongated oval shape. The display device 1 has a function of drawing a yawning state with the mouth open, and it is preferable to draw the yawn with the eyes closed during this drawing.

It is preferable that the display device 1 prepares a plurality of motion patterns for the 3D character 1200 during standby, and repeats the process of selecting and drawing one pattern from among these patterns. Motions during standby include licking the feet, stroking the face with hands, licking the butt, facing forward, looking left and right, licking the ground, stretching, yawning, There are walking motions, etc.

The display device 1 may draw the ears so that they move later than the face. For example, the ears may be drawn so that they remain in position for a while even if the face begins to move. The display device 1 preferably has a function of simultaneously performing a tail-waving motion from side to side when performing a licking motion.
In the display device 1, when the 3D character 1200 is viewed from the front, the pattern of the body may be asymmetrical. In this way, it will be easier to remember the cat as a unique cat, and it will also be easier to tell whether the cat's right side or left side is visible. This is particularly useful when creating a scene that is so enlarged that the entire image of the 3D character 1200 cannot be seen. In particular, the pattern is preferably a calico cat pattern, especially a tabby cat pattern. The inventors have found that this makes it particularly easy to grasp the three-dimensional effect. In particular, the patterns on the head may be provided in different directions, such as the pattern on the head being provided in the front-back direction, while the pattern on the body may be provided in the vertical direction. This makes it easier to recognize changes in the camera or cat's position no matter which direction they move.

It is preferable that the display device 1 has a function of emitting a cry of "Nya", has a plurality of intonations for the cry of "Nya", and has a configuration in which different motions are associated with each cry. It is preferable that the intonation includes an interrogative intonation, and the motion includes a tilting of the head.

<About the communication function related to 3D character 1200>
The communication function related to the 3D character 1200 will be supplemented. By doing the following, it is possible to provide the viewer with a higher quality communication function with the 3D character 1200. Here, an outline of the human behavior and the behavior story of the 3D character 1200 until it is tamed will be explained. In this embodiment, a photographing section for photographing a viewer is provided on the front side of the display device 1.

(1) First step: Stage until domestication There are various types of cats, such as stray cats, that usually run away when they see a person, or run away when a person approaches. At that time, the cat's behavior appears to be turning around and looking at the person before running away. Here, the control unit 70 recognizes the presence of the viewer based on the photographed image photographed using the photographing unit, and when the intensity of the microwave measured by the human sensor 64 exceeds a threshold value, the 3D character An image of 1200 running away is displayed. This is because it is assumed that a person has approached the cat. The purpose of recognizing the viewer in the photographing unit is to show the viewer a scene in which the 3D character 1200 runs away. In other words, the 3D character 1200 is prevented from running away unless the viewer approaches the display device 1 from the front.

Next, people are thought to say things like ``squat down'' (lower your eyes) and ``come on, come on'' to the cat. Some cats stop and check out what's going on. However, if a person approaches, the cat will run away. This is repeated several times. It is thought that cats will not get used to this type of human behavior. Therefore, the control unit 70 controls the 3D character 1200 when the intensity of the microwave measured by the human sensor 64 is below a certain threshold during the period when the image of the 3D character 1200 is running away is displayed, and when the 3D character When words indicating a call to 1200 are voice recognized, an image of the 3D character 1200 performing an action such as standing still is displayed. Here, the reason why the intensity of the microwave is set to be equal to or less than the threshold value is because it is assumed that a person is standing still.

Next, it is conceivable that people stop to feed the cat. However, if a person approaches a cat, the cat will run away, so the only option is to leave food in a place where cats often visit. Therefore, the display device 1 has a function of displaying an image in which bait is placed within the image display space. For example, when the control unit 70 receives a predetermined operation (for example, the operation of the operation unit 41 or the operation unit 42), or when the gesture sensor 63 detects a predetermined gesture instructing to place food, Assuming that bait is placed, an image showing the bait is displayed in the image. In this way, the viewer will, for example, place the bait every day. At this time, the control unit 70 may display the 3D character 1200 as if it were watching from a distance. The control unit 70 displays an image of the 3D character 1200 eating food when the presence of the viewer is not recognized using the human sensor 64 and the viewer is not photographed by the imaging unit. Here, we are recreating a situation where a cat refuses to eat in front of people. From the perspective of a visual observer, this creates a situation where the bait is empty before you know it. The control unit 70 counts the number of times the viewer feeds the food and stores it. Although this state continues for a while, the control unit 70 may display a display that gradually reduces the distance between the viewer, the 3D character 1200, and the person (the distance perceived by the viewer) depending on the number of times the food is fed. For example, the control unit 70 may display the 3D character 1200 in a larger size together with the number of times the food has been fed since the feeding started, thereby reproducing the fact that the distance has shortened (that is, the animal has gotten used to it a little). Furthermore, when the number of times the cat is fed increases and reaches a predetermined threshold, the cat is assumed to have gotten used to it, and even if the viewer is looking at the character, the control unit 70 uses the human sensor 64 to To display an image of a 3D character 1200 eating food even when the presence of a viewer is recognized and the viewer is photographed by a photographing unit. At this time, the viewer can visually observe how the 3D character 1200 eats food.

However, people often do not know when cats eat. Therefore, the control unit 70 determines a time period during which the 3D character 1200 eats food (alternatively, it may be set to a single point in time), and displays an image of the 3D character 1200 eating food during that time period. You may let them. This is to make viewers aware that they seem to be feeding at this time of day. When it is detected that the viewer is about to touch the 3D character 1200, the control unit 70 causes the 3D character 1200 to output a predetermined utterance of "Sha" or "Shasha" and causes the 3D character 1200 to run away. Display the image. The fact that the viewer tries to touch the 3D character 1200 means that the intensity of microwaves detected by the human sensor 64 exceeds a threshold while the 3D character 1200 is eating food, or The identification may be made when one sensor 2331 detects a predetermined gesture.

Although this situation continues for a while, the control unit 70 may gradually shorten the distance at which the viewer's hand can approach the 3D character 1200. When the 3D character 1200 approaches to a predetermined distance, the control unit 70 may assume that the 3D character 1200 has become accustomed to the viewer, and display an image of the 3D character 1200 preening its hair or making relaxing movements in public. Specifically, the control unit 70 increases the threshold value for the intensity of the microwave, or increases the threshold value for the distance from the display device 1 when the gesture is performed. In this way, the control unit 70 lowers the detection sensitivity, slows down the reaction of the 3D character 1200 to the movement of the viewer, and prevents the 3D character 1200 from making utterances such as "sha" or "shasha".

Cats are always alert, but they add activities such as grooming, lying down, sharpening their claws, and wiping their faces. As cats gradually get used to people and their hands, people can begin to touch them with their hands. Therefore, it is preferable that the control unit 70 not reflect the microwave detection result by the human sensor 64 on the movement of the 3D character 1200. The control unit 70 may cause the first sensor 2331 to function as a motion sensor, and display an image in which the 3D character 1200 looks comfortable when stroked, according to the detection results of the viewer's gestures in the up, down, left, right, and front/back directions. The control unit 70 may further recognize the viewer's voice using the microphone 61 and display an image in which the 3D character 1200 reacts to the voice. For example, it is preferable that the control unit 70 utters a cry of "nya" as the utterance content no matter what word it recognizes.

The control unit 70 may further display an image in which the 3D character 1200 appears to beg for food after a period of time has elapsed. When the presence of the viewer is recognized by the imaging unit and the presence of the viewer is detected by the human sensor 64, the control unit 70 determines the time period (for example, morning, afternoon, evening) and It would be a good idea to make the dog make a "meow" sound and display a video of it rubbing its face. Further, the control unit 70 preferably reproduces a situation where the 3D character 1200 remembers its own name as the viewer calls out to the 3D character 1200. For example, the control unit 70 may respond only to the word "Yuno" and emit a cry "Nya", or may respond to calls such as "Yuno" and "It's bait" to make a sweet sound. It's a good idea to have them do something, or show them a video of them happily grinding.

(2) Second step: stage of learning the language (Japanese) When the control unit 70 recognizes the viewer's voice saying "Yuno" at a certain time, it outputs a voice indicating the response "What?" Output. From this point on, the 3D character 1200 begins to learn words. The control unit 70 counts the number of times people have been called out, takes the cumulative average/day, and calculates the cumulative average/day of the number of times food has been given x the cumulative average of the number of times people have been called out x a random coefficient ( (hereinafter referred to as the "cumulative average value"). This greeting is, for example, a predetermined greeting such as "Good morning,""Hello,""Goodevening,""How are you?" and "Do you want food?" The control unit 70 may stop responding (that is, reproduce the fact that the 3D character 1200 has forgotten a word) or increase the number of words it responds to, depending on the cumulative average value. For example, the control unit 70 may reduce the number of words to be responded to as the cumulative average value is smaller, and increase the number of words to be responded to as the cumulative average value is larger. The cumulative average value is calculated based on the number of times the display device 1 has been called out from the start of use to the present time, and the number of times it has been called out from the time when a predetermined period of time has gone back from the current time point to the present time point. It may be calculated based on. The predetermined period may be fixed, such as one month, or if the display device 1 has not been used for a certain period of time, it may be a period after the point in time when the display device 1 is started to be used after that period. When the display device 1 is first used, the cumulative average value may change significantly, so if the viewer does not call out to the user even once a day, the 3D character 1200 may stop responding. However, as the number of calls increases, the cumulative average value does not change significantly. In this way, it is possible to reproduce the situation in which it takes time for the 3D character 1200 to forget words. The random coefficient used to calculate the cumulative average value is a value that reproduces the capriciousness of cats, and can be called a capricious coefficient. The random coefficient is determined by the 3D character 1200 and visual observation, such as giving or not giving food when the character 1200 begs for food, or taking actions to wake up the 3D character 1200 by calling or touching it when it is sleeping. It is good to change it depending on the behavior of the person.

Further, when the cumulative average value exceeds a certain threshold, the control unit 70 may cause the 3D character 1200 to speak to the viewer or respond to a question regarding predetermined information such as the weather or news. Of course, if the viewer reduces the number of times the viewer feeds, the cumulative average value decreases, so the control unit 70 reduces the types of responses or does not respond at all. In other words, if the viewer is sloppy in feeding them or does not call out to them appropriately, the 3D character 1200 may not maintain the ability to respond, or even if it does, it may not respond due to a "whim". In some cases, as described above, it is possible to provide the viewer with a higher quality communication function with the 3D character 1200.

Furthermore, the following may be used.

For example, in a lenticular display, the image may no longer appear three-dimensional if the eye position moves a few centimeters to the right or left from the position where the image appears three-dimensionally. In this case, there is a risk that the viewer may give up thinking that "the image does not look three-dimensional." Taking this into consideration, the control unit 70 issues an instruction such as "If you see two people, try moving 3 centimeters to the right" based on the detection results of the human sensor 64, for example. may be controlled. In this way, it is possible to prevent the user from getting bored with the image due to not being able to see it three-dimensionally. Note that the instructions may be output as audio from the speaker 62, for example. Further, the timing at which the instruction is issued may be the timing at which the human sensor 64 recognizes that there has been a transition from a state where there is no person around the display device 1 to a state where there is a person present. Further, the timing at which the instruction is issued may be the timing at which an unregistered person is recognized, or may be at regular timing.

For example, if the display device 1 is capable of performing physical calculations regarding the movements of each of a plurality of parts of the character, when a specific part of the character (for example, the chest) is relatively small, the display device 1 may It is best to prevent physical calculations from being performed.

Further, it is preferable to add motion to the character's body, but not to add motion to the character's clothes, and to control the clothes to move using physical calculations in accordance with the movement of the character's body. In this way, the amount of calculation in the physical calculation can be reduced.

Further, for example, the control unit 70 may display an object on the image display unit 20 to indicate whether or not voice recognition is in progress. For example, the image display unit 20 may be display-controlled so that an image resembling a lamp lights up only during voice recognition. For example, the object is displayed inconspicuously (with relatively inconspicuous brightness, color, shape, size, etc.) at the edge of the display area of the image display unit 20 on the back side of a specific character. Good.

Further, for example, the control unit 70 displays the words (sentences) recognized by voice recognition for a predetermined period of time after the voice recognition, on the viewer's viewpoint side (front side) from the object of the specific character, It is preferable to hide the display after the predetermined time has elapsed (see FIGS. 29 to 35). Then, it is preferable that the character starts speaking after the phrase (speech recognition result) is hidden.

Further, when a three-dimensional image in which a character exists on a stage is displayed, the control unit 70 may cause a character whose length in the depth direction is relatively small (for example, a humanoid character) to be placed in the center of the stage. On the other hand, characters with a relatively large length in the depth direction (for example, a cat character) may be displayed in the center of the stage. Further, for example, when a humanoid character is displayed, the display may be controlled to emphasize the length of the stage itself to create a sense of depth.

Furthermore, when displaying an image of a character at a position other than the center of the stage (for example, a position on the front side), the control unit 70 controls the stage to rotate in the same manner as the character when displaying an image in which the character rotates. It would be better to display the video.

In addition, a video in which a stage with a shape that is relatively far away in the depth direction is displayed, and a character moves along the outer edge of the stage inside such a stage (for example, a cat character moves along the outer edge of a circular stage) It would be nice if a video of the person walking was displayed.

Also, when making a character walk, it is a good idea not to draw the stage etc. (including roads), but instead to draw an image where the character steps on the spot and does not move the character's overall position. . Then, when the character performs an action other than walking, a stage or the like may be drawn at the character's feet.

[Modified example]
Although one example of the embodiment of the present invention has been described above, the present invention is not limited to the above embodiment, and various changes are possible. For example, the following modification may be implemented.

(1) For example, in the display device 1 according to the above embodiment, it is preferable that a plurality of (for example, two) light attenuation members 30 are further provided in a detachable manner. In this way, the brightness and floating feeling of the image displayed on the image display section 20 can be adjusted without providing a separate adjustment member.

(2) In addition, in the display device 1 according to the above embodiment and each modification, in addition to the light attenuation member 30 (see FIG. 6) arranged at an angle with respect to the bottom surface of the casing 10, the bottom surface of the casing 10 A light attenuation member arranged perpendicularly to the light beam may further be provided.

(3) Furthermore, in the above embodiment, the gesture sensor 63 (an example of a behavior detection sensor) is arranged on the inner peripheral surface of the housing 10 toward the inside of the housing 10 (see FIG. 6). However, it is not limited to this. For example, the gesture sensor 63 (specifically, the detection surface of the gesture sensor 63) may be arranged in the upper part of the opening 5 facing diagonally forward and downward. In this way, even if the gesture by the viewer is performed outside the opening 5, the gesture can be detected.

(4) Furthermore, for example, in the display device 1 according to the above embodiment and each modification example, a transmissive display whose transmittance (or transparency) can be adjusted may be further provided. The transmissive display is preferably provided, for example, on the front side (front side) of the light attenuation member 30 in the internal space 100 of the housing 10. In particular, it is preferable that the transmissive display is arranged at an angle in the same manner as the light attenuation member 30.

Alternatively, a film whose transmittance (or transparency) can be adjusted may be provided in place of the transmissive display. In this way, it is possible to create an effect in which the stereoscopically displayed character gradually begins to appear.

(5) Furthermore, in the display device 1 according to the above-described embodiment and each modification, a panel (so-called face-fitting panel) into which the viewer's face can be fitted is further provided near the opening 5. It's okay. The panel is preferably installed at a position that allows stereoscopic viewing with the naked eye. Alternatively, a picture may be drawn on the panel on the casing 10 side, and the viewer's face may be photographed with the viewer's face fitted on the panel. Then, the photographed image may be uploaded to an SNS (social networking service) as ``you looking at me''.

(6) An autostereoscopic system that outputs instructions to close one eye and move your head left and right to a position where you can see a clear image, and to open both eyes when you close one eye and see a clear image. It is preferable to use it as a visual display device. Furthermore, if you see double images when you open both eyes from a position where you can clearly see the image with one eye closed, close one eye again and move further to the left or right to find a position where you can clearly see the image. It is preferable to use an autostereoscopic display device that outputs an instruction to open both eyes.

(7) Furthermore, it is preferable that the display device 1 according to the above-described embodiment and each modification be packaged with a printed matter on which words and phrases that can be voice recognized by the display device 1 are included. Furthermore, it is preferable to provide a system in which printed matter on which words and phrases that can be voice recognized by the display device 1 are printed can be installed in the vicinity of the display device 1 together with the display device 1.

(8) Also, the display device 1 has a built-in voice recognition device and has sound directionality in a specific direction (for example, the front direction), and the same display device is arranged in the opposite direction to the specific direction. It would be good to have a system that is characterized by this. For example, the two display devices 1 may be arranged such that the respective openings 5 of the two display devices 1 face oppositely to each other. In this way, for example, one display device 1 (specifically, the microphone 61 of the display device 1) can hear the voice of the person using the other display device 1 or the speaker 62 of the other display device 1. It is possible to avoid outputted audio from being inputted.

(9) The display method of the image display unit 20 may be an autostereoscopic method such as a lenticular lens method or a parallax barrier method, or a display method that can be recognized as a three-dimensional image using glasses. The housing of the display device 1 may have a rectangular parallelepiped shape, a cubic shape, a cylindrical shape, another polyhedral shape, a spherical shape, or other shapes. Moreover, the shape, structure, size, color, pattern, arrangement, etc. of each component of the display device 1 described above are only examples. Further, some of the components included in the display device 1 described above may be omitted, or other components may be added. The display device 1 may be a stationary display device, but it may also be a portable type, a head-mounted type that can be mounted on the viewer's head, a glasses type, or the like. In such a case, as the light attenuation member, a common (single) light attenuation member is arranged on the optical path of the image light of the image seen by the viewer's left eye and the image light of the image seen by the right eye of the viewer. good. The opening 5 does not have to be square when viewed from the front side, and may be formed in a circular or other shape. The image display section 20 may be an image display section using an organic EL, digital mirror device, or other display element as a display element. Even if the image display unit 20 is a display device having a light source other than a backlight, if there is a possibility that light leakage from the light source is visible, the presence of a light reduction member may reduce the floating light that can be given to the viewer. It can improve the feeling.

(10) The display device 1 may have one or more image display sections other than the image display section 20. For example, as the second image display section, a display section may be provided on the entire or part of the floor of the internal space 100, with the display surface facing upward (for example, vertically upward). The second image display section is, for example, a liquid crystal display, but may be a display section of another type. It is preferable that the control unit 70 controls the display of one or more image display units other than the image display unit 20. In this case, a stage image may be displayed on the second image display section, and a 3D character may be displayed on the image display section 20. In this way, it is possible to create an effect using an image on the floor of the interior space 100. Furthermore, instead of the second image display section, a light emitter (for example, a light emitting diode), a light guide member, and a light shielding member may be used to create a floor effect. In this case, a light guide member is placed on the floor of the internal space 100, and a light shielding member corresponding to a predetermined pattern (for example, a magic circle) is placed on the light guide member. When the light from the light emitting body is incident on the light guide member, the light is emitted upward from a region of the upper surface of the light guide member where the light shielding member is not arranged, and a viewer can see this.

(11) In the above embodiment, voice recognition for interacting with the character displayed on the image display unit 20 is enabled in response to a pressing operation on the operation unit 41, but the present invention is not limited to this. For example, when the presence of a person is detected in the detection target area of a human sensor (an example of a detection means) such as a full-frequency microwave Doppler sensor, the central control unit 73 may enable the voice recognition. good. In this way, when the user interacts with the character displayed on the image display section 20, there is no need for the user to perform an operation to enable voice recognition or to utter a trigger word, for example, and the user can communicate more naturally. can be reproduced.

At this time, for example, it is preferable that both the voice recognition by the voice recognition application in the display device 1 and the voice recognition by the voice recognition server be enabled. However, as described below, the activation of voice recognition in the voice recognition application in the display device 1 and the validation of voice recognition in the voice recognition server may be performed in stages. For example, when the presence of a person is detected in the detection target area of the human sensor, etc., voice recognition in the voice recognition application in the display device 1 is enabled, and the viewer can then call out or greet the person using the voice. Once detected by the recognition application, speech recognition at the speech recognition server may be enabled.

Further, when the display device 1 is equipped with a photographing unit such as a camera (an example of a detection means), a detection target space is provided on the front side (opening 5 side) of the display device 1, and the overall control unit 73 controls the display When the presence of a person is detected in front of the device 1, voice recognition may be enabled. In this way, voice recognition can be enabled after more reliably determining that the viewer is trying to talk to the character displayed on the image display section 20.

Furthermore, after a person is detected in the detection target area, the overall control unit 73 may be configured to enable the voice recognition on condition that user authentication is successful. Note that the authentication method for user authentication may be, for example, an authentication method that does not require manual operation by the user (face authentication, vocal cord authentication, etc.). In this way, for example, when user authentication is performed for a person other than the registered user registered in the display device 1 and the user authentication fails, voice recognition is not enabled and the image display unit 20 displays the It is not possible to interact with the characters that are displayed. Conversely, the character displayed on the image display section 20 does not show any reaction to people other than registered users. Thereby, the user's attachment to the character can be increased.

Further, if the voice of a phrase other than the phrase registered in advance in the dialogue server installed in the display device 1 or an external server is detected, voice recognition may not be enabled.

Further, a scent sensor may be used as a means for validating voice recognition. For example, the odor of the registered user of the display device 1 may be registered in the display device 1 in advance, and when the odor of the registered user is detected by the odor sensor, voice recognition may be enabled.

Further, even if voice recognition is enabled in this way, for example, the voice of the character displayed on the image display unit 20 (for example, the 3D character 1100) is not immediately output, but the voice from the user is output. If there is no overlay, it is recommended that the voice of the character is not output. For example, the general control unit 73 does not immediately output the character voice "Welcome back" in response to voice recognition being enabled, but instead outputs a character voice saying "I'm home" to the user while voice recognition is enabled. It is preferable to output a character voice saying "Welcome back" on condition that the voice is detected. Furthermore, for example, in the dialogue system, a branching scenario may be created for reproducing the following dialogue between the viewer and the character (for example, the 3D character 1100). For example, if it's a weekday,
User: Now Character: Welcome home~
User: Atchi Character: Dialogue like ``Thank you for your hard work in the heat'' is reproduced, and if it is a holiday,
User: I'm home Character: Ah, welcome back User: Atchi Character: I won't complain because I went out in the heat User: It's work Work Character: Sorry if it's true, thank you for your hard work A branching scenario that reproduces the dialogue. It would be good if it had been created.

Further, a branching scenario may be created according to the detection result by the odor sensor. for example,
User: The food was delicious!Character: "Hmm, let me smell it. Smells good!" Or "Hmm!? Isn't there a lot of salt? Be careful of yourself!"
A dialogue such as this may be reproduced.

In addition, as another example, when an odor is detected by an odor sensor,
Character: Kunkun, huh? What is this smell?
User: I burned the aroma.Character: Oh, I thought it would be relaxing, so the dialogue could be reproduced. Note that if the content of the viewer's response to the odor type question is not registered in the branching scenario, it is preferable that a voice such as "Oh, that's right!" is uniformly output as the character voice, for example.

(12) Also, the general control unit 73 constantly records the voice for the most recent predetermined time (for example, about 15 seconds), and when the voice of the trigger word for enabling voice recognition is detected, The voice recognition may be enabled. For example, the voice recognition application of the display device 1 may be enabled at all times (or in response to a press operation on the operation unit 41, etc.), and the voice recognition by the voice recognition server may be enabled upon detection of a trigger word. At this time, the overall control unit 73 (specifically, the communication control circuit 706) controls the detection voice detected by the microphone 61 (an example of voice detection means) (for example, between the detection start time and the detection end time). The voice data obtained by removing the voice of the trigger word from the detected voice may be sent to the voice recognition server. For example, assume that a user's voice saying "I'm going to Tokyo tomorrow, please tell me the weather" is detected. Note that the trigger word here is "Rei-tan", which is the nickname of the 3D character 1100. In this case, the general control unit 73 generates the voice ``I'm going to Tokyo tomorrow, Ray-tan, please tell me the weather'' which is the voice obtained by removing the trigger word voice ``Rei-tan'' from the detected voice ``I'm going to Tokyo tomorrow, Ray-tan, please tell me the weather.'' to the speech recognition server.

For example, if the above detected voice ``I'm going to Tokyo tomorrow, Rei-tan, please tell me the weather'' is sent as is to the voice recognition server, ``Rei-tan'' will be included in the voice recognition result. Due to this, the dialogue server may not be able to accurately extract the character voice corresponding to the voice recognition result, and there is a risk that the dialogue with the user will not work properly. In contrast, with the above method, even if the trigger word is uttered in the middle of a sentence, the voice data of the voice excluding the trigger word is transmitted to the voice recognition server. Therefore, it is possible to prevent dialogue with the user from becoming inconsistent due to voice recognition being performed with a trigger word included in the middle of a sentence.

(13) In addition, when reproducing the interaction between the user and the character displayed on the image display unit 20 in cooperation with the voice recognition server, the following operations may be performed depending on the configuration of the voice recognition server. Good too.

For example, if the voice recognition server is configured to start the voice recognition process after the reception of the voice data file is completed, the general control unit 73 controls the voice recognition before and after the trigger word in the voice detected by the microphone 61. Preferably, each audio data file of the audio is sent individually to the speech recognition server. For example, among the detected voices from the detection start time to the detection end time, the voice data file of the user voice detected before the trigger word voice (also referred to as the first half of the user voice) is the voice of the trigger word. It is preferable that the audio data file of the user's voice detected later (also referred to as the latter part of the user's voice) is transmitted to the voice recognition server prior to the voice data file.

In this way, in the voice recognition server, the voice recognition process for the first half of the user's voice is started without waiting for the completion of reception of the voice data file of the second half of the user's voice. Therefore, the voice recognition process can be performed more efficiently than when a voice data file containing the first half of the user's voice and the second half of the user's voice is sent to the voice recognition server. As a result, the display device 1 can receive the character voice from the dialogue server earlier, and can shorten the user's waiting time until a response to the user's voice is received.

Furthermore, for example, if the voice recognition server is configured to stream playback voice data from the display device 1 and execute voice recognition processing in real time, the first half of the voice data is sent to the voice recognition server in real time. When the playback speed T1 of the first half of the user's voice is played is preferably controlled to be faster than the standard playback speed T0 (T1>T0). For example, the overall control unit 73 changes the settings so that the first half of the user's voice is played back 25% faster than the standard playback speed T0 in the voice recognition server, and transmits the first half of the audio data. In this way, the speech recognition server can finish the speech recognition process for the first half of the user's voice earlier than when the first half of the user's voice is played back at the standard playback speed T0, Speech recognition processing for the latter half of the user's voice can be started earlier. As a result, the display device 1 can receive the character voice from the dialogue server earlier, and can shorten the user's waiting time until a response to the user's voice is received.

Furthermore, when the audio data of the user's voice in the second half is transmitted to the speech recognition server in real time, the playback speed T2 of the voice in the second half is faster than the standard playback speed T0 and faster than the playback speed T1 of the user's voice in the first half. It is preferable that the control is performed so that the timing is also slow (that is, the relationship T0<T2<T1 is satisfied). For example, the overall control unit 73 changes the settings so that the second half of the user's voice is played back 10% faster than the standard playback speed T0 on the voice recognition server, and transmits the second half of the audio data. In this way, both the first half of the user's voice and the second half of the user's voice are stream-played faster than the standard playback speed T0, and the voice recognition server executes the voice recognition process. As a result, the user's waiting time until a response to the user's voice is received can be further shortened. On the other hand, the user voice in the second half is played back at a speed faster than the standard playback speed T0 but slower than the playback speed T1 of the user voice in the first half. Therefore, it is possible to suppress a decrease in speech recognition accuracy in the speech recognition system. Therefore, the user's waiting time can be further shortened while suppressing a decrease in speech recognition accuracy.

Note that when the voice recognition server performs voice recognition processing in real time by playing back a stream of voice data, for example, the user's voice detected by the microphone 61 is transmitted to the voice recognition server in real time, but the trigger word is It is preferable that the speech recognition server is controlled not to start speech recognition until speech is detected.

[Other expansion examples, etc.]
The above-mentioned embodiments and each modification are merely examples, and it goes without saying that partial substitution or combination of the configurations shown in the above-mentioned embodiment and each modification is possible. Each component described in the example may be combined arbitrarily. For example, the control unit 70 may execute the process of any one of the above-described embodiments and modifications and other processes in parallel (for example, by multitasking).

Further, the invention and each component described in the means for solving the problems may be further applied to a combination of each component of the above embodiment and each modification. Similar effects due to similar configurations of a plurality of embodiments and a plurality of modifications will not be mentioned for each embodiment and modification. Furthermore, the invention is not limited to the embodiments described above. For example, it will be obvious to those skilled in the art that various changes, improvements, combinations, etc. are possible.

1 Display device 5 Opening part 10 Housing 11 Main body part 12 of the housing Top cover part 20 Image display part 30 Light reduction member 40 Operation part 61 Microphone 62 Speaker 63 Gesture sensor 64 Human sensor

Claims (23)

A display device that displays an image,
a casing provided with an opening for viewing the image in a first direction in a light-shielded interior space;
an image display section arranged in the internal space;
a light reduction member disposed closer to the first direction than the image display unit and spaced apart from the image display unit;
A display device comprising: The display device according to claim 1, wherein the light attenuation member is arranged between the opening and the image display section. The display device according to claim 2, wherein a surface of the light attenuation member on the first direction side is inclined with respect to a display surface of the image display section. The display device according to claim 3, wherein the image display unit displays a first image that is recognized to be at least partially located closer to the opening than the light attenuation member, as the image recognized as a three-dimensional image. . The image display unit displays an image that is recognized as a three-dimensional image, which is located closer to the first direction than the first image or to a second direction opposite to the first direction. The display device according to claim 4, wherein the display device selectively displays any one of a plurality of images including the second image recognized as existing. further comprising an audio output section provided in the housing,
The audio output section is located on the first side of the first surface of the housing facing the internal space, and is closer to the light attenuation member than the opening. The display device according to any one of claims 2 to 5, wherein the display device is provided at a position with a short distance. The upper end of the opening is provided further above the upper end of the display surface of the image display section,
The display device according to any one of claims 1 to 6, wherein the upper surface of the internal space is sloped downward from the upper end of the opening toward the upper end of the display surface. The display device according to any one of claims 1 to 7, wherein the image display section includes a light source and a display body that modulates light from the light source to display an image. The display device according to any one of claims 1 to 7, wherein an upper end of the opening projects further in the first direction than a lower end of the opening. The casing has a cover portion on an upper surface of the casing, and has an accommodation space between the cover portion and an upper surface of an inner circumferential surface of the casing,
The display device according to any one of claims 1 to 9, wherein a control unit related to the display device is arranged in the accommodation space. comprising a power supply section provided below the internal space of the casing,
The connection cord that electrically connects the power supply section and the control section is wired so as to pass through a gap area secured between the outer peripheral wall of the casing and the internal space. Display device. The cover portion is attached to the main body portion of the casing at a plurality of attachment positions, and
The cover part and the main body part are
A first mounting position on the first direction side among the plurality of mounting positions is connected using a first fixture at a position inside the outer peripheral wall of the casing,
At a second mounting position on the second direction side opposite to the first direction from the first mounting position of the display device, the display device is coupled from the outside of the outer peripheral wall of the casing using a second fixture. The display device according to claim 10 or 11. The display according to any one of claims 1 to 12, further comprising: an operation section provided in a lower part of the housing on the first direction side relative to the opening. Device. The display device according to any one of claims 1 to 13, wherein a plurality of the light attenuation members are provided in a detachable manner. A specific character is displayed on the image display section,
a motion detection means capable of detecting the motion of a viewer;
a motion control means for controlling the motion of the specific character according to a detection result by the motion detection means;
The display device according to any one of claims 1 to 14, further comprising: The motion detection means is a behavior detection sensor capable of detecting the behavior of an object,
The display device according to claim 15, wherein the behavior detection sensor is arranged to detect a gesture performed in the internal space of the housing. The display device according to claim 16, wherein the behavior detection sensor is arranged on an upper surface of the inner circumferential surface of the housing. The behavior detection sensor detects the gesture by emitting light and receiving the reflected light;
a member that is provided in the light emission direction and suppresses the emitted light from being received by the behavior detection sensor;
The display device according to claim 16 or 17, further comprising: An odor sensor that detects odor,
a display output operation for displaying on the image display section an image of the character making a movement according to the detection result by the odor sensor; an operation control means for performing at least one of the voice output operation and outputting the voice as a voice;
The display device according to any one of claims 1 to 14, further comprising: The display output operation is an operation of displaying, on the image display section, an image in which the character moves in accordance with the type of detected odor,
The display device according to claim 19, wherein the sound output operation is an action of outputting a sound according to the type of detected odor as a sound emitted by the character. a voice detection means capable of detecting voice;
a detection means capable of detecting the presence of a person in a detection target area;
Furthermore,
The voice detection means activates voice recognition for interacting with the character displayed on the image display unit when the presence of a person in the detection target area is detected. The display device according to any one of the items. A wind detection means for detecting wind;
a display output operation for displaying on the image display section an image of a character moving in accordance with a detection result by the wind detection means; and a display output operation for displaying a sound in accordance with the detection result by the wind detection sensor for the character displayed on the image display section. an operation control means for performing at least one of the voice output operation and outputting the voice as a voice emitted by the voice;
The display device according to any one of claims 1 to 14, further comprising: The display device according to claim 22, wherein the operation control means performs the display output operation or the audio output operation in response to the user's breath based on the detection result by the wind detection means.