JP7448142B2 - Display device etc. - Google Patents

Description

The present invention relates to display devices and the like.

Patent Document 1 describes a stereoscopic image display device that does not use special glasses. This stereoscopic video display device includes a light source, a liquid crystal display panel, and a parallax barrier placed on the viewer's side of the liquid crystal display panel.

Japanese Patent Application Publication No. 2003-295113

One of the objects of the present invention is to enhance the visual effects of a display device.

The purpose of the invention of the present application is not limited to this, and we intend to acquire rights through divisional applications, amendments, etc. for structures that aim to obtain effects from the parts of the structure disclosed in this specification, drawings, etc. . For example, the present specification discloses a problem in which the phrase ``can be done'' is replaced with ``the problem is.'' Each issue is described as an independent entity, and we intend to acquire rights to the structure for solving each issue individually through divisional applications, amendments, etc. Even if the problem is implicitly understood from the description of the specification, the present applicant has the intention of claiming a part of the structure described in the specification in an amendment or divisional application. The company also discloses a structure that solves a problem that combines these independent problems, and has the intention to acquire the rights to it.

(1) A casing that has a light-shielded image display space inside and an image observation area provided on the first direction side of the image display space, and an image display unit that forms an aerial image in the image display space. It is preferable to provide a display device having the following.

In this way, the aerial image that is combined with the image display space is displayed in a relatively dark space when viewed from the viewing side, so it is possible to enhance the stereoscopic effect of the aerial image that can be given to the viewer. Therefore, the visual effect of the display device can be enhanced.

(2) A display device may be provided that includes a light attenuation member that reduces external light entering the image display space from the observation area.

In this way, the light attenuation member reduces external light entering the image display space, so the image display space can be maintained in a dark state, and the three-dimensional effect of the aerial image that can be given to the viewer can be enhanced. .

(3) The image display unit includes a first display unit that emits a first image light, and an optical system that forms an image of the aerial image based on the first image light, The display device may include a light shielding member between the light attenuating member and the optical system on the optical path of the reflected light reflected by the light attenuating member.

In this way, it is possible to prevent the viewer from observing the image displayed in the image display space due to the reflection of the first image light by the light attenuation member.

(4) The light shielding member may be a display device provided at a position that does not overlap the observation area when viewed from the first direction.

In this way, even when the observer looks into the video display space from the observation area, the video displayed in the video display space due to the reflection of the first image light by the light attenuation member, It is possible to prevent the image from being observed by an observer.

(5) The image display section includes a first display section that emits a first image light, and an optical system that forms an image of the aerial image based on the first image light, and the optical system includes a first display section that emits a first image light. The display device may be arranged so as to avoid a region on the optical path of the reflected light of the image light reflected by the light attenuation member.

In this way, it is possible to prevent the viewer from observing the image displayed in the image display space due to the reflection of the first image light by the light attenuation member.

(6) The optical system includes an optical member having a first surface onto which the first image light is incident, and a second surface opposite to the first surface, and the optical member is configured to receive the first image light. It is preferable that the display device reflect light toward the first direction and transmit light incident on the second surface toward the first surface.

In this way, the viewer can observe the second surface side of the optical member by superimposing it on the aerial image combined using the optical member, which gives the viewer a stereoscopic effect of the aerial image. can be further increased.

(7) The display device may include a second display section that emits a second image light that overlaps with the aerial image when viewed from the first direction.

In this way, it is possible to increase the degree of freedom in selecting an image to be superimposed on the aerial image for the observer to observe.

(8) It is preferable that the display device has a light emission brightness of the first display section higher than a light emission brightness of the second display section.

In this way, the three-dimensional effect of the aerial image that can be given to the viewer can be further enhanced due to the difference between the luminance of the first display section and the luminance of the second display section.

(9) The first display section is arranged above the observation area so that the display surface faces downward, and the second direction side opposite to the first direction is lower than the first direction side. It is preferable to use a display device that can be tilted so that

In this way, the first display section disposed above the observation area can form an aerial image using the optical member.

(10) The display surface of the first display section may be a display device that is inclined at approximately 20 degrees with respect to the horizontal direction.

In this way, the three-dimensional effect of the aerial image that can be given to the viewer can be further enhanced, and the first image light is reflected by the light reduction member, so that the image displayed in the image display space can be more easily observed. It can be made difficult.

(11) The second display unit may be a display device disposed below the observation area so that the display surface faces upward.

In this way, the image displayed on the second display screen appears to be located below the image formed in the air, thereby further enhancing the stereoscopic effect of the aerial image that can be given to the viewer. can.

(12) The first display unit may be a display device that emits the first image light so that the aerial image is observed on the second display screen.

In this way, the aerial image is viewed so as to be positioned above the image displayed on the second display screen, so that the stereoscopic effect that can be given to the viewer can be further enhanced.

(13) The casing may have a first housing space above the first display section, and the display device may include a processed substrate disposed in the second direction side of the first housing space. .

In this way, the processing substrate can be placed in a region with a relatively large margin in the height direction of the first accommodation space secured above the first display section.

(14) The processing board may include a mounting section to which an external device can be attached and detached, and the mounting section may be a display device exposed to the outside of the casing from the second direction side of the casing.

In this way, it is possible to make it difficult for an observer to observe the portion of the attachment portion to which an external device can be attached or detached that is exposed to the outside of the housing.

(15) Preferably, the display device includes a sensor provided below the observation area, and the processing substrate is a display device that executes processing according to information measured by the sensor.

In this way, it is possible to prevent the configuration related to the sensor from obstructing observation of the aerial image.

(16) The display device may include a sensor board on which the sensor is mounted, and the sensor board may be provided in a portion of the housing on the first direction side.

In this way, it is possible to prevent the configuration related to the sensor from obstructing observation of the aerial image.

(17) The sensor may be a display device including a sensor that detects gestures.

In this way, when the viewer performs a gesture, it is possible to prevent the viewer's body parts from interfering with viewing the aerial image.

(18) The casing has a second housing space below the video display space, and a display device that includes a control board that is provided in the second housing space and supplies signals from the sensor to the processing board. It is good to say.

In this way, compared to the case where the control board is accommodated in the first accommodation space above the first display section, it is possible to suppress the size of the casing above the observation area from increasing.

(19) The display device may include a wiring section that electrically connects the control board and the processing board, and a partition member that partitions off the wiring section so that it cannot be observed from the image display space side.

In this way, it is possible to prevent the wiring portion that electrically connects the control board and the processing board from being observed.

(20) The processing substrate may be a display device that controls display on the first display unit according to information measured by the sensor.

In this way, the aerial image can be changed based on the information measured by the sensor.

(21) The display device may include a viewing angle control member that is provided on the display surface of the first display section and narrows the viewing angle in the first direction.

In this way, it is possible to prevent the image displayed on the first display surface from being directly observed by the viewer.

(22) The first image light may be a display device that is image light of an image recognized as a two-dimensional image.

In this way, even when the first display unit that displays an image recognized as a two-dimensional image is used, it is possible to give the viewer a stereoscopic effect of the aerial image.

(23) The housing may have a plurality of parts connected by a fixture, and the fixture may be a display device that is not exposed at least from the first direction side.

In this way, it is possible to prevent the fixing member from being observed by an observer, and it is possible to improve the aesthetic appearance of the display device.

(24) It is preferable that the display device has at least a portion of the portion facing the image display space subjected to a treatment to reduce reflection of light.

In this way, it becomes easier to maintain the image display space in a dark state, so it is possible to further enhance the stereoscopic effect of the aerial image that can be given to the viewer.

(25) The casing may be a display device having a portion surrounding the observation area when viewed from the first direction.

In this way, the aerial image displayed in the image display space and the casing located in front of the aerial image are combined to further enhance the stereoscopic effect of the aerial image that can be given to the viewer.

(26) The image display unit may be a display device that displays an image of a character representing a cat.

In this way, it is possible to display a character image representing a cat with a three-dimensional effect.

(27) The video display unit may be a display device that changes the video based on a communication function that reproduces communication between the character and an observer observing the character.

In this way, the image of the character representing the cat can be changed based on the communication function.

(28) a smell sensor that detects a smell, a display output operation that displays on the video display section an image of a character making a movement according to the detection result of the smell sensor, and a display output operation that displays a sound according to the detection result of the smell sensor. It is preferable to further include an operation control means for performing at least one of an audio output operation and an audio output operation that is output as audio emitted by the character displayed on the video display section.

In this way, it is possible to reproduce communication regarding smell between the character displayed on the video display section and the user. For example, when a smell is detected by a smell sensor, the character is controlled to output a sound such as ``Something smells'' or to display an image of the character sniffing a smell. obtain. Therefore, more diverse communication can be achieved between the character and the user.

(29) The display output operation is an operation of displaying, on the video display section, an image in which a character displayed on the video display section moves in accordance with the type of detected odor, and the audio output operation includes: It is preferable that the operation outputs a sound corresponding to the type of detected odor as a sound emitted by a character displayed on the video display section.

In this way, communication regarding the type of smell can be reproduced between the character displayed on the video display section and the user. For example, when the smell of cigarettes is detected, a display output operation may be performed to display an image of a character making a motion to smoke, or an audio output operation may be performed to utter words that concern the user's health. Furthermore, when the smell of a fragrance such as aroma oil is detected, an audio output operation that asks a question regarding the fragrance may be performed. By performing such control, the range of communication between the character displayed on the video display section and the user can be expanded, and the user's attachment to the character can be increased.

(30) Further comprising a voice detection means capable of detecting voice and a detection means capable of detecting the presence of a person in the detection target area, the voice detection means detecting the presence of a person in the detection target area. It is preferable to enable voice recognition for interacting with the character displayed on the video display section.

In this way, when the user interacts with the character displayed on the video display, the user does not need to utter a trigger word to enable voice recognition, for example, and communication can occur more naturally. .

(31) a wind detection means for detecting wind; a display output operation for displaying on the video display section an image of a character making a movement according to the detection result by the wind detection means; It is preferable to further include an operation control means for performing at least one of a voice output operation of outputting the voice produced by the character displayed on the video display section as a voice emitted by the character.

In this way, communication regarding the wind applied to the display device between the character displayed on the video display section and the user can be reproduced. The wind may be generated artificially by the user, for example, by moving a body part such as waving a hand toward the display device, or by blowing on the user's breath.

(32) The operation control means may perform the display output operation or the audio output operation in response to the user's breath based on the detection result by the wind detection means.

In this way, it is possible to reproduce communication between the character displayed on the video display section and the user in accordance with the breath blown onto the display device.

The inventions shown in (1) to (32) above can be combined arbitrarily. For example, a configuration may be adopted in which at least a part of the configuration of at least one invention described in (2) and subsequent ones is added to all or part of the configuration of the invention shown in (1). In particular, it is preferable to create an invention in which at least a part of the structure of at least one invention after (2) is added to the invention shown in (1). Alternatively, arbitrary configurations may be extracted from the inventions shown in (1) to (32) and the extracted configurations may be combined. The applicant of this application intends to acquire rights to inventions containing these structures. Furthermore, even if there is a description of "in the case of" or "at the time of", the description is not intended to be limited to those cases or times. These are examples of better configurations, and we intend to acquire rights to these cases and other configurations as well. Furthermore, the sections described in order are not limited to this order. It also discloses a configuration in which some parts have been deleted or the order has been changed, and we have the intention to acquire the rights.

According to the present invention, the visual effects of the display device can be enhanced.

The effects of the invention of the present application are not limited to these, but the effects obtained from the parts of the structure disclosed in the specification, drawings, etc. are also disclosed, and the rights to the structure that produces the effects have also been acquired through divisional applications, amendments, etc. have the intention to For example, in this specification, a portion where it is written as "can be done" is a statement that clearly indicates the effect to be achieved, and there are parts that show an effect even if there is no mention of "can be done". Further, even without such a description, there are effects that can be understood from the configuration.

FIG. 1 is a diagram illustrating an overview of a display device according to an embodiment. FIG. 1 is a diagram illustrating an overview of a display device according to an embodiment. FIG. 3 is a diagram illustrating a character according to an embodiment. FIG. 1 is a diagram showing an external configuration of a display device according to an embodiment. FIG. 1 is a diagram showing an external configuration of a display device according to an embodiment. FIG. 1 is a diagram showing an external configuration of a display device according to an embodiment. FIG. 1 is a front view of a display device according to an embodiment. FIG. 2 is a right side view of a display device according to an embodiment. FIG. 1 is a left side view of a display device according to an embodiment. FIG. 1 is a plan view (top view) of a display device according to an embodiment. FIG. 2 is a rear view of a display device according to an embodiment. FIG. 2 is a bottom view of a display device according to an embodiment. FIG. 3 is a rear view of the display device according to one embodiment when the rear cover is removed. FIG. 2 is a diagram illustrating an example of how a display device according to an embodiment is used. FIG. 2 is a diagram illustrating a principle regarding display of a display device according to an embodiment. FIG. 2 is a diagram illustrating the internal configuration of a display device according to an embodiment. FIG. 2 is a diagram illustrating the internal configuration of a display device according to an embodiment. FIG. 2 is a diagram illustrating the internal configuration of a display device according to an embodiment. FIG. 2 is a diagram illustrating the internal configuration of a display device according to an embodiment. FIG. 2 is a diagram illustrating the internal configuration of a display device according to an embodiment. FIG. 2 is a diagram illustrating the internal configuration of a display device according to an embodiment. FIG. 2 is a diagram illustrating the internal configuration of a display device according to an embodiment. FIG. 2 is a diagram illustrating the internal configuration of a display device according to an embodiment. FIG. 2 is a diagram illustrating the internal configuration of a display device according to an embodiment. FIG. 2 is a diagram illustrating the internal configuration of a display device according to an embodiment. FIG. 2 is a diagram illustrating the internal configuration of a display device according to an embodiment. FIG. 2 is a diagram illustrating the internal configuration of a display device according to an embodiment. FIG. 2 is a diagram illustrating the internal configuration of a display device according to an embodiment. FIG. 2 is a diagram illustrating the internal configuration of a display device according to an embodiment. FIG. 3 is a diagram illustrating a reason why a virtual image is displayed on a display device according to an embodiment. FIG. 3 is a diagram illustrating the cause of reflection in a display device according to an embodiment. FIG. 2 is a diagram illustrating the principle of displaying a virtual image and suppressing reflections of a display device according to an embodiment. FIG. 3 is a diagram illustrating the cause of a virtual image being displayed on a display device. FIG. 1 is a front view of a display device according to an embodiment. FIG. 2 is a control block diagram in a display device according to an example. (A) A flowchart for reproducing communication regarding smell, and (B) a diagram showing a voice management table regarding smell. It is a flowchart for reproducing communication regarding the frequency of stay. (A) A flowchart for reproducing communication regarding the place of stay, and (B) a diagram showing a voice management table regarding the place of stay. (A) A flowchart for reproducing communication regarding the number of stays, and (B) a diagram showing a voice management table regarding the number of stays. (A) A flowchart for reproducing communication regarding the stay time, and (B) a diagram showing a voice management table regarding the stay time. (A) A flowchart for reproducing communication related to behavior patterns, and (B) a diagram showing a voice management table related to behavior patterns. It is a flowchart for reproducing operations related to suspicious person detection. FIG. 2 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. FIG. 2 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. FIG. 2 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. FIG. 2 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. FIG. 2 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. FIG. 2 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. FIG. 2 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. FIG. 2 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. FIG. 2 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. FIG. 2 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. FIG. 2 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. FIG. 2 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. FIG. 2 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. FIG. 2 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. FIG. 2 is a diagram illustrating an example of an image displayed on a display device according to an embodiment.

Hereinafter, embodiments will be described in detail with reference to the drawings. The embodiments shown below are examples of the embodiments of the present disclosure, and the present disclosure is not limited to these embodiments. In the drawings referred to in this embodiment, the same parts or parts having similar functions are denoted by the same or similar symbols (codes with A, B, etc. after the number), and their repetitions are indicated. The explanation may be omitted. Further, in each figure referred to in the following description, the scale may be different from the actual scale in order to make each member, each region, etc. recognizable.

<1. Overview of display device 1>
FIGS. 1A and 1B are diagrams illustrating an overview of a display device according to an embodiment of the present invention. The display device 1 displays an image so that an observer can observe the image through the observation area SC. In this embodiment, observation may be interpreted to mean seeing or visually observing. An observer is a user who uses the display device 1, and is, for example, a person who observes an image displayed on the display device 1. The observation area SC is an area provided on the front side of the display device 1, and is a rectangular area here. The display device 1 displays images by aerial imaging. Aerial imaging refers to forming an image in the air using, for example, reflection of light. Aerial imaging is sometimes employed to give viewers the feeling that images are floating in a predetermined space. Images displayed by aerial imaging are called aerial images.

In the case shown in FIG. 1A, the display device 1 displays the character 1100 as an aerial image. Character 1100 is a female character. The display device 1 further displays a stage image 2100 indicating a stage below the character 1100. The stage image 2100 here shows a magic circle. An observer who sees such a display can get the impression that the character 1100 is standing on the stage. The colors of the character 1100 and the stage image 2100 are not particularly limited. For example, the skin of character 1100 is flesh-colored. The hair color and upper body costume of the character 1100 are a relatively light blue color (for example, light blue), the ornaments on the knees are a darker blue color (for example, blue), and the skirt and shoes are a relatively light blue color (for example, light blue). It is white. The stage image 2100 is a relatively dark blue color (for example, dark light blue).

In the case shown in FIG. 1B(a), the display device 1 displays the character 1200 as an aerial image. Character 1200 is a cat character. In the case shown in FIG. 1B(b), the display device 1 displays a stage image 2200 indicating a stage below the character 1200. In the stage image 2200, a character string "Yupiteru" and a character string indicating "Juno" (referred to as "Yuno"), which is the name of the character 1200, are alternately arranged along the outer periphery of a circular stage. It is written.

The colors of the character 1200 and the stage image 2200 are not particularly limited. Here, the character 1200 and the stage image 2200 will be described in more detail with reference to FIG. 1C. The character 1200 is roughly divided into a character body 1210 and a collar 1220. The character body 1210 is the cat character itself whose name is "Juno" here. The character main body 1210 includes body parts shown in white, such as the area between the eyebrows, around the nose and mouth, the abdomen, and the front side of the legs. Among the body parts of the character body 1210, the parts shown in light gray are relatively light brownish colors (for example, ocher), such as the parts above and beside the eyes of the face, This applies to the upper part of the torso and parts other than the front side of the legs. Of the body parts of the character body 1210, the parts shown in darker gray are in a darker brown color (for example, brown), and are shown by thin lines on the face, head, body, and legs, for example. This corresponds to the area with the striped pattern. The collar 1220 means a collar displayed at the neck position of the character body 1210. The collar 1220 is a red color (for example, red). A tag 1221 is attached to the collar 1220 below the face of the character body 1210. The tag 1221 is circular and has a predetermined symbol written on it. The mark is a mark with a "●" (a circle with a filled inside) placed below a "V" symbol, each of which is written in a red color (for example, red). It is a chapter. The mark written on the tag 1221 may function as a trademark indicating the origin of the display device 1. The stage image 2200 has a brownish color as a whole, the circle and character string are a relatively dark brownish color (for example, brown), and the image imitating smoke inside the circle is a lighter brownish color (for example, yellow ocher).

In FIGS. 1A, 1B, and 1C, the backgrounds of the characters 1100 and 1200 are shown in black, but the backgrounds are not limited to pure black, and are relatively dark (for example, black or other dark colors). You can also use it as

The characters shown in FIGS. 1A, 1B, and 1C are examples. When displaying a humanoid character, the display device 1 is not limited to displaying a female character, and may display a male character. The display device 1 displays real people (e.g., family members), people who existed in the past (e.g., historical figures), and fictional characters (e.g., characters appearing in works of fiction such as manga and anime). etc.) may be displayed. When displaying non-humanoid animal characters, the display device 1 is not limited to cat characters, but also animal characters that can be kept in general households such as dogs and hamsters, other animal characters such as horses and cows, Also, any of the fictional animal characters (for example, characters appearing in manga, anime, and other works of fiction) may be displayed. Furthermore, the display device 1 may display another character having a collar 1220.

The display device 1 moves the body parts of the character and outputs sounds imitating the character's speech based on the communication function. The communication function is a function that reproduces communication between an observer and a character, or a function that reproduces pseudo communication. In the communication function, the character moves in response to the viewer's behavior (for example, speech or body movement). For example, the character 1100 performs actions that reproduce actions that humans normally perform, such as moving the entire body, such as dancing, and changing facial expressions (for example, expressing emotions of joy, anger, sadness, and happiness). For example, the character 1200 moves in a manner that reproduces the movements normally performed by animals (eg, yawning, moving its tail, walking, etc.). Further, the display device 1 outputs, for example, a singing sound as if the character 1100 is singing, or outputs a sound related to a dialogue with an observer, in accordance with the movement of the character 1100. For example, the display device 1 outputs a sound representing a cat's meow or a sound related to a dialogue with an observer in accordance with the movement of the character 1200. Such video and audio output is not limited to the communication function, and may be performed using various functions that the display device 1 has.

Dialogue with the user in the communication function is performed, for example, between a voice recognition application (an application having a voice recognition engine function) built into the display device 1, an external voice recognition server (not shown), and an external dialogue server (not shown). It would be good if this could be achieved through collaboration. For example, when an operation unit 2214, which will be described later, is pressed, a voice recognition application is started and voice recognition for interacting with a character is enabled. In this embodiment, enabling voice recognition means activating the voice recognition function, for example, turning on the voice recognition engine and putting it in a state of waiting for voice input. Then, the voice emitted by the user (also referred to as user voice) is transmitted from the communication control circuit 706 of the processing board 224 (described later) to the voice recognition server, and the voice recognition server executes voice recognition processing on the user voice. Speech recognition results are output. For example, in the dialogue server, for each character string that can be input, the voices (also referred to as character voices) emitted by the characters (for example, the character 1100) displayed on the display device 1 (for example, the video display section described below) are associated with each other. It has been registered in advance. Then, the voice recognition result (for example, the voice recognition result indicated by a character string) by the voice recognition server is input to the dialogue server, and the character voice corresponding to the voice recognition result is output from the dialogue server. Then, the character voice output by the dialogue server is output from the display device 1. In this way, the response process to the user's voice is executed, and the interaction between the user and the character is reproduced.

The display device 1 is used by general users as a display device for entertainment, for example. In this case, the display device 1 is used at the user's residence, such as the user's home, for example. The present invention is not limited to this, and the display device 1 may be used for commercial purposes (for example, for advertising) and other purposes. For example, in the case of commercial use, the display device 1 is installed in a public place such as a store or other commercial facility. The display device 1 may display images in which characters introduce or advertise products or services at a venue such as a product or service exhibition. The display device 1 may be used for purposes other than these.

<2. External configuration of display device 1>
2, 3, and 4 are perspective views showing the external configuration of the display device 1. As shown in FIG. FIG. 2 is a diagram of the display device 1 viewed diagonally from the front right. FIG. 3 is a view of the display device 1 viewed from slightly above the diagonally left front side. FIG. 4 is a view of the display device 1 viewed from diagonally forward right and slightly below. FIG. 5 is a front view of the display device 1. FIG. 6 is a right side view of the display device 1. FIG. 7 is a front side view of the display device 1. FIG. 8 is a plan view (top view) of the display device 1. FIG. 9 is a bottom view of the display device 1. FIG. 10 is a rear view of the display device 1.

The display device 1 has a rectangular parallelepiped appearance. The display device 1 has a housing 100. The housing 100 is a box-shaped member that forms the outer shape of the display device 1 . The housing 100 has a rectangular parallelepiped shape. The housing 100 is longer in the height direction (also referred to as the vertical direction) than in the width direction (also referred to as the horizontal direction). The length of the housing 100 in the width direction and the depth direction (also referred to as the front-back direction) is approximately the same. The ratio of the lengths of the display device 1 in the width direction, height direction, and depth direction (also referred to as the front-back direction) is approximately 2:3:2. In the following explanation, the side where the viewer is located in the depth direction of the display device 1 is the "front side" (corresponding to the first direction side), and the opposite side is the "back side" (corresponding to the second direction side). ).

The housing 100 has rounded corners. As shown in FIG. 5, when the display device 1 is viewed from the front side, each of the four corners of the housing 100 is rounded. The surface of the casing 100 is preferably treated with a matte finish to give it a textured appearance. In this way, a rectangular parallelepiped display device 1 with excellent design is provided. The housing 100 is preferably made of resin material, but may also be made of metal or other materials. The housing 100 has a light-blocked video display space inside. The video display space is a space inside the housing 100 in which an aerial video is displayed (formed). The entire or most part of the image display space is formed of a light-shielding member. Therefore, the members constituting the housing 100 prevent external light from entering the image display space. For example, the entire housing 100 may be made of a material that blocks external light, or the outer surface or the surface facing the image display space may be covered with a material that blocks light. . Although the color of the outer surface of the housing 100 does not matter, it may be white or black, which gives off a sense of luxury or simplicity, for example. The display device 1 is preferably of such a size and weight that a person such as an observer can carry it alone.

Portions of the housing 100 that are exposed to the outside are divided into a right panel 101, a front panel 102, a left panel 103, a back panel 104, an upper lid portion 105, and a lower lid portion 106. The right side panel 101, the front side panel 102, the left side panel 103, the back side panel 104, the upper lid part 105, and the lower lid part 106 are plate-shaped members. The right panel 101 is a panel located on the right side of the housing 100 when viewed from the front side. The left panel 103 is a panel located on the left side of the housing 100 when viewed from the front side. The right panel 101 and the left panel 103 have the same shape and dimensions. Further, the right panel 101 and the left panel 103 are symmetrical in the height direction, and a mold for forming the right panel 101 and the left panel 103 can be shared. Therefore, the right panel 101 and the left panel 103 can use common members, which can be expected to reduce costs and assembly work.

The front panel 102 is located on the front side of the display device 1. The front panel 102 has an opening 110 into which the light attenuation member 200 can be attached. The observation area SC is provided on the front panel 102. The observation area SC is an area observed by an observer who views an image displayed on the display device 1. The observation area SC is also an area where the opening 110 formed in the housing 100 exists. A light attenuation member 200 is provided in the observation area. The light attenuation member 200 is provided vertically so as to close the opening 110. The light attenuation member 200 and the opening 110 are provided above the center of the housing 100 in the height direction when viewed from the front side of the display device 1. Light attenuation member 200 and opening 110 are square or rectangular.

The light attenuation member 200 includes a rectangular (or square) first area 210 used for viewing images, and a second area 220 surrounding the first area 210. Since the second area 220 is an edge portion and is not used for image observation, it may be an area that does not transmit light. Therefore, the observation area SC can also be called an area where the first area 210 exists. In the following description, when the light attenuation member 200 is referred to, it may be understood that the first region 210 is referred to.

The light reduction member 200 is an optical member that reduces external light entering the image display space from the observation area SC. The light reduction member 200 is provided to maintain the image display space in a dark state. The light attenuation member 200 is provided to suppress the occurrence of reflection in which the viewer himself or herself is reflected in the observation area SC, and to make it difficult for the viewer to observe components inside the video display space. The light attenuation member 200 is a plate-shaped (including panel-shaped) member, but may also be a member called a sheet-shaped, film-shaped, or the like. The light reduction member 200 may be a member called a smoke panel, a smoke film, or the like. The light attenuation member 200 has, for example, a light transmittance of 24% and a thickness of about 2 mm. The light attenuation member 200 has a light transmittance that does not interfere with observation of the image displayed in the image display space of the display device 1. The light attenuation member 200 is a semitransparent member in a dark color such as black, but may be in a blue or other color.

The information area ST is provided below the observation area SC (the light attenuation member 200 and the opening 110) in the front panel 102. The information area ST is located in an opening made in the front panel 102. The information area ST is an area where predetermined information is collected using a sensor or where predetermined information is presented to an observer. Electronic components provided in the information area ST include a first sensor 2331, a second sensor 2332, a microphone 2333, and a light emitting section 2334. The first sensor 2331 is a gesture sensor that detects gestures performed by the observer. The second sensor 2332 includes one or more sensors other than the gesture sensor. Examples of the second sensor 2332 include a gas sensor (odor sensor), a temperature sensor, and an illuminance sensor. The microphone 2333 collects sound and converts the collected sound into an audio signal. The light emitting unit 2334 presents predetermined information by emitting light. The light emitting unit 2334 includes, for example, a light emitter (for example, a light emitting diode) that emits light in a predetermined color and a light guide member that guides the light emitted by the light emitter. In this embodiment, the light guide member of the light emitting unit 2334 is arranged so as to surround the area where the first sensor 2331, the second sensor 2332, and the microphone 2333 are provided. The light emitting unit 2334 emits light in, for example, a blue color (for example, light blue), but may be configured to emit light in one or more of green, red, and other colors. The light emitting unit 2334 is not limited to a configuration having a light guide member, and may emit light in a predetermined area by having a configuration including a plurality of light emitters, for example.

An operation area OT is provided in the upper lid portion 105. The operation area OT is an area that accepts operations performed by the observer. The operation area OT is an area in which operation units 2211, 2212, 2213, and 2214 are provided. The operation units 2211, 2212, 2213, and 2214 are switches that each accept a press operation. The operation unit 2211 is operated when instructing to turn on or turn off the power of the display device 1. The operation unit 2212 is operated when instructing to increase the volume. The operation unit 2213 is operated when instructing to lower the volume. The operation unit 2214 is operated when instructing execution of a predetermined function. The operation unit 2214 may be, for example, an operation unit called a special key. The operation unit 2214 may be operated, for example, when instructing the display device 1 to start voice recognition. The upper lid portion 105 is provided with openings corresponding to the positions where the operation portions 2211, 2212, 2213, and 2214 are provided. The operation parts 2211, 2212, 2213, and 2214 are exposed to the outside by being located in each opening. Note that the number of operation units, functions assigned to the operation units, and acceptable operation methods described here are merely examples.

A human sensor 234 is provided on the lower lid portion 106. The human sensor 234 is exposed to the outside by being located in the opening of the lower lid part 106. The human sensor 234 is a detection unit that detects the presence of a person (moving object) in the detection target space. The human sensor 234 is a microwave Doppler sensor in this embodiment, and emits microwaves, and detects the presence of a person in the detection target space based on the reception intensity of the microwaves that are reflected waves. For example, the human sensor 234 detects whether a person is present in front of the display device 1.

The back panel 104 of the display device 1 is provided with a power jack 2311 and a rear cover 1041. The power jack 2311 is a jack to which a power cord is connected. The power jack 2311 receives power from an external power source or the like via a power cord. The rear lid portion 1041 is a removable lid portion. When the rear lid part 1041 is removed, the slot 222 and the USB (Universal Serial Bus) connector 223 are exposed, as shown in FIG. The slot 222 is a mounting section into which an external storage medium is mounted. The external storage medium complies with, for example, the microSD (registered trademark) standard, but may also comply with the microSDHC, other SD card-related standards, or other standards. The USB connector 223 is a mounting portion into which a USB cable or a USB port of an external device compliant with the USB standard is mounted. The display device 1 can input and output data to and from external devices via the slot 222 and the USB connector 223. The number of attachment parts may be even greater. Since the portions of the slot 222 and the USB connector 223 that are exposed to the outside of the housing are on the back side of the display device 1, they can be made difficult to be observed by the viewer. Further, the number of mounting parts to which external devices are mounted and the corresponding standards are not particularly limited.

The housing 100 is configured by combining a right side panel 101, a front side panel 102, a left side panel 103, a back side panel 104, an upper lid part 105, and a lower lid part 106. In this embodiment, as a coupling method, screwing using a screw, which is an example of a fixing device, is employed. However, there are no screwed locations on the front panel 102 and the upper lid portion 105.

The right panel 101 is fastened with screws 710 and 720 at two locations on the front side, top and bottom. The left panel 103 of the housing 100 is fastened with screws 730 and 740 at two locations on the front side, upper and lower. On the back side panel 104, it is screwed at three places on the upper side with screws 751, 752, and 753, screwed on two places near the center in the height direction with screws 754, 755, and three places on the lower side. It is screwed in place with screws 756, 757, and 758. The lower lid portion 106 is screwed at two locations on the front side with screws 761 and 762. The front panel 102 and the top lid part 105 are parts that are relatively easily observed by an observer using the display device 1. On the other hand, other parts are relatively difficult to be observed by an observer using the display device 1. Therefore, according to the display device 1, it is possible to prevent the screwed parts from being observed by an observer and maintain the aesthetic appearance of the display device 1. Doing this can also contribute to giving the viewer a sense of immersion in the video.

FIG. 12 is a diagram illustrating an example of how the display device 1 is used by an observer. FIG. 12 shows the positional relationship between the display device 1 and the observer U using the display device 1, as viewed from the left side of the display device 1. The display device 1 is placed on a desk 3000. A chair 3100 is arranged on the front side (front side) of the display device 1. Observer U is seated on chair 3100 facing toward display device 1 . In this example, the position of the eyes of the observer U is higher than the top surface of the display device 1. Therefore, the observer U observes the observation area SC while looking down at the angle θ. The angle θ is the angle between the horizontal direction and the line of sight direction of the observer U. The angle θ is within the range of θ1 or more and θ2 or less. The angle θ is, for example, 15 degrees. The horizontal distance between the observer U and the observation area SC is approximately 50 cm.

<3. Principle regarding display of display device 1>
FIG. 13 is a diagram illustrating the principle of display on the display device 1. FIG. 13 shows a schematic diagram of the inside of the display device 1 viewed from the left side of the display device 1. A first display section 310, an optical member 320, and a second display section 330 are provided in the video display space S1 inside the housing 100. The first display section 310 and the optical member 320 cooperate to form an image display section that forms an aerial image in the image display space S1.

The first display section 310 and the second display section 330 are display sections that display images. The first display section 310 and the second display section 330 are display sections each having a light source, and are, for example, liquid crystal displays. The light source is a backlight. The first display section 310 and the second display section 330 display a color (multicolor) image based on the three primary colors of red (R), green (G), and blue (B). The first display section 310 and the second display section 330 display images that are recognized as two-dimensional images in this embodiment.

The first display section 310 is an 8-inch liquid crystal display. For example, in this case, the first display section 310 includes a backlight, which is an example of a light source, and a display body in which liquid crystal elements, which are examples of display elements, are two-dimensionally arranged. The light source is, for example, a white light source. A liquid crystal element modulates light from a backlight on a pixel-by-pixel basis. A liquid crystal element has, for example, a structure in which liquid crystal molecules are sandwiched between a pixel electrode provided for each pixel and a common electrode common to a plurality of pixels. The first display section 310 has a first display surface 311 that emits the first image light L1. In FIGS. 1A to 1C, the first display unit 310 emits image light for displaying the characters 1100 and 1200. The first display unit 310 is arranged so that one end on the observation area SC side is located above the observation area SC, and the first display unit 310 is inclined so that the back side is lower. This inclination is equal to the inclination of the first display surface 311, and is approximately 20 degrees with respect to the horizontal plane. If the tilt is approximately 20 degrees in this way, the three-dimensional effect of the aerial image that can be given to the viewer can be enhanced, and the first image light L1 is reflected by the light attenuation member 200 and formed in the image display space. The inventor has obtained the knowledge that it is possible to make a virtual image more difficult to observe. The basis for this will be discussed later. However, this angle is just an example. In the width direction of the display device 1, the height of each position of the first display surface 311 is the same.

The optical member 320 is an example of an optical system that forms an aerial image based on the first image light L1 from the first display section 310. The optical member 320 has light transmittance and light reflectivity. Optical member 320 is plate-shaped. The optical member 320 is a half mirror here. The optical member 320 is made of acrylmeter and has a light transmittance of about 30%. The thickness of the optical member 320 is approximately 2 mm. The light transmittance is just an example, and may be set to 6%, for example, as long as the transmittance is sufficient to allow the viewer to observe the aerial image displayed in the image display space S1. The optical member 320 is arranged at an angle with respect to the opening 110 and the first display surface 311 in the video display space S1. The optical member 320 is inclined so that the tip on the observation area SC side is located below the observation area SC, and becomes higher toward the back side. This inclination is 35 degrees with respect to the horizontal plane. However, this angle is just an example. In the width direction of the display device 1, the height of each position of the optical member 320 is the same.

The second display section 330 is a 7-inch liquid crystal display. The second display section 330 has a second display surface 331 that emits second image light L2 of the displayed image. The second display unit 330 displays a video V2 corresponding to the stage videos 2100 and 2200 in FIGS. 1A and 1B. The second display section 330 is arranged so that the normal direction of the second display surface 331 faces upward. The second display surface 331 is located closer to the back side than one end of the lower side of the optical member 320. A pedestal section 400 is provided on the front side of the second display surface 331. The pedestal section 400 forms part of a member constituting the video display space S1 of the housing 100. The upper surface of the pedestal section 400 is located at approximately the same height as the second display surface 331, but the second display surface 331 may be slightly lower.

With the above configuration, the first image light L1 emitted by the first display section 310 is incident on the first surface 321 of the optical member 320 at a predetermined angle. The incident first image light L1 is reflected by the optical member 320 toward the front side of the display device 1 at the predetermined angle. Due to this reflected light L1r, an aerial image V1 is recognized in the image display space S1 of the housing 100. The aerial image V1 is a virtual image recognized below the tip of the back side of the first display surface 311, for example, below the intersection of the first display surface 311 and the optical member 320.

The second image light L2 emitted by the second display section 330 enters the second surface 332 of the optical member 320 and is transmitted to the first surface 321 side. The second image light L2 directly enters the observer's eyes. The image V2 on the second display surface 331 is a real image that is recognized as being located below the aerial image V1. For example, the aerial image V1 is recognized at the center of the second display surface 331 in the front-rear direction. In this way, the aerial image V1 is recognized as the characters 1100, 1200 in FIGS. 1A to 1C, and the image V2 is recognized as the stage images 2100, 2200 in FIGS. 1A to 1C. According to the display device 1, the viewer is given a three-dimensional effect by having the viewer observe the aerial image V1 combined using the optical member 320, and the three-dimensional effect is given to the viewer by having the viewer observe the image V2 below the aerial image V1. It can enhance the feeling. In addition, by using the second display unit 330, the viewer has more freedom in selecting the image to be observed along with the aerial image, compared to a case where a light emitting body and a light guiding member are combined to emit light in a predetermined pattern. can be increased.

It is desirable that the first display surface 311 of the first display unit 310 is provided with a viewing angle control member 312 that narrows the viewing angle toward the front side. In this way, even if the viewer approaches the observation area SC and looks up, it is possible to prevent the image displayed on the first display surface 311 from being directly observed by the viewer. Regarding the second display surface 331, a viewing angle control member that narrows the viewing angle toward the front side is not provided so that the viewer can easily observe the image V2.

The basic display principle of the display device 1 is as described above. Furthermore, the display device 1 includes a light attenuation member 200 and a light shielding member 500 as a configuration for enhancing its visual effect. Its action and effect will be described later.

<4. Internal configuration of display device 1>
Next, the internal configuration of the display device 1 will be explained. 14, FIG. 15, FIG. 16, FIG. 17, and FIG. 18 show the housing 100 with the right side panel 101, front side panel 102, left side panel 103, and back side panel 104 removed. It is a diagram. As shown in FIG. 14, by removing the right panel 101, the right inner panel 107 is exposed. As shown in FIG. 15, by removing the front panel 102, the front inner panel 108 is exposed. As shown in FIG. 16, by removing the left panel 103, the left internal panel 109 is exposed. As shown in FIG. 16, by removing the back side panel 104, the wiring section 800 and the partition member 900 are exposed.

The right internal panel 107 and the left internal panel 109 hold the first display section 310 and the optical member 320 described in FIG. 13 by sandwiching them from both left and right sides.

The screws 710 and 720 shown in FIGS. 2, 4, and 6 sequentially pass through the holes H1 and H2 that pass through the right panel 101, the front inner panel 108, and the right inner panel 107 to connect them. The screws 730 and 740 shown in FIGS. 3 and 7 sequentially pass through the holes H3 and H4 that pass through the left panel 103, the front inner panel 108, and the left inner panel 109 to connect them. The screws 751, 752, and 753 shown in FIG. 10 fix the back side panel 104 and the top lid part 105. Screws 754 connect back side panel 104 and right side panel 101. The screws 755 fix the rear side panel 104 and the left side panel 103. The screws 765, 765, and 757 fix the back side panel 104 and the lower lid part 106.

19, FIG. 20, FIG. 21, FIG. 22, FIG. 23, and FIG. 24 are views showing the state in which the right inner panel 107 and the left inner panel 109 are further removed. FIG. 19 is a diagram showing the display device 1 viewed from the right side. FIG. 20 is a diagram showing the display device 1 viewed from the left side. FIG. 21 is a diagram showing the display device 1 viewed from diagonally below on the right side. FIG. 22 is a diagram showing the display device 1 viewed diagonally from above on the right side. FIG. 23 is a diagram showing the display device 1 viewed diagonally from below on the left side surface side. FIG. 24 is a diagram showing the display device 1 viewed diagonally from above on the left side.

Inside the housing 100, a first display section 310, an optical member 320, a second display section 330, a pedestal section 400, and a light shielding member 500 are provided. The first display section 310, the optical member 320, the second display section 330, and the pedestal section 400 have the same configuration as described using FIG. 13.

The light shielding member 500 is provided on the optical path of the reflected light reflected from the light attenuation member 200 out of the first image light L1 from the first display section 310. The light shielding member 500 is configured to prevent the reflected light from entering the optical member 320 at one end of the optical member 320 on the light attenuation member 200 (observation area SC) side, in other words, from the first display section 310. Cover one end of the far side. The light shielding member 500 is, for example, a member that absorbs visible light, but may be any member that prevents transmission of the first image light L1. The light shielding member 500 may be made of, for example, black or another dark color, but may be made of other colors. The reason for doing this will be described later, but it prevents the viewer from observing the image (virtual image) formed in the image display space S1 by the reflection of the first image light L1 by the light reduction member 200. It's for a reason. In particular, it is possible to suppress images that may be observed when an observer looks into the image display space S1 from the observation area SC. In addition to this image, external objects such as the ceiling are also suppressed from being observed. Although the upper surface of the light shielding member 500 is approximately horizontal, it is not limited thereto.

A first plate 601 is provided above the first display section 310, and a first accommodation space S2 (see FIGS. 19 and 20) for accommodating various components is formed above the first plate 601. Further, a second plate 602 is provided below the second display section 330, and a second storage space S3 (see FIGS. 25 to 27) for various components is formed below the pedestal section 400 and the second plate 602. ing.

As shown in FIGS. 17 to 24, the first accommodation space S2 is a space separated from the video display space S1 by a first plate 601 provided on the first display section 310. The first plate 601 is coupled to the right interior panel 107 using screws 791, 792, 793 and to the left interior panel 109 using screws 794, 795, 796. The first accommodation space S2 is provided with an operation board 221, a processing board 224, speakers 2251, 2252, and a holding part 226. The operation board 221 is a board on which operation units 2211, 2212, 2213, and 2214 are mounted. The operation board 221 supplies signals corresponding to the operations of the operation units 2211, 2212, 2213, and 2214 to the processing board 224. The processing board 224 functions as a processing board that controls the display device 1. The processing substrate 224 may be called a main substrate. The processing board 224 is electrically connected to the operation board 221 and the speakers 225A and 225B via, for example, a printed wiring board (for example, FPC). The processing substrate 224 is located on the back side of the first accommodation space S2 in the depth direction of the display device 1. The processing board 224 is a so-called SoC board, and operates a processor and an OS (Operating System). The processing board 224 uses the OS to read signals from sensors mounted on the sensor board 233 and audio signals from the microphone 2333, and acquires signals from the operation board 221 according to operations on the operation units 2211, 2212, and 2213. do. The processing board 224 controls the first display section 310 and the second display section 330 to display images. A slot 222 and a USB connector 223 are mounted on the processing board 224 and exposed from the back side of the display device 1 .

The speakers 2251 and 2252 are provided on both the left and right sides when viewed from the front side, and emit sound to the outside through openings 1051 and 1052 formed in the upper lid portion 105. It is desirable that the speakers 2251 and 2252 are not too far away from the processing substrate 224. It is desirable that the speakers 2251 and 2252 be spaced apart so that their sounds do not interfere with each other as much as possible.

The holding portion 226 is provided at a position overlapping the processing substrate 224 and holds the processing substrate 224 on its lower surface. A heat sink 2261 for heat radiation or heat absorption is provided on the upper surface of the holding portion 226 on the side opposite to the side that holds the processing substrate 224. The first display section 310 and the first plate 601 are inclined downward from the front side to the back side. For this reason, the first accommodation space S2 has a dimension in the height direction that gradually increases from the front side to the back side, and there is more room in the height direction toward the back side. By utilizing this, thick members such as the processing substrate 224 and the holding portion 226 are accommodated. This prevents the casing portion above the viewing area SC from becoming longer, which contributes to the reduction in weight and size of the display device 1, and is also desirable in terms of design.

25, 26, and 27 are diagrams showing the internal configuration of the display device 1 when the lower lid portion 106 is removed. A second plate 602 is provided below the pedestal section 400 and the second display section 330. A second accommodation space S3 is formed between the second plate 602 and the lower lid part 106. A control board 231, wiring 232, a sensor board 233, and a human sensor 234 are provided in the second accommodation space S3. Front interior panel 108 is coupled to second plate 602 using screws 771, 772, 773, 774. The front internal panel 108 is coupled to the lower lid portion 106 using screws 775, 776, and 777. The front internal panel 108 is fixed using screws 771 to 777, but when the display device 1 is used, it is covered by the front panel 102, so the screws 771 to 777 are exposed on the front side. do not.

The control board 231 controls the supply of power and signals to the display device 1 . The control board 231 is electrically connected to the processing board 224 via the wiring section 800, and sends and receives various signals and supplies power to the processing board 224. Control board 231 is electrically connected to sensor board 233 and human sensor 234 via wiring 232 . The wiring 232 is, for example, a printed wiring board (for example, FPC).

The sensor board 233 is a board on which a first sensor 2331, a second sensor 2332, and a microphone 2333 are mounted. The sensor substrate 233 is provided in a region below the light attenuation member 200 (observation area SC) on the back surface of the front internal panel 108. The sensor board 233 is erected vertically so that its board surface extends in the height and width directions. The sensor of the sensor board 233 may be any sensor as long as it detects predetermined information. The first sensor 2331 is an optical sensor that emits light (for example, infrared light) to the front side and detects the gesture of the viewer by receiving the reflected light. The microphone 2333 collects sound and outputs a sound signal indicating the collected sound. The gas sensor as the second sensor 2332 detects odors such as gas odor and burnt odor. A temperature sensor detects temperature. The illuminance sensor detects illuminance. The first sensor 2331 is located approximately at the center in the width direction of the information area ST. The sensor board 233 outputs signals from the first sensor 2331, the second sensor 2332, and the microphone 2333 to the control board 231 via the wiring 232. The processing board 224 controls, via the wiring section 800 and the control board 231, the light emitting section 2334 to emit light when voice recognition is possible.

The human sensor 234 is arranged at a predetermined interval, such as about 30 cm, on the back side of the front internal panel 108 so as not to contact the front internal panel 108 . This is desirable in order to ensure the detection sensitivity of the human sensor 234. The human sensor 234 is provided slightly to the front side from the center in the depth direction. The human sensor 234 outputs a signal indicating the detection result to the control board 231.

Wiring section 800 includes a power line 810, a signal line 820, and a signal line 830. The wiring section 800 is routed from the bottom of the housing 100 to the top. The wiring section 800 passes between the back side panel 104 and the partition member 900. The control board 231 supplies power to the processing board 224 via the power line 810. The control board 231 sends and receives signals to and from the processing board 224 via the signal line 820. The processing board 224 supplies a signal (for example, a driving signal or a video signal) for driving the second display section 330 via a signal line 830. The power line 810, the signal line 820, and the signal line 830 are provided so as to pass through the spatial region between the partition member 900 and the rear panel 104. A background plate 910 is provided on the front side of the partition member 900. The background plate 910 is, for example, a dark color such as black. The partition member 900 is formed into a plate shape using, for example, a resin material, and is a member that does not transmit light. In this way, the wiring section 800 is not observed from the video display space S1 side.

The processing board 224 functions as an operation control unit that controls the display of the first display section 310 and the second display section 330 and the audio output from the speakers 2251 and 2252 based on the communication function. For example, the processing board 224 controls the display of the first display section 310 and the second display section 330 according to the information measured by the sensor board 233 and the human sensor 234, and controls the sound output from the speakers 2251 and 2252. control the output. For example, when the processing board 224 detects the presence of a person based on the human sensor 234, the processing board 224 may cause the displayed character to perform a greeting gesture or output the voice of the character. When the first sensor 2331 detects a gesture such as moving left/right, up/down, bye-bye, or forward/backward, the processing board 224 controls the display on the first display unit 310 and controls the display from the speakers 2251 and 2252. Control audio output. For example, the processing board 224 rotates the character in that direction in response to a left/right or up/down hand gesture. When the bye-bye gesture is detected, the processing board 224 causes the character to perform a bye-bye motion. When the processing board 224 detects a gesture of moving the hand back and forth, the processing board 224 returns the character display to the default (for example, FIGS. 1A to 1C). The processing substrate 224 changes the display of at least one of the first display section 310 and the second display section 330 according to the illuminance measured by the illuminance sensor. For example, the processing substrate 224 may darken the display when the periphery of the display device 1 becomes dark. The processing board 224 may perform control such as moving the character's eyes based on the illuminance sensor. The processing board 224 controls the display of the first display section 310 and the output of audio from the speakers 2251 and 2252 according to the temperature detected by the temperature sensor. The contents of the character's utterances change depending on whether the surrounding area is hot or cold. Further, the processing substrate 224 controls the light emission of the light emitting section 2334. The processing board 224 changes the volume depending on the operation of the operation units 2211, 2212, 2213, and 2214. Note that the voice engine may be realized by a function of the processing board 224, or may be realized by an external recognition server. In the latter case, the processing board preferably has a communication module that performs wireless LAN or network communication such as Wi-Fi, and communicates with the voice recognition server via it.

The processing substrate 224 makes the light emission brightness of the light source of the first display section 310 brighter than the light emission brightness of the light source of the second display section 330 . In this way, the difference between the luminance of the first display section 310 and the luminance of the second display section 330 can further enhance the three-dimensional effect of the aerial image that can be given to the viewer. This is because the inventor obtained it. If the video display space S1 is bright, the three-dimensional effect may be impaired, so the luminance of the second display section 330 is set low.

The first display section 310 is inclined at approximately 20 degrees with respect to the horizontal direction. This is to prevent the viewer from getting into a position where he or she looks into the screen when sitting on a chair, or from causing display problems in conjunction with the display on the second display section 330. In this way, even when the viewer views the display device 1 from slightly above, the entire display can be seen. Therefore, the observer does not need to look into the image.

In this way, the ceiling will not be reflected by the optical member 320 and observed by the observer, and the aerial image will not overlap with the image on the second display surface 331 and become difficult to see clearly. The effect will be explained. As shown in FIG. 28, it is assumed that the first image lights L31 and L32 are incident on the light attenuation member 200. In this case, the respective reflected waves L31r and L32r of the first image lights L31 and L32 are emitted from the light attenuation member 200 and further reflected by the optical member 320, so that the image V3, which is a virtual image, is observed by the observer. Ru. For example, when the first display unit 310 displays an image of a character, the lower part of the character, for example, the image near the feet may be observed. Further, as shown in FIG. 29, light L4 from the ceiling, lighting, etc. enters the light reduction member 200, passes through it, and is further reflected by the optical member 320, so that the ceiling is reflected near the lower end of the optical member 320. Congestion occurs. In this way, the display quality of the display device 1 may be affected by observing a video other than the original aerial video V1.

Therefore, by arranging the light shielding member 500 on the optical path of the reflected light from the light attenuation member 200 and on the optical path of the light L4 from the ceiling, lighting, etc., the display of the video V3 and the reflection of the ceiling, etc. can be suppressed. As shown in FIG. 30, by providing the light shielding member 500, reflection at the optical member 320 is suppressed, so display of the image V3 and reflection on the ceiling are suppressed. Since the light shielding member 500 is located below the observation area SC and the light attenuation member 200 is also present, the presence of the light shielding member 500 is difficult to be recognized by the observer. For example, assuming that the horizontal distance between the observer and the observation area SC is 50 cm and the angle θ at which the observer's line of sight enters is 35 degrees, a light shielding member 500 is placed on the optical path of the light related to the image V3 and reflections. will be provided. As shown in FIG. 31, if the inclination angle of the first display unit 310 is 10 degrees, the position of the image V3 will be displayed closer to the back side, making it easier to observe the image V3. To suppress this, it is necessary to extend the light shielding member 500 further to the back, which is not desirable. Therefore, it is desirable that the inclination angle of the first display section 310 is 20 degrees.

According to this idea, even without using the light shielding member 500, the optical member 320 may be arranged avoiding the area on the optical path of the reflected light reflected by the light reduction member 200 of the first image light L1. . In this way, it is possible to prevent the viewer from observing a virtual image formed in the video display space by reflection of the first image light L1 by the light attenuation member.

Further, the observer performs a gesture near the first sensor 2331, which is a gesture sensor. In this case, if the first sensor 2331 is located above the observation area SC, the hand making the gesture may get in the way, and observation of the image via the observation area SC may be hindered. In this embodiment, since a sensor such as the first sensor 2331 is provided below the observation area SC, even if a gesture is made while observing the observation area SC, the observation is prevented from being disturbed.

The reason why the image display space S1 is darkened is to make the aerial image appear more three-dimensional. For example, when a specific character is displayed, the dark surroundings can give the character a floating feeling. Further, when viewed from the front side, the observation area SC is surrounded by the housing 100 (front panel 102). In this way, the aerial image displayed in the image display space and the casing located in front of the aerial image are combined to further enhance the stereoscopic effect of the aerial image that can be given to the viewer.

The portion facing the video display space S1 is treated to reduce light reflection (for example, matte finish). In this way, even if external light or other light enters the video display space S1, reflection is suppressed, making it easy to maintain a dark state. It can prevent the interior space from getting too bright. Such processing is preferably performed on part or all of the frames of the background plate 910, the pedestal section 400, the first display section 310, and the second display section 330.

Furthermore, if a joining method using fixing tools such as screws is adopted, the front panel 102 and the front inner panel 108 can be easily removed compared to the case of adhesive, etc., so dust that has entered the image display space can be removed by air. It can also be removed by blow drying or using a soft cloth. On the other hand, since the front panel 102 is not fixed with fixing devices such as screws, it is possible to prevent the viewer from being disturbed by the front panel 102 being observed by the viewer.

<5. Detailed configuration of processing substrate 224>
FIG. 33 is a control block diagram of the processing substrate 224 included in the display device 1 according to one embodiment. As shown in FIG. 33, the processing board 224 includes a CPU 701 that functions as an arithmetic processing unit that executes arithmetic processing, etc., and a memory that includes a RAM 703 used as a work area and a ROM 702 that stores control programs and the like. It is a controller with etc. Note that the processing substrate 224 may be read as, for example, a control unit (an example of an operation control unit). Various programs are stored in the ROM 702 of the processing board 224, and the processing board 224 realizes various functions by executing these programs. For example, the ROM 702 stores a voice recognition application for reproducing the interaction between the user and the character, and the processing board 224 receives input signals from various sensors 234, 2331 to 2332 or the GPS receiver 60, etc. By executing the voice recognition application based on the above, the interaction between the user and the character is reproduced. The processing board 224 also includes a display control circuit 704 that controls images displayed on the display device 1 (specifically, a video display unit), and an audio control circuit 705 that controls audio output from the speakers 2551 and 2552. It has The processing board 224 also communicates with other devices (for example, an external speech recognition server (also referred to as a speech recognition engine) not shown, an external dialogue server (also referred to as a dialogue engine) not shown), etc. It has a communication control circuit 706 that controls communication.

<6. Regarding communication functions related to character 1100>
Below, various controls for reproducing the communication between the character 1100 displayed on the display device 1 (eg, video display unit) and the user will be explained in order with reference to FIGS. 34 to 40.

<About odor-related communication functions>
For example, an odor sensor for detecting odor is provided as the second sensor 2332 in the display device 1, and the processing board 224 executes an audio output operation to output audio as the character voice of the character 1100 according to the detection result by the odor sensor. It's good to do that. For example, some odor sensors output a signal that changes depending on the intensity of a certain odor, or output a signal that changes depending on the components contained in the odor (smell components). For example, the odor sensor outputs a signal that changes depending on the type of odor. The odor sensor is configured to be able to detect the concentration of a specific odor component (tar, ammonia, alcohol, carbon dioxide, etc.) using, for example, a deodorizing filter or the like. In this way, the processing board 224 can reproduce odor-related communication between the character displayed on the video display section of the display device 1 and the user, and more diverse communication between the character and the user can be performed. communication can be reproduced.

For example, the processing board 224 may perform an audio output operation of outputting a sound corresponding to the type of detected odor as the character sound of the character 1100. Note that a single sensor capable of identifying multiple types of odor components may be configured as an odor sensor, and a plurality of sensors capable of discriminating different types of odor components may be configured as an odor sensor. good.

FIG. 34(A) is a flowchart for reproducing communication regarding smell, and FIG. 34(B) is a diagram showing a voice management table regarding smell (also referred to as a voice management table). The audio management table is stored, for example, in the processing board 224 of the display device 1 or in the dialogue server. As shown in FIG. 34(B), the voice management table lists the types of odors that mainly contain the odor components (also called odorants) that can be detected by the odor sensor. and the voice emitted by the character 1100 (referred to as character voice) are registered in advance. For example, in the voice management table, cigarette odor, which mainly contains tar, is registered in association with tar, and when cigarette odor is detected, a character voice saying ``Smoking too much is not good.'' Words that express concern for the user's health, such as "", are registered.

First, in step S11, the processing board 224 (which may also be read as a control unit) determines whether or not an odor has been detected. For example, when the concentration of the odor component detected by the odor sensor exceeds a predetermined threshold value (reference value) regarding a specific odor, the processing substrate 224 determines that the odor component has been detected. In step S12, the processing board 224 determines the type of odor registered in the audio management table in association with the detected odor component. For example, if tar is detected at a concentration exceeding a predetermined threshold, it is determined that cigarette odor has been detected. Then, the processing board 224 outputs character voices from the speakers 2551 and 2552 according to the type of detected odor. For example, when it is determined that a cigarette odor has been detected, the processing board 224 outputs a voice that expresses concern for the user's health (here, "Smoking too much is not good") as a character voice. perform an action. Note that other examples include the following. For example, if the concentration of a specific main component contained in a fragrance such as aroma oil or food exceeds a predetermined reference value, the processing board 224 determines that the odor of the fragrance or food has been detected, and determines the source of the odor. The question voice is output as a character voice. Additionally, if alcohol exceeding a predetermined standard value is detected, the processing board 224 determines that an alcohol odor has been detected, and responds with messages such as ``The alcohol tastes bad'' or ``You've been drinking again. The voice of the character 1100 is output as the character voice of the character 1100. Further, when a component of bad breath (for example, hydrogen sulfide, methyl mercaptan, dimer sulfide, etc.) exceeding a predetermined standard value is detected, the processing board 224 determines that bad breath has been detected and says, ``I have a bit of bad breath.'' Voices such as "Are you brushing your teeth?" and "Please apply alveolar air purifier" are output as character voices of the character 1100. Furthermore, when an odor component contained in the gas fuel, such as tertiary butyl mercaptan, dimethyl sulfide, or tetrahydrothiophene, is detected, the processing board 224 determines that the odor of the gas fuel has been detected, and responds, "It smells like gas!" etc. is output as the character voice of the character 1100.

In this way, the processing board 224 preferably executes control to output a sound corresponding to the type of detected odor as the character sound of the character 1100. By performing such control, the scope of communication between the character displayed on the video display section and the user can be expanded, and the user's attachment to the character can be increased.

The display device 1 is not limited to one that specifies the audio to be output based on the audio management table. The display device 1 may specify the audio to be output, for example, according to a scenario in which the content of the character's utterance changes based on the content of past dialogues (dialogue history). This scenario may define a branching scenario in which data specifying the sounds output by the character is managed in a tree structure.

Here, the audio output operation of audio according to the detection result by the odor sensor is illustrated, but the processing board 224 is not limited to this, and the processing board 224 outputs an image of the character making a movement according to the detection result from the odor sensor. You may perform a display output operation to display on the display unit. For example, similar to the audio management table, a display management table (not shown) is provided in advance, and the processing board 224 displays, on the video display section, an image of the character 1100 making a movement according to the type of detected odor. It is better to perform a display output operation. The display management table may be, for example, a table in which data defining the character 1100 is registered in association with odor components and odor types. The data specifying the character 1100 may be data indicating an image of the character 1100 to be displayed, or may be data specifying the content of the movement of the character 1100. For example, when some odor component is detected, the processing board 224 may display an image of the character 1100 performing a sniffing motion on the image display section. Furthermore, when the processing board 224 determines that a cigarette odor has been detected, for example, it is preferable to display an image in which the character 1100 makes a motion similar to that of smoking on the image display section. Note that at this time, the processing board 224 may display an image imitating smoke on the image display section. Further, the processing board 224 may perform both the audio output operation and the display output operation as described above. For example, when some odor component is detected by the odor sensor, the processing board 224 displays an image of the character 1100 performing a sniffing motion on the image display section, and also outputs a voice such as "Something smells" to the character 1100. The character voice may be output from the speakers 2551 and 2552.

Furthermore, the processing board 224 may be controlled so that the reaction of the character 1100 changes depending on the concentration (also referred to as detection intensity) of the odor component detected by the odor sensor. For example, the processing board 224 displays images of a plurality of movements provided in stages according to the concentration of the odor component (for example, "makes a grimace (makes a disgusted expression)", "breaks into a cold sweat", " It is preferable to selectively display one of the following expressions: "to turn pale" and "to faint", etc.

The display device 1 uses, for example, a smoke sensor that detects smoke, a camera image (for example, an image taken by the photographing unit 227), and a thermo camera image as a method for distinguishing between cigarette odor and odors other than cigarette odor. It may be possible to detect that the user is smoking in combination with another sensor.

When the processing board 224 detects that the user is smoking a cigarette, the processing board 224 displays an image imitating smoke (reproducing the appearance of smoke appearing thickly), which is superimposed on the character 1100 (in front of the character 1100). video) may also be displayed. At this time, the processing board 224 may push the face of the character 1100 forward to look up at the character 1100 and give it a disgusted expression. The processing board 224 may display a display that changes the degree to which the character 1100 dislikes the character 1100, depending on the degree of intimacy that is the degree of intimacy between the user and the character 1100. For example, the processing board 224 may make the character 1100 have an expression that says "I love you and will forgive you" when the intimacy level is above a predetermined value, and make the character 1100 have an unpleasant expression when it is less than the predetermined value. That's how it is. The processing board 224 may, for example, identify the degree of familiarity according to the usage history of the display device 1 by the user (for example, past usage time and past conversation content). The algorithm for determining intimacy is not limited to this.

<About the communication function based on user location information>
Further, for example, it is preferable that the display device 1 includes a GPS (Global Positioning System) receiver 60 (see FIG. 33), and the following control is executed based on the user's position information. Then, for example, the processing board 224 acquires the positional information of the display device 1 carried by the user as the user's own positional information based on the signal from the GPS receiver 60, and uses the acquired positional information as the user's own positional information. Based on this, it is recommended to perform the following control.

For example, it is preferable that the voice corresponding to the frequency of stay (also referred to as visit frequency) of the user at a location specified based on the user's location information is outputted as the character voice. FIG. 35 is a flowchart for reproducing communication regarding the frequency of stay.

For example, in step S21, the processing board 224 determines whether the user's location information has been received from the GPS receiver 60. When the user's location information is received, in step S22, the processing board 224 determines that the number of times the user has stayed at the location specified based on the user's location information (also referred to as the number of visits) is a predetermined value ( For example, it is determined whether the number is greater than or equal to "2". Note that the stay frequency is the number of times the user stayed at one place during a predetermined period (for example, one day or one week). For example, the processing board 224 uses a network or the like to search and specify the user's place of stay based on the position information acquired from the GPS receiver 60 (for example, the user's current position information). The processing board 224 then calculates the frequency of stay of the user based on the number of times the user has stayed at the specified location, and determines whether the frequency of stay of the user is equal to or higher than a predetermined value. For example, if the frequency of stay of the user is equal to or higher than a predetermined value, in step S23, the processing board 224 controls the speakers 2551 and 2552 to output a predetermined character voice registered in advance regarding the frequency of stay of the user. For example, if the user goes to the same place twice on the same day, the processing board 224 determines that the user's frequency of stay is equal to or higher than a predetermined value, and outputs a character voice such as "Oh, I went there a while ago." Output.

Further, the processing board 224 may be controlled to output, as the character voice of the character 1100, a voice corresponding to the location specified based on the acquired position information. FIG. 36(A) is a flowchart for reproducing communication regarding the place of stay, and FIG. 36(B) is a diagram showing a voice management table of character voices regarding the place of stay.

For example, in step S31, the processing board 224 determines whether the user's position information has been received from the GPS receiver 60. When the user's location information is received, in step S32, the processing board 224 uses a network or the like to search and specify the user's place of stay based on the user's location information. Then, in step S33, the processing board 224 outputs character voices corresponding to the specified location from the speakers 2551 and 2552 based on the voice management table of FIG. 36(B). For example, the processing board 224 may produce a character voice such as "What are you going to make for dinner tonight?" when the user goes to the supermarket, or "Are you okay? Are you feeling unwell?" when the user goes to the hospital. The voice of the character 1100 is output as the character voice of the character 1100. Further, the processing board 224 outputs a character voice such as "You had a lot of fun" when the user goes to an amusement park, for example.

Furthermore, the processing board 224 controls to output, as the character voice of the character 1100, a voice corresponding to the number of stays (also referred to as the number of visits, etc.) of the user at the specified location based on the acquired location information. good. FIG. 37(A) is a flowchart for reproducing communication regarding the number of stays, and FIG. 37(B) is a diagram showing a voice management table of character voices regarding the number of stays.

Steps S41 and S42 in FIG. 37(A) are the same as steps S31 and S32 in FIG. 36(A), so a description thereof will be omitted. In step S43, the processing board 224 obtains the number of times the user has stayed at the location specified in step S42. Then, in step S44, the processing board 224 outputs character voices from the speakers 2551 and 2552 according to the number of times the user has stayed, based on the voice management table of FIG. 37(B). For example, when the user goes to a certain game center for the first time, the processing board 224 outputs a character voice such as "That game was fun." Then, when the user goes to the certain game center again, the processing board 224 outputs a character voice such as "I wanted to go again." Further, the processing board 224 outputs a character voice such as "Are you going to play the game again?" when the user has visited the certain game center a predetermined number of times or more (for example, 10 times or more).

Further, the processing board 224 may be controlled to output, as the character voice of the character 1100, a voice corresponding to the user's stay time at the location specified based on the acquired position information. FIG. 38(A) is a flowchart for reproducing communication regarding stay time, and FIG. 38(B) is a diagram showing a voice management table of character voices regarding stay time.

Steps S51 and S52 in FIG. 38(A) are the same as steps S31 and S32 in FIG. 36(A), so a description thereof will be omitted. In step S53, the processing board 224 acquires the user's stay time at the location specified in step S52. Then, in step S54, the processing board 224 outputs character voices corresponding to the user's stay time from the speakers 2551 and 2552 based on the voice management table of FIG. 38(B). For example, when the user stays at the convenience store for less than five minutes, the processing board 224 outputs a character voice such as "That was early. I'm glad I waited." Further, when the user's stay time at the convenience store is 5 minutes or more and less than 10 minutes (5 to 10 minutes), the processing board 224 outputs a character voice such as "What did you buy?". Further, when the user's stay time at the convenience store exceeds 10 minutes, the processing board 224 outputs a character voice such as "You're late. I was worried."

The processing board 224 may perform the above-described control based on the user's position information obtained using the GPS receiver 60 or the like. In this way, the user can feel that the character has responded in accordance with his or her actions, and the user's attachment to the character increases.

Note that the display device 1 is installed, for example, at the user's home, and the display device 1 (specifically, the communication control circuit 706) communicates with the user's smartphone (smartphone equipped with a GPS receiver), etc. The location information of a user who is out and about (location information of a smartphone owned by the user) may be acquired. Then, when the user communicates with the character 1100 after returning home, etc., the processing board 224 may be controlled to perform the above operations. Note that the content of the character's voice and movement at this time may be changed as appropriate.

<About the communication function regarding user behavior patterns>
Furthermore, when it is determined that the user's behavior pattern matches a predetermined behavior pattern, control may be performed such that a voice corresponding to the predetermined behavior pattern is output as the character voice of the character 1100. FIG. 39(A) is a flowchart for reproducing communication regarding behavior patterns, and FIG. 39(B) is a diagram showing a voice management table of character voices regarding behavior patterns.

For example, in the processing board 224, the days of the week (for example, Monday to Friday) that the user works, the work time (for example, 8:30), and the specific route that the user uses when going to work are determined by the user as a "behavior pattern when going to work". Registered in advance by . For example, when the user's location information is received from the GPS receiver 60 (step S61), the processing board 224 determines whether the user's behavior pattern matches a predetermined behavior pattern based on the user's location information. (Step S62). For example, if the user passes through a specific route at 8:30 on Tuesday, the processing board 224 determines that the user's behavior pattern matches the "behavior pattern when going to work." Then, in step S63, the processing board 224 uses the voice management table shown in FIG. ) is output from the speakers 2551 and 2552 as the character voice of the character 1100. In this way, the character shows reactions according to the user's actions, thereby increasing the user's attachment to the character. Note that it is not essential that a predetermined behavior pattern (for example, a behavior pattern when going to work) is registered by the user in advance; for example, the processing board 224 may have a learning function and learn the user's behavior pattern. By doing so, a predetermined behavior pattern may be registered.

<About the communication function related to suspicious person detection>
Furthermore, when it is determined that the person detected in the detection target space is a suspicious person, a predetermined action may be performed. Then, when the user of the display device 1 is detected after the predetermined operation is executed, the sound related to the detection of a suspicious person may be output as the character sound of the character 1100. FIG. 40 is a flowchart for implementing operations related to suspicious person detection.

For example, in the display device 1, as shown in FIG. It is preferable that a sensor included in the photographing unit 227 is used as a detection means for detecting the presence of a person in the detection target space. The "detection target space" includes, for example, the viewing angle range (shootable range) of the imaging unit 227 in the space where the display device 1 is placed (for example, the user's home). The photographing unit 227 includes, for example, a lens and an image sensor (for example, a CCD or CMOS), and photographs a multicolor image. The lens of the photographing unit 227 is provided at a position where it can photograph the observer (particularly the face). In the example shown in FIG. 32, the lens of the imaging unit 227 is located above the observation area SC and near the center in the width direction of the display device 1 on the front panel 102 disposed on the front side of the housing 100. It is provided. The photographing unit 227 outputs image signals of each color component of R, G, and B to the processing board 224, for example. The processing board 224 processes this image signal to generate a photographed image.

The processing board 224 monitors the detection target space using the imaging unit 227 (step S71). When the presence of a person is detected in the detection target space, the processing board 224 performs user authentication such as face authentication in step S72, and in step S73, the processing board 224 determines whether the detected person is a registered user of the display device 1. Determine whether it exists or not. For example, if the processing board 224 determines that the person photographed by the photographing unit 227 is a registered user of the display device 1, the processing board 224 determines that the person is not a suspicious person. On the other hand, if the person photographed by the photographing unit 227 is determined to be an unregistered user, the processing board 224 determines that the person is a suspicious person and executes a predetermined operation in step S74. Examples of the "predetermined action" include an action to start recording by the imaging unit 227, an action to issue an alarm at a relatively high volume, an action to notify a pre-registered security company, and the like. Alternatively, the "predetermined action" may be an action in which the character 1100 calls out to a suspicious person (for example, "Who is it? Say the password!"). Then, if there is no reply from the person who is determined to be a suspicious person, or if the password is incorrect, the above recording start operation, etc. may be executed. Note that when the password is incorrect, the processing board 224 outputs a voice such as "No!? Say it again" as the character voice of the character 1100, and when it is determined that the password is incorrect again, the processing board 224 outputs a voice such as "No!? Say it again". The recording start operation, etc. may be executed. By doing so, for example, a suspicious person can be made to retreat from the detection target space, and crime prevention in the detection target space can be improved.

Then, when the user of the display device 1 is detected after performing the predetermined operation, the processing board 224 may output a sound related to the detection of a suspicious person as the character sound of the character 1100. Examples of the "voice related to suspicious person detection" include "I was scared." In this way, the user's attachment to the character displayed on the video display section can be increased.

Further, when the detection target space is monitored using the display device 1, the following operations may be performed in addition to the detection of a suspicious person.

For example, the display device 1 may be placed in a reception space of a company, and the display device 1 may be displayed so that the character 1100 performs reception work as a so-called receptionist. Specifically, when a microwave Doppler sensor (an example of a detection means) detects the approach of a person in a detection target space (for example, a reception space), the processing board 224 issues a message saying, ``Welcome.Which department would you like to work for?'' ?” may be output as the character voice of the character 1100. Then, the processing board 224 may be controlled to make a call to the desired department of the visitor based on the response from the detected person (visitor).

<About the communication function regarding the startup time of the display device 1>
Furthermore, the processing board 224 determines whether the character 1100's wording in the character voice is the content of the communication depending on the startup time (for example, cumulative startup time) of the display device 1 from a predetermined point in time (for example, the first startup time). It is best to control it so that it changes. For example, as described below, the processing board 224 may control the character 1100 to speak to the user in a familiar language as the startup time of the display device 1 increases.

For example, for the various character voices mentioned above, three patterns of character voices are registered in advance in the voice management table: honorific tone, tone that indicates a friend relationship with the user, and tone that indicates a relationship between the user and a lover. It would be good if it were done. For example, if the startup time of the display device 1 from a predetermined point of time is less than 100 hours, the processing board 224 outputs a polite character voice among the three patterns of character voices registered in the voice management table. do. In addition, when the startup time is 100 hours or more and less than 1000 hours, the processing board 224 selects a character voice that has a tone that indicates a friend relationship with the user among the three patterns of character voice registered in the voice management table. Output. Furthermore, when the startup time exceeds 1000 hours, the processing board 224 outputs a character voice with a tone that suggests that the user is in a romantic relationship with the user, out of the three patterns of character voice registered in the voice management table.

In this way, the user can feel that the relationship (for example, intimacy) with the character has changed due to the change in the character's wording toward the user.

Note that the processing board 224 may be controlled to reduce the intimacy of the character 1100 with the user depending on the time that has passed since the previous activation. For example, even if the cumulative startup time of the display device 1 exceeds 100 hours, if one week has passed since the last startup, the processing board 224 will not use a tone of voice that is equal to the user's, but will use honorific language. It is also possible to output the character voice in the key. In this way, the user will come into contact with the character displayed on the video display unit as close as possible to the character in order to maintain intimacy with the character, thereby further increasing the user's attachment to the character. Can be done.

In addition, the processing board 224 outputs a greeting voice such as "Nice to meet you" as a character voice at the time of first startup, and when a predetermined period (for example, a well-defined period such as one month) has passed from the time of first startup. In this case, it is preferable to output a voice indicating the anniversary (for example, "It's been a month since we met") as a character voice. In this way, attachment to the character 1100 can be further increased.

<About communication function by linking with other devices>
Further, for example, when the display device 1 is installed at a user's home or the like, the following operations may be performed in cooperation with other devices. For example, when a user visits a place where a device (hereinafter referred to as another device) that can communicate with the display device 1 is installed, the other device identifies the user as described below, and Information suitable for the user (for example, gourmet information or event information) may be automatically provided. For example, a face image of a user who uses a system for linking a display device and other devices and a display device owned by the user (eg, IP address, etc.) are associated and registered in advance in an external server or the like. For example, when a person is detected by a sensor included in a photographing unit provided in the other device, the control unit of the other device collects the face image of the person detected in the captured image and the user registered on the external server. The user of the display device 1 is identified by comparing the face image of the user with the face image of the user. Then, the control unit of the other device identifies the display device 1 registered in association with the user in the external server (for example, the IP address of the display device 1, etc.), and detects the user of the display device 1. The display device 1 transmits information indicating that the In the processing board 224 of the display device 1, "information suitable for the user" (for example, gourmet information and event information) is registered in advance, and the processing board 224, in response to signal reception from the other device, Send the registered "information suitable for the user" to the other device. Then, the control unit of the other device outputs (for example, outputs audio) the "information suitable for the user" received from the display device 1. Note that when providing guidance on "information suitable for the user," the other device may display the character 1100 on its display screen. Further, it is preferable that information etc. guided to the user be transmitted from the other device to the display device 1 and stored as user information in the processing board 224 of the display device 1. For example, when the display device 1 is installed at the user's home, when the user's return home is detected, the processing board 224 outputs a voice message such as "You went to **, how was it?" It is preferable to output it as a 1100 character voice. In this way, the user's attachment to the character displayed on the video display section can be increased.

<About other communication functions>
Furthermore, the following control may be performed based on detection results from various sensors.

For example, a wind detection means (for example, a wind sensor) capable of detecting wind (for example, wind speed) is provided on the front panel 102 of the display device 1, and the following control is performed based on the detection result by the wind sensor. It's okay to be hurt. The wind is often caused artificially by the user, for example, the wind generated by moving a body part such as waving a hand toward the display device 1, or the wind generated by blowing breath (exhalation). It is good to say. For example, when the wind sensor detects wind having a wind speed equal to or higher than a predetermined value, the processing board 224 detects the hair (e.g., hair) and clothes (e.g., skirt) of the character (e.g., character 1100) displayed on the video display section. ) is best displayed as a waving image. Further, for example, when an image of a lit candle is displayed on the image display section, when wind is detected by the wind sensor, the processing board 224 may switch to an image of the candle being extinguished. Furthermore, when the detected wind is stronger than a predetermined threshold (wind speed is greater than a predetermined threshold), the character 1100's clothes flutter more. ) You may want to switch the video accordingly.

Further, for example, an object detection means (for example, an ultrasonic sensor) capable of detecting the presence or absence (presence or absence) of a target object and the distance to the target object is installed in the display device 1, and the following is performed based on the detection result by the ultrasonic sensor. Such control may also be performed. For example, when it is determined that the observer's hand is touching the character 1100 recognized as a stereoscopic image based on the detection result by the ultrasonic sensor, the processing board 224 displays an image in which the character 1100 shows a reaction. It is better to output it on display. Furthermore, the display of the processing board 224 may be controlled so that it exhibits different reactions depending on the part of the character 1100 that is touched by the viewer. The parts of the character 1100 that can be touched by the viewer may be, for example, body parts such as the head, chest, abdomen, buttocks, or legs. Furthermore, the parts of the character 1100 that can be touched by the viewer may be clothing (for example, clothes, skirts) or accessories (for example, accessories) of the character 1100.

Further, for example, the display device 1 is provided with an earthquake detection means (for example, a seismic sensor) capable of sensing an earthquake and measuring the seismic intensity, and when an earthquake is detected by the seismic sensor, the processing board 224 issues an earthquake alarm. It is good to say .

Further, for example, a weather sensor capable of measuring the weather may be provided in the display device 1, and the processing board 224 may notify weather changes, weather forecasts, etc. based on the measurement results by the weather sensor. Note that the weather sensor preferably includes, for example, an air pressure sensor, a temperature sensor, and a humidity sensor, and is configured to be able to measure the weather based on the detection results of each sensor.

The processing board 224 also displays an image in which the facial expression and movement (also referred to as motion) of the character displayed on the image display section change depending on the temperature detected by the temperature sensor and/or the humidity detected by the humidity sensor. It is good to display it.

In addition, the processing board 224 changes the facial expressions and movements of the character displayed on the video display section according to the detection results (for example, the distance between the display device 1 and the observer) by a human sensor such as a microwave Doppler sensor. It is a good idea to display images that

Further, it is preferable that the processing board 224 uses a humidity sensor to determine whether or not the user has breathed on the processing board 224 . Furthermore, the processing board 224 may also utilize a temperature sensor to determine the type of breath blown by the user. Note that these sensors may be provided in the display device 1 as, for example, the second sensor 2332.

Here, there are two types of breaths that can be blown by the user: a ``huh'' breath and a ``ha'' breath. Generally, when blowing cold breath, the person blows quickly with a "whoop" sound, so here, the breath that is blown with a "whoop" is referred to as "cold breath." In addition, generally when blowing warm breath, the person blows slowly with a "ha" sound, so here, the breath that is blown with a "hah" is referred to as "warm breath."

Regarding these two types of breath, the inventor of the present application obtained the following findings through experiments and the like. In detail, first, regarding humidity, if you blow your breath toward the temperature/humidity sensor (e.g., a sensor that is a combination of a temperature sensor and a humidity sensor) at a predetermined distance from the sensor. The measurement results showed that immediately after that, the humidity rose rapidly from a steady state. Furthermore, the measurement results showed that the humidity increases monotonically while blowing, and when the blowing is stopped, it takes several tens of seconds to return to the original steady state. Similar measurement results were obtained when people blew into the temperature and humidity sensor under the same conditions. On the other hand, when it comes to temperature, it has been determined that when a person blows a 'huh' sound, the temperature drops slightly from the steady state or stays at about the same level, and when a person blows a 'hah' sound, the temperature rises. The results were obtained. Note that the breath that the user blows on the display device 1 is an example of the wind that hits the display device 1.

In consideration of such findings, for example, in the display device 1 provided with a humidity sensor, when the humidity sensor detects that the humidity has suddenly increased from a steady state, the processed substrate 224 is It is best to judge (also called decision) that the breath has been blown on. Further, if a monotonous increase in humidity is no longer detected thereafter, the processing substrate 224 may determine that the blowing of breath has stopped. Alternatively, when a predetermined period of time (for example, the time required to exhale normally (for example, about 3 seconds)) has elapsed after a sudden increase in humidity was detected, the processing substrate 224 displays the humidity detection result at that point. Regardless of the situation, it is a good idea to determine that breathing has stopped.

Further, when a sudden increase in humidity is detected by the humidity sensor and the temperature sensor detects that the temperature has increased from a steady state (for example, at approximately the same time), the processing substrate 224 may be detected by an observer. It is best to determine that the type of breath being blown on is "warm breath." Conversely, when the humidity sensor detects a sudden increase in humidity and the temperature sensor detects that the temperature has not changed from the steady state or has decreased from the steady state, the processing substrate 224 It is helpful to determine that the type of breath blown by the observer is "cold breath."

Then, the processing board 224 preferably outputs video and audio in response to the detection of the blowing of breath as the movement and character audio of the character displayed on the video display section. Further, the processing board 224 may output images and sounds corresponding to the type of breath blown as the movements and sounds of the character displayed on the image display section. For example, if the type of breath blown by the observer is "cold breath," the processing board 224 displays and outputs an image of the character's clothes fluttering, and if the type of breath blown by the observer is "warm breath." If the character is "breathing", it is preferable to display and output an image in which the character moves in a way that avoids breathing.

The inventor of the present application also obtained the following findings using various gas sensors. In detail, when you blow into the gas sensor at a predetermined distance (for example, about 10 cm) from the gas sensor, the output value of the gas sensor immediately decreases, and when you finish blowing, immediately after The measurement results showed that the output value of the gas sensor started to increase. Conversely, the measurement results show that when you blow into the gas sensor, the output value of the gas sensor increases immediately after that, and immediately after you finish blowing, the output value of the gas sensor starts to decrease. was gotten. In addition, measurement results have been obtained that, for example, when the wind from a blower (for example, an electric fan) hits the gas sensor, the output value of the gas sensor decreases, and when the wind from the fan stops hitting the gas sensor, the output value of the gas sensor increases. It was done.

Considering such findings, for example, in the display device 1 equipped with a gas sensor, if the output value of the gas sensor suddenly decreases from a steady state, the type of breath blown by the observer may be determined to be "cold breath". It would be good if it was determined that there is. Conversely, if the output value of the gas sensor suddenly increases from a steady state, it may be determined that the type of breath blown by the observer is "warm breath."

It is also possible to adopt a configuration in which breath is detected using a wind sensor. The inventor of this application found that, according to wind sensors, it is possible to detect relatively weak winds that are as strong as looking up at a piece of paper, and when the wind sensor blows on the wind sensor, the wind reaches its peak immediately, and the responsiveness is good when the wind starts blowing. It was confirmed. However, if you keep breathing, it will quickly fall from its peak. If there is a strong wind that blows, the heater may cool down and take time to recover.

In relation to the configuration of detecting breath using a wind sensor, the following configuration may be used.

When the processing substrate 224 is continuously detecting a predetermined amount of air by the wind sensor, it is preferable to perform processing in a direction in which it is not being blown with breath. The processing in the direction in which the breath is not being blown is, for example, the processing in which it is determined that the breath is not being blown. In this case, when the time from the start to the end of wind detection by the wind sensor is within the time during which breath can be blown, the processing board 224 performs processing in the direction in which the wind is being blown. It is a good idea to do this.

In this case, the wind sensor may be a sensor that detects wind by electrically measuring heat removed by receiving wind. In this sensor, the wind that is received by the sensor corresponds to the amount of air that is blown onto the sensor. This sensor is set so that when the wind received by the sensor lasts for a time equivalent to the time when the breath is blown, the wind volume falls to a value lower than the actual air volume during the duration. However, it is preferable that the setting is such that this drop is less likely to occur when the volume of air is smaller than the amount of air blown.

In the display device 1, a plurality of wind sensors may be provided with a flow path through which air flows through a common breath inflow path. The flow path may be configured to allow wind to enter different wind sensors at a predetermined ratio other than 1:1. The processing board 224 may determine the magnitude and duration of the blowing based on the ratio and the difference in characteristics of the plurality of wind sensors. The display device 1 includes a plurality of wind sensors that have different timings of dropping to a value smaller than the actual airflow volume during the duration time, and the processing board 224 determines the magnitude of the blowing based on the outputs of the plurality of wind sensors. and the time may be determined. The display device 1 may include at least a wind sensor that is not a gas sensor and a waste sensor as the plurality of wind sensors.

Further, it is preferable to use a gas sensor for detecting a predetermined gas as the wind sensor. The wind sensor may be a gas sensor for detecting a predetermined gas, and may include a heater. In this case, the gas sensor equipped with the heater outputs an output in the direction of increasing the detected amount of gas (as a result of detecting gas contained in the breath) when the degree of blowing is relatively small; It is preferable to use a device that has a characteristic of outputting in a direction in which the detected amount of gas decreases (by cooling the heater with the airflow) when the degree of spraying is relatively large.

When the processing board 224 determines that breath is being blown and the strength of the blow is relatively large (for example, when the air volume is above a threshold value), it displays an animation that moves the clothes, hair, etc. of the character 1100. On the other hand, when the strength is relatively small, it is preferable to display an animation different from the animation that moves the clothes, hair, etc. of the character 1100.

By the way, when a gas sensor is used to detect breath, the gas sensor outputs the above-mentioned output value in response to components (for example, carbon dioxide) contained in human breath. The reason why the output value of the gas sensor is different depending on whether the breath is blown "whoo" or "haa" is that when the breath "whoo" is blown, On the other hand, when a breath is blown, the speed of the blown breath is low and the gas is easily dispersed into the surrounding area after colliding with the gas sensor. This is thought to be due to the fact that breath components tend to remain in the field.

Further, the processing board 224 may determine whether the detected wind is caused by the blowing of the observer's breath or by a blower, for example, by also using the humidity detection result by a humidity sensor. For example, in the display device 1, when the humidity sensor detects that the output value of the gas sensor has suddenly decreased from the steady state and the humidity has suddenly increased from the steady state, the processing board 224 will be activated when the user takes a breath. It is best to assume that it was sprayed on. On the other hand, when the output value of the gas sensor has suddenly decreased from the steady state, but the humidity remains in the steady state, the processing substrate 224 may determine that air is being blown by the blower. Further, the processing board 224 may also use the temperature detection result by the temperature sensor to determine the type of breath when it is determined that the user has breathed on the user. Furthermore, if the output value of the gas sensor repeatedly increases and decreases within a relatively short fixed period, it may be determined that the processing substrate 224 is being hit by the wind from an oscillating electric fan.

Note that a wind sensor, a humidity sensor, a temperature sensor, a temperature/humidity sensor, and a gas sensor used to detect wind are examples of wind detection means. The display device 1 may include an atmospheric pressure sensor as a sensor for detecting wind. This is because changes in atmospheric pressure can occur depending on the generation and strength of wind.

Various controls such as those described above may be executed. Note that the above control may be performed not only for the character 1100 but also for communication functions related to other characters (for example, the character 1200).

<7. Specific example of video displayed by display device 1>
Next, specific examples of images displayed by the display device 1 will be described with reference to FIGS. 41 to 55. 41 to 55 are diagrams showing examples of characters (images including the character 1200 described in FIGS. 1B and 1C) displayed on the display device 1. Each of the images shown in FIGS. 41 to 55 is an image that is displayed on the display device 1 and can be observed by an observer via the observation area SC. Note that although the stage image 2200 is displayed in FIGS. 41 to 55, the character 1200 may be displayed instead of this.

41 to 47 are displays that the display device 1 performs during a period when it is waiting for an observer's action based on the communication function. The display device 1 (specifically, the processed substrate 224) performs the display described below by switching regularly or randomly. For example, as shown in FIG. 41(a), the character 1200 is displayed in a standing posture facing the front side (viewing side) of the display device 1. The display device 1 may use this posture as a basic posture, and may display a period in which communication based on the communication function is not performed. For example, as shown in FIG. 41(b), the character 1200 makes an action such as licking its own front paw. For example, as shown in FIGS. 41(c) and 42(a), the character 1200 behaves in a manner such that it alternately looks at its left and right sides. For example, as shown in FIG. 42(b), the character 1200 moves to face the ground. For example, as shown in FIG. 42(c), the character 1200 performs a stretching motion while sitting. For example, as shown in FIG. 43(a), the character 1200 moves as if looking into the ground. Further, for example, as shown in FIGS. 43(b) and 43(c), the character 1200 moves as if walking on the front side. When making the character 1200 perform a walking motion, the display device 1 may display an image in which the character 1200 steps on the spot and does not substantially move the overall position of the character 1200, without displaying the stage image. The display device 1 may display a stage image at the feet of the character 1200 when the character 1200 performs an action other than walking.

For example, as shown in FIG. 44(a), the character 1200 acts as if looking into its own abdomen. For example, as shown in FIG. 44(b), the character 1200 makes an action of tilting its head. For example, as shown in FIG. 44(c), the character 1200 makes an action of rubbing its own eyes. For example, as shown in FIG. 45(a), the character 1200 makes a yawning motion. For example, as shown in FIG. 45(b), the character 1200 makes a motion of licking its own front paw while sitting. For example, as shown in FIG. 45(c), the character 1200 moves to look diagonally to the left of itself. As shown in FIGS. 46(a) and 46(b), the character 1200 makes a stretching motion. For example, as shown in FIG. 46(c), the character 1200 moves as if looking into the ground. As shown in FIG. 47(a), the character 1200 faces diagonally forward to the right of the display device 1, and then faces forward as shown in FIG. 47(b). As shown in FIG. 47(c), the character 1200 makes a motion of licking its own front paw.

48 to 55 are examples of the display of the character 1200 performed by the display device 1 (specifically, the processing board 224) during dialogue processing in the communication function. The character strings shown in FIGS. 48 to 55 are character strings that can be recognized by voice recognition and are displayed above the character 1200. It is preferable that the words (sentences) recognized by voice recognition are displayed for a predetermined period of time after the voice recognition, and are hidden after the predetermined period of time has elapsed. Then, it is preferable that the character 1200 is controlled to start speaking after the phrase (speech recognition result) is hidden.

FIG. 48(a) is displayed when the display device 1 recognizes the observer's utterance, ``Come on, come on~'', and a voice is output in response to this. 48(b) to FIG. 49(b) are displayed when the display device 1 recognizes the observer's utterance of "sit," and a voice is output in response to this. FIG. 49(c) is displayed when the display device 1 recognizes the observer's utterance, ``I wonder if I'm hungry,'' and a voice is output in response to this. FIG. 50(a) is displayed when the display device 1 recognizes the observer's utterance of "police officer," and a voice is output in response. FIGS. 50(b) and 50(c) are displayed when the display device 1 recognizes the observer's utterance, ``It's snack time,'' and a voice is output in response to this. FIG. 51(a) is displayed when the display device 1 recognizes the observer's utterance of "hand," and a voice is output in response. 51(b) to 52(b) are displayed when the display device 1 recognizes the observer's utterance, ``You're cute,'' and a voice is output in response to this. When the display device 1 displays the character 1200 at a position other than the center of the stage image (for example, a position on the front side) and rotates the character 1200, it is preferable to rotate the stage image 2200 in the same manner as the character 1200. Further, the display device 1 displays a stage image 2200 having a shape that is relatively distant in the depth direction, and displays an image (for example, , an image of a cat character walking along the outer edge of a circular stage).

FIG. 52(c) is displayed when the display device 1 recognizes the observer's utterance of "Hello," and a voice is output in response. FIG. 53(a) is displayed when the display device 1 recognizes the observer's utterance "I'm going to eat," and a voice is output in response to this. FIGS. 53(b) and 53(c) are displayed when the display device 1 recognizes the observer's utterance "Is it a girl?" and a voice is output in response. FIG. 54(a) is displayed when the display device 1 recognizes the observer's utterance of "wait," and a voice is output in response. FIG. 54(b) is displayed when the display device 1 recognizes the observer's utterance, "You're a good girl," and a voice is output in response. 54(c) and 55 are displayed when the display device 1 recognizes the observer's utterance of "Yuno", and a voice is output in response to this.

<8. More detailed description of character 1200>
The character 1200 described in FIGS. 1B, 1C and FIGS. 41 to 55 will be described in more detail. In the following description, descriptions in which the display device 1 is the main processing body may be performed by the processing substrate 224. It is particularly advantageous if the character 1200 is drawn approximately three-dimensional. It has been found that by doing so, the sense of depth is particularly emphasized. The display device 1 displays a character 1200 so that the head occupies approximately one-third of the height, the torso occupies one-third, and the feet occupy one-third in the vertical direction when viewed from the side (lateral side). It is recommended to draw The display device 1 preferably draws the character 1200 so that, except for the tail, the head occupies approximately one-third and the body occupies two-thirds in the left-right direction when viewed from the side.

The display device 1 has a function of displaying images that are mutually displaced between a state in which the tail is not visible and a state in which the tail is visible when the face is in front of the person, and a state in which the tail is visible and a state in which the tail is not visible. It is recommended that the time be shorter than that of . The tail is drawn further back than the head, but by seeing the tail from time to time, you can feel a larger three-dimensional effect, and constantly feeling a larger three-dimensional effect can cause eye and head fatigue. can be prevented. In particular, it is preferable that the display device 1 performs such a drawing process while in a standby state for voice recognition. The display device 1 may have a function of drawing the tail so that it appears from the top of the head when the tail is displaced to a visible state. If you do this, the tail will suddenly pop out above the head from the center of the eyes of the face, where the viewer's line of sight is usually directed, and this can give surprise and interest.

The display device 1 may preferably provide a flat portion on the top of the head of the character 1200 when viewed from the front, and in particular, the portion of the head between the left and right ears may be rendered flat when viewed from the front. In this way, a tail with a three-dimensional effect suddenly appears above the head from the top of the flat head, which has a weak three-dimensional effect, which can give more surprise and interest. Further, the display device 1 may draw the tail so that it appears from above, and then draw the part of the tail that moves toward the tip. In this way, the viewpoint can be focused on the tail part on the back side of the face, giving a more three-dimensional effect. The display device 1 may similarly draw the tail so that it appears from the left and right sides of the torso. When the display device 1 makes the tail appear from the left and right sides, it is preferable to shorten the length and/or time for which the tail appears, compared to when the tail appears from above. When the display device 1 makes the image appear from the left and right, it is preferable to draw the image so that the image appears flickeringly. The display device 1 may be configured to sometimes draw the user's line of sight to the back, which can give a more three-dimensional effect. It is preferable that the display device 1 performs rendering such that the tail appears from above the cat's head during voice recognition, and that the tail appears from either the left or right direction when outputting voice from the cat. In the display device 1, it is preferable that the tail is provided with portions having a drawing mode different from other portions at predetermined intervals in the length direction. For example, it is preferable to apply annular or arcuate patterns having a predetermined width on the cylindrical surface of the tail at regular intervals. The inventors have found that by doing this, the tail movement feels more dynamic in three-dimensional space.

The display device 1 performs drawing to change the current posture to the same posture when there is a change from a state not in voice recognition to a state in which voice recognition is in progress so that the same posture is maintained during speech recognition. Good. It is preferable that the display device 1 causes the user to say "Chat to you" before starting voice recognition. The display device 1 is preferably provided with a function (for example, a sensor or a switch) to detect the movement of the observer, and a function of uttering "What?" when the movement from the observer is detected. It is best to perform both functions in succession in the form of "What's that?" and "Talk to me," and then enter the speech recognition state.

The display device 1 may be provided with information on complimentary words such as "You're cute" as speech recognition words, and change the body posture when recognizing the complimentary words. It is even better if you move the cat's position, such as by walking. In this way, the observer wants to see changes in the cat's posture and movements, so the observer will engage in words and actions that praise the cat, and excellent therapeutic effects such as improvement of the cat's behavior and speech can be obtained.

It is preferable that the display device 1 is provided with a voice recognition phrase corresponding to "to feed", and when the phrase is recognized, a drawing is performed in which the tail wags faster than in other cases. In this way, the viewer can feel as if the cat is actually alive.

The display device 1 preferably renders the outline of the cat's eyes as approximately circular, and the iris as a vertically elongated ellipse. In the display device 1, it is preferable that the iris part be drawn with a gradation of shading in the vertical direction, and the iris should be drawn in a brighter color as it goes downward. In the display device 1, it is preferable that the center part of the iris has a blacker part than the generally circular or elliptical periphery. The display device 1 preferably provides a crescent-shaped or half-moon-shaped white region along the outer edge of the iris in the outer part of the face above the iris. In contrast, it is preferable that the display device 1 draw a circular white area at a position near the center of the face below the iris. The display device 1 preferably continues to draw this white area even when there is a change in the position of the character 1200 (such as a change in posture) or a change in the position of the camera or light. Usually, highlights are often added by calculation as reflections of light or the like. However, by doing this, it is possible to emphasize the cat's individuality in the eyes, which are most visible when speaking with voice recognition, and give an impression as a cat with a unique personality in a short time during voice recognition. be able to.

The display device 1 takes a state where the face is facing forward and a state where the face is facing downward. When the face is facing forward, the outline of the eyes is drawn in a generally circular shape, while when the face is facing downward When the character is facing towards the camera, it is best to draw the eyes as horizontally elongated ellipses.

The display device 1 has two states: the top of the face is above the top of the body, and the top of the face is below the top of the body, and when the top of the face is above the top of the body, the eyes are While the outline is generally drawn in a circular shape, if the upper end of the face is lower than the upper end of the body, it is better to draw the eyes in a horizontally elongated oval shape. The display device 1 has a function of drawing a yawning state with the mouth open, and it is preferable to draw the yawn with the eyes closed during this drawing.

The display device 1 preferably prepares a plurality of motion patterns for the character 1200 during standby, and repeats a process of selecting and drawing one pattern from these patterns. Motions during standby include licking the feet, stroking the face with hands, licking the butt, facing forward, looking left and right, licking the ground, stretching, yawning, There are walking motions, etc.

The display device 1 may draw the ears so that they move later than the face. For example, the ears may be drawn so that they remain in position for a while even if the face begins to move. The display device 1 preferably has a function of simultaneously performing a tail-waving motion from side to side when performing a licking motion. In the display device 1, when the character 1200 is viewed from the front, the pattern of the body may be asymmetrical. In this way, it will be easier to remember the cat as a unique cat, and it will also be easier to tell whether the cat's right side or left side is visible. This is particularly useful when creating a scene that is so enlarged that the entire image of the character 1200 cannot be seen. In particular, the pattern is preferably a calico cat pattern, especially a tabby cat pattern. The inventors have found that this makes it particularly easy to grasp the three-dimensional effect. In particular, the patterns on the head may be provided in different directions, such as the pattern on the head being provided in the front-back direction, while the pattern on the body may be provided in the vertical direction. This makes it easier to recognize changes in the camera or cat's position no matter which direction they move.

It is preferable that the display device 1 has a function of emitting a cry of "Nya", has a plurality of intonations for the cry of "Nya", and has a configuration in which each cry is associated with a different motion. It is preferable that the intonation includes a question-like intonation, and the motion includes a tilting of the head.

<9. Regarding communication functions related to character 1200>
The communication function related to the character 1200 will be supplemented. By doing the following, it is possible to provide the viewer with a higher quality communication function with the character 1200. Here, an outline of the human behavior and the behavior story of the character 1200 until it is tamed will be explained. In this embodiment, as shown in FIG. 32, a photographing section 227 for photographing the observer is provided on the front side of the display device 1.

(9-1) First step: Stage until domestication Normally, there are various types of cats, such as stray cats, that run away when they see a person, or run away when a person approaches. At that time, the cat's behavior appears to be turning around and looking at the person before running away. Here, the processing board 224 recognizes the presence of the observer based on the captured image captured using the imaging unit 227, and the intensity of the microwave (received intensity) measured by the human sensor 234 exceeds a threshold value. In this case, an image in which the character 1200 performs an action such as running away is displayed. This is because it is assumed that a person has approached the cat. The purpose of recognizing the viewer in the photographing unit 227 is to show the viewer a scene in which the character 1200 runs away. In other words, the character 1200 is prevented from running away unless the viewer approaches the display device 1 from the front side.

Next, people are thought to say things like ``squat down'' (lower your eyes) and ``come on, come on'' to the cat. Some cats stop and check out what's going on. However, if a person approaches, the cat will run away. This is repeated several times. It is thought that cats will not get used to this type of human behavior. Therefore, the processing board 224 determines that during a period when the image of the character 1200 running away is displayed, the intensity of the microwave measured by the human sensor 234 is below a certain threshold, and the character 1200 saying, for example, "Come!" When words indicating a call to someone are voice recognized, an image of the character 1200 performing an action such as stopping is displayed. Here, the reason why the intensity of the microwave is set to be equal to or less than the threshold value is because it is assumed that a person is standing still.

Next, it is conceivable that people stop to feed the cat. However, if a person approaches a cat, the cat will run away, so the only option is to leave food in a place where cats often visit. Therefore, the display device 1 has a function of displaying an image in which bait is placed within the image display space. For example, when the processing board 224 receives a predetermined operation using the operation area OT (for example, an operation on the operation unit 2214), or when the first sensor 2231 detects a predetermined gesture instructing to place food, In this case, if bait is placed, an image showing the bait is displayed in the image. This video may be displayed using either the first display section 310 or the second display section 330. In this way, the observer places the food, for example, every day. At this time, the processing board 224 may be displayed so that the character 1200 is watching from a distance. The processing board 224 displays an image of the character 1200 eating food when the presence of the observer is not recognized using the human sensor 234 and the observer is not photographed by the photographing unit 227. Here, we are recreating a situation where a cat refuses to eat in front of people. From an observer's point of view, this creates a situation where the bait is empty before you know it. The processing board 224 counts and stores the number of times the observer feeds the food. Although this state continues for a while, the processing board 224 may display a display that gradually reduces the distance between the viewer, the character 1200, and the person (the distance perceived by the viewer) depending on the number of feedings. For example, the processing board 224 may display the character 1200 in a larger size together with the number of times the character 1200 has started feeding, thereby reproducing the fact that the distance has shortened (that is, the character has gotten used to it a little). Furthermore, when the number of times the cat is fed increases and reaches a predetermined threshold, it is assumed that the cat has gotten used to it, and even if the observer is looking at the character, the processing board 224 uses the human sensor 234 to Even when the presence of an observer is recognized and the observer is photographed by a photographing unit 227, an image of the character 1200 eating food is displayed. At this time, the observer can observe the character 1200 eating food for the first time.

However, people often do not know when cats eat. Therefore, the processing board 224 determines a time period in which the character 1200 eats food (alternatively, it may be set as a point in time), and allows the character 1200 to perform the action of eating food during that time period. good. This is to make observers aware that they seem to be feeding at this time of day. When the processing board 224 detects that the observer is about to touch the character 1200, the processing board 224 causes the character 1200 to output a predetermined utterance of "Sha" or "Shasha" and causes the character 1200 to make an action to run away. . The fact that the observer tries to touch the character 1200 is caused by the fact that the intensity of microwaves detected by the human sensor 234 exceeds a threshold while the character 1200 is eating food, or by the first It is preferable that the identification is made when the sensor 2331 detects a predetermined gesture.

Although this situation continues for a while, it is preferable that the processing board 224 gradually reduce the distance at which the viewer's hand can approach the character 1200. When the character 1200 comes close to a predetermined distance, the processing board 224 may assume that the character 1200 has become accustomed to the viewer, and display an image of the character 1200 preening or relaxing in public. Specifically, the processing board 224 increases the threshold value for the intensity of microwaves, or increases the threshold value for the distance from the display device 1 when a gesture is performed. In this way, the processing board 224 lowers the detection sensitivity, slows down the reaction of the character 1200 to the observer's movements, and prevents the character 1200 from making utterances such as "sha" or "shasha".

Cats are always alert, but they add activities such as grooming, lying down, sharpening their claws, and wiping their faces. As cats gradually get used to people and their hands, people can begin to touch them with their hands. Therefore, it is preferable that the processing board 224 not reflect the microwave detection result by the human sensor 234 on the movement of the character 1200. The processing board 224 may cause the first sensor 2331 to function as a motion sensor, and display an image that appears pleasant when the character 1200 strokes it, according to the detection results of the viewer's gestures in the up, down, left, and right directions, and in the front and back directions. The processing board 224 may further recognize the observer's voice using the microphone 2333 and display an image in which the character 1200 reacts to the voice. For example, it is preferable for the processing board 224 to emit a cry of "nya" as the utterance content no matter what kind of word it recognizes.

The processing board 224 may further display an image of the character 1200 begging for food as time passes. When the photographing unit 227 recognizes the presence of the observer and the human sensor 234 detects the presence of the observer, the processing board 224 determines a time period (for example, morning, noon, evening), and It would be a good idea to have the dog make a "meow" sound and display a video of him rubbing his face. Further, the processing board 224 preferably reproduces a situation where the character 1200 remembers its own name as the viewer calls out to the character 1200. For example, the processing board 224 may respond only to the word "Yuno" and emit a cry of "Nya", or may respond to calls such as "Yuno" and "It's bait" and make a sweet sound. It's a good idea to have them do something, or show them a video of them happily grinding.

(9-2) Second step: Learning the language (Japanese) When the processing board 224 recognizes the observer's voice saying "Yuno" at some point, it responds with "What?" Output audio. From this point on, the character 1200 begins to learn words. The processing board 224 counts the number of times people have been called out, takes the cumulative average/day, and calculates the cumulative average/day of the number of times food has been given x the cumulative average of the number of times people have been called out x a random coefficient ( (hereinafter referred to as the "cumulative average value"). This greeting is, for example, a predetermined greeting such as "Good morning,""Hello,""Goodevening,""How are you?" and "Do you want food?" The processing board 224 may stop responding (that is, reproduce the fact that the character 1200 has forgotten a word) or increase the number of words it responds to, depending on the cumulative average value. For example, the processing board 224 may reduce the number of words to respond to as the cumulative average value is smaller, and increase the number of words to respond to as the cumulative average value is larger. The cumulative average value is calculated based on the number of times the display device 1 has been called out from the start of use to the present time, and the number of times it has been called out from the time when a predetermined period of time has gone back from the current time point to the present time point. It may be calculated based on. The predetermined period may be fixed, such as one month, or if the display device 1 has not been used for a certain period of time, it may be a period after the point in time when the display device 1 is started to be used after that period. When the display device 1 is first used, the cumulative average value may change significantly, so if the observer does not call out to him once a day, for example, the character 1200 may stop responding. However, as the number of calls increases, the cumulative average value does not change significantly. In this way, it is possible to reproduce the situation in which it takes time for the character 1200 to forget words. The random coefficient used to calculate the cumulative average value is a value that reproduces the capriciousness of cats, and can be called a capricious coefficient. The random coefficient is based on the behavior of the character 1200 and the observer, such as giving or not giving food when the character 21200 begs for food, or taking actions to wake the character 1200 by calling or touching it when it is sleeping. It is best to change it through your actions.

The processing board 224 may further have the character 1200 speak to the viewer or respond to a question regarding predetermined information such as the weather or news when the cumulative average value exceeds a certain threshold. Of course, if the observer reduces the number of times the observer feeds, the cumulative average value decreases, so the treated substrate 224 reduces the types of responses or becomes non-responsive. In other words, if the observer is sloppy in feeding or does not call out appropriately, the character 1200 may not be able to respond, or even if it is maintained, it may not respond due to a "whim". In the above manner, it is possible to provide the viewer with a higher quality communication function with the character 1200.

[Other embodiments]
The present disclosure is not limited to the embodiments described above, and can be modified as appropriate without departing from the spirit.

The display device 1 may include a touch sensor, a proximity sensor, or other operation receiving means for receiving operations from an observer in the observation area SC. In this way, the observer can perform operations using the observation area SC. For example, if such an operation method is adopted in the communication function, it can be expected to have the effect of improving the quality of communication with the character that can be observed via the observation area SC.

The first display unit 310 may display an image that is recognized as a three-dimensional image (stereoscopic image). In this way, it is possible to expect the effect of further improving the three-dimensional effect given to the observer. The display method may be an autostereoscopic method such as a lenticular lens method or a parallax barrier method, or a display method that can be recognized as a three-dimensional image using glasses.

The display device is not limited to the shape of a rectangular parallelepiped, but may be a cube, a cylinder, another polyhedron, a sphere, or other shapes. Further, the shape, structure, size, color, pattern, etc. of each component of the display device 1 described above are merely examples. Further, some of the components included in the display device 1 described above may be omitted, or other components may be added. For example, the second display section 330 may be omitted, or the second display section 330 that emits the second image light L2 in the first direction may be placed in an upright position in place of the background plate 910. Furthermore, aerial imaging may be realized using an optical system other than the one described in FIG. 13. Further, the configuration of the present invention may be applied to a display device using a display method or a projector method instead of an aerial imaging method. In the case of a display type, a liquid crystal display, an organic EL display, or another type of display is used as the image display section. For example, as the video display section, a display section may be used that is provided inside the video display space and has a display surface facing the observation area SC (for example, a display surface parallel to the observation area SC). This display section has the same configuration as the first display section 310 or the second display section 330, and is preferably provided at the back of the video display space. In the case of a projector method, a projection surface and a projection means for projecting an image onto the projection surface may be used. Further, the light reduction member 200 may be disposed on the front side or the back side of the opening 110 to reduce light entering the image display space from the outside. Furthermore, if the video display space S1 is to be maintained in a relatively dark state, a configuration in which the light reduction member 200 is not provided may be considered.

Further, in the above embodiment, voice recognition for interacting with the character displayed on the video display unit is enabled in response to a pressing operation on the operation unit 2214, but the present invention is not limited to this. For example, when the presence of a person is detected in a detection target area of a human sensor (an example of a detection means) such as a full-frequency microwave Doppler sensor, the processing board 224 may enable the voice recognition. . In this way, when the user interacts with the character displayed on the video display, there is no need for the user to perform an operation to enable voice recognition or to utter a trigger word, for example, and the user can communicate more naturally. Can be reproduced.

At this time, for example, it is preferable that both the voice recognition by the voice recognition application in the display device 1 and the voice recognition by the voice recognition server be enabled. However, as described below, the activation of voice recognition in the voice recognition application in the display device 1 and the validation of voice recognition in the voice recognition server may be performed in stages. For example, when the presence of a person is detected in the detection target area of the human sensor, etc., voice recognition in the voice recognition application in the display device 1 is enabled, and the observer's greeting or greeting is then Once detected by the recognition application, speech recognition at the speech recognition server may be enabled.

Further, when the display device 1 is equipped with a photographing unit such as a camera (an example of a detection means), a detection target space is provided on the front side of the display device 1, and the processing board 224 When the presence of a voice is detected, voice recognition may be enabled. In this way, voice recognition can be enabled after more reliably determining that the viewer is trying to talk to the character displayed on the video display section.

Furthermore, after a person is detected in the detection target area, the processing board 224 may be configured to enable the voice recognition on condition that user authentication is successful. Note that the authentication method for user authentication may be, for example, an authentication method that does not require manual operation by the user (face authentication, vocal cord authentication, etc.). In this way, for example, when user authentication is performed for a person other than the registered user registered on the display device 1 and the user authentication fails, voice recognition will not be enabled and will not be displayed on the video display section. Unable to interact with other characters. Conversely, the character displayed on the video display section does not show any reaction to people other than registered users. Thereby, the user's attachment to the character can be increased.

Further, if the voice of a phrase other than the phrase registered in advance in the dialogue server installed in the display device 1 or an external server is detected, voice recognition may not be enabled.

Further, a scent sensor may be used as a means for validating voice recognition. For example, the odor of the registered user of the display device 1 may be registered in the display device 1 in advance, and when the odor of the registered user is detected by the odor sensor, voice recognition may be enabled.

Furthermore, even if voice recognition is enabled in this way, for example, the voice of the character displayed on the video display unit (for example, character 1100) will not be output immediately, but when the user calls out to it. If it is not available, it is preferable to prevent the voice of the character from being output. For example, the processing board 224 does not immediately output a character voice saying "Welcome back" in response to voice recognition being enabled, but instead outputs a character voice saying "I'm home" to the user with voice recognition enabled. It is preferable that a character voice saying "Welcome back" is output on condition that the voice is detected. Furthermore, for example, in the dialogue system, a branching scenario for reproducing the following dialogue between an observer and a character (for example, the character 1100) may be created. For example, if it is a weekday,
User: Now Character: Welcome home~
User: Atchi Character: Dialogue like ``Thank you for your hard work in the heat'' is reproduced, and if it is a holiday,
User: I'm home now Character: Ah, welcome home User: Atchie Character: I won't complain because I went out in the heat User: I'm at work Work character: I'm sorry if that's true, thank you for your hard work.A branching scenario that reproduces the dialogue. It would be good if it had been created.

Further, a branching scenario may be created according to the detection result by the odor sensor. for example,
User: The food was delicious!Character: "Eh, let me smell it. Smell it. It smells good!" Or "Hmm!? Isn't there a lot of salt? Take care of yourself!"
A dialogue such as this may be reproduced.

In addition, as another example, when an odor is detected by an odor sensor,
Character: Kunkun, huh? What is this smell?
User: I burned the aroma.Character: Oh, I thought it would be relaxing.You can also reproduce the dialogue. Note that if the content of the observer's response to the question about the type of smell is not registered in the branching scenario, it is preferable that a voice such as "Oh, that's right!" is uniformly output as the character voice, for example.

Further, the processing board 224 constantly records the voice for the most recent predetermined period of time (for example, about 15 seconds), and when the voice of the trigger word for activating the voice recognition is detected, the processing board 224 activates the voice recognition. It may be enabled. For example, the voice recognition application of the display device 1 may be enabled at all times (or in response to a press operation on the operation unit 41, etc.), and the voice recognition by the voice recognition server may be enabled upon detection of a trigger word. At this time, the processing board 224 removes the sound of the trigger word from the detected sound (for example, the sound detected between the detection start time and the detection end time) detected by the microphone 2333 (an example of sound detection means). It is preferable to send the voice data of the recorded voice to the voice recognition server. For example, assume that a user's voice saying "I'm going to Tokyo tomorrow, please tell me the weather" is detected. Note that here, "Rei-tan", which is the nickname of the character 1100, is the trigger word. In this case, the processing board 224 generates the voice ``I'm going to Tokyo tomorrow, Ray-tan, please tell me the weather'' which is obtained by removing the trigger word voice ``Rei-tan'' from the detected voice ``I'm going to Tokyo tomorrow, Ray-tan, please tell me the weather.'' Send to speech recognition server.

For example, if the above detected voice ``I'm going to Tokyo tomorrow, Rei-tan, please tell me the weather'' is sent as is to the voice recognition server, ``Rei-tan'' will be included in the voice recognition result. Due to this, the character voice corresponding to the voice recognition result may not be accurately extracted in the dialogue server, and there is a possibility that the dialogue with the user will not be consistent. In contrast, with the above method, even if the trigger word is uttered in the middle of a sentence, the voice data of the voice excluding the trigger word is transmitted to the voice recognition server. Therefore, it is possible to prevent dialogue with the user from becoming inconsistent due to voice recognition being performed with a trigger word included in the middle of a sentence.

In addition, when realizing dialogue between the user and the character displayed on the video display section by cooperation between the voice recognition server and the dialogue server, the following operations may be performed depending on the configuration of the voice recognition server. good.

For example, if the voice recognition server is configured to start the voice recognition process after the reception of the voice data file is completed, the processing board 224 may detect sounds before and after the trigger word among the sounds detected by the microphone 2333. It is preferable that each voice data file of the voice is individually transmitted to the voice recognition server. For example, among the detected voices from the detection start time to the detection end time, the voice data file of the user voice detected before the trigger word voice (also referred to as the first half of the user voice) is the voice of the trigger word. It is preferable that the audio data file of the user's voice detected later (also referred to as the latter part of the user's voice) is transmitted to the voice recognition server prior to the voice data file.

In this way, in the voice recognition server, the voice recognition process for the first half of the user's voice is started without waiting for the completion of reception of the voice data file of the second half of the user's voice. Therefore, the voice recognition process can be performed more efficiently than when a voice data file containing the first half of the user's voice and the second half of the user's voice is sent to the voice recognition server. As a result, the display device 1 can receive the character voice from the dialogue server earlier, and can shorten the user's waiting time until a response to the user's voice is received.

Furthermore, for example, if the voice recognition server is configured to stream playback voice data from the display device 1 and execute voice recognition processing in real time, the first half of the voice data is sent to the voice recognition server in real time. When the playback speed T1 of the first half of the user's voice is played is preferably controlled to be faster than the standard playback speed T0 (T1>T0). For example, the processing board 224 changes settings so that the first half of the user's voice is played back 25% faster than the standard playback speed T0 in the voice recognition server, and transmits the first half of the audio data. In this way, the speech recognition server can finish the speech recognition process for the first half of the user's voice earlier than when the first half of the user's voice is played back at the standard playback speed T0, Speech recognition processing for the latter half of the user's voice can be started earlier. As a result, the display device 1 can receive the character voice from the dialogue server earlier, and can shorten the user's waiting time until a response to the user's voice is received.

Furthermore, when the audio data of the user's voice in the second half is transmitted to the speech recognition server in real time, the playback speed T2 of the voice in the second half is faster than the standard playback speed T0 and faster than the playback speed T1 of the user's voice in the first half. It is preferable that the control is performed so that the timing is also slow (that is, the relationship T0<T2<T1 is satisfied). For example, the processing board 224 changes settings so that the second half of the user's voice is played back 10% faster than the standard playback speed T0 in the speech recognition server, and transmits the second half of the audio data. In this way, both the first half of the user's voice and the second half of the user's voice are stream-played faster than the standard playback speed T0, and the voice recognition server executes the voice recognition process. As a result, the user's waiting time until a response to the user's voice is received can be further shortened. On the other hand, the user voice in the second half is played back at a speed faster than the standard playback speed T0 but slower than the playback speed T1 of the user voice in the first half. Therefore, it is possible to suppress a decrease in speech recognition accuracy in the speech recognition system. Therefore, the user's waiting time can be further shortened while suppressing a decrease in voice recognition accuracy.

Note that when the voice recognition server performs voice recognition processing in real time by playing back a stream of voice data, for example, the user's voice detected by the microphone 2333 is transmitted to the voice recognition server in real time, but the trigger word is It is preferable that the speech recognition server is controlled not to start speech recognition until speech is detected.

The scope of the present invention is not limited to the configurations explicitly described in the specification, but also includes combinations of various aspects of the invention disclosed herein. Of the present invention, the structure for which a patent is sought has been specified in the attached claims, but at present, even if the structure is not specified in the claims, it is not disclosed in this specification. We intend to include such configurations in the scope of claims in the future.

The present invention is not limited to the configuration described in the embodiments described above. The components of each of the embodiments and modifications described above may be arbitrarily selected and combined. Also, any component of each embodiment or modification, any component described in the means for solving the invention, or a component that embodies any component described in the means for solving the invention. It may be configured by combining them arbitrarily. The applicant intends to acquire rights to these matters through amendments to the application or divisional applications. Even if there is a description of "in the case of..." or "at the time of...", the description is not intended to be limited to those cases or times. We have also disclosed these cases and other configurations, and we intend to acquire the rights. Furthermore, the sections described in order are not limited to this order. It also discloses a configuration in which some parts have been deleted or the order has been changed, and we have the intention to acquire the rights.

In addition, the applicant intends to acquire rights to the entire design or partial design by converting the application to a design registration application. If the device displays an image, there is an intention to acquire rights to a design that includes all or part of that image. Although the drawing depicts the entire device using solid lines, the drawing includes not only the overall design but also the partial design claimed for some parts of the device. For example, it is a drawing that not only includes some members of the device as a partial design, but also includes some parts of the device as a partial design regardless of the members. The part of the device may be a part of the device or a part of the device. We intend to obtain rights not only for the entire design, but also for partial designs in which any part of the solid line part of the drawing is a broken line part. In addition, the modules, members, parts, etc. inside the device casing that are shown in the drawings are subject to independent transactions, and similarly, they are not included in the design registration application. There is an intention to make changes and obtain rights.

1: Display device 100: Housing 101: Right panel 102: Front panel 103: Left panel 104: Back panel 105: Upper lid 106: Lower lid 107: Right internal panel 108: Front internal panel 109: Left internal Panel 110 : Opening 200 : Light reduction member 210 : First area 220 : Second area 221 : Operation board 222 : Slot 223 : USB connector 224 : Processing board 226 : Holding part 227 : Photographing part 231 : Control board 232 : Wiring 233: Sensor board 234: Human sensor 310: First display section 311: First display surface 312: Viewing angle control member 320: Optical member 321: First surface 330: Second display section 331: Second display surface 400: Pedestal part 500 : Light shielding member 601 : First plate 602 : Second plate 800 : Wiring part 810 : Power line 820 : Signal line 830 : Signal line 900 : Partition member 910 : Background plate 1041 : Back cover part 1051 : Opening part 1052 : Opening 1100 : Character 1200 : Character 1210 : Character body 1220 : Collar 1221 : Tag 2100 : Stage image 2200 : Stage image 2211 : Operating section 2212 : Operating section 2213 : Operating section 2214 : Operating section 2251 : Speaker 2252 : Speaker 2261 : Heat sink 2311 : Power jack 2331 : First sensor 2332 : Second sensor 2333 : Microphone 2334 : Light emitting part

Claims (32)

a casing having a light-shielded image display space therein, and an image observation area provided in a first direction side of the image display space;
a video display unit that forms an aerial video in the video display space;
a light reduction member that reduces external light entering the image display space from the observation area;
has
The image display section includes a first display section that emits a first image light, and an optical system that forms an image of the aerial image based on the first image light,
A display device comprising: a light shielding member provided between the light attenuation member and the optical system on an optical path of reflected light of the first image light reflected by the light attenuation member. The display device according to claim 1, wherein the light shielding member is provided at a position that does not overlap the observation area when viewed from the first direction. The image display section includes a first display section that emits a first image light, and an optical system that forms an image of the aerial image based on the first image light,
The display device according to claim 1 , wherein the optical system is arranged so as to avoid a region on an optical path of reflected light of the first image light that is reflected by the light attenuation member. The optical system includes an optical member having a first surface onto which the first image light is incident, and a second surface opposite to the first surface,
The optical member reflects the first image light toward the first direction and transmits the light incident on the second surface toward the first surface. 4 . display device. The display device according to any one of claims 1 to 4, further comprising a second display unit that emits second image light that overlaps with the aerial image when viewed from the first direction side. The display device according to claim 5, wherein the luminance of the first display section is higher than the luminance of the second display section. The first display section is arranged above the observation area so that the display surface faces downward, and the second direction side opposite to the first direction is lower than the first direction side. The display device according to claim 5 or 6 , wherein the display device is tilted. a casing having a light-shielded image display space therein, and an image observation area provided in a first direction side of the image display space;
a video display unit that forms an aerial video in the video display space;
a light reduction member that reduces external light entering the image display space from the observation area;
a second display unit that emits second image light that overlaps the aerial image when viewed from the first direction;
has
The image display section includes a first display section that emits a first image light, and an optical system that forms an image of the aerial image based on the first image light,
The light emission brightness of the first display section is made higher than the light emission brightness of the second display section ,
The first display section is arranged above the observation area so that the display surface faces downward, and the second direction side opposite to the first direction is lower than the first direction side. tilted ,
The second display section is arranged below the observation area so that the display surface faces upward. A display device. The display device according to claim 7 or 8, wherein the display surface of the first display section is inclined at approximately 20 degrees with respect to the horizontal direction. The display device according to any one of claims 7 to 9 , wherein the first display unit emits the first image light so that the aerial image is observed on a display surface of the second display unit. a casing having a light-shielded image display space therein, and an image observation area provided in a first direction side of the image display space;
a video display unit that forms an aerial video in the video display space;
a light reduction member that reduces external light entering the image display space from the observation area;
a second display unit that emits second image light that overlaps the aerial image when viewed from the first direction;
has
The image display section includes a first display section that emits a first image light, and an optical system that forms an image of the aerial image based on the first image light,
The light emission brightness of the first display section is made higher than the light emission brightness of the second display section ,
The first display section is arranged above the observation area so that the display surface faces downward, and the second direction side opposite to the first direction is lower than the first direction side. tilted ,
The casing has a first accommodation space above the first display section,
A display device including a processing board that is disposed on the second direction side of the first housing space and that performs control to display images on the first display section and the second display section. The processing board has a mounting part to which an external device can be attached and detached and for inputting and outputting data to and from the external device,
The display device according to claim 11 , wherein the mounting portion is exposed to the outside of the housing from the second direction side of the housing. a sensor provided below the observation area;
The display device according to claim 11 , wherein the processing substrate controls display on the first display unit according to information measured by the sensor. It has a sensor board on which the sensor is mounted,
The display device according to claim 13 , wherein the sensor board is provided in a portion of the housing on the first direction side.
The display device according to claim 13 or 14 , wherein the sensor includes a sensor that detects a gesture. The housing has a second accommodation space below the video display space,
The display device according to any one of claims 13 to 15 , further comprising a control board that is provided in the second accommodation space and supplies a signal from the sensor to the processing board. a wiring section that electrically connects the control board and the processing board;
The display device according to claim 16 , further comprising: a partition member that partitions the wiring section so that it cannot be observed from the video display space side. The display device according to any one of claims 1 to 17 , further comprising a viewing angle control member provided on a display surface of the first display unit and narrowing a viewing angle in the first direction. a casing having a light-shielded image display space therein, and an image observation area provided in a first direction side of the image display space;
a video display unit that forms an aerial video in the video display space;
a light reduction member that reduces external light entering the image display space from the observation area;
a second display unit that emits second image light that overlaps the aerial image when viewed from the first direction;
has
The image display section includes a first display section that emits a first image light, and an optical system that forms an image of the aerial image based on the first image light,
The light emission brightness of the first display section is made higher than the light emission brightness of the second display section ,
A display device comprising: a viewing angle control member that is provided on a display surface of the first display section and narrows a viewing angle in the first direction. The display device according to any one of claims 1 to 19, wherein the first image light is image light of an image recognized as a two-dimensional image. The display device according to any one of claims 1 to 20 , wherein at least a portion of the portion facing the video display space is treated to reduce light reflection. The display device according to any one of claims 1 to 21 , wherein the housing has a portion surrounding the observation area when viewed from the first direction. The display device according to any one of claims 1 to 22 , wherein the video display section displays a video of a character representing a cat. a casing having a light-shielded image display space therein, and an image observation area provided in a first direction side of the image display space;
a video display unit that forms an aerial video in the video display space;
a light reduction member that reduces external light entering the image display space from the observation area;
a second display unit that emits second image light that overlaps the aerial image when viewed from the first direction;
has
The image display section includes a first display section that emits a first image light, and an optical system that forms an image of the aerial image based on the first image light,
The light emission brightness of the first display section is made higher than the light emission brightness of the second display section,
The video display unit is a display device that displays a video of a character representing a cat. The display device according to claim 23 or 24, wherein the video display unit changes the video based on a communication function that reproduces communication between the character and an observer observing the character. An odor sensor that detects odor,
a display output operation of displaying on the video display section an image of a character moving in accordance with a detection result by the odor sensor; and a display output operation in which the character displayed on the video display section emits a sound in accordance with the detection result by the odor sensor. an operation control means for performing at least one of the voice output operation and outputting the voice;
The display device according to any one of claims 1 to 25, further comprising:. a casing having an image display space therein and an image observation area provided in a first direction side of the image display space;
a video display unit that forms an aerial video in the video display space;
An odor sensor that detects odor,
a display output operation of displaying on the video display section an image of a character moving in accordance with a detection result by the odor sensor; and a display output operation in which the character displayed on the video display section emits a sound in accordance with the detection result by the odor sensor. an operation control means for performing at least one of the voice output operation and outputting the voice;
A display device comprising: The display output operation is an operation of displaying, on the video display section, an image in which a character displayed on the video display section moves in accordance with the type of detected odor,
The display device according to claim 26 or 27, wherein the audio output operation is an operation of outputting audio according to the type of detected odor as audio emitted by a character displayed on the video display section. a voice detection means capable of detecting voice;
a detection means capable of detecting the presence of a person in a detection target area;
Furthermore,
29. Any one of claims 1 to 28, wherein the voice detection means activates voice recognition for interacting with the character displayed on the video display section when the presence of a person in the detection target area is detected. The display device according to item 1. a casing having an image display space therein and an image observation area provided in a first direction side of the image display space;
a video display unit that forms an aerial video in the video display space;
a voice detection means capable of detecting voice;
a detection means capable of detecting the presence of a person in a detection target area;
Equipped with
The voice detection means activates voice recognition for interacting with the character displayed on the video display section when the presence of a person in the detection target area is detected. A wind detection means for detecting wind;
a display output operation for displaying, on the video display section, an image of a character moving in accordance with a detection result by the wind detection means; and a display output operation for displaying, on the video display section, an image in which a character moves in accordance with a detection result by the wind detection means, and a character displayed on the video display section making a sound in accordance with the detection result by the wind detection means. an operation control means for performing at least one of the voice output operation and outputting the voice as a voice emitted by the voice;
The display device according to any one of claims 1 to 25, further comprising:. 32. The display device according to claim 31, wherein the operation control means performs the display output operation or the audio output operation in response to the user's breath based on the detection result by the wind detection means.

Images