JP6165302B1 - Image display device, topic selection method, topic selection program - Google Patents

Abstract

A character to be displayed on an image display device is made familiar to a user. An image display device includes a display unit that displays a character, a conversation unit in which the character performs a conversation with the user, and a chat unit in which the character performs a chat with the user's communication terminal. The next topic is selected based on the content of the executed conversation and the content of the chat performed by the chat unit, and the chat unit selects the next topic based on the content of the executed chat and the content of the conversation performed by the conversation unit. select. [Selection] Figure 5

Description

  The present invention relates to an image display device that displays a character image, and more particularly to an image display device that allows a user to feel a character more familiar.

  Conventionally, various character products have been sold, and some of them are called desktop characters. This is an application that displays a character on a monitor such as a PC, operates according to a predetermined algorithm, displays a specific line, and plays music. There is also an application that allows a character displayed on a user's communication terminal to explain a service provided by using a chat system (for example, Patent Document 1).

JP 2004-145541 A

  By the way, in such a character product, a product that makes the character feel closer is desired.

  An object of the present invention is to provide an image display device that realizes communication with a specific character and makes the character feel closer.

  In order to achieve the above object, an image display device includes a display unit that displays a character, a conversation unit in which the character performs a conversation with the user, and a chat unit in which the character performs a chat with the user's communication terminal. The conversation unit selects the next topic based on the content of the executed conversation and the content of the chat performed by the chat unit, and the chat unit performs the next based on the content of the executed chat and the content of the conversation performed by the conversation unit. Select topics.

  The image display device communicates with a specific character by connecting the topic to each other in the actual conversation that the user performs with the character and the chat that the user performs with the image display device at its communication terminal, thereby allowing the character to be displayed to the user. You can feel closer.

It is the perspective view which looked at the image display device concerning the embodiment of the present invention from the upper part. It is the perspective view which looked at the image display device concerning the embodiment of the present invention from the lower part. 1 is a left side view of an image display device according to an embodiment of the present invention. It is the equipment mounted in the image display device according to the embodiment of the present invention, where (a) is equipment installed in the upper housing part, (b) is equipment installed in the pillar part, and (c) is lower housing. It is a figure which shows the apparatus installed in a part typically. It is a functional block diagram of an image display device concerning an embodiment of the present invention, and is a figure showing one use mode. It is another functional block diagram of the image display apparatus which concerns on embodiment of this invention. It is a data block diagram of the data utilized with the image display apparatus which concerns on embodiment of this invention, (a) is image data, (b) is an audio | voice data, (b) It is an example of signal data. It is a figure explaining the pattern of the audio | voice output with the image display apparatus which concerns on embodiment of this invention. It is a data block diagram which shows the data structural example of the conversation log | history data utilized with the image display apparatus which concerns on embodiment of this invention. It is a data block diagram which shows the data structural example of the chat log | history data utilized with the image display apparatus which concerns on embodiment of this invention. It is a data block diagram which shows the data structural example of the random conversation data utilized with the image display apparatus which concerns on embodiment of this invention. It is a figure explaining the state transition in the image display apparatus which concerns on embodiment of this invention. It is an example of the image displayed with the image display apparatus which concerns on embodiment of this invention. It is a figure explaining the communication mode in the image display apparatus which concerns on embodiment of this invention. It is another figure explaining the communication mode in the image display apparatus which concerns on embodiment of this invention. It is a flowchart which shows the operation | movement in the communication mode of the image display apparatus which concerns on embodiment of this invention. It is an example of a screen which registers a user's schedule with the image display apparatus which concerns on embodiment of this invention. It is a chart explaining the wake-up mode in the image display apparatus which concerns on embodiment of this invention. It is a chart explaining the going-out mode in the image display apparatus which concerns on embodiment of this invention. It is a chart explaining the return home mode in the image display apparatus which concerns on embodiment of this invention. It is a flowchart explaining the chat mode in the image display apparatus which concerns on embodiment of this invention. (A), (b) is a figure which shows the example of a display screen of the communication terminal of the user of the chat mode which concerns on embodiment of this invention. It is a circuit block diagram of the image display apparatus which concerns on embodiment of this invention.

  Hereinafter, an image display device according to an embodiment of the present invention will be described with reference to the drawings. The image display device according to the embodiment displays a character image and outputs a voice of the character. At this time, the character image and the sound of the character displayed on the image display device are determined according to the environment in which the image display device is placed, information about the user who owns the device, and time information.

<Device configuration>
First, the apparatus configuration of the image display apparatus 1 will be described with reference to FIGS. 1 to 4. FIG. 1 is a perspective view of the image display device 1 as viewed from above. FIG. 2 is a perspective view of the image display device 1 as viewed from below.

  As shown in FIGS. 1 and 2, the image display device 1 mainly includes a cylindrical transparent case 2 having a hollow inside, and a transmissive film (in the case of the present invention) erected almost vertically inside the case 2. A flat member 3, a projector 4 that outputs a character image and the like, and components and equipment such as a reflection mirror 5 are provided.

  In the image display device 1 having such a configuration, the image output from the projector 4 is projected onto the transmissive film 3 through reflection by the reflection mirror 5, and the user has thus projected the image projected onto the transmissive film 3. Can be seen through the transparent case 2.

  The case 2 is a housing that is partly or entirely made of a translucent member, and is formed of, for example, an acrylic plate. For example, the case 2 is formed by integrating two transparent semi-cylindrical case members 2 a and 2 b into the two support columns 23 to form a transparent integral cylinder. However, a preformed cylindrical body can also be used for the case 2, and a rectangular plate or film material having elasticity or flexibility is curved into a semi-columnar shape, and this is incorporated into the column 23 and formed. A cylindrical body can also be used as the case 2. By using the cylindrical case 2 in this way, an image projected on the transmissive film 3 can be appropriately visually recognized from any left and right angles. In addition, the support | pillar 23 may be formed with the transparent member, In this case, almost all of the case 2 can be made transparent. However, the support post 23 may be opaque or translucent.

  A band-like opaque shielding portion 25 that is curved along the surface of the case 2 is provided at the upper part on the front side of the case 2. Thereby, when the case 2 is viewed from the front side, the reflection mirror 5 is behind the shielding portion 25 and thus can be hidden and cannot be seen. Although not shown, the circular portion corresponding to the upper bottom surface of the case 2 is subjected to a light shielding process such as application of a light shielding paint. Thereby, indoor lighting etc. can be prevented from entering the transmissive film 3, and the image displayed on the transmissive film 3 can be easily viewed. Further, the upper part on the back side of the case 2 (the upper part of the case member 2b) is provided with an opening so that light forming an image from the reflection mirror 5 can reach the transmission film 3 directly without passing through the case member 2b. ing. Note that the case 2 is not limited to a transparent member, and a translucent member such as milky white may be used.

  A transparent film 3 is provided inside the case 2, and an upper storage portion 21, a lower storage portion 22, and a column portion 6, which will be described later, are provided above, below, and on the back side of the case 2. It has been.

  The transmissive film 3 is an embodiment of the “flat member having translucency” in the present invention, and functions as a transparent screen on which a predetermined image is projected. The transmission film 3 of the present embodiment has a rectangular shape, and is erected so as to be substantially vertical near the center inside the case 2. Specifically, the transmissive film 3 is supported by two support columns 23 erected on both ends of the pedestal 221, so that the surface faces the front side (back side) and is perpendicular to the center of the pedestal 221. Standing up. Instead of the transmissive film 3, a transparent plate material, a translucent plate material, a film material, or the like can be used.

  The lower housing portion 22 is a box made of plastic or the like, and has a space for mounting a control board 701 and other devices (see FIG. 4C) that perform various control operations including output control of the projector 4. The lower housing portion 22 is provided with a detachable lower cover 222 that can be attached to hide the inside, and can be removed to perform maintenance of internal devices. On the pedestal 221 on the upper surface of the lower housing portion 22, the support columns 23 are erected at the left and right ends of the erected position of the transmission film 3.

  The transmissive film 3 and the case members 2 a and 2 b are supported by the support column 23 so as to be integrally provided on the pedestal 221. Thereby, the cylindrical case 2 is erected on the pedestal 221, and the transmissive film 3 has a lower side (lower end) along the upper surface (front surface) of the pedestal 221 while the side portion is inscribed inside the case 2. Provided.

  The pedestal 221 also functions as a pedestal for virtually placing a character or the like displayed in the case 2. That is, the pedestal 221 can look like a base material of a display case that accommodates dolls and models so that they can be displayed.

  In the image display device 1, the angle and orientation of the reflection mirror 5 are adjusted by the mirror mounting portion 51 so that the feet of characters and the like are displayed on the lower end of the transmission film 3 (FIG. 1). By doing in this way, it can be shown that the character etc. are actually standing on the base 221.

  Moreover, the base 221 has predetermined visibility. Specifically, the presence of the pedestal 221 is made conspicuous by giving a pattern or coloring to the surface of the pedestal 221 or giving a feature to the shape. For example, the pedestal 221 of this embodiment is configured such that grooves along a so-called magic square pattern are formed on the surface of an acrylic plate by laser processing or the like. This pattern is only an example. For example, as a magic team, a pentagram may be used, or other complicated geometric patterns may be applied.

  Further, the pedestal 221 is arranged such that a plurality of effect LEDs 706 (light emitting means of the present invention) are distributed below the acrylic plate, so that the light from the effect LED 706 spreads over the entire surface of the pedestal 221. . In this way, since each region straddling the transparent film 3 is strongly recognized on the surface of the base 221, the presence of the base 221 is more emphasized before and after the character or the like projected on the transparent film 3. Can do. Then, the character or the like can appear to be standing on the base 221 firmly.

  The upper housing portion 21 has a space for mounting a device such as the projector 4 that performs image output (see FIG. 4A). Specifically, the upper housing portion 21 is provided with a ladder-like upper device attachment portion 211 connected to the upper portion of the column portion 6, and the projector 4 is attached to the lower surface of the upper device attachment portion 211.

  As shown in FIG. 2 and FIG. 3, the upper device mounting portion 211 is fixed in a state of being tilted upward from the connecting portion 213 with the column portion 6, and is attached to the upper device mounting portion 211 accordingly. The projector 4 is also fixed in a tilted state. In this way, by attaching the projector 4 at an angle, the output direction of the image is directed toward the reflection mirror 5 positioned below the back side of the projector 4.

  The upper device mounting portion 211 is pivotally supported using a shaft member such as a bolt in connection with the column portion 6, rotated to an arbitrary position around the shaft, and fixed by a fixing member such as a nut. You can also. In this way, the inclination of the projector 4 can be easily changed, and the output of the image can be adjusted in the vertical direction by this change.

  The upper housing part 21 is provided with a detachable upper cover 212. By attaching it, devices such as the upper device mounting part 211 and the projector 4 can be hidden, and by removing them, maintenance of internal devices can be performed. It is said.

  The projector 4 is an image output unit that outputs an image such as a character image. This type of projector 4 normally displays an image by directly projecting an image on a so-called screen, but in the present embodiment, the image is indirectly projected onto the screen (transmission film 3) via the reflection mirror 5. Like to do. Specifically, the projector 4 according to the present embodiment is inclined in the upper housing portion 21 so that the output image is directed to the reflection mirror 5 on the upper portion of the column portion 6 that is provided upright on the back side of the case 2. It is attached in the state.

  By the way, the specifications of the projector include a focal length (hereinafter referred to as “allowable projection distance”) and a projection ratio (hereinafter referred to as “allowable projection angle”). The “allowable projection distance” is a necessary projection distance corresponding to the image size (the distance of the optical path from the projector to the screen). If the actual projection distance is less than the allowable projection distance, the image is not focused and the image cannot be displayed clearly. The “allowable projection angle” is an allowable value of the angle between the optical path of the image projected on the screen and the screen. If the actual projection angle is less than the allowable projection angle, the image will be distorted, and the image quality will deteriorate, for example, the amount of light will be different at both ends of the image and the image will be blurred.

  In view of these points, the projector 4 according to the present embodiment has a specification that has a relatively short allowable projection distance and a small allowable projection angle, and further uses the reflection mirror 5 so that the projector 4 and the screen (that is, The transmission film 3) can be integrated in a compact manner.

  The column portion 6 is a columnar member that is erected on the backmost part of the lower housing portion 22, and is erected on the back side of the case 2 so as to be separated from the case 2. Thus, by providing the column part 6 on the back side of the case 2, indoor lighting or the like can be prevented from entering the transmissive film 3, and the image displayed on the transmissive film 3 can be easily viewed. A reflection mirror 5 and various sensors are attached to the column portion 6 (see FIGS. 2, 3, and 4B).

  The reflection mirror 5 is provided on the upper portion of the column portion 6 so that the mirror surface is substantially vertical (that is, substantially parallel to the surface of the transmission film 3). As a result, the light of the image having a predetermined incident angle output from the projector 4 obliquely downward on the back side is reflected at the same angle (reflection angle), and the image is projected onto the transmissive film 3 by the reflected light. ing. In this way, since the difference in projection distance between the upper part and the lower part of the image on the transmissive film 3 can be suppressed, blurring of the image projected on the transmissive film 3 can be suppressed.

  As shown in FIG. 3, the image light output from the projector 4 is reflected by the reflection mirror 5, and the reflected image light travels obliquely downward on the front side and passes through the opening of the case member 2b. Then, the transmission film 3 provided inside the case 2 is projected from the back side. In this state, when an image of a character or the like projected on the transmissive film 3 through the case 2 is viewed, the character or the like can be visually recognized as a three-dimensional entity in the same space.

  The reason why such a visual recognition effect is exhibited will be described below. As described above, the image display device 1 is provided with a transparent film (transmission film 3) inside the transparent case 2, and projects an image on the transparent film. In such an image display device 1, the user sees a character or the like displayed on a transparent film through the transparent case 2.

  In this case, the user recognizes the 3D environment, that is, the vertical (height), the horizontal, and the depth in the space in the case 2 that is limited by being partitioned by the case 2. For this reason, in particular, by recognizing the depth resulting from the relationship between the character and the like displayed in the space and the case 2, there is a visual effect (3D environmental effect) that the character or the like itself appears to be 3D (three-dimensional). .

  That is, by visually recognizing the transparent case 2 in the back of the character, the character, etc. and the partition on the back side are both visually recognized in the closed space. As a result, the transparent case with the character in the same space Characters etc. look three-dimensional based on the sense of depth.

  On the other hand, if the case 2 is eliminated and an image of a character or the like projected on a transparent film is seen in an open space with nothing around, the surrounding space is recognized vertically and horizontally. While the depth perception is weakened. Then, even if you look at the images of characters, etc. projected on transparent film in such an open environment, it is difficult to feel the sense of depth just by increasing the presence of the film. There is no visual effect.

  Further, when the transparent film is viewed through the transparent case 2, the transparent film becomes inconspicuous. This is because the transmission film 3 is inscribed in the case 2 so that the left and right ends of the transmission film 3 cannot be seen. In addition, when the back is viewed through a front material, including a transparent material, it is difficult to recognize the back material.

  When this is applied to the image display device 1, for example, when the case 2 is viewed from the front side, the transparent film 3 behind the case 2 (case member 2a) is difficult to recognize. Then, since the presence of the planar transmission film 3 is not recognized, the character projected on the transmission film 3 seems to float a three-dimensional object that is not a plane. For these reasons, the image of the character or the like can be displayed more three-dimensionally when the case 2 is present than when the case 2 is absent.

  In addition, the image display device 1 of the present embodiment is provided with a base 221 below (lower end) of the transmissive film 3 so that the feet of characters and the like are displayed in alignment with the lower end of the transmissive film 3. In this way, it looks as if the character or the like is standing on the pedestal 221, and the character or the like can be given an illusion as if it were a solid object with mass.

  In particular, the pedestal 221 is provided with a pattern or the like so that the surface can be easily seen, and the production LED 706 is arranged in both the area on the front side and the area on the back side to straddle the transparent film 3 so as to emit light. Yes. Thereby, it can be made to recognize clearly that the base 221 exists before and behind a character etc., and, as a result, the character etc. can be shown standing in the state which landed firmly on the base 221. Therefore, the character etc. projected on the transparent film 3 in the transparent case 2 can be made to look like an actual three-dimensional object also by such a relationship with the base 221.

  In addition, for the transmissive film 3, projection is performed by reflected light from the reflection mirror 5 provided on the upper part on the back side, and part of the light of the image is transmitted through the transmissive film 3, so It is projected on top as a shadow of light. Even when such a shadow is visually recognized, there is an effect of visually recognizing the display target.

  Next, devices mounted on the image display apparatus 1 will be described with reference to FIG. 4A is a schematic diagram of a device installed in the upper housing part, FIG. 4B is a schematic diagram of a device installed in the pillar part, and FIG. 4C is a schematic diagram of a device installed in the lower housing part. is there.

  In addition, the side of Case 2 is made opaque, or an opaque film is attached to the side surface to reduce the visibility of the character from the side, so that the user can see the character from the front side. May be. Here, the image from the projector is projected onto the transmissive film 3. For example, this is because the image display device is provided with a configuration capable of spraying, for example, water droplets, and projection is performed on the sprayed water droplets. It is good also as projecting a character by such a three-dimensional holography. By applying the 3D holography technology, it is possible to display a character with a more 3D effect.

《Installation equipment for lower housing part》
As shown in FIG. 4C, the lower housing portion 22 includes a control board 701, a human sensor 702, an infrared LED 703, a microphone 704, a speaker 705, an effect LED 706, an infrared light receiver 707, a status LED 708, and a start button 709. In addition to the USB hub 710, a Wi-Fi (registered trademark) module, a Bluetooth (registered trademark) module, and the like are installed.

  The control board 701 is equipped with one or a plurality of control chips on which a CPU, ROM, RAM, HDMI (registered trademark) port, LAN port, USB port, various input / output ports and the like are mounted. Based on the information, a predetermined device performs various output operations including images and sounds.

  The human sensor 702 is a sensor that detects the location of a person by detecting the amount of change in infrared rays, and is provided on the left and right sides of the front side.

  The infrared LEDs 703 are provided radially on the front upper part and function as a so-called infrared remote controller. Specifically, by outputting infrared rays to the surroundings, it is possible to remotely control an external device such as a television or a vacuum cleaner.

  The microphone 704 inputs sound emitted from the user. For example, one microphone 704 is provided in the lower part of the front.

  The speaker 705 outputs sound information such as voice and music via an amplifier. In the example shown in FIG. 4C, the speaker 705 is provided on the front side, but is preferably installed in a stereo manner on the left and right of the rear pillar.

  The effect LED 706 is a light emitting means in the pedestal 221.

  The infrared light receiving unit 707 is provided on the front side, and receives infrared information related to a remote control operation used by the remote controller from a remote controller of home appliances such as a television, a lighting fixture, an air conditioner, and a robot cleaner.

  The status LED 708 is a notification unit that indicates the state of the image display device 1 (for example, power-on, error occurrence, communication, “sleep state”, “unsummoned state”, “summoned state”, etc. described later). Various states are notified in a distinguishable manner by a specific blinking pattern, emission color, or the like.

  The start button 709 is an operation unit for turning on / off the power of the main body of the image display apparatus 1.

  The USB hub 710 is a hub for connecting a plurality of USB devices.

  The Wi-Fi (registered trademark) module is a wireless LAN module connected to a USB hub, and provides an Internet environment to a wireless LAN slave unit as an access point, or connects to the Internet through another access point as a wireless LAN slave unit. You can do it.

The Bluetooth (registered trademark) module is a wireless communication interface that enables wireless communication with peripheral devices such as a keyboard, a mouse, a communication terminal such as a smartphone, a microphone, and a speaker that comply with a predetermined standard.
《Pillar installation equipment》

  As shown in FIG. 4B, the column portion 6 is provided with a temperature / humidity sensor 611, a vibration sensor 612, and a noise sensor 613 in addition to the reflection mirror 5 described above.

  The temperature / humidity sensor 611 measures indoor temperature and humidity, and inputs these measured values.

  The vibration sensor 612 is a sensor for detecting vibration, and corresponds to, for example, a piezo vibration sensor. The vibration detected by the vibration sensor 612 includes a large vibration such as an earthquake, and a relatively small vibration that can identify footsteps and door opening / closing.

The noise sensor 613 is a sensor for detecting indoor environmental sounds. The environmental sound detected by the noise sensor 613 includes, for example, a user's life sound (including TV sound), a nearby environmental sound, and noise determined based on a predetermined reference volume.
<< Installation equipment for the upper housing part >>

  As shown in FIG. 4C, the upper accommodating portion 21 is provided with a projector 4, an infrared LED 703, an optical sensor (illuminance sensor) 721, and a camera 722.

  As described above, the projector 4 projects an image onto the transmissive film 3 via the reflection mirror 5. The images output from the projector 4 include, for example, 2D images and 3D images of characters, real people, articles, etc. appearing in various comics and animations, and images for effects that produce character emotion expressions.

  The infrared LEDs 703 are provided on the left and right, respectively, and function as an infrared remote controller, similar to the one provided in the upper housing portion 21.

  The optical sensor (illuminance sensor) 721 is a sensor that measures brightness (illuminance).

  The camera 722 is an imaging unit that is provided in front and captures a still image or a moving image.

<function>
Next, functions realized by the above-described devices will be described with reference to FIGS. FIG. 5 is a functional block diagram of the image display apparatus 1 according to the embodiment. As shown in FIG. 5, the image display device 1 includes a display unit 700, a conversation unit 717, and a chat unit 718.

  The display unit 700 has a function of displaying a character. For example, the character is displayed by causing the projector 4 to project an image related to the character onto the transparent film 3. The display unit 700 is realized by, for example, a processor or a graphic engine, but the realization method is not limited to this. The character is a person or animal appearing in an animation, a manga, a novel, a computer game, a novel, or the like, but is not limited thereto, and may be an original creative person. Moreover, not only a person and an animal but the inorganic substance which has individuality can also be a character. For example, a robot.

  The conversation unit 717 has a function of conversing with the user, and has a function of rendering the character as if talking with the user. The conversation unit 717 is realized by a processor, for example, and performs a conversation with the user according to a predetermined algorithm. The conversation unit 717 selects a topic of conversation with the user from previously stored sounds, outputs the sound from the speaker 705, and analyzes the user's sound input from the microphone 704. Execute. Here, the voice of the character is stored in advance, but this is not the case, and the character may output a synthesized voice as a voice.

  The chat unit 718 executes chat with a communication terminal held by the user. The chat unit 718 is realized by a processor, for example, and chats with the user according to a predetermined algorithm. The chat unit 718 may perform a wireless communication directly with the user's communication terminal to perform a chat, or may perform a chat via a predetermined messaging server (chat server). The chat here is for exchanging so-called messages (communication texts). The chat unit 718 automatically selects the content of the conversation, transmits the selected conversation content as a character string, analyzes the content of the chat transmitted from the user's communication terminal, and responds to the analyzed content. Select a topic and generate a response and send the message.

  Here, the conversation unit 717 and the chat unit 718 are linked to each other. The fact that the conversation unit 717 and the chat unit 718 are linked to each other means that the character-user conversation performed by the conversation unit 717 with the user is reflected in the contents of the chat performed by the chat unit 718, and the chat unit 718 is the user. The content of the chat executed with the communication terminal is reflected in the content of the conversation executed by the conversation unit 717. The content of chat and the content of conversation are the content of the speech itself and the topic. The conversation unit 717 and the chat unit 718 are linked to each other. For example, when the conversation unit executes a conversation about baseball with a user, the topic about the baseball is included in the topic executed by the chat unit. To be precise, it means having the possibility of executing a topic about baseball. The conversation unit 717 and the chat unit 718 are realized by the control unit 71 described below.

  In addition, the image display device 1 can further include a case 2 that is at least partially made of a translucent member as described above with reference to FIGS. 1 to 3. The display unit 700 is a light-transmitting device that projects a character image and an effect image on the transmission film 3 that is a translucent flat plate member standing in the case 2 and the transmission film 3 that is a flat plate member. A certain projector 4 and a display processing unit 713 that controls display of an image via a projector that is a light projecting device can be provided.

  Specifically, as shown in FIG. 6, the image display device 1 includes a control unit 71, an input unit 72, an output unit 73, an operation unit 74, a storage device 75, and a communication unit 76. By executing the image display program P1, the conversation program P2, and the chat program P3 stored in the storage device 75, the control unit 71 obtains the acquisition processing unit 711, the analysis unit 712, the display processing unit 713, and the voice output unit 714. Processing as the transmission processing unit 715 and the data management unit 716 can be executed.

  The input unit 72 is a means for inputting various information detected by various sensors. The data input to the input unit 72 includes, for example, identification information output from the human sensor 702 when the human sensor 702 detects a person, voice information input via the microphone 704, and a temperature / humidity sensor 611. Information on the room temperature and humidity detected by the sensor, information capable of identifying the magnitude and change of the vibration detected by the vibration sensor 612, volume information input via the noise sensor 613, and input via the optical sensor 721 Illuminance information, still image / moving image information captured by the camera 722, and the like.

  The output unit 73 is output means for outputting signals and information based on a predetermined command. Signals and information output by the output unit 73 include, for example, infrared signals for controlling the operation of external devices output from the infrared LED 703, audio information output via the speaker 705, and light emitted from the effect LED 706. Light, images output from the projector 4, and the like.

  The operation unit 74 is an operation means by the user, and corresponds to, for example, a keyboard and mouse (not shown), operation buttons (hard keys) provided on the image display device 1, and a touch panel. The operation performed by the operation unit 74 includes, for example, a button for turning on / off the power of the apparatus main body by the start button 709 and switching the image display apparatus 1 between a sleep state (non-summon state) and an active state (summon state). Etc.

  The storage device 75 includes, for example, a RAM that constitutes the image display device 1, a nonvolatile memory such as an EEPROM or a flash memory, and stores programs and data for executing various functions of the image display device 1. It is a storage means. Data stored in the storage device 75 includes image data 751 and voice data 752 such as characters, signal data 753 for operating an external device such as a television and a lighting device, user data 754 regarding user attribute information, and the like, an image display device 1, conversation history data 755 indicating the history of conversations with the user, chat history data 756 indicating the history of chats performed by the image display device 1 with the user's communication terminal, and a remote control related to the remote control of the external device Information, calendar information registered on the calendar site, attribute information of the apparatus main body and each device, information input from sensors, music information, language data, and the like. In addition to the image display program P1 for executing various control operations to be described later, the storage device 75 includes a conversation program P2 for directly communicating with the user, There are a chat program P3 for executing a chat with a communication terminal (via a chat server), a voice recognition program, an artificial intelligence program, and the like.

  The image data 751 includes display conditions for displaying an image, character image information (first image information) for specifying a character image displayed due to the conditions, and effect image information (second image) for specifying an effect image. Image information). The effect image expresses the character's emotions and the like, and may include an image including characters of words representing the emotion or the like, or an image including particles such as a star shape or a heart shape. . The effect image is not essential and may not be displayed. For example, it may be displayed with a predetermined probability. Specifically, for example, a random threshold value that changes in one day is provided, a random value is calculated at any time to determine whether or not to display an effect image, and the random value exceeds the set threshold value An effect image may be displayed depending on whether or not.

  In the example of the image data 751 shown in FIG. 7A, it is defined that “character image A” and “effect image A” are displayed when “sound A” is detected as the environmental signal. For example, when the voice A is the word “good morning”, an image that shows the character saying “good morning” is displayed as the character image A, and the morning image is refreshed as the production image A An image that produces an effect is displayed. Further, the effect image A may include a speech balloon displaying the characters “Good morning”.

  When “motion C” is detected as the environmental signal, “character image C” and “effect image C” are displayed. For example, when the action C is “user's return home”, an image that shows the character saying “return” is displayed as the character image C, and the home screen is presented as the production image C. An image that produces a special effect is displayed. Further, the effect image C may include a balloon displaying the characters “return”.

  At the timing of “time D”, “character image D” and “effect image D” are displayed. For example, when “6 am” is set as the alarm time for time D, when it is 6 am, an image showing a character waking up the user is displayed as character image D. As the effect image D, an image that wakes up may be displayed. In addition, the effect image D may include a balloon displaying the characters “It's morning”.

  At the timing when “signal E” is received, “character image E” and “effect image E” are displayed. For example, when the signal E is a “habrush” signal transmitted from the user's communication terminal, when the signal E is received, an image representing a character brushing teeth is displayed as the character image E. At the same time, as the effect image E, a refreshing image suitable for tooth brushing may be displayed. In addition, the effect image E may include a character “in brushing”.

  In the image data 751, display conditions including time information as well as environment information may be defined. For example, even if the environment information is the same, the image data 751 can be defined such that the displayed character image and effect image are different between morning and afternoon.

  Further, the image data 751 may define display conditions including a reception signal together with environment information.

  The sound data 752 is data in which an output condition for outputting sound is associated with information for specifying sound output due to the condition.

  In the example of the audio data 752 illustrated in FIG. 7B, it is defined that “audio A” is output when “audio A” is detected as the environment signal. For example, when the voice A is the word “good morning”, “good morning” is output as the voice A in the voice of the character.

  When “operation C” is detected as the environmental signal, “voice C” is output. For example, when the action C is “user's return home”, “Okaeri” is output as the voice C in the voice of the character.

  At the timing of “time D”, “6 o'clock” is output as voice D in the voice of the character.

  At the timing when the “signal E” is received, a sound that the character brushes and gargles is output as the sound E.

  In the audio data 752, an output condition including time information as well as environment information may be defined. For example, the audio data 752 can be defined so that the output audio is different between morning and afternoon even if the environmental information is the same.

  Furthermore, in the audio data 752, an output condition including a reception signal together with environment information may be defined.

  The signal data 753 is data in which a condition for outputting an operation signal for operating an external electric device such as a home appliance is associated with an operation signal transmitted due to the condition.

  In the example of the signal data 753 illustrated in FIG. 7C, it is defined that “operation signal F” is output when “voice F” is detected as the environmental signal. For example, when the voice F is a word “Turn off the TV”, an operation signal F for turning on the TV is output.

  In addition, as shown in FIG. 8, the image and audio | voice output according to a date may differ also with respect to the same word and action. For example, if a voice of “Good morning” is detected, a voice that encourages the day will be output if it is a weekday morning, “Good morning today!” If it is a holiday morning, “Good morning, I can do it slowly” And output a sound that makes you tired of weekdays. On the other hand, at night, it outputs a voice saying "What are you talking about? Therefore, it is possible to prevent unnatural mechanical communication in daily life. Thereby, the user can feel the character closer.

  The user data 754 includes various information related to the user such as the user profile, attributes, and preferences. Having the user's name in the user data 754 allows the image display device 1 to output the user's name by voice, for example. At this time, not only the name but also a nickname may be registered. This allows the character to call the user's name. Therefore, the user can feel familiar with the character and feel closer to him.

  By inputting the user's address or company address in the user data 754, the image display device 1 can acquire information on the user's action range using the Internet or the like, and output the information by voice or image, for example. it can. As a result, the character can inform the user of various information. Therefore, the user can feel familiar with the character and feel closer to him.

  By inputting the user's date of birth in the user data 754, the image display device 1 can output, for example, a sound for an image celebrating the birthday on the user's birthday. This allows the character to celebrate the user's birthday. As a result, the user can feel familiar with the character and feel closer to him.

  By inputting the user's mobile phone number in the user data 754, the image display device 1 can make a call to the mobile phone while the user is out, for example. Thereby, the user can be in a state where he / she has received a call from a character waiting at home. As a result, the user can feel familiar with the character and feel closer to him.

  In addition, the user data 754 can include information such as favorite anime, manga, novel, game, movie, favorite character, hobby, interest, weight, height, occupation, and the like. The image display device 1 can display an image from a topic that the user is interested in or output a sound based on such information about the user. Further, such information can be generated from a result of a questionnaire or the like, a history of SNS (social networking service) used by the user, or the like. The questionnaire referred to here may be that the character of the image display device 1 asks the user a question such as “Do you like XX?” Through conversation or chat, or sometimes a question list. It is also possible for the user to fill in various data. In the case of the former, the user's favorite topic can be selected thereafter by associating the question content with the character string of the answer from the user and associating it with it as part of the user data 754.

  The conversation history data 755 is history information regarding the contents of conversations directly exchanged between the character of the image display device 1 and the user. FIG. 9 is a data conceptual diagram showing a specific example of the conversation history data 755. As shown in FIG. 9, the conversation history data 755 is information indicating what the conversation has occurred, and is speaker information 901 indicating whether the character side utterance or user side utterance, and date / time information indicating the date and time when the utterance was performed. 902 is information associated with conversation content information 903 indicating the specific content of the conversation. For example, in the example of FIG. 9, the character is talking to “July 10, 2016, 18:30:10”, “There is a baseball broadcast today,” whereas the user, It can be seen that “July 10, 2016, 18:32:20”, “Yes, thank you for telling me”. Note that the conversation content information 903 for the user stores text data as a result of speech recognition performed by the analysis unit 712 for the input speech. Note that the conversation content information 903 may be information in which the entire conversation content is converted into a character string, or may be information obtained by picking up a keyword from the conversation content. For example, in the example of FIG. 9, if the conversation content is “Do you like Team A?”, Combination information such as “Team A, likes” may be stored as the conversation content information 903. In this case, the keyword selected by the image display device 1 may be selected based on a noun in the conversation sentence, or if there is a word representing the user's emotion, it may be picked up and stored. Since the conversation history data 755 is stored in the storage device 75, the image display apparatus 1 can recognize the contents of the past conversation and can reflect the contents of the subsequent conversation or chat. The conversation history data 755 is additionally updated by the control unit 71 every time a conversation is made between the character displayed by the image display device 1 and the user.

  The chat history data 756 is history information related to the contents of the chat executed by the character of the image display device 1 with the communication terminal held by the user. FIG. 10 is a data conceptual diagram showing a specific history of chat history data 756. As shown in FIG. 10, chat history data 756 is information indicating the side that has made a speech in chat, and has speaker information 1001 indicating whether it is a user side speech or a character side speech. This is information in which date / time information 1002 indicating the date and time of the chat is associated with chat content information 1003 that is a character string indicating the content of the chat. For example, in the example of FIG. 10, the character is asking the question “What are you doing now?” On “July 2, 2016, 19:39:21”, while the user However, it can be seen that he answered “I am watching a baseball game at Jingu Stadium” on July 2, 2016, 19:40:30. Note that the chat content information 1003 may be information in which the entire chat content is converted into a character string, or may be information obtained by picking up a keyword from the chat content. For example, in the example of FIG. 10, only the keyword “baseball” may be stored from the chat content “I'm watching a baseball game at Jingu Stadium,” or “I like a player”. For chat contents, a combination keyword such as “a player, likes” may be stored as the chat contents information 1003. In this case, the keyword selected by the image display device 1 may be selected on the basis of a noun in the chat sentence. If there is a word representing the user's emotion, it may be picked up and stored. Since the chat history data 756 is stored in the storage device 75, the image display device 1 can recognize the contents of the past chat and can reflect the contents of the subsequent chat and conversation. The chat history data 756 is additionally updated by the control unit 71 every time a chat is performed between the character displayed on the image display device 1 and the user.

  The random conversation data 757 is data related to selection of a topic when a character performs conversation or chat at random. As shown in FIG. 11, random conversation data 757 is information in which a keyword 1101, a condition 1102, and a conversation or chat content 1103 are associated with each other. The keyword 1101 is a word serving as a conversation trigger, and is information for the control unit 71 to collate with the conversation history recorded in the conversation history data 755 and the chat history data 756 and the topic in the chat history. When the keyword included in the conversation history and the chat history matches any of the keywords 1101, the content of the conversation or chat content 1103 is output by voice or as a chat text. The condition 1102 is a condition that must be cleared in order for the character to speak or chat the corresponding conversation or chat content, and includes a case where there is no condition. Conditions include specific weather (sunny, rain, snow, ...), specific audio input, or specific information (for example, a program being broadcast) It is included in information (for example, TV program information) or various. The conversation or chat content 1103 is information indicating the actual content of the conversation or chat to be executed when the conversation history or the keyword included in the chat history matches the keyword 1101 and the condition 1102 matches. In addition, when a plurality of conversations or chat contents can be detected by the control unit 71, any one of them may be selected at random, or the keywords included in the conversation of the selected conversation or chat contents may be selected. It is good also as selecting a thing with high matching rate with a user preference, and good also as selecting a thing with high consistency with one or more previous conversations. By storing the random conversation data, the control unit 71 can perform the next conversation or chat reflecting each past history as the conversation unit or the chat unit.

  The communication unit 76 is a communication unit that performs bidirectional or one-way data communication processing with an external device by wire or wireless. For example, various data can be transmitted to and received from a device connected to the Internet via a wireless connection based on a LAN cable connected to a LAN port or a Wi-Fi (registered trademark) module. For example, the communication unit 76 can receive a signal transmitted from a user communication terminal. The communication unit 76 includes information that can be acquired via the Internet, such as weather information that can be received from the weather information site and calendar information registered in the calendar site. Moreover, the communication part 76 can perform chat communication between a user's communication terminal via the chat server on the network which is not shown in figure.

  The control unit 71 can perform control operations as the acquisition processing unit 711, the analysis unit 712, the display processing unit 713, the audio output unit 714, the transmission processing unit 715, and the data management unit 716 according to the image display program P1.

  The acquisition processing unit 711 acquires a signal detected from at least one of the microphone 704, the camera 722, the human sensor 702, the optical sensor 721, the temperature / humidity sensor 611, the vibration sensor 612, the noise sensor 613, and the like.

  The analysis unit 712 analyzes the environment information acquired by the acquisition processing unit 711. For example, the analysis unit 712 analyzes words uttered by the user from the environment signal detected by the acquisition processing unit 711 from the microphone 704. For example, the analysis unit 712 can specify a word uttered by the user from the voice acquired by the microphone 704 using a language model and a voice model registered in advance in the storage device 75. The language model is data in which a set of word information of languages used in the language used by the image display apparatus 1 and various wordings are registered. The speech model is a speech signal model of a language to be used, for example, a signal indicating frequency characteristics. Specifically, it is a standard model of a word-by-word speech such as “A”, “I”,..., “A”, “b”. Thereby, the input user's voice can be specified by pattern matching. Thereby, the image display device 1 can display an image determined according to the words uttered by the user, and output a sound determined according to the words. Here, the storage device 75 may have voiceprint information as user data relating to the user who is the owner of the image display device 1 so that the voice of the owner user can be recognized.

  In addition, when the analysis unit 712 cannot analyze the words uttered by the user, the image display device 1 does not output normal mechanical audio such as “say again” and request the user to repeat, React in another way. For example, the image display apparatus 1 outputs a voice of “speak closer” and “speak gently” to induce repetition. Further, the image display device 1 may output a sound of appropriate consonance such as “Fun”, “So-ka”, “Naru-do”, or “N-”, “Et-”, etc. Voice of filler expression may be output.

  Further, the analysis unit 712 analyzes the position and operation of the user from the environment signal detected by the acquisition processing unit 711 from the camera 722. Specifically, the analysis unit 712 can detect a human face from an image as image analysis. In addition, the storage device 75 may have user face information as user data related to the owner user, and recognize the owner user's face from the detected person's face.

  By specifying the owner user, the image display device 1 can display an image that makes the character feel close to the owner user or output a sound. On the other hand, the image display apparatus 1 can display an image or output a sound that makes contact with a person other than the owner, or gives a greeting such as self-introduction. As a result, the user can feel closer to the character displayed on the image display device 1.

  Further, the analysis unit 712 combines the results of the analyzed user's words, the user's position and operation, and other environment information and button operations detected by other sensors into one environment information. It may be generated. For example, it is possible to determine whether to go out or go home, which will be described later, from the detection result of the human sensor in addition to the sound and image.

  The display processing unit 713 reads out the image data 751 from the storage device 75 and selects character image information and effect image information associated with the display condition corresponding to the environmental signal acquired by the acquisition processing unit 711 from the image data 751. In addition, the display processing unit 713 outputs an image corresponding to the selected character image information and effect image information to the output unit 73 for display. The display processing unit 713 may display a character image and an effect image according to the environment information and the time information. Further, the display processing unit 713 may display the character image and the effect image according to the environment information and the received signal.

  The audio output unit 714 reads out the audio data 752 from the storage device 75 and selects audio information associated with the output condition corresponding to the environmental signal acquired by the acquisition processing unit 711 from the audio data 752. In addition, the audio output unit 714 outputs audio corresponding to the selected audio information to the output unit 73. Moreover, the audio | voice output part 714 may output an audio | voice according to environmental information and time information. Furthermore, the audio output unit 714 may output audio according to the environment information and the received signal.

  The transmission processing unit 715 reads out the signal data 753 from the storage device 75 and selects an operation signal associated with the environmental signal acquired by the acquisition processing unit 711 from the signal data 753. In addition, the transmission processing unit 715 outputs the read operation signal to the output unit 73.

  The data management unit 716 acquires time information from a clock built in the image display device 1 or an external clock. When an image or sound to be displayed is determined according to time, a control signal is output to the display processing unit 713 and the sound output unit 714 according to the display and output schedule.

  In addition, the data management unit 716 accesses the weather information site when the image display device 1 is activated, acquires the weather information of the day, and stores the weather information in the storage device 75. Furthermore, the data management unit 716 can periodically access the calendar site where the user's schedule is registered, and store the latest calendar information obtained thereby in the storage device 75. In addition, the data management unit 716 can receive remote control information (infrared information) related to the external device from the remote control of the external device such as a television or lighting by the infrared light receiving unit 707 and store (learn) it in the storage device 75. Based on the remote control information, infrared information for operating an external device can be transmitted from the infrared LED 703. Note that the data management unit 716 can also access data on various networks and collect various data that can be used for conversations and chats with users.

<Operation>
In the image display device 1, processing such as image display and sound output is executed in accordance with each state such as “sleep state”, “unsummoned state”, and “summoned state”. As shown in FIG. 12, the power button (not shown) is not effective in the image display device 1 when the outlet is not connected (S1), but when the outlet is inserted and the outlet is connected ( S2) The power button is enabled.

《Unsummoned》
When the power button is pressed while the outlet is connected (S2), the control unit 71 is activated (S3). With this activation, for example, an activation screen is displayed, and the process proceeds to the “unsummoned state” (S4). The “unsummoned state” is a state in which the image display device 1 is turned on and the projector 4 is activated, but no character image is displayed and an unsummoned image is displayed. In the unsummoned state, the projector 4 is activated, but the speaker 705, the camera 722, etc. are not activated, and an environmental signal cannot be detected. In the image display device 1, the status LED 708 is lit when not summoned.
《Summoned state》

  When the touch button 26 is pressed for a long time in the unsummoned state (S4), the state shifts to the “summoned state” (S5). The long press of the touch button 26 means that the user touches the touch button 26 for a predetermined time or longer (for example, 3 seconds or longer). This summoning state is a state in which characteristic image display and audio output processing are executed in the image display device 1. In the summoning state, the image display device 1 is a state in which the projector 4 is activated and a character image is displayed, and the speaker 705, the camera 722, and the like are activated to detect an environmental signal. In the “summoning state”, there are (a) communication mode, (b) life mode, (c) care mode, (d) appeal mode, (e) chat mode, and the like. Processing is executed.

《Sleep state》
If the power button is pressed in the unsummoned state (S4) or left for a predetermined time, the state shifts to the “sleep state” (S6). “Leave for a predetermined time” is, for example, a state in which the touch button 26 is not pressed for a predetermined time or longer (for example, 20 minutes or longer). The sleep state is a state of a power saving standby mode in which the projector 4 is not activated and the speaker 705, the camera 722, and the like are not activated. In the image display device 1, the status LED 708 is lit in the sleep state.

  The image display device 1 shifts to an unsummoned state when the user presses the power button or touches the touch button 26 in the sleep state. “The touch button is touched” means that the user touches the touch button 26 for a time less than a predetermined time (for example, less than 3 seconds).

  Next, (a) communication mode, (b) life mode, (c) care mode, (d) appeal mode, and (e) chat mode in the summon state will be described.

(A) Communication mode The communication mode is a state in which a character image is displayed and the character and the user can communicate with each other. Specifically, the image display apparatus 1 displays a character image corresponding to the environmental signal acquired by the acquisition processing unit 711 in the communication mode. The image display device 1 displays an effect image according to the environmental signal. Furthermore, the image display device 1 outputs sound according to the environmental signal.

  The image display device 1 first enters the communication mode when the touch button is pressed for a long time from the unsummoned state and shifts to the summoned state. Further, the image display device 1 enters the life mode when the environmental signal is not acquired and the operation signal or the like is not received at the communication mode timing for a predetermined time or longer (for example, 10 minutes or longer). Transition.

  For example, in the image display device 1, when a word “What is the weather today?” Uttered by the user as an environmental signal is detected by the microphone 704, the data management unit 716 stores the word in the storage device 75 accordingly. On the basis of the weather information, a sound such as “It is sunny today” is output from the speaker 705. Further, in the image display device 1, a character image that performs an operation expressing joy with respect to sunny weather is displayed on the transparent film 3. Further, in the image display device 1, an effect image for producing a sunny weather is displayed on the transmissive film 3. As shown in FIG. 13A, the effect image may be not only a simple image but also a combination with text data such as displaying a text “Today is sunny” in a balloon. As a result, the user can feel the feeling of living with the character who taught us today's weather and feel the character closer to him. It should be noted that the effect image is not essential, and display / non-display may be switched at random.

  Further, for example, in the image display device 1, when the user approaches the image display device 1 and the user's face is largely detected by the camera 722, a sound such as “It is too close” is output from the speaker 705 accordingly. Is done. Further, in the image display device 1, a character image is displayed on the transparent film 3 that performs an operation of embarrassing that the user's face is nearby. Further, the image display device 1 displays an effect image that produces a feeling of embarrassment of the character. As shown in FIG. 13B, the effect image may be not only a simple image but also a combination with text data such as a balloon that displays a character “too close”. Thereby, the user can feel a sense of living with a character who is shy according to the vicinity, and can feel the character more familiar.

  Further, for example, in the image display apparatus 1, when the user presses the touch button 26 a plurality of times and performs an operation that calls the user a plurality of times and disturbs the character's action, the speaker 705 responds to “What, what? "Nano-" sound is output. Further, in the image display device 1, a character image is displayed on the transparent film 3 that operates as if disturbed by being called by the user a plurality of times. Further, in the image display device 1, an effect image that asks the user for a plurality of calls is displayed on the transparent film 3. Thereby, the user can feel closer to the character corresponding to a plurality of calls, and can feel the feeling of living with the character.

  Further, for example, in the image display device 1, when a signal for sending an object to a character is transmitted from the user's communication terminal, a sound that pleases this is output from the speaker 705. Characters that use the sent object are displayed.

  As shown in FIG. 14A, the user's communication terminal is operated to transmit “TV” to the character of the image display device 1. Then, in the image display device 1, a television is displayed as an effect image as shown in FIG. In addition, the effect image may include, for example, characters “Let's watch TV together” in a balloon. In this case, in the image data 751, the character image and the effect image shown in FIG. 14B are associated with the transmission signal for transmitting the television.

  Further, the image display device 1 outputs a sound “Watch TV together”. In this case, in the audio data 752, a sound “TV together” is output as a transmission signal for transmitting television.

  Then, when the target television program ends, as shown in FIG. 14B, the image display device 1 may display an effect image including the characters “It was fun” in a balloon. At the same time, the image display device 1 outputs a sound “It was fun”. In this case, in the image data 751, an effect image including “interesting” is associated on condition that a predetermined time has elapsed after the transmission signal for transmitting the television is received (the television program has ended). Also, in the audio data 752, “interesting” audio is associated with a condition that a predetermined time has elapsed after the transmission signal for transmitting the television is received (the television program has ended). Note that there may be cases where “interesting” is not appropriate as the content of a television program, and therefore, an audio with an appropriate impression may be selected and output.

  In addition, when the user laughs while watching the television, the image display device 1 may output the voice of the character laughing at the same time when the user laughs. By outputting such a character image, an effect image, and sound, the user can feel as if watching the TV together with the character.

  For example, when the input device of the user's communication terminal is a touch panel, the transmission operation can be executed by flicking the image of the substance to be transmitted toward the image display device 1.

  As illustrated in FIG. 14D, the user's communication terminal is operated to transmit “coffee” to the character of the image display device 1. Then, as shown in FIG. 14E, the image display device 1 displays coffee as an effect image. The effect image may include, for example, characters “Let's break coffee” in the balloon. In this case, in the image data 751, the character image and the effect image shown in FIG. 14E are associated with the transmission signal for transmitting coffee.

  Further, the image display device 1 outputs a voice “Let's break coffee”. In this case, in the audio data 752, a voice “Let's break coffee” is output as a transmission signal for transmitting coffee.

  Then, when a predetermined time (for example, 10 minutes) elapses, as shown in FIG. 14 (f), the image display device 1 may display an effect image including the characters “Frustrated” in a balloon. Good. At the same time, the image display device 1 outputs a voice saying “Food was frustrated”. In this case, in the image data 751, an effect image including “Frustrated” is associated with a condition that a predetermined time has elapsed after receiving a transmission signal for transmitting coffee. Also, in the audio data 752, the voice of “I was frustrated” is associated on condition that a predetermined time has elapsed after receiving the transmission signal for transmitting coffee.

  In addition, while drinking coffee, the image display device 1 may display a moving image in which the character drinks coffee or output a sound such as “delicious”. By outputting such a character image, a production image, and a voice, the user can feel as if they are drinking coffee with the character.

  As shown in FIG. 14G, the user's communication terminal is operated to transmit “food (a donut in FIG. 14G)” to the character of the image display device 1. Then, in the image display device 1, as shown in FIG. 14 (h), food is displayed as an effect image. The effect image may include, for example, characters “thank you” in the balloon. In this case, in the image data 751, the character image and the effect image shown in FIG. 14H are associated with a transmission signal for transmitting food.

  Further, the image display device 1 outputs a voice “thank you”. In this case, in the audio data 752, a voice “thank you” is output as a transmission signal for transmitting food.

  Then, when a predetermined time (for example, 10 minutes) elapses, as shown in FIG. 14 (i), the image display device 1 may display an effect image including a character “delicious” in a balloon. . At the same time, the image display apparatus 1 outputs a sound “It was delicious”. In this case, in the image data 751, an effect image including “delicious” is associated on the condition that a predetermined time has elapsed after receiving a transmission signal for transmitting food. Also, in the audio data 752, the voice “delicious” is associated on condition that a predetermined time has elapsed after receiving a transmission signal for transmitting food.

  As shown in FIG. 15 (b), one of a plurality of types of clothing and accessories displayed on the user's communication terminal as shown in FIG. 15 (a) is selected, and the selected clothing or the like is transmitted. Operation may be possible. Then, in the image display device 1, as shown in FIG. 15C, the character image of the character wearing the transmitted clothing is displayed. The effect image may include, for example, characters “thank you” in the balloon. Further, the image display device 1 outputs a voice “thank you”.

  In this case, in the image data 751, the character image and the effect image shown in FIG. 15C are associated with the transmission signal. Further, in the audio data 752, the transmission signal is associated with the audio “thank you”.

  By outputting such a character image, an image for production, and a sound, it is possible to learn a sense that the user has presented the character. In addition, the user can put favorite clothes on the character. Therefore, the user can feel the character closer.

  In addition, when the user transmits toothbrush data, the image display device 1 may display an image of the character brushing the tooth so that the user can brush the tooth together with the character. In addition, when the user transmits data on jumping rope or dumbbells, the image display device 1 may display an image of a state of exercising so that the user can exercise with the character.

  Note that the storage device 75 may store preference data relating to character preferences and history data relating to items and gifts transmitted in the past. In this case, when an item or a gift as described above with reference to FIGS. 14 and 15 is transmitted, the character's reaction may differ depending on the preference and history. For example, when an item that a character likes is transmitted, the character's joy is expressed by an image and sound. On the other hand, when an item that the character does not particularly like is transmitted, the character's joy is expressed with a small image and sound. Moreover, when the same item is continuously transmitted, the way of pleasure may be reduced. Further, when the frequency of transmitting the food increases, it may be expressed by an image and sound such as “Fat”. In this way, since the character's reactions are not always the same, the user can be more familiar with the character.

  In addition, in the communication mode, the image display device 1 selects a topic of conversation as a user in addition to the environmental signal acquired by the acquisition processing unit 711 (with a predetermined probability, The probability for determining whether or not to conduct a conversation related to past communication (this probability may be changed as appropriate), and the image display device 1 in the content of the conversation in the past and the chat mode described later. Executes a random conversation based on the topic according to the content of the chat performed with the user's communication terminal.

  Specifically, when the human sensor 702 detects a person (user), the control unit 71 generates a random numerical value (for example, 0 to 100) according to a program for generating a random number at random timing. It is determined whether or not (numerical value) exceeds a predetermined threshold, and when this threshold is exceeded, the control unit 71 reads the conversation history data 755 and the chat history data 256 from the storage device 75. Then, a keyword is selected from the conversation contents included in the conversation content information 903 of the conversation history data 755 and the chat content information 1003 of the chat history data 256, and read out from the image data 751 and the audio data 752 corresponding to the keyword. The image data and audio data having a tag that matches the keyword are specified, the image data specified by the display processing unit 713 is output from the projector 4, and the audio data specified by the audio output unit 714 is output from the speaker 705. In the random conversation, the image display device 1 performs a conversation related to the topic of the conversation executed in the past, so that the user feels familiar with the character displayed on the image display device 1. In addition, since the user performs conversation based on the topic related to the contents of the chat performed by the user's own communication terminal, the user can further feel the familiarity of the character and feel close to the character. Further, by performing voice recognition processing on the conversation performed by the user, the image display device 1 obtains the text data of the conversation, adds the content of the conversation to the conversation history data 755, and uses it for the subsequent conversation and chat. can do. For example, in response to the chat content that the user said in the chat, “I'm watching a baseball game,” the character made a comment like “I'll do a baseball broadcast on TV today”, and the user went with the character. The user can feel the familiarity that the contents of the chat can be reminded and the character has remembered it. Moreover, the image display apparatus 1 can output the voice corresponding to the output condition or the voice of the conversation corresponding to the random conversation based on the result of the voice recognition.

  Hereinafter, general-purpose operations of the image display device 1 that realizes such a communication mode will be described.

  As illustrated in FIG. 16, the acquisition processing unit 711 acquires various environmental signals (S161). Various environmental signals acquired by the acquisition processing unit 711 are transmitted to the analyzing unit 712, and the analyzing unit 712 analyzes the transmitted environmental signals (S162). With reference to the analysis result, image data 751, audio data 752, signal data 753, and the like, the control unit 71 determines whether the character action to be executed by the character meets any of the prescribed conditions (S163). . As a result of the determination, if there is a character motion to be executed (S163: YES), the audio output unit 714 outputs the corresponding audio, and the display processing unit 713 projects the corresponding character image from the projector 4. (S164). As a result of the analysis, if the character to be executed has no action (S164: NO), the control unit 71 proceeds to the process of step S165.

  In step S165, the control part 71 produces | generates the random value of 0-100, for example (S165). In addition, a random value is not restricted to the range of 0-100. The control unit 71 compares the generated random value with a threshold value for comparison with the generated random value. When the random value is larger than the threshold value (S166: YES), the process proceeds to step S167, and when the random value is equal to or less than the threshold value (S166: NO), the process is terminated.

  In step S167, the control unit 71 reads out the conversation history data 755 and the chat history data 756. A keyword is extracted from the conversation content information 903 of the read conversation history data 755 and the chat content information 1003 of the chat history data 756. This can be realized by, for example, syntax analysis. Then, for example, a keyword with a high appearance frequency of the most recent (for example, one day) keyword is selected. The selection of the keyword may be random or may be selected based on other criteria.

  The control unit 71 specifies whether or not there is a conversation that matches the selected keyword and the environmental signal acquired in step S161 with reference to the random conversation data 757 (S168). Then, the voice output unit 714 outputs the voice of the specified conversation from the speaker 705. At this time, if there is a corresponding character image, the display processing unit 713 projects it (S169), and ends the process. For example, if the content of the conversation of the character is related to “baseball”, an image in which the character is wearing a baseball uniform is displayed, or an image with an item such as a ball or bat is displayed.

  The process of FIG. 16 is repeatedly executed in the communication mode. In this way, in a random conversation, the character has a conversation based on the content of the conversation with the user in the past and the content of the chat performed, so the user feels the accumulation of history with the character, and more You can feel the character close to you.

(B) Life mode The life mode is a state in which a character image is displayed and this character image does not depend on an environmental signal, and changes according to time, for example. For example, the image display device 1 displays an image of making breakfast, eating breakfast, or cleaning in the morning. If it is noon, an image of making lunch, eating lunch or ironing is displayed. If it is night, an image of making dinner, eating dinner, or stretching is displayed.

  In addition, the image may be an image of a character washing, cleaning, brushing teeth, or showering. In addition, an image of a character sitting on a chair and hanging his legs, an image of sitting on a chair and operating a communication terminal such as a smartphone, an image of sitting on a chair and writing a picture may be displayed. In addition, an image of a character reading a comic on the bed, an image of looking around on the bed, an image of sleeping on the bed, and the like may be displayed.

  In addition, it is possible to manage this frequency and probability, it is possible to display images that perform different operations depending on the day, and the operation time may not be completely the same, It is selected randomly within a certain range. Thereby, you may make it display for a long time about the action which a user is interested. For example, when the user often makes “breakfast” while making breakfast, the time for displaying an image for making breakfast can be lengthened.

  When the touch button 26 is touched at the timing of the life mode, the image display device 1 shifts to the communication mode. In the life mode, the mode shifts to a care mode or an appeal mode at a predetermined timing.

(C) Care mode In the care mode, a character image and an effect image are displayed at predetermined timings according to a user's schedule registered in advance, and sound corresponding to the twing is output. For example, the image display apparatus 1 outputs sounds such as “good morning”, “welcome”, “good morning”, and “good night”.

  For example, the user inputs a time in each time input box b11 to b14 via a registration screen W1 as shown in FIG. "," Going out time "," home time "and" sleeping time "are registered.

  If this schedule changes, it can be updated again using this registration screen W1, but if you want to change the schedule for only one day, as shown in FIG. The chat screen W2 may be used for the change. The chat screen W2 includes an input unit b21 for inputting a message to be transmitted, a transmission unit b22 for transmitting the input message, a message display unit b23 for displaying a message example, and a message display unit for displaying the transmitted message. b24.

  As shown in the chart of FIG. 18, the image display device 1 can execute the “wake-up mode”. Specifically, the “wake-up mode” is started a predetermined time before the registered wake-up time (for example, “1 hour before”) (S201).

  In this state, when the user's face is detected by the analysis unit 712 or the touch button 26 is touched, it is determined that the user has woken up. On the condition that the user has woken up, the display processing unit 713 displays a character image and an effect image for greeting “good morning”, and the voice output unit 714 outputs a greeting of “good morning” (S202). .

  In addition, words according to the user's behavior may be output. When the user wakes up earlier than the registered wake-up time, the voice of “I woke up crisply” can be output. When the user is late for the previous day, the voice “Do not be late today” can be output. When it is detected that the curtain is closed, the voice “Let's open the curtain” can be output. If the user's bedtime on the previous day is late and today's wake-up time is late, the voice “being up late yesterday” can be output.

  When it is determined that the user has woken up, the transmission processing unit 715 transmits an operation signal to operate a predetermined home appliance (S203). For example, when a coffee maker is set as a home appliance to be activated after getting up, the coffee maker is activated.

  If the user's wake-up is determined, an image and sound for morning information notification are output (S204). For example, an image or sound for notifying “date”, “weather”, “temperature”, etc. is output.

  When a voice uttered by the user is detected in response to an operation of home appliances or an image or voice output related to morning information notification, a voice of the character greeting is output (S205). For example, when “thank you” issued by the user is detected, a voice such as “you are welcome” is output as the voice of the character. Thereafter, when a predetermined time elapses, the mode shifts to the life mode (S213).

  Further, when the user's face is not detected by the analysis unit 712 or the touch button 26 is not touched by a predetermined time before the wake-up time (for example, 30 seconds before) in the unsummoned state, the summons are performed. A state is entered (S206).

  When changing from the unsummoned state to the summoned state, the transmission processing unit 715 transmits an operation signal to operate a pre-registered home appliance (S207).

  When the analysis unit 712 does not detect the user's face until the wake-up time, the display processing unit 713 displays an image that wakes up the user, and the audio output unit 714 outputs the sound that wakes up the user to start the alarm function (S208). ). For example, the voice that wakes up the user is the voice of the character “Morning”.

  When the user's face is detected by the analysis unit 712 or when the touch button 26 is touched, the process proceeds to step S202. On the other hand, when the user's face is not detected and the touch button 26 is not touched, as the snooze function, the image and voice output that wakes up the user are continued (S209). For example, the voice awakening the user can be gradually increased. Further, the amount of light output from the image display device 1 may be increased.

  When the user's face is detected by the analysis unit 712 or when the touch button 26 is touched, the process proceeds to step S202. On the other hand, when the user's face is not detected and the touch button 26 is not touched, the transmission processing unit 715 transmits an operation signal to operate a pre-registered home appliance (S210).

  Further, the image and sound that wakes up the user are used as the image and sound of the final means (S211). For example, the display processing unit 713 displays an image in which the character taps the frying pan. In addition, for example, the voice output unit 714 outputs a voice including a sound that a frying pan strikes while the character says “I can leave it when I do not wake up”.

  Thereafter, when the user's face is detected by the analysis unit 712 or when the touch button 26 is touched, the process proceeds to step S202. On the other hand, when the face is not detected by the analysis unit 712 and the touch button 26 is not detected, the image display device 1 sets the state of the user as unknown (S212) and shifts to the life mode (S213).

  As shown in the chart of FIG. 19, the image display device 1 can execute the “outing mode”. Specifically, the “outing mode” is started a predetermined time before the registered outing time (for example, “5 minutes before”), and the state shifts from the unsummoned state (S301) to the summoned state (S302).

  When the departure time is reached, an alert image and sound are output (S303). For example, the alert is a character image that urges the user and a voice of the character “It's a departure”.

  Further, the transmission processing unit 715 transmits an operation signal to operate a predetermined home appliance (S303).

  Further, the display processing unit 713 displays an image for going out check, and the sound output unit 714 outputs the sound for going out check (S304). For example, an image or sound for notifying confirmation of a plan, confirmation of forgotten things, confirmation of prompting to hold an umbrella when the probability of precipitation is high, and the like are output.

  At the departure time, the display processing unit 713 outputs an image for urgent departure, and the audio output unit 714 outputs an audio for urgent departure (S305). For example, a moving image of a character moving swiftly, and a voice of the character “Departure time!

  When the analysis unit 712 detects the voice of “I will go” by the user, the display processing unit 713 displays an image corresponding to the voice, and the voice output unit 714 outputs the voice corresponding to the image (S306). . For example, the display processing unit 713 displays a character image waving at the user. The voice output unit 714 outputs a voice such as “Come to me”. The output voice may be changed according to the registered user schedule, user action history, and the like.

  Thereafter, the transmission processing unit 715 transmits an operation signal to operate a predetermined home appliance (S307).

  After notifying the departure time in step S305, or after operating the home appliance in step S307, the mode is shifted to the life mode (S308, S309). Furthermore, when a human being is not detected by the human sensor 702 after a predetermined time (for example, 10 minutes) has elapsed, the process shifts to a sleep state (S310).

  As shown in FIG. 20, the image display apparatus 1 can perform “going out / going home determination” according to the environmental signal, and can execute the “return home mode” accordingly. Specifically, when the image display device 1 is in the sleep state after the outing is determined in the “outing mode” described above with reference to FIG. 15, when a message to return home is received from the user's communication terminal (S 41). As a preparation for returning home, the process proceeds to the summon state (S42).

  Thereafter, the transmission processing unit 715 transmits an operation signal to operate a predetermined home appliance (S43).

  Further, the image display apparatus 1 predicts that the user has returned home at the timing when the person is detected by the human sensor 702, when the lighting of the house is turned on, and when the door is opened. Determine (S44). Here, whether the door is opened or closed can be determined by detecting a change in atmospheric pressure using an atmospheric pressure sensor (not shown) or detecting sound using a noise sensor 613. When the return home prediction is determined, the voice output unit 714 may output a voice such as “It seems to have returned home”.

  When the return home prediction is determined, the transmission processing unit 715 transmits an operation signal to operate a predetermined home appliance (S45).

  Further, the image display device 1 is determined to be “home” when the analysis unit 712 detects the user's face or when the touch button 26 is touched. On the condition that the user has returned home, the display processing unit 713 displays a character image and an effect image for greeting home, and the voice output unit 714 outputs a voice for greeting home (S46). For example, the greetings for returning home are not limited to “Okaeri”, but “Today is too late—”, “Today is early”, “Today is late”, “Otsukase-sama”, etc. Etc. can be included.

  When the voice uttered by the user is detected, the voice of the character reply is output (S47). For example, the character may output a voice such as “I ate yesterday yesterday and exercised today” as what I did on that day. You may also let you know what happened at home. For example, when the chime at the entrance sounds multiple times, a sound such as “someone came today” may be output.

  On the other hand, when the return home cannot be determined for a predetermined time (for example, 30 seconds) after the return home prediction is determined, the return home confirmation is performed (S48). For example, in the confirmation of returning home, the voice output unit 714 outputs a voice such as “Returned home? In addition, the display processing unit 713 displays a character image such as a kneaded or angry character image and an effect image.

  After responding to the greeting of the user in step S47, or after confirming the return home in step S48, the mode shifts to the life mode (S49).

(D) Appeal mode In the appeal mode, a character image or effect image corresponding to each condition is displayed according to a time or a signal detected by a sensor or the like, and sound corresponding to each condition is output. For example, the image display device 1 can output a sound such as “It's already 8 o'clock” according to the time. Further, the image display device 1 can output a sound such as “something hot” according to the temperature. Thereby, since the user can talk from the character at an unexpected timing, the user can feel the character closer.

(E) Chat mode The chat mode realizes message transmission / reception with a communication terminal held by the user when the user is away from the image display device 1 such as when the user is out. The communication terminal held by the user is, for example, a mobile communication terminal such as a smartphone or a mobile phone.

  The basic algorithm in the chat mode can be performed in the same manner as the conversation with the user. However, instead of the voice input from the user, the image display apparatus 1 performs a chat using a character string on the chat as an input.

  FIG. 21 is a flowchart showing the operation of the image display apparatus 1 in the chat mode, and is a flowchart during operation in the chat mode. When executing the chat mode, the user executes a chat application for chatting with the image display device 1 using his / her communication terminal. Then, a chat application activation signal is transmitted from the user communication terminal to the image display device 1 via the network. Then, the control part 71 of the image display apparatus 1 starts chat mode, and starts the chat between a user's communication terminal via a chat server. Note that the image display device 1 detects that the user is not around by using a human sensor, activates the chat mode from the image display device 1 side under a predetermined condition, and sends it to the user's communication terminal. It is good also as starting chat by transmitting the activation signal of a chat application. The chat server may be a dedicated server for the image display device 1 or a general-purpose chat server.

  As shown in FIG. 21, first, the acquisition processing unit 711 acquires various environmental signals (S501). This environmental signal may include the latest speech entered by the user on the chat. Various environment signals acquired by the acquisition processing unit 711 are transmitted to the analysis unit 712, and the analysis unit 712 analyzes the transmitted environment signals (S502). The analysis unit 712 performs syntax analysis on the character string of the message content on the user's chat to recognize the message content. The analysis unit 712 determines the situation from other environmental signals such as weather information. The control unit 71 refers to the analysis result, the voice data 752, the signal data 753, and the like, and determines whether the chat message to be executed by the character meets any of the defined conditions (S503). Note that the voice data 752 is information defining the voice, but can be used in chat because it is common to chat in the concept of conversation. As a result of the determination, if there is content to be spoken (S503: YES), the transmission processing unit 715 sends a message of the identified speech content to the user's communication terminal via the chat application (S504). As a result of the analysis, if there is no character statement to be executed (S504: NO), the control unit 71 proceeds to the process of step S505.

  In step S505, the control unit 71 generates a random value from 0 to 100, for example (S505). In addition, a random value is not restricted to the range of 0-100. The control unit 71 compares the generated random value with a threshold value for comparison with the generated random value. When the random value is larger than the threshold value (S506: YES), the process proceeds to step S507, and when the random value is equal to or less than the threshold value (S506: NO), the process ends.

  In step S507, the control unit 71 reads out the conversation history data 755 and the chat history data 756. A keyword is extracted from the conversation content information 903 of the read conversation history data 755 and the chat content information 1003 of the chat history data 756 (S507). This can be realized by, for example, syntax analysis. Then, for example, a keyword with a high appearance frequency of the most recent (for example, one day) keyword is selected. The selection of the keyword may be random or may be selected based on other criteria.

  The control unit 71 specifies whether or not there is a conversation that matches the selected keyword and the environmental signal acquired in step S501 with reference to the random conversation data 757 (S508). And the transmission process part 715 transmits the message which shows the content of the specified statement to a user's communication terminal via a chat application (S509). At this time, if there is a corresponding character image, the transmission processing unit 715 transmits image data for displaying the image on the chat via the chat application, and ends the process. For example, if the content of the conversation of the character is related to “baseball”, an image of the character wearing a baseball uniform or an image with an item such as a ball or bat is transmitted.

  The process of FIG. 21 is repeatedly executed in the chat mode. In this way, in a random conversation in chat, the character speaks based on the content of the conversation with the user in the past and the content of the executed chat, so the user feels the accumulation of history with the character. , You can feel closer to the character. The image display device 1 can realize a configuration in which the content of the conversation and the content of the chat are interlocked with each other by the processing of FIG. 16 and the processing of FIG. Note that the image display device 1 is shown in the present embodiment as long as the content of the chat is reflected in the content of the subsequent conversation and the content of the conversation is also reflected in the content of the subsequent chat. It goes without saying that the same configuration may be realized by operating according to an algorithm other than the algorithm.

  With the above-described configuration, for example, a chat as shown in FIG. Fig.22 (a) has shown the example of the display of the chat screen in a user's communication terminal. The chat content of the user and the character is displayed on the chat screen W3. The user uses a touch panel (not shown) of the communication terminal to input a message to the input unit b21, and touches the transmission unit b22 to transmit the message.

  Also, in this chat, as shown in the chat screen W4 in FIG. 22 (b), unlike a normal chat, a question is asked by a character, and an option b220 as an answer to the question can be displayed. . This can be realized by installing a dedicated chat application with the image display device 1 in the user's communication terminal. In this case, the chat server has a function of relaying a command from the image display device 1 for realizing this control to the user's communication terminal. This command includes an answer command selected by the user. With such a configuration, it is possible to give the user a sense of playing a game with a character. Therefore, the user can enjoy chatting with the character as if it were a game.

  In the present embodiment, the conversation and chat using the conversation history data 755 and the chat history data 756 are randomly executed. However, this is not the only case, and predetermined conditions are satisfied. Needless to say, it may be executed in some cases.

<Operations related to audio>
For example, when the user calls a character name toward the microphone 704, the image display device 1 can display an image of the character corresponding to the name. In addition, when the user talks to the displayed character about a specific topic, the image display device 1 can output a sound in response to the user.

  For this reason, the user can call a favorite character when he / she likes it, and can display this character etc. in the transparent case 2 which can be seen more three-dimensionally. Further, when the user talks to a character or the like, it can be operated as if the character or the like behaves according to the user's talk. For this reason, it is possible to give the user a feeling as if they are living with a character or the like in the same space.

  In addition, lighting on / off can be controlled according to voice input. For example, when a sound such as “Turn off electricity” or “Good night” is input from the microphone 704, the control unit 71 associates remote control information relating to turning off the illumination previously associated with this character string and stored in the storage device 75. The data is taken out from the storage device 75 and the corresponding infrared information is transmitted from the infrared LED 703. Thereby, indoor lighting can be turned off. Similarly, the illumination can be turned on in response to “return” or “good morning”.

  Furthermore, a control operation combining such voice input and human detection by the human sensor 702 is also possible. For example, when a voice “I'm coming” is input from the microphone 704 in response to the user's conversation, the control unit 71 shifts to a monitoring mode corresponding to a character string obtained from the voice. Note that it is possible to shift to the monitoring mode in response to “I welcome you” by a character or the like.

  The monitoring mode is a mode in a state where the user is not present in the room. For this reason, the monitoring mode can be canceled when a voice of “I'm right” by talking to the user is input and a character string obtained from this voice is detected. It is also possible to cancel the monitoring mode in response to “Please come back” by a character or the like.

  For example, when a person is detected by the human sensor 702 during the monitoring mode, the control unit 71 can determine that this is abnormal and notify the user of this abnormality. Specifically, a predetermined warning sound or warning message can be output from the speaker 705, or a predetermined message can be transmitted to a destination registered in advance via the communication unit 76. Further, at this time, the control unit 71 can cause the camera 722 to take an image of the room and store the image in the storage device 75, or can transmit the image to a destination registered in advance via the communication unit 76.

  It should be noted that, after a person is detected by the human sensor 702 during the monitoring mode, it may be determined that there is an abnormality immediately and notification may be given, and if the monitoring mode is not canceled within a certain time, it is determined that there is an abnormality. Can also be notified.

<Control operation related to infrared LED>
As a control operation using the infrared LED 703, the following operation can be performed. Specifically, when the wake-up time preset by the timer program is reached, the control unit 71 controls the operation of the corresponding device based on the behavior information associated with the time information.

  For example, when registering a timer program such as “lights on” when waking up (7:00) and “lights off” at bedtime (23:00), the control unit 71 sets “lights on” at 7:00. Remote control information is extracted from the storage device 75 and the corresponding infrared information is transmitted from the infrared LED 703. At 23:00, the remote control information “illumination is off” is extracted from the storage device 75 and the corresponding infrared information is transmitted from the infrared LED 703. Let In this way, a predetermined device can be automatically operated at a predetermined date and time.

  In addition, on / off control of an air conditioner or the like can be performed according to the temperature / humidity detected by the temperature / humidity sensor 611, and television on / off control can be performed according to a time zone.

<Control operations related to sensors>
Using the optical sensor 721, for example, it is possible to detect that the curtain is not open despite the daytime, and to prompt the user to open the curtain.

  Specifically, the sunrise time is stored in the storage device 75 as calendar information, and when the illuminance input from the optical sensor 721 is less than the predetermined illuminance even after the time, the control unit 71 Audio data (“open curtain”) stored in the storage device 75 in advance is output from the speaker 705.

《Control action for noise sensor》
The noise sensor 613 can be used to alert the user that, for example, the television remains on for a long time. Specifically, when the control unit 71 determines that the television is turned on based on the volume, frequency, etc. of the sound input by the noise sensor 613, the control unit 71 starts measuring time from the determination, and the time of the state is When the predetermined time is exceeded, audio data (“Let's turn off TV”) stored in advance in the storage device 75 is taken out and output from the speaker 705. Thereby, while contributing to energy saving, it is possible to give the user a feeling as if the bride is paying attention.

<Control operation related to vibration sensor>
Using the vibration sensor 612, an earthquake can be detected and a notification operation can be performed.

  For example, in the state where the presence of a person is not detected by the human sensor 702, when the vibration sensor 612 detects a predetermined magnitude of vibration, the controller 71 determines that an earthquake has occurred and the controller 71 A predetermined warning sound or a warning message can be output from the speaker 705 or a predetermined message can be transmitted to a destination registered in advance via the communication unit 76.

  On the other hand, when the vibration sensor 612 detects a predetermined magnitude of vibration in a state where the presence sensor 702 detects that there is a person, it is determined that it is due to an artificial action by the user or the like, and notification is made. Do not do. In this case, for example, a voice message (“No shaking!”) Can be output from the speaker 705. If it does in this way, operation corresponding to each can be performed, distinguishing an earthquake and a life vibration accurately.

<Control operations related to temperature and humidity sensor>
Predetermined audio output control corresponding to the temperature / humidity sensor 611 can be performed. For example, when the temperature detected by the temperature / humidity sensor 611 is lower than 10 ° C., the control unit 71 can output a sound such as “It is cold today” from the speaker 705 at a predetermined timing.

  When the humidity detected by the temperature / humidity sensor 611 is less than 40%, a sound such as “Dry! Don't catch a cold” can be output from the speaker 705 at a predetermined timing.

<Operations related to images>
Image display and audio output control corresponding to an image captured by the camera 722 can be performed. For example, it is possible to change the character image by executing face tracking and facial expression detection using an image acquired by the camera 722.

  Specifically, when the user moves, a character image in which the character looks at the user may be displayed. Further, a character image may be displayed such that the character sometimes turns away from his eyes and looks at the user. Further, when the user laughs, a character image that laughs back may be displayed. In addition, if the user sees a direction different from the character and then sees, a character image that smiles at the timing when the user sees the eye may be displayed. Further, when the user is drinking with a cup registered in the image display device 1, a voice image of “I drink too” may be output and a character image for drinking with the same cup may be displayed. Furthermore, when the user is wearing clothes registered in the image display device 1, a sound “cool” may be output.

  Various other input / output controls are possible.

  For example, on the basis of temperature / humidity and weather information input information, it is possible to output a voice such as “It ’s better to carry an umbrella” or a voice input from a user such as “What should I wear?” It is possible to display recommended clothes corresponding to weather information, calendar information, and the like.

《Action according to likability》
The character displayed by the image display device 1 may have different actions depending on the user's preference for the user. For example, as character setting information, character information such as a preference of a favorite word or color, a favorite operation, a happy thing to be done, and the like, and a preference of the character to the user are set in advance. And if the user takes a conversation, chat, or action that matches the character's preference, the character's preference value is raised, and if the user takes a conversation, chat, or action that does not match, the character's preference value is lowered. It is good as well.

  And in the memory | storage device 75, you may memorize | store the information which prescribes | regulates the action of the character according to the favorable value further. For example, when the user is close to the character and the character is saying “It ’s too close”, if the favorability is low, the voice of angry voice is output and the favorability is high May output a voice of shy voice. Therefore, the storage device 75 may store a plurality of speech with the same content corresponding to the preference. By doing in this way, the character of the image display apparatus 1 can be made impersonal, and a user can feel familiarity.

  Further, the image display device 1 may realize the following processing.

《Wake-up judgment system》
The control unit 71 can make an alarm call using, for example, calendar information including the user's wake-up time registered in the storage device 75 at the calendar site and the time acquired by the data management unit 716. After that, for example, when the user gets up from the bed and the face detected by the analysis unit 712 becomes a certain size or larger, the control unit 71 determines that the user gets up, and the user executes processing after getting up. For example, the user may transmit schedule information of his / her communication terminal to the image display device 1, and the image display device 1 may operate according to the contents indicated in the received schedule information. For example, when the schedule information includes “wake up at 6 o'clock on the 23rd”, the control unit 71 may cause the character to wake up the user at 6 o'clock on the 23rd.

<< Outing judgment system >>
For example, when the location information of the user's communication terminal acquired by the acquisition processing unit 711 is outside the house in addition to the user's voice that the analysis unit 712 detects, the control unit 71 may Can be determined. For example, in addition to the fact that the presence sensor 702 is not detected by the human sensor 702 and the location information of the user's communication terminal acquired by the acquisition processing unit 711 is outside the house, it is determined that the user has gone out. it can.

《Homecoming judgment system》
For example, when the presence sensor is detected by the human sensor 702 after determining that the user has gone out in the above-described going-out determination, the control unit 71 can determine that the user has returned home. In the detection, in addition to detecting a person with the human sensor 702, the face of the user may be determined from an image captured by the camera 722.

《Sleep determination system》
When the user is at home, the control unit 71 detects that the motion of the user is not detected by the human sensor 702 for one hour, and the illuminance detected by the optical sensor 721 is bright enough that the illumination is not turned off. If it is analyzed by the analysis unit 712, it can be determined that the user has fallen asleep. Here, “falling asleep” means that the user goes to sleep without turning off the light during any work such as watching TV or playing a game. The image display device 1 may control the proof to turn off the room lighting when it is determined that the user has fallen down and the room lighting is not turned off.

《Wake-up time confirmation system》
For example, the controller 71 can suggest that the next morning wake-up time should be set earlier in order to secure the usual morning preparation time if it is the next morning outing time or earlier than the usual morning. Specifically, if the time difference between the next day's wake-up time and the next day's scheduled time to go out is shorter than the time required for going out, which is determined by the time difference between the average wake-up time and the time of going-out, it is suggested that the wake-up time be the next morning. To do. For example, the control unit 71 selects and outputs the voice of “Tomorrow is the departure time? Want to be early? Wake up the wake-up time?” From the voice data 752. Further, the control unit 71 changes the alarm time registered in the storage device 75 when the user answers “YES”.

  Further, for example, if the control unit 71 is late this morning, the control unit 71 can propose to wake up the next morning. Specifically, when the going-out time this morning is delayed by a predetermined time (for example, 10 minutes) from the scheduled going-out time, the control unit 71 can suggest that the wake-up time be advanced by the predetermined time. For example, the control unit 71 selects and outputs, from the voice data 752, a voice “You are late today? Would you like to get up 10 minutes early tomorrow?”. Further, the control unit 71 changes the alarm time registered in the storage device 75 when the user answers “YES”.

《Squat judgment function》
For example, the control unit 71 may include a system in which the analysis unit 712 detects the vertical motion of face recognition and counts the number of squats. The control unit 71 can be applied not only to push-ups but also to a system that counts the number of abdominal muscles and the number of push-ups. Thereby, the display process part 713 can display the character image and effect image which support a user's operation | movement. In addition, the voice output unit 714 can output a voice counted by the character and a voice to support.

《Camera self-taking system》
For example, the control unit 71 may allow the user to take a self-portrait with a character. At this time, when the user moves to a range where the camera 722 can capture an image of the user with the camera 722, the control unit 71 combines the character image with the captured image. Further, the control unit 71 may upload the captured image obtained by combining the character images to a providing server such as an SNS (social networking service) via the Internet or the like.

《Coffee break time system》
The control unit 71 may allow the character to propose a coffee break to the user. For example, when the time managed by the data management unit 716 is a predetermined time, the transmission processing unit 715 transmits an operation signal to the coffee maker. The display processing unit 713 selects and displays an image that prompts the user to make a coffee break, and the audio output unit 714 selects and outputs a sound that prompts the user to make a coffee break. Furthermore, when the analysis unit 712 detects that the user has finished drinking coffee from the images and sounds, the control unit 71 ends the coffee break. For example, the control unit 71 can be terminated when the analysis unit 712 detects the user's “delicious” or “feast” voice.

《Call response system》
The control unit 71 may call the user, the character, and the name. The voice output unit 713 outputs the voice of the character that calls the name or nickname registered in the user data 754. When the analysis unit 712 detects the voice of the character name or nickname uttered by the user, the voice output unit 713 can output the voice of the character that calls the user name or nickname.

《Changing recommendation system》
The control unit 71 may recommend user coordination. For example, the analysis unit 712 determines the shape and color of what the user wears, such as “a square hat above the face” and “a long rectangular tie below the face” from the image captured by the camera 722. In addition, the control unit 71 comprehensively determines the user's facial expression and mood analyzed from the environment information acquired by the acquisition processing unit 711, the user's schedule registered in the storage device 75, weather information, season, and the like. You may recommend a recommended color.

《Operation request》
The control unit 71 can receive an operation of a device and a request for schedule management from a user via an information processing apparatus such as a communication terminal. For example, when an operation of the device is requested, the transmission processing unit 715 outputs an operation signal according to the requested signal. Further, when registration or change of a schedule is requested, the data management unit 716 registers or updates data according to this signal. Specifically, as described above with reference to FIG. 13B, the control unit 71 can be operated using a chat function or using a memo or a message board. Since the user can feel asking the character what he wants to be a character, he can feel as if he is asking a human being.

《Sleeping Mode》
The control unit 71 may display a character image that sleeps angry when a predetermined condition is satisfied. For example, when the image display device 1 is not connected to an external network, or when the image display device 1 is not connected to the user's communication terminal, an image that sleeps angry is selected. ,indicate. Thereby, the character image which the image display apparatus 1 appeals to a user is displayed, and it can be expressed more like a human being and more realistically.

《Interest Transition Algorithm》
When a plurality of types of interests and hobbies are registered in the user data 754, the control unit 71 can randomly select one of the plurality of interests and hobbies and reflect them in the output image or sound. For example, at this time, in the user data 754, weight values are respectively set for the user preference information, and the control unit 71 can select an image or sound to be output in consideration of the weight values. Moreover, the weight value of these hobby preferences can be increased or attenuated with the passage of time. Furthermore, when the weight value is equal to or less than a predetermined value, another preference value may be selected by increasing the weight value of another preference.

《Life mode algorithm》
In the life mode, the control unit 71 can select an image to be displayed and an audio to be output based on “user preference information” and “character preference information”. For example, if the user likes comics, the control unit 71 can display a character image for reading the comics in the life mode, and can output a sound corresponding to the character image. Further, if the user likes cooking, the control unit 71 can display a character image for cooking when he / she is free, and can output a sound corresponding to the character image.

《Interest Talk》
The control unit 71 can output a topical image and sound related to the interaction after a predetermined time when the interaction with the user occurs. The control unit 71 stores the time at which the interaction with the user has occurred, and determines whether or not a predetermined time has passed from that time, thereby realizing the control.
<< User behavior analysis estimation system >>
The data for determining the user's action by the control unit 71 can be derived by referring to a plurality of patterns of data given in advance as teacher data. Specifically, using various sensors provided in the image display device 1, sensing data when the user performs a predetermined action is acquired and stored in association with information indicating the predetermined action at that time. This is used as teacher data. And the image display apparatus 1 can analyze and estimate a user's action by comparing the data input from the various sensors with the teacher data. Thereby, the control part 71 can make a character perform the operation | movement according to a user's action. Moreover, the control part 71 is good also as updating this teacher data sequentially according to a user's action.

<< Emotion tracking system >>
Further, the image display device 1 may estimate the user's emotion and cause the character to perform an action corresponding to the user emotion. Specifically, the process is executed as follows.

  The control unit 71 may estimate the user's emotion by performing facial expression recognition processing from the user's face image captured by the camera 722. This is done by storing information on the feature amount of the face image corresponding to various emotions in advance in the storage device 75, specifying the face image estimated to be closest by pattern matching with the captured image, and It is to identify the emotion to be. Further, the user's emotion may be estimated from the voiceprint input from the microphone 704. Similarly to the case of a face image, information of voice information (for example, frequency, volume, etc.) corresponding to various emotions is stored in the storage device 75 in advance, and according to the feature amount with the input voiceprint. Estimate user emotions. Or the control part 71 is good also as estimating a user's emotion from the content of the conversation and chat with a user. For example, the user's emotions are estimated from words representing emotions such as “I enjoyed” or “Mukatsu” during the conversation.

  Then, the control unit 71 of the image display device 1 can cause the user to take actions such as tuning and encouragement according to the character personality stored and set in the image display device 1. For example, if it is estimated that the user feels lonely as a result of judging the user's feelings, “Yes, I was lonely. But I am there?” Or “There is no need to feel lonely! The speech output unit 714 may output a speech such as “It's all right!”. For example, when it is estimated that the user is depressed, “Fight!” May be encouraged. Needless to say, the actions of these characters are only examples.

《Thank you learning system》
The control unit 71 of the image display device 1 stores the contents of which words of gratitude such as thankfulness transmitted from the user in conversation or on the chat are transmitted. Then, the condition at that time is stored. That is, the control unit 71 (character) stores when the user is said to be thankful for “when” and “what to do”. That is, “timing” and “character action” when the user is thanked are stored in the storage device 75 in association with each other. And the control part 71 is good also as making a character reproduce an appreciation action at the timing of "when."

《Face learning system》
When the control unit 71 of the image display device 1 determines that the image captured by the camera 722 includes a face image of a person different from the user, the control unit 71 attaches the face image to the chat and asks “Who is this person?” It is also possible to ask. On the other hand, when the user replies “I'm mom”, the image display device 1 stores the face image obtained by imaging the person and the word “mom” in association with each other. Further, the control unit 71 of the image display device 1 may change a message such as “I'm mom. I remembered” to the user's answer “I'm mom”. If the stored face image of the person is captured at another timing, the image display device 1 may transmit a message “Mother has come” to the user's communication terminal. Further, when the behavior of the person can be estimated at that time, the content may be transmitted. In addition, this configuration can be used for crime prevention when the face image captured by the image display device 1 is a face of a person unknown to the user.

<< worry system >>
When the image display apparatus 1 detects that the user has gone out (after a predetermined time has passed without the human sensor 702 detecting a person), the image display apparatus 1 has become slower than a certain time (for example, the current time is night 22:00), the user may be contacted by means of twitter (registered trademark), mail, chat, telephone or the like. For example, the control unit 71 may transmit a message such as “I am late but are you okay?” Or may make a call. When making a call, it is necessary to set the image display device 1 to connect to a telephone line. Further, a threshold value for determining whether or not to take the action may be determined, and whether or not an action for worrying about the user is taken may be determined based on whether or not the random value exceeds the threshold value. Further, the image display device 1 may control the threshold value to be higher as the time is later. Further, the threshold value may be changed according to the state of the user in the morning of the day. For example, when it is estimated that the user's physical condition is bad, the threshold value may be controlled to be lower than usual.
<Infrared information monitoring system>
The image display device 1 may further include an infrared sensor to acquire surrounding infrared information and cause the character to take an action according to the acquired infrared information. For example, it is possible to acquire the infrared information output from the remote controller and detect that the user has operated the TV remote controller, and store the time, day of the week, and channel when the TV is turned on. Then, it may be controlled that the image display device 1 operates the television and attaches the same channel when the same time of the same day of the week is reached on another day.

  When the body temperature of the user or the temperature of the room is monitored from the infrared sensor and it is detected that the temperature has risen, the control unit 71 of the image display device 1 tells the character “When the window is opened”. It may be a conversation that makes suggestions such as “How about?”, “Do you turn on the fan?”, Or “Do you turn on air conditioning?”.

《Viewing program monitoring system》
The image display device 1 may be configured to acquire and store information related to a television or radio program that the user is viewing. Specifically, TV program information is acquired from the network, and the audio popularity process is performed on the sound emitted from the TV to estimate the program that the user is viewing. Alternatively, the image display apparatus 1 is connected to various home appliances, acquires TV ON / OFF information and channel information, identifies and stores a program viewed by the user. Then, a keyword may be acquired from a program guide relating to the stored program and used as a story for conversation.

  For example, in a cloud server, speech recognition is performed on what kind of conversation is being performed on a program of each broadcast station, the contents of the program of each broadcast station are converted into text, and cloud text information is acquired. On the other hand, in the image display device 1, the audio information of the program that the user is viewing is acquired from the microphone 704. Then, the acquired voice is subjected to voice recognition and converted to user text information. Then, by comparing and collating the cloud text information with the user text information, the image display device 1 can specify which program the user is viewing. Then, the control unit 71 identifies the program that the user is viewing, incorporates the program name, recommends, for example, “Morning is A TV in the morning!”, And controls the TV remote control. Good.

《Air reading system》
The control unit 71 of the image display device 1 may determine whether or not the user is busy and take an action corresponding to the determined state, that is, an action of reading so-called air. The busyness of the user is determined according to various environmental signals acquired by the control unit 71 (acquisition processing unit 711) of the image display device 1. For example, when the user's wake-up time is late and it is detected that the position of the user detected by the human sensor 702 moves left and right a predetermined number of times (for example, 10 times or more) within a predetermined time (for example, within 5 minutes). Then, it is determined that the user is busy, and the control unit 71 of the image display device 1 performs control so as not to speak to the user to the character. In addition, when the user does not move much, that is, when the user position detected by the human sensor 702 remains within a predetermined range, the control unit 71 controls the character to speak to the user. As described above, the control unit 71 of the image display apparatus 1 can determine whether or not to cause the character to see the user's state, that is, to read the air and cause an action.

<< Face & Eye Tracking System >>
The control unit 71 of the image display device 1 may detect the user's line of sight based on the user's face image and eye image acquired by the camera 722. For example, it is detected that the face image of the user faces the direction of the image display device 1, and it is detected whether or not the pupils of the eyes are both facing the direction of the image display device 1. Then, when the user's line of sight is facing the character, the control unit 71 can make the character feel shy or stare at the user.

《Virtual style system》
The control unit 71 of the image display device 1 may detect that the user is blowing on the microphone 704 and generate an effect that blows the world in the image display device 1. For example, the character's clothes may flutter. This configuration can also be realized by providing a wind pressure sensor in the image display device 1 instead of the microphone 704.

《Physical condition management system》
The image display device 1 may acquire user status information from a device that can detect the user status, such as a weight scale or an exercise meter held by the user, via the communication unit 76. For example, when the weight of the user detected from the weight scale has decreased more than a predetermined amount within a predetermined period, the control unit 71 causes the character to speak “Do you eat properly?” If the average weight is greater than the predetermined weight, it may be recommended that “I have to exercise a little!”. When the user repeatedly exercises, the control unit 71 may cause the character to output a sound so as to count the number of repeated exercises while referring to an image captured by the camera 722. For example, it is possible to count the number of push-ups and squats.

《Real-time motion distribution system》
The control unit 71 of the image display device 1 may perform a special operation by receiving a special signal via the communication unit 76. Specifically, a motion capture sensor is attached to the body of a person on the development and management side, and the movement of the person is distributed to the image display device 1 of all users. The image display apparatus 1 can also realize program distribution by displaying a character that moves in the same manner as the distributed motion. For example, when earthquake early warning or the like is received as a special signal, the voice output unit 714 may output a voice such as “Oh, it is an earthquake of seismic intensity 4. Please act calmly”. Further, when image data to be displayed is included in a special signal, the image data may be displayed. The image data may be, for example, a real person, for example, a celebrity interview may be displayed and the sound may be output. Thereby, for example, program distribution by hologram can be realized. Further, the image display device 1 can display image data of a real person by acquiring image data of the real person and acquiring voice data of the person.

《Hologram Avatar Phone System》
When a telephone is connected to the image display device 1 or when the image display device 1 has a telephone function, the image display device 1 may have the following functions. At this time, the image display device 1 identifies the user's facial expression based on the image acquired from the camera 722, generates avatar information having the same facial expression as the identified facial expression, transmits the avatar information to the telephone partner, You may provide the structure which displays the avatar image on the display screen of a telephone other party.

《Reporting system》
The control unit 71 of the image display device 1 may detect the user's return home and cause the character to report the character's day. For example, the analysis unit 712 determines that the user has returned home when the human sensor 702 has not detected the user for a predetermined time or longer and has newly detected the user. Then, the control part 71 is good also as making a user report the event (content estimated that the event occurred based on the information which can be acquired from various sensors) which happened to the character vicinity. For example, if the temperature / humidity sensor 611 has detected a temperature above a predetermined level for a predetermined time or longer, the character may report “It was hot today” or the room temperature sensor 611 may have a temperature and humidity above a predetermined level. If it was detected for more than a certain period of time, it was reported that “It was hot and humid today”, or if an earthquake bulletin was received, “There was an earthquake today. Was that okay?” You may want to report it, or “Who came when you were n’t there.”

《Unwell physical contact phone system》
When the telephone function is installed in the image display device 1 and the user's physical condition is bad, the control unit 71 of the image display device 1 sets in advance the user's work place or school destination according to the instruction from the user. It is also possible to have the phone number contacted by phone instead of the user, saying, “I will take a rest due to poor physical condition today”.

<< Gesture control system by specific device >>
The control unit 71 of the image display device 1 may control the character in accordance with a signal from a specific item worn or held by the user. For example, when a specific item is a ring and it is detected by image analysis that the user is rubbing the ring, the character may be caused to perform a shy operation. Alternatively, as a specific item, when the user is swinging left and right with a penlight, the control unit 71 displays an image in which the character has the penlight and swings his / her hand to the left and right. It is good also as projecting the image which moves like this.

《Character change system》
The control unit 71 of the image display device 1 may appropriately change clothes and items to be worn by the character. For this purpose, the control unit 71 stores display data of various clothes and items in the storage device 75 or downloads and acquires it from an external server. Then, the control unit 71 is a character dressed according to the season, weather, temperature, and time zone including the date and time from the time measuring unit (not shown; clock for detecting the current date and time) mounted on the image display device 1. May be displayed.

《Moment transfer system》
When the user holds a plurality of image display apparatuses 1 according to the above-described embodiment, the characters may be displayed only at positions that can be confirmed by the user by interlocking the image display apparatuses 1. In that case, the control unit 701 may produce an effect as if the character has moved to the image display apparatus 1 at the destination to which the user has moved.

《Cleaning system》
The control part 71 of the image display apparatus 1 is good also as communicating with a robot cleaner as a household appliance, controlling the robot cleaner, and cleaning a user's room | chamber interior. In addition, at that time, the control unit 71 specifies a place where the user normally cleans and a place not cleaned,

《Tooth brushing support system》
The control unit 71 of the image display device 1 may detect that the user is brushing teeth by image analysis, and may cause the character to take action to support the user's tooth brushing, or the user may take medicine. It is also possible to detect that a drug is applied to the affected area and cause the character to support the action.

《Sports player motion capture system》
The image display device 1 may acquire a video such as a sports broadcast and project the image so that the character performs the same motion as the motion of a sports player appearing in the sports broadcast. At that time, the user instructs the direction of the character using the user's communication terminal, the operation panel provided in the image display device 1, voice, or the like, and displays the video according to the instruction in the image display device. 1 may be displayed. At this time, it is also possible to display an image of the sports player itself instead of the character.

《Live support system》
When the user is watching a live such as an idol or the like, the image display device 1 displays the live video on the character as if the user is watching the live video. You may make a shout or shake the chemical light as if you were participating. Alternatively, the control unit 71 may link the movements according to the clapping and cheering of the user when the character sings and dances like a idol as a virtual singer. For example, the timing of the user's clapping may be detected, and an image may be output so that the steps are performed in accordance with the timing, or the behavior may be changed according to the amount of support from the user.

《Multi-agent system》
The image display device 1 may store information related to a plurality of characters in the storage device 75. And the control part 71 is good also as selecting and projecting the character to be used according to a user's condition. Further, when the image display device 1 is equipped with a multi-core and one character is controlled by one core, the image display device 1 may project a plurality of characters at the same time.

《Age course system》
When displaying the character, the image display device 1 may display the image so that the character gets older in a certain time. For example, when the character is summoned for the first time, the image display device 1 displays the baby's state, and from there, the character image is displayed every time a predetermined period elapses (for example, every month). It may be displayed as if the character is growing as it is changed.

<< Systems for various languages >>
The image display apparatus 1 can cope with various languages by mounting a speech recognition algorithm and a dialogue system with models corresponding to each language in each country.

《Original character system》
The character displayed by the image display device 1 may be created by the user as an original. The image display device 1 may be configured so that various data formats necessary for this can be prepared and edited by the user, or the edit itself created by the user's PC or the like is transferred to the image display device 1. It is good to do. The character data created by the user may be distributed via a network.

《Various character summoning system》
As a character displayed by the image display device 1, character data of VR (Virtual Reality) content may be used. For example, a character such as a game played by a user using an HMD (Head Mounted Display) may be used as a character displayed on the image display device 1. In addition to VR content, it can be used as a character for downloading and displaying characters of various games (for example, a smartphone game).

《External implementation of chat function》
In the above description, the image display device 1 has a chat function, but the chat function may be executed by an external device. That is, when a user exchanges a message with the character of the image display device 1 using a communication terminal, the user may actually exchange with an external server. In this case, the external server needs to acquire the response algorithm as a character and acquire the conversation history data 755 and chat history data 756 related to the user from the image display device 1 in advance. Therefore, when there is a chat input from the user, an external device may be configured to access the image display device 1 and acquire such information. Further, after the external device finishes the chat with the user's communication terminal, the external device transmits the chat history data 756 to the image display device 1, and the image display device 1 stores the received chat history data 756. The storage device 75 may be overwritten. With such an implementation, it is possible to realize a system in which a device having a chat function is provided outside the image display device 1.

  As described above, according to the image display device 1 according to the first embodiment of the present invention, it is possible to display a character or the like to be displayed as an entity in the same space. Further, the image display device 1 causes a character or the like to perform a behavior corresponding to environmental information such as a user's voice. Further, the image display device 1 can display an effect image representing the character's feeling and the like together with the character image. Furthermore, since the past contents are reflected in the latest conversations and chats regarding the conversations and chats performed with the user, the user is more familiar with the character and is more attached.

  Thereby, it is possible to give the user a feeling as if they were in the same space as a real character or the like. In addition, the character can be felt closer.

  In the embodiment described above, each process has been described as being realized by the control unit 71 of the image display device 1 executing an image display program, a conversation program, a chat program, and the like. On the other hand, in the image display device 1, instead of the CPU, an integrated circuit (IC (Integrated Circuit) chip, LSI (Large Scale Integration)), FPGA (Field Programmable Gate Array), CPLD (Complex Programmable Logic Device), or the like is formed. Each process may be realized by a logic circuit (hardware) or a dedicated circuit. In addition, these circuits may be realized by one or a plurality of integrated circuits, and the functions of the plurality of functional units described in the above embodiments may be realized by a single integrated circuit. An LSI may be called a VLSI, a super LSI, an ultra LSI, or the like depending on the degree of integration.

  That is, as shown in FIG. 23, the image display device 1 may include a control circuit 71a, an input circuit 72a, an output circuit 73a, an operation circuit 74a, a storage circuit 75a, and a communication circuit 76a. The acquisition control circuit 711a, analysis circuit 712a, display processing circuit 713a, audio output circuit 714a, transmission processing circuit 715a, and data management circuit 716a included in the control circuit 71a are controlled by an image display program P1, a conversation program P2, a chat program P3, and the like. Is done. Each function is the same as each part which has the same name shown in the said embodiment.

  Further, as the storage device 75, a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The image display program P1, the conversation program P2, and the chat program P3 are transmitted via any transmission medium (communication network, broadcast wave, etc.) that can transmit the image display program P1, the conversation program P2, and the chat program P3. It may be supplied to the processor. The present invention can also be realized in the form of a data signal embedded in a carrier wave in which the video display program is embodied by electronic transmission. In addition to these programs, voice data and image data related to characters may be downloaded from a server storing them and used in the image display apparatus 1. In this way, various characters can be enjoyed on the image display device 1. In addition, new voice data and image data of the same character may be downloaded and used. Various data stored in the storage device 75 may be stored not in the storage device 75 but in an external device such as a server on a network accessible by the image display device 1. Then, the control unit 71 of the image display device 1 may access the external server via the communication unit 76 at a necessary timing and acquire necessary information. For example, information such as the language model and the speech model in the above embodiment can be stored on the network.

  The image display program P1, the conversation program P2, and the chat program P # are script languages such as ActionScript, JavaScript (registered trademark), Python, Ruby, C language, C ++, C #, Objective-C, Java (for example). It can be implemented using a compiler language such as a registered trademark, assembly language, RTL (Register Transfer Language), or the like.

  INDUSTRIAL APPLICABILITY The present invention can be suitably used for an image display device that can display character images and link conversations with the user and chat contents exchanged with the user's communication terminal.

DESCRIPTION OF SYMBOLS 1 Image display apparatus 2 Case 21 Upper accommodating part 22 Lower accommodating part 221 Base 23 Support | pillar 3 Transparent film (flat member)
4 Projector (video output means)
5 Reflection mirror (reflection means)
51 Mirror mounting part (adjustment means)
6 pillar part 71 control part (output control means)
72 Input section (input means)
73 Output section (output means)
706 Production LED (light emitting means)

Claims (12)

A display for displaying the character,
A conversation unit in which the character performs a conversation with the user;
A chat unit for performing chat with the user's communication terminal;
The conversation unit selects a next topic based on the content of the conversation performed and the content of the chat performed by the chat unit,
The said chat part selects the next topic based on the content of the chat performed, and the content of the conversation performed by the said conversation part. The image display apparatus. The image display device further includes:
A case where part or all of the case is made of a translucent member;
A translucent flat member erected inside the case, and
The image display device according to claim 1, wherein the display unit displays the character by projecting the character onto the flat member. The image display device further includes:
A first storage unit for storing information related to a conversation with the user executed by the conversation unit;
A second storage unit that stores information related to the chat executed by the chat unit,
The image display device according to claim 1, wherein the conversation unit selects a next topic based on information stored in the first storage unit and the second storage unit. The image display apparatus according to claim 3, wherein the chat unit selects a next topic based on information stored in the first storage unit and the second storage unit. The image display device according to any one of claims 1 to 4, wherein the display unit displays an image corresponding to a content of a conversation executed by the conversation unit together with the character. The image display device further includes:
With speakers,
The image display device according to claim 1, wherein the conversation unit outputs the voice of the character from the speaker. The image display device further includes:
With a microphone,
The image display device according to claim 6, wherein the conversation unit analyzes a user's voice input to the microphone and outputs a voice of a character that is an answer to the voice from the speaker. The said conversation part converts the said user's voice into text data, and memorize | stores the noun obtained by analyzing the said text data in the said 1st memory | storage part as the content of the said conversation. Image display device. The image display device further includes:
A communication unit that performs communication with a device outside the image display device;
The chat unit transmits text data corresponding to the selected topic to the chat server outside the image display device via the communication unit,
The image display according to any one of claims 1 to 8, wherein the communication unit analyzes text data from the communication terminal of the user received from the chat server and selects a next topic. apparatus. The image display apparatus according to claim 9, wherein the chat unit stores a noun obtained by analyzing the text data in the second storage unit as the content of the chat. A display step to display the character;
A conversation step in which the character performs a conversation with the user;
A chat step in which the character performs a chat with the communication terminal of the user;
A first topic selection step for selecting a conversation topic to be executed next in the conversation step based on a conversation content previously executed and a chat content executed in the chat step;
A topic selection method including a second topic selection step of selecting a chat topic to be executed next in the chat step based on the content of the chat executed previously and the content of the conversation executed in the conversation step. On the computer,
Display function to display the character,
A conversation function in which the character performs a conversation with the user;
A chat function in which the character performs a chat with the communication terminal of the user;
A first topic selection function for selecting a conversation topic to be executed next by the conversation function based on a conversation content previously executed and a chat content executed by the chat function;
The topic selection program which implement | achieves the 2nd topic selection function which selects the topic of the chat performed next by the said chat function based on the content of the chat performed previously, and the content of the conversation performed by the said conversation function.

Images