JP2005217539A - Virtual companion system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a virtual companion system with almost no restriction of the user's behavior range which can be used as a user-friendly user interface for exclusively personal use. <P>SOLUTION: The virtual companion system is provided with: an input means 1 for inputting instructions of the user; and a calculation processing means 5 which at least generates expression data of a virtual companion on the basis of information for generating data comprising: information received from an external system 7 via a communication means 4 following the instructions inputted by the input means 1; configuration information of a model read out from a storage means 3; and customized information, and makes an expression means 2 express the virtual companion. When there are transfer instructions to a terminal from the user by the input means 1, the calculation processing means 5 transfers identification information and the customized information made to correspond to the identification information to the terminal via the communication means 4 independently from the configuration information of the model. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a virtual companion system used as a user interface capable of interacting with a virtual companion created in a virtual space and a real space user.

  Conventionally, an agent device has been proposed in which a virtual companion is displayed on a display device and the sound of the virtual companion is output from the sound output device, thereby enabling communication between the virtual companion and the user (for example, (See Patent Documents 1 and 2).

  The agent devices disclosed in Patent Documents 1 and 2 include the above-described display device, audio output device, and the like mounted on a vehicle, and a user who is a driver driving the vehicle communicates with a virtual companion. Can be done.

  Conventionally, a system that can grow a so-called virtual pet as a virtual object in an interactive environment has been proposed (see, for example, Patent Document 3).

In the system disclosed in Patent Document 3, a user can interact with a virtual pet using a personal computer (hereinafter abbreviated as a personal computer) when at home, while using a wristwatch-type mobile phone when going out. The unit can be used to interact with the virtual pet, and data about the virtual pet can be communicated between the personal computer and the portable unit.
Japanese Patent Laid-Open No. 11-37766 (see paragraph numbers [0007] to [0060], FIG. 1 to FIG. 11) Japanese Patent Laid-Open No. 11-250395 (see paragraph numbers [0006] and [0071], FIGS. 1 to 13) Japanese translation of PCT publication No. 2003-515367 (see paragraph numbers [0018]-[0038], FIG. 1 to FIG. 4)

  By the way, since the agent device disclosed in Patent Documents 1 and 2 is a device in which the display device and the audio output device are mounted on a vehicle driven by the user, the range of action of the user when using the agent device is limited. It is constrained in the vehicle. Here, a driver who is a user interacts in the past by storing information about the virtual companion in a storage medium such as an IC card and carrying it, and reading the storage information of the storage medium in the agent device of another vehicle. Although it is possible to interact with the virtual companion, it was impossible to interact with the virtual companion until the vehicle was loaded with the agent device.

  In the system disclosed in Patent Document 3, the user can train a virtual pet using a personal computer when the user is at home, and can continue growing the virtual pet using a dedicated mobile unit when going out. Therefore, restrictions on the user's action range can be reduced.

  However, the system disclosed in Patent Document 3 is difficult to handle because the user interface is completely different between the personal computer and the portable unit.

  In addition, some user interfaces using virtual pets have been applied to e-mail software, but they can only deal with a specific environment, which limits the user's action range.

  The present invention has been made in view of the above-mentioned reasons, and an object of the present invention is to provide a virtual companion system that can be used as a personal user interface that is less likely to be restricted by the user and that is easy for the user to get familiar with. There is.

  The invention according to claim 1 is an expression means for expressing to a user a virtual companion created in a virtual space and interacting with a user in real space, configuration information of the model of the virtual companion, identification information for identifying the virtual companion, and Storage means for storing user-specific customization information related to the virtual companion, communication means for allowing information to be exchanged between a plurality of external systems to be accessed, and input for inputting a user instruction regarding access to the external system Virtually based on data generation information composed of information exchanged with the external system via the communication means and the model configuration information and customization information read from the storage means in accordance with the instructions input by the input means and at least the input means Companion expression data A virtual companion system comprising, as a component, an arithmetic processing unit that causes a representation means to express a virtual companion, and a plurality of external systems include a terminal that can be used by a user and has the component, The storage means stores the virtual companion customization information in association with the identification information, and the arithmetic processing means stores the identification information and the customization information associated with the identification information when there is a transfer instruction from the user to the terminal by the input means. Can be transferred to the terminal via the communication means independently of the configuration information of the model. Note that the configuration information of the model includes information on the appearance (shape and form) of the model, information on the action rules of the model, and information on the voice of the model.

  According to the present invention, the user can transfer the identification information and the customized information associated with the identification information to the terminal independently from the model configuration information by giving a transfer instruction to the terminal using the input means. By transferring the identification information and customization information to the user, it is possible to access an external system through a virtual companion specialized for the user even when the user moves, so there are few restrictions on the user's action range, and It can be used as a personal user interface that is easy for users to become familiar with.

  According to a second aspect of the present invention, in the first aspect of the invention, the storage means stores characteristic information relating to the representation means, and the arithmetic processing means reads the data generation information from the storage means. Characteristic information is included.

  According to this invention, it becomes possible to change the expression level by the expression means according to the characteristic information of the expression means in the terminal used by the user, and an appropriate expression level according to the characteristic information of the expression means It becomes possible to express the virtual companion.

  According to a third aspect of the present invention, in the invention of the second aspect, the storage means stores the configuration information of each of a plurality of models that are different from each other in detail, and the arithmetic processing means stores the memory. The configuration information is alternatively selected according to the characteristic information read from the means.

  According to the present invention, the virtual companion can be expressed at an optimal expression level according to the characteristic information of the expression means.

  A fourth aspect of the present invention is the external system according to any one of the first to third aspects of the present invention, wherein one of the external systems can reflect the environment information related to the environment around the user to the generation of information for replying to the access source. And environmental information acquisition means for acquiring environmental information about the environment around the user, wherein the arithmetic processing means can transmit the environmental information acquired by the environmental information acquisition means to the external system via the communication means. It is characterized by that.

  According to the present invention, the environment information related to the environment around the user is taken into account when generating the virtual companion expression data, and the time and effort for the user to input the environment information can be reduced.

  According to a fifth aspect of the present invention, in the first to fourth aspects of the invention, the arithmetic processing means stores the contents of processing performed internally in the storage means as history information, and uses the history information read from the storage means. And learning to change the customization information so as to be closer to the user's preference.

  According to this invention, since the user continuously uses it, learning is performed using history information, and the expression of the virtual companion becomes closer to the user's preference. A virtual companion makes it easier to get to know.

  The invention of claim 6 is the invention of claim 1 to claim 5, wherein at least one of the external systems has the same configuration as the virtual companion system of any one of claims 1 to 5. It is a virtual companion system.

  According to the present invention, since information can be exchanged between a plurality of virtual companion systems, for example, most of work such as conference schedule adjustment can be performed by mutual communication between virtual companion systems. Thus, it is possible to reduce the burden on each user for work such as schedule adjustment, and it is expected that the ease of use for each user will increase.

  The invention according to claim 7 relates to the invention according to claim 6, wherein the arithmetic processing means relates to a function of acquiring information related to another virtual companion in the other virtual companion system via the communication means, and to another virtual companion. It has a function of storing information in the storage means, and a function of causing the expression means to express other virtual companions based on information related to other virtual companions read from the storage means.

  According to the present invention, the virtual companion specialized for the user of the other virtual companion system is displayed on the expression means together with the virtual companion specialized for the user, thereby allowing the user to communicate with the other user. It is possible to exchange information with other users without feeling the physical and psychological distance.

  The invention according to claim 8 is the invention according to any one of claims 1 to 7, wherein the arithmetic processing means has a function of causing the expression means to express the external system as a character that interacts with the user.

  According to this invention, the user responds to the user's questions and requests by causing the expression means to express the external system as a character that the user can interact in the same manner as the virtual companion. The user interface can be operated more like a request for work while consulting with a person rather than directly operating a device as the external system, thus providing a user interface that is easier to use for the user.

  A ninth aspect of the present invention provides the server according to any one of the first to eighth aspects, further comprising a server connected to the communication unit via a network, wherein the storage unit or the storage unit and the arithmetic processing unit are part of the server. It is characterized in that it is shared in a systematic manner.

  According to the present invention, the storage capacity required for the terminal can be reduced, and restrictions on the terminal are reduced. Therefore, the necessary memory in the portable terminal that can be carried by the user without burden as the terminal and that can access the network, or in the fixed terminal that is installed in the place where the user has moved (for example, an Internet cafe) and can access the network Capacity can be reduced.

  A tenth aspect of the invention is characterized in that, in the first to eighth aspects of the invention, there is provided a management function for allowing a part of information handled internally by the arithmetic processing means to be browsed from the outside via the communication means. And

  According to the present invention, since a part of information handled by the arithmetic processing means of another virtual companion system can be used, more information can be used and the usability of the user is increased. .

  According to the first aspect of the present invention, even when a user moves, an external system can be accessed through a virtual companion specialized for the user, so that the user's range of action is small and the user is easy to get close to There is an effect that it can be used as a dedicated user interface.

  The virtual companion system described below is capable of interaction between a virtual companion created in a virtual space and a real space user, and the user and an external system to be accessed are connected via a computer and a computer network (hereinafter referred to as a network). It is used as a user interface connected by.

(Embodiment 1)
As shown in FIG. 1, the virtual companion system VS of the present embodiment includes an input unit 1 for inputting an instruction of a user M (see FIG. 2) regarding access to the external system 7 to be accessed, and a virtual companion VC (see FIG. 1). 2) to the user M, model configuration information of the virtual companion VC, identification information (for example, ID) for identifying the virtual companion VC, and user-specific customization information regarding the virtual companion VC A terminal used by the user M as the virtual companion system VS (for example, a fixed terminal such as a desktop computer dedicated to the user installed in the home of the user M, a desktop personal computer installed in the Internet cafe, or the user) designated Between a storage unit 3 including a memory for storing characteristic information of a notebook computer, a portable information terminal, a portable terminal such as a cellular phone), and an external system (for example, a server) 7 to be accessed via the network 6 The communication means 4 that can exchange information between them, and the external system 7 is accessed through the communication means 4 in accordance with the input (information) from the user M by the input means 1, and the information corresponding to the input from the external system 7 The virtual companion VC is generated in real time based on the data generation information including at least the information obtained from each of the input unit 1 and the external system 7 and the information stored in the storage unit 3 to obtain the virtual companion VC. As a component. Here, since the storage unit 3 stores the customization information of the virtual companion VC in association with the identification information of the virtual companion VC, it is possible to express the virtual companion VC specialized for the user M individual. Note that the virtual companion system VS of the present embodiment is configured by mounting a processing program (software) for the virtual companion system on the terminal.

  The storage means 3 is associated with the default information storage unit 31 that stores the virtual companion VC model configuration information (default information), the identification information storage unit 32 that stores the identification information for identifying the virtual companion VC, and the identification information. Customization information storage unit 33 for storing customization information, terminal characteristic information storage unit 34 for storing terminal characteristic information, and API information storage for storing application program interface (API) information necessary for using external system 7 Unit 35, history information storage unit 36 for storing history information related to the exchange between the arithmetic processing means 5 and the user M and other series of processing, temporary data storage unit 37 for temporarily storing data (information), etc. have. The API information may be stored in advance in the API information storage unit 35, or may be acquired by accessing the external system 7 and stored in the API information storage unit 35. The storage unit 3 also stores an address (for example, a URL) of the external system 7.

  The model configuration information of the virtual companion VC described above is expressed by a set of function items set for each attribute and default values (default information). For example, as shown in the table on the left side of FIG. Default values are set for each item. In the example shown in FIG. 3, “expression”, “hairstyle”, “hair color”, “sex”, “age”, “skeleton / joint”, as attributes relating to the appearance (shape / form) of the virtual companion VC. There are functional items such as “movable range”, “skeletal length”, “height”, “weight”, etc., and there are functional items such as “language”, “speaking” as attributes related to the voice expression of the virtual companion VC, There are functional items such as “selfie”, “gesture”, “contrast”, “blink”, and “gaze” as attributes related to the action rules of the virtual companion VC. Each functional item is to the right of the slash (/). The default value as described in is set. On the other hand, for example, the user M can set customization information for each desired function item as in the table on the right side of FIG. In the table on the right side of FIG. 3, customization information for each function item is described to the right of the slash (/). The customization information includes, for example, a search function for accessing the external system 7 in addition to the above example. In addition, when assuming an information providing system that provides a route guidance service as one of the external systems 7, in addition to the above-described example, the customization information includes user M's preference (likes and dislikes of eating out, Information on food preferences, fields of interest for movies and entertainment, preferences for transportation such as walking, buses, trains, bicycles and airplanes, and likes and dislikes of places where people gather) may be set.

  Further, as the above-mentioned terminal characteristic information, for example, characteristic information regarding the input means 1 (for example, a keyboard, a microphone, a voice recognition device, etc.) usable in the terminal, and sensing means 8 (for the surroundings of the user) Environmental information acquisition means for acquiring environmental information related to the environment, for example, characteristic information relating to GPS sensors, temperature sensors, humidity sensors, etc., expression means 2 (image display device, speaker as sound output device) usable on the terminal, Characteristic information relating to a vibration device, etc., characteristic information relating to processing capability of the terminal itself, and the like. Here, as the characteristic information of the input means 1, for example, there is information which can be input by a microphone or input by a voice recognition device with respect to voice input. The characteristic information of the expression means 2 includes, for example, information such as resolution, display area size, color (monochrome to full color), refresh rate (still image to moving image), sound information, etc. regarding image display of the image display device. Regarding output, beep sound such as buzzer, melody, synthesized sound, three-dimensional sound, etc., information on sound that can be output, and characteristic information on processing capability of the terminal itself include, for example, CPU clock frequency, memory capacity, disk There is information such as capacity.

  The arithmetic processing unit 5 includes a communication processing unit 51 that communicates with the external system 7 via the communication unit 4 and the network 6, and an input processing unit that converts an input from the input unit 1 or the sensing unit 8 into a predetermined data format. 52 and an interactive processing unit for performing processing for expressing the virtual companion VC for accessing the external system 7 and interacting with the user M in accordance with an inquiry or instruction from the user M input from the input processing unit 52. 53 and history information that changes the customization information stored in the customization information storage unit 33 so that the virtual companion VC preferred by the user M is expressed by learning based on the history information stored in the history information storage unit 36 Difference information (customized information that has been changed) when the customization information is changed with the processing unit 54 The difference information processing unit 55 to be output, the storage data input / output processing unit 56 for exchanging data (information) stored in the storage unit 3 with the processing units 51 to 55, and the processing units 51 to 56 And a system control unit 57 for controlling the system.

  The communication processing unit 51 converts the data exchanged between the external data 7 and the communication data processing unit 51a that communicates data with the external system 7 via the communication unit 4 and the network 6 into a predetermined data format. An external system input / output processing unit 51b for conversion is configured.

  Further, the input processing unit 52 includes a user input processing unit 52a that converts an input (for example, an inquiry or an instruction) of the user M received from the input unit 1 into a command by a data conversion process, and a detection input from the sensing unit 8. A sensing input processing unit 52b that converts information into a predetermined data format is used.

  The dialogue processing unit 53 includes an input action processing unit 53a that accesses the external system 7 when data for accessing the external system 7 to be accessed is prepared based on the command output from the user input processing unit 52a; An action generation processing unit 53b that determines the action rule of the virtual companion VC to be expressed by the expression unit 2 based on the model configuration information stored in the storage unit 3, the terminal characteristic information, and the customization information, and the input action processing unit 53a And an output behavior processing unit 53c that generates data related to the behavior of the virtual companion VC based on the output of the external system input / output processing unit 51b and the behavior rule information input from the behavior generation processing unit 53b. Configuration information and terminal characteristics information and customization information The form generation processing unit 53d that generates data related to the form of the virtual companion VC to be expressed by the expression means 2 based on the data, the data related to the action given from the output action processing part 53c, and the data related to the form given from the form generation processing part 53d And an expression data generation processing unit 53e that generates expression data of the virtual companion VC and causes the expression means 2 to express the virtual companion VC.

  Here, the input action processing unit 53a takes in the API information and the like related to the external system 7 to be accessed from the storage unit 3 through the storage data input / output processing unit 56, and the data is insufficient to access the external system 7. In the case where there is data that is lacking, it is confirmed whether or not it can be supplemented with data output from the sensing input processing unit 52b. When the input behavior processing unit 53a does not have the necessary data, the system control unit 57 instructs the output behavior processing unit 53b to start a program for outputting an inquiry to the user M, and the virtual companion VC. The user M is inquired through When the input behavior processing unit 53a has necessary data, the external system 7 is accessed, and the information sent from the external system 7 is input to the external system input / output processing unit 51b. Then, the system control unit 57 instructs the output behavior processing unit 53b to start a program for outputting an answer to the user M, and an answer is made to the user M through the virtual companion VC. Information input from the external system 7 to the external system input / output processing unit 51 b is stored in the storage unit 3 via the storage data input / output processing unit 56.

  By the way, in the virtual companion system VS of the present embodiment, the user M is a user among a plurality of terminals that can be used by the user M (including not only the terminal owned by the user M but also a personal computer installed in an Internet cafe, for example). Terminals other than those currently used by M as the virtual companion system VS also constitute the external system 7. Here, the virtual companion system VS of the present embodiment stores the address and API information of terminals other than the currently used terminal in the storage means 3, and the input behavior processing unit 53a of the arithmetic processing means 5 When there is a transfer instruction from the user M to another terminal by the means 1, the identification information and the customized information associated with the identification information are read from the storage means 3 independently of the model configuration information, and the communication means 4 is read out. And a transfer processing function for transferring to another terminal.

  Therefore, in the virtual companion system according to the present embodiment, even when the user M moves, the external system 7 can be accessed through the virtual companion VC specialized for the user. The user interface can be used as a personal user interface that is small and friendly to the user M.

  Hereinafter, an information providing service (for example, a digital map system such as a car navigation system, a station spa (registered trademark) such that the external system 7 to be accessed by the virtual companion system VS of the present embodiment can access the user M as needed. A case where a server in which a route search system that provides information such as a route between a departure station and an arrival station, a fare, and a required time) is used will be described with reference to FIG.

  The virtual companion system VS described at the upper side in FIG. 2 is configured by mounting a processing program dedicated to the virtual companion system on a desktop personal computer used by the user M at home, for example. A microphone 12 is provided, and an image display device 21 and a speaker 22 attached to a desktop personal computer are provided as the expression means 2. In the present embodiment, since the processing program is installed in a computer of a terminal used by the user M, the programming language of the processing program is set via a web browser via a network such as Java (R) language. If a downloadable programming language is used, the operation for mounting the processing program on the terminal used by the user M is simplified and the convenience is enhanced.

  The user M can use the terminal used as the virtual companion system VS in the building such as the mobile phone carried by the user M, the PDA, and the user's stop (for example, an Internet cafe) when going out. If you want to change to another terminal such as a personal computer, download the processing program dedicated to the virtual companion system to the terminal you want to use as the virtual companion system VS using a web browser or install or install it. In response to the transfer instruction of the user M to the input means 1 of the currently used virtual companion system VS, the identification information and the latest customization information are transferred by accessing the terminal of the virtual companion system VS to be used thereafter. That. At this time, the virtual companion system VS that has received the identification information and the customization information stores the identification information and the customization information in the storage unit 3, and performs virtual processing based on the model configuration information, customization information, and the like stored in the storage unit 3. The expression data of the companion VC is generated and expressed by the expression means 2. On the other hand, in the virtual companion system VS used so far, when it is confirmed that the transfer of the identification information and the customization information is completed, the expression of the virtual companion VC is stopped and the system is terminated or shifts to a standby state. When the user M issues a transfer instruction, the address or name of the transfer destination terminal may be input by the input unit 1, or a search for a terminal that can be used by the user M is instructed through the input unit 1. Then, based on the search result, the input unit 1 may instruct transfer to the terminal that has been replied from the virtual companion VC.

  The virtual companion system VS described at the lower side in FIG. 2 is configured by mounting the above processing program on a computer of a terminal including a mobile phone carried by the user M. Provided with an image display device 21 comprising a liquid crystal display, a sound output device (not shown) comprising a speaker, and a vibration device (not shown). As a means 4, a communication device provided in a mobile phone is provided.

  Note that the input unit 1 is not limited to the above-described example, and a voice input device such as a voice recognition device or a microphone, a touch panel, or the like may be employed.

  Further, a system in which the external system 7 provides a service using environmental information (for example, the current location where the user M is present and its time, temperature, humidity, noise, road congestion, weather, etc.). In this case, as the sensing means 8, the current position information and current time of the terminal currently used by the user M is obtained by using, for example, a GPS sensor, a temperature sensor for detecting the ambient temperature, and the ambient humidity. By mounting and using the above processing program on a terminal having various sensors such as a humidity sensor to detect, for example, an image sensor made up of a CCD camera that captures a landscape, etc., it is possible to reduce time and effort for the user M to input environmental information. It becomes possible. Further, the user input processing unit 52a or the sensing input processing unit 52b can determine the instruction of the user M from the facial expression and gesture (the direction indicated by the user M with the finger) of the user M captured by an imaging device such as a CCD camera. With this configuration, it is possible to save the trouble of operating the operation keys and the like.

  Hereinafter, processing performed by the above processing program will be described with reference to FIGS. 4 to 7. The customization information is initially set by the user M when setting identification information for the first time, and can be changed at any time. It has become.

  When the virtual companion system VS is activated, first, identification information corresponding to the virtual companion VC of the user M is read from the storage means 3, and then customization information corresponding to the identification information is read from the storage means 3 (S1), and thereafter Then, based on the model configuration information and customization information read from the storage means 3, the virtual companion VC expression data is generated and the virtual companion VC is expressed by the expression means 3 (S2). Here, the image for greeting by the virtual companion VC is displayed on the image display device 21 and the sound is output from the sound output device.

  Thereafter, the first interrupt process for waiting for the input from the user M by the input means 1 is performed (S3), and then the second interrupt process for waiting for the input from the sensing means 8 is performed (S4) and stored in the storage means 3 Based on the various information, the expression data of the virtual companion VC is updated (S5), and the virtual companion VC is expressed by the expression means 2 (S6).

  Here, in the first interrupt process, the input by the input means 1 is monitored. When an interrupt is generated in response to an instruction from the user M, the interrupt content is determined as shown in FIG. 5 (S11). If it is a system termination instruction, the updated information such as customization information is stored in the storage means 3 (S12), and the virtual companion system VS is terminated (S13).

  Further, when the interruption content is an inquiry from the user M, as shown in FIG. 6, it is determined from the information stored in the storage means 3 whether or not the inquiry content can be answered immediately (S21). If it is possible to answer immediately, the information stored in the storage means 3 is updated based on the answer information (S22), and then the process returns to the first interrupt process (S3) (S23). After performing the interrupt processing (S4), the expression data of the virtual companion VC is updated based on various information stored in the storage means 3 (S5), and the virtual companion VC is expressed (S6) to the user M. Answer. On the other hand, if it is impossible to answer immediately, the external system 7 is accessed by supplementing the information that is insufficient to make an inquiry to the external system 7 with customization information or a reply to the question to the user M (S24). Information (stored data) stored in the storage means 3 is updated (S25). Thereafter, the process returns to the first interrupt process (S26), and after performing the second interrupt process (S4), the expression data of the virtual companion VC is updated on the basis of various information stored in the storage means 3 ( In step S5, the virtual companion VC is expressed (S6), and the user M is answered. Note that the content of the answer, the text, the voice quality, and the action when replying can be adapted to the preference of the user M by updating the model configuration information based on the customization information and generating expression data (S5). . In addition, when it is not possible to respond immediately, such as when it is necessary to access the external system 7 in order to generate information to be answered, the expression means 2 outputs a voice such as “please wait” and the current processing You may make it display the operation | movement matched with. Further, when making a question to the user M as described above, an inquiry request to the user is generated, and information (stored data) stored in the storage means 3 corresponding to the inquiry content to the user M is stored. Update and generate your own interrupt. As a result, a question is made to the user M by the virtual companion VC.

  If the interruption content is an instruction to change the terminal by the user M in S11, as shown in FIG. 7, it is determined whether or not the terminal to be changed can be searched and connected (S41). If there is, update information such as customization information is stored in the storage means 3 (S42), then the identification information and customization information are transferred to the terminal to be changed (S43), and the system is terminated (S44). On the other hand, if it is determined in S41 that connection is impossible, the storage information in the storage means 3 is updated (S45), and then the process returns to the first interrupt process (S46), and the second interrupt process. After performing (S4), the representation data of the virtual companion VC is updated based on various information stored in the storage means 3 (S5), and the virtual companion VC is represented (S6), thereby changing the terminal to the user M. Answer that it is not possible.

  When an input-waiting interrupt occurs in S4, the input information is processed and the information stored in the storage means 3 is updated. Thereafter, the process returns to the second interrupt processing and is stored in the storage means 3. The expression data of the virtual companion VC is updated based on the various information (S5), and the virtual companion VC is expressed based on the expression data (S6).

  Note that the external system 7 is a route guidance system, and is customized as an expression method of the virtual companion VC for answering the user M when there is an inquiry such as “Where is the road to Δ □” from the user M? Based on information and terminal characteristic information, you can answer by voice, such as “next corner to the right” and “next corner to the left”, display a map to show the path, and various expression methods However, when a mobile terminal is used, it is difficult to display a map because the screen is small. In such a case, for example, when the user M arrives at a place where a personal computer can be used such as an Internet cafe, the user M uses the personal companion system as a virtual companion system for the virtual companion system VS currently used. It is sufficient to input In addition, when the virtual companion system VS searches for a terminal such as a personal computer that can be used by the user M because the screen is larger than that of the mobile terminal, and the corresponding personal computer exists near the user M, the virtual companion system VS The fact may be transmitted to the user M through the virtual companion VC, and a map may be displayed by connecting to a mobile terminal currently used as the virtual companion system VS via a wireless LAN or the like. In addition, the terminal used as the virtual companion system VS is a mobile terminal, and the expression unit 2 includes a vibration device capable of giving vibration to the user M in addition to the image display device 21 and the audio output device. The virtual companion VC calls the user M or alerts the user M when the user M is instructed to turn at an intersection in the course of the route guidance or when the user M enters the wrong road. A vibration may be given to the user M from the vibration device. In addition, when the terminal used as the virtual companion system VS includes a vibrator or an electrode that can be attached to both hands of the user M as the expression means 2, the direction in which the virtual companion VC bends to the user M can be expressed by voice or image. When instructing, the direction of the bending may be instructed by sending a signal to the vibrator or electrode attached to the bending hand.

  By the way, regarding the configuration information of the virtual companion VC model (the model of the internal model) to be expressed by the expression unit 2, a plurality of configuration information at different levels is stored in the storage unit 3 as shown in FIG. The configuration information of a plurality of models having different levels of detail is stored by performing hierarchical multiplexing, and the arithmetic processing means 5 is configured to alternatively select a model according to the characteristic information of the expression means 2 May be. Here, in selecting a model according to the characteristic information, the expressive power of the virtual companion VC and the response to the user M (response time, time required for updating the display in the image display device 21) are a trade-off. Although the response depends on the customization information, if the expressive power is increased, the computation time becomes longer and the response becomes worse. Therefore, the arithmetic processing means 5 determines the expressive power and the response based on the characteristic information of the expressive means 2. It is preferable to have a selection function for selecting a model with the most detailed level of detail from the above relationship. By having such a selection function, if the terminal performance is high, the response is the same as that of a low-performance terminal. A virtual companion VC using a template with a higher level of detail can be expressed. For example, when the terminal used as the virtual companion system VS is a mobile phone, since the screen of the image display device 21 in the expression means 2 is small, the appearance of the virtual companion VC is displayed on the image display device 21 as a two-dimensional character. At the same time, sound may be output from the sound output device. On the other hand, when the terminal used as the virtual companion system VS is a personal computer, the screen of the image display device 21 is relatively large. Therefore, as the virtual companion VC, a character having three-dimensional shape data and motion data is imaged. If the audio is output from the audio output device 22 while being displayed on the display device 21, the virtual companion VC can be displayed three-dimensionally (three-dimensionally) on the image display device 21 of the expression means 2, and the virtual companion VC can be displayed in detail. Therefore, it is possible to express the virtual companion VC that is more familiar to the user M.

  More specifically, as shown in FIG. 9, for example, as shown in FIG. 9, the virtual companion VC (VC1) in the case where the terminal used by the user M is a mobile phone A1 and the image display device 21 is configured by a liquid crystal display of the mobile phone. The model of the virtual companion VC (VC2) in the case where the model is MD1 and the terminal used by the user M is the notebook personal computer A2 and the image display device 21 is configured by the liquid crystal display of the notebook personal computer is used by the user MD2. MD3, user M uses the model of virtual companion VC (VC3) when the terminal is a large-screen digital television A3 equipped with a remote control (not shown) and the image display device 21 is the main body of the large-screen digital television A3. Device that has a remote control (not shown) to enable stereoscopic viewing (i.e. The model of the virtual companion VC (VC4) when the image display device 21 is the main body of the high presence immersive presentation device A4, which is a high presence immersive presentation device A4 including a display device (which displays a three-dimensional video) is MD4. Assuming that the customization information unique to the user M is common, the details of the four types of models MD1, MD2, MD3, and MD4 based on the characteristic information of the terminal are expressed as [detail of model MD1] <[model MD2 <Detail level of model MD3> <detail level of model MD4>, the performance of the image of virtual companion VC is [performance of virtual companion VC1] <[performance of virtual companion VC2] < [Performance of Virtual Companion VC3] <[ Over Virtual becomes a companion VC4 of performance].

  In the virtual companion system VS of the present embodiment described above, when changing the terminal used by the user M, customization information regarding the virtual companion VC can be taken over from the terminal before the change to the terminal to be changed. Therefore, there is no need to reset the customization information, and even if the terminal changes, the appearance characteristics of the virtual companion VC (for example, hairstyle, clothes, etc.), voice quality, language, motion, Since the conversation is continued, for example, the user M feels that the conversation with the same virtual companion VC continues and is easy to use. Therefore, even when the user M changes the terminal as the user moves as shown in FIG. 10, it is possible to feel that the user M is interacting with the same virtual companion VC. FIG. 10 is an image diagram of the route guidance by the virtual companion VC. In the upper left, a personal computer is used as a terminal, in the lower right, a display device capable of displaying 3D video is used as a terminal, and in the upper right, a headset is used as a terminal. We are using.

  Further, if a part of the storage means 3 or the storage means 3 and the arithmetic processing means 5 is shared by the server on the network, the storage capacity required for the terminal used as the virtual companion system VS can be reduced. Restrictions on terminals used as the virtual companion system VS are reduced. Accordingly, when a terminal such as a portable terminal that can be carried by the user M without burden as a terminal and can access the network, or a fixed terminal that is installed at a location where the user M has moved and can access the network, is used for the virtual companion system VS. The required storage capacity can be reduced. In addition, the server in which the storage unit 3 or a part of the storage unit 3 and the arithmetic processing unit 5 is shared as described above may have various management functions such as data backup and arrangement in addition to various arithmetic processing functions. desirable.

  In addition, the external system 7 is a system that can reply to the access source (here, the virtual companion system VS) information related to the calculation result obtained by comprehensive calculation considering information (environment information) related to the environment around the user M In this case, since the virtual companion system VS includes the sensing unit 8 and the sensing input processing unit 52b, information regarding the calculation result is reflected in the behavior of the virtual companion VC. For example, when it is raining in a place where the user M is present, the sensing unit 8 detects environmental information indicating that it is raining, and transmits this environmental information to the external system 7 through the communication unit 4. As a result, the external system 7 can answer as a candidate for a route that guides the user M on a road that prevents the user M from getting wet.

  In the present embodiment, the arithmetic processing unit 5 includes the history information processing unit 54 described above, and the history information processing unit 54 uses the stored data input / output unit 56 as processing history information in the arithmetic processing unit 5. Through the storage data input / output unit 56 and using the history information read out from the storage means 3 to learn and extract the procedure of the processing contents repeated from the history information or similar The process of patterning or extracting the expression that the user M likes and having the function of changing the customization information so as to be closer to the user's preference, the user M continuously uses the virtual companion system VS. (The terminal may be changed as appropriate), learning is performed using history information, and the expression of the virtual companion VC is preferred by the user M. Since going to become closer to the user M is likely to feel the familiar by the virtual companion VC.

  Furthermore, in this embodiment, since the arithmetic processing unit 5 includes the above-described difference information processing unit 55, when the user M changes the terminal used as the virtual companion system VS, only the changed customization information is identified. It is also possible to transfer in association with information.

  Further, if it is configured to have a management function that allows some of the information handled internally by the arithmetic processing means 5 to be browsed from the outside via the communication means 4, the arithmetic processing means 5 of the other virtual companion system VS handles the information. In addition to being able to use advanced information processing at high speed, it is possible to use more information such as various individual data and environmental information at various locations. This improves the usability of the user M. Here, in order to realize the above-described management function, for example, a password permitting access is registered in the storage unit 3 in advance, and the password is read from the storage unit 3 when the password is transmitted from the outside. Can be viewed only when the passwords match, and information indicating that access is denied may be returned via the communication means 4 if the passwords do not match. That is, what is necessary is just to restrict | limit the user who can browse information by authenticating another user with a password.

(Embodiment 2)
The basic configuration of the virtual companion system VS of the present embodiment is the same as that of the first embodiment shown in FIG. 1, and a plurality of users M who use different virtual companion systems VS attend as the external system 7. A system for adjusting the schedule of a conference is assumed, and the contents of information handled by the arithmetic processing means 5 are different. Of course, different identification information is set for each virtual companion VC of each user M. Since the basic configuration of the virtual companion system VS is the same as that of the first embodiment as described above, illustration and description thereof are omitted.

  Each virtual companion system VS accesses, as an external system 7, a schedule database of each user M (hereinafter referred to as a schedule database), a conference room reservation database, and the like. The virtual companion systems VS are also connected to each other via a computer network, and exchange data with each other.

  Hereinafter, an operation example of the virtual companion system VS of the present embodiment will be described.

  For example, when a certain user M inputs a list of parties involved in the conference and a rough date and place of the conference through the input unit 1 of the virtual companion system VS of the user M, the arithmetic processing unit 5 stores the customization information in the storage unit 3. If there is customization information (for example, schedule setting conditions, preferences, etc.) related to the schedule setting in the unit 33, the corresponding customization information is acquired and connected to the schedule database of the user M as the external system 7 to become the parties involved in the conference The request of schedule adjustment is transmitted to the virtual companion system VS of the user. Each virtual companion system VS grasps the schedule database of each user M and the conditions for schedule adjustment, and determines the date and place of the meeting while communicating with each other as necessary. Since most of such adjustment work is performed between the virtual companion systems VS, the time required for the adjustment work by the user M can be eliminated. However, the virtual companion system VS is a virtual companion VC familiar to the user M (customized information is set for each user M) when it is necessary to contact the user M because the adjustment is not successful in the schedule setting. The user M is contacted through the virtual companion VC). When the user M is requested to report the adjustment status, the adjustment status is reported through the virtual companion VC familiar to the user M.

  An example of operation when the above-described schedule adjustment is performed will be specifically described.

  When the user M inputs an instruction “I want to have a meeting with Mr. XX on the day of the day” by the input unit 1, the arithmetic processing unit 5 uses the instruction pattern input from the input unit 1 as the external system 7. Set up Mr. x's virtual companion system, check the information necessary for schedule adjustment based on the API information, and check whether the instruction from the user M is sufficient and whether the necessary information is stored in the storage means 3 If there is missing information, the user M is inquired. The virtual companion system VS also sets the schedule database of its own user M as the external system 7 and examines its API information. Each virtual companion system VS performs schedule adjustment while exchanging information with each other using the mutual schedule database. If it is necessary to make an inquiry to the user M at any stage of the schedule adjustment, the corresponding user M is inquired through the expression means 2. If there is a vacancy in the schedule of each user M, the conference is registered in the schedule database, and the result is notified to the user M if necessary. If there is no vacancy in the schedule of any user M, adjustment work is necessary, but if there is information such as the priority of the conference or the conference partner to be prioritized based on the customization information, such information Based on the schedule adjustment work. If an alternative can be set, confirmation is made to the user M through the virtual companion VC, and if there is no problem, the conference is registered in the schedule database.

  Thus, in the present embodiment, the user M's own work can be reduced with respect to complicated work such as adjustment of the schedule and location of the conference in which a plurality of parties participate, and the adjustment work can be performed efficiently. It becomes possible, and it becomes possible to improve the satisfaction level of the user M. Therefore, a plurality of users M will feel that the virtual companion VC of their virtual companion system VS performs adjustments such as the schedule and place of the conference in which they participate.

  Since schedule adjustment is frequently performed, the history information processing unit 55 causes the history information of the schedule adjustment to be stored (stored) in the history information storage unit 36, and the history information of the schedule adjustment is reflected in the customization information. If a learning function is provided, the efficiency of adjustment work will gradually improve as it is used, and convenience will be further enhanced. In addition, when the above-described priority is changed or new priority conditions are set, by reflecting these in the customization information, inquiries to the user M when performing the same schedule adjustment are reduced. Therefore, the time can be shortened and the burden on the user M can be reduced.

(Embodiment 3)
The basic configuration of the virtual companion system VS of the present embodiment is the same as the configuration of the first embodiment shown in FIG. 1, and other virtual companion systems 7 are assumed as external systems 7 and users of other virtual companion systems VS are assumed. The arithmetic processing means 5 is provided with a function for causing the expression means 2 to express the character in which M (M2) is anthropomorphic together with the virtual companion VC of the user M itself, and the contents of information handled by the arithmetic processing means 5 are different. To do. In short, the arithmetic processing means 5 in this embodiment is a function for obtaining information related to the user M2 of another virtual companion system VS connected via the communication means 4, and character representation data based on the information related to the other user M2. Is added, and the storage means 3 is added with another user information storage unit for holding information related to the other user M2. Since the basic configuration of the virtual companion system VS is the same as that of the first embodiment as described above, illustration and description thereof are omitted.

  Thus, in the present embodiment, since the character that is anthropomorphic of the user M2 of another virtual companion system VS can be expressed and interacted with the expressing means 2 together with the virtual companion VC of the user M (M1), Regardless of the physical distance (and psychological distance) from the user M2, it is possible to exchange information intuitively and directly with other users M2, and to receive support from the virtual companion VC. Therefore, for example, when the virtual companion VC is used as a simultaneous interpretation, it is difficult for the user M1 to feel uncomfortable due to an unnatural time caused by the time required for interpretation (translation), and the words of other users M2 Expressions other than the above, such as facial expressions and gestures, can be transmitted to the user M1 together with the translation, and the interface can be made more natural and easy to use. In addition, when the information regarding the user M2 cannot be obtained, the same usability can be realized by creating a character using the information of the virtual companion VC of the user M2 as an agent of the user M2.

(Embodiment 4)
The basic configuration of the virtual companion system VS of the present embodiment is the same as that of the first embodiment shown in FIG. 1, and the external system 7 includes various devices in the home of the user M (for example, a washing machine, an air conditioner, a refrigerator, Assuming a lighting fixture or the like), the user M can set various devices from whereabouts, and the contents of information handled by the arithmetic processing means 5 are different. Since the basic configuration of the virtual companion system VS is the same as that of the first embodiment as described above, illustration and description thereof are omitted.

  In addition, the virtual companion system VS of the present embodiment has a function that the processing means 5 anthropomorphizes the external system 7 so that the external system 7 can be imaged regardless of its appearance, and causes the expression means 2 to express it together with the virtual companion VC. There is a feature in the point. For example, when the external system 7 is a washing machine at home, the expression means 2 is made to express the character of the laundry person who impersonated the washing machine together with the virtual companion VC. Here, information on the washing machine (for example, what type of washing is available, the current amount of laundry, the relationship between the washing method and the washing time, amount of water used, cost, etc.) and the washing method from the user M And the like are presented to the user M through a conversation between the character who is anthropomorphic of the washing machine and the virtual companion VC. Here, the user M of the virtual companion system VS confirms the mutual interaction between the virtual companion VC and the character displayed on the image display device 21 of the expression means 2 and, if necessary, the virtual companion VC and the character. It is possible to sneak into (that is, interrupt) the dialogue with. As an example, the character asks, “What would you do if it was scrubbing, but what would you do?” And virtual companion VC based on the expression data generated based on the customization information says “Please scrub. To answer. Here, when the user M feels it is difficult to perform scrubbing, the user can change the scrubbing setting to the normal scrubbing setting by instructing the input means 1 with an instruction such as “use normal washing”. When such a change is instructed, the customization information is updated as appropriate. If scrubbing is acceptable, it can be left as it is or input to the effect that scrubbing can be performed.

  In addition, when the user M of the virtual companion system VS wants to move the washing machine, which is one of the external systems 7 in accordance with an instruction from the outside, as in the above-described example, the input means 1 inputs “to wash”, for example. Do. Then, the virtual companion system VS accesses the washing machine, generates data on the form of the laundry and data on the behavior from the model of the laundry based on the acquired API information, and expresses the character of the laundry together with the virtual companion VC. Mean 2 is expressed. At this time, if the current amount of laundry, the candidate for the washing method, the time taken for washing, and the like are obtained as information from the washing machine, the information is sent to the user M as if the character is transmitting the information to the virtual companion VC. Present.

  Further, when the external system 7 is an air conditioner, when the user M gives an instruction to set the air conditioning to an appropriate temperature by the input means 1, the arithmetic processing means 5 converts it into a specific numerical value based on the customization information. Is transmitted to the external system 7 via the communication means 4, but the character is expressed based on the information returned from the external system 7 (for example, the character is displayed and “the cooling temperature is slightly increased It is easier and cheaper to output the voice "), so that user M's real-time needs can be easily reflected when user M changes his mind or when user M makes a new decision. Can improve convenience.

  Thus, in the present embodiment, since the arithmetic processing means 5 has a function of causing the expression means 2 to express the external system 7 as a character that interacts with the user M, the external system 7 can be represented by the user M as with the virtual companion VC. Makes it possible for the user M to feel that the external system 7 is an expert who answers the questions and wishes of the user M, and does not directly operate the device as the external system 7. Since the user M can be operated as if he / she requested a work while consulting with a person, the user interface is easier to use for the user M. Here, if the virtual companion VC is a secretary, the external system 7 is expressed as an anthropomorphic character, making the external system 7 feel like an expert who does each job in each place instead of a device. It becomes possible.

(Embodiment 5)
The present embodiment is different in that a part of the storage means 3 in the virtual companion system VS described in the first embodiment is shared by a server S (see FIG. 11) on the network, and a client / server configuration is adopted. . Since the basic configuration of the virtual companion system VS is the same as that of the first embodiment, illustration and description thereof are omitted.

  In the present embodiment, as shown in FIG. 11, a part of each storage means 3 of the virtual companion system VS of each of the plurality of users M (M1, M2, M3) is shared by the server S. Therefore, the virtual companion system It can be used even if the performance of a terminal used as a VS is relatively low, and by performing data management such as data backup and organization on the server S, both high functionality and stability can be achieved. it can.

  Therefore, in this embodiment, even when the terminal used by the movement of the user M changes variously, the virtual companion VC can be expressed with the optimum performance for each individual terminal, and the processing program of the virtual companion system can be displayed on the server. In addition to being able to download from S to the terminal, data safety is maintained by backup at the server S, so the restrictions on the movement range of the user M are further reduced, and the usability of the user M is increased.

  Furthermore, since data of a large number of virtual companion systems VS can be held in the server S, it becomes easy to share and use information on specific or unspecified virtual companion systems VS to the outside. In this way, you can use various virtual companion systems VS experience, know-how, problem-solving cases, etc., and use a wide range of sensing information (detailed weather maps, temperatures, traffic jams, etc.) It is possible to realize a high-performance user interface function that is difficult in the individual virtual companion system VS, for example, by parallelizing arithmetic processing such as search.

  In short, if the information of the virtual companion system VS can be browsed through the network, a large number of virtual companion systems VS can work together and process individual information to bring in a wide range of situations. Or a method for easily realizing a wide range search using the resources of others. In addition to using resources of many others in this way, advanced calculation processing can be performed at high speed, and various characteristic data of each person and environmental information of various places can be used. The ease of use of M increases.

  In addition, it is possible to construct a new business model by managing the provision of individual resources for a fee and collecting statistical information on resource usage. For example, it is also possible to statistically evaluate the degree of utilization by using identification information (ID) in contrast to providing information to the other person by disclosing all or part of the information related to the personal virtual companion system VS. There may be a system that pays a person a fee or charges a usage fee depending on the amount, quality, activity level, evaluation, etc. of the disclosed information. Moreover, not only as an anonymous virtual companion system VS, but also by using information of the owner of the virtual companion system VS, a request that an enthusiastic fan wants to use a virtual companion VC raised by a celebrity himself. The effect that it can respond and can supply various easy-to-use user interfaces can be expected.

  By the way, in each said embodiment, although the human is employ | adopted as a form of virtual companion VC, the form of virtual companion VC is not restricted to a person, A pet and a robot may be sufficient and the model according to a form is memorize | stored in the memory | storage means 3. You can let it go.

  Note that the virtual companion system VS is a doll-shaped interface as shown in FIG. 12, the serial number of the doll body B serving as a model is user identification information (ID), and the hair (wig) that can be attached to and detached from the doll body B Customization information can be initially set by setting attributes to parts P1, P2,... Such as clothes with RFID tags (RFIDs), barcodes, etc., and wearing desired parts P1, P2,. It is also conceivable to configure this. In this case, the doll body B may be provided with the input means 1, the voice output device, the storage means 3, the arithmetic processing means 5, the communication means 4, and the like.

1 is a system configuration diagram illustrating a first embodiment. It is explanatory drawing of the example of use same as the above. It is explanatory drawing of the memory content of the memory | storage means in the same as the above. It is operation | movement explanatory drawing same as the above. It is operation | movement explanatory drawing same as the above. It is operation | movement explanatory drawing same as the above. It is operation | movement explanatory drawing same as the above. It is explanatory drawing of the memory content of the memory | storage means in the same as the above. It is explanatory drawing of the example of use same as the above. It is an image figure of the example of use same as the above. 10 is an image diagram of a usage example of Embodiment 5. FIG. It is an image figure of the usage example of a reference example.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Input means 2 Representation means 3 Storage means 4 Communication means 5 Arithmetic processing means 6 Network 7 External system

Claims (10)

  Representation means for expressing virtual companions created in virtual space and interacting with users in real space, configuration information of virtual companion templates, identification information for identifying virtual companions, and user-specific customization for virtual companions Storage means for storing information, communication means for enabling information exchange between a plurality of external systems to be accessed, input means for inputting user instructions regarding access to the external system, and at least input means Virtual companion expression data is generated based on data generation information consisting of information received from the external system via the communication means and the model configuration information and customization information read from the storage means in accordance with the input instructions, A virtual companion system comprising as a component an arithmetic processing unit that causes an expression means to represent ON, and a plurality of external systems include a terminal that can be used by a user and has the component, The virtual companion customization information is stored in association with the identification information, and when the input means instructs the transfer from the user to the terminal, the calculation processing means uses the identification information and the customization information associated with the identification information as a template. A virtual companion system capable of being transferred to a terminal via communication means independently of configuration information.   The characteristic information about the representation means is stored in the storage means, and the arithmetic processing means includes characteristic information read from the storage means as the data generation information. Virtual companion system.   The storage means stores the configuration information of each of a plurality of models having different levels of detail, and the arithmetic processing means stores the configuration information according to the characteristic information read from the storage means. 3. The virtual companion system according to claim 2, wherein the selection is made alternatively.   One of the external systems is an external system capable of reflecting the environment information related to the environment around the user to the generation of information to reply to the access source, and environment information acquisition means for acquiring environment information about the environment around the user 4. The apparatus according to claim 1, wherein the arithmetic processing unit is capable of transmitting the environment information acquired by the environment information acquiring unit to the external system via the communication unit. Virtual companion system.   The arithmetic processing means stores the contents of processing performed internally in the storage means as history information, and learns using the history information read from the storage means so that the customization information approaches the user's preference. 5. The virtual companion system according to claim 1, wherein the virtual companion system has a function of changing.   6. At least one of the external systems is another virtual companion system having the same configuration as the virtual companion system according to any one of claims 1 to 5. A virtual companion system according to any of the above.   The arithmetic processing means has a function of acquiring information on other virtual companions in the other virtual companion system via the communication means, a function of storing information on other virtual companions in the storage means, and the storage means The virtual companion system according to claim 6, further comprising: a function for causing the expression means to express another virtual companion based on information related to the other virtual companion read from.   8. The virtual companion system according to claim 1, wherein the arithmetic processing unit has a function of causing the expression unit to express the external system as a character that interacts with the user.   9. The server according to claim 1, further comprising a server connected to the communication unit via a network, wherein the storage unit or the storage unit and the arithmetic processing unit are partially shared by the server. A virtual companion system according to any of the above.   The virtual companion system according to any one of claims 1 to 9, further comprising a management function that allows part of information handled by the arithmetic processing means to be viewed from outside via the communication means. .

Images