JP4131717B2 - Status display method, mobile communication system, and gateway - Google Patents

Description

  The present invention is used for a communication service using a mobile communication terminal such as a mobile phone. In particular, it relates to avatar control technology.

  2. Description of the Related Art Conventionally, there has been provided a web service in which a user registers his / her avatar on a personal dedicated web page and the web page can be browsed by himself and others.

  In addition, the user can change his / her avatar's clothes and hairstyle. In addition, this personal dedicated page can be viewed or edited not only from a PC terminal but also from a mobile phone terminal, and a communication service through an avatar is provided.

  Such services provide satisfaction by creating the user's desired avatar, superiority by showing it to others, or communication between users with similar avatars, etc. .

  As another approach, avatars are also used in mobile TV phones. In a conventional mobile TV phone, there are users who do not want this because their face, the state of the room, etc. can be seen by the communication partner. For this reason, a service has been proposed in which an avatar set by the user is projected on the other party's mobile TV terminal instead of his / her face.

“What is Cafesta”, [online], Powerdcom.inc, [Search May 12, 2004], Internet <URL: http: //www.cafesta.com/main_off.jsp> “Yahoo! Avatar”, [online], Yahoo Japan Corporation, [Search May 12, 2004], Internet <URL: http://avatar.yahoo.co.jp/> “Chara-den”, [online], NTT DoCoMo.Inc, [Search May 12, 2004], Internet <URL: http: //foma.nttdocomo.co.jp/tv/list/chara/tv_chara.html> “TeamFactory”, [online], KDDIau, [Search May 12, 2004], Internet <URL: http://www.au.kddi.com/ezweb/au_dakara/teamfactory/index.html Atsumi Watanabe, Masako Ito, “Birth of Warm Communication“ Connection Communication ””, Kyoritsu Shuppan, July 2003 JP 2002-314963 A JP 2002-314707 A JP 2002-307338 A

  In a service using a conventional avatar, the user needs to create his / her avatar and change the state of the avatar. For example, in a service for reflecting one's own state on an avatar, it is necessary to explicitly reflect one's own state such as a free state, a meeting, or moving on the one's avatar.

  Therefore, when the user neglects an operation for reflecting his / her state on the avatar, a state different from the actual state of the user is transmitted to the third party. In general, since the state such as a meeting or moving is a busy state for the user, there are many cases in which an operation for reflecting the user's state on the avatar is neglected, and the role of the avatar can be fully exhibited. Can not.

  The present invention is made in such a background, and can automatically grasp the user's state and reflect it in the avatar. In this case, the actual state and the avatar in the user are reflected. It is an object of the present invention to provide not only a service that allows a user to adjust the state to be performed among a plurality of mobile communication terminals but also a non-mobile communication terminal.

  The present invention is characterized in that, based on information obtained from a mobile communication terminal such as a mobile phone, the state of a user who is the owner of the mobile communication terminal is grasped and reflected in an avatar. At this time, if the state of the user is reflected in the avatar in detail as it is, the detailed state of the user will be unobtrusive to a third party. There are few users who welcome such an unplugged state, and many users rather want to keep a part of their state secret.

  Therefore, the present invention is characterized in that information representing the user's state can be converted into ambiguous information within a range desired by the user and reflected on the avatar.

  Furthermore, the service of the present invention can be provided not only between a plurality of mobile communication terminals but also including non-mobile communication terminals.

  That is, the first aspect of the present invention is inferred from the step of inferring the current state of the owner of the mobile communication terminal based on detection information detected by a plurality of state detection means provided in the mobile communication terminal. Generating control information for controlling the shape or behavior of the avatar based on the state of the owner, and controlling the shape or behavior of the avatar based on the generated control information. This is a state display method in which information of other mobile communication terminals to be shared is determined in advance and the detection information is distributed to the other mobile communication terminals.

  Here, the feature of the present invention is that, in addition to the other mobile communication terminal, information of a non-mobile communication terminal that shares the detection information is determined in advance, and the detection information is used as the non-mobile communication terminal. When executing the step of distributing to the non-mobile communication terminal after the gateway that receives the authentication request including the device ID and the user ID from the non-mobile communication terminal and executes the user authentication succeeds in the user authentication of the non-mobile communication terminal. The step of delivering the detection information to the non-mobile communication terminal is performed (claim 1).

  Thereby, since a user's state can be automatically grasped and reflected in an avatar, a user's state can be correctly reflected in an avatar, without waiting for a user's operation. In addition, it is possible to transmit the state of oneself to a third party by an avatar. At this time, even in non-mobile communication terminals other than those between the same mobile communication terminals, its own state can be transmitted by the avatar.

  The second aspect of the present invention is inferred by a plurality of state detection means, a means for inferring the current state of the owner of the mobile communication terminal based on detection information from the state detection means, and the inference means. Means for generating control information for controlling the shape or behavior of the avatar based on the state of the owner, and means for controlling the shape or behavior of the avatar based on the control information generated by the means for generating A mobile communication terminal, and a server connected to the mobile communication terminal via a communication line, the server holding information of another mobile communication terminal that shares the detection information; Means for referring to the held information of the other mobile communication terminal and distributing the detection information to the other mobile communication terminal, wherein the mobile communication terminal transmits the detection information to the service information. Is a mobile communication system comprising means for transferring the.

  Here, the present invention is characterized in that the service includes means for holding information of a non-mobile communication terminal sharing the detection information in addition to the mobile communication terminal, and the non-mobile communication The terminal includes means for sending an authentication request including a device ID and a user ID, and a gateway for receiving the authentication request and executing user authentication is provided, and the server is a user of the non-mobile communication terminal. After the authentication is successful, there is provided means for distributing the detection information to the non-mobile communication terminal (claim 2).

  A third aspect of the present invention is a gateway provided in the mobile communication system of the present invention, comprising a means for receiving an authentication request including a device ID and a user ID from the non-mobile communication terminal and executing user authentication (Claim 3).

  Alternatively, the state display method of the present invention is inferred from the step of inferring the current state of the owner of the mobile communication terminal based on detection information detected by a plurality of state detection means provided in the mobile communication terminal. Generating control information for controlling the shape or behavior of the avatar based on the state of the owner, and controlling the shape or behavior of the avatar based on the generated control information; A plurality of corresponding control patterns of the shape or behavior of the avatar are provided, and prior to execution of the step of generating the control information, a step of selecting any one of the control patterns, and the control information based on the selection result Information of other mobile communication terminals that share the control information is determined in advance, and the control information is Which is a state display method of performing the step of delivering to the other mobile communication terminal.

  Here, a feature of the present invention is that, in addition to the other mobile communication terminal, information of a non-mobile communication terminal that shares the control information is determined in advance, and the control information is transferred to the non-mobile communication terminal. When executing the step of distributing to the non-mobile communication terminal after the gateway that receives the authentication request including the device ID and the user ID from the non-mobile communication terminal and executes the user authentication succeeds in the user authentication of the non-mobile communication terminal. The step of delivering the control information to the non-mobile communication terminal is performed (claim 4).

  Thus, in the present invention, the control pattern of the shape or behavior of the avatar corresponding to the same state is not a single pattern but a plurality of patterns are provided. For example, in the case of notifying the position of the owner, (1) a pattern displaying a detailed address, (2) a pattern displaying a town name, (3) a pattern displaying a prefecture name, etc. Patterns are prepared, and these patterns can be selected according to the policy of the owner. Once the setting is completed, the avatar is automatically controlled after that, so it is not necessary to change the avatar setting every time the state changes, and the convenience can be improved. . In addition, it is possible to transmit the state of oneself to a third party by an avatar. At this time, even in non-mobile communication terminals other than those between the same mobile communication terminals, its own state can be transmitted by the avatar.

  Alternatively, the mobile communication system of the present invention infers the current state of a mobile communication terminal provided with a plurality of state detection means and the owner of the mobile communication terminal based on detection information from the state detection means. Means and a server comprising means for generating control information for controlling the shape or behavior of the avatar based on the state of the owner inferred by the inferring means, and the mobile communication terminal includes the control Means for controlling the shape or behavior of the avatar based on the information, a plurality of control patterns for the shape or behavior of the avatar corresponding to the same state are provided, and the means for generating the control information is the generation of the control information Prior to this, information for selecting one of the control patterns is received from the mobile communication terminal and held, and the control is performed based on the selected information. Means for generating information, wherein the mobile communication terminal comprises means for transmitting the information to be selected to the server, and the server holds information of other mobile communication terminals sharing the control information A mobile communication system comprising: means; and means for distributing the control information to the other mobile communication terminal by referring to the information of the other mobile communication terminal held in the holding means.

  Here, a feature of the present invention is that, in addition to the other mobile communication terminal, the server includes means for holding information of a non-mobile communication terminal that shares the control information, and the non-mobile body The communication terminal includes means for sending an authentication request including a device ID and a user ID, and a gateway for receiving the authentication request and executing user authentication is provided. The server is configured such that the gateway is the non-mobile communication terminal. A means for delivering the control information to the non-mobile communication terminal after successful user authentication is provided.

  Alternatively, the gateway of the present invention is provided in the mobile communication system, and includes means for receiving an authentication request including a device ID and a user ID from the non-mobile communication terminal and executing user authentication (Claim 6). .

  According to the present invention, the user's state can be automatically grasped and reflected in the avatar, and at this time, the user can adjust the actual state of the user and the state reflected in the avatar. Services that can be provided can be provided not only among a plurality of mobile communication terminals but also including non-mobile communication terminals.

(First Example)
A mobile communication system according to the first embodiment will be described with reference to FIGS. FIG. 1 is an overall configuration diagram of a mobile communication system according to a first embodiment. FIG. 2 is a flowchart showing the operation of the non-mobile communication terminal of the first embodiment. FIG. 3 is a flowchart showing the operation of the gateway of the first embodiment. FIG. 4 is a block diagram of the mobile communication terminal of the first embodiment. FIG. 5 is a block diagram of the program execution unit of the first embodiment. In these block configuration diagrams, illustrations other than the functional blocks necessary for the description of the present embodiment are omitted. FIG. 6 is a flowchart showing the detection information distribution procedure of the first embodiment.

  A state display method in the mobile communication system of the present embodiment will be described with reference to FIGS. The status display method of the present embodiment includes a GPS unit 1, a call detection unit 2, a packet communication analysis unit 3, a voice recognition unit 4, an acceleration sensor 5, and a terminal, which are a plurality of status detection means provided in the mobile communication terminal 20-1 Based on the detection information detected by the operation detection unit 6 and the charge detection unit 7, the step of inferring the current state of the owner of the mobile communication terminal 20-1 and the avatar's state based on the inferred state of the owner The other mobile communication terminal 20-2 that executes the step of generating control information for controlling the shape or behavior and the step of controlling the shape or behavior of the avatar based on the generated control information and shares the detection information Is a state display method for executing the step of distributing the detection information to the other mobile communication terminal 20-2.

  Here, the feature of the present embodiment is that, in addition to the other mobile communication terminal 20-2, information of the non-mobile communication terminal 50 sharing the detection information is determined in advance, and the detection information is When executing the step of delivering to the mobile communication terminal 50, the gateway 40 that receives the authentication request including the device ID and the user ID from the user authentication device 51 of the non-mobile communication terminal 50 and executes user authentication After successful user authentication of the non-mobile communication terminal 50, the step of delivering the detection information to the non-mobile communication terminal 50 is performed (Claim 1).

  The server 30 is provided with a user management database 23 in which information of the mobile communication terminal 20-2 and the non-mobile communication terminal 50 that share detection information with the mobile communication terminal 20-1 is recorded.

  Further, the server 30 and the gateway 40 are provided with user authentication units 21 and 41 and detection information distribution units 22 and 42, respectively, which are executed between the mobile communication terminals 20-1 and 20-2 and the server 30. The user authentication corresponding to the user authentication is performed between the user authentication device 51 provided in the non-mobile communication terminal 50 and the user authentication unit 41 provided in the gateway 40.

  When the user authentication is successful, the detection information of the mobile communication terminal 20-1 is distributed to the non-mobile communication terminal 50 by the detection information distribution units 22 and 42.

  That is, as shown in FIG. 2, when receiving the avatar display request from the non-mobile communication terminal 50 (S1), the user authentication device 51 sends out the device ID and the user ID to the gateway 40 (S2). As a result, if the user authentication is successful, detection information is distributed from the gateway 40, and the non-mobile communication terminal 50 generates avatar control information (S4) and displays an avatar (S5). However, when the detection information is not distributed (S3), retry is performed a predetermined number of times (S6). If the detection information is still not distributed after a predetermined number of retries, it is expected that some trouble has occurred in the mobile communication terminal 20-1 or the server 30, so the non-mobile communication terminal 50 A connection impossible message is displayed (S7).

  On the other hand, as shown in FIG. 3, the user authentication unit 41 of the gateway 40 receives the device ID and the user ID as an authentication request from the non-mobile communication terminal 50 (S10), and searches the user management database 23 (S11). As a result, when the corresponding device ID and user ID are searched and authentication is successful (S12), the detection information distribution unit 42 distributes the detection information of the mobile communication terminal 20-1 to the non-mobile communication terminal 50. (S13). When the authentication fails (S12), the non-mobile communication terminal 50 is notified that connection is not possible (S14).

  Thereby, the owner's state of the mobile communication terminal 20-1 can be transmitted to the owners of the mobile communication terminal 20-2 and the non-mobile communication terminal 50 using the avatar. Similarly, the state of the owner of the mobile communication terminal 20-2 can be transmitted to the owner of the mobile communication terminal 20-1 using an avatar.

  In the present embodiment, two mobile communication terminals 20-1 and 20-2 and one non-mobile communication terminal 50 are illustrated, but between three or more mobile communication terminals or a plurality of non-mobile communication terminals Similarly, the owner status of one mobile communication terminal can be transmitted to other predetermined mobile communication terminals and non-mobile communication terminal owners using avatars.

  As shown in FIGS. 4 and 5, the mobile communication system of the present invention includes a GPS unit 1, a call detection unit 2, a packet communication analysis unit 3, a voice recognition unit 4, an acceleration sensor 5, The mobile communication terminal 20-1 including the terminal operation detection unit 6 and the charging detection unit 7 is provided. In the user real-time information database 9, the user information collection unit 8 collects various information from a plurality of state detection means. Detection information is stored. Further, the communication function unit 13 transmits this detection information to the server 30.

  The program execution unit 11 infers the current state of the owner of the mobile communication terminal 20-1 based on the detection information, and the state of the owner inferred by the state inference unit 14. A state information generation unit 15 that generates state information to be expressed, and a control information generation unit 16 that generates control information for controlling the shape or behavior of the avatar based on the state information generated by the state information generation unit 15 are provided.

  Further, the program execution unit 11 controls the shape or behavior of the avatar based on the control information and the user basic information stored in the user basic information database 10 and displays it on the display 12. The user basic information includes, for example, a user ID, information for authenticating the user (password, fingerprint information, etc.), the type of avatar used by the user, and the like.

  A server 30 connected to the mobile communication terminals 20-1 and 20-2 via a communication line is provided, and this server 30 has information on the other mobile communication terminal 20-2 sharing the detection information in the user management database 23. And means for referring to the information of the other mobile communication terminal 20-2 held in the means for holding and distributing the detection information to the other mobile communication terminal 20-2.

  Here, the feature of the present embodiment is that the server 30 includes a user management database that stores information on the non-mobile communication terminal 50 sharing the detection information in addition to the mobile communication terminal 20-2. 23, the non-mobile communication terminal 50 includes a user authentication device 51 that transmits authentication information including a device ID and a user ID, and is provided with a gateway 40 that receives the authentication request and executes user authentication. 30 includes a detection information distribution unit 42 that distributes the detection information to the non-mobile communication terminal 50 after the gateway 40 succeeds in user authentication of the non-mobile communication terminal 50. 2, 3).

  The non-mobile communication terminal 50 is, for example, a PC (personal computer). Moreover, this PC shall be equipped with the function corresponding to the function with which the mobile communication terminals 20-1 and 20-2 are provided as a function for displaying an avatar.

  The detection information distribution procedure will be described with reference to the flowchart of FIG. As shown in FIG. 6, basic user information is set in the basic user database 10 (S20). The user basic information is transferred to the server 30 via the communication function unit 13 under the control of the program execution unit 11, and then distributed to the other mobile communication terminal 20-2 and the non-mobile communication terminal 50 (S21). This basic user information includes, for example, a user ID, information for authenticating the user (password, fingerprint information, etc.), the type of avatar used by the user, and the like.

  The user information collection unit 8 collects detection information (S22). The user real-time information database 9 is constructed from this detection information (S23).

  Based on the detection information stored in the user real-time information database 9, the state inference unit 14, the state information generation unit 15, and the control information generation unit 16 of the program execution unit 11 generate avatar control information to control the avatar, and display The state of the owner is reflected in the avatar on 12 (S24).

  On the other hand, the detection information is transmitted to the server 30 by the communication function unit 13 (S25). The server 30 transmits the detection information to the user's previously registered mobile communication terminal 20-2 and non-mobile communication terminal 50 (S26). When the mobile communication terminal 20-2 and the non-mobile communication terminal 50 receive the detection information of the mobile communication terminal 20-1 from the server 30, the mobile communication terminal 20-2 generates control information of the avatar to control the avatar, and The state of the owner of the mobile communication terminal 20-1 is reflected on the avatar (S27).

  In addition, when the mobile communication terminals 20-1 and 20-2 have a function of performing direct communication, the mobile communication terminals 20-1 and 20-2 can be used in addition to the exchange of detection information via the server 30. -2 can be exchanged directly with -2.

  The present embodiment can be implemented as a program that, when installed in a general-purpose information processing apparatus, causes the information processing apparatus to realize functions corresponding to the mobile communication terminal of the present embodiment. This program is recorded on a recording medium and installed in the information processing apparatus, or installed in the information processing apparatus via a communication line, so that the user information collecting unit 8, the user real-time information database 9, Functions corresponding to the user basic information database 10 and the program execution unit 11 can be realized.

  Hereinafter, this embodiment will be described in more detail.

  The service proposed in the present embodiment automatically reflects the behavior of the user who is the owner of the terminal obtained from the various sensors of the mobile communication terminal 20-1 in the avatar, and is registered in advance. The behavior of the owner of the mobile communication terminal 20-1 is automatically reflected in the avatars of the mobile communication terminal 20-2 and the non-mobile communication terminal 50.

  Information acquired from various sensors of the user's mobile communication terminal 20-1 will be described. The information acquired from the various sensors of the user's mobile communication terminal 20-1 is information that allows the user's current behavior to be understood.

  As an example, examples of information acquired by the GPS unit 1 include a user's current position and moving speed. Information acquired from the call detection unit 2 includes the presence / absence of a current call or a call partner. The information obtained from the packet communication analysis unit 3 is information obtained by analyzing a packet such as the presence / absence of current packet communication, identification of whether mail transmission / reception or web browsing is being performed by a browser, or identification of a connection site. The information that can be acquired from the voice recognition unit 4 is the user's emotions assumed from the conversation speed, sound pressure, etc. of the user. The information that can be acquired from the acceleration sensor 5 is the user's acceleration. That is, when the user collides with an object or falls, the acceleration changes suddenly, so that such a state can be detected. Information that can be acquired by the terminal operation detection unit 6 is a user's key operation. In addition to these pieces of information, the charging detector 7 can obtain information such as whether charging is in progress as information of the mobile communication terminal 20-1.

(Second embodiment)
As a second embodiment, an example of control information generation based on detection information from the GPS unit 1 will be described with reference to a flowchart of FIG. The control information generation unit 16 generates control information as shown in FIG. 7 based on the detection information sent from the GPS unit 1. The program execution unit 11 controls the shape or behavior of the avatar based on this control information. An example of the shape or behavior of this avatar is shown in FIG.

  In addition, the program execution part 11 processes similarly about the detection information sent from the other mobile communication terminal 20-2, and displays the state of the owner of the other mobile communication terminal 20-2 on its display 12 as an avatar. Can be displayed as

  Detection information from the GPS unit 1 is input to the state inference unit 14 to infer whether or not the user is moving and the moving speed if the user is moving. The inference result is input to the state information generation unit 15, and state information that can be recognized by the control information generation unit 16 is generated.

  In the present embodiment, the state inference unit 14, the state information generation unit 15, and the control information generation unit 16 are illustrated as separate blocks for ease of explanation, but the state inference unit 14 and the state information generation unit are illustrated. Reference numeral 15 denotes an internal function of the control information generation unit 16, and it is not necessary to separately provide blocks. The same applies to the following embodiments.

  As illustrated in FIG. 7, the control information generation unit 16 acquires state information based on the detection information of the GPS unit 1 from the state information generation unit 15 (S30), and recognizes the current state of the user. When there is no movement (S31), there is no change in the avatar (S38). If there is movement (S31), the movement speed information is extracted (S32), and if the movement speed is 4 km / h or less, control information “walking avatar” is generated as shown in FIG. S33). If the moving speed is 10 km / h or less, control information “run avatar” is generated as shown in FIG. 8B (S34). If the moving speed is 10 km / h or more and the same route as that of the public transportation means (train) is followed (S35), it means that the public transportation means (train) is used, so that FIG. ), Control information “get on the avatar train” is generated (S36). Also, if the moving speed is 10 km / h or more and it does not follow the same route as the public transportation means (train) (S35), it uses a transportation means (automobile) other than the public transportation means (train). Therefore, as shown in FIG. 8D, control information “get on the avatar car” is generated (S37). In addition, a display indicating the moving direction or a display indicating the current position such as an address can be displayed on each avatar display.

(Third embodiment)
As a third embodiment, an example of control information generation based on detection information from the speech recognition unit 4 will be described with reference to a flowchart of FIG. The control information generation unit 16 generates control information as shown in FIG. 9 based on the detection information sent from the voice recognition unit 4. The program execution unit 11 controls the shape or behavior of the avatar based on this control information. An example of the shape or behavior of this avatar is shown in FIG.

  In addition, the program execution part 11 processes similarly about the detection information sent from the other mobile communication terminal 20-2, and displays the state of the owner of the other mobile communication terminal 20-2 on its display 12 as an avatar. Can be displayed as

  Detection information from the voice recognition unit 4 is input to the state inference unit 14 to infer the sound pressure and conversation speed during the user's call. The inference result is input to the state information generation unit 15, and state information that can be recognized by the control information generation unit 16 is generated.

  As shown in FIG. 9, the control information generation unit 16 acquires state information based on the detection information of the voice recognition unit 4 from the state information generation unit 15 (S40), and recognizes the current state of the user.

  The control information generation unit 16 holds the previous sound pressure and conversation speed information, and compares this with the current sound pressure and conversation speed information to extract changes (S41). As a result, if there is no change (S42), the avatar is also left unchanged (S43). If the sound pressure and the conversation speed are higher than the previous time (S42), it is understood that the user is in an excited state compared to the previous time. Further, the degree of excitement is classified based on the degree of change in sound pressure and conversation speed (S45), and when the degree of excitement is small, control information “avatar excitement (small)” is generated as shown in FIG. (S48). When the degree of excitement is medium, control information “avatar excitement (medium)” is generated as shown in FIG. 10B (S47). If the degree of excitement is large, control information “Avatar excitement (large)” is generated as shown in FIG. 10C (S46). Further, if the sound pressure and the conversation speed are lower than the previous time (S42), it is understood that the user is in a calm state compared to the previous time, so as shown in FIG. Control information "Avatar calm" is generated (S44).

(Fourth embodiment)
As a fourth embodiment, an example of control information generation based on detection information from the communication detection unit 2, the packet communication analysis unit 3, and the terminal operation detection unit 6 will be described with reference to the flowchart of FIG. The control information generation unit 16 generates control information as shown in FIG. 11 based on the detection information transmitted from the communication detection unit 2, the packet communication analysis unit 3, and the terminal operation detection unit 6. The program execution unit 11 controls the shape or behavior of the avatar based on this control information received by the communication function unit 13. An example of the shape or behavior of this avatar is shown in FIG.

  In addition, the program execution part 11 processes similarly about the detection information sent from the other mobile communication terminal 20-2, and displays the state of the owner of the other mobile communication terminal 20-2 on its display 12 as an avatar. Can be displayed as

  Detection information from the communication detection unit 2, the packet communication analysis unit 3, and the terminal operation detection unit 6 is input to the state inference unit 14 to infer the user's call state, packet communication state, and terminal operation state, respectively. The inference result is input to the state information generation unit 15, and state information that can be recognized by the control information generation unit 16 is generated.

  As shown in FIG. 11, the control information generation unit 16 acquires state information based on the detection information of the communication detection unit 2, the packet communication analysis unit 3, and the terminal operation detection unit 6 from the state information generation unit 15 (S50). The user's current call state, packet communication state, and terminal operation state are recognized (S51).

  As a result, if all calls, packet communications, and terminal operations are not frequent (S52), control information “Avatar doze” is generated as shown in FIG. 12A (S56). If there are many calls (S53), control information “Avatar on call” is generated as shown in FIG. 12B (S57). If there are many packet communications (S54) and the communication destination is a game site (S55), control information “Avatar game in progress” is generated as shown in FIG. 12D (S59). If the notification destination is mail (S55), control information “Avatar mail is in progress” is generated as shown in FIG. 12E (S60). If the communication destination is Web browsing (S55), control information “Avatar Web browsing in progress” is generated as shown in FIG. 12F (S61).

(Fifth embodiment)
As a fifth embodiment, an example of control information generation based on detection information from the GPS unit 1 and the acceleration sensor 5 will be described with reference to a flowchart of FIG. The control information generating unit 16 generates control information as shown in FIG. 13 based on the detection information sent from the GPS unit 1 and the acceleration sensor 5. The program execution unit 11 controls the shape or behavior of the avatar based on this control information received by the communication function unit 13. An example of the shape or behavior of this avatar is shown in FIG.

  In addition, the program execution part 11 processes similarly about the detection information sent from the other mobile communication terminal 20-2, and displays the state of the owner of the other mobile communication terminal 20-2 on its display 12 as an avatar. Can be displayed as

  Detection information from the GPS unit 1 and the acceleration sensor 5 is respectively input to the state inference unit 14 to infer the user's moving speed and acceleration state. The inference result is input to the state information generation unit 15, and state information that can be recognized by the control information generation unit 16 is generated.

  As illustrated in FIG. 13, the control information generation unit 16 acquires state information based on detection information of the GPS unit 1 and the acceleration sensor 5 from the state information generation unit 15 (S70), and obtains the current moving speed and acceleration of the user. Recognize each (S71).

  As a result, if there is no sudden acceleration change (S72), control information “no avatar change” is generated (S75). Alternatively, even if there is a sudden change in acceleration (S72), if there is no change in the moving speed (S73), control information “no avatar change” is generated (S75).

  If there is a sudden acceleration change (S72) and the moving speed indicates a stop (S73), it can be determined that the probability that the user has collided with or fell over the object is high. At this time, it can be inferred that the larger the moving speed immediately before the stop, the larger the accident, and accordingly, according to the moving speeds “high”, “medium”, and “small” immediately before the stop, respectively, FIG. ) Control information “Avatar accident (large)”, “avatar accident (medium)” as shown in FIG. 14B, and “avatar accident (small)” as shown in FIG. 14 (a). Each is generated (S76, S77, S78).

(Sixth embodiment)
A mobile communication system according to the sixth embodiment will be described with reference to FIGS. FIG. 15 is an overall configuration diagram of the mobile communication system of the sixth embodiment. FIG. 16 is a block diagram of the mobile communication terminal of the sixth embodiment. FIG. 17 is a block diagram of the server of the sixth embodiment. In these block configuration diagrams, illustrations other than the functional blocks necessary for the description of the present embodiment are omitted. The block configuration of the server 30 in FIG. 17 corresponds to the block configuration of the control information distribution unit 24 in FIG.

  A state display method in the mobile communication system of the present embodiment will be described with reference to FIGS. The mobile communication terminal 20-1 includes a GPS unit 1, a call detection unit 2, a packet communication analysis unit 3, a voice recognition unit 4, an acceleration sensor 5, a terminal operation detection unit 6, a charge, which are a plurality of state detection units provided in the mobile communication terminal 20-1. The step of inferring the current state of the owner of the mobile communication terminal 20-1 based on the detection information of the middle detection unit 7, and the control for controlling the shape or behavior of the avatar based on the inferred state of the owner Performing a step of generating information and a step of controlling the shape or behavior of the avatar based on the generated control information, and a plurality of control patterns of the shape or behavior of the avatar corresponding to the same state are provided, Prior to execution of the step of generating the control information, a step of selecting one of the control patterns and a step of generating the control information based on the selection result. Status display for executing the step of distributing the control information to the other mobile communication terminal 20-2, the information of the other mobile communication terminal 20-2 sharing the control information being determined in advance Is the method.

  Here, the feature of this embodiment is that, in addition to the other mobile communication terminal 20-2, information of the non-mobile communication terminal 50 sharing the control information is determined in advance, and the control information is transferred to the non-mobile communication terminal 20-2. When executing the step of distributing to the mobile communication terminal 50, the gateway 40 that receives the authentication request including the device ID and the user ID from the non-mobile communication terminal 50 and executes the user authentication is the non-mobile communication terminal. After successful 50 user authentication, the control information is distributed to the non-mobile communication terminal 50 (Claim 4).

  As shown in FIGS. 16 and 17, the mobile communication system of the present embodiment includes a GPS unit 1, a call detection unit 2, a packet communication analysis unit 3, a voice recognition unit 4, and an acceleration sensor 5 as a plurality of state detection means. The mobile communication terminal 20-1 including the terminal operation detection unit 6 and the charge detection unit 7 is provided. In the user real-time information database 9, the user information collection unit 8 collects various information from a plurality of state detection means. Detection information is stored.

  Further, the communication function unit 13 transmits this detection information to the server 30. The server 30 is a state inference unit 31 that infers the current state of the owner of the mobile communication terminal 20-1 based on the detection information, and a state that represents the state of the owner inferred by the state inference unit 31. A state information generation unit 32 that generates information, and a control information generation unit 33 that generates control information for controlling the shape or behavior of the avatar based on the state information generated by the state information generation unit 32 are provided.

  Further, the mobile communication terminals 20-1 and 20-2 execute a program for controlling the shape or behavior of the avatar based on the control information and the user basic information stored in the user basic information database 10 and displaying it on the display 12. The unit 11 is provided. The user basic information includes, for example, a user ID, information for authenticating the user (password, fingerprint information, etc.), the type of avatar used by the user, and the like.

  Furthermore, a plurality of control patterns of the shape or behavior of the avatar based on the same state information are provided, and the correspondence relationship between these control patterns and the state information is stored in the abstraction database 35, and the control information generation unit 33 Prior to generation of the control information, a selection information holding unit 34 that receives and holds information for selecting any one of the control patterns from the mobile communication terminal 20-1, and the control information based on the selected information. The mobile communication terminal 20-1 includes a selection information transmission unit 25 that transmits information to be selected to the server 30 by the communication function unit 31.

  Further, the server 30 stores the user management database 23 that holds the information of the other mobile communication terminal 20-2 that shares the control information, and the information of the other mobile communication terminal 20-2 that is held in the user management database 23. It is a mobile communication system provided with the means to refer and distribute the said control information to the said other mobile communication terminal 20-2.

  Here, the feature of this embodiment is that the user management database 23 of the server 30 holds information on the non-mobile communication terminal 50 sharing the control information in addition to the other mobile communication terminal 20-2. The non-mobile communication terminal 50 includes a user authentication device 51 that transmits an authentication request including a device ID and a user ID, and is provided with a gateway 40 that receives the authentication request and executes user authentication. The server 30 includes a control information relay unit 43 that distributes the control information to the non-mobile communication terminal 50 after the user authentication unit 41 of the gateway 40 succeeds in user authentication of the non-mobile communication terminal 50. (Claims 5 and 6).

  Thereby, the owner's state of the mobile communication terminal 20-1 can be transmitted to the owners of the mobile communication terminal 20-2 and the non-mobile communication terminal 50 using the avatar. Similarly, the owner's state of the mobile communication terminal 20-2 can be transmitted to the owners of the mobile communication terminal 20-1 and the non-mobile communication terminal 50 using an avatar.

  In the present embodiment, two mobile communication terminals 20-1 and 20-2 and one non-mobile communication terminal 50 are illustrated, but a plurality of non-mobile communication between three or more mobile communication terminals Similarly, the terminal can transmit the state of the owner of one mobile communication terminal to other predetermined mobile communication terminals and non-mobile communication terminal owners using an avatar.

  Hereinafter, this embodiment will be described in more detail.

  The service proposed in the present embodiment is transmitted from the mobile communication terminal 20-1 to the server 30 and the action of the user who is the owner of the terminal is abstracted from detailed information in the server 30. This abstracted information is transmitted to an arbitrary mobile communication terminal 20-2 and non-mobile communication terminal 50 after being converted into information.

  A major feature of the function of the server 30 of this embodiment is that the control information generating unit 33 has a function of converting detailed real-time data transmitted from the mobile communication terminal 20-1 into ambiguous data in the server 30. Is a point.

  Information acquired from the user's mobile communication terminal 20-1 will be described. The information acquired from the user's mobile communication terminal 20-1 is information that allows the user's current behavior to be understood.

  As an example, examples of information acquired by the GPS unit 1 include a user's current position and moving speed. Information acquired from the call detection unit 2 includes the presence / absence of a current call or a call partner. The information obtained from the packet communication analysis unit 3 is information obtained by analyzing a packet such as the presence / absence of current packet communication, identification of whether mail transmission / reception or web browsing is being performed by a browser, or identification of a connection site. The information that can be acquired from the voice recognition unit 4 is the user's emotions assumed from the conversation speed, sound pressure, etc. of the user. Information that can be acquired from the acceleration sensor 5 is the acceleration of the user.

  That is, when the user collides with an object or falls, the acceleration changes suddenly, so that such a state can be detected. Information that can be acquired by the terminal operation detection unit 6 is a user's key operation. In addition to these pieces of information, the charging detector 7 can obtain information such as whether charging is in progress as information of the mobile communication terminal 20-1.

  If the detailed data as described above is transferred as it is to the other party's mobile communication terminal 20-2 and the non-mobile communication terminal 50, detailed data such as the user's current position and key operation will be lost to the other party. Although this service is characterized by the fact that the other party's status is known, it is generally considered that the user dislikes a situation in which his / her detailed information is unclear to a third party.

  For the above reasons, the server 30 obtains part or all of the detailed information transferred from the mobile communication terminal 20-1, and then abstracts it by the control information generation unit 33. At this time, the correspondence between detailed user information and ambiguous user information obtained by abstracting this is stored in the abstract database 35. The control information generation unit 33 makes an inquiry to the selection information holding unit 34 to know what kind of ambiguous information should be generated.

  In addition, the selection information holding | maintenance part 34 needs to hold | maintain the selection information from the user of the mobile communication terminal 20-1 beforehand. The user registers in advance in the selection information holding unit 34 a policy regarding how much his state is to be ambiguously converted as selection information.

  The registration method can individually register policies of each ambiguity such as location information, emotion information, movement information, busyness information, etc. In addition to that, specify the overall ambiguity level. The individual ambiguity setting can be automatically determined by the control information generator 33. For example, the ambiguity is classified and set as “high”, “medium”, and “low”. That is, the degree of ambiguity “high” means that it is more ambiguous than “low”.

(Seventh embodiment)
As a seventh embodiment, an example of control information generation based on detection information from the GPS unit 1 will be described with reference to a flowchart of FIG. The control information generation unit 33 generates control information as shown in FIG. 7 based on the detection information sent from the GPS unit 1. The program execution unit 11 controls the shape or behavior of the avatar based on this control information received by the communication function unit 13. An example of the shape or behavior of this avatar is shown in FIG.

  Detection information from the GPS unit 1 is input to the state inference unit 31 to infer whether or not the user is moving and the moving speed if the user is moving. The inference result is input to the state information generation unit 32, and state information that can be recognized by the control information generation unit 33 is generated.

  In the present embodiment, the state inference unit 31, the state information generation unit 32, and the control information generation unit 33 are illustrated as separate blocks in order to make the description easy to understand. However, the state inference unit 31 and the state information generation unit 32 is an internal function of the control information generation unit 33, and it is not necessary to provide separate blocks. The same applies to the following embodiments.

  As illustrated in FIG. 7, the control information generation unit 33 acquires state information based on the detection information of the GPS unit 1 from the state information generation unit 32 (S30), and recognizes the current state of the user. When there is no movement (S31), there is no change in the avatar (S38). If there is movement (S31), the movement speed information is extracted (S32), and if the movement speed is 4 km / h or less, control information “walking avatar” is generated as shown in FIG. S33). If the moving speed is 10 km / h or less, control information “run avatar” is generated as shown in FIG. 8B (S34). If the moving speed is 10 km / h or more and the same route as that of the public transportation means (train) is followed (S35), it means that the public transportation means (train) is used, so that FIG. ), Control information “get on the avatar train” is generated (S36). Also, if the moving speed is 10 km / h or more and it does not follow the same route as the public transportation means (train) (S35), it uses a transportation means (automobile) other than the public transportation means (train). Therefore, as shown in FIG. 8D, control information “get on the avatar car” is generated (S37). In addition, a display indicating the moving direction or a display indicating the current position such as an address can be displayed on each avatar display.

  Here, as a feature of the present embodiment, a part of the flowchart shown in FIG. 7 can be invalidated according to the selection information from the user held in the selection information holding unit 34. For example, when the ambiguous policy registered by the user is “medium”, the flow (S35, S36, S37) in the portion surrounded by the broken line in FIG. 7 is invalidated. In addition, the branch condition “less than 10 km / h” in step S12 is changed to “over 4 km / h”.

  As a result, as the display by the avatar, only two of “Avatar walk” or “Avatar run” are displayed according to the moving speed of the user (threshold value 4 km / h), and “Avatar train ride” and “Avatar car” “Ride” is not displayed.

  When the ambiguous policy registered by the user is “high”, the flow (S32, S34 to S37) in the portion surrounded by the one-dot chain line in FIG. 7 is invalidated. Further, the YES branch of step S31 is directly connected to step S33. Thereby, as the display by the avatar, only “walking avatar” is displayed regardless of the moving speed as the user moves.

  In addition, when displaying information on the current position of the user together with each avatar display, if the policy is “low”, a detailed address is displayed according to the ambiguous policy registered by the user. If "", the name of the town can be displayed, and if the policy is "High", the name of the prefecture can be displayed.

(Eighth Example)
As an eighth embodiment, an example of control information generation based on detection information from the speech recognition unit 4 will be described with reference to the flowchart of FIG. The control information generation unit 33 generates control information as shown in FIG. 9 based on the detection information sent from the voice recognition unit 4. The program execution unit 11 controls the shape or behavior of the avatar based on the control information received by the communication function unit 13. An example of the shape or behavior of this avatar is shown in FIG.

  Detection information from the voice recognition unit 4 is input to the state inference unit 31 to infer the sound pressure and conversation speed during the user's call. The inference result is input to the state information generation unit 32, and state information that can be recognized by the control information generation unit 33 is generated.

  As shown in FIG. 9, the control information generation unit 33 acquires state information based on the detection information of the voice recognition unit 4 from the state information generation unit 32 (S40), and recognizes the current state of the user.

  The control information generation unit 33 holds the previous sound pressure and conversation speed information, and compares this with the current sound pressure and conversation speed information to extract changes (S41). As a result, if there is no change (S42), the avatar is also unchanged (S43). If the sound pressure and the conversation speed are higher than the previous time (S42), it is understood that the user is in an excited state compared to the previous time. Further, the degree of excitement is classified based on the degree of change in sound pressure and conversation speed (S45), and when the degree of excitement is small, control information “avatar excitement (small)” is generated as shown in FIG. (S48). When the degree of excitement is medium, control information “avatar excitement (medium)” is generated as shown in FIG. 10B (S47). If the degree of excitement is large, control information “Avatar excitement (large)” is generated as shown in FIG. 10C (S46). Further, if the sound pressure and the conversation speed are lower than the previous time (S42), it is understood that the user is in a calm state compared to the previous time, so as shown in FIG. Control information "Avatar calm" is generated (S44).

  Here, as a feature of the present embodiment, a part of the flowchart shown in FIG. 9 can be invalidated according to the selection information from the user held in the selection information holding unit 34. For example, when the ambiguous policy registered by the user is “medium”, the flow (S46) in the portion surrounded by the broken line in FIG. 9 is invalidated. As a result, the display of “avatar excitement (large)” shown in FIG.

  Further, when the ambiguous policy registered by the user is “high”, the flow (S46, S47) in the portion surrounded by the one-dot chain line in FIG. 9 is invalidated. Thereby, as the display by the avatar, only “avatar excitement (small)” shown in FIG. 10A or “avatar calm” shown in FIG. 10D is displayed.

(Ninth Example)
As a ninth embodiment, an example of control information generation based on detection information from the communication detection unit 2, the packet communication analysis unit 3, and the terminal operation detection unit 6 will be described with reference to the flowchart of FIG. The control information generator 33 generates control information as shown in FIG. 11 based on the detection information sent from the communication detector 2, the packet communication analyzer 3, and the terminal operation detector 6. The program execution unit 11 controls the shape or behavior of the avatar based on this control information received by the communication function unit 13. An example of the shape or behavior of this avatar is shown in FIG.

  Detection information from the communication detection unit 2, the packet communication analysis unit 3, and the terminal operation detection unit 6 is input to the state inference unit 31, and the user's call state, packet communication state, and terminal operation state are inferred. The inference result is input to the state information generation unit 32, and state information that can be recognized by the control information generation unit 33 is generated.

  As shown in FIG. 11, the control information generation unit 33 acquires state information based on the detection information of the communication detection unit 2, the packet communication analysis unit 3, and the terminal operation detection unit 6 from the state information generation unit 15 (S50). The user's current call state, packet communication state, and terminal operation state are recognized (S51).

  As a result, if all calls, packet communications, and terminal operations are not frequent (S52), control information “Avatar doze” is generated as shown in FIG. 12A (S56). If there are many calls (S53), control information “Avatar on call” is generated as shown in FIG. 12B (S57). If there are many packet communications (S54) and the communication destination is a game site (S55), control information “Avatar game in progress” is generated as shown in FIG. 12D (S59). If the notification destination is mail (S55), control information “Avatar mail is in progress” is generated as shown in FIG. 12E (S60). If the communication destination is Web browsing (S55), control information “Avatar Web browsing in progress” is generated as shown in FIG. 12F (S61).

  Here, as a feature of the present embodiment, a part of the flowchart shown in FIG. 11 can be invalidated according to the selection information from the user held in the selection information holding unit 34. For example, when the ambiguous policy registered by the user is “medium”, the flow (S59) in the portion surrounded by the broken line in FIG. 11 is invalidated. As a result, the display of “in avatar game” shown in FIG. 12D is not performed as the display by the avatar.

  Further, when the ambiguous policy registered by the user is “high”, the flow (S59, S61) in the portion surrounded by the one-dot chain line in FIG. 11 is invalidated. Thereby, as the display by the avatar, the display of “in avatar game” shown in FIG. 12D and “in avatar web browsing” shown in FIG. 12F is not performed.

(Tenth embodiment)
An example of control information generation based on detection information from the GPS unit 1 and the acceleration sensor 5 will be described as a tenth embodiment with reference to a flowchart of FIG. The control information generation unit 33 generates control information as shown in FIG. 13 based on the detection information sent from the GPS unit 1 and the acceleration sensor 5. The program execution unit 11 controls the shape or behavior of the avatar based on this control information received by the communication function unit 13. An example of the shape or behavior of this avatar is shown in FIG.

  Detection information from the GPS unit 1 and the acceleration sensor 5 is input to the state inference unit 31 to infer the user's moving speed and acceleration state, respectively. The inference result is input to the state information generation unit 32, and state information that can be recognized by the control information generation unit 33 is generated.

  As illustrated in FIG. 13, the control information generation unit 33 acquires state information based on detection information of the GPS unit 1 and the acceleration sensor 5 from the state information generation unit 32 (S70), and obtains the current moving speed and acceleration of the user. Recognize each (S71).

  As a result, if there is no sudden acceleration change (S72), control information “no avatar change” is generated (S75). Alternatively, even if there is a sudden change in acceleration (S72), if there is no change in the moving speed (S73), control information “no avatar change” is generated (S75).

  If there is a sudden acceleration change (S72) and the moving speed indicates a stop (S73), it can be determined that the probability that the user has collided with or fell over the object is high. At this time, it can be inferred that the larger the moving speed just before the stop, the larger the accident, so FIG. 14 (c) respectively according to the “high”, “medium”, and “small” moving speeds just before the stop. ) Control information “Avatar accident (large)”, “avatar accident (medium)” as shown in FIG. 14B, and “avatar accident (small)” as shown in FIG. 14 (a). Each is generated (S76, S77, S78).

  Here, as a feature of the present embodiment, a part of the flowchart shown in FIG. 13 can be invalidated according to the selection information from the user held in the selection information holding unit 34. For example, when the ambiguous policy registered by the user is “medium”, the flow (S76) in the portion surrounded by the broken line in FIG. 13 is invalidated. Thereby, the display of the state of “avatar accident (large)” shown in FIG. 14C is not performed as the display by the avatar.

  Further, when the ambiguous policy registered by the user is “high”, the flow (S76, S77) of the portion surrounded by the one-dot chain line in FIG. 13 is invalidated. As a result, the display of “avatar accident (middle)” shown in FIG. 14B and “avatar accident (large)” shown in FIG.

(Other examples)
In addition to the first to fourth embodiments, when the charging detection unit 7 detects charging, control information “charging avatar” can be generated.

  In the present embodiment, by installing in a general-purpose information processing apparatus, the mobile communication terminals 20-1, 20-2 or the server 30 or the gateway 40 or the non-mobile communication terminal 50 according to the present embodiment are installed in the information processing apparatus. Alternatively, it can be realized as a program for executing each procedure shown in FIGS. 2, 3, 6, 7, 9, 11, and 13 performed by the user authentication device 51. This program is recorded on a recording medium and installed in the information processing apparatus, or installed in the information processing apparatus via a communication line, whereby the mobile communication terminals 20-1, 20-2 or The server 30 or the gateway 40 or the non-mobile communication terminal 50 or the user authentication device 51 implements a function for executing each procedure of FIGS. 2, 3, 6, 7, 9, 11, and 13 respectively. be able to.

  Here, the general-purpose information processing apparatus is, for example, a microprocessor installed in the mobile communication terminals 20-1 and 20-2. Alternatively, it is a personal computer that operates as the non-mobile communication terminal 50 or the user authentication device 51. Alternatively, it is a processor mounted on the server 30 and the gateway 40.

  In the present embodiment, the state inference unit 31, the state information generation unit 32, the control information generation unit 33, the selection information holding unit 34, and the abstract database 35 have been described as functional blocks included in the server 30. This is because a plurality of mobile communication terminals can use one server 30 in common, so it has been described as such from the viewpoint of effective use of resources, but the configuration in which the mobile communication terminal has all these functional blocks is excluded. Not what you want.

  This can contribute to the spread of services using avatars in mobile communication terminals such as mobile phones.

1 is an overall configuration diagram of a mobile communication system according to a first embodiment. The flowchart which shows operation | movement of the non-mobile communication terminal of a 1st Example. The flowchart which shows operation | movement of the gateway of a 1st Example. The block block diagram of the mobile communication terminal of a 1st Example. The block block diagram of the server of a 1st Example. The flowchart which shows the detection information delivery procedure of a 1st Example. The flowchart which shows an example of the control information production | generation procedure of 2nd and 7th Example. The figure which shows the example of the shape or behavior of the avatar of 2nd and 7th Example. The flowchart which shows an example of the control information production | generation procedure of 3rd and 8th Example. The figure which shows the example of the shape or behavior of the avatar of the 3rd and 8th Example. The flowchart which shows an example of the control information production | generation procedure of 4th and 9th Example. The figure which shows the example of the shape or behavior of the avatar of a 4th and 9th Example. The flowchart which shows an example of the control information production | generation procedure of 5th and 10th Example. The figure which shows the example of the shape or behavior of the avatar of 5th and 10th Example. The whole block diagram of the mobile communication system of 6th Example. The block block diagram of the mobile communication terminal of 6th Example. The block block diagram of the server of 6th Example.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 GPS part 2 Call detection part 3 Packet communication analysis part 4 Voice recognition part 5 Acceleration sensor 6 Terminal operation detection part 7 Charge detection part 8 User information collection part 9 User real-time information database 10 User basic information database 11 Program execution part 12 Display 13 Communication function unit 14, 31 State inference unit 15, 32 State information generation unit 16, 33 Control information generation unit 20-1, 20-2 Mobile communication terminal 21, 41 User authentication unit 22, 42 Detection information distribution unit 23 User Management database 24 Control information distribution unit 25 Selection information transmission unit 30 Server 34 Selection information holding unit 35 Abstraction database 40 Gateway 43 Control information relay unit 50 Non-mobile communication terminal 51 User authentication device

Claims (6)

Inferring the current state of the owner of the mobile communication terminal based on detection information detected by a plurality of state detection means provided in the mobile communication terminal;
Generating control information for controlling the shape or behavior of the avatar based on the inferred state of the owner;
Controlling the shape or behavior of the avatar based on the generated control information,
Information of other mobile communication terminals that share the detection information is predetermined,
A state display method for executing the step of delivering the detection information to the other mobile communication terminal,
In addition to the other mobile communication terminal, information of a non-mobile communication terminal that shares the detection information is predetermined,
When executing the step of delivering the detection information to the non-mobile communication terminal,
After the gateway that receives the authentication request including the device ID and the user ID from the non-mobile communication terminal and performs user authentication succeeds in the user authentication of the non-mobile communication terminal, the detection information is transferred to the non-mobile communication terminal. run the step to be delivered to,
The step of generating the control information generates control information to be displayed with the shape or behavior of the avatar having a level of ambiguity specified in advance by the owner among a plurality of levels corresponding to the ambiguity representing the state of the owner. A state display method characterized by: A plurality of state detection means;
Means for inferring the current state of the owner of the mobile communication terminal based on detection information from the state detection means;
Means for generating control information for controlling the shape or behavior of the avatar based on the state of the owner inferred by the means for inferring;
A mobile communication terminal comprising: means for controlling the shape or behavior of the avatar based on the control information generated by the generating means;
A server connected to the mobile communication terminal via a communication line;
This server
Means for holding information of other mobile communication terminals sharing the detection information;
Means for referring to the information of the other mobile communication terminal held in the holding means, and delivering the detection information to the other mobile communication terminal;
The mobile communication terminal is a mobile communication system comprising means for transferring the detection information to the server,
In addition to the other mobile communication terminal, the server includes means for holding information of a non-mobile communication terminal that shares the detection information,
The non-mobile communication terminal includes means for sending an authentication request including a device ID and a user ID,
A gateway for accepting this authentication request and executing user authentication is provided,
The server comprises means for delivering the detection information to the non-mobile communication terminal after the gateway has succeeded in user authentication of the non-mobile communication terminal,
The means for generating the control information generates control information to be displayed with the shape or behavior of the avatar having a level of ambiguity specified in advance by the owner among a plurality of levels corresponding to the ambiguity representing the state of the owner. A mobile communication system comprising means for performing Provided in the mobile communication system according to claim 2,
A gateway comprising means for accepting an authentication request including a device ID and a user ID from the non-mobile communication terminal and executing user authentication. Inferring the current state of the owner of the mobile communication terminal based on detection information detected by a plurality of state detection means provided in the mobile communication terminal;
Generating control information for controlling the shape or behavior of the avatar based on the inferred state of the owner;
Controlling the shape or behavior of the avatar based on the generated control information, and
A plurality of control patterns of the shape or behavior of the avatar corresponding to the same state are provided,
Prior to execution of the step of generating the control information, selecting any of the control patterns;
Generating the control information based on the selection result, and
Information of other mobile communication terminals that share the control information is predetermined,
A state display method for executing the step of delivering the control information to the other mobile communication terminal,
In addition to the other mobile communication terminal, information of a non-mobile communication terminal that shares the control information is predetermined,
When executing the step of delivering the control information to the non-mobile communication terminal,
After the gateway that receives the authentication request including the device ID and the user ID from the non-mobile communication terminal and performs user authentication succeeds in the user authentication of the non-mobile communication terminal, the control information is transferred to the non-mobile communication terminal. run the step to be delivered to,
The step of generating the control information generates control information to be displayed with the shape or behavior of the avatar having a level of ambiguity specified in advance by the owner among a plurality of levels corresponding to the ambiguity representing the state of the owner. A state display method characterized by: A mobile communication terminal comprising a plurality of state detection means;
Means for inferring the current state of the owner of the mobile communication terminal based on detection information from the state detection means;
A server comprising: means for generating control information for controlling the shape or behavior of the avatar based on the state of the owner inferred by the means for inferring;
The mobile communication terminal comprises means for controlling the shape or behavior of an avatar based on the control information,
A plurality of control patterns of the shape or behavior of the avatar corresponding to the same state are provided,
The means for generating the control information includes:
Prior to generating the control information, means for receiving and holding information for selecting any one of the control patterns from the mobile communication terminal;
Means for generating the control information based on the information to be selected,
The mobile communication terminal comprises means for transmitting the information to be selected to the server,
The server
Means for holding information of other mobile communication terminals sharing the control information;
A mobile communication system comprising: means for referring to the information of the other mobile communication terminal held in the holding means and delivering the control information to the other mobile communication terminal;
In addition to the other mobile communication terminal, the server includes means for holding information of a non-mobile communication terminal that shares the control information,
The non-mobile communication terminal includes means for sending an authentication request including a device ID and a user ID,
A gateway for accepting this authentication request and executing user authentication is provided,
The server includes means for distributing the control information to the non-mobile communication terminal after the gateway has succeeded in user authentication of the non-mobile communication terminal .
The means for generating the control information generates control information to be displayed with the shape or behavior of the avatar having a level of ambiguity specified in advance by the owner among a plurality of levels corresponding to the ambiguity representing the state of the owner. A mobile communication system comprising means for performing Provided in the mobile communication system according to claim 5;
A gateway comprising means for accepting an authentication request including a device ID and a user ID from the non-mobile communication terminal and executing user authentication.

Images