JP2017068681A - Service providing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a service which can reduce a load of an operation input of a user, and which can give ease to a user through a communication network.SOLUTION: The system of the present invention is configured to store personal attribute information which characterizes each user out of plural users who use a service, and communication connection information of plural electrical appliances used for the service. When it is determined that, the user is present in the vicinity of at least one of the plural electrical appliances, the system acquires user state information which indicates at least one of a user's expression, a user's behavior, a user's voice and a user's body condition in the place, and an environment of the place where the determined object user is present, through the communication network. Based on the user state information and the personal attribute information associated with the object user, the system creates control information for controlling an operation of the electrical appliances so as to apply to the object user who is present in the vicinity of the electrical appliance, at least one of ease and satisfaction feeling, then, sends the control information to the electrical appliance through the communication network.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a service providing system that provides a service via a communication network.

  Conventionally, data input by a user operating a communication terminal device is transmitted to a server to request desired information, and information corresponding to the request is transmitted from the server to the communication terminal device and provided. A service providing system is known.

  For example, Patent Document 1 discloses information provision in which a user such as an elderly person inputs a voice from a user terminal and transmits a keyword obtained by voice recognition of the input voice data to a home service information providing server. A system is disclosed. In this information providing system, the home service information providing server searches for an information providing URL associated with the keyword received from the user terminal and stored as information link data in the member database, and the Web accessed according to this URL The server information provision screen is transmitted to the user terminal.

  In the conventional service providing system as disclosed in Patent Document 1, it is necessary to operate the communication terminal device to input data in order to receive the service, and there is a problem that the operation input burden on the user is large. There is. In addition, as for the service to be provided, there is a case where it is desired to provide an unprecedented service that gives a sense of security to the user according to the user's emotion, expectation or preference, rather than merely providing information.

In order to solve the above-described problem, a service providing system according to an aspect of the present invention is a service providing system that provides a service to a user via a communication network, and characterizes each of a plurality of users who use the service. Storage means for storing personal attribute information and communication connection information of a plurality of electrical appliances used for the service, and determination means for determining whether or not a user is located near at least one of the plurality of electrical appliances When it is determined that the user is located near at least one of the plurality of electrical appliances, the environment of the location where the determined target user is located and the facial expression, behavior, and voice of the target user at the location And acquisition means for acquiring user status information indicating at least one of physical condition from the at least one electrical appliance via a communication network; The target usage located near the at least one electrical appliance based on the user status information acquired for the target user and personal attribute information corresponding to the target user stored in the storage means Based on the communication connection information stored in the storage means, generating means for generating control information for controlling the operation of the at least one appliance so as to give at least one of a sense of security and satisfaction to the person Transmitting means for transmitting the control information to the at least one electrical appliance via a communication network.
In the service providing system, the storage unit stores a priority order of each of the plurality of electrical appliances, and the generation unit stores in the storage unit when a plurality of electrical appliances are located near the target user. The control information may be generated for each of the plurality of electrical appliances according to the priority order.
In the service providing system, the plurality of electrical appliances are devices that accept at least one of user operation and voice input, and the priority order of the plurality of electrical appliances is the user for each of the plurality of electrical appliances. It may be updated based on the reception frequency of at least one of the above operation and voice input.
In the service providing system, the personal attribute information includes user association information for associating users who are close to each other among the plurality of users, and the generation unit acquires the user status acquired for the target user. The control information may be generated based on information, personal attribute information of the target user, and personal attribute information of a user who is close to the target user.
In the service providing system, the user association information may include identification information of a user who is close to the target user and information indicating a type of relationship between the close user.
In the service providing system, the user association information may be newly registered or updated based on input information input by the user.
In the service providing system, the user association information includes the user's action history information, the SNS (Social Networking Service) posting information, and the user's chat information on the communication network. And a user who is close to each other based on at least one piece of information written on the bulletin board on the communication network of the user, the closeness is measured for the estimated users, and the closeness is a predetermined value. It may be newly registered or updated when it becomes higher than the reference.
In the service providing system, the personal attribute information includes personal basic information registered in advance by the user, posted information on the user's SNS (Social Networking Service), and information on the user's communication network. It may include at least one information of message information in chat, information written on a bulletin board on the communication network of the user, and action history information of the user.
In the service providing system, the action history information of the user includes at least one of information on a person who is present at the place where the user was located and information on an object located at the place. May be included.
In the service providing system, the user status information includes image information of facial expressions of the target user, voice information of the target user, text input information input by the target user, and the target user. May include at least one of current position information where the user is located and physical condition information of the target user.
In the service providing system, the physical condition information may be received via a communication network from a physical condition measuring apparatus with a communication function worn by the target user.
In the service providing system, the physical condition information may include information on at least one of the body temperature, the heart rate, the respiratory rate, the sweating amount, and the exhalation of the target user.
Further, in the service providing system, the current location information of the target user is at least one of information on a person who is present at the location where the target user is located and information on an object located at the location. Information.
In the service providing system, the electrical appliance is at least one of a physical condition measurement device, a home appliance, a lighting device, an automobile, a camera, a robot, a digital signage, and a communication terminal device having a communication function via a communication network. There may be.
Further, in the service providing system, the operation of the control target of the electrical appliance includes: a voice message output to the target user; a still image directed to the target user; a video output with a video or audio; the target Adjustment of at least one of temperature, humidity, lighting, fragrance and air purification at the current position of the user, adjustment of seasoning of food automatically provided to the target user, and operation of a robot near the target user It may be at least one of the following.

  ADVANTAGE OF THE INVENTION According to this invention, the service which gives a user a sense of security and satisfaction via a communication network can be provided, reducing the burden of a user's operation input.

1 is a schematic configuration diagram illustrating an example of an overall configuration of a communication system including a service providing system according to an embodiment of the present invention. The block diagram which shows an example of the hardware constitutions of the communication terminal device which can be used as an electric appliance which concerns on embodiment of this invention. The flowchart which shows an example of the process in the server of the service provision system which concerns on this embodiment. The flowchart which shows the other example of the process in the server of the service provision system which concerns on this embodiment. The flowchart which shows the further another example of the process in the server of the service provision system which concerns on this embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a schematic configuration diagram illustrating an example of the overall configuration of a communication system including a service providing system according to an embodiment of the present invention. The service providing system 10 according to the present embodiment acquires at least one information of the facial expression, behavior, voice, and physical condition of a user near the electrical appliance 20 via a communication network, and the user feels secure and satisfied. The operation of the electrical appliance 20 is controlled so as to speak to change at least one of the above and to change the environment. This control reduces the burden of user operation input in various locations and scenes, and a virtual reality person (avatar, buddy) speaks to the user through the communication network. By changing the environment in which it is located, it is possible to provide a service that gives the user a sense of security and satisfaction and enriches the mind.

  The service providing system 10 according to the present embodiment includes a server 11 that can communicate with a user-side electrical appliance 20 via a communication network, and a database 12 that stores various information and data used for providing the service. Each of the server 11 and the database 12 can be configured by, for example, individual independent computer devices or a single computer device that is shared. Each of the server 11 and the database 12 may be composed of a group of a plurality of computer devices connected to each other via a communication network.

  For example, the server 11 communicates with various appliances 20 on the user side via the backbone network 30 of the LAN network and the access point 31 which is a wireless LAN relay device, or via the wired LAN cable 32 and the backbone network 30. It is possible to communicate with various electric appliances 20 on the user side. Further, the server 11 can communicate with the various electric appliances 20 on the user side via the core network 40 and the base station 41 of the mobile communication network according to the communication functions of the various electric appliances 20 on the user side. . In addition, the server 11 accesses various servers 51 on the Internet 50 at a predetermined timing (for example, periodically), and is made public by various servers 51 such as posting on an SNS, remarks on a chat, and writing on a bulletin board. You may comprise so that information may be searched.

  The electric appliance 20 on the user side has a communication function for communicating with the server 11 and other electric appliances 20 through a LAN communication network or a mobile communication network. The electrical appliance 20 is, for example, a communication terminal device 21 such as a personal computer (PC) such as a notebook computer or a smartphone, a mobile phone, a tablet terminal, a game machine, or a book browsing terminal that can be carried and used by a user. Further, the appliance 20 may be a wearable device 22 such as a physical condition measuring device with communication function (health care device) or a clock-type information communication terminal that can be worn by a user. Further, the electrical appliance 20 may be a lighting fixture 23, a home appliance 24, and a robot 25 installed in a home or workplace where a user stays or passes. The home appliance 24 is, for example, an air conditioner, a refrigerator, a washing machine, a vacuum cleaner, a television, a radio, a recording device, a printer, an artificial scent output device, an automatic cooking device, an air cleaner, a humidifier, or the like. Further, the electrical appliance 20 may be a still image or video camera 26. Moreover, the electric appliance 20 may be a public vehicle such as an automobile 27 that a user drives or rides on, a bus, a train, an airplane, or a ship. In the automobile 27, for example, a communication function for communicating with the server 11 may be incorporated in the navigation device. Further, the electrical appliance 20 may be a digital signage 28 that is provided in a place where a user stays, a commuting route or a school route through which the user passes, and displays information such as advertisements.

  Note that the electrical appliance 20 other than the communication terminal device 21 used by the user performs short-range wireless communication of an appropriate method with the communication terminal device 21 and communicates with the server 11 via the communication terminal device 21. Alternatively, the wearable device 22 has a function of communicating with the server 11, and the wearable device 22 and the other electrical appliance 20 perform short-range wireless communication of an appropriate method, and the other electrical appliance 20 You may make it communicate with the server 11 via the wearable device 22. FIG.

  The communication terminal device 21 has at least one of a cellular communication function, a wireless LAN communication function, and a wired LAN communication function so that a communication function for communicating with the server 11 via the communication network can be performed. For example, when the communication terminal device 21 is located within the wireless communication area of the access point 31, for example, the communication terminal device 21 wirelessly communicates with the access point 31 by a wireless LAN wireless communication method such as Wi-Fi conforming to the IEEE 802.11 standard. Then, it is possible to communicate with the server 11 via the access point 31. Further, for example, when the communication terminal device 21 is in a cellular communication communication area such as a macro cell or a small cell, the communication terminal device 21 is in a third generation (3G), LTE (Long Term Evolution), LTE-Advanced, fourth generation ( 4G) and 5th generation (5G) standards can be connected to a communication network via a base station 41 such as a macro cell base station or a small cell base station for cellular communication.

  In FIG. 1, one communication terminal device 21 is illustrated, but a plurality of communication terminal devices 21 respectively used by a plurality of users may communicate with the server 11.

  In the service providing system 10 configured as described above, the server 11 and the database 12 can implement the following functions as means by executing predetermined programs.

For example, the server 11 functions as the following units (A101) to (A104) by executing a predetermined program.
(A101) Judgment means for judging whether a user is located near at least one of a plurality of electrical appliances.
(A102) When it is determined that a user is located near at least one of a plurality of electrical appliances, the environment of the location where the determined target user is located and the facial expression, behavior, and voice of the target user at that location And acquisition means for acquiring user status information indicating at least one of physical condition from the at least one electrical appliance via a communication network.
(A103) Based on the user status information acquired for the target user and the personal attribute information corresponding to the target user stored in the database 12 as storage means, the position is close to the at least one electrical appliance Generating means for generating control information for controlling the operation of the at least one electrical appliance so as to give at least one of a sense of security and satisfaction to the target user.
(A104) Transmission means for transmitting control information to the at least one electrical appliance via a communication network based on communication connection information stored in the database 12.

  Here, whether or not the user is located near at least one of the plurality of electrical appliances is obtained, for example, by acquiring information on the current position of the user and storing the acquired information on the current position of the user in the database 12. The position information of the electrical appliances 20 registered in advance (for example, the location information of a plurality of electrical appliances 20 shown in Table 4 to be described later) may be compared and determined. For example, the distance between the current position of the user and the positions of the plurality of appliances 20 registered in the database 12 is calculated, and the calculated distance is equal to or less than a preset reference distance (or less than the reference distance). If there is one or more electrical appliances that are present, it is determined that the user is located near the corresponding electrical appliance or appliances. Here, the reference distance is set to a distance at which the user can perceive or recognize the operation, output, or change of the appliance 20 controlled by the service of the present embodiment. For example, when controlling the appliance 20 so as to output a message to be described later, the distance at which the user can hear the voice of the message or the distance at which the user can see the display of the message is the reference distance. Set as.

  The method for acquiring the current position information of the user is not limited to a specific method. For example, even if the communication terminal device 21 carried by the user accesses the server 11 and transmits information on the current position of the user to the server 11, the server 11 acquires the information on the current position of the user. Good. Further, the server 11 accesses the communication terminal device 21 carried by the user to request information on the current position, and the communication terminal device 21 includes the information on the current position in its response to the request. 11 may acquire information on the current position of the user. In addition, the server 11 accesses the position information database that manages the position information of the communication terminal device 21 carried by the user and acquires information on the current position of the communication terminal device 21 to be used by the server 11. Information on the current position of the person may be acquired. The timing at which the current position information of the user is acquired may be a timing at which the user moves to a predetermined location set in advance, or may be periodic.

  Further, whether or not the user is located near at least one of the plurality of electrical appliances 20 is determined when the communication terminal device 21 carried by the user and the electrical appliance 20 are capable of short-range communication with each other. The communication terminal device 21 or the electrical appliance 20 may transmit the location information indicating that the user is located near the electrical appliance 20 to the server 11 and may make a determination based on the location information.

  The user status information is at least one of image information of facial expressions of the user, voice information of the user, text input information of the user, current position information where the user is located, and physical condition information of the user. May be included. The physical condition information may be received via a communication network from the wearable device 22 that is a health information measuring apparatus with a communication function that can be worn by the user. The physical condition information may include information on at least one of a user's body temperature, heart rate, respiratory rate, sweating amount, and exhalation. Further, the current position information of the user may include at least one of information on a person who is present at the place where the user is located and information on an object located at the place.

  The database 12 is controlled by personal attribute information that characterizes the user in association with each of a plurality of users who use the service of the present embodiment and the service of the present embodiment by executing a predetermined program. It functions as storage means for storing communication connection information of a plurality of electrical appliances used as objects.

  Here, the database 12 may store priorities of a plurality of electrical appliances. In this case, when a plurality of appliances are located near the user, the server 11 generates control information for each of the plurality of appliances, and operates the plurality of appliances according to the priority order stored in the database 12. The control information may be sequentially transmitted so that the items are controlled in order. The plurality of electrical appliances are devices that accept at least one of a user's operation and voice input, and the priority order of the plurality of electrical appliances is the user's operation and voice input of each of the plurality of electrical appliances. New registration or update may be performed based on at least one reception frequency.

  The personal attribute information may include user association information that associates users who are close to each other among a plurality of users. In this case, the generation unit of the server 11 controls the electrical appliance 20 based on the user status information acquired for the user, the personal attribute information of the user, and the personal attribute information of the user familiar to the user. Generate information.

  The user association information includes identification information of a user who is close to the user and the type of relationship between the close user (for example, a family relationship, a relative relationship, a friend relationship, a lover relationship, a disciple relationship, a colleague at work) Information indicating the relationship or the relationship of residents in the neighborhood). Further, the user association information may be newly registered or updated based on input information input by the user. In addition, the user association information includes user action history information, user SNS (Social Networking Service) posting information, user utterance information in a chat on a communication network, and a user bulletin board on a communication network. Estimate users who are close to each other based on at least one piece of information written at the site, measure the intimacy of the estimated users, and register when the intimacy is higher than a predetermined standard Or it may be updated.

In addition, the personal attribute information includes personal basic information registered in advance by the user, posted information of the user's SNS (Social Networking Service), remark information in a chat on the user's communication network, It may include at least one piece of information written on a bulletin board on the communication network and user action history information.
Moreover, the user's action history information may include at least one of information on a person who is present at a place where the user is located and information on an object located at the place.

Table 1 is a list showing an example of personal basic information that constitutes a part of the user personal attribute information stored in the database 12. This personal basic information is basic information of the personal attribute information of the user. For example, when the user operates and inputs the communication terminal device 21 or the like when starting service use, the personal basic information is newly registered in the database 12 or thereafter. It can be updated at any timing. In the example of Table 1, for a plurality of users, individuals such as the user's address, name, age, occupation, blood type, telephone number, hometown, home school, etc., are associated with the user identification information (user ID). The basic information is stored in the database 12 together with the acquisition method and registration date (or update date) of the personal basic information.

Table 2 is a list showing an example of individuality information constituting a part of the personal attribute information of the user stored in the database 12. This individuality information is information indicating the individuality of the user. For example, when the user operates and inputs the communication terminal device 21 or the like when starting service use, the personality information is newly registered in the database 12 or updated at an arbitrary timing thereafter. You can do it. In the example of Table 2, individual information such as personal tastes, preferences (food, entertainment, color, fragrance, flowers, movies), personality, etc. of a plurality of users in association with user identification information (user ID). Are stored in the database 12 together with the acquisition method and registration date (or update date) of the individuality information.

  Table 3 is a list showing an example of the user association information that constitutes a part of the user personal attribute information stored in the database 12. This user association information is information for associating users who are close to each other. For example, when the user operates and inputs the communication terminal device 21 or the like at the start of service use, the user association information is newly registered in the database 12, or any arbitrary subsequent And can be updated at the timing. The user association information includes user action history information, user SNS (Social Networking Service) posting information, user utterance information in a chat on a communication network, and a bulletin board on the user communication network. Can be acquired based on at least one piece of information written in the database and newly registered in the database 12 or updated at an arbitrary timing thereafter.

In the example of Table 3, in correspondence with the user identification information (user ID: 0001) of the user U1, user identification information (users) of the father, mother, and brother as intimate persons close to the user U1 ID), relationship with user U1, type of relationship, intimacy, hobby, preference (food, entertainment, color, fragrance, flower, movie), personality information, accuracy of the information, and method of acquiring the information And it is stored in the database 12 together with the registration date (or update date). Here, the familiarity is an index indicating the degree of familiarity with the other party, “A” being the highest level and “D” being the lowest level. The accuracy of information is an index indicating the degree of accuracy of the information, and the accuracy is low in the order of “determined”, “provisional decision”, “confidence”, “estimation”, and “rumor”.

  For example, in Table 3, the user association information of the father, mother, and brother who are the family of the user U1 is acquired when the user U1 operates and inputs the communication terminal device 21 and the like. The familiarity with the user U1 is the highest level “A”. For the father and mother in Table 3, the user U1 has an input indicating that the user IDs “0100” and “0101” are their own father and mother, and the father and mother respectively Since there is an input indicating that the user ID “0001” is his / her child, the accuracy of the information is the highest “determined” level. On the other hand, for the father and mother in Table 3, the user U1 has input indicating that his / her brother is the user ID “0102”. Therefore, the accuracy of the information is the second “provisional decision” level.

  Also, in Table 3, the user association information of the teacher and friend of the school for the user U1 is the post information on the SNS of the user U1, the teacher and the friend, remarks in chat, writing on the bulletin board, and action history information Acquired based on at least one. The intimacy between the teacher and the user U1 is, for example, the value of parameters such as the location where both of them are calculated based on SNS posting information and the like, the frequency at which the date and time match, and the length of time that both are in the same location. And a predetermined standard are compared, and a determination is made based on the comparison result. Here, since the value of the parameter satisfies the predetermined first criterion, the closeness between the teacher and the user U1 is the second level “B”, and the accuracy of the information is the second “confidence”. Is a level. On the other hand, since the intimacy between the school friend and the user U1 does not satisfy the predetermined first standard, the intimacy between the friend and the user U1 is the third level “C”. The accuracy of the information is the third “estimated” level.

  Also, in Table 3, the user association information of the boss and colleagues at the workplace for the user U1 includes post information on the SNS of the user U1, boss and colleagues, comments on chat, writing on the bulletin board, and action history information. Acquired based on at least one. The familiarity between the boss of the workplace and the user U1 is a parameter such as the location where both of them are calculated based on the SNS posting information and the like, the frequency at which the date and time match, and the length of time that both are in the same location. Is compared with a predetermined standard, and the determination is made based on the comparison result. Here, since the value of the parameter satisfies the predetermined first criterion, the closeness between the boss and the user U1 is the second level “B”, and the accuracy of the information is the second “confidence”. Is a level. On the other hand, since the value of the above parameter does not satisfy the predetermined first standard, the closeness between the colleague and the user U1 is the third level “C”. The accuracy of the information is the third “estimated” level.

  Further, in Table 3, the user association information of the neighborhood resident at home with respect to the user U1 is at least one of the posting information on the SNS of the user U1 and the neighborhood resident, chat remarks, writing on the bulletin board, and action history information. Based on one. The intimacy between the neighboring resident and the user U1 is, for example, parameters such as the location where both of them are calculated based on SNS posting information and the like, the frequency at which the date and time match, and the length of time that both are in the same location. The value is compared with a predetermined standard, and determination is made based on the comparison result. Here, since the value of the parameter is the lowest value (for example, the frequency at which the location and the date coincide with each other is once), the intimacy between the neighboring resident and the user U1 is the fourth level “D”. Yes, the accuracy of the information is the fifth “rumor” level.

  The intimacy information in Table 3 may be used when generating control information for controlling the operation of the electrical appliance 20 located near the user U1.

Table 4 is a list showing an example of appliance information regarding each of the plurality of appliances 20 stored in the database 12. This appliance information is information relating to each of the plurality of appliances 20 used in the service of the present embodiment, and includes communication connection information (for example, URL, global IP address, telephone number) used when communicating with the server 11. . In addition, the appliance information is newly registered in the database 12 or updated at an arbitrary timing thereafter by, for example, an operation or input of the communication terminal device 21 or the like by the administrator or user of the service at the start of service use. You can do it.

  In the example of Table 4, the name, owner information (owner ID), location information, communication connection information, and control of the appliance are associated with the device identification information (device ID) of each of the plurality of appliances 20. Information on possible items is stored in the database 12 together with the information acquisition method and registration date (or update date).

  In addition, as shown in Table 4, the electrical appliance information is the priority of each electrical appliance when controlling the operation of the electrical appliance so as to give the user at least one of a sense of security and satisfaction in the service of this embodiment. The ranking information may be included. In the example of Table 4, the priority is lowered in the order of A, B, C, and D. This priority order may be updated by a learning function such as deep learning after starting the operation of the service of the present embodiment. For example, when the plurality of electrical appliances 20 are devices that accept at least one of user operations and voice input, the priority order is at least one of user operations and voice inputs for each of the plurality of electrical appliances 20. Based on the frequency, it is updated by a learning function such as deep learning.

  FIG. 2 is a block diagram illustrating an example of a hardware configuration of the communication terminal device 21 that can be used as the electrical appliance 20 according to the embodiment of the present invention. The communication terminal device 21 of the present embodiment includes a main control unit 210, a wireless communication unit 211, a baseband processing unit 212, a sound input / output unit 213, a display unit 214, and an operation unit 215 as an operation unit. The communication terminal device 21 is equipped with a USIM 230 as an IC module, which is a subscriber information storage medium that can be attached to and detached from the device main body.

  The main control unit 210 includes a storage device such as an MPU (Micro Processing Unit), RAM, ROM, and the like, and controls each unit such as the baseband processing unit 212 by executing a program such as a predetermined basic OS or middleware. Or build a native platform environment or application execution environment on the software configuration, or execute various processes.

  The storage device of the main control unit 210 includes, for example, at least one of a semiconductor memory, a magnetic disk device, and an optical disk device. The storage device stores a driver program, an operating system program, an application program, data, and the like used for processing in each unit. For example, the storage device includes, as a driver program, a communication driver program that executes a wireless communication method of IEEE802.11 standard or a wireless communication method of mobile communication (cellular communication), an input device driver program that controls the operation unit 215, a display unit An output device driver program for controlling 214 is stored. In addition, the storage device has, as an operating system program, for example, a basic OS such as Android (registered trademark) OS or iOS (registered trademark), a wireless communication method of IEEE 802.11 standard, or wireless communication of mobile communication (cellular communication). A connection control program for performing authentication and the like in the system is stored. In addition, the storage device transmits and receives an e-mail as an application program, a communication program that communicates with the server 11, an authentication program that performs web authentication, a time measurement program that measures time, a web browser program that acquires and displays a web page. An e-mail program, a communication quality measurement program for measuring communication quality with the access point 20 of the wireless LAN, and the like are stored. The storage device may store various text data, video data, image data, and the like, or temporarily store temporary data related to a predetermined process.

  The wireless communication unit 211 functions as a wireless LAN communication unit that communicates via a wireless LAN access point 20 and a mobile communication unit that communicates via a base station 60 for cellular communication. For example, a synthesizer, a frequency converter, and a high frequency amplifier It is composed of an antenna and the like. The wireless communication unit 211 performs high-frequency signal processing for wireless communication with the access point 20 using a predetermined communication method such as IEEE 802.11, or performs predetermined communication with the base station 60 such as 3G or LTE. For example, high-frequency signal processing for wireless communication is performed by a communication method.

  The baseband processing unit 212 executes digital processing for performing voice communication and data transmission / reception communication with communication terminal devices such as other mobile phones and various servers. The baseband processing unit 212 and the wireless communication unit 211 are connected via a D / A converter or an A / D converter.

  The sound input / output unit 213 includes a microphone, a speaker, a sound signal processing unit, and the like. An analog audio signal output from the microphone is converted into a digital signal by the sound signal processing unit and sent to the main control unit 210, the baseband processing unit 212, and the like. The speaker receives an analog signal converted from a digital signal by the sound signal processing unit, and outputs a voice during a call, or outputs a ringtone for a mail, a ringing tone for a telephone, music, or the like. The speaker may be configured by separately providing a receiver speaker (receiver) for listening to voice during a call and an external output speaker for outputting ringtones, music, etc. You may comprise with one speaker so that a speaker and an external output speaker may be combined.

  The display unit 214 includes an LCD (liquid crystal display), an organic EL (Electro-Luminescence) display, and the like, and displays various images based on commands from the main control unit 210.

  The operation unit 215 includes a touch panel incorporated in the display unit 214, various operation keys and buttons, a power switch as a power ON / OFF unit, and the like. This operation unit 215 is used when the user turns on / off the main body power supply of the communication terminal device 21, instructs to start / end a call, menu selection, screen switching, etc., or inputs information. It is done.

  The communication terminal device 21 includes a GPS (Global Positioning System) unit 217 as a position information acquisition unit, a camera unit 218 as an imaging unit, a sensor unit 219, a power supply unit 220 as a power supply unit, a clock unit (not shown), and the like. It also has.

  The GPS unit 217 includes a GPS receiving module, a GPS antenna, and the like, receives radio waves from a plurality of GPS satellites arranged around the earth, and based on the reception result, the current position where the communication terminal device 21 is located. Calculate latitude, longitude and altitude data.

  The position information of the current position of the communication terminal device 21 output from the GPS unit 217 may be transmitted to the server 11 spontaneously or in response to an acquisition request from the server 11 at a predetermined timing. For example, the communication terminal apparatus 21 transmits the position information of the current position of the communication terminal apparatus 21 to the server 11 via the communication network periodically at a preset period or at a preset upload time set in advance. Also good. Based on the position information of the current position received from the communication terminal device 21, the server 11 additionally registers the action history information of the user of the communication terminal device 21, or the user uses at least one of the plurality of electrical appliances 20. It is possible to determine whether or not they are close to each other.

  The camera unit 218 includes a lens, an imaging device, and the like, and is used when shooting a person or a landscape. As the imaging device, a CCD (Charge Coupled Device) camera or a CMOS camera can be used.

  The sensor unit 219 includes an acceleration sensor and / or a geomagnetic sensor. The acceleration sensor may be a uniaxial acceleration sensor or a multi-axis acceleration sensor such as a biaxial or triaxial acceleration sensor. Further, the geomagnetic sensor may be a uniaxial geomagnetic sensor, or may be a multiaxial geomagnetic sensor such as a biaxial or a triaxial. Based on the output of the sensor unit 219, data indicating the position, orientation, posture, and movement of the communication terminal device 21 can be calculated. Also, based on the output of the sensor unit 219, the communication terminal device 21 determines whether the communication terminal device 21 is based on history information that is information about time change of acceleration data or geomagnetic data when the user's communication terminal device 21 moves from a reference position at a predetermined altitude. Data indicating the altitude, angle, and the like of the current position that is located can be calculated.

  The power supply unit 220 includes a rechargeable battery, a power supply circuit that supplies power of a predetermined voltage from the battery to each unit, a charging circuit that charges the battery, and the like. The clock unit includes a clock circuit and the like, counts accurate date and time, and generates time information for various information update processing and the like.

  In addition, it is assumed that the communication terminal device 21 functions as the wearable device 22 by providing the sensor unit 219 with physical condition measurement information (for example, information on at least one of body temperature, heart rate, respiration rate, sweat rate, and exhalation). Also good.

Next, a processing example of the server 11 in the service providing system 10 having the above configuration will be described.
FIG. 3 is a flowchart showing an example of processing of the server 11 in the service providing system 10 of the present embodiment. In this example, a virtual reality person (avatar or buddy) who cares for the user talks to the user or changes the environment in which the user is located, via an appliance located near the user. It is an example of a process of the server 11 which provides the service of the assistance action to perform.

  In FIG. 3, the server 11 includes a plurality of users registered in advance as remote controllable devices in the service of the present embodiment by any one of a plurality of users registered in advance as users of the service of the present embodiment. It is determined whether it is located near at least one of the electrical appliances 20 (S101). This determination may be made based on, for example, information on the current position received from the communication terminal device 21 carried by the user, or by performing short-range communication with the communication terminal device 21 carried by the user. May be performed based on the information regarding the position of the user received from the electrical appliance 20 (excluding the communication terminal device 21) that has detected that is located nearby.

  In addition, the server 11 normally communicates with each electrical appliance 20 via a communication network to check whether each electrical appliance 20 is in an operating state. For example, the server 11 confirms the power ON / OFF state of each of the plurality of electrical appliances 20 periodically at a predetermined cycle or at a predetermined confirmation timing via a communication network, and stores the electrical appliance information in the database 12. The latest power ON / OFF information of each electrical appliance may be included as one item. In this case, the server 11 confirms the latest power ON / OFF information of each electrical appliance in the database 12 and determines whether the user is located near only the electrical appliance that is powered on. Also good.

  Next, when the server 11 determines that the user is located near at least one appliance of the plurality of appliances 20 (YES in S101), the user status such as the facial expression and physical condition of the determined target user is determined. Information is received via a communication network (S102). This user status information can be received without an operation input of the target user, for example, an electrical appliance (hereinafter referred to as “a communication terminal device 21” carried by the target user) located near the target user. It may be an image of the face of the target user photographed by “target electrical appliance”) or measured by a wearable device 22 such as a physical condition measuring device (health care device) worn by the target user. It may be physical condition measurement information (for example, information on at least one of body temperature, heart rate, respiration rate, sweat rate, and exhalation).

  Next, based on the user status information of the target user and the personal attribute information corresponding to the target user stored in the database 12, the server 11 determines the target user located near the target appliance. Control information such as message output information for controlling the operation of the target appliance so as to give at least one of a sense of security and satisfaction is generated (S103). Specifically, it is determined that the target user is disgusted from the user status information (for example, body temperature or facial expression) of the target user, and the personal attribute information of the target user is searched in the database 12 for target usage. Control information that outputs message information that speaks to give a sense of security and satisfaction to the target audience when a user knows that he likes orange juice (drinks) or a comedy program (entertainment) To do. For example, when the target electrical appliance is an air conditioner of the home appliance 24, message information that says “Would you like to warm your body?” Is output, and control information that slightly increases the temperature setting is generated. In addition, when the target electrical appliance is the refrigerator of the home appliance 24, control information is generated that outputs message information that says “How about orange juice? Your mood will change.” In addition, when the target electrical appliance is the lighting fixture 23, message information that says “Since the lighting is darkened, please rest for a while” is output, and control information that slightly darkens the brightness of the lighting is generated. In addition, if the target electrical appliance is a television or recording device of the home appliance 24, the message information that says “Do you want to come and see me?” Is displayed, and the TV broadcast program guide and recording list are displayed. Control information to be generated.

  Next, the server 11 transmits control information to the target appliance via the communication network based on the communication connection information of the target appliance (S104). Based on the control information received from the server 11, the target appliance controls the operation (for example, message output) so as to give the target user at least one of a sense of security and satisfaction.

  As described above, according to this example, a virtual reality person (avatar or buddy) who cares about the user talks to the user himself / herself through the electrical appliance and communication network located near the user. It is possible to provide a service that gives the user a sense of security and satisfaction according to the state of the user's physical condition and the like by changing the environment in which the user is located. In addition, since the user's operation input for receiving the service can be reduced as compared with the prior art, the burden of the user's operation input can be reduced.

  FIG. 4 is a flowchart showing another example of processing of the server 11 in the service providing system 10 of the present embodiment. In this example, a virtual reality person (avatar, buddy) who cares for the user talks to the user on behalf of the user through an electrical appliance located near the user. It is a processing example of the server 11 which provides the service of the assistance action which changes the environment where is located. Note that the processing in S101 and S102 in FIG. 4 is the same as that in S101 and S102 in FIG. 3 described above, and a description thereof will be omitted.

  In FIG. 4, the server 11 receives and acquires user status information such as the facial expression and physical condition of the target user, and then searches the database 12 for the target user and is included in the user attribute information of the target user. A person close to the target user is determined based on the user association information (S103). For example, a person (for example, a family member) having a high familiarity and high information accuracy is selected from the list of a plurality of close persons exemplified in Table 3 above.

  Next, the server 11 is located near the target appliance based on the user status information of the target user and the personal attribute information of a person close to the target user (for example, family) stored in the database 12. Control information such as message output information for controlling the operation of the target appliance is generated so as to give the target user at least one of a sense of security and satisfaction (S104). Specifically, it is determined that the target user is disappointed from the user status information (for example, body temperature or facial expression) of the target user, and the personal attribute information of the person familiar with the target user is searched in the database 12. If the target user knows that he / she likes orange juice (drinks) or a comedy program (entertainment), he / she outputs the message information that speaks to give the target user a sense of security and satisfaction. Generate information. For example, if the target appliance is a refrigerator of home appliances 24, output message information that says "I heard from dad, you like orange juice. Do you drink orange juice? Control information to be generated. In addition, when the target electrical appliance is a television or recording device of the home appliance 24, the message information that says “I heard from your mother, do you like comedy? Generate control information to be output.

  Next, the server 11 transmits control information to the target appliance via the communication network based on the communication connection information of the target appliance (S105). Based on the control information received from the server 11, the target appliance controls the operation (for example, message output) so as to give the target user at least one of a sense of security and satisfaction.

  As described above, according to the present example, a virtual reality person (avatar or buddy) who cares for a user is replaced with a person who is close to the user via an appliance and a communication network located near the user. By speaking to the user or changing the environment in which the user is located, it is possible to provide a service that gives the user a sense of security and satisfaction according to the user's physical condition and the like. In addition, since the user's operation input for receiving the service can be reduced as compared with the prior art, the burden of the user's operation input can be reduced.

  In particular, according to this example, the user can receive a talk that cared for the user on behalf of a close person, so that the user can be more effectively given a sense of security and satisfaction.

  FIG. 5 is a flowchart showing still another example of the processing of the server 11 in the service providing system 10 of the present embodiment. In this example, when a plurality of appliances are located near the user, a virtual reality person (avatar, buddy) who cares about the user through the appliance selected according to the preset priority order. It is a processing example of the server 11 that provides a service that talks to the user or changes the environment in which the user is located. Note that the processing of S101, S102, S105, and S106 in FIG. 5 is the same as that of S101, S102, S104, and S105 in FIG. 3 described above, and a description thereof will be omitted.

  In FIG. 5, the server 11 receives and acquires the user status information such as the facial expression and physical condition of the target user, and then refers to the positional information in Table 4 to determine whether the appliance located near the target user is It is determined whether or not there are multiple (S103). Here, when there are a plurality of electrical appliances located near the target user (YES in S103), the server 11 searches the database 12 for the plurality of electrical appliances, for example, in advance as illustrated in Table 4 above. Based on the set priority of each electrical appliance, the electrical appliance to be controlled is determined (S104). On the other hand, when a single appliance is located near the target user (NO in S103), the single appliance is a control target.

As described above, according to this example, a virtual reality person (avatar or buddy) who cares about the user talks to the user himself / herself through the electrical appliance and communication network located near the user. It is possible to provide a service that gives the user a sense of security and satisfaction according to the state of the user's physical condition and the like by changing the environment in which the user is located. In addition, since the user's operation input for receiving the service can be reduced as compared with the prior art, the burden of the user's operation input can be reduced.
In particular, according to this example, when there are a plurality of appliances located near the target user, based on the priority order of each appliance set in advance in terms of the effect of talking to the user via the appliance, etc. Since the appliance to be controlled is determined, providing the assistance that the user desires most according to the state of the user's physical condition and the like can provide a sense of security and satisfaction more reliably.

In the example of FIGS. 3 to 5 described above, the case where the user status information acquired by the server 11 is the facial expression or physical condition of the target user has been described. However, the user status information is the location of the target user. It may be information indicating the environment (temperature, humidity, fragrance, air cleanliness, etc.), or the behavior and voice of the target user at that location.
Further, in the examples of FIGS. 3 to 5 described above, the case where the control target appliance located near the user is a home appliance or a lighting device has been described. However, the control target appliance is illustrated in FIG. It may be a physical condition measuring device (health care device) 22, an automobile 27, a still or moving image camera 26, a robot 25, a digital signage 28, or a communication terminal device 21 that has various communication functions.
In the example of FIGS. 3 to 5 described above, the case has been described where the control information for controlling the operation of the controlled appliance is message output information. However, the control information is a still image for the target user, Output of video or audio accompanying video, adjustment of at least one of temperature, humidity, lighting, fragrance and air cleaning at the current location of the target user, adjustment of seasoning of food automatically provided to the target user, or target usage It may be the action of a robot near the person.

DESCRIPTION OF SYMBOLS 10 Service provision system 11 Server 12 Database 20 Electrical appliance 21 Communication terminal device 22 Wearable device 23 Lighting fixture 24 Home appliance 25 Robot 26 Camera 27 Car 28 Digital signage 30 Backbone network of LAN network 31 Access point 32 Wired LAN cable 40 Mobile communication network Core network 41 Base station 50 Internet 51 Server

JP 2004-038252 A

Claims (15)

A service providing system for providing services to users via a communication network,
Storage means for storing personal attribute information characterizing each of a plurality of users using the service and communication connection information of a plurality of electrical appliances used for the service;
Determining means for determining whether a user is located near at least one of the plurality of electrical appliances;
When it is determined that a user is located near at least one of the plurality of electrical appliances, the environment of the place where the determined target user is located and the facial expression, behavior, voice, and physical condition of the target user at the place Acquisition means for acquiring user status information indicating at least one of the information from the at least one electrical appliance via a communication network;
The target usage located near the at least one electrical appliance based on the user status information acquired for the target user and personal attribute information corresponding to the target user stored in the storage means Generating means for generating control information for controlling the operation of the at least one electrical appliance so as to give at least one of a sense of security and satisfaction to the person;
A service providing system comprising: a transmission unit configured to transmit the control information to the at least one electrical appliance via a communication network based on the communication connection information stored in the storage unit. In the service provision system of Claim 1,
The storage means stores a priority order of each of the plurality of electrical appliances,
The generating unit generates the control information for each of the plurality of electrical appliances according to the priority order stored in the storage unit when a plurality of electrical appliances are located near the target user. Service providing system. In the service provision system of Claim 2,
The plurality of electrical appliances are devices that accept at least one of user operation and voice input,
The priority order of the plurality of electrical appliances is updated based on reception frequency of at least one of user operation and voice input of each of the electrical appliances. In the service provision system in any one of Claims 1 thru | or 3,
The personal attribute information includes user association information for associating users who are close to each other among the plurality of users,
The generation unit generates the control information based on user status information acquired for the target user, personal attribute information of the target user, and personal attribute information of a user who is close to the target user. A service providing system characterized by: In the service provision system of Claim 4,
The service association system, wherein the user association information includes identification information of a user who is close to the target user and information indicating a type of relationship between the user and the close user. In the service provision system of Claim 4 or 5,
The service providing system, wherein the user association information is newly registered or updated based on input information input by the user. In the service provision system of Claim 4 or 5,
The user association information includes the user's action history information, the user's SNS (Social Networking Service) post information, the utterance information in chat on the user's communication network, and the user's communication network. When users who are close to each other are estimated based on at least one piece of information written on the bulletin board, the closeness is measured for the estimated users, and the closeness is higher than a predetermined standard A service providing system that is newly registered or updated. In the service provision system in any one of Claims 1 thru | or 7,
The personal attribute information includes personal basic information registered in advance by the user, posted information of the user's SNS (Social Networking Service), utterance information in chat on the user's communication network, the usage A service providing system comprising at least one of information written on a bulletin board on a user's communication network and action history information of the user. In the service provision system of Claim 8,
The user's action history information includes at least one of information on a person who is present at the place where the user is located and information on an object located at the place. Offer system. In the service provision system in any one of Claims 1 thru | or 9,
The user status information includes image information of facial expressions of the target user, voice information of the target user, text input information input by the target user, current position information where the target user is located And at least one of physical condition information of the target user. In the service provision system of Claim 10,
The physical condition information is received via a communication network from a physical condition measuring apparatus with a communication function that can be worn and used by the target user. The service providing system according to claim 10 or 11,
The said physical condition information contains the information regarding at least one of the said user's body temperature, heart rate, respiration rate, perspiration amount, and exhalation. The service providing system according to any one of claims 10 to 12,
The current location information of the target user includes at least one of information on a person who is present at the location where the target user is located and information on an object located at the location. Service providing system. In the service provision system in any one of Claims 1 thru | or 13,
The electrical appliance is at least one of a physical condition measurement device, a home appliance, a lighting device, an automobile, a camera, a robot, a digital signage, and a communication terminal device having a communication function via a communication network. system. In the service provision system in any one of Claims 1 thru | or 14,
The operation of the control target of the appliance includes: a voice message output to the target user; a still image directed to the target user; an output of a video or a video with sound; a temperature at the current position of the target user; It is at least one of adjustment of humidity, lighting, fragrance, and air cleaning, adjustment of seasoning of meals automatically provided to the target user, and operation of a robot near the target user Characteristic service provision system.

Images