JP6355797B1 - Determination apparatus, determination method, and determination program - Google Patents

Abstract

An apparatus, a method, and a program for appropriately determining a service provision mode are provided. A determination apparatus includes an acquisition unit and a determination unit. The acquisition unit is a first user identified by identification information associated with one device and a user identified by association information associated with the identification information of the first user, and is a user different from the first user. Input information indicating a request for a predetermined service input by one user to one device among a certain second user is acquired. The determination unit is input information acquired by the acquisition unit in accordance with the identification of one user being the first user or the second user based on the identification information associated with the one device and the association information. The service provision mode corresponding to the is determined. [Selection] Figure 3

Description

  The present invention relates to a determination device, a determination method, and a determination program.

  In recent years, techniques for providing various Internet services such as online shopping have been provided. For example, there is provided a technology related to an electronic shopping system that allows a user to supervise the entire shopping of Internet shopping by another user and restrict the shopping.

JP 2004-78924 A

  However, it is difficult to appropriately determine the service provision mode in the above-described conventional technology. For example, it is often complicated for a user to supervise (monitor) the use of a service such as Internet shopping by another user, and whenever the user uses another user, the service provision mode is appropriately determined. Is difficult. Further, for example, when a plurality of users use one device such as a voice assist device, it is desired to be able to provide a service appropriately depending on which user instruction is given.

  The present application has been made in view of the above, and an object thereof is to provide a determination device, a determination method, and a determination program for appropriately determining a service provision mode.

  The determination apparatus according to the present application is a first user identified by identification information associated with one device, and a user identified by association information associated with the identification information of the first user, wherein the first user An acquisition unit that acquires input information indicating a request for a predetermined service that one user has input to the one device among a second user that is a user different from the user, and the association with the one device Providing a service corresponding to the input information acquired by the acquisition unit according to the identification of whether the one user is the first user or the second user based on the identification information and the association information And a determining unit that determines the mode.

  According to one aspect of the embodiment, there is an effect that it is possible to appropriately determine a service provision aspect.

FIG. 1 is a diagram illustrating an example of a determination process according to the embodiment. FIG. 2 is a diagram illustrating a configuration example of the determination system according to the embodiment. FIG. 3 is a diagram illustrating a configuration example of the determination apparatus according to the embodiment. FIG. 4 is a diagram illustrating an example of a user information storage unit according to the embodiment. FIG. 5 is a diagram illustrating an example of the service providing information storage unit according to the embodiment. FIG. 6 is a diagram illustrating a configuration example of the mobile terminal according to the embodiment. FIG. 7 is a flowchart illustrating an example of the determination process according to the embodiment. FIG. 8 is a diagram illustrating an example of user information registration according to the embodiment. FIG. 9 is a diagram illustrating an example of user information registration according to the embodiment. FIG. 10 is a hardware configuration diagram illustrating an example of a computer that realizes the function of the determination apparatus.

  Hereinafter, a determination apparatus, a determination method, and a mode for executing a determination program according to the present application (hereinafter referred to as “embodiment”) will be described in detail with reference to the drawings. Note that the determination device, the determination method, and the determination program according to the present application are not limited to the embodiment. In the following embodiments, the same portions are denoted by the same reference numerals, and redundant description is omitted.

(Embodiment)
[1. Decision process)
First, the determination process according to the embodiment will be described. FIG. 1 is a diagram illustrating an example of a determination process according to the embodiment. In the example of FIG. 1, the case where the determination apparatus 100 determines a service providing mode according to a user who has input input information indicating a request for a predetermined service to one device will be described as an example. In the example of FIG. 1, a case where the user inputs voice information as input information to one device is shown. In the following, a user whose identification information (user ID) is associated with one device is referred to as “first user”, voice information is associated with information, and is associated with identification information (user ID) of the first user. An existing user is described as a “second user”.

[Configuration of decision system]
Prior to the description of FIG. 1, the configuration of the determination system 1 will be described with reference to FIG. FIG. 2 is a diagram illustrating a configuration example of the determination system according to the embodiment. As illustrated in FIG. 2, the determination system 1 according to the embodiment includes a device AP 11, a mobile terminal 10, and a determination device 100. The device AP11, the portable terminal 10, and the determination device 100 are connected to be communicable via a predetermined network N. The determination system 1 illustrated in FIG. 2 may include a plurality of devices AP11, a plurality of portable terminals 10, and a plurality of determination apparatuses 100.

  In the example of FIG. 1, the device AP11 is a so-called voice assist terminal, which is a terminal device that detects ambient sounds and performs various processes according to the detected sounds. For example, the device AP11 is a terminal device that processes a user's utterance. In the example of FIG. 1, when an utterance by the user is input, the device AP 11 transmits input information corresponding to the utterance input by the user to the determination apparatus 100.

  The device AP11 is not limited to the above, and any terminal device can be used as long as it can acquire information related to the designation of a product or service from the user and can transmit the designation of the product or the like to the determining apparatus 100. Good. Here, the transmission of the designation of a product or the like to the determination device 100 includes transmission of the designation of a product or the like to the determination device 100 via another device. For example, the device AP11 may be any terminal device as long as it is a device that can communicate with the determination apparatus 100 via a predetermined network, that is, a so-called IoT (Internet of Things) device. For example, the device AP11 may be a terminal device having an image sensor or the like.

  The device AP11 may have various functions such as an infrared sensor, a human sensor, a temperature sensor, and an atmospheric pressure sensor, and may detect and acquire environmental information around the device AP11 such as temperature and atmospheric pressure. . The device AP11 may collect not only the user's utterance but also environmental sounds around the device AP11.

  For example, the device AP11 may be a terminal device that can collect user biometric information and the like. For example, the device AP11 may be a wearable terminal or the like worn by the user. For example, the device AP11 may be a wristwatch type terminal or a glasses type terminal. In addition, for example, the device AP11 may be a terminal device that collects user biometric information.

  The mobile terminal 10 is an information processing device used by a user. For example, the mobile terminal 10 is a terminal device used by a first user. The mobile terminal 10 is realized by, for example, a smartphone, a tablet terminal, a notebook PC (Personal Computer), a desktop PC, a mobile phone, a PDA (Personal Digital Assistant), or the like. Although the example of FIG. 1 shows the case where the mobile terminal 10 is a smartphone, the mobile terminal 10 may be any terminal device as long as the information notified from the determination device 100 can be notified to the user. . For example, the mobile terminal 10 may be a wristwatch type terminal device. Hereinafter, the mobile terminal 10 may be referred to as a user. That is, hereinafter, the user can be read as the mobile terminal 10.

  The determination apparatus 100 determines whether the one user is the first user or the second user based on the identification information and the association information associated with one device, and determines the service corresponding to the input information. A provision aspect is determined. For example, the determination apparatus 100 provides a mail service, a calendar (schedule management) service, a shopping service, and the like. For example, the determination apparatus 100 may be an information processing apparatus that provides an electronic commerce service such as online shopping. For example, the determination apparatus 100 may provide a service SA1, a service SA2, a service SA3, and the like. Further, the determination apparatus 100 may be able to acquire information from an information processing apparatus that provides the service SA1, the service SA2, and the service SA3. In this case, the determination system 1 may include, for example, an information processing apparatus that provides the service SA1, the service SA2, and the service SA3.

  Further, the determination device 100 may have a voice recognition function. Moreover, the determination apparatus 100 may be able to acquire information from a voice recognition server that provides a voice recognition service. In this case, the determination system 1 may include a voice recognition server. In the example of FIG. 1, the determination device 100 and the voice recognition server will not be described on the assumption that the user's utterance is recognized or the uttered user is identified by appropriately using various conventional techniques.

  Hereinafter, an example of the determination process will be described with reference to FIG. In the example of FIG. 1, the first user is the user U11 identified by the user ID “U11”, and the user ID “U11” of the user U11 is associated with the device AP11. Details of the association between the device AP11 and the first user will be described later.

  In the example of FIG. 1, it is assumed that the voice information VP12 to the voice information VP14 are linked as linked information to the user U11 who is the first user, as shown in the service providing information storage unit 122. Details of the association between the voice information of the first user and the second user will be described later. 1 will be described based on a state in which the device AP11, the user U11 as the first user, and the voice information VP12 to the voice information VP14 are associated with each other as shown in the service providing information storage unit 122. For example, it is assumed that the voice information VP12 to the voice information VP14 are information (hereinafter, also referred to as “feature information”) indicating voice characteristics extracted from the utterance. The voice information VP12 to the voice information VP14 may be feature information extracted from each utterance by appropriately using various conventional techniques related to voice feature extraction.

  The service providing information storage unit 122 in FIG. 1 includes items such as “device ID”, “association information (first user)”, and “association information (second user)”. “Correspondence information (first user)” includes items such as “user ID” and “voice information”. The “linking information (second user)” includes “voice information”, “service SA1 (mail)”, “service SA2 (calendar)”, “service SA3 (shopping)”, “age”, and “sex”. Are included.

  “Device ID” indicates information for identifying a device. For example, the device identified by the device ID “AP11” corresponds to the device AP11 in FIG.

  “Correspondence information (first user)” indicates information of the first user associated with the device. “User ID” in “correspondence information (first user)” indicates identification information for identifying a user. For example, the user identified by the user ID “U11” corresponds to the user U11 in FIG. Further, “voice information” in “corresponding information (first user)” indicates voice information of the corresponding first user. “Associated information (second user)” indicates information of the second user associated with the first user. “Voice information” in “association information (second user)” indicates the voice information of the corresponding second user. As described above, the second user is a user specified by the voice information of the user, not by identification information such as a user ID for identifying the user.

  “Service SA1 (mail)” in “association information (second user)” indicates whether or not the service SA1 can be used as the first user when input information is input to the corresponding device. “Service SA2 (calendar)” in “association information (second user)” indicates whether or not the service SA2 can be used as the first user when input information is input to the corresponding device. “Service SA3 (shopping)” in “association information (second user)” indicates whether or not the service SA3 can be used as the first user when input information is input to the corresponding device. “Age” indicates the age of the user specified by the voice information. For example, “age” indicates an age estimated from audio information. “Gender” indicates the gender of the user specified by the voice information. For example, “gender” indicates a gender estimated from voice information.

  For example, in the example of FIG. 1, the device identified by the device ID “AP11” (hereinafter, also referred to as “device AP11”) includes a user (user U11) identified by the user ID “U11” as the first user. Indicates that it is associated. Further, the voice information of the user U11 is “voice information VP11”. For example, the device AP11 is in a state in which the user U11 who is the first user logs in with the user ID and is associated with the device AP11. Further, it is shown that “voice information VP12” to “voice information VP14” are linked as voice information of the second user linked to the user U11 who is the first user.

  Further, in the service providing information storage unit 122 in FIG. 1, the user specified by the “voice information VP12” indicates that the service SA1 related to the user U11 who is the first user cannot be used. That is, the user specified by “voice information VP12” cannot receive the service related to the mail of the first user. In other words, the example of FIG. 1 shows a case where the service SA1 related to the first user cannot be used by the second user specified by the “voice information VP12”. Note that “use of the service related to the first user by the second user” here means use of information etc. collected by the action of the user U11 and associated with the first user when the first user uses the service. Shall be included. In addition, for example, “use of service related to the first user by the second user” includes that the first user purchases a product by using the account of the first user in the use of the service. Shall be. For example, “use of a service related to the first user by the second user” may include various forms in which the second user uses the service as the first user.

  The user specified by the “voice information VP12” indicates that the use of the service SA2 related to the user U11 who is the first user is permitted. That is, the user specified by “voice information VP12” can receive the service related to the calendar of the first user. The user specified by the “voice information VP12” indicates that the use of the service SA3 related to the user U11 who is the first user is permitted. That is, the user specified by the “voice information VP12” indicates that the service related to the shopping of the first user can be received. For example, the user specified by “voice information VP12” indicates that a product or the like can be purchased using the account of the first user.

  Further, it is indicated that the age of the user specified by “voice information VP12” is estimated to be “30s”. In addition, the gender of the user specified by the “voice information VP12” is estimated to be “female”.

  Further, in the service providing information storage unit 122 in FIG. 1, the user specified by the “voice information VP14” indicates that the service SA1 related to the user U11 who is the first user cannot be used. The user specified by the “voice information VP14” indicates that the service SA2 related to the user U11 who is the first user cannot be used. The user specified by the “voice information VP14” indicates that the service SA3 related to the user U11 who is the first user cannot be used. In other words, “voice information VP14” indicates that the service SA1 to service SA3 is not provided with a service that can be used with respect to the user U11 as the first user. Note that the user specified by the “voice information VP14” may be able to perform an operation on an electrical appliance in the house HM, such as a television or lighting, by inputting to the device AP11.

  Further, it is indicated that the age of the user specified by “voice information VP14” is estimated to be “teen”. Further, the gender of the user specified by “voice information VP14” is estimated to be “female”.

  As described above, the second user has the second authority that is more limited than the authority (first authority) of the first user when receiving provision of the service as the first user. In the generation apparatus 100, the second user may grant the same authority as the first user. For example, in the generation device 100, when the first user permits, the second user may grant the same authority as the first user.

  In FIG. 1, the device AP11 that is a voice assist terminal is arranged in the house HM. For example, the house HM is a house owned by the user U11, and is assumed to be a house where the user U11, the user U12 to the user U14, and the like who are their families live. In this way, the device AP11 arranged in the house HM performs various processes according to surrounding environmental sounds, user utterances, and the like.

  From here, the determination process in FIG. 1 is demonstrated. First, the use time of the user U14 in the upper part of FIG. 1 will be described. For example, the user U14 who is the second user who has returned to the house HM performs the utterance PA11 “What is today's schedule?” Around the device AP11. As a result, the device AP11 acquires the input corresponding to the utterance PA11 “What is today's schedule?” (Step S11). Then, the device AP11 transmits the acquired utterance PA11 (voice) to the determining apparatus 100 as input information (hereinafter referred to as “input information PA11”) (step S12). In the example of FIG. 1, the device AP11 transmits information (for example, a device ID) specifying the device AP11 together with the input information PA11 to the determination apparatus 100.

  The device AP11 may transmit the voice information of the utterance PA11 to the voice recognition server, acquire the character information of the utterance PA11 from the voice recognition server, and transmit the acquired character information to the determination apparatus 100. In this case, the device AP11 may transmit the acquired feature information of the utterance PA11 to the determination apparatus 100. When the device AP11 has a voice recognition function, the device AP11 may transmit only input information that needs to be transmitted to the determination apparatus 100 to the determination apparatus 100. In the example of FIG. 1, the determination apparatus 100 acquires input information PA11 from the device AP11.

  The determination apparatus 100 that has acquired the input information PA11 from the device AP11 specifies an input destination device (step S13). In the example of FIG. 1, the determination apparatus 100 specifies an input destination device as the device AP11 based on information (for example, a device ID) specifying the device AP11 acquired together with the input information PA11.

  And the determination apparatus 100 specifies the audio | voice information corresponding to input information (step S14). For example, the determining apparatus 100 analyzes the acquired input information PA11 and compares the feature information of the input information PA11 extracted with the voice information VP11 to VP14 and the like, and the voice information VP11 to VP14 corresponding to the input information PA11. Identify what to do. For example, the determining apparatus 100 may specify which voice information VP11 to VP14 the input information PA11 corresponds to by appropriately using various conventional techniques related to voiceprint authentication and the like. In the example of FIG. 1, the determination apparatus 100 specifies that the audio information corresponding to the input information PA11 is the audio information VP14 based on the association information stored in the service providing information storage unit 122.

  In addition, the determination device 100 specifies a service corresponding to the input information (step S15). In the example of FIG. 1, the determination apparatus 100 identifies the service SA2 related to the service calendar corresponding to the input information by analyzing the input information PA11.

  For example, the determining apparatus 100 converts the acquired input information PA11 into character information and specifies that the content indicating that the input information PA11 requests confirmation of the schedule is included based on the converted character information. To do. For example, the determining apparatus 100 identifies that the schedule confirmation is requested by appropriately analyzing the character information of the input information PA11 using various conventional techniques such as syntax analysis. The input information PA11 may include information that can specify the service SA2, such as “service SA2”, “calendar”, and “schedule”.

  And the determination apparatus 100 determines the provision aspect of service based on the specified audio | voice information (step S16). In the example of FIG. 1, in the determination apparatus 100, the service providing information storage unit 122 stores stored information indicating that the user corresponding to the voice information VP14 is a user who cannot use the service SA2. Therefore, it is determined that the service SA2 cannot be provided for the input information PA11.

  Then, the determination apparatus 100 notifies the device of information based on the determined service provision mode (step S17). In the example of FIG. 1, the determination apparatus 100 notifies the device AP11 of information indicating that the service SA2 cannot be provided to the input information PA11. For example, the determination apparatus 100 notifies the device AP11 of the output information OP11, thereby causing the device AP11 to output the output information OP11. In the example of FIG. 1, the device AP11 outputs the output information OP11 that “service cannot be provided”.

  Next, the use time of the user U12 in the lower part of FIG. 1 will be described. For example, the user U12 who is the second user who has returned to the house HM performs the utterance PA21 “What is the schedule today?” Around the device AP11. As a result, the device AP11 acquires the input corresponding to the utterance PA21 “What is today's schedule?” (Step S21). Then, the device AP11 transmits the acquired utterance PA21 (voice) as input information (hereinafter referred to as “input information PA21”) to the determination apparatus 100 (step S22). In the example of FIG. 1, the device AP11 transmits information (for example, a device ID) specifying the device AP11 together with the input information PA21 to the determination apparatus 100. In the example of FIG. 1, the determination apparatus 100 acquires input information PA21 from the device AP11.

  The determining apparatus 100 that has acquired the input information PA21 from the device AP11 specifies the input destination device (step S23). In the example of FIG. 1, the determination apparatus 100 specifies an input destination device as the device AP11 based on information (for example, a device ID) specifying the device AP11 acquired together with the input information PA21.

  And the determination apparatus 100 specifies the audio | voice information corresponding to input information (step S24). For example, the determination apparatus 100 analyzes the acquired input information PA21 and compares the feature information of the input information PA21 extracted and the voice information VP11 to VP14, etc., to which voice information VP11 to VP14 the input information PA21 corresponds to. Identify what to do. In the example of FIG. 1, the determination apparatus 100 specifies that the audio information corresponding to the input information PA21 is the audio information VP12 based on the association information stored in the service providing information storage unit 122.

  In addition, the determination apparatus 100 specifies a service corresponding to the input information (step S25). In the example of FIG. 1, the determination apparatus 100 identifies the service SA2 related to the service calendar corresponding to the input information by analyzing the input information PA21. For example, the determining apparatus 100 converts the acquired input information PA21 into character information and specifies that the content indicating that the input information PA21 requests confirmation of the schedule is included based on the converted character information. To do.

  And the determination apparatus 100 determines the provision aspect of service based on the specified audio | voice information (step S26). In the example of FIG. 1, in the determination apparatus 100, the service providing information storage unit 122 stores stored information indicating that the user corresponding to the voice information VP12 is a user permitted to use the service SA2. Therefore, it is determined that the service SA2 can be provided for the input information PA21.

  Then, the determination apparatus 100 notifies the device of information based on the determined service provision mode (step S27). In the example of FIG. 1, the determination apparatus 100 notifies the device AP11 of information related to the schedule registered by the user U1 in the service SA2 to the input information PA21. For example, the determining apparatus 100 causes the device AP11 to output the output information OP21 by notifying the device AP11 of the output information OP21 regarding the schedule of the utterance PA21 (for example, May 12, 2017). In the example of FIG. 1, the device AP11 outputs the output information OP21 regarding the schedule of the user U1 “Today's schedule is ...”.

  As described above, the determination apparatus 100 registers only voice information for the second user, identifies the second user based only on the comparison between the input information and the registered voice information, and determines the service provision mode. To do. As described above, the determination apparatus 100 can receive the service provided by the device AP11 without registering the user ID for the second user by registering only the user ID of the first user. Moreover, the determination apparatus 100 changes the provision mode of a service according to the authority given to each 2nd user. Thereby, the determination apparatus 100 can appropriately determine the service provision mode.

  As described above, in the example of FIG. 1, in the state where only the identification information (user ID) of the user U11 who is the first user is associated with the device AP11, another user (for example, the user U12 who is the family of the user U11). -User U14 etc.) can use the device AP11 to receive service. In this way, only the first user (user U11) logs in using the user ID and can provide services to the second user (user U12 to user U14, etc.) in a state associated with the device AP11. By doing so, the second user can receive the service without issuing identification information (user ID) for receiving the service. For this reason, even if it is a user who feels that the generation of an account such as issuance of identification information (user ID) is complicated or a parent (user) who hesitates to issue an original account to a younger child or the like, the first It is possible to allow the second user to receive the service within the range of authority given in the user authorization.

[1-1. (Pegging information)
In addition, the association information is not limited to voice, and may be any information as long as it is an item corresponding to information used for specifying the second user. For example, the association information may be a face photograph (image information) as long as an image of a user who has input input information can be acquired by an image sensor or the like included in the device AP11 or the like. The association information may be various types of information for identifying the user, such as fingerprint information and vein information, as long as it can be acquired for the user who has input the input information.

[1-2. Multi account)
When the user U12 is also associated with the device AP11 as the user ID “U12”, a plurality of users of the user U11 and the user U12 may use the device AP11 as the first user. In this case, when the user U12 inputs input information, a service based on the usage data of the user U12 may be provided as the first user.

[1-3. Input multi-account by the first user]
Although not described in FIG. 1, when the user U11 who is the first user inputs input information, the determination apparatus 100 determines the user U11 whose stored input information is stored in the service providing information storage unit 122. A service may be provided as corresponding to the voice information VP11. In the case of the input information from the first user, the determination device 100 may perform the determination process with permission to provide all available services.

  For example, the determination apparatus 100 may determine a service provision mode corresponding to the input information according to the environment information. For example, the determination apparatus 100 may acquire environment information detected by various sensors included in the device AP11 and determine a service provision mode based on the environment information.

  For example, when the determination apparatus 100 acquires input information on which the first user has uttered, and the situation around the device AP11 specified based on the environment information satisfies a predetermined condition, a service corresponding to the input information You may decide not to provide. For example, the determination apparatus 100 determines not to provide a service corresponding to the input information when it is estimated that there is another user around the device AP11 when the input information obtained by the first user is obtained. May be. For example, the determination apparatus 100 may determine not to provide a voice output service when it is estimated that there is another user around the device AP11 when the input information obtained by the first user is spoken. Good. For example, when it is estimated that there are a plurality of users around the device AP11 based on environmental information detected by an image sensor, a sound wave sensor, or the like, the determination apparatus 100 determines not to provide a service corresponding to the input information. May be.

  For example, when determining that the noise around the device AP11 is greater than or equal to a predetermined threshold based on the environment information, the determining apparatus 100 may determine not to provide a service providing mode by voice output. Further, for example, when the determination device 100 specifies that the noise around the device AP11 is equal to or higher than a predetermined threshold based on the environment information, the sound output is performed after the noise around the device AP11 becomes less than the predetermined threshold. A service providing mode may be performed.

[1-4. Notification to the first user]
Note that the determination device 100 may notify or confirm the first user regarding the determination of the usage mode of the second user's service. For example, the first user may be set to notify the mobile terminal 10 used by the first user when the determining device 100 determines the usage mode of the service of the second user. For example, the determination apparatus 100 provides a first user when a second user who has been associated with the first user is about to receive a new service for a device to which the first user has logged in. It may be possible to make a setting so as to confirm whether or not the second user has newly used the device. Accordingly, the determination apparatus 100 can be managed individually when the mode of service provision by the authority of the second user is different for each device. In addition, the determination apparatus 100 can manage the usage status of each device by the first user.

  For example, in a case where the first user is set to confirm whether or not the service can be newly provided by the second user, the determination apparatus 100 can determine whether the second user When a new service is to be provided, the first user may confirm whether the service can be provided. For example, in the determination apparatus 100, the user U12 who is a second user linked in advance with the user U1 receives a new service (for example, the content distribution service SA4) to the device AP11 to which the user U1 has logged in. In such a case, the user U1 may confirm whether or not the provision is possible. For example, when the first user is set to notify the use of a new service by the second user, the determination apparatus 100 determines that the second user newly provides a service to the device to which the first user has logged in. If the service is received, the first user may be notified of information indicating that the second user has newly received the service.

[2. Configuration of decision device]
Next, the configuration of the determination apparatus 100 according to the embodiment will be described with reference to FIG. FIG. 3 is a diagram illustrating a configuration example of the determination apparatus 100 according to the embodiment. As illustrated in FIG. 3, the determination apparatus 100 includes a communication unit 110, a storage unit 120, and a control unit 130. The determination device 100 includes an input unit (for example, a keyboard and a mouse) that acquires various operations from an administrator of the determination device 100 and a display unit (for example, a liquid crystal display) for displaying various types of information. May be.

(Communication unit 110)
The communication unit 110 is realized by, for example, a NIC (Network Interface Card). The communication unit 110 is connected to the network by wire or wireless, and transmits / receives information to / from the device AP 11 and the mobile terminal 10. The communication unit 110 may transmit and receive information to and from an information processing apparatus that provides an electronic commerce service or a voice recognition server.

(Storage unit 120)
The storage unit 120 is realized by, for example, a semiconductor memory device such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. As shown in FIG. 3, the storage unit 120 according to the embodiment includes a user information storage unit 121 and a service providing information storage unit 122.

(User information storage unit 121)
The user information storage unit 121 according to the embodiment stores various types of information regarding the user. For example, the user information storage unit 121 stores various types of information regarding user attributes. FIG. 4 is a diagram illustrating an example of a user information storage unit according to the embodiment. The user information storage unit 121 illustrated in FIG. 4 includes items such as “user ID”, “age”, “gender”, “mobile terminal”, “account ID”, and “service information”. “Service information” includes items such as “service SA1 (mail)”, “service SA2 (calendar)”, and “service SA3 (shopping)”.

  “User ID” indicates identification information for identifying a user. For example, the user identified by the user ID “U11” corresponds to the user U11 in FIG. “Age” indicates the age of the user identified by the user ID. The “age” may be a specific age of the user identified by the user ID, such as 35 years old. “Gender” indicates the gender of the user identified by the user ID. “Mobile terminal” indicates identification information for identifying the mobile terminal used by the user identified by the corresponding user ID. “Account ID” indicates identification information for identifying a user account identified by the corresponding user ID.

  “Service information” indicates user usage information (data) in each service. “Service SA1 (mail)” indicates user usage information (data) in the service SA1 which is a mail service. “Service SA2 (calendar)” indicates user usage information (data) in the service SA2 which is a calendar service. “Service SA3 (shopping)” indicates user usage information (data) in service SA3, which is a shopping service.

  For example, in the example of FIG. 4, the age of the user (user U11) identified by the user ID “U11” is “30s”, and the gender is “male”. For example, it shows that user U11 is using the portable terminal identified by ID “DV11”. In addition, the account of the user U11 is an account identified by the account ID “ACN11”. For example, the user U11 indicates that shopping or the like is performed using the account identified by the account ID “ACN11”.

  Further, the user U11 is a user who uses the service SA1, and the usage data in the service SA1 of the user U11 is the service data SDT11. In the example of FIG. 4, the usage data of each user is indicated by an abstract code such as “service data SDT11”, but is data indicating the specific usage content of the user in the corresponding service. For example, it is assumed that the service data SDT11 is specific data such as the contents of mail transmitted and received by the user U11.

  Further, the user U11 is a user who uses the service SA2, and the usage data in the service SA2 of the user U11 is the service data SDT12. Further, the user U11 is a user who uses the service SA3, and the usage data in the service SA3 of the user U11 is the service data SDT13.

  For example, in the example of FIG. 4, the age of the user (user U21) identified by the user ID “U21” is “20s”, and the gender is “female”. Further, for example, the user U21 indicates that the mobile terminal identified by the ID “DV21” is used. Further, the account of the user U21 indicates that the account is identified by the account ID “ACN21”. For example, the user U21 indicates that shopping or the like is performed using the account identified by the account ID “ACN21”.

  Further, the user U21 is a user who uses the service SA1, and the usage data in the service SA1 of the user U21 is the service data SDT21. Further, the user U21 indicates that the location of the service SA2 is “−” and is not using the service SA2. The user U21 is a user who uses the service SA3, and the usage data in the service SA3 of the user U21 is the service data SDT23.

  The user information storage unit 121 is not limited to the above, and may store various types of information according to the purpose. For example, the user information storage unit 121 may store user attribute information. For example, the user information storage unit 121 may store information on demographic attributes of users and information on psychographic attributes in addition to age and gender. For example, the user information storage unit 121 may store information such as home, work place, interest / interest, name, family structure, income, and the like.

(Service providing information storage unit 122)
The service providing information storage unit 122 according to the embodiment stores various types of information related to products and the like. For example, the service providing information storage unit 122 stores various types of information regarding products for each group. FIG. 5 is a diagram illustrating an example of the service providing information storage unit according to the embodiment. The service providing information storage unit 122 illustrated in FIG. 5 includes items such as “device ID”, “corresponding information (first user)”, and “correlation information (second user)”.

  The “corresponding information (first user)” includes items such as “user ID” and “voice information”. The “linking information (second user)” includes “voice information”, “service SA1 (mail)”, “service SA2 (calendar)”, “service SA3 (shopping)”, “age”, and “sex”. Are included. In the example of FIG. 5, the voice information of each user is conceptually indicated by symbols “VP11” to “VP14”, “VP21”, etc., and “voice information” is a file path name indicating the storage location thereof. Etc. may be stored. The “voice information” may be characteristic information indicating the characteristics of the user's voice.

  “Device ID” indicates information for identifying a device. For example, the device identified by the device ID “AP11” corresponds to the device AP11 in FIG.

  “Correspondence information (first user)” indicates information of the first user associated with the device. “User ID” in “correspondence information (first user)” indicates identification information for identifying a user. For example, the user identified by the user ID “U11” corresponds to the user U11 in FIG. Further, “voice information” in “corresponding information (first user)” indicates voice information of the corresponding first user.

  “Associated information (second user)” indicates information of the second user associated with the first user. “Voice information” in “association information (second user)” indicates the voice information of the corresponding second user. As described above, the second user is a user specified by the voice information of the user, not by identification information such as a user ID for identifying the user.

  “Service SA1 (mail)” in “association information (second user)” indicates whether or not the service SA1 can be used as the first user when input information is input to the corresponding device. “Service SA2 (calendar)” in “association information (second user)” indicates whether or not the service SA2 can be used as the first user when input information is input to the corresponding device. “Service SA3 (shopping)” in “association information (second user)” indicates whether or not the service SA3 can be used as the first user when input information is input to the corresponding device.

  “Age” indicates the age of the user specified by the voice information. For example, “age” indicates an age estimated from audio information. “Gender” indicates the gender of the user specified by the voice information. For example, “gender” indicates a gender estimated from voice information.

  For example, in the example of FIG. 5, the user (user U11) identified by the user ID “U11” is associated with the device (device AP11) identified by the device ID “AP11” as the first user. Indicates. Further, the voice information of the user U11 is “voice information VP11”.

  Further, it is shown that “voice information VP12” to “voice information VP14” are linked as voice information of the second user linked to the user U11 who is the first user.

  Further, the user specified by the “voice information VP12” indicates that the service SA1 related to the user U11 who is the first user cannot be used. That is, the user specified by “voice information VP12” cannot receive the service related to the mail of the first user. The user specified by the “voice information VP12” indicates that the use of the service SA2 related to the user U11 who is the first user is permitted. That is, the user specified by “voice information VP12” can receive the service related to the calendar of the first user. The user specified by the “voice information VP12” indicates that the use of the service SA3 related to the user U11 who is the first user is permitted. That is, the user specified by the “voice information VP12” indicates that the service related to the shopping of the first user can be received. For example, the user specified by “voice information VP12” indicates that a product or the like can be purchased using the account of the first user.

  Further, it is indicated that the age of the user specified by “voice information VP12” is estimated to be “30s”. In addition, it is indicated that the gender of the user specified by “voice information VP12” is estimated to be “female”.

  Further, the user specified by the “voice information VP13” indicates that the service SA1 related to the user U11 who is the first user cannot be used. That is, the user specified by the “voice information VP13” cannot receive the service related to the mail of the first user. Further, the user specified by the “voice information VP13” indicates that the use of the service SA2 related to the user U11 who is the first user is permitted with permission (cannot be edited). That is, the user specified by the “voice information VP13” cannot edit the calendar (schedule) for the provision of the service related to the calendar of the first user, and can receive the provision of the calendar information. . Further, the user specified by the “voice information VP13” indicates that the use of the service SA3 related to the user U11 who is the first user is permitted with a restriction (10,000 yen). That is, the user specified by the “voice information VP13” indicates that the provision of the service related to the shopping of the first user can be received with a limit of 10,000 yen. For example, the user specified by the “voice information VP13” indicates that purchase of a product or the like can be made up to 10,000 yen per month using the account of the first user.

  Further, it is indicated that the age of the user specified by “voice information VP13” is estimated to be “teen”. Further, it is indicated that the gender of the user specified by “voice information VP13” is estimated to be “male”.

  The service providing information storage unit 122 is not limited to the above, and may store various types of information according to the purpose.

(Control unit 130)
Returning to the description of FIG. 3, the control unit 130 is a controller, and is stored in a storage device inside the determination apparatus 100 by, for example, a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). Various programs (corresponding to an example of a determination program) are implemented by using the RAM as a work area. The control unit 130 is a controller, and is realized by an integrated circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).

  As illustrated in FIG. 3, the control unit 130 includes an acquisition unit 131, a specification unit 132, a determination unit 133, and a notification unit 134, and implements or executes the functions and operations of the determination process described below. . Note that the internal configuration of the control unit 130 is not limited to the configuration illustrated in FIG. 3, and may be another configuration as long as a determination process described later is performed.

(Acquisition part 131)
The acquisition unit 131 acquires various types of information. For example, the acquisition unit 131 acquires various types of information from an external information processing apparatus. For example, the specifying unit 132 acquires various types of information from the user information storage unit 121 and the service providing information storage unit 122.

  For example, the acquisition unit 131 is a first user identified by identification information associated with one device and a user identified by association information associated with the identification information of the first user, Among the second users who are different users, input information indicating a request for a predetermined service input by one user to one device is acquired.

  For example, the acquisition unit 131 acquires information indicating the second authority that the first user gives to the second user. The acquisition unit 131 acquires voice information input by one user to one device as input information. The acquisition unit 131 acquires audio information input to one device by a user other than the first user and the second user whose association information is already registered. The acquisition unit 131 acquires the surrounding environment information where one device is installed.

  In the example of FIG. 1, the acquisition unit 131 acquires input information PA11 from the device AP11. In the example of FIG. 1, the acquisition unit 131 acquires input information PA21 from the device AP11.

(Specification part 132)
The identification unit 132 performs various identifications. For example, the identification unit 132 performs various identifications based on various types of information acquired from an external information processing apparatus. For example, the identification unit 132 performs various identifications based on various types of information stored in the user information storage unit 121 and the service providing information storage unit 122.

  For example, the specifying unit 132 specifies one user based on the voice information of the first user associated with the identification information and the association information that is the audio information associated with the identification information. For example, the specifying unit 132 specifies one user by comparing the input information with the voice information of the first user and the association information of the second user.

  The specifying unit 132 may perform processing for specifying various types of information. For example, the specifying unit 132 may recognize the user's utterance or specify the user who has spoken using various conventional techniques as appropriate. For example, the specifying unit 132 may recognize the user's utterance or specify the uttered user based on the voice information.

  In the example of FIG. 1, the specifying unit 132 specifies that the user who performed the utterance PA11 is the user U12 by analyzing the voice information of the utterance PA11. For example, the specifying unit 132 analyzes the input information PA11 based on the audio information VP11 to the audio information VP14 and the like, thereby specifying that the feature information of the input information PA11 corresponds to the audio information VP14. For example, the specifying unit 132 analyzes the input information PA11 to specify that the provision regarding the service SA2 is requested. For example, the specifying unit 132 converts the input information PA11 into character information, and if the input information PA11 includes “I want to buy” or “Now” along with the product name based on the converted character information, the product You may specify that the content which shows having requested | required purchase of is included. For example, the specifying unit 132 specifies that the user is requesting the input information PA11 by appropriately analyzing character information of the input information PA11 using various conventional techniques such as syntax analysis.

  In the example of FIG. 1, the specifying unit 132 specifies an input destination device. For example, the specifying unit 132 specifies the input destination device as the device AP11 based on information (for example, a device ID) specifying the device AP11 acquired together with the input information PA11. For example, the specifying unit 132 specifies audio information corresponding to the input information. For example, the identifying unit 132 analyzes the acquired input information PA11 and compares the feature information of the input information PA11 extracted with the voice information VP11 to VP14 and the like, and the voice information VP11 to VP14 corresponding to the input information PA11. Identify what to do. For example, the specifying unit 132 specifies that the audio information corresponding to the input information PA11 is the audio information VP14 based on the association information stored in the service providing information storage unit 122.

  In the example of FIG. 1, the specifying unit 132 specifies a service corresponding to the input information. For example, the identifying unit 132 identifies the service SA2 related to the service calendar corresponding to the input information by analyzing the input information PA11. For example, the specifying unit 132 converts the acquired input information PA11 into character information and specifies that the content indicating that the input information PA11 requests confirmation of the schedule is included based on the converted character information. To do. For example, the specifying unit 132 specifies that the schedule confirmation is requested by appropriately analyzing the character information of the input information PA11 using various conventional techniques such as syntax analysis.

  For example, the specifying unit 132 specifies an input destination device. In the example of FIG. 1, the specifying unit 132 specifies an input destination device as the device AP11 based on information (for example, a device ID) specifying the device AP11 acquired together with the input information PA21. For example, the specifying unit 132 specifies audio information corresponding to the input information. For example, the identifying unit 132 analyzes the acquired input information PA21 and compares it with the feature information of the input information PA21 extracted from the voice information VP11 to VP14, etc., to which voice information VP11 to VP14 the input information PA21 corresponds to. Identify what to do. For example, the specifying unit 132 specifies that the audio information corresponding to the input information PA21 is the audio information VP12 based on the association information stored in the service providing information storage unit 122.

  For example, the specifying unit 132 specifies a service corresponding to the input information. In the example of FIG. 1, the specifying unit 132 analyzes the input information PA21 to specify that the service SA2 is a service calendar related to the service calendar corresponding to the input information. For example, the specifying unit 132 converts the acquired input information PA21 into character information and specifies that the content indicating that the input information PA21 requests confirmation of the schedule is included based on the converted character information. To do.

(Determining unit 133)
The determination unit 133 performs various determinations. For example, the determination unit 133 makes various determinations based on various information acquired from an external information processing apparatus. For example, the determination unit 133 performs various determinations based on various types of information stored in the user information storage unit 121 and the service providing information storage unit 122.

  For example, the determination unit 133 is acquired by the acquisition unit 131 depending on whether the one user is the first user or the second user based on the identification information associated with the one device and the association information. The service provision mode corresponding to the input information is determined. For example, the determination unit 133 responds to the input information depending on whether one user is a first user having a first authority or a second user having a second authority different from the first authority. Determine the service delivery mode.

  For example, the determination unit 133 provides a service corresponding to the input information depending on whether one user is a first user or a second user having a second authority that is more limited than the first authority. Determine aspects. For example, when one user is the second user, the determination unit 133 determines a service provision mode corresponding to the input information according to the second authority granted by the first user. For example, when one user is the second user, the determination unit 133 determines a service provision mode corresponding to the input information according to the second authority that can set the authority range according to the service. For example, when one user is the second user, the determination unit 133 determines not to provide the service corresponding to the input information when the request for the predetermined service is outside the second authority.

  For example, the determination unit 133 determines a service provision mode corresponding to the input information according to one user specified by the specification unit 132. For example, the determination unit 133 determines whether to register another user as the second user based on a predetermined condition. For example, when the first user permits registration of another user, the determination unit 133 determines to register another user as the second user.

  For example, the determination unit 133 determines a service provision mode corresponding to the input information according to the environment information. For example, when one user is the first user, the determination unit 133 does not provide a service corresponding to the input information when the surrounding conditions of the one device specified based on the environment information satisfy a predetermined condition. And decide.

  In the example of FIG. 1, the determination unit 133 determines a service provision mode based on the voice information specified by the specification unit 132. For example, the determination unit 133 stores the stored information indicating that the user corresponding to the voice information VP14 is a user who cannot use the service SA2 in the service providing information storage unit 122. It is determined that the service SA2 cannot be provided for the information PA11.

  In the example of FIG. 1, the determination unit 133 determines a service provision mode based on the specified voice information. For example, the determination unit 133 stores the stored information indicating that the user corresponding to the voice information VP12 is a user who is permitted to use the service SA2 in the service providing information storage unit 122. It is determined that the service SA2 can be provided for the information PA21.

(Notification unit 134)
The notification unit 134 notifies various information. For example, the notification unit 134 notifies various types of information by transmitting the various types of information to an external information processing apparatus. For example, the notification unit 134 notifies various information by transmitting various information to the mobile terminal 10. For example, the notification unit 134 notifies various information to the mobile terminal 10 used by the first user. For example, the notification unit 134 notifies the terminal device (the portable terminal 10) used by the first user of information related to the voice information input to one device by another user.

  In the example of FIG. 1, the notification unit 134 notifies the device of information based on the determined service provision mode. For example, the notification unit 134 notifies the device AP11 of information indicating that the service SA2 cannot be provided for the input information PA11. For example, the notification unit 134 notifies the device AP11 of the output information OP11, thereby causing the device AP11 to output the output information OP11.

  In the example of FIG. 1, the notification unit 134 notifies the device of information based on the determined service provision mode. For example, the notification unit 134 notifies the device AP11 of information related to the schedule registered by the user U1 in the service SA2 to the input information PA21. For example, the notification unit 134 causes the device AP11 to output the output information OP21 by notifying the device AP11 of the output information OP21 regarding the schedule of the utterance PA21 (for example, May 12, 2017).

[3. (Configuration of mobile terminal)
Next, the configuration of the mobile terminal 10 according to the embodiment will be described with reference to FIG. FIG. 6 is a diagram illustrating a configuration example of the mobile terminal according to the embodiment. As illustrated in FIG. 6, the mobile terminal 10 includes a communication unit 11, a storage unit 12, an input unit 13, an output unit 14, and a control unit 15.

(Communication unit 11)
The communication unit 11 is realized by a communication circuit or the like, for example. The communication unit 11 is connected to a predetermined network (not shown) in a wired or wireless manner, and transmits / receives information to / from the determination device 100. The communication unit 11 may transmit and receive information to and from the device AP11.

(Storage unit 12)
The storage unit 12 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 12 stores, for example, information related to applications installed in the mobile terminal 10, such as programs.

(Input unit 13)
The input unit 13 acquires various operations from the user. For example, the input unit 13 may accept various operations from the user via a display surface (for example, the display unit 153) by a touch panel function. The input unit 13 may accept various operations from buttons provided on the mobile terminal 10 or a keyboard or mouse connected to the mobile terminal 10.

(Output unit 14)
The output unit 14 is a display screen such as a smartphone or a tablet terminal realized by, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display, and is a display device for displaying various types of information.

(Control unit 15)
The control unit 15 is a controller, and for example, various programs stored in a storage device such as the storage unit 12 in the mobile terminal 10 are executed by the CPU, MPU, or the like using the RAM as a work area. Realized. For example, the various programs include installed application programs. The control unit 15 is a controller, and is realized by an integrated circuit such as an ASIC or FPGA, for example.

  As illustrated in FIG. 6, the control unit 15 includes a request unit 151, a reception unit 152, and a display unit 153, and realizes or executes a display processing function and operation described below. The internal configuration of the control unit 15 is not limited to the configuration illustrated in FIG. 6, and may be another configuration as long as it performs a display process described later. Further, the connection relationship between the processing units included in the control unit 15 is not limited to the connection relationship illustrated in FIG. 6, and may be another connection relationship.

  The request unit 151 makes various requests. For example, the request unit 151 makes various requests to an external information processing apparatus. For example, the request unit 151 transmits various requests to the determination apparatus 100 and the device AP 11 according to the user operation acquired by the input unit 13. For example, the request unit 151 may request the determination apparatus 100 to notify information in response to a user operation. In addition, for example, the request unit 151 may request the determination apparatus 100 to notify the information according to a user operation. In addition, for example, the request unit 151 may request (instruct) the determination apparatus 100 to set (register) new audio information in accordance with the operation of the first user. For example, the request unit 151 instructs the determination apparatus 100 to perform login or the like using the user ID via the device according to the operation of the first user.

  The receiving unit 152 receives various types of information from an external information processing apparatus. For example, the reception unit 152 receives information notified from the determination device 100. For example, the receiving unit 152 receives notification information indicating that new voice information has been input from the determining apparatus 100. For example, the receiving unit 152 receives notification information indicating that new voice information not included in the association information associated with the device in the service providing information storage unit 122 is input from the determination apparatus 100. The receiving unit 152 may receive various information from the device AP11.

  The display unit 153 displays various information. For example, the display unit 153 displays various information received by the receiving unit 152. For example, the display unit 153 displays the notification information received from the determination device 100. For example, the display unit 153 displays notification information for confirming the setting (registration) of new audio information received from the determination device 100.

  Note that the processing such as the display processing by the control unit 15 described above may be realized by, for example, JavaScript (registered trademark). In addition, when the display process described above is performed by a predetermined application or when the display process is performed by a dedicated application, the control unit 15 may include, for example, an application control unit that controls the predetermined application or the dedicated application. .

[4. Processing flow
Next, the procedure of the determination process by the determination system 1 according to the embodiment will be described with reference to FIG. FIG. 7 is a flowchart illustrating an example of the determination process according to the embodiment.

  As illustrated in FIG. 7, the determination apparatus 100 acquires input information from the device (step S101). In the example of FIG. 1, the determination apparatus 100 acquires input information PA11 from the device AP11.

  Then, the determination apparatus 100 specifies an input destination device (step S102). In the example of FIG. 1, the determination apparatus 100 specifies an input destination device as the device AP11 based on information (for example, a device ID) specifying the device AP11 acquired together with the input information PA11.

  And the determination apparatus 100 specifies the audio | voice information corresponding to input information (step S103). In the example of FIG. 1, the determination apparatus 100 specifies that the audio information corresponding to the input information PA11 is the audio information VP14 based on the association information stored in the service providing information storage unit 122.

  In addition, the determination apparatus 100 specifies a service corresponding to the input information (Step S104). In the example of FIG. 1, the determination apparatus 100 identifies the service SA2 related to the service calendar corresponding to the input information by analyzing the input information PA11.

  Then, the determination device 100 determines a service provision mode based on the specified voice information (step S105). In the example of FIG. 1, in the determination apparatus 100, the service providing information storage unit 122 stores stored information indicating that the user corresponding to the voice information VP14 is a user who cannot use the service SA2. Therefore, it is determined that the service SA2 cannot be provided for the input information PA11.

  Then, the determination apparatus 100 notifies the device of information based on the determined service provision mode (step S106). In the example of FIG. 1, the determination apparatus 100 notifies the device AP11 of information indicating that the service SA2 cannot be provided to the input information PA11. For example, the determination apparatus 100 notifies the device AP11 of the output information OP11, thereby causing the device AP11 to output the output information OP11.

[5. First user registration]
From here, registration of information on each user will be described. First, registration of information of the user U11 who is the first user will be described with reference to FIG. FIG. 8 is a diagram illustrating an example of user information registration according to the embodiment. Specifically, FIG. 8 is a diagram illustrating registration of voice information of the user U11 who is the first user.

  In the example of FIG. 8, a case where the device AP11 is activated first is shown as an example. Further, in the example of FIG. 8, to simplify the description, when the user U11 purchases the device AP11 and arrives at the house HM, the user ID “U11” of the user U11 has been associated with the device AP11. It shall be. The determination apparatus 100 stores the information in the service providing information storage unit 122 by associating with the device AP11 by a predetermined application of the mobile terminal 10 (DV11) used by the user U11 who is the first user. The user ID “U11” may be added (registered) to the association information of the device ID “AP11”.

  For example, the user U11 performs pairing between the mobile terminal 10 (DV11) and the device AP11 using, for example, WiFi (registered trademark) (Wireless Fidelity), Bluetooth (registered trademark), etc. The association with the device AP11 may be performed. The pairing between the portable terminal 10 (DV11) and the device AP11 is not limited to WiFi and Bluetooth, and may be performed by various communication methods, for example, NFC (Near Field Communication) function. Further, the user U1 may perform association with the device AP11 by operating an application activated on the mobile terminal 10 (DV11).

  From here, the information registration of the 1st user in FIG. 8 is demonstrated. In the service providing information storage unit 122 in FIG. 8 before the process of step S34, it is assumed that only the user ID “U11” is associated with the device AP11 and the voice information VP11 of the user U11 is not associated. . In the service providing information storage unit 122 in FIG. 8, it is assumed that there is no second user associated with the user U11 who is the first user.

  First, the user U11 who is the first user who has received the device AP11 activates the device AP11 and performs the utterance PA31 of “XXX” around the device AP11. Note that the utterance PA31 “XXX” may be a predetermined utterance that activates the device AP11. For example, the device AP11 may be activated by the utterance PA31 of “XXX” by the user U11. In the example of FIG. 8, the utterance PA31 is indicated by an abstract code “XXX”. However, the utterance PA31 may be various utterances such as “activate device AP11” and “yes, device AP11”.

  Accordingly, the device AP11 acquires the input corresponding to the utterance PA31 “XXX” (step S31). Then, the device AP11 transmits the acquired utterance PA31 (speech) as input information (hereinafter referred to as “input information PA31”) to the determination apparatus 100 (step S32). In the example of FIG. 8, the device AP11 transmits information (for example, a device ID) specifying the device AP11 together with the input information PA31 to the determination apparatus 100. In the example of FIG. 8, the determination apparatus 100 acquires input information PA31 from the device AP11.

  The determining apparatus 100 that has acquired the input information PA31 from the device AP11 specifies an input destination device (step S33). In the example of FIG. 8, the determination apparatus 100 specifies the input destination device as the device AP11 based on the information (for example, the device ID) specifying the device AP11 acquired together with the input information PA31.

  And the determination apparatus 100 registers the audio | voice information corresponding to input information (step S34). For example, the determining apparatus 100 registers the feature information of the input information PA31 extracted by analyzing the acquired input information PA31 as the voice information VP11 of the user U11. In the example of FIG. 8, the determination apparatus 100 registers the voice information VP11 as the voice information of the user ID “U11” associated with the device ID “AP11” in the service providing information storage unit 122.

  Then, the determination apparatus 100 notifies the device that the audio information has been registered (step S35). In the example of FIG. 8, the determining apparatus 100 notifies the device AP11 of information indicating that the voice information VP11 corresponding to the input information PA31 is registered as the voice information of the user U11 who is the first user. For example, the determination apparatus 100 notifies the device AP11 of the output information OP31, thereby causing the device AP11 to output the output information OP31. In the example of FIG. 8, the device AP11 outputs the output information OP31 “Registration completed”.

[6. Second user registration]
Next, registration of information of the user U12 who is the second user will be described with reference to FIG. FIG. 9 is a diagram illustrating an example of user information registration according to the embodiment. Specifically, FIG. 9 is a diagram illustrating registration of the voice information and the second authority of the user U21 who is the second user. In the example of FIG. 9, the state of the service providing information storage unit 122 before the user U12 inputs the utterance PA41 corresponds to the service providing information storage unit 122 in FIG. In other words, in the service providing information storage unit 122 before the user U12 inputs the utterance PA41, there is no second user associated with the user U11 who is the first user.

  First, the user U12 who is an unregistered user associated with the user U11 performs the utterance PA41 “XXX” around the device AP11. In the example of FIG. 9, the utterance PA41 is indicated by an abstract code “XXX”, but the utterance PA41 may be various utterances such as “register voice information” and “use service SA1”.

  Thereby, the device AP11 acquires the input corresponding to the utterance PA41 “XXX” (step S41). Then, the device AP11 transmits the acquired utterance PA41 (speech) as input information (hereinafter referred to as “input information PA41”) to the determination apparatus 100 (step S42). In the example of FIG. 9, the device AP11 transmits information (for example, a device ID) specifying the device AP11 together with the input information PA41 to the determination apparatus 100. In the example of FIG. 9, the determination apparatus 100 acquires input information PA41 from the device AP11.

  The determination apparatus 100 that has acquired the input information PA41 from the device AP11 specifies an input destination device (step S43). In the example of FIG. 9, the determining apparatus 100 specifies the input destination device as the device AP11 based on the information (for example, the device ID) specifying the device AP11 acquired together with the input information PA41.

  And the determination apparatus 100 specifies the audio | voice information corresponding to input information. In the example of FIG. 9, the determining apparatus 100 analyzes the acquired input information PA41 and compares the feature information of the input information PA41 extracted with the voice information VP11, whereby the user U11 whose input information PA41 is the first user is compared. It is determined whether or not. In the example of FIG. 9, the determining apparatus 100 specifies that the feature information of the input information PA41 does not correspond to the voice information VP11 and does not correspond to any voice information because there is no voice information of the second user. That is, the determining apparatus 100 specifies that the input information PA41 is input information input to the device AP11 by a user other than the first user and the second user whose association information is already registered.

  Therefore, the determination apparatus 100 determines to confirm whether or not to register the association information corresponding to the input information PA41 to the user U11 who is the first user.

  First, the determination device 100 specifies the mobile terminal 10 used by the user U11 (step S44). In the example of FIG. 9, the determination apparatus 100 specifies that the mobile terminal 10 used by the user U11 is the mobile terminal 10 (DV11) based on the information stored in the user information storage unit 121.

  In addition, the determination apparatus 100 specifies a setting target service (step S45). In the example of FIG. 9, the determination apparatus 100 specifies the service used by the user U11 as the setting target service. Specifically, the determination device 100 identifies the services SA1 to SA3 used by the user U11 as the setting target services.

  And the determination apparatus 100 notifies information to the user U11 (step S46). In the example of FIG. 9, the determination device 100 transmits a setting confirmation to the mobile terminal 10 (DV11) used by the user U11. For example, the determination apparatus 100 transmits a screen for confirming whether or not the voice information is registered as the second user for the input information PA41 to the mobile terminal 10 (DV11). For example, the determining apparatus 100 transmits a screen that allows the mobile terminal 10 (DV11) to select which service is to be used by the second user of the voice information corresponding to the input information PA41.

  For example, the determination apparatus 100 registers information regarding the input information PA41 to the user U11 by notifying the mobile terminal 10 (DV11) of information (gender, age, etc.) regarding the demographic attribute of the user estimated from the input information PA41. You may check. In the example of FIG. 9, the determination apparatus 100 may notify the mobile terminal 10 (DV11) of information indicating that the speaker (user) corresponding to the input information PA41 is a 30's female. Further, for example, the determination apparatus 100 may confirm whether or not to register the input information PA41 to the user U11 by notifying the mobile terminal 10 (DV11) of information for outputting a sound corresponding to the input information PA41. .

  Then, the user U11 operates the portable terminal 10 (DV11) to set whether or not to register as a second user, a service to be used, and the like (step S47). In the example of FIG. 9, the user U11 permits the user corresponding to the input information PA41 to be registered as the second user. In addition, the user U11 performs setting such that the second user corresponding to the input information PA41 cannot use the service SA1 and permits use of the service SA2 and the service SA3. For example, the user U11 performs setting using a confirmation screen displayed on the mobile terminal 10 (DV11).

  Note that the service provision mode according to the second authority may have various variations depending on the service provision mode. For example, the authority range of the second authority set for the second user may be set according to the service provision mode. For example, in the case of the service SA2 that is a calendar service, the second authority includes an authority range that allows both browsing and editing (first range), and an authority range that permits browsing but cannot write (input) (second). Range) and various authority ranges such as an authority range (third range) that is not permitted for browsing and editing may be settable. For example, the service providing information storage unit 122 in FIG. 5 sets the first range for the second user corresponding to the voice information VP12 and sets the first range corresponding to the voice information VP13 for the service SA2 that is a calendar service. The second range is set for two users, and the third range is set for the second user corresponding to the voice information VP14. Thus, the determination apparatus 100 may be able to set various different authority ranges according to services for the second authority. Further, the determination apparatus 100 may be capable of setting the second authority including the amount setting as shown in the service SA3 which is a shopping service in the service providing information storage unit 122 in FIG. Thus, the determination apparatus 100 may be capable of setting authority ranges corresponding to various different upper limit amounts.

  And according to operation by the user U11, the portable terminal 10 (DV11) transmits setting information ST41 to the determination apparatus 100 (step S48). In the example of FIG. 9, the mobile terminal 10 (DV11) registers the user corresponding to the input information PA41 as the second user, prohibits the use of the service SA1, and permits the use of the service SA2 and the service SA3. The setting information ST41 shown is transmitted to the determination apparatus 100.

  And the determination apparatus 100 performs registration corresponding to the acquired setting information ST41. First, the determination apparatus 100 registers audio information corresponding to the input information based on the acquired setting information ST41 (step S49). For example, the determining apparatus 100 registers the feature information of the input information PA41 extracted by analyzing the input information PA41 as the second user voice information VP12. In the example of FIG. 9, the determination apparatus 100 registers the voice information VP12 as voice information associated with the user ID “U11” of the first user in the service providing information storage unit 122.

  Further, the determination apparatus 100 registers a service to be used by the user corresponding to the voice information based on the acquired setting information ST41 (step S50). For example, the determination apparatus 100 registers information that prohibits the use of the service SA1 and permits the use of the service SA2 and the service SA3 in association with the voice information VP12. In the example of FIG. 9, the determination apparatus 100 registers the estimated age “30s” and gender “female” in association with the voice information VP12.

[7. effect〕
As described above, the determination device 100 according to the embodiment includes the acquisition unit 131 and the determination unit 133. The acquisition unit 131 is a first user identified by identification information associated with one device and a user identified by association information associated with the identification information of the first user, and is different from the first user. Input information indicating a request for a predetermined service input by one user to one device among the second users who are users is acquired. The determination unit 133 is acquired by the acquisition unit 131 according to the identification of one user, the first user or the second user, based on the identification information and the association information associated with one device. A service provision mode corresponding to the input information is determined.

  As described above, the determining apparatus 100 according to the embodiment determines whether one user is the first user or the second user based on the identification information and the association information associated with one device. By determining the service providing mode corresponding to the input information acquired by the acquiring unit, the service providing mode can be appropriately determined.

  Moreover, in the determination apparatus 100 according to the embodiment, the determination unit 133 is either a first user in which one user has the first authority or a second user in which the second authority is different from the first authority. In response to this, the service provision mode corresponding to the input information is determined.

  As described above, the determination apparatus 100 according to the embodiment depends on whether one user is a first user having a first authority or a second user having a second authority different from the first authority. By determining the service providing mode corresponding to the input information, the service providing mode can be appropriately determined according to the authority level given to the user.

  Moreover, in the determination apparatus 100 according to the embodiment, the determination unit 133 determines whether one user is a first user or a second user having a second authority that is more limited than the first authority. The service providing mode corresponding to the input information is determined.

  As described above, the determination apparatus 100 according to the embodiment provides input information depending on whether one user is a first user or a second user having a second authority that is more restricted than the first authority. By determining the service provision mode corresponding to, it is possible to appropriately determine the service provision mode according to the authority level given to the user.

  In the determination device 100 according to the embodiment, the acquisition unit 131 acquires information indicating the second authority that the first user grants to the second user. When one user is the second user, the determination unit 133 determines a service provision mode corresponding to the input information according to the second authority granted by the first user.

  As described above, when the one user is the second user, the determining apparatus 100 according to the embodiment determines a service providing mode corresponding to the input information according to the second authority given by the first user. Accordingly, it is possible to appropriately determine the service provision mode according to the authority level given to the user.

  Further, in the determination device 100 according to the embodiment, when the one user is the second user, the determination unit 133 is a service corresponding to the input information according to the second authority that can set the authority range according to the service. To determine the provision mode.

  Thus, the determination apparatus 100 according to the embodiment provides a service providing mode corresponding to input information according to the second authority in which the authority range according to the service can be set when one user is the second user. By determining the service provision mode, the service provision mode can be appropriately determined according to the authority range finely set for each service.

  In the determination device 100 according to the embodiment, the determination unit 133 does not provide the service corresponding to the input information when the one user is the second user, and the request for the predetermined service is outside the second authority. And decide.

  As described above, when the one user is the second user, the determination apparatus 100 according to the embodiment determines not to provide the service corresponding to the input information when the request for the predetermined service is outside the second authority. Accordingly, it is possible to appropriately determine the service provision mode according to the authority level given to the user.

  In addition, the determination device 100 according to the embodiment includes the specifying unit 132. The acquisition unit 131 acquires voice information input by one user to one device as input information. The specifying unit 132 specifies one user based on the voice information of the first user associated with the identification information and the association information that is the audio information associated with the identification information. For example, the specifying unit 132 specifies one user by comparing the input information with the voice information of the first user and the association information of the second user. The determining unit 133 determines a service providing mode corresponding to the input information in accordance with one user specified by the specifying unit 132.

  As described above, the determination device 100 according to the embodiment determines the service provision mode corresponding to the input information according to one user specified by voice, and thus according to the authority level given to the user. Therefore, it is possible to appropriately determine the service provision mode.

  In the determination apparatus 100 according to the embodiment, the acquisition unit 131 acquires voice information input to one device by a user other than the first user and the second user whose association information is already registered. The determination unit 133 determines whether to register another user as the second user based on a predetermined condition.

  As described above, the determination apparatus 100 according to the embodiment determines whether to register another user as the second user based on a predetermined condition, and thereby determines the service according to the authority level given to the user. Can be appropriately determined.

  In addition, the determination apparatus 100 according to the embodiment includes a notification unit 134. The notification unit 134 notifies the terminal device used by the first user of the information related to the voice information input to one device by another user. The determination unit 133 determines to register another user as the second user when the first user permits registration of the other user.

  As described above, when the first user permits registration of another user, the determination apparatus 100 according to the embodiment determines that the other user is registered as the second user, thereby obtaining the authority level given to the user. Accordingly, it is possible to appropriately determine the service provision mode.

  Further, in the determination apparatus 100 according to the embodiment, the acquisition unit 131 acquires the surrounding environment information in which one device is installed. The determination unit 133 determines a service provision mode corresponding to the input information according to the environment information.

  As described above, the determination apparatus 100 according to the embodiment determines the service provision mode according to the authority level given to the user by determining the service provision mode corresponding to the input information according to the environment information. Can be determined appropriately.

  Moreover, in the determination apparatus 100 according to the embodiment, the determining unit 133, when one user is the first user, when a situation around one device specified based on the environment information satisfies a predetermined condition, It decides not to provide the service corresponding to the input information.

  As described above, the determination apparatus 100 according to the embodiment uses input information when one user is a first user, when a situation around one device specified based on environment information satisfies a predetermined condition. By determining not to provide the corresponding service, it is possible to appropriately determine the service provision mode according to the authority level given to the user.

[8. Hardware configuration)
The determination apparatus 100 according to the embodiment described above is realized by a computer 1000 having a configuration as shown in FIG. 10, for example. FIG. 10 is a hardware configuration diagram illustrating an example of a computer that realizes the function of the determination apparatus. The computer 1000 includes a CPU 1100, RAM 1200, ROM 1300, HDD 1400, communication interface (I / F) 1500, input / output interface (I / F) 1600, and media interface (I / F) 1700.

  The CPU 1100 operates based on a program stored in the ROM 1300 or the HDD 1400 and controls each unit. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 is started up, a program depending on the hardware of the computer 1000, and the like.

  The HDD 1400 stores programs executed by the CPU 1100, data used by the programs, and the like. The communication interface 1500 receives data from other devices via the network N and sends the data to the CPU 1100, and transmits data generated by the CPU 1100 to other devices via the network N.

  The CPU 1100 controls an output device such as a display and a printer and an input device such as a keyboard and a mouse via the input / output interface 1600. The CPU 1100 acquires data from the input device via the input / output interface 1600. In addition, the CPU 1100 outputs the generated data to the output device via the input / output interface 1600.

  The media interface 1700 reads a program or data stored in the recording medium 1800 and provides it to the CPU 1100 via the RAM 1200. The CPU 1100 loads such a program from the recording medium 1800 onto the RAM 1200 via the media interface 1700, and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or PD (Phase change rewritable disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory. Etc.

  For example, when the computer 1000 functions as the determination device 100, the CPU 1100 of the computer 1000 implements the function of the control unit 130 by executing a program loaded on the RAM 1200. The CPU 1100 of the computer 1000 reads these programs from the recording medium 1800 and executes them. However, as another example, these programs may be acquired from other devices via the network N.

  As described above, some of the embodiments and modifications of the present application have been described in detail with reference to the drawings. It is possible to carry out the present invention in other forms that have been modified and improved.

[9. Others]
In addition, among the processes described in the above-described embodiments and modifications, all or a part of the processes described as being automatically performed can be manually performed, or are described as being performed manually. All or part of the processing can be automatically performed by a known method. In addition, the processing procedures, specific names, and information including various data and parameters shown in the document and drawings can be arbitrarily changed unless otherwise specified. For example, the various types of information illustrated in each drawing is not limited to the illustrated information.

  Further, each component of each illustrated apparatus is functionally conceptual, and does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution / integration of each device is not limited to that shown in the figure, and all or a part thereof may be functionally or physically distributed or arbitrarily distributed in arbitrary units according to various loads or usage conditions. Can be integrated and configured.

  In addition, the above-described embodiments and modifications can be combined as appropriate within a range that does not contradict processing contents.

  In addition, the “section (module, unit)” described above can be read as “means” or “circuit”. For example, the acquisition unit can be read as acquisition means or an acquisition circuit.

DESCRIPTION OF SYMBOLS 1 Determination system 100 Determination apparatus 121 User information storage part 122 Service provision information storage part 130 Control part 131 Acquisition part 132 Identification part 133 Determination part 134 Notification part 10 Portable terminal AP11 Device (voice assist terminal)
N network

Claims (12)

A first user identified by identification information associated with one device and a user identified by association information associated with the identification information of the first user, the user being different from the first user An acquisition unit that acquires input information indicating a request for a predetermined service input by one user to the one device among the second users;
Acquired by the acquisition unit according to whether the one user is the first user or the second user based on the identification information and the association information associated with the one device. If the one user is the second user and the predetermined service is a new service, the predetermined service provision to the one user is determined. A determination unit that determines to confirm with the first user whether or not
Equipped with a,
The acquisition unit
Obtaining voice information input to the one device by a user other than the first user and the second user in which the association information has been registered;
The determination unit
If the voice information input to the one device does not correspond to any information associated with the one device, the first user is allowed to register the other user as the second user. And determining whether to register the other user as the second user based on whether or not the second user is registered as the second user . The determination unit
Depending on whether the one user is the first user having the first authority or the second user having the second authority different from the first authority, the service corresponding to the input information The determining apparatus according to claim 1, wherein the providing mode is determined. The determination unit
Providing a service corresponding to the input information depending on whether the one user is the first user or the second user having the second authority more limited than the first authority. The determination device according to claim 2, wherein: The acquisition unit
Obtaining information indicating the second authority given to the second user by the first user;
The determination unit
The service providing mode corresponding to the input information is determined according to a second authority given by the first user when the one user is the second user. The determination device according to claim 3. The determination unit
When the one user is the second user, a service provision mode corresponding to the input information is determined according to a second authority that can set an authority range according to the service. The determination apparatus of any one of 2-4. The determination unit
The said one user is the said 2nd user, When the request | requirement with respect to the said predetermined | prescribed service is outside the said 2nd authority, it determines not providing the service corresponding to the said input information. The determination apparatus of any one of -5. A specifying unit that identifies the one user based on the voice information of the first user associated with the identification information and the association information that is the audio information associated with the identification information;
Further comprising
The acquisition unit
The voice information input to the one device by the one user is acquired as the input information,
The specific part is:
The one user is identified by comparing the input information with the voice information of the first user and the association information of the second user,
The determination unit
The determination apparatus according to claim 1, wherein a service providing mode corresponding to the input information is determined according to the one user specified by the specifying unit. A notification unit for notifying the terminal device used by the first user of information related to voice information input by the other user to the one device;
Further comprising
The determination unit
The determination apparatus according to any one of claims 1 to 7 , wherein when the first user permits registration of the other user, it is determined to register the other user as the second user. . The acquisition unit
Acquire environmental information of surroundings where the one device is installed,
The determination unit
The determination apparatus according to any one of claims 1 to 8 , wherein a service providing mode corresponding to the input information is determined according to the environment information. The determination unit
When the one user is the first user, it is determined not to provide a service corresponding to the input information when a surrounding condition of the one device specified based on the environment information satisfies a predetermined condition. The determination device according to claim 9 , wherein: A decision method performed by a computer,
A first user identified by identification information associated with one device and a user identified by association information associated with the identification information of the first user, the user being different from the first user An acquisition step of acquiring input information indicating a request for a predetermined service input by one user to the one device among the second users;
Acquired by the acquisition step depending on whether the one user is the first user or the second user based on the identification information and the association information associated with the one device. If the one user is the second user and the predetermined service is a new service, the predetermined service provision to the one user is determined. A determination step for determining whether to confirm with the first user whether or not
Only including,
The acquisition step includes
Obtaining voice information input to the one device by a user other than the first user and the second user in which the association information has been registered;
The determination step includes
If the voice information input to the one device does not correspond to any information associated with the one device, the first user is allowed to register the other user as the second user. Determining whether to register the other user as the second user based on whether or not the second user is registered . A first user identified by identification information associated with one device and a user identified by association information associated with the identification information of the first user, the user being different from the first user An acquisition procedure for acquiring input information indicating a request for a predetermined service input by one user to the one device among the second users;
Acquired by the acquisition procedure according to whether the one user is the first user or the second user based on the identification information and the association information associated with the one device. If the one user is the second user and the predetermined service is a new service, the predetermined service provision to the one user is determined. A determination procedure for determining whether to confirm with the first user whether or not
To the computer ,
The acquisition procedure is as follows:
Obtaining voice information input to the one device by a user other than the first user and the second user in which the association information has been registered;
The determination procedure is as follows:
If the voice information input to the one device does not correspond to any information associated with the one device, the first user is allowed to register the other user as the second user. or based on whether, determination program the other user, characterized in decide whether or not to register as the second user.

Images