JP2023180943A - Information processing device, information processing method and program - Google Patents

Abstract

To confirm that there is a situation in which communication between a user of an electronic appliance and others is hindered by the uses of the electronic appliance.SOLUTION: Communication requests from others to users of electronic appliances are evaluated. A user response to the request is evaluated. Based on an evaluation result of the request and an evaluation result of the response, it is determined whether communication between the user and another person is being hindered by the use of the electronic appliance. When it is determined that the communication is being hindered, a notification that communication is being hindered is provided.SELECTED DRAWING: Figure 3

Description

The present disclosure relates to a technique for detecting a state in which conversation/communication is obstructed by the use of electronic devices.

With the spread of electronic devices such as smartphones, tablets, notebook PCs, and desktop PCs, and the expansion of services provided, opportunities to use electronic devices in various everyday situations are increasing.

On the other hand, it has been pointed out that the use of electronic devices in the home, especially by caregivers, obstructs communication between caregivers and children, leading to effects such as poor attachment formation and loss of developmental opportunities through imitation of parents. ing. Therefore, evaluation of communication using various types of information is being considered.

In this regard, Patent Document 1 calculates the brightness scores of the facial expressions of the target person and the people around him in the image, and based on the difference, calculates the possibility of problems between the people, such as abuse and bullying, for example. A technique for estimating and notifying the estimation results is disclosed.

JP2018-112831A

``Analyzing emotions from baby's cries, now available with ``Papatto Childcare@Baby Note'', [online], PR TIMES Co., Ltd., [Searched May 25, 2020], Internet <URL: https:/ /prtimes.jp/main/html/rd/p/000000006.000023831.html〉 ``Koe Dakeno Emotion Recognition Test'', [online], Empas Co., Ltd., [searched on May 25, 2020], Internet <URL: https://webempath.net/lp-jpn/> Naohiro Tawara, “How old is this voice? Deep speaker attribute estimation using speaker clustering”, [online], NTT Communication Science Laboratories, [searched on May 25, 2020], Internet <URL: https //www.rd.ntt/cs/event/openhouse/2020/download/c_15.pdf〉 ``Speech-to-Text'', [online], Google, [searched on May 25, 2020], Internet <URL: https://cloud.google.com/speech-to-text?hl=ja> ``Next generation UX ``Gaze detection technology'' that charms you with gaze sensing'', [online], Swallow Incubate Co., Ltd., [Searched on May 25, 2020], Internet <URL: https://eyetrack.pas-ta. io/〉 ``Estimating facial orientation using head-pose-estimation'', [online], ITAC Solutions Co., Ltd., [searched on May 25, 2020], Internet <URL: https://www.itd- blog.jp/entry/peep-prevention-1〉 ``Evaluation Board/Development Kit What is ToF Camera? ~ What you can do with ToF Camera ~'', [online], Tokyo Electron Devices Co., Ltd., [Searched on May 25, 2020], Internet <URL: https:/ /www.inrevium.com/pickup/tofcamera/〉 ``Estimation of depth by AI'', [online], Briswell Co., Ltd., [Retrieved May 25, 2020], Internet <URL: https://tech.briswell.com/entry/2021/03/28 /204127?utm_source=feed〉

The technique disclosed in Patent Document 1 detects the possibility that the above problem will occur based on a person's facial expression.

On the other hand, in a scene where a child's caregiver uses an electronic device to obstruct communication between the caregiver and the child, a change in the caregiver's facial expression does not necessarily occur. Therefore, even if the technology of Patent Document 1 is adopted and images of the caregiver and the child are acquired, based on the acquired images, communication between the caregiver and the child due to the caregiver's use of electronic devices is hindered. The condition could not be detected properly. Such problems may arise between the user of the electronic device and another person, such as between the child and the caregiver when the child uses the electronic device.

An information processing device according to an aspect of the present disclosure includes a first evaluation unit that evaluates a communication request from another person to a user who uses an electronic device, and a second evaluation unit that evaluates a response of the user to the request. , a first evaluation result by the first evaluation means, and a second evaluation result by the second evaluation means, the communication between the user and the other person is determined by the electronic device. a determining means for determining whether the communication is being obstructed by the use of the communication; and a determination means for determining whether the communication is being obstructed by the use of the communication; It is characterized by having a notification means for notifying.

According to the present disclosure, it is possible to recognize that communication between a user of an electronic device and another person is obstructed by the use of the electronic device.

It is a diagram showing an example of the hardware configuration of a detection system. It is a figure showing an example of application of a detection system. FIG. 2 is a diagram showing an example of a functional configuration of a detection system. 3 is a flowchart showing the flow of processing executed by the detection system. It is a figure which shows the example of a request evaluation result obtained by the request evaluation part. It is a figure which shows the example of a correspondence evaluation result obtained by the correspondence evaluation part. It is a flowchart showing the detailed flow of the technoference detection process (S403). FIG. 7 is a diagram illustrating an example in which the technoference score at the current time is determined to be equal to or higher than the threshold value THα. FIG. 7 is a diagram illustrating an example in which the sum of technoference scores for the past Tn minutes from the current time is determined to be greater than or equal to the threshold value THβ. 12 is a flowchart showing a detailed flow of technoference notification processing (S404). It is a figure showing an example of application of a detection system. FIG. 2 is a diagram showing an example of a functional configuration of a detection system. It is a figure which shows the example of a correspondence evaluation result obtained by the correspondence evaluation part. It is a figure showing an example of application of a detection system. FIG. 2 is a diagram showing an example of a functional configuration of a detection system. It is a figure which shows the example of a request evaluation result obtained by the request evaluation part.

Hereinafter, embodiments of the technology of the present disclosure will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the technology of the present disclosure according to the claims, and all the combinations of features described in the embodiments are essential to the solution of the technology of the present disclosure. Not necessarily. Identical components are given the same reference numerals and explanations will be omitted.

<<Embodiment 1>>
FIG. 1 is a diagram showing an example of the hardware configuration of a detection system 100 according to the present embodiment. The detection system 100 has a detection function for detecting technoferences, which will be described in detail later. Note that the technoference detection function can be set to be enabled or disabled during a specific period such as a specific day, specific day of the week, or specific time, for example.

The detection system 100 has a CPU 101, a ROM 102, a RAM 103, a communication IF (interface) 104, and an input/output IF 105, and each component is connected by a bus 106 so that data can be transmitted and received.

A CPU (central processing unit) 101 controls the operation of the detection system 100 in accordance with programs stored in the ROM 102 and programs loaded into the RAM 103. The ROM 102 is a read-only memory, and stores a boot program, firmware, various processing programs for realizing the processing described later, and various data. The RAM 103 is a work memory that temporarily stores programs and data for processing by the CPU 101, and various processing programs and data are loaded by the CPU 101.

The communication IF 104 is an interface for controlling communication with an external device (not shown) via a network, and sends and receives data via the network. The input/output IF 105 is an interface that connects to devices that input and output data, such as a sound collector 311, a display 312, and a loudspeaker 313, which will be described in detail later.

<Application example of detection system>
FIG. 2 is a diagram showing an example of application of the detection system according to this embodiment. A device user 201 who uses a smartphone 211 and a device non-user 202 who does not use an electronic device such as the smartphone 211 are in the same room, and the device non-user 202 requests communication from the device user 201. Suppose that it is a scene. Note that here, it is assumed that the detection system 100 is applied to the smartphone 211. Device users (hereinafter referred to as users) 201 and non-device users (hereinafter referred to as non-users) 202 include, but are not limited to, caregivers of children and the children. and may also be a caregiver who brings up the child. Furthermore, the device user is not limited to a caregiver, but may also be a childcare worker or another unrelated third party. Further, the non-user does not have to be a child, but may be anyone who wants to communicate with the user. For example, the user may be the user's spouse, brother or sister, or a third party who is not related by blood. Alternatively, it may be someone else.

The smartphone 211 is a device (electronic device) operated by the user 201. The smartphone 211 acquires information regarding the status (history) of the usage of the smartphone 211 by the user 201 as usage information. Furthermore, the smartphone 211 acquires sounds generated in the surrounding environment of the smartphone 211, such as sounds emitted by the user 201 and sounds emitted by the non-user 202, as audio information. Note that in this embodiment, an example of application of the detection system 100 to the smartphone 211 has been shown, but the present invention is not limited to this. The detection system 100 may be applied to electronic devices other than the smartphone 211.

<Functional configuration of detection system>
FIG. 3 is a diagram showing an example of the functional configuration of the detection system 100 according to the present embodiment. The detection system 100 includes a voice acquisition section 301, a request evaluation section 302, a usage information acquisition section 303, and a correspondence evaluation section 304. The detection system 100 further includes a technoference detection unit (hereinafter referred to as TF detection unit) 305 and a technoference notification unit (hereinafter referred to as TF notification unit) 306. The detection system 100 is connected to external devices such as a sound collector 311, a display 312, and a loudspeaker 313. Note that the sound collector 311, the display 312, and the loudspeaker 313 are not limited to being connected to the detection system 100, but may be included inside the detection system 100.

The audio acquisition unit 301 acquires audio information collected by the sound collector 311 connected to the detection system 100. When a user 201 and a non-user 202 are in the same room and the detection system 100 is applied to the smartphone 211 used by the user 201, the audio information acquired by the audio acquisition unit 301 is as follows. Contains audio information. That is, the audio information acquired by the audio acquisition unit 301 includes the device user's audio information indicating the audio uttered by the user 201. Alternatively, the voice information acquired by the voice acquisition unit 301 includes voice information of a device non-user indicating the voice uttered by the non-user 202. Alternatively, the audio information acquired by the audio acquisition unit 301 includes audio information of both device users and non-device users. Note that the audio information acquired by the audio acquisition unit 301 is sent to the request evaluation unit 302 and the response evaluation unit 304.

The request evaluation unit 302 evaluates the request evaluation items described in detail later regarding the communication request from the non-user 202 to the user 201 based on the voice information (first voice information) acquired by the voice acquisition unit 301. Find the required evaluation value. Specifically, first, the voice information of the user 201 (second voice information) and the voice information of the non-user 202 (third voice information) are registered in advance, and the voice information (not shown) Assume that it is stored in the storage section. Next, using the second and third voice information registered in advance, it is determined whether the first voice information includes third voice information (voice information of the non-user 202). Subsequently, when a determination result indicating that the third audio information is included is obtained, a portion of the first audio information that includes the third audio information is analyzed. As a result of this analysis, information regarding the presence or absence of a request to the device user, the emotion (type/intensity) of the non-device user, and the age/age of the non-device user is obtained. A corresponding request evaluation value is determined from the obtained information. Details of the required evaluation value will be described later. The obtained request evaluation value is sent to the TF detection unit 305.

The usage information acquisition unit 303 acquires usage information generated by the smartphone 211 and indicating the usage status of an electronic device (device). The usage information includes information indicating whether the user 201 is using the smartphone 211. Note that at least when the screen of the smartphone 211 is lit, the usage information includes this state as information indicating that the smartphone 211 is being used. The usage information acquired by the usage information acquisition unit 303 is sent to the correspondence evaluation unit 304.

The response evaluation unit 304 determines the details of the response to the communication request from the non-user 202 to the user 201 based on the voice information acquired by the voice acquisition unit 301 and the usage information acquired by the usage information acquisition unit 303. Evaluate the corresponding evaluation items described below. Then, a corresponding evaluation value is determined based on the evaluation result. Specifically, it is determined whether the response corresponds to the communication request of the non-user 202. If there is no voice information from the user 201 within a predetermined time in response to a communication request from the non-user 202, it is determined that there is no response to the request. Further, even if there is voice information of the user 201 within a predetermined time, if this voice information of the user 201 differs from response information registered in advance, it is determined that there is no response to the request. On the other hand, if the response information is the same as the previously registered response information, it is determined that there is a response to the request. If a determination result of no response is obtained, an evaluation result of "inappropriate" is obtained. On the other hand, if a response is determined, an evaluation result of "appropriate" is obtained. Then, a corresponding evaluation value corresponding to the evaluation result is determined. Details of the correspondence evaluation value will be described later. The obtained correspondence evaluation value is sent to the TF detection unit 305.

Based on the request evaluation value and the response evaluation result, the TF detection unit 305 detects a state in which communication between the user 201 and the non-user 202 is obstructed due to the use of the smartphone 211 (electronic device) (hereinafter referred to as technoference). ) is detected. Technoference refers to a state in which communication between a caregiver of a child, such as an infant, and the child being cared for by the caregiver is obstructed by the use of electronic devices. Details of the detection process will be described later. Note that the TF detection unit 305 can be said to determine the presence or absence of technoference, since there are cases in which technoference is detected and cases in which technoference is not detected as a result of the detection process described above. The detection result is sent to the TF notification unit 306.

The TF notification unit 306 executes technoference notification processing based on the technoference detection result detected by the TF detection unit 305 . Details of the technoference notification process will be described later. The technoference notification destination is both the display 312 and the loudspeaker 313, but is not limited thereto. The technoference notification destination may be only the display 312, only the loudspeaker 313, or a device other than the display 312 and the loudspeaker 313.

<Processing executed by the detection system>
FIG. 4 is a flowchart showing the flow of processing executed by the detection system. The CPU 101 reads a program that implements the flowchart shown in FIG. 4 stored in the ROM 102, and executes the program using the RAM 103 as a work area. Thereby, the CPU 101 plays a role as each functional configuration shown in FIG. Assume that the technoference detection function described above is enabled. Note that the symbol "S" in the explanation of the flowchart represents a step. This point also applies to the description of the flowcharts below.

In S401, the request evaluation unit 302 detects a communication request from the non-user 202 to the user 201 based on the voice information acquired by the voice acquisition unit 301. Note that regarding the detection of the presence or absence of a request to the device user, voice information registered in advance as described above may be used, or the technique described in the above-mentioned Non-Patent Document 1 may be used. Then, the request evaluation unit 302 evaluates the request evaluation items for the request based on the detection result of the request and the audio information acquired by the audio acquisition unit 301, and calculates a request evaluation value. The calculated request evaluation value is sent to the TF detection unit 305.

In S402, the response evaluation unit 304 evaluates the response of the user 201 to the communication request from the non-user 202 based on the voice information acquired by the voice acquisition unit 301 and the usage information acquired by the usage information acquisition unit 303. Calculate the evaluation value. That is, the response evaluation unit 304 evaluates the response evaluation items regarding the response of the user 201 to the request, and calculates a response evaluation value. The calculated correspondence evaluation value is sent to the TF detection unit 305.

In S403, the TF detection unit 305 executes technoference detection processing based on the request evaluation value calculated in S401 and the corresponding evaluation value calculated in S402. Details of the technoference detection process will be described later. The technoference detection results are sent to the TF notification unit 306.

In S404, the TF notification unit 306 executes technoference notification processing. Details of the technoference notification process will be described later. Note that when the technoference notification process is completed, the flow shown in FIG. 4 ends.

<Requirements evaluation results>
FIG. 5 is a diagram showing an example of the request evaluation results calculated by the request evaluation section 302. The request evaluation result 500 includes, at each time indicated by a time 501, the evaluation result of the evaluation item 502 regarding the presence or absence of a request to the device user, the evaluation result of the evaluation item 503 regarding the emotion (type/intensity) at the time of the request, and the age/month/month. It has the evaluation results of the evaluation item 504 related to age. Time 501 represents the time when voice information of a non-device user was detected.

The evaluation item 502 regarding the presence or absence of a request to the device user includes an evaluation result regarding the presence or absence of a communication request from the non-user 202 to the user 201 based on the voice information acquired by the voice acquisition unit 301, and the evaluation result regarding the presence or absence of a communication request from the non-user 202 to the user 201. The corresponding evaluation values are shown. Regarding the presence or absence of a request to the device user, if an analysis result is obtained that the voice information acquired by the voice acquisition unit 301 includes specific voice information such as "neeee" or "papa", the request is made to the device user. I would rate it as positive. On the other hand, if an analysis result is obtained that the audio information acquired by the audio acquisition unit 301 does not include the specific information, it will be evaluated that there is no request. Note that the evaluation value corresponding to the evaluation result of "required" is 5, and the evaluation value corresponding to the evaluation result of "no request" is 0, but the present invention is not limited to this.

The evaluation item 503 regarding the emotion (type/intensity) at the time of request includes the evaluation result regarding the emotion (type/intensity) when the non-user 202 requests communication from the user 201, and the evaluation corresponding to this evaluation result. It shows the value. Regarding the evaluation of the emotion (type/intensity) at the time of the request, it is possible to use a known technique such as the technique described in Non-Patent Document 2, for example. As the type of emotion, for example, sadness, anger, nothing, etc. are detected. Additionally, medium and small levels of emotional intensity are detected. Based on these detection results, regarding the emotion (type/intensity), regarding the communication request of the non-user 202 to the user 201, it is possible to determine whether the emotion is sadness, anger, or none, and whether the emotion intensity is medium or low. We will evaluate whether there is. Regarding emotion/intensity, the evaluation value corresponding to the evaluation result of "sad/small" and "angry/small" is 1, and the evaluation value corresponding to the evaluation result of "sad/medium" and "angry/medium" is 1. 2, and the evaluation value corresponding to the evaluation result of "none" is set to 0, but the evaluation value is not limited to this.

The evaluation item 504 regarding age/age shows the evaluation result regarding the age/age of the non-user 202 based on the audio information acquired by the audio acquisition unit 301, and the evaluation value corresponding to this evaluation result. Regarding the age/age evaluation, an age estimated by analyzing audio information or a pre-registered age may be compared with personal information. Note that regarding the evaluation of age/age, for example, it is possible to use a known technique such as the technique described in Non-Patent Document 3. Regarding age/age, the evaluation value corresponding to the evaluation result of "6 months or less" is 3, the evaluation value corresponding to the evaluation result of "6 months to 12 months" is 2, and the evaluation value corresponding to the evaluation result of "12 months to 24 months" The evaluation value corresponding to the evaluation result is 1, but is not limited to this.

Regarding the above-mentioned request evaluation result 500, at time 501 "t0", evaluation item 502 is set as "Yes (5)", evaluation item 503 is set as "Sad/Slight (1)", and evaluation item 504 is set as "24". Month (1)" is shown.

<Results of response evaluation>
FIG. 6 is a diagram showing an example of a correspondence evaluation result calculated by the correspondence evaluation unit 304. The response evaluation result 600 includes, for each time indicated by a time 601, an evaluation result of an evaluation item 602 regarding whether or not a device is used, and an evaluation result of an evaluation item 603 regarding the contents of comments during response. Note that the time 601 indicates the same time as the time 501 of the request evaluation result 500.

The evaluation item 602 regarding whether or not the device is used includes an evaluation result regarding whether or not the user 201 uses the smartphone 211 at the time of a communication request from the non-user 202, based on voice information and usage information, and an evaluation value corresponding to this evaluation result. It shows. Regarding whether or not the smartphone 211 is being used, if an analysis result is obtained that the usage information includes information indicating that the smartphone 211 is being used, it is determined that the device is being used. On the other hand, if an analysis result is obtained that the usage information includes information indicating that the smartphone 211 is not used, it will be evaluated that the device is not used. Note that the evaluation value corresponding to the evaluation result of "device usage" is 3, and the evaluation value corresponding to the evaluation result of "device usage not being used" is 0, but the present invention is not limited to this.

The evaluation item 603 regarding the content of comments made during response shows the evaluation results regarding the content of comments made by the user 201 when responding to a communication request from the non-user 202, and the evaluation value corresponding to this evaluation result. Regarding the evaluation of the content of the statement, it is determined whether the response corresponds to the request of the non-user 202 by using the voice of the user 201 and the non-user 202 converted into text. Note that for converting speech into text, it is possible to use a known technique such as the technique described in Non-Patent Document 4, for example. Regarding the content of the statement made during response, if the voice information acquired by the voice acquisition unit 301 indicates that there is no response within a predetermined time after the request, the response will be evaluated as inappropriate. On the other hand, if an analysis result of the voice information acquired by the voice acquisition unit 301 indicates that there is a response within a predetermined time after the request, the request will be evaluated as appropriate. Note that the evaluation value corresponding to the evaluation result of "appropriate" is 0, and the evaluation value corresponding to the evaluation result of "inappropriate" is 2, but the present invention is not limited to this.

Regarding the above-mentioned response evaluation result 600, at time 601 "t0", evaluation item 602 shows "Yes (3)" and evaluation item 603 shows "Inappropriate (2)".

<Technoference detection processing>
FIG. 7 is a flowchart showing the detailed flow of the technoference (hereinafter referred to as TF) detection process (S403).

In S701, the TF detection unit 305 calculates the TF score at the current time and the total TF score for a certain time Tn. The TF score at the current time is calculated based on the evaluation result by the request evaluation unit 302 and the evaluation result by the correspondence evaluation unit 304. In this embodiment, for example, the evaluation results of each evaluation section are converted into numerical values, the numerical values are added together within the evaluation sections, and the numerical values are multiplied between the evaluation sections. Then, the obtained value is further multiplied by a value where the evaluation result of the evaluation item 502 regarding the presence or absence of a communication request to the device user is set as 1 if it is present, and 0 if it is not. calculate. Here, the evaluation result by the request evaluation unit 302 will be explained using the request evaluation result 500 shown in FIG. 5 as an example. The evaluation result "Yes" of the evaluation item 502 is converted to 5, the evaluation result "Sad/Slight" of the evaluation item 503 is converted to 1, and the evaluation result of evaluation item 504 "24 months" is converted to 1. Then, 5, 1, and 1 are added together to calculate 7 as the request evaluation value of the request evaluation unit 302. The evaluation result by the correspondence evaluation unit 304 will be explained using the correspondence evaluation result 600 shown in FIG. 6 as an example. The evaluation result "Yes" for the evaluation item 602 is converted to 3, and the evaluation result "Inappropriate" for the evaluation item 603 is converted to 2. Then, 3 and 2 are added together to calculate 5 as the correspondence evaluation value of the correspondence evaluation unit 304. Then, 35 is calculated by multiplying the request evaluation value of 7 and the corresponding evaluation value of 5. Since the evaluation result of the evaluation item 502 regarding the presence or absence of a request to the device user is "Yes", 35 is calculated by multiplying 35 by 1 as the TF score. Note that if the evaluation result of the evaluation item 502 regarding the presence or absence of a request to the device user is "no", 0, which is 35 multiplied by 0, is calculated as the TF score.

Further, the total TF score for a certain time Tn is the sum of n TF scores from the past to the current time. For example, if the constant time Tn is 3 and the current time is _T4 , the sum of the TF scores for the constant time _T3 is the TF score at time _T2 , the TF score at time _T3 , and the TF score at time _T4 . The value is the sum of

In S702, the TF detection unit 305 determines whether the TF score at the current time is greater than or equal to the threshold THα. If the determination result is that the TF score at the current time is not equal to or greater than the threshold THα (NO in S702), the process moves to S703. On the other hand, if the determination result is that the TF score at the current time is greater than or equal to the threshold THα (YES in S702), the process moves to S704.

In S703, the TF detection unit 305 determines whether the total TF score for a certain time Tn is equal to or greater than a threshold value THβ. That is, the TF detection unit 305 determines whether the sum of the TF scores over the past Tn from the current time is greater than or equal to the threshold THβ. If a determination result is obtained that the sum of TF scores over the past Tn from the current time is not equal to or greater than the threshold THβ (NO in S703), the process moves to S705. On the other hand, if a determination result is obtained that the sum of TF scores over the past Tn from the current time is equal to or greater than the threshold THβ (YES in S703), the process moves to S704.

In S704, the TF detection unit 305 determines that a TF has been detected. In S705, the TF detection unit 305 determines that no TF has been detected. Note that when the processing in S704 or S705 is completed, the flow shown in FIG. 7 ends.

<Detection of technoference using TF score>
FIG. 8 is a diagram showing an example in which the TF score at the current time is determined to be greater than or equal to the threshold value THα. In the example of FIG. 8, the threshold value THα is set to 40, and the fixed time Tn is set to 3. Note that the time 801 corresponds to the time 501, the evaluation item 802 corresponds to the evaluation item 502, the evaluation item 803 corresponds to the evaluation item 503, and the evaluation item 804 corresponds to the evaluation item 504. Further, the evaluation item 811 corresponds to the evaluation item 602, and the evaluation item 812 corresponds to the evaluation item 603, respectively.

At the time 801 of t0, the evaluation result (evaluation value) of the evaluation item 802 is null (0), so the TF score 821 at the current time t0 is 0. Since the TF score 821 at the current time t0 is 0, the TF score sum 822 at the current time t0 is 0.

At time 801 of t1, the evaluation result (evaluation value) of evaluation item 802 is yes (5), the evaluation result (evaluation value) of evaluation item 803 is no (0), and the evaluation result (evaluation value) of evaluation item 804 is value) is 24 months (1). Therefore, the required evaluation value is 6 (5+0+1). The evaluation result (evaluation value) of evaluation item 811 is Yes (3), and the evaluation result (evaluation value) of evaluation item 812 is Appropriate (0). Therefore, the correspondence evaluation value is 3+0. The TF score 821 at the current time t1 is obtained by multiplying the requested evaluation value of 6 at the current time t1 by the corresponding evaluation value at the current time t1 of 3. The result is 18, which is multiplied by 1 when the evaluation result is yes. The total TF score 822 for t1 is 18, which is the sum of 0 of the TF score 821 of t0 and 18 of the TF score 821 of t1.

At time 801 of t2, the evaluation result (evaluation value) of evaluation item 802 is yes (5), the evaluation result (evaluation value) of evaluation item 803 is sad/small (1), and the evaluation result of evaluation item 804 is (Evaluation value) is 24 months (1). Therefore, the required evaluation value is 7 (5+1+1). The evaluation result (evaluation value) of evaluation item 811 is yes (3), and the evaluation result (evaluation value) of evaluation item 812 is inappropriate (2). Therefore, the correspondence evaluation value is 5 (3+2). Then, the TF score 821 at the current time t2 is obtained by multiplying the requested evaluation value of 7 at the current time t2 by the corresponding evaluation value of 5 at the current time t2. The result is 35, which is multiplied by 1 when the evaluation result is yes. The total TF score 822 for t2 is 53, which is the sum of 0 of the TF score 821 of t0, 18 of the TF score 821 of t1, and 35 of the TF score 821 of t2.

At time 801 of t3, the evaluation result (evaluation value) of evaluation item 802 is yes (5), the evaluation result (evaluation value) of evaluation item 803 is sad/medium (2), and the evaluation result of evaluation item 804 is (Evaluation value) is 24 months (1). Therefore, the required evaluation value is 8 (5+2+1). The evaluation result (evaluation value) of evaluation item 811 is yes (3), and the evaluation result (evaluation value) of evaluation item 812 is inappropriate (2). Therefore, the correspondence evaluation value is 5 (3+2). The TF score 821 at the current time t3 is the value obtained by multiplying the required evaluation value of 8 at the current time t3 by the corresponding evaluation value of 5 at the current time t3, and the evaluation item 802 at the current time t3. The result is 40, which is multiplied by 1 when the evaluation result is yes. The total TF score 822 for t3 is 93, which is the sum of 18 of the TF score 821 of t1, 35 of the TF score 821 of t2, and 40 of the TF score 821 of t3.

As described above, the TF score 831 at time t3 is 40, and since this value is greater than or equal to the threshold THα, the detection of TF is confirmed, and the detection of TF is notified in S404.

<Detection of technoference by total TF score for Tn>
FIG. 9 is a diagram showing an example in which the sum of TF scores for the past Tn from the current time is determined to be greater than or equal to the threshold value THβ. In the example of FIG. 9, the threshold value THβ is set to 100, and the fixed time Tn is set to 3. Note that the time 901 corresponds to the time 501, the evaluation item 902 corresponds to the evaluation item 502, the evaluation item 903 corresponds to the evaluation item 503, and the evaluation item 904 corresponds to the evaluation item 504. Further, the evaluation item 911 corresponds to the evaluation item 602, and the evaluation item 912 corresponds to the evaluation item 603, respectively.

At the time 901 of t0, the evaluation result (evaluation value) of the evaluation item 902 is null (0), so the TF score 921 at the current time t0 is 0. Since the TF score 921 at the current time t0 is 0, the TF score total 922 at the current time t0 is 0.

At time 901 of t1, the evaluation result (evaluation value) of evaluation item 902 is Yes (5), the evaluation result (evaluation value) of evaluation item 903 is No (0), and the evaluation result (evaluation value) of evaluation item 904 is value) is 24 months (1). Therefore, the required evaluation value is 6 (5+0+1). The evaluation result (evaluation value) of evaluation item 911 is yes (3), and the evaluation result (evaluation value) of evaluation item 912 is appropriate (0). Therefore, the correspondence evaluation value is 3+0. The TF score 921 at the current time t1 is obtained by multiplying the required evaluation value of 6 at the current time t1 by the corresponding evaluation value at the current time t1 of 3. The result is 18, which is multiplied by 1 when the evaluation result is yes. The total TF score 922 for t1 is 18, which is the sum of 0 of the TF score 921 of t0 and 18 of the TF score 921 of t1.

At time 901 of t2, it is the same as at time 901 of t1, and the requested evaluation value is 6 (5+0+1), and the corresponding evaluation value is 3 (3+0). Then, the TF score 921 at the current time t2 is obtained by multiplying the required evaluation value of 6 at the current time t2 by the corresponding evaluation value at the current time t2 of 3. The result is 18, which is multiplied by 1 when the evaluation result is yes. The total TF score 922 for t2 is 36, which is the sum of 0 of the TF score 921 of t0, 18 of the TF score 921 of t1, and 18 of the TF score 921 of t2.

At time 901 of t3, the evaluation result (evaluation value) of evaluation item 902 is yes (5), the evaluation result (evaluation value) of evaluation item 903 is sad/small (1), and the evaluation result of evaluation item 904 is (Evaluation value) is 24 months (1). Therefore, the required evaluation value is 7 (5+1+1). The evaluation result (evaluation value) of evaluation item 911 is yes (3), and the evaluation result (evaluation value) of evaluation item 912 is inappropriate (2). Therefore, the correspondence evaluation value is 5 (3+2). The TF score 921 at the current time t3 is the value obtained by multiplying the required evaluation value of 7 at the current time t3 by the corresponding evaluation value of 5 at the current time t3. The result is 35, which is multiplied by 1 when the evaluation result is yes. The total TF score 922 for t3 is 71, which is the sum of 18 of the TF score 921 of t1, 18 of the TF score 921 of t2, and 35 of the TF score 921 of t3.

At time 901 of t4, the evaluation result (evaluation value) of evaluation item 902 is Yes (5), the evaluation result (evaluation value) of evaluation item 903 is No (0), and the evaluation result (evaluation value) of evaluation item 904 is value) is 24 months (1). Therefore, the required evaluation value is 6 (5+0+1). The evaluation result (evaluation value) of evaluation item 911 is yes (3), and the evaluation result (evaluation value) of evaluation item 912 is inappropriate (2). Therefore, the correspondence evaluation value is 5 (3+2). The TF score 921 at the current time t3 is the value obtained by multiplying the requested evaluation value of 6 at the current time t4 by the corresponding evaluation value of 5 at the current time t4, and the evaluation item 902 at the current time t4. The result is 30, which is multiplied by 1 when the evaluation result is yes. The total TF score 922 for t3 is 83, which is the sum of 18 of the TF score 921 of t2, 35 of the TF score 921 of t3, and 30 of the TF score 921 of t4.

At time 901 of t5, it is the same as at time 901 of t3, the request evaluation value is 7 (5+1+1), and the corresponding evaluation value is 5 (3+2). The TF score 921 at the current time t5 is the value obtained by multiplying the requested evaluation value of 7 at the current time t5 by the corresponding evaluation value of 5 at the current time t5, and the evaluation item 902 at the current time t5. The result is 35, which is multiplied by 1 when the evaluation result is yes. The total TF score 922 for t3 is 100, which is the sum of 35 of the TF score 921 of t3, 30 of the TF score 921 of t4, and 35 of the TF score 921 of t5.

As described above, the total TF score 931 at time t5 is 100, and since this value is greater than or equal to the threshold THβ, the detection of TF is confirmed, and the detection of TF is notified in S404.

<TF notification processing>
FIG. 10 is a flowchart showing the detailed flow of the TF notification process (S404).

In S1001, the TF notification unit 306 determines whether the TF detection unit 305 has detected a TF. If the determination result is that a TF has been detected (YES in S1001), the process moves to S1002. On the other hand, if the determination result is that no TF has been detected (NO in S1001), the flow shown in FIG. 10 ends. That is, since no TF is detected, the TF notification unit 306 finishes the TF notification process without notifying the device of the message.

In S1002, the TF notification unit 306 determines whether the basis for detecting a TF is greater than or equal to a threshold value THα. If a determination result is obtained that the basis for detecting TF is not equal to or greater than the threshold THα (NO in S1002), the process moves to S1005. On the other hand, if a determination result is obtained that the detection of TF is greater than or equal to the threshold THα (YES in S1002), the process moves to S1003.

In S1003, the TF notification unit 306 determines whether the number of times the threshold value THα has been exceeded is equal to or greater than the threshold value THΓ within a certain period of time. The fixed period is, for example, 12 hours, but is not limited to this. The threshold value THΓ is, for example, 5, but is not limited thereto. If a determination result is obtained that the number of times the threshold value THα has been exceeded is not equal to or greater than the threshold value THΓ within a certain period of time (NO in S1003), the process moves to S1005. On the other hand, if a determination result is obtained that the number of times the threshold value THα has been exceeded is equal to or greater than the threshold value THΓ within a certain period (YES in S1003), the process moves to S1004.

In S1004, the TF notification unit 306 executes processing to restrict the use of the smartphone 211 by the user 201. This process includes, for example, disabling functions other than telephone and email functions such as running entertainment applications, or changing notifications from each application to be received once an hour instead of individually. This includes, but is not limited to, processing to reduce notification frequency.

In S1005, the TF notification unit 306 notifies the smartphone 211 used by the user 201 of a message indicating that there is a high possibility that technoference is currently occurring.

As described above, according to the present embodiment, a communication request from a non-user 202 to a user 201 of an electronic device and a response of the user 201 to the request are evaluated. Based on the request evaluation result and response evaluation result, it is determined whether communication between the user 201 and the non-user 202 is being obstructed by the use of the electronic device. Then, if it is determined that communication is being inhibited, a notification is sent that communication is being inhibited. By providing such notification, it is possible to recognize that communication between the user 201 and the non-user 202 is being obstructed by the use of the electronic device.

<<Embodiment 2>>
In this embodiment, in addition to voice information and usage information, information regarding the user's face image is acquired, and the response of the user 201 to the request is evaluated based on the acquired information, thereby achieving more accurate TF detection processing. The manner in which this is executed will be explained.

<Application example of detection system>
FIG. 11 is a diagram showing an application example of the detection system according to this embodiment. Suppose that a user 201 who uses a smartphone 211 and a non-user 202 who does not use an electronic device such as the smartphone 211 are in the same room, and the non-user 202 requests communication from the user 201. do. Note that here, it is assumed that the detection system of this embodiment is applied to a smartphone 211 that is equipped with an imaging device 1101 that performs imaging. Note that the imaging device 1101 is, for example, a front camera located on the operation panel side of the smartphone 211.

The smartphone 211 is a device (electronic device) operated by the user 201. The smartphone 211 acquires usage information indicating how the user 201 used the smartphone 211 and audio information regarding sounds surrounding the smartphone 211 . Further, in the smartphone 211, the imaging device 1101 images the user 201 to obtain a facial image (still image or video) of the user 201.

<Functional configuration of detection system>
FIG. 12 is a diagram showing an example of the functional configuration of a detection system 1200 according to this embodiment. In this embodiment, differences from the detection system 100 of Embodiment 1 will be mainly explained. The detection system 1200 includes the functional units 301 to 306 included in the detection system 100 of the first embodiment and an image acquisition unit 1201. The detection system 1200 is connected to an imaging device 1101, which is an external device. Note that the imaging device 1101 is not limited to a configuration in which it is connected to the detection system 1200, but may be included in the detection system 1200.

The image acquisition unit 1201 acquires a captured image obtained by capturing an image with the imaging device 1101 of the smartphone 211 connected to the detection system 1200. The acquired captured image is provided to the correspondence evaluation unit 304 of the detection system 1200.

Similar to Embodiment 1, the response evaluation unit 304 of this embodiment evaluates predetermined response evaluation items regarding the response to the communication request from the non-user 202 to the user 201 based on the voice information and usage information. Furthermore, the response evaluation unit 304 evaluates response evaluation items, which will be described in detail later, regarding the response to the communication request from the non-user 202 to the user 201, based on the captured image acquired by the image acquisition unit 1201. Then, a corresponding evaluation value is determined based on the evaluation results. Note that, in S402, the response evaluation unit 304 of this embodiment evaluates response evaluation items regarding the response of the user 201 to the request based on the audio information, usage information, and captured image, and calculates a response evaluation value. The calculated correspondence evaluation value is sent to the TF detection unit 305 and used to calculate the TF score and the TF score total.

<Results of response evaluation>
FIG. 13 is a diagram showing an example of a correspondence evaluation result calculated by the correspondence evaluation unit 304 included in the detection system 1200. Note that the correspondence evaluation result example shown in FIG. 13 will be explained with a focus on the differences from the correspondence evaluation result example shown in FIG. 6. Time 1301 corresponds to time 601, evaluation item 1302 corresponds to evaluation item 602, and evaluation item 1303 corresponds to evaluation item 603.

The response evaluation result 1300 includes, for each time indicated by a time 1301, an evaluation result of an evaluation item 1302 regarding whether or not a device is used, and an evaluation result of an evaluation item 1303 regarding the contents of comments during response. Further, the correspondence evaluation result 1300 includes the evaluation result of the evaluation item 1304 regarding whether the line of sight is a device or not for each time indicated by the time 1301.

The evaluation item 1304 regarding whether the line of sight is on the device includes an evaluation result regarding whether the line of sight (line of sight) of the user 201 is on the screen of the device (smartphone 211) based on the captured image acquired by the image acquisition unit 1201; An evaluation value corresponding to the evaluation result is shown. That is, when the user 201 is looking at the smartphone 211 when responding to the request, this indicates that the user 201 is not looking at the non-user 202 . Further, when responding to a request, if the line of sight of the user 201 is not the smartphone 211, this indicates that the user 201 may be looking at the non-user 202.

Regarding whether the line of sight of the user 201 is on the screen of the device (smartphone 211), it is possible to use a known technique such as the technique described in Non-Patent Document 5, for example. Regarding whether the line of sight is at the device, if the captured image is analyzed and an analysis result is obtained that the line of sight of the user 201 is at the screen of the device, the evaluation is ``Yes''. On the other hand, if the captured image is analyzed and an analysis result is obtained that the user 201's line of sight is not at the device screen, the evaluation will be No. That is, it can be said that the captured image is analyzed to acquire the user's 201's line of sight information, and based on the acquired line of sight information, it is evaluated whether the user's 201's line of sight is towards the device. Note that the evaluation value corresponding to an evaluation result of "Yes" is 2, and the evaluation value corresponding to an evaluation result of "No" is 0, but the present invention is not limited to this.

Regarding the above-mentioned response evaluation result 1300, at time 1301 "t0", evaluation item 1302 is set as "Yes (3)", evaluation item 1303 is set as "Inappropriate (2)", and evaluation item 1304 is set as "Yes ( 2). In the correspondence evaluation result 1300, 7 (3+2+2) is calculated as the correspondence evaluation value.

As explained above, according to the present embodiment, the line of sight information of the user 201 obtained by analyzing the captured image is used to determine whether the user 201's line of sight is on the screen of the smartphone 211. It can be used to evaluate the correspondence of 201. Thereby, it is determined with higher accuracy whether communication between the user 201 and the non-user 202 is being obstructed by the use of the electronic device. Then, if it is determined that communication is being inhibited, a notification is sent that communication is being inhibited. By providing such notification, it is possible to recognize that communication between the user 201 and the non-user 202 is being obstructed by the use of the electronic device.

<<Embodiment 3>>
In this embodiment, in addition to voice information, location information of users and non-users, and information indicating the direction of the non-user's face are acquired, and the non-user's request is evaluated based on the acquired information. Now, a mode of executing TF detection processing with higher accuracy will be described.

<Application example of detection system>
FIG. 14 is a diagram showing an example of application of the detection system according to this embodiment. Suppose that a user 201 who uses a smartphone 211 and a non-user 202 who does not use an electronic device such as the smartphone 211 are in the same room, and the non-user 202 requests communication from the user 201. do. Note that here, an imaging device 1401 is installed indoors, images a user 201 and a non-user 202, and obtains a captured image (still image or video) including the user 201 and the non-user 202. Suppose it is possible. The acquired captured image is sent to the smartphone 211 via a communication means (not shown). Assume that the detection system of this embodiment is applied to the smartphone 211.

<Functional configuration of detection system>
FIG. 15 is a diagram showing an example of the functional configuration of a detection system 1500 according to this embodiment. In this embodiment, differences from the detection system 100 of Embodiment 1 will be mainly explained. The detection system 1500 includes the functional units 301, 302, 304-306 included in the detection system 100 of the first embodiment, and an image acquisition unit 1501. The detection system 1500 is connected to an imaging device 1401, which is an external device. It is assumed that the direction of the imaging device 1401 can be rotated (pan) about the vertical direction with respect to the attitude of the imaging device 1401, and rotated (tilt) about the horizontal direction with respect to the attitude of the imaging device 1401.

The image acquisition unit 1501 acquires a captured image captured by an imaging device 1401 connected to the detection system 1500. The acquired captured image is provided to the request evaluation section 302 and the correspondence evaluation section 304 of the detection system 1500.

The request evaluation unit 302 of this embodiment detects a communication request from the non-user 202 to the user 201, as in the first embodiment. Then, the request evaluation unit 302 evaluates the request on predetermined request evaluation items based on the detection result of the request and the audio information. Further, the request evaluation unit 302 evaluates the request evaluation items, which will be described in detail later, regarding the request of the non-user 202 based on the captured image acquired by the image acquisition unit 1501. Then, a required evaluation value is determined based on the evaluation results. Note that the request evaluation unit 302 of this embodiment detects a communication request from the non-user 202 to the user 201 in S401 based on voice information. Then, the request evaluation unit 302 evaluates the request evaluation items for the request based on the detection result of the request, the audio information, and the captured image, and calculates the request evaluation value. The calculated request evaluation value is sent to the TF detection unit 305 and used to calculate the TF score and the TF score total.

The response evaluation unit 304 of this embodiment evaluates the response evaluation items regarding the response to the communication request from the non-user 202 to the user 201 based on the audio information and the captured image acquired by the image acquisition unit 1501. Then, a corresponding evaluation value is determined based on the evaluation result. Note that, in S402, the response evaluation unit 304 of this embodiment evaluates response evaluation items regarding the response of the user 201 to the request based on the audio information and the captured image, and calculates a response evaluation value. The calculated correspondence evaluation value is sent to the TF detection unit 305 and used to calculate the TF score and the TF score total.

<Requirements evaluation results>
FIG. 16 is a diagram showing an example of a request evaluation result calculated by the request evaluation unit 302 included in the detection system 1500. Note that the request evaluation result example shown in FIG. 16 will be explained with a focus on the differences from the request evaluation result example shown in FIG. 5. Time 1601 corresponds to time 501, evaluation item 1602 corresponds to evaluation item 502, evaluation item 1603 corresponds to evaluation item 503, and evaluation item 1604 corresponds to evaluation item 504.

The request evaluation result 1600 includes, at each time indicated by time 1601, the evaluation result of the evaluation item 1602 regarding the presence or absence of a request to the device user, the evaluation result of the evaluation item 1603 regarding the emotion (type/intensity) at the time of the request, and the age/month/month. It has the evaluation results of the evaluation item 1604 related to age. Further, the request evaluation result 1600 includes, at each time indicated by time 1601, the evaluation result of the evaluation item 1605 regarding whether the face direction is that of the device user (user 201), It has the evaluation result of the evaluation item 1606 regarding the distance.

The evaluation item 1605 regarding whether the face direction of the non-user 202 is the user 201 is based on the captured image acquired by the image acquisition unit 1501, and the evaluation result regarding whether the face direction of the non-user 202 is the user 201. An evaluation value corresponding to the evaluation result is shown.

Regarding whether the face direction is that of the user 201, it is possible to use a known technique such as the technique described in Non-Patent Document 6, for example. Regarding whether the face direction of the non-user 202 is the user 201, if the captured image is analyzed and an analysis result is obtained that the face direction of the non-user 202 is the user 201, then the evaluation is ``Yes''. On the other hand, if the captured image is analyzed and an analysis result is obtained that the face direction of the non-user 202 is not the user 201, the evaluation will be No. That is, it can be said that the captured image is analyzed to obtain face information of the non-user 202, and based on the obtained face information, it is evaluated whether the face orientation of the non-user 202 is that of the user 201. Note that the evaluation value corresponding to an evaluation result of "Yes" is 1, and the evaluation value corresponding to an evaluation result of "No" is 0, but the present invention is not limited to this.

The evaluation item 1606 regarding the distance to the user 201 includes an evaluation result regarding the distance between the non-user 202 and the user 201 based on the captured image acquired by the image acquisition unit 1501, and an evaluation value corresponding to this evaluation result. It shows.

Regarding the distance to the user 201, it is possible to use known techniques such as those described in Non-Patent Documents 7 and 8, for example. Regarding the distance to the user 201, if the captured image is analyzed and an analysis result is obtained that the distance between the non-user 202 and the user 201 is less than a predetermined value, it is evaluated that the non-user 202 and the user 201 are close. On the other hand, if the captured image is analyzed and it is determined that the distance between the non-user 202 and the user 201 is not less than the predetermined value, the distance between the non-user 202 and the user 201 is determined to be far. That is, the captured image is analyzed to obtain location information of the non-user 202 and the user 201, and based on the obtained location information, it is evaluated whether the distance between the non-user 202 and the user 201 is less than a predetermined value. I can say that. Note that the evaluation value corresponding to the evaluation result of "near" is 1, and the evaluation value corresponding to the evaluation result of "far" is 0, but the present invention is not limited to this.

Regarding the above-mentioned request evaluation result 1600, at time 1601 "t0", evaluation item 1602 is ``Yes (5)'', evaluation item 1603 is ``Sad/Slight (1)'', and evaluation item 1604 is ``24''. Month (1)" is shown. Further, regarding the request evaluation result 1600, at time 1601 "t0", evaluation item 1605 indicates "Yes (1)" and evaluation item 1606 indicates "Near (1)". In the request evaluation result 1600, 9 (5+1+1+1+1) is obtained as the request evaluation value.

As explained above, according to the present embodiment, it is also possible to determine whether the non-user 202's face is facing the user 201 by using the face information of the non-user 202 obtained by analyzing the captured image. It can be used to evaluate requirements. Further, the distance between the non-user 202 and the user 201 can also be used to evaluate the request by using the position information of the user 201 and the non-user 202 obtained by analyzing the captured image. Thereby, it is determined with higher accuracy whether communication between the user 201 and the non-user 202 is being obstructed by the use of the electronic device. Then, if it is determined that communication is being inhibited, a notification is sent that communication is being inhibited. By providing such notification, it is possible to recognize that communication between the user 201 and the non-user 202 is being obstructed by the use of the electronic device.

The technology of the present disclosure can also be implemented as, for example, a system, a device, a data processing method, a program, a storage medium, or the like. Specifically, the present invention may be applied to a system composed of a plurality of devices, or to a device composed of a single device.

Further, the technology of the present disclosure can also be realized by executing the following processing. That is, the software (program) that realizes the functions of the embodiments described above is supplied to a system or device via a network or various storage media, and the computer (or CPU or MPU) of the system or device reads and executes the program. This is the process of

(Other embodiments)
In the above, a mode has been described in which the TF detection result is notified to the smartphone 211 operated by the user 201, but the notification destination is not limited to this. For example, if the non-user 202 is a child and the user 201 is the father of the non-user 202, the notification may be sent to a smartphone held by the mother of the non-user 202. Alternatively, the notification may be sent to a display device such as a television set in the room. If the non-user 202 is an infant and the user 201 is a childcare worker who is caring for the non-user 202, the notification may be sent to a smartphone held by another childcare worker other than the childcare worker. Further, the notification may be sent to a smartphone owned by the head childcare worker, or to a display device installed in the childcare worker's staff room.

In the above description, when a state in which communication between the user 201 and the non-user 202 is blocked due to the use of the smartphone 211 is detected, a notification is given that communication is blocked. , but not limited to. When it is detected that the communication between the user 201 and the non-user 202 is not obstructed due to the use of the smartphone 211, a notification may be made that the communication is not obstructed. It may be detected whether communication between the user 201 and the non-user 202 is being obstructed by the use of the smartphone 211, and information regarding the state may be notified based on the detection result.

Although the above describes the notification process of notifying the device of a message when a predetermined condition is met, the present invention is not limited to this. For example, an alarm may be used for notification. Further, depending on the number of detections, processing may be performed to add weight to the notification content, such as changing the content of the message to be notified, or changing the type and volume of the alarm. Further, when the number of notifications exceeds a predetermined value, processing may be performed such as forcibly shutting down the electronic device.

In the above, the request evaluation value is calculated from all evaluation values such as presence or absence of a request to the device user, emotion at the time of the request, and age in months, and also calculates the request evaluation value from the evaluation values of the device user, the direction of the face of the non-user, and the distance from the user. Although a case has been described in which the required evaluation value is calculated from the evaluation value of , the present invention is not limited to this. The request evaluation value may be calculated from the evaluation value of at least one of the emotion at the time of the request, the age in months, the direction of the non-user's face, and the distance from the user, and the evaluation value of whether or not the request is made to the device user. .

Further, a process of supplying a program that implements one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in a computer of the system or device read and execute the program. But it is possible. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

The disclosure of this embodiment includes the following configuration example, method example, and program example.

(Configuration 1)
a first evaluation means for evaluating a communication request from another person to a user using an electronic device;
a second evaluation means for evaluating the user's response to the request;
Based on the first evaluation result by the first evaluation means and the second evaluation result by the second evaluation means, communication between the user and the other person is hindered by the use of the electronic device. determination means for determining whether the state is
Notifying means for notifying that the communication is being inhibited when the determining means determines that the communication is being inhibited;
An information processing device comprising:

(Configuration 2)
further comprising an acquisition means for acquiring voices of the user and the other person, or a captured image including the user and the other person, or the voice and the captured image,
The information processing according to configuration 1, wherein the first evaluation means evaluates the request based on the voice, the captured image, or an analysis result obtained by analyzing the voice and the captured image. Device.

(Configuration 3)
The information processing device according to configuration 2, wherein the first evaluation means evaluates the request based on the presence or absence of the request obtained through the analysis.

(Configuration 4)
The first evaluation means includes the emotion of the other person at the time of the request obtained from the analysis, the age of the other person obtained from the analysis, the orientation of the other person's face obtained from the analysis, and the analysis. 4. The information processing apparatus according to configuration 2 or 3, wherein the request is evaluated based on at least one of the distances between the other person and the user obtained in the above and whether or not the request is made.

(Configuration 5)
The first evaluation means includes a detection means for detecting the request,
Configuration 2 characterized in that the detection means detects the request based on at least one of the content of the statement obtained by analyzing the voice and the age of the other person obtained by analyzing the voice. The information processing device according to any one of 4 to 4.

(Configuration 6)
The acquisition means may acquire the voice of the user and the other person, or a captured image including the user and the other person, or usage information indicating the usage status of the electronic device, or the voice, the captured image, and the usage information. Get a combination of information,
The second evaluation means evaluates the response based on an analysis result obtained by analyzing the audio, the captured image, the usage information, or a combination of the audio, the captured image, and the usage information. The information processing device according to any one of features 2 to 5.

(Configuration 7)
The second evaluation means includes whether or not the user uses the electronic device, which is obtained from the analysis, what the user says when responding, which is obtained from the analysis, and the information obtained from the analysis. The information processing device according to configuration 6, wherein the correspondence is evaluated based on at least one of the user's gaze directions.

(Configuration 8)
The determining means is configured to evaluate the communication based on a current evaluation value based on the current first evaluation result and the second evaluation result, and a sum of evaluation values for a predetermined number of times in the past including the current evaluation value. 8. The information processing apparatus according to any one of configurations 1 to 7, wherein the information processing apparatus determines whether or not the information processing apparatus is in a state in which the information processing apparatus is inhibited.

(Configuration 9)
9. The information processing device according to any one of configurations 1 to 8, wherein the user is a caregiver, and the other person is a child raised by the caregiver.

(Configuration 10)
9. The information processing device according to any one of configurations 1 to 8, wherein the user is a child, and the other person is a caregiver who takes care of the child.

(Method 1)
a first evaluation step of evaluating communication requests from others to users of electronic devices;
a second evaluation step of evaluating the user's response to the request;
Based on the first evaluation result from the first evaluation step and the second evaluation result from the second evaluation step, communication between the user and the other person is hindered by the use of the electronic device. a determination step of determining whether the state is
a notification step of notifying that the communication is being inhibited when it is determined in the determining step that the communication is being inhibited;
An information processing method characterized by comprising:

(Program 1)
A program for causing a computer to function as means for the information processing apparatus according to any one of Configurations 1 to 10.

Claims (12)

a first evaluation means for evaluating a communication request from another person to a user using an electronic device;
a second evaluation means for evaluating the user's response to the request;
Based on the first evaluation result by the first evaluation means and the second evaluation result by the second evaluation means, communication between the user and the other person is hindered by the use of the electronic device. determination means for determining whether the state is
Notifying means for notifying that the communication is being inhibited when the determining means determines that the communication is being inhibited;
An information processing device comprising: further comprising an acquisition means for acquiring voices of the user and the other person, or a captured image including the user and the other person, or the voice and the captured image,
The information according to claim 1, wherein the first evaluation means evaluates the request based on the voice, the captured image, or an analysis result obtained by analyzing the voice and the captured image. Processing equipment. The information processing apparatus according to claim 2, wherein the first evaluation means evaluates the request based on the presence or absence of the request obtained through the analysis. The first evaluation means includes the emotion of the other person at the time of the request obtained from the analysis, the age of the other person obtained from the analysis, the orientation of the other person's face obtained from the analysis, and the analysis. 4. The information processing apparatus according to claim 3, wherein the request is evaluated based on at least one of the distances between the other person and the user obtained from the above and the presence or absence of the request. The first evaluation means includes a detection means for detecting the request,
The detection means detects the request based on at least one of the content of the statement obtained by analyzing the voice and the age of the other person obtained by analyzing the voice. 2. The information processing device according to 2. The acquisition means may acquire the voice of the user and the other person, or a captured image including the user and the other person, or usage information indicating the usage status of the electronic device, or the voice, the captured image, and the usage information. Get a combination of information,
The second evaluation means evaluates the response based on an analysis result obtained by analyzing the audio, the captured image, the usage information, or a combination of the audio, the captured image, and the usage information. The information processing device according to claim 2. The second evaluation means includes whether or not the user uses the electronic device, which is obtained from the analysis, what the user says when responding, which is obtained from the analysis, and the information obtained from the analysis. The information processing device according to claim 6, wherein the correspondence is evaluated based on at least one of the user's gaze directions. The determining means is configured to evaluate the communication based on a current evaluation value based on the current first evaluation result and the second evaluation result, and a sum of evaluation values for a predetermined number of times in the past including the current evaluation value. The information processing apparatus according to claim 1, wherein the information processing apparatus determines whether or not the information processing apparatus is in a state where the information processing apparatus is inhibited. The information processing device according to claim 1, wherein the user is a caregiver, and the other person is a child raised by the caregiver. The information processing apparatus according to claim 1, wherein the user is a child, and the other person is a caregiver who takes care of the child. a first evaluation step of evaluating communication requests from others to users of electronic devices;
a second evaluation step of evaluating the user's response to the request;
Based on the first evaluation result from the first evaluation step and the second evaluation result from the second evaluation step, communication between the user and the other person is hindered by the use of the electronic device. a determination step of determining whether the state is
a notification step of notifying that the communication is being inhibited when it is determined in the determining step that the communication is being inhibited;
An information processing method characterized by comprising: A program for causing a computer to function as means for the information processing apparatus according to claim 1.

Images