JP2019009666A - Information processing method and information processing device - Google Patents

Abstract

To support promotion of a better understanding of another child carer concerning a situation where a child and a child carer share a time together.SOLUTION: In an information processing method, a processor is used to acquire voice information to be obtained by voice collection by a voice collection device, identify the voice of a child and the voice of an adult included in voice indicated by voice information, determine a state of the child on the basis of the identified voice of the child, determine a state of the adult on the basis of the identified voice of the adult, and generate a report in accordance with a determined state of the child, a determined state of the adult, and a destination of the report concerning a state of the adult (steps S16 and S25). Then, the generated report is transmitted to a destination (step S17).SELECTED DRAWING: Figure 6

Description

  The present disclosure relates to an information processing method and an information processing apparatus.

  In a system for sharing information on child-raising, there is a conventional method for diagnosing a child's condition from a child's voice and notifying a parent (childcare person, for example, a child's mother) who is away from the child of the child's condition. Proposed.

  For example, Patent Document 1 discloses a technique for detecting a child's cry and notifying a guardian's terminal of the situation on condition that the child's cry is continuously emitted for a predetermined time or longer.

Japanese Patent No. 480596

  However, in the technique disclosed in Patent Document 1, only the situation of a child is diagnosed, and the diagnosis result is notified to a child-care worker in a remote place. With this technique, information regarding the situation in which the child and the child-care worker spend together cannot be shared with other child-care workers (for example, the father of the child).

  Therefore, the present invention provides an information processing method that supports further deepening the understanding of other child-caregivers about the situation where the child and the child-caregiver spend together.

  An information processing method according to one embodiment of the present invention uses a processor to acquire sound information obtained by sound collection by a sound collection device, and outputs a child's voice and an adult's voice included in the sound indicated by the sound information. Identifying, determining the state of the child based on the identified voice of the child, determining the state of the adult based on the identified voice of the adult, and determining the state of the child; and The notification is generated according to the determined adult state and the notification destination regarding the adult state, and the generated notification is transmitted to the destination.

  Note that these comprehensive or specific aspects may be realized by a system, a method, an integrated circuit, a computer program, or a recording medium such as a computer-readable CD-ROM, and the system, method, integrated circuit, and computer program. And any combination of recording media.

  The information processing method of the present invention can assist in further deepening the understanding of other child-care workers about the situation where the child and the child-care worker are spending time together.

FIG. 1 is an explanatory diagram showing an overview of services provided by the information processing system according to the first embodiment. FIG. 2 is a block diagram illustrating functions of the information processing system according to the first embodiment. FIG. 3 is an explanatory diagram of a table showing conditions used for determination by the sharing determination unit according to the first embodiment. FIG. 4 is an explanatory diagram of a table indicating the notification destination and the content of the notification according to the first embodiment. FIG. 5 is a flowchart showing a flow of processes executed by the identification unit, the child state determination unit, and the mother state determination unit in the first embodiment. FIG. 6 is a flowchart showing a flow of processing executed by the sharing determination unit in the first embodiment. FIG. 7 is an explanatory diagram illustrating a first example of an image presented by the information processing system according to the first embodiment. FIG. 8 is an explanatory diagram illustrating a second example of an image presented by the information processing system according to the first embodiment. FIG. 9 is a block diagram illustrating functions of the information processing system according to the second embodiment. FIG. 10 is an explanatory diagram of a table showing conditions used for determination by the sharing determination unit in the second embodiment. FIG. 11 is a flowchart showing a flow of processes executed by the identification unit, the child state determination unit, the mother state determination unit, and the environmental sound determination unit in the second embodiment. FIG. 12 is an explanatory diagram of a table showing another condition used for determination by the sharing determination unit in the second embodiment. FIG. 13 is a block diagram illustrating functions of the information processing system according to the third embodiment. FIG. 14 is an explanatory diagram of a table showing the transmission timing of information by the transmission unit and the transmission timing indicating the information notification mode in the third embodiment.

(Knowledge that became the basis of the present invention)
In the technique disclosed in Patent Document 1, only the situation of a child is diagnosed, and the diagnosis result is notified to a child-care worker (for example, a mother of the child) at a remote location. This technique does not inform other parenters (e.g., the child's father) or parties (e.g., the child's grandparents) about information about the parent who is spending time with the child. Therefore, this alone does not provide an understanding of other child-care workers about information related to child-care workers. Therefore, when trying to make other childcare workers or related persons grasp the status of childcare, it is necessary for the childcare worker himself to give notice. If the child-care worker himself / herself notifies other child-caregivers or related parties, there may be a problem that an inappropriate impression different from the intention is given to the other child-caregivers or related parties. When an inappropriate impression is given, it is necessary to perform another notification, and there may be a problem that extra time or power is consumed for the notification.

  Therefore, the present invention provides an information processing method that supports further deepening the understanding of other child-caregivers about the situation where the child and the child-caregiver spend together.

  In order to solve such a problem, an information processing method according to one embodiment of the present invention acquires sound information obtained by sound collection by a sound collection device using a processor, and includes the sound information indicated by the sound information. Identifying the voice of the child and the voice of the adult, determining the state of the child based on the identified voice of the child, and determining the state of the adult based on the identified voice of the adult The notification is generated according to the determined state of the child, the determined state of the adult, and a notification destination regarding the adult state, and the generated notification is transmitted to the destination To do.

  According to the said aspect, the notification produced | generated according to the state of a child and an adult is transmitted to a destination. The notification is generated according to the notification destination. If the adult is the child's parent (e.g., mother) and the notification is addressed to the child's other child (e.g., father or grandparent), a notification that indicates the status of the child and mother is Whether it is a father or a grandparent). Since the information generated in accordance with the destination is notified, it is easy to obtain the understanding of other childcare persons who are the destination. Therefore, it can support further deepening the understanding of other child-care workers about the situation where the child and the child-care worker spend together.

  For example, generating the notification may include generating the notification having a different expression or content depending on the destination.

  According to the said aspect, the notification is made to the address | destination by the expression or content which changes with the other childcare person who is the address | destination of notification, for example, father or grandparents. When the notification has an appropriate expression or content according to the destination, it is possible to help deepen the understanding of other child-care workers who are the destination of the notification.

  For example, generating the notification may include generating the notification including a symbol or a sentence having a different expression or content depending on the destination and indicating the adult state.

  According to the said aspect, the notification containing a design or a text is transmitted. By the design or text included in the notification, the other childcare person who is the destination of the notification can grasp the content of the notification more intuitively than the case of the character information.

  For example, generating the notification may include generating the notification depending on whether the generated notification includes or does not include a graphic or a sentence indicating the adult state.

  According to the above aspect, whether the notification includes a symbol or a sentence can be made different depending on the destination. Depending on the destination of the notification, it may not be appropriate to include a design or text in the notification. In such a case, it is appropriate to transmit a notification that does not include the design or text. According to this aspect, a notification including a symbol is transmitted to a destination for which a notification including a symbol or a sentence is appropriate, and a notification including no symbol or a sentence is transmitted to a destination for which a notification including no symbol or a sentence is appropriate. Can do.

  For example, the representation or content of the symbol or the sentence may be different depending on the attribute of the destination.

  According to the said aspect, the expression or content of the pattern or text contained in notification can be varied according to the attribute of a destination. Here, the destination attribute means male, female, maternal or paternal. Then, a notification including a sentence with an appropriate expression can be transmitted according to the destination attribute.

  For example, generating the notification calculates an index according to at least one of the determined child state and the determined adult state, and only when the calculated index is higher than a threshold value, It may include generating the notification.

  According to the said aspect, it can control whether notification is produced | generated based on the parameter | index calculated from the state of a child or the state of an adult. Thereby, it is possible to control whether to generate a notification specifically and quantitatively.

  For example, generating the notification calculates an index according to at least one of the determined state of the child and the determined state of the adult, and the larger the calculated index, the larger the symbol Generating said notification including.

  According to the said aspect, the magnitude | size of the symbol contained in notification is controllable based on the parameter | index calculated from the state of a child or the state of an adult. Thereby, it is possible to control the size of the symbols included in the notification in a specific and quantitative manner, and contribute to deepening the understanding of other child-care workers who are the notification destinations.

  For example, generating the notification accepts information indicating the adult state via an input device, and converts the received information into information in a form issued by the child or information indicating the child state. This may include generating the notification.

  According to the above aspect, the information representing the state is converted into information indicating that the child has emitted, or the information indicating the child's state, and transmitted to the other childcare person who is the destination. It can contribute to deepening the understanding of the person.

  For example, the destination may be determined according to the determined state of the child and the determined state of the adult.

  According to the above aspect, the notification destination is determined based on the state of the child and the state of the adult. Depending on the condition of the child and the adult, it may be inappropriate to notify a specific destination. In such a case, it is possible not to notify the specific destination.

  For example, the environmental sound included in the sound indicated by the sound information is further identified, and the adult state is determined based on the identified adult voice and the environmental sound. May be included.

  According to the above aspect, the environmental sound is further used to determine the adult state. Further, a notification is generated and transmitted according to the adult state determined based on the environmental sound. Thereby, an adult's state can be determined in detail, and notification is generated and transmitted based on this detailed determination.

  For example, in the information processing method, the detection result by a sensor that detects a person is acquired, and the determination of the adult state is based on the identified adult voice and the detection result. It may include determining an adult state.

  According to the above aspect, the sensor is further used to determine the adult state. Further, a notification is generated and transmitted according to the adult state determined based on the sensor. Thereby, an adult's state can be determined in detail, and notification is generated and transmitted based on this detailed determination.

  For example, in the information processing method, acquiring the position information indicating the position of the destination and transmitting the notification to the destination is that the destination is at a predetermined position with reference to the position information. In response to sending the notification to the destination.

  According to the said aspect, notification can be transmitted according to the position of the other childcare person who is the destination of notification. By transmitting the notification in a state in which the other childcare person can easily confirm the notification, the certainty that the other childcare person can recognize the notification can be improved.

  For example, the predetermined position is a position where a boarding / recording device related to a vehicle is installed, and in response to communication with the boarding / recording device using proximity wireless communication by a terminal carried by a person related to the destination , Sending the notification to the destination.

  According to the above aspect, the notification is transmitted in response to the fact that another child-care worker gets on or off the vehicle as a timing at which the other child-care worker can easily confirm the notification. Thereby, the certainty that other child-care workers recognize the notification can be further improved.

  An information processing apparatus according to an aspect of the present invention includes an identification unit that identifies a child's voice and an adult's voice included in the sound indicated by the sound information obtained by sound collection by the sound collection device, and the identified A child state determination unit that determines the state of the child based on the voice of the child, an adult state determination unit that determines the state of the adult based on the voice of the identified adult, and the determined child A generation unit that generates the notification according to the state, the determined adult state, and a destination of the notification about the adult state; and a transmission unit that transmits the generated notification to the destination Is provided.

  Thereby, there exists an effect similar to the said information processing method.

  Note that these comprehensive or specific aspects may be realized by a system, a method, an integrated circuit, a computer program, or a recording medium such as a computer-readable CD-ROM, and the system, method, integrated circuit, and computer program. Alternatively, it may be realized by any combination of recording media.

  Hereinafter, embodiments will be specifically described with reference to the drawings.

  It should be noted that each of the embodiments described below shows a comprehensive or specific example. The numerical values, shapes, materials, constituent elements, arrangement positions and connecting forms of the constituent elements, steps, order of steps, and the like shown in the following embodiments are merely examples, and are not intended to limit the present invention. In addition, among the constituent elements in the following embodiments, constituent elements that are not described in the independent claims indicating the highest concept are described as optional constituent elements.

(Embodiment 1)
In the present embodiment, an information processing method and the like for assisting in further deepening the understanding of other child-care workers regarding the situation where the child and the child-care worker spend together will be described.

  First, an overview of services aimed by the present inventors will be described with reference to FIG.

  FIG. 1 is an explanatory diagram showing an overview of services provided by the information processing system 1 according to the present embodiment.

  In the technical field of notifying childcare persons who are remotely informed of a child's condition, the present inventors have described a negative part such as difficulty of childcare that cannot be seen only from the state of the child, or a positive part such as happiness. Focuses on technologies shared with other childcare workers or related parties. Then, the above-mentioned negative part or positive part is communicated to other child-rearing persons or related persons, aiming to deepen the understanding of the situation of child-rearing.

  Here, “child” refers to an infant, and more specifically, refers to a person from the first day of life to 6 to 7 years old, but is not limited thereto.

  As shown in FIG. 1, in the information processing system 1 according to the present embodiment, an input terminal 10 that acquires sound such as a microphone is disposed in the house. Then, the information processing system 1 determines the state of each by analyzing the sound of the child and the sound of the childcare person based on the sound acquired by the input terminal 10, and provides information indicating the state to other childcare Information should be presented after judging whether or not to share with the person. It is assumed that the information to be presented is presented to other child-care workers.

  In addition, although the case where the “childcare person” is the mother of the child, the “other childcare person” is the father of the child, and the “participant” is the child's grandparent is described as an example, the present invention is not limited thereto. . More generally, as long as both the “childcare worker” and the “other childcare worker” are adults, this embodiment can be applied. “Adult” can also be expressed as a person who is not a child.

  Thereby, the father can grasp the situation of child care that cannot be grasped by the conventional technology. Further, in addition to the situation of childcare, the father can know the timing when the burden on the mother is extremely high or the happiness time for the mother in daily childcare and housework. If the father knows these timings, the couple can share detailed information about the event, such as by giving them time to talk about these things later. As described above, the information processing system 1 according to the present embodiment assists in further deepening the understanding of other child-care workers about the situation in which the child and the child-care worker are spending time together.

  Hereinafter, the information processing system 1 and the like according to the present embodiment will be described in detail.

  FIG. 2 is a block diagram illustrating functions of the information processing system 1 in the present embodiment.

  As shown in FIG. 2, the information processing system 1 includes an input unit 101, an identification unit 102, a child state determination unit 103, a mother state determination unit 104, holding units 105 and 106, a sharing determination unit 107, , A generation unit 108, a transmission unit 109, and a display unit 110.

  The input unit 101 is an input device that collects ambient sounds with a sound collection device and generates sound information indicating the collected sound. The input unit 101 is a microphone, for example.

  The identification unit 102 acquires sound information from the input unit 101 and identifies a child's voice and a mother's voice included in the sound indicated by the acquired sound information. For example, when the identification unit 102 identifies a child's voice and a mother's voice, the frequency of the child's voice is relatively high and the frequency of the mother's voice is relatively low. A low frequency can be identified as a child's voice, and a frequency higher than a predetermined frequency can be identified as a mother's voice.

  The child state determination unit 103 is a processing unit that determines the child state by analyzing the voice of the child identified by the identification unit 102.

  The mother state determination unit 104 is a processing unit that determines the state of the mother by analyzing the mother's voice identified by the identification unit 102.

  The holding unit 105 is a storage device that holds the child state determined by the child state determination unit 103 temporarily or permanently.

  The holding unit 106 is a storage device that holds the state of the mother determined by the mother state determination unit 104 temporarily or permanently.

  Based on the state of the child held in the holding unit 105 and the state of the mother held in the holding unit 106, the sharing determination unit 107 stores information indicating these states in advance as registered destinations (for example, It is a processing unit that determines whether or not to share with a father or grandparent).

  The generation unit 108 generates a notification to be presented to a pre-registered destination (for example, father or grandparent) when the sharing determination unit 107 determines that it should be shared with a pre-registered person. It is. When generating a notification, a notification is generated according to the destination of the notification. The contents of the notification will be described in detail later.

  The transmission unit 109 is a processing unit that transmits the image generated by the generation unit 108 to the portable terminal of the father or grandparent. The transmission unit 109 includes a transmission circuit for transmitting information indicating an image, a connector, an antenna, and the like.

  The display unit 110 is a display unit that displays the image transmitted by the transmission unit 109. The display unit 110 is a display screen of a mobile terminal such as a mobile phone or a smartphone, for example.

  The identification unit 102, the child state determination unit 103, the mother state determination unit 104, the holding units 105 and 106, the sharing determination unit 107, and the generation unit 108 are stored by a processor using a memory, for example. It can be realized by executing a predetermined program stored in a device or the like.

  In addition, the technique which the identification part 102 identifies a child's audio | voice from the sound which the sound information acquired from the input part 101 shows can be implement | achieved using xauris (Elephant) which is a well-known child audio | voice identification technique, for example. xauris uses a learning model constructed using deep learning from learning data showing the relationship between children's voices and states collected in advance by developers. Are categorized into four types: “crying”, “laughing”, “guzuri”, and “spoken words (utterances that do not become words)”. Therefore, the process of identifying the child's voice among the processes performed by the identification unit 102 and the process performed by the child state determination unit 103 can be realized by xauris. In this case, four types of states of “crying”, “laughing”, “guzuri”, and “gogo” are stored in the holding unit 105 as determination results of the child state determination unit 103.

  Moreover, the technique in which the identification unit 102 identifies the mother's voice from the sound indicated by the sound information acquired from the input unit 101 can be realized using a known speaker identification technique. The speaker identification technique is constituted by various element techniques. For example, a detection method using a fundamental frequency and a spectral envelope characteristic of a specific band can be adopted. However, instead of using speaker identification technology, there is a method in which a sound collection device such as a microphone is attached to or mounted on the mother's clothing or decoration and the sound acquired by the sound collection device is identified as the mother's voice. It may be adopted.

  The technique in which the mother state determination unit 104 analyzes the mother's voice identified by the identification unit 102 to determine the mother's state can be realized using a known emotion analysis engine. For example, the emotion analysis engine captures a person's voice as “sound (tone)” instead of “word” and quantifies the person's emotion from the sound. The emotions that are output include, for example, “anger”, “concentration”, “confused”, “excitement”, “thinking”, “stress”, “躊躇”, “happiness”, “interest / interest”, “sadness / Dissatisfied ”. Here, a case where the mother state determination unit 104 outputs an emotion such as “anger” as described above will be described as an example. The determination result of the mother state determination unit 104 is stored in the holding unit 106 as a combination of emotions and numerical values, for example, “anger: 5”, “concentration: 8”, “confused: 2”.

  Note that the information processing system 1 includes, for example, an input terminal 10, a server 20, and a display terminal 30. The input terminal 10 and the server 20 and the server 20 and the display terminal 30 are communicably connected via a network (not shown). The functional block provided in the information processing system 1 is provided by the input terminal 10, the server 20, and the display terminal 30.

  For example, the input terminal 10 may employ a portable terminal such as a mother's smartphone or a dedicated device having a sound collection device and a communication function. The server 20 may employ a server device that can be connected to the input terminal 10 and the display terminal 30 via a network, such as a so-called cloud server. The display terminal 30 may employ a portable terminal such as a father's smartphone.

  The input terminal 10 includes an input unit 101. The server 20 includes an identification unit 102, a child state determination unit 103, a mother state determination unit 104, holding units 105 and 106, a sharing determination unit 107, a generation unit 108, and a transmission unit 109. The display terminal 30 includes a display unit 110.

  In this case, the input terminal 10 transmits the sound information generated by the input unit 101 to the identification unit 102 of the server 20 through the network. In addition, the server 20 transmits data such as an image transmitted by the transmission unit 109 to the display unit 110 of the display terminal 30 through the network.

  Note that the above-described function sharing of each device is merely an example, and other function sharing may be employed.

  FIG. 3 is an explanatory diagram of the table T1 showing the conditions used for the determination by the sharing determination unit 107 in the present embodiment. The table T1 shows the first condition and the second condition, which are examples of conditions used by the sharing determination unit 107 for determination.

  Based on the state of the child held in the holding unit 105 and the state of the mother held in the holding unit 106, the sharing determination unit 107 should share information indicating these states with the father or grandparent. Determine whether. Various conditions can be adopted for the determination. For example, the condition for determining that the information should be shared in a negative situation (first condition), and the information in a positive situation. When any of the conditions (second condition) for determining that the information should be shared is satisfied, the sharing determination unit 107 determines that the information should be shared with the father or the like. Hereinafter, each situation, and the first condition and the second condition will be described.

(1) Negative Situation and First Condition Negative Situation refers to a situation where the child is crying or lazy and the mother has negative emotions such as anger. In such a situation, since it is necessary to support childcare or housework by the father or grandparents or to support psychologically, it is considered that information indicating these states should be shared with the father or grandparents.

  The first condition is a condition regarding the state of the child stored in the holding unit 105 (also referred to as “child condition”) and a condition regarding the state of the mother stored in the holding unit 106 (also referred to as “mother condition”). ). Specifically, the first condition is that the child state stored in the holding unit 105 is “crying” or “guzuri”, and the first condition is calculated by the following (Equation 1) based on the emotion of the mother. One index may be greater than or equal to a threshold value.

  First index = (degree of “anger”) + (degree of “stress”) + (degree of “confused”) − (degree of “happiness”) (Formula 1)

  Here, each emotion such as “anger” is acquired from the state of the mother stored in the holding unit 106 at the time point. For example, when the degree of each emotion such as “anger” is evaluated from 0 to 10, the threshold value in the first condition is, for example, 15.

  The first index can be said to be an index indicating the importance of sharing the state between the mother and the father. In addition to the above, the first index may be calculated as a result of subtracting the degree of one or more positive emotions from the total degree of one or more negative emotions, It may be calculated from only the total.

  In the determination of the first condition, the first condition is satisfied only when the child condition and the mother condition are satisfied for a predetermined time (also referred to as “duration”, for example, 60 seconds). You may make it determine with satisfy | filling. This is because even if a negative situation occurs in only a short time of about a few seconds regarding the state of the child and the state of the mother, it is considered that the necessity of sharing the information with the father or the like is relatively low. Hereinafter, a case will be described in which it is determined that the first condition is satisfied when the child condition and the mother condition are continuously satisfied for a predetermined duration.

(2) Positive situation and second condition A positive situation refers to a situation in which a child laughs or speaks and a mother has a positive feeling such as happiness. In such a situation, it is desirable to have the father or grandparents have similar feelings, so information indicating these conditions should be shared with the father or grandparents.

  The second condition is defined by the condition regarding the state of the child stored in the holding unit 105, that is, the condition of the child, and the condition regarding the state of the mother stored in the holding unit 106, that is, the condition of the mother. . Specifically, the second condition is that the state of the child stored in the holding unit 105 is “laughter” or “Language”, and is calculated by the following (Equation 2) based on the emotion of the mother. The two indices can be equal to or greater than a threshold value.

  Second index = (degree of “happiness”) + (degree of “concentration”) + (degree of “interest”) − (degree of “stress”) (Formula 2)

  Here, each emotion such as the above “happiness” is acquired from the state of the mother stored in the holding unit 106 at the time point. For example, when the degree of each emotion such as “happiness” is evaluated from 0 to 10, the threshold value in the first condition is, for example, 15.

  The second index can be said to be an index indicating the importance of sharing the state between the mother and the father, like the first index. The second index may be calculated as a result of subtracting the degree of one or more negative emotions from the total degree of one or more positive emotions, as in the case of the first index. It may be calculated only from the total degree.

  In the determination of the second condition, as in the case of the first condition, only when the child condition and the mother's condition are continuously satisfied for a predetermined time (that is, the duration time) or more, You may make it determine with satisfy | filling conditions. Hereinafter, a case where it is determined that the second condition is satisfied when the child condition and the mother condition are continuously satisfied for a predetermined duration will be described.

  FIG. 4 is an explanatory diagram of the table T2 showing the notification destination and the notification content in the present embodiment. The table T2 shows the notification destination and the content of the notification for each notification destination when each of the first condition and the second condition is satisfied. The address of the notification is determined according to the condition of the child and the condition of the adult.

(1) When the first condition is satisfied When the sharing determination unit 107 determines that the first condition is satisfied, the generation unit 108 presents it to each of the child's father and the child's maternal grandparent. Generate a notification for.

  For example, as a notification to be presented to the child's father, a predetermined image is added to the position corresponding to the point in time when it is determined that the first condition is satisfied on the graph showing the state of the child and the mother in time series. Generate an image. Here, the predetermined image is, for example, an image showing an illustration (design) of a cat's hand. This is because the mother's situation at the time when the predetermined image is added is a very busy situation, that is, a situation in which a so-called cat's hand is desired (an expression derived from a Japanese proverb). In addition, the predetermined image may be an image indicating words as if the child had uttered the situation at that time, such as a message “I was in trouble with my mom”.

  Further, for example, the notification to be presented to the child's maternal grandparents may be an image showing the words that the mother has uttered the situation at that time, such as a message “It is very hard”.

(2) When the second condition is satisfied When the sharing determination unit 107 calculates the second index, the generation unit 108 presents each of the child's father, the maternal grandparent, and the paternal grandparent. Generate notifications for

  For example, in the case of a child's father and paternal grandparents, a predetermined image is added at a position corresponding to the point in time when it is determined that the second condition is satisfied on the graph showing the state of the child and the mother in time series Generated image. Here, the predetermined image is, for example, an image showing an illustration of a smiling mother and child. In addition, the predetermined image may be an image indicating words as if the child had uttered the situation of the mother and the child at that time, such as a message “That's so fun!”

  Also, for example, as a notification to be presented to the child's maternal grandparents, an image showing the words that the mother spoke about the situation at that time, such as the message “I had so much fun!” Good.

  As described above, the generation unit 108 may generate a notification having different expressions or contents depending on the destination of the notification. Thus, the destination is notified with different expressions or contents depending on other child-rearing persons, for example, fathers or grandparents, who are the destination of the notification. When the notification has an appropriate expression or content according to the destination, it is possible to help deepen the understanding of other child-care workers who are the destination of the notification.

  Further, the generation unit 108 may generate a notification including a pattern or a sentence indicating the mother's state. Thereby, the notification containing a design or a sentence is transmitted. From the design or text included in the notification, the other child-caregivers who are the notification recipients can grasp the content of the notification more intuitively.

  And the production | generation part 108 may produce | generate the notification from which the notification produced | generated includes or does not contain the pattern or sentence which shows the state of a mother according to a destination, when producing | generating a notification. Further, when generating the notification, the generation unit 108 may generate a notification in which the contents of the symbols or texts differ depending on the destination. Thereby, it can be made different according to a destination whether a design includes a design or a sentence. Depending on the destination of the notification, it may not be appropriate to include a design or text in the notification. In such a case, it is appropriate to transmit a notification that does not include the design or text. According to this aspect, a notification including a symbol or text is transmitted to a destination where the notification including the symbol or text is appropriate, and a notification including no symbol or text is transmitted to a destination where the notification not including the symbol or text is appropriate. Can be sent.

  Further, when generating the notification, the generation unit 108 may generate a notification in which the expression or content of the symbol or text included in the generated notification differs depending on the destination. Thereby, the expression or content of the design or text included in the notification can be varied depending on the destination. And the notification containing the pattern or text of an appropriate expression or content according to a destination can be transmitted.

  Further, when generating the notification, the generation unit 108 may generate a notification in which the expression of the text is different depending on the attribute of the destination. Thereby, the expression of the text included in the notification can be changed according to the attribute of the destination. Here, the destination attribute means male, female, maternal or paternal. Then, a notification including a sentence with an appropriate expression can be transmitted according to the destination attribute.

  Note that when generating the notification, the generation unit 108 calculates an index indicating the importance of the notification according to at least one of the state of the child and the state of the mother, and the calculated index is higher than the threshold value. Only a notification may be generated. Said 1st parameter | index and 2nd parameter | index are examples of the parameter | index which shows the importance of notification according to a mother's condition. Instead of the first index and the second index, it is possible to employ an index indicating the importance of notification according to the condition of the child. Thereby, it is possible to control whether or not to generate a notification based on an index calculated from a child state or an adult state. Thereby, it is possible to control whether to generate a notification specifically and quantitatively.

  When generating the notification, the generation unit 108 calculates an index indicating the importance of the notification according to at least one of the state of the child and the state of the mother, and the larger the calculated index, the more A notification including a large symbol may be generated. Specifically, the size of the above-described illustration of the cat's hand or the illustration showing the smile of the mother and child may be made larger. Thereby, the size of the symbol included in the notification can be controlled based on the index calculated from the state of the child or the state of the adult. Thereby, it is possible to control the size of the symbols included in the notification in a specific and quantitative manner, and contribute to deepening the understanding of other child-care workers who are the notification destinations.

  The processing flow of the information processing apparatus configured as described above will be described with reference to specific examples and drawings.

  FIG. 5 is a flowchart showing a flow of processing executed by the identification unit 102, the child state determination unit 103, and the mother state determination unit 104 in the present embodiment.

  In step S1, the identification unit 102 acquires sound information from the input unit 101, and identifies a child's voice and a mother's voice included in the sound indicated by the acquired sound information.

  In step S2, the identification unit 102 determines whether or not a child's voice has been identified in step S1. If it is determined that the child's voice has been identified (Yes in step S2), the process proceeds to step S3. If not (No in step S2), the process proceeds to step S4.

  In step S <b> 3, the child state determination unit 103 determines the child state based on the child voice identified in step S <b> 1 and stores the child state in the holding unit 105.

  In step S4, the identification unit 102 determines whether or not the mother's voice is identified in step S1. If it is determined that the mother's voice has been identified (Yes in step S4), the process proceeds to step S5. If not (No in step S4), the series of processes shown in the flowchart is terminated.

  In step S5, the mother state determination unit 104 determines the mother's state based on the mother's voice identified in step S1, and stores the mother's state in the holding unit 106.

  Regarding the above processing, a statement will be made in more detail while applying a specific example.

  Here, an example is given of a scene in which a mother who was standing in the kitchen at the evening of dinner on a certain day, a 2-year-old child who was a little hungry, started to crawl against her mother. Trying to take the mother out of the kitchen while the child is crying, and because he wants to eat rice as soon as possible, uttering words such as “Ah, Ah! I started crying. On the other hand, while mothers say “I can't eat now!”, “I ca n’t eat rice? Suppose it continues.

  First, the identification unit 102 identifies children's voices “Achi-Achi-Ai!” And “Hochi-Ai!” Included in the sound information acquired from the input unit 101. Further, the identification unit 102 identifies the mother's voices “Now it is impossible!”, “I can't eat rice?” And “Dame!” Included in the sound information acquired from the input unit 101. (Step S1).

  The child state determination unit 103 determines that the child state is “Gurzuri” on the basis of the child voices “Atchi Atchiai!” And “Hochii!” Identified in Step S1, and determines the determination result. The data is stored in the holding unit 105 (step S3).

  Based on the mother's voices identified in step S1, “I can't eat now!”, “I ca n’t eat rice?” And “Dame!” It is determined that anger is “8”, “confused: 8”, “stress: 9”, and “happiness: 1”, and the determination result is stored in the holding unit 106 (step S5).

  Next, processing by the sharing determination unit 107 will be described.

  FIG. 6 is a flowchart showing a flow of processing executed by the sharing determination unit 107 in the present embodiment.

  In step S <b> 11, the sharing determination unit 107 acquires the state of the child from the holding unit 105 and acquires the state of the mother from the holding unit 106.

  In step S12, the sharing determination unit 107 determines whether or not the child state acquired in step S11 is “crying” or “guzuri”. If the child's state is “crying” or “guzuri” (Yes in step S12), the process proceeds to step S13, and if not (No in step S12), the process proceeds to step S21.

  In step S13, the sharing determination unit 107 calculates the first index using the above (Equation 1) based on the mother's state acquired in step S11.

  In step S14, the sharing determination unit 107 determines whether or not the calculated first index is greater than or equal to a threshold value. If the first index is equal to or greater than the threshold value (Yes in step S14), the process proceeds to step S15. If not (No in step S14), the process of the flowchart is terminated.

  In step S15, the sharing determination unit 107 determines that the current state, that is, the state of the child is “crying” or “guzuri”, and the state in which the first index based on the emotion of the mother is equal to or greater than the threshold is the latest 60. It is determined whether it continues for 2 seconds. If the current state continues for the last 60 seconds (Yes in step S15), the process proceeds to step S16. If not (No in step S15), the process of this flowchart is terminated.

  In step S16, the generation unit 108 generates a notification based on the first index calculated by the sharing determination unit 107 in step S13. As described above, the generated notification may include different expressions or contents depending on the destination of the notification.

  In step S <b> 17, the transmission unit 109 transmits the notification generated in step S <b> 16 and displays it on the display unit 110. When the process of step S17 is finished, the series of processes shown in the flowchart is finished.

  In step S <b> 21, the sharing determination unit 107 determines whether or not the child state acquired in step S <b> 11 is “laughter” or “gogo”. If the child's state is “laughter” or “Language” (Yes in step S21), the process proceeds to step S22. If not (No in step S21), the process of this flowchart is terminated.

  In step S22, the sharing determination unit 107 calculates the second index using the above (Equation 2) based on the mother's state acquired in step S11.

  In step S23, the sharing determination unit 107 determines whether or not the calculated second index is equal to or greater than a threshold value. If the second index is greater than or equal to the threshold value (Yes in step S23), the process proceeds to step S24. If not (No in step S23), the process of this flowchart is terminated.

  In step S24, the sharing determination unit 107 determines that the current state, that is, the state of the child is “laughter” or “Language”, and the state in which the second index based on the emotion of the mother is equal to or greater than the threshold is the latest 60. It is determined whether it continues for 2 seconds. If the current state continues for the last 60 seconds (Yes in step S24), the process proceeds to step S25. If not (No in step S24), the process of this flowchart is terminated.

  In step S25, the generation unit 108 generates a notification based on the second index calculated by the sharing determination unit 107 in step S22. As described above, the generated notification may include different expressions or contents depending on the destination of the notification. When step S25 is completed, the process proceeds to step S17.

  As described above, in steps S16 and S25, the generation unit 108 generates a notification according to the state of the child, the state of the mother, and the destination of the notification about the state of the mother. This helps to further deepen the understanding of other child-care workers about the situation where children and child-caregivers are spending time together.

  This will be described more specifically with a specific example.

  In step S <b> 11, the sharing determination unit 107 acquires “Gurzuri” as the child state and “Anger: 8”, “Confusion: 8”, “Stress: 9”, and “Happiness: 1” as the mother state. And In this case, the child's condition is “Gizuri” (Yes in Step S12), and the first index is calculated as 24 from the following (Equation 3) (Step S13), which exceeds the threshold 15.

  First index = 8 + 9 + 8−1 = 24 (Formula 3)

  In addition, since the state where the child is “guzuri” and the first index exceeds the threshold value continues for 60 seconds or more (Yes in step S14), the generation unit 108 is based on the first index. A notification is generated (step S16).

  Next, the generation unit 108 generates an image for notification for each notification destination (specifically, the child's father and the child's maternal grandparent) (step S16). For example, the generation unit 108 generates, as an image to be sent to the father, an image in which an illustration of a cat's hand is given on a graph showing the state of the child and the mother in time series. In addition, the generation unit 108 generates an image including a “very hard” message issued by the child's mother as an image to be sent to the maternal grandparents. The generation unit 108 provides the generated image to the display unit 110 via the transmission unit 109 (step S17).

  An image presented by the information processing system 1 by the series of processes described above will be described.

  FIG. 7 is an explanatory diagram illustrating a first example of an image presented by the information processing system 1 according to the present embodiment.

  The display unit 110 of the display terminal 30 shown in FIG. 7A displays an image with a cat hand illustration 40 showing the mother's state together with a graph showing the state of the child and the mother in time series. it's shown. More specifically, this graph shows, as an example of the state of the child and the mother, the frequency of voices uttered by the child and the mother on the vertical axis and the passage of time on the horizontal axis. Note that the strength of the voice may be used instead of the voice frequency.

  As a result, the father can grasp the status of childcare that cannot be grasped by the conventional technique, together with quantitative information. Then, the mother can share the status of childcare with the father or related parties. In addition, the information processing system 1 notifies the father or related parties of the timing when the burden on the mother is extremely high or the happiness timing for the mother and the event in daily childcare and housework. As a result, it is possible to raise interest in the information for the father or the related person, to deepen the understanding of childcare, and to further enhance the family life.

  It goes without saying that sharing information on childcare and housework in this way is a big step for smooth support for childcare at home. It also leads to a change in consciousness in the father and a so-called “Ikumen” spirit.

  The generation unit 108 generates an image that differs depending on the notification destination, so that notification can be performed in a format suitable for each notification destination, and further understanding by the notification destination can be obtained.

  Note that, as described above, the notification format is not limited to that showing an image showing the mother's state together with the graph showing the state of the child and the mother in time series. For example, as shown in FIG. 7B, a short text notification on the display terminal 30, for example, a so-called push notification 41 on a lock screen of a smartphone may be used.

  In addition, the character string which the mother input may be attached | subjected to the image contained in notification. This will be specifically described with reference to FIG.

  FIG. 8 is an explanatory diagram illustrating a second example of an image presented by the information processing system 1 according to the present embodiment.

  FIG. 8A shows an image 42 including a character string indicating the state of the mother together with the graph. The image 42 is an image including the character string “again woken up” received from the mother. Thereby, the information input by the mother himself / herself can be shared with the father or the person concerned.

  Further, in this case, the notification may be generated by converting the character string received from the mother into information in a form issued by the child or information indicating the state of the child. For example, a notification including the image 43 obtained by converting the above-mentioned character string “Wake up again” into information “Mama has been woken up” in a form issued by the child may be generated (FIG. 8B). ). At this time, the information before the conversion and the information after the conversion both express the state of the mother, so the intention is generally maintained although the expression methods are different. Rather than expressing the mother's condition in terms of the mother's expression, expressing the mother's condition in words as if the child originated may be more appropriately shared with the father or other parties. It is. As a result, it is possible to contribute to further deepening the understanding of other childcare persons by converting the information indicating the state into information as if the child originated and transmitting it to the other childcare person who is the destination. . Furthermore, by adding a child's illustration 44, it is possible to emphasize the atmosphere that the child has spoken.

  In addition, about the determination of the state of the mother by the mother state determination unit 104, the state is determined here based only on the mother's voice, but the presence / absence of the ON / OFF sound of the cooking appliance, for example, the IH cooking heater, or the running water sound in the sink Or the like may be detected to determine the mother's condition. Moreover, you may acquire and use status information directly from apparatuses, such as a cooking household appliance. Furthermore, information on sensors mounted on home appliances, for example, temperature, humidity, and human behavior may be detected and used to analyze the mother's condition.

  As described above, the information processing system according to the present embodiment transmits a notification generated according to the state of the child and the adult to the destination. The notification is generated according to the notification destination. If the adult is the child's parent (e.g., mother) and the notification is addressed to the child's other child (e.g., father or grandparent), a notification that indicates the status of the child and mother is Whether it is a father or a grandparent). Since the information generated in accordance with the destination is notified, it is easy to obtain the understanding of other childcare persons who are the destination. Therefore, it can support further deepening the understanding of other child-care workers about the situation where the child and the child-care worker spend together.

(Embodiment 2)
In the present embodiment, an information processing method and the like for assisting in further deepening the understanding of other child-care workers regarding the situation where the child and the child-care worker spend together will be described. The information processing method according to the present embodiment determines the situation in which the child and the child-care worker are spending together based on the environmental sound in addition to the sound of the child and the child-care worker (mother). To deepen the understanding of

  FIG. 9 is a block diagram showing functions of the information processing system 2 in the present embodiment.

  As shown in FIG. 9, the information processing system 2 includes an input unit 101, an identification unit 102A, a child state determination unit 103, a mother state determination unit 104, holding units 105 and 106, and a sharing determination unit 107A. A generation unit 108, a transmission unit 109, a display unit 110, an environmental sound determination unit 112, and a holding unit 113.

  Here, among the functional blocks of the information processing system 2, the functional blocks excluding the identification unit 102 </ b> A, the environmental sound determination unit 112, and the holding unit 113 are the same as those in the first embodiment, and thus detailed description will be given. Omitted. The server 20A corresponds to the server 20 in the first embodiment.

  The identification unit 102A acquires sound information from the input unit 101, and identifies a child's voice, mother's voice, and environmental sound included in the sound indicated by the acquired sound information. Here, the identification unit 102A is different from the identification unit 102 in that the environmental sound is identified. The environmental sound is a sound excluding the child's voice and the mother's voice among the surrounding sounds picked up by the input unit 101 by the sound pickup device. Specifically, the environmental sounds include operation sounds and operation sounds of home appliances (for example, IH cooking heater, microwave oven, washing machine or toy), sounds generated by housework (for example, running sound of kitchen sink, door opening / closing sound, Sound generated when cutting an object with a kitchen knife), sound generated by a non-housework operation (for example, a sound emitted by a musical instrument, a clapping sound, a footstep sound generated by dancing or walking), and the like.

  The environmental sound determination unit 112 is a processing unit that determines a state related to the environment by analyzing the environmental sound identified by the identification unit 102A.

  The holding unit 113 is a storage device that temporarily or permanently holds the environment-related state determined by the environmental sound determination unit 112.

  Based on the state of the child held in the holding unit 105, the state of the mother held in the holding unit 106, and the state related to the environment held in the holding unit 113, the sharing determination unit 107A It is a processing unit that determines whether or not information indicating a state should be shared with a destination (for example, a father or a grandparent) registered in advance. More specifically, the sharing determination unit 107A determines whether the mother is doing housework or playing with a child from the state regarding the environment.

  FIG. 10 is an explanatory diagram of a table T3 indicating conditions used for determination by the sharing determination unit 107A in the present embodiment. The table T3 shows the first condition and the second condition, which are examples of conditions used by the sharing determination unit 107A for determination.

  Based on the state of the child held in the holding unit 105, the state of the mother held in the holding unit 106, and the state related to the environment held in the holding unit 113, the sharing determination unit 107A It is determined whether the condition and the second condition are satisfied.

(1) About the first condition In addition to the first condition of the first embodiment, the first condition further considers a condition based on the state regarding the environment. Specifically, the first condition is that when the child state stored in the holding unit 105 is “crying” or “guzuri”, the first index calculated based on the emotion of the mother is equal to or greater than a threshold value. Or, the mother can do the housework.

  If the mother is doing housework when the child is crying or swaying, regardless of the mother's feelings, childcare or housework assistance by the father or grandparents, or psychological support, is necessary. This is because it can be said that information indicating these states should be shared with the father or grandparents.

(2) Second condition As for the second condition, in addition to the second condition of the first embodiment, a condition based on the state regarding the environment is further considered. Specifically, the second condition is that the second index calculated based on the emotions of the mother is equal to or greater than a threshold when the child state stored in the holding unit 105 is “laughter” or “Language”. Or, the mother and the child can play together.

  When a child laughs or speaks a language, if the mother and the child are playing together, it is desirable that the father or grandparents have positive feelings such as happiness regardless of the mother's feelings. Therefore, it can be said that information indicating these states should be shared with the father or grandparents.

  The information processing system 2 configured as described above will be described with reference to the drawings.

  FIG. 11 is a flowchart showing a flow of processing executed by the identification unit 102A, the child state determination unit 103, the mother state determination unit 104, and the environmental sound determination unit 112 in the present embodiment.

  In addition, since the process (step S2 to S5) which the child state determination part 103 and the mother state determination part 104 perform is the same as that in Embodiment 1, detailed description is abbreviate | omitted.

  In step S1A, the identification unit 102A acquires sound information from the input unit 101, and identifies a child's voice, mother's voice, and environmental sound included in the sound indicated by the acquired sound information.

  In steps S2 to S5, the child state determined by the child state determination unit 103 is stored in the holding unit 105, and the mother state determined by the mother state determination unit 104 is stored in the holding unit 106 (details are given in the embodiment). 1).

  In step S6, the identification unit 102A determines whether an environmental sound has been identified in step S1. If it is determined that the environmental sound has been identified (Yes in step S6), the process proceeds to step S7. If not (No in step S6), the series of processes shown in the flowchart is terminated.

  In step S7, the environmental sound determination unit 112 determines the environmental state based on the sound of the environmental sound identified in step S1, and stores the determined environmental state in the holding unit 113. In the specific example, based on the operation sound of the IH cooking heater, which is the environmental sound identified in step S <b> 1, it is determined that housework is being performed, and the determination result is stored in the holding unit 113.

  When the series of processes shown in the flowchart is completed, the sharing determination unit 107A shares information indicating these states with the father or grandparents based on the child state, the mother state, and the state regarding the environment. An index indicating the degree to be calculated is calculated. This process is the same as the process shown in FIG. 6, but only the processes in steps S14 and S23 are different. Specifically, the determination condition in step S14 is “Is the first index greater than or equal to a threshold value, or is the mother doing housework?”. Further, the determination condition in step S23 is “Is the second index greater than or equal to the threshold value, or is the mother playing?”.

  As described above, the information processing system 2 identifies the child's voice, the adult's voice, and the environmental sound when identifying the child's voice and the adult's voice, and determines the adult's state. The adult state may be determined based on the identified adult voice and environmental sound.

  By doing in this way, the information processing system 2 determines the situation where the child and the childcare person are spending together based on the environmental sound in addition to the sound of the child and the mother, Support deeper understanding.

  Note that another example of conditions used for determination by the sharing determination unit 107A will be further described.

  FIG. 12 is an explanatory diagram of a table T4 showing another condition used for determination by the sharing determination unit 107A in the present embodiment. The table T4 shown in FIG. 12 may be used instead of the table T3 shown in FIG. 10, or may be used together with the table T3.

(1) About the first condition In addition to the first condition of the first embodiment, the first condition further considers a condition based on the action of a person (that is, a child or a mother). Specifically, the first condition is that when the child state stored in the holding unit 105 is “crying” or “guzuri”, the first index calculated based on the emotion of the mother is equal to or greater than a threshold value. Alternatively, the human motion may be an irregular motion. Here, it is assumed that an irregular motion of a person is a motion caused by a negative event such as running around, moving in a busy manner, or moving loudly.

  When a child is crying or wandering, if the mother behaves irregularly, the father or grandparents need help with childcare or housework, or psychological support, regardless of the mother's feelings Therefore, it can be said that information indicating these states should be shared with the father or grandparents.

(2) Second condition In addition to the second condition of the first embodiment, the second condition further considers a condition based on the action of a person (that is, a child or a mother). Specifically, the second condition is that the second index calculated based on the emotions of the mother is equal to or greater than a threshold when the child state stored in the holding unit 105 is “laughter” or “Language”. Alternatively, the human motion may be an irregular motion. Here, unlike the irregular movement in (1) above, the irregular movement of a person raises both hands (high and high), moves continuously at a slow speed (chasing), and moves up and down. It is assumed that the action is caused by a positive event such as (if not).

  When a child laughs or speaks a language, if the mother and the child are playing together, regardless of the mother's feelings, the father or grandparents can have positive feelings such as happiness. This is because it can be said that information indicating these states should be shared with the father or grandparents.

  As described above, the information processing system 2 further acquires a detection result by the sensor that detects the adult body, and determines the adult state based on the identified adult voice and the detection result. The adult state may be determined.

  As described above, according to the information processing method according to the present embodiment, the environmental sound is further used to determine the adult state. Further, a notification is generated and transmitted according to the adult state determined based on the environmental sound. Thereby, an adult's state can be determined in detail, and notification is generated and transmitted based on this detailed determination.

  Sensors are also used to determine adult status. Further, a notification is generated and transmitted according to the adult state determined based on the sensor. Thereby, an adult's state can be determined in detail, and notification is generated and transmitted based on this detailed determination.

(Embodiment 3)
In the present embodiment, an information processing method and the like for assisting in further deepening the understanding of other child-care workers regarding the situation where the child and the child-care worker spend together will be described. In the information processing method according to the present embodiment, notification is performed at a timing at which it is easier for a person related to the notification destination to confirm, so that the certainty of recognizing the notification is improved, in other words, communication failure can be prevented.

  FIG. 13 is a block diagram illustrating functions of the information processing system 3 in the present embodiment.

  As illustrated in FIG. 13, the information processing system 3 includes an input unit 101, an identification unit 102, a child state determination unit 103, a mother state determination unit 104, holding units 105 and 106, a sharing determination unit 107, , Generation unit 108, transmission unit 109A, display unit 110, and position acquisition unit 115.

  The position acquisition unit 115 is a processing unit that acquires position information indicating the position of the notification destination. Specifically, the position acquisition unit 115 is a position sensor that acquires position information of the mobile terminal 32 carried by the person who is the notification destination. For example, when the position acquisition unit 115 receives information indicating that the owner of the mobile terminal 32, that is, the child's father has passed the ticket gate at a predetermined station, from the ticket company system of the railway company, The father generates position information indicating a position in the vicinity of the ticket gate. The mobile terminal 32 is, for example, a smartphone or a mobile phone that performs close proximity wireless communication with a ticket gate, or a non-contact IC card. The position acquisition unit 115 may be other means as long as the position information of the mobile terminal 32 can be acquired. The position acquisition unit 115 may acquire the position of the mobile terminal 32 from a GPS (Global Positioning System) receiver mounted on the mobile terminal 32, for example. Note that the mobile terminal 32 may be the same terminal as the display terminal 30. Further, instead of communication with the ticket gate, communication with a communication device (also referred to as a boarding / alighting recorder) used when using a vehicle such as a bus fare payment machine may be used.

  The transmission unit 109 </ b> A controls the transmission timing of the information generated by the generation unit 108 and the information notification mode according to the position information acquired by the position acquisition unit 115. Specifically, the transmission unit 109A refers to the position information acquired by the position acquisition unit 115, and transmits a notification to the destination in response to the destination being located at a predetermined position. For example, when the position information of the vehicle entry / exit recorder is known, the transmission unit 109A sends a notification in response to communication with the entry / exit recorder using proximity wireless communication by a terminal carried by the person involved in the destination. Send to. More specifically, the notification is transmitted to the destination at the timing when it passes the ticket gate of the station using the proximity wireless communication by the terminal carried by the person related to the destination.

  FIG. 14 is an explanatory diagram of a table T5 indicating the transmission timing of information by the transmission unit 109A and the transmission timing indicating the information notification mode in the present embodiment.

  As shown in FIG. 14, the table T <b> 5 shows information about the time zone 51, the position 52, and the notification mode 53 for each entry. Each entry indicates how to notify the display terminal 30 owned by the father when the time zone and the position are given.

  The time zone 51 is information indicating a time zone for which the display terminal 30 performs notification. The time zone 51 designates a time zone such as morning, afternoon, 7 o'clock or 15 o'clock. The time length of the time zone may be anything, and may be several hours or several minutes.

  The position 52 is information indicating the position of the display terminal 30 when notification is made by the display terminal 30. The position 52 may be in any format as long as it can uniquely identify the position, and is a set of latitude and longitude, an address, a name of a building as a landmark, and the like.

  The notification mode 53 is information indicating a mode in which notification is performed by the display terminal 30. For example, the notification mode 53 includes “image update” or “push notification”.

  As described above, according to the information processing method according to the present embodiment, a notification can be transmitted according to the position of another childcare person who is the destination of the notification. By transmitting the notification in a state in which the other childcare person can easily confirm the notification, the certainty that the other childcare person can recognize the notification can be improved.

  In addition, as a timing when it is easy for other childcare personnel to confirm the notification, a notification is transmitted in response to another childcare worker getting on and off the vehicle. Thereby, the certainty that other child-care workers recognize the notification can be further improved.

  In each of the above embodiments, each component may be configured by dedicated hardware or may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory. Here, the software that realizes the information processing system of each of the above embodiments is a program as follows.

  That is, this program uses a processor to acquire sound information obtained by sound collection by a sound collection device, identifies a child's voice and an adult's voice included in the sound indicated by the sound information, Determining the state of the child based on the voice of the identified child; determining the state of the adult based on the voice of the adult identified; and determining the state of the child An information processing method is executed in which the notification is generated according to the adult state and a notification destination regarding the adult state, and the generated notification is transmitted to the destination.

  As described above, the information processing system according to one or more aspects has been described based on the embodiment, but the present invention is not limited to this embodiment. Unless it deviates from the gist of the present invention, various modifications conceived by those skilled in the art have been made in this embodiment, and forms constructed by combining components in different embodiments are also within the scope of one or more aspects. May be included.

  INDUSTRIAL APPLICABILITY The present invention is useful as an information sharing method for sharing a situation such as childcare in a child (infant) and a childcare person (for example, a mother) with another childcare person (for example, a father) or a related person (for example, a grandparent). is there.

1, 2, 3 Information processing system 10 Input terminal 20, 20A Server 30 Display terminal 32 Portable terminal 40, 44 Illustration 101 Input unit 102, 102A Identification unit 103 Child state determination unit 104 Mother state determination unit 105, 106, 113 Holding unit 107, 107A Sharing determination unit 108 Generation unit 109, 109A Transmission unit 110 Display unit 112 Environmental sound determination unit 115 Position acquisition unit T1, T2, T3, T4, T5 table

Claims (14)

Using a processor
Acquire sound information obtained by sound collection
Identifying a child's voice and an adult's voice included in the sound indicated by the sound information;
Determining the child's condition based on the identified child's voice;
Determining the status of the adult based on the identified voice of the adult;
Generating the notification according to the determined state of the child, the determined adult state, and a notification destination for the adult state;
Sending the generated notification to the destination;
Information processing method. The information processing method according to claim 1, wherein generating the notification includes generating the notification having a different expression or content depending on the destination. The information according to claim 2, wherein generating the notification includes generating the notification including a pattern or a sentence that is different in expression or content depending on the destination and indicates the state of the adult. Processing method. The generation of the notification includes generating the notification in which whether the generated notification includes or does not include a graphic or a sentence indicating the adult state depends on the destination. Information processing method described in 1. The information processing method according to claim 3, wherein expression or content of the symbol or the sentence varies depending on an attribute of the destination. Generating the notification calculates an index according to at least one of the determined state of the child and the determined state of the adult, and the notification is performed only when the calculated index is higher than a threshold value. The information processing method of any one of Claims 1-5 including producing | generating. Generating the notification calculates an index according to at least one of the determined state of the child and the determined state of the adult, and the larger the calculated index, the larger the pattern The information processing method according to claim 1, further comprising generating a notification. Generating the notification includes
Accepting information indicating the adult status via an input device,
The information according to any one of claims 1 to 7, further comprising: generating the notification by converting the received information into information in a form issued by the child or information indicating the state of the child. Processing method. The information processing method according to claim 1, wherein the destination is determined according to the determined state of the child and the determined state of the adult. Furthermore, the environmental sound included in the sound indicated by the sound information is identified,
Determining the adult status is
The information processing method according to claim 1, further comprising: determining a state of the adult based on the identified voice of the adult and the environmental sound. In the information processing method, further, a detection result by a sensor for detecting a person is acquired,
Determining the adult status is
The information processing method according to claim 1, further comprising: determining a state of the adult based on the identified voice of the adult and the detection result. The information processing method further acquires position information indicating the position of the destination,
Sending the notification to the destination is
The information processing method according to any one of claims 1 to 11, further comprising: transmitting the notification to the destination in response to the destination being in a predetermined position with reference to the position information. The predetermined position is a position where a boarding / alighting recorder related to the vehicle is installed,
The information processing method according to claim 12, further comprising: transmitting the notification to the destination in response to communication with the boarding / exiting recorder using proximity wireless communication by a terminal carried by a person related to the destination. An identification unit for identifying a child's voice and an adult's voice included in the sound indicated by the sound information obtained by the sound collection by the sound collection device;
A child state determination unit for determining the state of the child based on the voice of the identified child;
An adult state determination unit for determining the adult state based on the identified adult voice;
A generating unit that generates the notification according to the determined state of the child, the determined adult state, and a destination of the notification about the adult state;
An information processing apparatus comprising: a transmission unit that transmits the generated notification to the destination.

Images