JP7405502B2 - Information processing device, information processing method, and information processing program - Google Patents

Description

The present invention relates to an information processing device, an information processing method, and an information processing program.

2. Description of the Related Art Conventionally, techniques have been provided for providing various information to users using directional speakers and the like. For example, there is a technology that provides an in-vehicle speaker system that allows each seat to hear a different sound without the sound output from the speaker spreading to the surrounding area.

Japanese Patent Application Publication No. 2005-217807

However, with the above-mentioned conventional technology, it is not always possible to provide appropriate information according to the position of the target user within the moving body. For example, if you simply make it possible for each seat to hear a different sound without it spreading to the surrounding area, it will be difficult to provide appropriate information to the user if who is sitting where is not taken into consideration.

The present application has been made in view of the above, and aims to provide an information processing device, an information processing method, and an information processing program that enable appropriate information provision according to the location of a target user within a moving body. shall be.

The information processing device according to the present application includes an acquisition unit that acquires target position information indicating the position of a target user to whom information is to be provided within a predetermined moving object, and based on the target position information acquired by the acquisition unit, A directional speaker that is a directional speaker that outputs audio toward the position of the target user is determined as an output target speaker that is a directional speaker that outputs audio related to the content that corresponds to the target user. The present invention is characterized by comprising: a determining section for determining.

According to one aspect of the embodiment, it is possible to provide appropriate information according to the position of the target user within the moving object.

FIG. 1 is a diagram illustrating an example of information processing according to an embodiment. FIG. 2 is a diagram illustrating a configuration example of an information processing system according to an embodiment. FIG. 3 is a diagram illustrating a configuration example of an information processing device according to an embodiment. FIG. 4 is a diagram illustrating an example of a user information storage unit according to the embodiment. FIG. 5 is a diagram illustrating an example of a POI information storage unit according to the embodiment. FIG. 6 is a diagram illustrating an example of a content information storage unit according to the embodiment. FIG. 7 is a diagram illustrating an example of a mobile object information storage unit according to the embodiment. FIG. 8 is a diagram illustrating an example of a sensor information storage unit according to the embodiment. FIG. 9 is a flowchart illustrating an example of information processing according to the embodiment. FIG. 10 is a diagram illustrating an example of information processing according to the embodiment. FIG. 11 is a hardware configuration diagram showing an example of a computer that implements the functions of the information processing device.

DESCRIPTION OF THE PREFERRED EMBODIMENTS An information processing apparatus, an information processing method, and an embodiment of an information processing program (hereinafter referred to as "embodiments") according to the present application will be described in detail below with reference to the drawings. Note that the information processing apparatus, information processing method, and information processing program according to the present application are not limited to this embodiment. Further, in each of the embodiments below, the same parts are given the same reference numerals, and redundant explanations will be omitted.

(Embodiment)
[1. Information processing〕
First, an example of information processing according to the embodiment will be described using FIG. 1. FIG. 1 is a diagram illustrating an example of information processing according to an embodiment. In the example of FIG. 1, the information processing device 100 sends a directional speaker that outputs audio toward the position of a user to whom information is to be provided (also referred to as a "target user") in a moving object, such as a car, to a target user. A case is shown in which a directional speaker (also referred to as an "output target speaker") is determined to output audio related to the corresponding content. In the example of FIG. 1, a case is shown in which audio is output from the directional speaker 20 disposed on a moving body C1 driven by a user U1. Note that the content referred to herein is not limited to entertainment-related music content, advertising content, etc., but also includes various information provided to various users, such as the voice of the user and the other party on the phone. Further, the moving object is not limited to a car, but may be any moving object as long as a plurality of people can be located in the interior space. For example, the moving object may be a variety of moving objects such as a bus, train, airplane, or ship.

[Configuration of information processing system]
Prior to describing FIG. 1, the configuration of the information processing system 1 will be described using FIG. 2. FIG. 2 is a diagram illustrating a configuration example of an information processing system according to an embodiment. As shown in FIG. 2, the information processing system 1 includes a terminal device 10, a directional speaker 20, and an information processing device 100. The terminal device 10, the directional speaker 20, and the information processing device 100 are connected via a predetermined network N so that they can communicate by wire or wirelessly. Note that the information processing system 1 shown in FIG. 2 may include a plurality of terminal devices 10, a plurality of directional speakers 20, and a plurality of information processing apparatuses 100.

The terminal device 10 is a terminal device (information processing device) used by a user. The terminal device 10 may be any type of terminal device as long as it is movable with the user. The terminal device 10 may be a communication device that can communicate with the directional speaker 20 or the information processing device 100. The terminal device 10 is realized by, for example, a smart speaker, a smartphone, a tablet terminal, a notebook PC (Personal Computer), a mobile phone, a PDA (Personal Digital Assistant), or the like.

FIG. 1 shows a case where the terminal device 10 is a smart speaker. For example, the terminal device 10 (terminal device TM1-1) identified by the terminal ID "TM1-1" corresponds to the terminal device 10 located in the mobile body C1 of the user U1 shown in FIG. In this way, when "user U* (* is an arbitrary number)" is written, it indicates that the user is identified by the user ID "U*". For example, when "user U1" is written, the user is identified by the user ID "U1". Furthermore, when it is written as "mobile body C* (* is an arbitrary number)", it indicates that the mobile body is a mobile body identified by the mobile body ID "C*". For example, when "mobile body C1" is written, the mobile body is a mobile body identified by the mobile body ID "C1".

Further, the terminal device 10 identified by the terminal ID “TM1-1” may be written as the terminal device TM1-1 as described above. In this way, when each terminal device 10 is explained separately, the terminal ID (TM1-1, etc.) is added to the end of "terminal device" in the description. When describing each terminal device 10 without any particular distinction, it will simply be referred to as "terminal device 10."

The terminal device 10 also collects information detected by various sensors (hereinafter also referred to as "sensor information"). The terminal device 10 includes a sensor section including various sensors. Further, it is assumed that the terminal device 10 has a function of a position sensor such as a GPS (Global Positioning System) sensor, and is capable of detecting and acquiring the user's position. Furthermore, the terminal device 10 may estimate and acquire the user's location information using the location information of the base station with which it is communicating or the radio waves of Wi-Fi (registered trademark) (Wireless Fidelity). Note that below, location information may be simply referred to as "location."

Furthermore, the terminal device 10 has a sound sensor such as a microphone that detects sound. For example, the terminal device 10 detects the user's utterances around the terminal device 10 using a sound sensor. For example, the terminal device 10 may be a device (voice assist terminal) that detects surrounding sounds and performs various processes depending on the detected sounds. For example, the terminal device 10 is a terminal device that processes a user's utterance. For example, the terminal device 10 collects not only the user's utterances but also environmental sounds around the terminal device 10 and the like. Note that the terminal device 10 is not limited to the above, and may include various sensors. For example, the terminal device 10 includes various sensors such as an acceleration sensor, a gyro sensor, a temperature sensor, a humidity sensor, an illuminance sensor, a pressure sensor, a proximity sensor, and sensors for acquiring biological information such as odor, sweat, heartbeat, pulse, and brain waves. It may have a sensor. Then, the terminal device 10 may transmit various sensor information detected by various sensors to the information processing device 100.

Further, the terminal device 10 may have a voice recognition function. Furthermore, the terminal device 10 may be able to acquire information from a speech recognition server that provides speech recognition services. In this case, the information processing system 1 may include a voice recognition server. In the example of FIG. 1, it is assumed that the terminal device 10 and the voice recognition server appropriately use various conventional techniques to recognize the user's utterances and estimate the user who has uttered the utterances, so the explanation will be omitted as appropriate.

Further, the terminal device 10 may include an image sensor or the like. For example, the terminal device 10 has various functions such as an infrared sensor, a human sensor, a temperature sensor, and an atmospheric pressure sensor, and can detect and obtain sensor information related to the environment surrounding the terminal device 10, such as temperature and atmospheric pressure. There may be. Further, the terminal device 10 transmits various information and the like to the information processing device 100. For example, the terminal device 10 transmits various sensor information such as location information regarding the user to the information processing device 100.

The directional speaker 20 is an audio output device that is placed on a moving body and outputs audio in a predetermined direction. For example, the directional speaker 20 is an information processing device that has a communication function for transmitting and receiving information to and from external devices such as the terminal device 10 and the information processing device 100. The directional speaker 20 is an audio output device that can limit the audible range of sound to a relatively narrow angle. For example, the directional speaker 20 is a speaker with high directivity, and can output audio only to a user located in a desired direction. For example, the directional speaker 20 may be a speaker that has high directivity by using ultrasonic waves. For example, directional speaker 20 may be a parametric speaker. Note that the directional speaker 20 may be realized by any means as long as it is capable of outputting audio only to a desired user. Note that "only the desired user" here means that the voice can be recognized mainly by the desired target user, and that the voice is not recognized by any other users other than the target user. It's not a thing.

FIG. 1 shows a case where four directional speakers 20, including a directional speaker DS1-1 and a directional speaker DS1-2, are arranged in a moving body C1. The directional speaker 20 identified by the sensor ID "DS1-1" is described as the directional speaker DS1-1 as described above, and the directional speaker 20 identified by the sensor ID "DS1-2" is described as the directional speaker DS1-1 as described above. It is sometimes written as a directional speaker DS1-2. In this way, when each directional speaker 20 is explained separately, the sensor ID (such as DS1-1) is added to the end of "directional speaker" in the description. When describing each directional speaker 20 without any particular distinction, it will simply be referred to as "directional speaker 20."

In the example of FIG. 1, the mobile object C1 includes a directional speaker DS1-1 that outputs audio toward the driver's seat of the mobile object C1, and a directional speaker DS1 that outputs audio toward the passenger seat of the mobile object C1. -2 indicates that it is placed. That is, in the mobile object C1, the directional speaker DS1-1 outputs audio to the user seated in the driver's seat, and the directional speaker DS1-2 outputs audio to the user seated in the passenger seat. Show that. Furthermore, a directional speaker DS1-3 that outputs audio toward the right side of the rear seat and a directional speaker DS1-4 that outputs audio toward the left side of the rear seat are also arranged in the mobile object C1. 1, in order to simplify the explanation, an example will be described in which a user is seated in the driver's seat and passenger seat of the mobile object C1.

As shown in FIG. 1, the directional speaker DS1-1 is installed so that audio is output toward the position of a user (also referred to as a "driver") seated in the driver's seat of the mobile object C1. Outputs audio only to the driver. For example, the directional speaker DS1-1 receives audio related to content from the terminal device TM1-1 or the information processing device 100, and outputs the received audio toward the vicinity of the head of the driver's seat of the mobile object C1.

Further, as shown in FIG. 1, the directional speaker DS1-2 is installed so that audio is output toward the position of the user seated in the passenger seat of the mobile object C1. Outputs audio only to the user. For example, the directional speaker DS1-1 receives audio related to content from the terminal device TM1-1 or the information processing device 100, and outputs the received audio toward the vicinity of the head of the user seated in the passenger seat of the mobile object C1. do.

The information processing device 100 causes a directional speaker that outputs audio toward the location of a user to whom content is to be provided (target user) to output audio related to the content corresponding to the target user based on the target location information. This is an information processing device that is determined as a target speaker. That is, the information processing device 100 is a determining device that determines an output target speaker that outputs audio related to content to a target user. Further, the information processing device 100 determines the audio related to the content to be provided (distributed) to the terminal device 10 and the directional speaker 20, and provides (distributes) the determined audio to the terminal device 10 and the directional speaker 20 as an advertisement.

Furthermore, although not shown, the information processing system 1 may include an information providing device that provides various information to the information processing device 100 and the like. For example, the information providing device is an information processing device that provides the information processing device 100 with open data, which is data that is widely permitted to be used. For example, the information providing device may be an information processing device that is managed by each local government and provides data held by the local government to the outside as open data. Further, for example, the information providing device may be various information processing devices such as a server managed by the Japan Meteorological Agency. The information providing device may provide data (information) that is permitted to be used, including but not limited to the above, open data related to traffic such as road information, open data related to meteorology such as weather and temperature, geospatial information, disaster prevention and mitigation. Various open data such as information, procurement information, statistical information, etc. may be provided. The information processing device 100 may acquire various information from an information providing device.

From here, the flow of information processing will be explained using FIG. FIG. 1 is a diagram illustrating an example of information processing according to an embodiment. Specifically, FIG. 1 is a diagram illustrating an example of a providing process in which a target user is determined based on the position of the mobile object C1 and audio related to content according to the target user is provided to the target user.

In the example of FIG. 1, a case is shown in which a mobile object C1, which is a car shown in map information MP1, is driving a user U1, and a child of the user U1 is riding in the passenger seat. Further, FIG. 1 shows a case where a terminal device TM1-1 used by a user U1 is arranged in the mobile C1. The terminal device TM1-1 may be an in-vehicle smart speaker. The terminal device TM1-1 detects sensor information using various sensors and transmits it to the information processing device 100. For example, the terminal device TM1-1 detects the utterances of the user U1 and the user U2 within the mobile body C1 using a sound sensor, and transmits the detected utterances to the information processing device 100. Furthermore, the terminal device TM1-1 transmits position information detected by the position sensor to the information processing device 100. In addition, in the example of FIG. 1, the location information is illustrated by an abstract code such as location information LC1-1, but the location information may be information indicating concrete latitude and longitude (latitude and longitude information), etc. good. Further, hereinafter, "position information LC* (* is a character string such as an arbitrary numerical value)" may be written as "position LC*". For example, when "position LC1-1" is written, it indicates that the position corresponds to position information LC1-1.

In the example of FIG. 1, the position of the moving body C1 moves from the position LC1-1 to the position LC1-2. For example, the moving object C1 moves to the position LC1-2 due to the driving of the user U1. The terminal device TM1-1 located in the mobile body C1 transmits the detected sensor information SN1-1 to the information processing device 100. The terminal device TM1-1 transmits sensor information SN1-1, which is image information of a moving image detected by an image sensor, to the information processing device 100. In the example of FIG. 1, the terminal device TM1-1 transmits sensor information SN1-1, which is a moving image of the inside of the mobile body C1, to the information processing device 100. In the example of FIG. 1, sensor information SN1-1 indicates that the user U1 is seated in the driver's seat of the moving object C1, the child of the user U1 is seated in the driver's seat of the moving object C1, and the child of the user U1 is seated in the driver's seat of the moving object C1. Information indicating that no one is present shall be included.

For example, the terminal device TM1-1 transmits the position information indicating the position LC1-2 where the sensor information SN1-1 was detected and the date and time information indicating that the sensor information SN1-1 was detected at the date and time dt1-1 to the sensor information SN1. -1 and is transmitted to the information processing apparatus 100. For example, the terminal device TM1-1 transmits location information of the terminal device TM1-1 and information on the date and time when the sensor information SN1-1 was detected to the information processing device 100 together with the sensor information SN1-1. Further, for example, the terminal device TM1-1 associates terminal information (terminal ID, etc.) with the sensor information SN1-1 that makes it possible to identify that the acquisition source of the sensor information SN1-1 is the terminal device TM1-1. It is transmitted to the information processing device 100. For example, the terminal device TM1-1 transmits the terminal ID of the terminal device TM1-1 and the like to the information processing device 100 together with the sensor information SN1-1. Note that the terminal device TM1-1 may transmit various information such as sensor information to the information processing device 100 in real time every time it detects sensor information, or at predetermined intervals (for example, every 5 minutes). Various information such as sensor information may be transmitted to the information processing device 100.

Thereby, the information processing device 100 acquires the sensor information SN1-1, location information, date and time information, terminal information, etc. (step S11). In the example of FIG. 1, the information processing apparatus 100 acquires the log identified by the log ID "LG11" as shown in list information SLST1. The information processing device 100 acquires information indicating that the acquisition source of the sensor information SN1-1 is the terminal device TM1-1. The information processing device 100 acquires sensor information SN1-1 whose type is "image", that is, a moving image. The information processing device 100 also obtains information indicating that the sensor information SN1-1 was obtained (detected) at the position LC1-2 at the date and time dt1-1.

The information processing device 100 that has acquired the sensor information SN1-1, which is a moving image, analyzes the sensor information SN1-1 (step S12). In the example of FIG. 1, the information processing device 100 analyzes the sensor information SN1-1 using various conventional techniques related to image analysis and image processing as appropriate, and calculates each position within the moving body C1 (“in-vehicle position”). estimating the user's seating position at

The information processing device 100 appropriately uses various conventional techniques related to image analysis and image processing to determine each of the moving objects C1 based on the sensor information SN1-1, as shown in the moving object information storage section 124 in FIG. Estimate whether a user is seated in the vehicle. The information processing device 100 estimates whether a user is seated at each position in the vehicle C1 by appropriately using various conventional techniques related to object recognition such as specific object recognition. For example, the information processing device 100 uses various conventional techniques related to object recognition such as specific object recognition as appropriate to estimate whether a user is seated in the driver's seat, passenger seat, or rear seat of the mobile object C1. Further, the information processing device 100 uses various conventional techniques as appropriate to estimate the attribute information of the seated user. For example, the information processing device 100 estimates attribute information such as the gender and age of the seated user by appropriately using various conventional techniques related to human face recognition. For example, the information processing device 100 estimates whether the seated user is an adult or a child, appropriately using various conventional techniques related to human face recognition. For example, the information processing device 100 appropriately uses various conventional techniques related to human face recognition to estimate whether the seated user is an adult in his or her 20s or older, or a child in his or her teens or younger.

The "mobile body ID" shown in the mobile body information storage section 124 in FIG. 1 indicates identification information for identifying a mobile body. The "vehicle terminal ID" shown in the mobile body information storage section 124 in FIG. 1 indicates information that identifies a terminal device mounted on a mobile body.

"In-vehicle position information" shown in the moving body information storage unit 124 in FIG. 1 indicates information regarding the position where the user is seated within the moving body. The "in-vehicle position information" includes items such as "in-vehicle position #1 (driver's seat)" and "in-vehicle position #2 (passenger seat)." “In-vehicle position #1 (driver's seat)” and “in-vehicle position #2 (passenger seat)” include items such as “in-vehicle position ID,” “speaker ID,” and “seated user.” In addition, in the example of FIG. 5, only "in-vehicle position #1 (driver's seat)" and "in-vehicle position #2 (passenger seat)" are illustrated, but "in-vehicle position #3 (right rear seat)" and "in-vehicle position Items such as "#4 (left rear seat)" are included depending on the number of positions where the user is seated in the corresponding moving object.

The "in-vehicle position ID" shown in the mobile object information storage section 124 in FIG. 1 indicates information that identifies the corresponding in-vehicle position. The "speaker ID" shown in the mobile object information storage section 124 in FIG. 1 indicates information that identifies the directional speaker associated with the corresponding in-vehicle position. "Seated user" shown in the mobile object information storage unit 124 in FIG. 1 indicates information regarding a user seated at a corresponding position in the vehicle.

In the example of FIG. 1, the mobile object (mobile object C1) identified by the mobile object ID "C1" indicates that the terminal device installed therein is the terminal device identified by the in-vehicle terminal ID "TM1-1". . That is, the mobile object C1 indicates that the terminal device mounted thereon is the terminal device TM1-1.

Further, at the position of the driver's seat in the mobile object C1, which is identified by the in-vehicle position ID "CSP1-1", there is a directional speaker (directional speaker DS1-1) identified by the speaker ID "DS1-1". 1) is associated. In addition, at the position of the passenger seat in the mobile object C1, which is identified by the in-vehicle position ID "CSP1-2," there is a directional speaker (directional speaker DS1-2) identified by the speaker ID "DS1-2." 2) is associated.

In the example of FIG. 1, the information processing device 100 estimates that a user is seated in the driver's seat and the passenger seat of the mobile object C1 based on the sensor information SN1-1. For example, the information processing device 100 determines that a user is seated in the driver's seat when a predetermined object corresponding to the external shape of a person is included in the position corresponding to the driver's seat in the moving body C1 in the sensor information SN1-1. It is estimated that For example, the information processing device 100 uses various conventional techniques related to object recognition as appropriate to estimate that a user is seated in the driver's seat of the mobile object C1. For example, the information processing device 100 uses various conventional techniques related to human recognition as appropriate to estimate that a user is seated in the driver's seat of the mobile object C1. For example, the information processing device 100 estimates that the user is seated in the driver's seat of the mobile object C1, appropriately using various conventional techniques for recognizing the shape of a person.

For example, the information processing device 100 estimates that the user sitting in the driver's seat of the mobile object C1 is an adult male based on the information on the face area of the user sitting in the driver's seat of the mobile object C1 in the sensor information SN1-1. It's okay. Further, for example, the information processing device 100 determines that the user sitting in the driver's seat of the mobile body C1 is an adult male based on the information on the face area of the user sitting in the driver's seat of the mobile body C1 in the sensor information SN1-1. It may be estimated that it is U1.

For example, the information processing apparatus 100 may estimate that the user U1 is the user U1 using image information such as a facial photograph of the user U1 stored in the storage unit 120 (see FIG. 3). For example, the information processing device 100 compares the face photo of the user U1 stored in the storage unit 120 (see FIG. 3) with the face area of the user seated in the driver's seat of the mobile object C1 in the sensor information SN1-1. Therefore, it may be estimated that the user sitting in the driver's seat of the mobile object C1 is the user U1.

For example, if the sensor information SN1-1 includes a predetermined object corresponding to the external shape of a person at the position corresponding to the passenger seat in the moving body C1, the information processing device 100 determines that the user is seated in the passenger seat. It is estimated that For example, the information processing device 100 uses various conventional techniques related to object recognition as appropriate to estimate that a user is seated in the passenger seat of the mobile object C1. For example, the information processing device 100 uses various conventional techniques related to object recognition as appropriate to estimate that a user is seated in the passenger seat of the mobile object C1. For example, the information processing device 100 estimates that a user is seated in the passenger seat of the mobile object C1, using various conventional techniques for recognizing the shape of a person.

For example, the information processing device 100 estimates that the user sitting in the passenger seat of the mobile object C1 is a child based on the information on the face area of the user sitting in the passenger seat of the mobile object C1 in the sensor information SN1-1. Good too. For example, the information processing device 100 estimates that the user sitting in the passenger seat of the mobile object C1 is a child based on the information on the face area of the user sitting in the passenger seat of the mobile object C1 in the sensor information SN1-1. You may.

For example, the information processing device 100 estimates that the user sitting in the passenger seat of the mobile object C1 is a child, using image information such as face photographs of children and adults stored in the storage unit 120 (see FIG. 3). It's okay. For example, the information processing device 100 compares the face photo of the child stored in the storage unit 120 (see FIG. 3) with the face area of the user sitting in the passenger seat of the mobile object C1 in the sensor information SN1-1, By determining that the face area and the child's face photo are dissimilar, it may be estimated that the user sitting in the passenger seat of the mobile object C1 is a child. For example, the information processing device 100 compares the face photo of an adult stored in the storage unit 120 (see FIG. 3) with the face area of the user seated in the passenger seat of the mobile object C1 in the sensor information SN1-1, By determining that the face area and the adult face photo are dissimilar, it may be estimated that the user sitting in the passenger seat of the mobile object C1 is a child. Note that the above is an example, and the information processing apparatus 100 may estimate the user attributes of the seated user using any method as long as it is possible to estimate whether the seated user is a child.

Further, the information processing device 100 estimates that no one is seated in the rear seat of the mobile object C1 based on the sensor information SN1-1. For example, in the sensor information SN1-1, if a predetermined object corresponding to the external shape of a person is not included in the position corresponding to the rear seat of the mobile object C1, the information processing device 100 determines that the user is seated in the rear seat. It is assumed that there is no.

Note that the above is just an example, and the information processing device 100 may use various conventional techniques as appropriate to analyze the video and estimate whether the user is seated in the vehicle. In addition, the information processing device 100 transmits the video (sensor information) to an external information processing device (analysis device) that provides a video analysis service, so that the information processing device 100 can analyze the video (sensor information) from the external information processing device. The estimated result of whether or not the user is seated in the vehicle may be acquired.

Through the above-described processing, the information processing device 100 indicates that the user sitting in the driver's seat of the moving object C1 is the user U1, who is an adult male, as shown in the moving object information storage unit 124 in FIG. Get information. Further, the information processing device 100 acquires information indicating that the user sitting in the passenger seat of the moving body C1 is a child, as shown in the moving body information storage unit 124 in FIG.

Then, the information processing device 100 determines a target user (step S13). For example, the information processing device 100 determines a passenger other than the driver as the target user among the plurality of users located in the mobile object C1. In the example of FIG. 1, the information processing apparatus 100 determines a child (referred to as "child user CU") sitting in the passenger seat of the mobile object C1 as the target user. Then, the information processing device 100 acquires information indicating that the position (target position information) of the child user CU, who is the target user, is in the passenger seat of the mobile body C1 from the mobile body information storage unit 124 in FIG. do. The information processing device 100 retrieves a moving object C1, which is the in-vehicle position identified by the in-vehicle position ID "CPS1-2," from the moving object information storage unit 124 in FIG. Obtain information indicating the passenger seat.

Note that the above determination of the target user is an example, and the information processing apparatus 100 may determine the target user using various types of information as appropriate. For example, target users may be determined depending on the content to be output. For example, if output of content targeted at user U1 is requested, user U1 may be the target user, but this point will be described later.

Then, the information processing device 100 determines the content (step S14). The information processing device 100 determines content based on the position of the mobile object C1 and content output conditions (also simply referred to as "output conditions"). The information processing apparatus 100 determines the content based on the attributes of the target user and the output conditions regarding the output timing of the content. In the example of FIG. 1, the information processing device 100 determines the content to be provided to the child user CU based on the position LC1-2 of the mobile object C1 and each output condition shown in the content information storage unit 123.

"Content ID" shown in the content information storage unit 123 in FIG. 1 indicates identification information for identifying content. "Content" indicates content. “Provider ID” indicates identification information for identifying a content provider.

The "output condition" shown in the content information storage unit 123 in FIG. 1 indicates the distribution condition (output condition) of the content identified by the content ID. The "output conditions" include items such as "target user" and "timing." “Target user” indicates a target (user) to whom the content identified by the content ID is to be output. “Target user” indicates the attributes of the user to whom the content is output. "Timing" indicates the timing at which the content identified by the content ID is output. "Timing" may be various timing conditions such as range or time zone. "Timing" may be various timing conditions such as a positional relationship with a predetermined POI or a context.

In the example shown in FIG. 1, the content (content CT1) identified by the content ID "CD1" indicates that the content is "CT1." The advertiser of content CT1 is store SP1, which is toy store A. The condition regarding the target of content CT1 indicates that it is a "child." That is, the content CT1 indicates that the content is output with "child" as the target attribute. The condition regarding the timing of content CT1 indicates that it is "range AR1 (1 km radius)". That is, the content CT1 indicates that the content is outputted from the toy store A at a timing located within the "range AR1 (radius 1 km)".

For example, the information processing device 100 determines content based on output conditions. In the example of FIG. 1, the information processing device 100 determines content that satisfies output conditions regarding target and timing as content to be output to the terminal device TM1-1.

If the attributes of the target user correspond to the target user of the output condition, the information processing apparatus 100 determines that the target user satisfies the target user of the output condition. The information processing apparatus 100 determines whether the target user satisfies the target user output condition by comparing the attributes of the target user and the output condition "target user" of each content. In the example of FIG. 1, since the target user is a child user CU, the information processing apparatus 100 determines that the target user "child" of the content CT1 is satisfied.

Furthermore, the information processing apparatus 100 determines whether the output condition "timing" of the content CT1 is satisfied based on the position of the mobile object C1. For example, the information processing apparatus 100 determines that the output condition regarding the timing of the content CT1 is satisfied when the position LC1-2 of the moving body C1 is located within the timing "range AR1" of the content CT1. For example, the information processing device 100 determines whether the output condition regarding the timing of the content CT1 is satisfied based on the position LC1-2 of the mobile object C1 and the position LC2-1 of the store SP1. For example, the information processing device 100 acquires, as POI position information, position information indicating the location (position LC2-1) of the store SP1, which is a POI related to the content CT1, from the POI information storage unit 122 (see FIG. 5). The information processing device 100 determines whether the output condition regarding the timing of the content CT1 is satisfied by comparing the position LC1-2 of the moving body C1 and the position LC2-1 of the store SP1. The information processing device 100 determines whether the output condition regarding the timing of the content CT1 is satisfied by calculating the distance between the position LC1-2 of the mobile object C1 and the position LC2-1 of the store SP1. In this case, if the calculated distance between the user U1 and the store SP1 is less than or equal to the radius of the range AR1, the information processing device 100 determines that the output condition regarding the timing of the content CT1 is satisfied. For example, if the calculated distance between the user U1 and the store SP1 is within 1 km, the information processing device 100 determines that the output condition regarding the timing of the content CT1 is satisfied. In the example of FIG. 1, the information processing apparatus 100 determines that the output condition regarding the timing of the content CT1 is satisfied because the position LC1-2 of the moving object C1 is within the range AR1.

As described above, in the example of FIG. 1, the information processing apparatus 100 determines that the content CT1 satisfies the output conditions regarding the target and timing. Therefore, the information processing apparatus 100 determines the content to be provided to the child user CU as the content CT1.

Then, the information processing device 100 determines the speaker that outputs the content CT1 (step S15). For example, the information processing device 100 determines, among the directional speakers 20 of the mobile object C1, the directional speaker 20 that outputs audio toward the position of the child user CU as the output target speaker that outputs the audio related to the content CT1. . In the example of FIG. 1, the information processing device 100 determines the directional speaker DS1-2 corresponding to the passenger seat where the child user CU is seated as the output target speaker. Then, the information processing device 100 provides the content CT1 to the directional speaker DS1-2 (step S16). The information processing device 100 transmits (distributes) the content CT1 to the directional speaker DS1-2. Note that the information processing device 100 may provide the content CT1 to the directional speaker DS1-2 via the terminal device TM1-1.

The directional speaker DS1-2, which has received the content CT1 from the information processing device 100, outputs the content CT1 (step S17). For example, the directional speaker DS1-2 outputs audio related to the content CT1 toward the child user CU. In the example of FIG. 1, the directional speaker DS1-2 audio outputs the content CT1 related to the store SP1, which is the A toy store. For example, the directional speaker DS1-2 outputs content CT1 such as "A toy store is ahead" or "AA card new release". Note that the content CT1 may be any advertisement as long as it is an advertisement regarding the store SP1, which is the A toy store. For example, the content CT1, which is an audio advertisement, may be any audio information as long as it reminds the user of A toy store. For example, the content CT1 may be audio information such as a jingle or a sound logo corresponding to A toy store.

In this way, the information processing device 100 appropriately determines the content to be output to the user by determining the content to be output to the target user based on the position of the mobile object C1 and the output conditions of each content. can do. Furthermore, the information processing device 100 can output content only to the target user by determining the output target speaker based on the target user's seating position within the mobile body C1. Thereby, the information processing device 100 can output content with appropriate content to the child user CU, using the directional speaker 20 corresponding to the child user CU, who is the target user. Therefore, the information processing apparatus 100 can provide appropriate information according to the position of the target user within the moving object.

In the example of FIG. 1, the information processing device 100 suppresses sound from reaching the driver's seat of the mobile object C1 by outputting the content CT1 only to the directional speaker DS1-2 corresponding to the passenger seat of the mobile object C1. can do. In other words, the information processing device 100 can suppress the sound from reaching the driver's seat of the mobile object C1, and allow the sound to reach the passenger seat of the mobile object C1, so that the driver can be careful when driving. It is possible to appropriately provide content to users other than the operator while suppressing interference. In this way, the information processing device 100 can appropriately provide content within the mobile body while maintaining safe driving of the mobile body.

[1-1. content〕
The example in FIG. 1 shows a case where the information processing device 100 decides to provide the content CT1, which is an advertisement regarding toy store A, but the information processing device 100 may also provide various contents to the target user. good. The information processing device 100 may provide entertainment music content to the location where the child is sitting (inside the vehicle).

[1-2. Output to driver]
The example in FIG. 1 shows a case where the information processing device 100 determines the user sitting in the passenger seat of the mobile object C1 as the target user, but the information processing device 100 determines the target user using various information as appropriate. You may. For example, target users may be determined depending on the content to be output. For example, the information processing device 100 acquires target position information indicating the position of a target user who is a driver among a plurality of users located in a car, which is a predetermined mobile body, and provides information to the driver of the mobile body. Content may also be output.

In the example of FIG. 1, when user U1, who is the driver of mobile object C1, receives a phone call from a predetermined user (user The audio of user X's utterances may be outputted to sexual speaker DS1-1. In other words, the information processing device 100 determines that the utterance information (content X) of the user U1's call destination (user The speaker DS1-1 is determined as the output target speaker for outputting the content X. Then, the directional speaker DS1-1 outputs the utterance information (content X) of the user X, who is the user U1's call destination, only to the user U1.

In this way, by determining the output target speaker that outputs the utterance information of the call destination, the information processing device 100 can, for example, when the mother leaves home and wants to talk only to the father who is riding in the car, the information processing device 100 can Notifications can be directed to fathers rather than children in a way that makes them easier to hear. Therefore, the information processing apparatus 100 can provide appropriate information according to the position of the target user within the moving body.

As described above, the content referred to in the present application may be various information such as the voice of the other party with whom the user is speaking. For example, the content may be an utterance by another user to the target user in a voice interaction by means such as a telephone. This point will be further described in detail below using FIG. 10. FIG. 10 is a diagram illustrating an example of information processing according to the embodiment. Specifically, FIG. 10 is a diagram illustrating an example of information processing when the content is utterances of other users. Note that in FIG. 10, descriptions of points similar to those in FIG. 1 will be omitted as appropriate.

From here, the flow of information processing will be explained using FIG. The example of FIG. 10 shows a case where a mobile object C1, which is a car shown in map information MP5, is driving a user U1, and a child of the user U1 is riding in the passenger seat. Further, FIG. 10 shows a case where the mobile body C1 is provided with a terminal device TM1-1 used by the user U1. In FIG. 10, it is assumed that the terminal device TM1-1 is a terminal capable of providing a voice dialogue service-related service to the user using a predetermined voice dialogue function. Note that the terminal device TM1-1 is communicably connected to a mobile terminal such as a smartphone used by the user U1 using various conventional wireless communication technologies such as Bluetooth (registered trademark), so that the terminal device TM1-1 can communicate with a mobile terminal such as a smartphone used by the user U1. The terminal may be a terminal capable of providing a service related to a voice dialogue service. Note that the terminal device TM1-1 may be any type of terminal as long as the user U1 can perform voice dialogue. In the example of FIG. 10, a case is shown in which the terminal device TM1-1 is an in-vehicle smart speaker, but the terminal device TM1-1 may be a mobile terminal such as a smartphone used by the user U1.

First, user U2 located at a position corresponding to house HM1 shown in FIG. 10 uses terminal device TM1-2 to make a call to user U1 (step S50). For example, the user U2 located in the house HM1 where the user U1 and the user U2 reside makes a telephone call to the user U1 using the terminal device TM1-2. For example, the information processing device 100 acquires position information from the terminal device TM1-2, and combines the acquired position information with information indicating the home positions of the user U1 and the user U2 stored in the storage unit 120 (see FIG. 3). By comparing the above, it may be determined that the user U2 is located in the residence HM1. For example, if the location acquired from the terminal device TM1-2 is within a predetermined range (for example, within 10 meters) from the user U2's home location, the information processing device 100 determines that the user U2 is located in the residence HM1. Good too.

Furthermore, in the example of FIG. 10, it is assumed that the terminal device TM1-1 is assigned a telephone number NM1, which is an identifier for specifying the terminal device TM1-1 in the voice interaction service. For example, the information processing device 100 stores allocation information indicating that the telephone number NM1 is allocated to the terminal device TM1-1 in the storage unit 120 (see FIG. 3), and stores the allocation information stored in the storage unit 120. to identify the terminal device TM1-1 from the telephone number NM1. In the example of FIG. 1, when the user U2 specifies the phone number NM1 to the terminal device TM1-2 and makes a call, the information processing device 100 stores the phone number NM1 specified by the user U2 and the allocation information of the storage unit in the storage unit 120. By comparing the numbers, the terminal device TM1-1 is identified from the telephone number NM1.

Then, the information processing device 100 uses the information stored in the user information storage unit 121 (see FIG. 4) to identify that the user of the terminal device TM1-1 corresponding to the telephone number NM1 is the user U1. The information processing device 100 obtains the telephone number NM1 by comparing the terminal device TM1-1 corresponding to the telephone number NM1 with the information of the terminal used by each user stored in the user information storage unit 121 (see FIG. 4). It is specified that the user of the terminal device TM1-1 corresponding to TM1-1 is the user U1. Thereby, the information processing device 100 identifies the user U1 as the destination of the user U2. That is, the information processing apparatus 100 identifies the user U1 as the other party of the voice dialogue of the user U2.

Note that the above is an example, and the information processing device 100 may specify the other party of the voice conversation by appropriately using various conventional techniques related to voice conversation services such as telephone calls. Further, the information processing device 100 may provide a service related to a voice dialogue service, and perform various processing by acquiring various information regarding the voice dialogue service from an external service providing device that provides the voice dialogue service. You may go.

In the example of FIG. 10, the user U1 who receives the call from the user U2 accepts the voice dialogue request and starts a voice dialogue with the user U2. The user U1 starts a voice conversation with the user U2 by performing an operation on the terminal device TM1-1 to accept a voice conversation request from the user U2. Further, in the example of FIG. 10, after starting the voice interaction between the user U1 and the user U2, the user U2 makes an utterance, and the information processing device 100 receives voice information indicating the utterance of the user U2 from the terminal device TM1-2. get.

In the example of FIG. 10, the information processing device 100 adds content that is uttered by the user U2 to the content information storage unit 123. In the example shown in FIG. 10, the information processing apparatus 100 adds the utterance of the user U2 to the content information storage unit 123 as the content (content CT5) identified by the content ID "CD5". As shown in the content information storage unit 123 in FIG. 10, the source of the content CT5 is the user U2 who uses the terminal device TM1-2. As shown in the content information storage unit 123 in FIG. 10, the target user of the content CT5 is the user U1. As shown in the content information storage unit 123 in FIG. 10, the condition regarding the timing of the content CT5 indicates that it is "utterance by the provider." In this way, the content CT5 is the utterance of the user U2 who is the provider, and is output at the timing when the utterance of the user U2 is acquired. That is, when the information processing apparatus 100 acquires the content CT5 that is the utterance of the user U2, it is shown that the information processing apparatus 100 provides it to the user U1, who is the target user, in real time. Furthermore, each time the user U2 speaks, the information processing device 100 updates the contents of the content CT5 to the latest utterance of the user U2, and provides the updated content CT5 to the user U1.

Note that the information processing apparatus 100 may delete the information corresponding to the content ID "CD5" from the content information storage unit 123 when the voice interaction between the user U1 and the user U2 ends. The information processing device 100 may delete the information corresponding to the content ID “CD5” from the content information storage unit 123 when either the user U1 or the user U2 performs an operation to disconnect the audio dialogue.

The terminal device TM1-1 located in the mobile body C1 transmits the detected sensor information SN1-5 to the information processing device 100. The terminal device TM1-1 transmits sensor information SN1-5, which is image information of a moving image detected by an image sensor, to the information processing device 100. In the example of FIG. 10, the terminal device TM1-1 transmits sensor information SN1-5, which is a moving image of the inside of the mobile body C1, to the information processing device 100. In the example of FIG. 10, sensor information SN1-5 indicates that the user U1 is seated in the driver's seat of the moving object C1, the child of the user U1 is seated in the driver's seat of the moving object C1, and the child of the user U1 is seated in the driver's seat of the moving object C1. Information indicating that no one is present shall be included.

For example, the terminal device TM1-1 transmits the position information indicating the position LC1-5 where the sensor information SN1-5 was detected and the date and time information indicating that the sensor information SN1-5 was detected at the date and time dt1-5 to the sensor information SN1. -5 and is transmitted to the information processing apparatus 100. For example, the terminal device TM1-1 transmits location information of the terminal device TM1-1 and information on the date and time when the sensor information SN1-5 was detected to the information processing device 100 together with the sensor information SN1-5. For example, the terminal device TM1-1 associates terminal information (terminal ID, etc.) with the sensor information SN1-5 that makes it possible to identify that the acquisition source of the sensor information SN1-5 is the terminal device TM1-1. It is transmitted to the information processing device 100. For example, the terminal device TM1-1 transmits the terminal ID of the terminal device TM1-1 and the like to the information processing device 100 together with the sensor information SN1-5.

Thereby, the information processing device 100 acquires sensor information SN1-5, location information, date and time information, terminal information, etc. (step S51). In the example of FIG. 10, the information processing apparatus 100 acquires the log identified by the log ID "LG15" as shown in list information SLST5. The information processing device 100 acquires information indicating that the acquisition source of the sensor information SN1-5 is the terminal device TM1-1. The information processing device 100 acquires sensor information SN1-5 whose type is "image", that is, a moving image. Further, the information processing device 100 acquires information indicating that the sensor information SN1-5 was acquired (detected) at the position LC1-5 at the date and time dt1-5.

The information processing device 100 that has acquired the sensor information SN1-5, which is a moving image, analyzes the sensor information SN1-5 (step S52). In the example of FIG. 10, the information processing device 100 uses various conventional techniques related to image analysis and image processing to analyze sensor information SN1-5, thereby determining the Estimate user seating.

In the example of FIG. 10, the information processing device 100 estimates that a user is seated in the driver's seat and the passenger seat of the mobile object C1 based on the sensor information SN1-5. For example, the information processing device 100 estimates that the user sitting in the driver's seat of the mobile object C1 is the user U1, using various conventional techniques related to human face recognition as appropriate. In the example of FIG. 10, the information processing device 100 uses image information such as a face photograph of the user U1 stored in the storage unit 120 (see FIG. 3) to determine whether the user sitting in the driver's seat of the mobile object C1 is the user U1. We estimate that there is. For example, the information processing device 100 compares the face photo of the user U1 stored in the storage unit 120 (see FIG. 3) with the face area of the user seated in the driver's seat of the mobile body C1 in the sensor information SN1-5. Therefore, it is estimated that the user sitting in the driver's seat of the mobile object C1 is the user U1.

Further, for example, if the sensor information SN1-5 includes a predetermined object corresponding to the external shape of a person at the position corresponding to the passenger seat in the moving body C1, the information processing device 100 determines that the user is seated in the passenger seat. It is estimated that For example, the information processing device 100 uses various conventional techniques related to object recognition as appropriate to estimate that a user is seated in the passenger seat of the mobile object C1. For example, the information processing device 100 uses various conventional techniques related to object recognition as appropriate to estimate that a user is seated in the passenger seat of the mobile object C1. For example, the information processing device 100 estimates that a user is seated in the passenger seat of the mobile object C1, using various conventional techniques for recognizing the shape of a person.

For example, the information processing device 100 estimates that the user sitting in the passenger seat of the mobile object C1 is a child based on the information on the face area of the user sitting in the passenger seat of the mobile object C1 in the sensor information SN1-5. Good too. For example, the information processing device 100 estimates that the user sitting in the passenger seat of the mobile object C1 is a child based on the information on the face area of the user sitting in the passenger seat of the mobile object C1 in the sensor information SN1-5. You may.

For example, the information processing device 100 estimates that the user sitting in the passenger seat of the mobile object C1 is a child, using image information such as face photographs of children and adults stored in the storage unit 120 (see FIG. 3). You can. For example, the information processing device 100 compares the child's face photograph stored in the storage unit 120 (see FIG. 3) with the face area of the user sitting in the passenger seat of the mobile object C1 in the sensor information SN1-5, By determining that the face area and the child's face photo are dissimilar, it may be estimated that the user sitting in the passenger seat of the mobile object C1 is a child. For example, the information processing device 100 compares the face photo of an adult stored in the storage unit 120 (see FIG. 3) with the face area of the user sitting in the passenger seat of the mobile object C1 in the sensor information SN1-5, By determining that the face area and the adult face photo are dissimilar, it may be estimated that the user sitting in the passenger seat of the mobile object C1 is a child. Note that the above is an example, and the information processing apparatus 100 may estimate the user attributes of the seated user using any method as long as it is possible to estimate whether the seated user is a child.

Furthermore, the information processing device 100 estimates that no one is seated in the rear seat of the mobile object C1 based on the sensor information SN1-5. For example, in the sensor information SN1-5, if a predetermined object corresponding to the external shape of a person is not included in the position corresponding to the rear seat in the mobile object C1, the information processing device 100 determines that the user is seated in the rear seat. It is assumed that there is no.

Note that the above is just an example, and the information processing device 100 may use various conventional techniques as appropriate to analyze the video and estimate whether the user is seated in the vehicle. In addition, the information processing device 100 transmits the video (sensor information) to an external information processing device (analysis device) that provides a video analysis service, so that the information processing device 100 can analyze the video (sensor information) from the external information processing device. The estimated result of whether or not the user is seated in the vehicle may be acquired.

Through the above-described processing, the information processing device 100 acquires information indicating that the user sitting in the driver's seat of the moving body C1 is the user U1, as shown in the moving body information storage unit 124 in FIG. . Further, the information processing device 100 acquires information indicating that the user sitting in the passenger seat of the moving body C1 is a child, as shown in the moving body information storage unit 124 in FIG.

Then, the information processing device 100 determines a target user (step S53). For example, the information processing apparatus 100 determines the user with whom the user U2 has a voice dialogue as the target user. In the example of FIG. 10, the information processing apparatus 100 determines the user U1, who is the destination of the user U2, as the target user. Then, the information processing device 100 acquires information indicating that the position of the user U1 who is the target user (target position information) is the driver's seat of the mobile body C1 from the mobile body information storage unit 124 in FIG. . The information processing device 100 retrieves, from the moving object information storage unit 124 in FIG. 10, the object position information of the moving object C1, which is the in-vehicle position identified by the in-vehicle position ID "CPS1-1," as the target position information of the user U1, who is the target user. Obtain information indicating the driver's seat.

Then, the information processing device 100 determines the content (step S54). In the example of FIG. 10, since the user U1 and the user U2 are engaged in a voice conversation, the information processing apparatus 100 determines the utterance of the user U2 as the content to be provided to the user U1. That is, the information processing device 100 determines, among the contents shown in the content information storage unit 123 in FIG. 10, the content CT5 whose provider is the terminal device TM1-2 (user U2) as the content to be provided to the user U1. .

Then, the information processing device 100 determines the speaker that outputs the content CT5 (step S55). For example, the information processing device 100 determines, among the directional speakers 20 of the mobile object C1, the directional speaker 20 that outputs audio toward the position of the user U1 as the output target speaker that outputs the audio related to the content CT5. In the example of FIG. 10, the information processing device 100 determines the directional speaker DS1-1 corresponding to the driver's seat where the user U1 is seated as the output target speaker. Then, the information processing device 100 provides the content CT5 to the directional speaker DS1-1 (step S56). The information processing device 100 transmits (distributes) the content CT5 to the directional speaker DS1-1. Note that the information processing device 100 may provide the content CT5 to the directional speaker DS1-1 via the terminal device TM1-1.

The directional speaker DS1-1, which has received the content CT5 from the information processing device 100, outputs the content CT5 (step S57). For example, the directional speaker DS1-1 outputs audio related to the content CT5 toward the user U1. In the example of FIG. 10, the directional speaker DS1-1 audio outputs the content CT5 that is uttered by the user U2. For example, the directional speaker DS1-1 audio outputs the content CT5 that is desired to be transmitted from the user U2 to only the user U1. For example, the directional speaker DS1-1 outputs content CT5 that the user U2 does not want the child user CU to hear.

As described above, the information processing device 100 transmits content corresponding to the audio dialogue between the user U2 outside the mobile body C1 and the user U1 inside the mobile body C1 only to the user U1 who is the target user inside the mobile body C1. By outputting the content, it is possible to appropriately provide the content to the user. In this way, the information processing device 100 can output content only to the target user by determining the output target speaker based on the target user's seating position within the mobile body C1. Thereby, the information processing apparatus 100 can output content with appropriate content to the user U1, using the directional speaker 20 corresponding to the user U1, who is the target user. Therefore, the information processing apparatus 100 can provide appropriate information according to the position of the target user within the moving object. In the example of FIG. 10, the information processing device 100 outputs the content CT5 only to the directional speaker DS1-1 corresponding to the driver's seat of the mobile object C1, thereby preventing the sound from reaching the passenger seat of the mobile object C1. Can be suppressed.

[1-3. System configuration〕
Note that the information processing system 1 is not limited to the system configuration shown in FIG. 2, and may have various configurations. For example, the terminal device 10 may perform the process of determining the output target speaker. For example, the terminal device 10 may have the functions of the information processing device 100. That is, the information processing device 100 and the terminal device 10 may be integrated. In this case, the information processing system may include a content distribution server. The information processing device 100, which is the terminal device 10, may acquire content from the content distribution server and cause the determined output target speaker to output the acquired content. Further, the information processing device 100, which is the terminal device 10, may transmit information indicating that the content has been output to the content distribution server. Further, the information processing device 100, which is the terminal device 10, may transmit various information such as sensor information detected by a sensor and user behavior information to the content distribution server.

[2. Configuration of information processing device]
Next, the configuration of the information processing device 100 according to the embodiment will be described using FIG. 3. FIG. 3 is a diagram illustrating a configuration example of the information processing device 100 according to the embodiment. As shown in FIG. 3, the information processing device 100 includes a communication section 110, a storage section 120, and a control section 130. Note that the information processing device 100 includes an input unit (for example, a keyboard, a mouse, etc.) that accepts various operations from an administrator of the information processing device 100, and a display unit (for example, a liquid crystal display, etc.) for displaying various information. May have.

(Communication Department 110)
The communication unit 110 is realized by, for example, a NIC (Network Interface Card). The communication unit 110 is connected to a network by wire or wirelessly, and transmits and receives information to and from the terminal device 10 and the directional speaker 20.

(Storage unit 120)
The storage unit 120 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. As shown in FIG. 3, the storage unit 120 according to the embodiment includes a user information storage unit 121, a POI information storage unit 122, a content information storage unit 123, a mobile information storage unit 124, and a sensor information storage unit 125. and has. Note that the storage unit 120 is not limited to the above information, and may store various types of information.

(User information storage unit 121)
The user information storage unit 121 according to the embodiment stores various information regarding users. For example, the user information storage unit 121 stores various information regarding user attributes. FIG. 4 is a diagram illustrating an example of a user information storage unit according to the embodiment. The user information storage unit 121 shown in FIG. 4 includes items such as "user ID", "age", "gender", "terminal used", "interest", and "location information". Furthermore, the "location information" includes items such as "latest location".

"User ID" indicates identification information for identifying a user. Moreover, "age" indicates the age of the user identified by the user ID. Note that the "age" may be a specific age of the user identified by the user ID, such as 35 years old. Furthermore, “gender” indicates the gender of the user identified by the user ID.

“Using terminal” indicates a terminal used by a user. Note that although the example shown in FIG. 4 shows a case where each user is associated with one terminal device 10, a plurality of terminal devices 10 may be associated with a user. For example, when the user U3 uses the terminal device TM1-30, which is a smart speaker, in addition to the terminal device TM1-3, which is a smartphone, the "user terminals" corresponding to the user U3 are "TM1-3" and "TM1-3". TM1-30" may be stored.

Moreover, "interest" indicates the interest of the user identified by the user ID. That is, "interest" indicates an object in which the user identified by the user ID is highly interested. In the example shown in FIG. 4, one "interest" is shown for each user, but there may be a plurality of "interests".

Furthermore, "latest position" in "position information" indicates the last position information acquired for the corresponding user. Note that the "latest position" is illustrated by an abstract code such as "LC1-2", but even if it is information indicating latitude and longitude or address such as "Y city, Z town, X prefecture", good. Further, the "location information" may include an item of "date and time of acquisition". For example, "date and time of acquisition" indicates the date and time when position information was last acquired.

In the example of FIG. 4, the age of the user (user U1) identified by the user ID "U1" is "20s" and the gender is "male." The terminal used by the user U1 is the terminal device TM1-1, which is a smart speaker. User U1 also indicates that he is interested in the economy. For example, for the user U1, the position information indicating that the user is located at the position LC1-2 indicates that the position information was acquired last, that is, the latest position information.

Note that the user information storage unit 121 is not limited to the above, and may store various information depending on the purpose. For example, the user information storage unit 121 may store various information such as demographic attribute information and psychographic attribute information. For example, the user information storage unit 121 may store information such as name, family structure, income, etc.

Further, although not shown, the user information storage unit 121 may store identification information for identifying each user based on sensor information in association with each user ID. For example, the user information storage unit 121 may include an item "identification information" including an item such as "audio".

The item “voice” stores voice information used for user identification. The item "audio" may store audio information of each user, a file path name indicating a storage location thereof, or the like. The information stored in the item "voice" may be characteristic information indicating the characteristics of the user's voice. For example, the information stored in the item "voice" may be information indicating vocal characteristics extracted from the user's utterances (voice feature information). For example, the information stored in the item "voice" may be voice feature information extracted from each utterance using various conventional techniques related to voice feature extraction.

In the example of FIG. 1, the information processing apparatus 100 may determine (estimate) the user who has made the utterance using the user's utterance and the voice stored in the user information storage unit 121. For example, the information processing device 100 determines the user who made the utterance by comparing the voice information of the user's utterance with the voice information of each user stored in the item “voice” in the user information storage unit 121. (estimate). Note that the item "identification information" may include an item such as "image". In this case, the item "image" stores image information used for user identification.

(POI information storage unit 122)
The POI information storage unit 122 according to the embodiment stores various information regarding POIs (points of interest) such as stores and landmarks. FIG. 5 is a diagram illustrating an example of a POI information storage unit according to the embodiment. For example, the POI information storage unit 122 stores information regarding various POIs. The POI information storage unit 122 shown in FIG. 5 includes items such as "POIID", "Name", "Category", and "Location".

“POIID” indicates identification information for identifying a POI. “Name” indicates the specific name of the POI. For example, the "name" may be a combination of a trade name and information indicating the location of the store, such as "○○ Cafe X Town Store." Moreover, "category" indicates the category to which the POI belongs. Moreover, "location" indicates the location where the POI is located. Although the "location" is illustrated as an abstract code such as "LC2-1", it may also be information indicating latitude and longitude, or information indicating an address such as "Z town, Y city, X prefecture". .

In the example of FIG. 5, the POI identified by the POI ID "SP1" has the name "A toy store" and indicates that it is a POI belonging to the category "store (toy mass retailer)". Further, it is shown that toy store A is located at position LC2-1.

Note that the POI information storage unit 122 is not limited to the above, and may store various information depending on the purpose.

(Content information storage unit 123)
The content information storage unit 123 according to the embodiment stores various information regarding content such as advertisements and music. FIG. 6 is a diagram illustrating an example of a content information storage unit according to the embodiment. The content information storage unit 123 shown in FIG. 6 has items such as "content ID", "content", "provider ID", "content", and "condition (level)".

"Content ID" indicates identification information for identifying content. "Content" indicates content submitted by advertisers, content providers, agencies, and the like. Although FIG. 6 shows an example in which conceptual information such as "CT1" is stored in "content," in reality, moving images, audio, or file path names indicating their storage locations are stored. Furthermore, "content" may include still images, moving images, text data, URLs, file path names indicating storage locations thereof, and the like. In the following, the term "provider" is a concept that includes not only advertisers and content providers but also agencies.

“Provider ID” indicates identification information for identifying a provider. Note that the provider may request an agency to perform the submission work, etc. Therefore, the expression "provider" is a concept that includes not only businesses such as stores and content providers, but also agencies. In the example of FIG. 6, a case is shown in which a POI ID and information identifying a content provider are stored as the "provider ID".

"Output condition" indicates the distribution condition (output condition) of the content identified by the content ID. The "output conditions" include items such as "target user" and "timing." "Target user" indicates a target object (user) to output the content identified by the content ID. “Target user” indicates the attributes of the user to whom the content is output. "Timing" indicates the timing at which the content identified by the content ID is output. "Timing" may be various timing conditions such as range or time zone. "Timing" may be various timing conditions such as a positional relationship with a predetermined POI or a context.

In the example shown in FIG. 6, the content (content CT1) identified by the content ID "CD1" indicates that the content is "CT1". The advertiser of content CT1 is store SP1, which is toy store A. The condition regarding the target of content CT1 indicates that it is a "child." That is, the content CT1 indicates that the content is output with "child" as the target attribute. The condition regarding the timing of content CT1 indicates that it is "range AR1 (1 km radius)". That is, the content CT1 indicates that the content is outputted from the toy store A at a timing located within the "range AR1 (radius 1 km)".

Note that the content information storage unit 123 is not limited to the above, and may store various information depending on the purpose. For example, when the content is an advertisement, the content information storage unit 123 may store information regarding bid prices and the like. For example, the content information storage unit 123 may store information indicating the product name or service name that is the subject of the content.

(Mobile object information storage unit 124)
The mobile object information storage unit 124 according to the embodiment stores various information regarding the mobile object. FIG. 7 is a diagram illustrating an example of a mobile object information storage unit according to the embodiment. For example, the mobile object information storage unit 124 stores information regarding various mobile objects. The mobile object information storage unit 124 shown in FIG. 7 includes items such as "mobile object ID,""vehicle terminal ID," and "in-vehicle position information."

"Mobile ID" indicates identification information for identifying a mobile. "Vehicle-mounted terminal ID" indicates information that identifies a terminal device mounted on a mobile object.

"In-vehicle position information" indicates information regarding the position where the user is seated within the moving body. The "in-vehicle position information" includes items such as "in-vehicle position #1 (driver's seat)" and "in-vehicle position #2 (passenger seat)." “In-vehicle position #1 (driver's seat)” and “in-vehicle position #2 (passenger seat)” include items such as “in-vehicle position ID,” “speaker ID,” and “seated user.” In addition, in the example of FIG. 5, only "in-vehicle position #1 (driver's seat)" and "in-vehicle position #2 (passenger seat)" are illustrated, but "in-vehicle position #3 (right rear seat)" and "in-vehicle position Items such as "#4 (left rear seat)" are included depending on the number of positions where the user is seated in the corresponding moving object.

"In-vehicle position ID" indicates information that identifies the corresponding in-vehicle position. "Speaker ID" indicates information that identifies the directional speaker associated with the corresponding in-vehicle position. "Speaker ID" indicates information that identifies a directional speaker that outputs audio toward a corresponding in-vehicle position. "Seated user" indicates a user seated at a corresponding position in the vehicle. “Seated user” indicates user attributes estimated for the user seated at the corresponding in-vehicle position and information for identifying the user.

In the example of FIG. 7, the mobile object (mobile object C1) identified by the mobile object ID "C1" indicates that the terminal device installed therein is the terminal device identified by the vehicle-mounted terminal ID "TM1-1". . That is, the mobile object C1 indicates that the terminal device mounted thereon is the terminal device TM1-1.

Further, at the position of the driver's seat in the mobile object C1, which is identified by the in-vehicle position ID "CSP1-1", there is a directional speaker (directional speaker DS1-1) identified by the speaker ID "DS1-1". 1) is associated. Further, it is shown that the user sitting in the driver's seat of the mobile object C1 (seated user) is the user U1 who is an adult male. That is, it shows that the directional speaker DS1-1 outputs audio toward the user U1 seated in the driver's seat of the mobile object C1.

In addition, at the position of the passenger seat in the mobile object C1, which is identified by the in-vehicle position ID "CSP1-2," there is a directional speaker (directional speaker DS1-2) identified by the speaker ID "DS1-2." 2) is associated. Further, it is shown that the user sitting in the passenger seat of the mobile object C1 (seated user) is a child. That is, it shows that the directional speaker DS1-2 outputs sound toward the child seated in the passenger seat of the mobile object C1.

Note that the mobile information storage unit 124 is not limited to the above information, and may store various information depending on the purpose. For example, the mobile information storage unit 124 may have an item "registration number." In this case, for example, the "registration number" indicates a specific registration number of the mobile object. For example, the "registration number" may be a number displayed on a vehicle registration number plate (license plate) attached to a moving object such as a car. For example, the "registration number" may be a combination of letters, numbers, and other symbols such as "Shinagawa 500 XX-XX." Further, for example, the moving object information storage unit 124 may store list information (list) of latitudes and longitudes through which the user's line of sight corresponds to the line of sight direction. Furthermore, the mobile object information storage unit 124 may store information that identifies a user who owns (uses) a mobile object in association with the mobile object.

(Sensor information storage unit 125)
The sensor information storage unit 125 according to the embodiment stores various information regarding detection by the sensor. For example, the sensor information storage unit 125 stores sensor information detected by a sensor. FIG. 8 is a diagram illustrating an example of a sensor information storage unit according to the embodiment. For example, the sensor information storage unit 125 stores sensor information detected by a terminal device used by each user. The sensor information storage unit 125 shown in FIG. 8 includes items such as "log ID", "obtainment source", "type", "sensor information", "date and time", and "position".

"Log ID" indicates identification information for identifying acquired sensor information. “Obtainment source” indicates the terminal device that detected the sensor information. Moreover, "type" indicates information regarding the type of detected sensor information. "Sensor information" indicates detected sensor information. Although Fig. 8 shows an example in which conceptual information such as "SN1-1" is stored in "sensor information," in reality, it is necessary to store specifically detected information (sensor data) or its storage location. The indicated file path name, etc. may also be stored.

For example, when the type of sensor information is "image", "sensor information" stores still images, moving images, file path names indicating their storage locations, and the like. For example, if the type of sensor information is "speech", "sensor information" stores audio data, character information after converting the audio data, or a file path name indicating the storage location of these data. .

“Date and time” indicates the date and time when the sensor information was detected. Although the "date and time" is illustrated abstractly such as "dt1-1", a specific date and time such as "August 9, 2018, 22:31:52" may be stored. Note that the "date and time" is not limited to a time, but may be a predetermined period such as "August 9, 2018, 22:31" or "August 9, 2018, 22:30-31". Moreover, "position" indicates the position where the corresponding action was performed. Note that "location" is illustrated by an abstract code such as "LC1-2", but it is also information indicating latitude and longitude, or information indicating an address such as "B intersection, Z town, Y city, X prefecture". Good too.

The example in FIG. 8 indicates that the acquisition source of sensor information SN1-1 in the history information (log LG11) identified by log ID "LG11" is the terminal device identified by ID "TM1-1." That is, sensor information SN1-1 of log LG11 indicates that it has been detected by terminal device TM1-1. The sensor information SN1-1 of the log LG11 indicates that it is moving image information of type "image". Further, sensor information SN1-1 of log LG11 indicates that it was acquired (detected) at position LC1-2 at date and time dt1-1.

Note that the sensor information storage section 125 is not limited to the above, and may store various information depending on the purpose.

(Control unit 130)
Returning to the explanation of FIG. 3, the control unit 130 is a controller, and is stored in a storage device inside the information processing device 100 by, for example, a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). This is realized by executing various programs (corresponding to an example of an information processing program) using the RAM as a work area. Further, the control unit 130 is a controller, and is realized by, for example, an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

As shown in FIG. 3, the control unit 130 includes an acquisition unit 131, an estimation unit 132, a determination unit 133, and a provision unit 134, and realizes or executes information processing functions and operations described below. . Note that the internal configuration of the control unit 130 is not limited to the configuration shown in FIG. 3, and may be any other configuration as long as it performs information processing to be described later. Further, the connection relationship between the respective processing units included in the control unit 130 is not limited to the connection relationship shown in FIG. 3, and may be other connection relationships.

(Acquisition unit 131)
The acquisition unit 131 acquires various information. The acquisition unit 131 acquires various information from an external device such as the terminal device 10 or an information providing device. Further, the acquisition unit 131 acquires various information from the storage unit 120. Further, the acquisition unit 131 acquires various information from the user information storage unit 121, the POI information storage unit 122, the content information storage unit 123, the mobile information storage unit 124, the sensor information storage unit 125, and the like. For example, the acquisition unit 131 may acquire various information from the directional speaker 20. The acquisition unit 131 acquires various information such as sensor information from the terminal device 10. The acquisition unit 131 acquires image information of a moving image from the terminal device 10.

The acquisition unit 131 acquires target position information indicating the position of a target user to whom information is to be provided within a predetermined moving object. The acquisition unit 131 acquires target position information indicating the position of a target user among a plurality of users located within a predetermined moving object.

The acquisition unit 131 acquires mobile body position information indicating the position of a predetermined mobile body. The acquisition unit 131 acquires POI position information indicating the position of a POI related to content. The acquisition unit 131 acquires target position information indicating the position of a target user among users located in an automobile, which is a predetermined moving object.

The acquisition unit 131 acquires target position information indicating the position of a target user who is a passenger other than the driver among a plurality of users located in an automobile, which is a predetermined moving object. The acquisition unit 131 acquires target position information indicating the position of a target user, who is a driver, among a plurality of users located in an automobile, which is a predetermined moving object. The acquisition unit 131 acquires an in-body image that is image information captured inside a predetermined moving body.

The acquisition unit 131 acquires target position information of a target user who is the other user's voice dialogue partner located outside a predetermined moving body. The acquisition unit 131 acquires target position information of a target user who is the other user's voice dialogue partner who is located in a predetermined residence. The acquisition unit 131 acquires target location information of a target user corresponding to a call destination from a terminal device used by another user.

In the example of FIG. 1, the acquisition unit 131 acquires sensor information SN1-1, location information, date and time information, terminal information, and the like. The acquisition unit 131 acquires the log identified by the log ID "LG11" as shown in list information SLST1. The acquisition unit 131 acquires information indicating that the acquisition source of the sensor information SN1-1 is the terminal device TM1-1. The acquisition unit 131 acquires sensor information SN1-1 whose type is "image", that is, a moving image. The acquisition unit 131 also acquires information indicating that the sensor information SN1-1 was acquired (detected) at the position LC1-2 at the date and time dt1-1.

The acquisition unit 131 acquires information indicating that the user sitting in the driver's seat of the mobile body C1 is the user U1, who is an adult male, as shown in the mobile body information storage unit 124 in FIG. Further, the acquisition unit 131 acquires information indicating that the user sitting in the passenger seat of the mobile body C1 is a child, as shown in the mobile body information storage unit 124 in FIG.

The acquisition unit 131 acquires information indicating that the position (target position information) of the child user CU, who is the target user, is in the passenger seat of the mobile body C1 from the mobile body information storage unit 124 in FIG. The acquisition unit 131 acquires, from the mobile object information storage unit 124 in FIG. Get information indicating the passenger seat. The acquisition unit 131 acquires, as POI position information, position information indicating the location (position LC2-1) of the store SP1, which is a POI related to the content CT1, from the POI information storage unit 122 (see FIG. 5).

(Estimation unit 132)
The estimation unit 132 analyzes various information. The estimation unit 132 estimates various information. The estimation unit 132 specifies various information. The estimation unit 132 extracts various information. The estimation unit 132 analyzes various information based on the various information stored in the storage unit 120. The estimation unit 132 estimates various information based on the various information stored in the storage unit 120. The estimation unit 132 identifies various pieces of information based on the various types of information stored in the storage unit 120. The estimation unit 132 extracts various information based on the various information stored in the storage unit 120. The estimation unit 132 analyzes various information based on the user information storage unit 121, the POI information storage unit 122, the content information storage unit 123, the mobile information storage unit 124, the sensor information storage unit 125, and the like. The estimation unit 132 estimates various information based on the user information storage unit 121, the POI information storage unit 122, the content information storage unit 123, the mobile information storage unit 124, the sensor information storage unit 125, and the like. The estimation unit 132 specifies various information based on the user information storage unit 121, the POI information storage unit 122, the content information storage unit 123, the mobile information storage unit 124, the sensor information storage unit 125, and the like. The estimation unit 132 extracts various information based on the user information storage unit 121, the POI information storage unit 122, the content information storage unit 123, the mobile information storage unit 124, the sensor information storage unit 125, and the like. The estimation unit 132 analyzes various information based on the various information acquired by the acquisition unit 131. The estimation unit 132 estimates various information based on the various information acquired by the acquisition unit 131. The estimation unit 132 specifies various information based on the various information acquired by the acquisition unit 131. The estimation unit 132 extracts various information based on the various information acquired by the acquisition unit 131.

The estimation unit 132 estimates the position of the target user within a predetermined moving object. The estimation unit 132 estimates the position of the target user within a predetermined moving body based on the inside moving body image.

In the example of FIG. 1, the estimation unit 132 analyzes sensor information SN1-1. The estimation unit 132 analyzes the sensor information SN1-1 using various conventional techniques related to image analysis and image processing as appropriate to estimate the seating position of the user at each in-vehicle position within the mobile body C1.

The estimating unit 132 appropriately uses various conventional techniques related to image analysis and image processing to estimate the inside of each vehicle of the moving body C1 based on the sensor information SN1-1, as shown in the moving body information storage unit 124 in FIG. Estimate whether a user is seated at a location. The estimation unit 132 estimates whether a user is seated at each position in the vehicle C1 by appropriately using various conventional techniques related to object recognition such as specific object recognition. For example, the estimating unit 132 uses various conventional techniques related to object recognition such as specific object recognition as appropriate to estimate whether a user is seated in the driver's seat, passenger's seat, or rear seat of the mobile object C1. Furthermore, the estimation unit 132 estimates the attribute information of the seated user using various conventional techniques as appropriate. For example, the estimating unit 132 estimates attribute information such as the gender and age of the seated user by appropriately using various conventional techniques related to human face recognition. For example, the estimation unit 132 estimates whether the seated user is an adult or a child, appropriately using various conventional techniques related to human face recognition. For example, the estimation unit 132 appropriately uses various conventional techniques related to human face recognition to estimate whether the seated user is an adult in his or her 20s or older, or a child in his or her teens or younger.

In the example of FIG. 1, the estimating unit 132 estimates that a user is seated in the driver's seat and the passenger's seat in the mobile object C1 based on the sensor information SN1-1. The estimation unit 132 estimates that the user sitting in the driver's seat of the mobile object C1 is an adult male based on the information on the face area of the user sitting in the driver's seat of the mobile object C1 in the sensor information SN1-1. Further, for example, the estimating unit 132 calculates that the user U1 who is seated in the driver's seat of the moving body C1 is an adult male based on the information on the face area of the user sitting in the driver's seat of the moving body C1 in the sensor information SN1-1. It is estimated that

The estimation unit 132 estimates that the user sitting in the passenger seat of the mobile object C1 is a child based on the information on the face area of the user sitting in the passenger seat of the mobile object C1 in the sensor information SN1-1. Further, for example, the estimating unit 132 estimates that the user sitting in the passenger seat of the mobile object C1 is a child based on the information on the face area of the user sitting in the passenger seat of the mobile object C1 in the sensor information SN1-1. .

The estimation unit 132 estimates that no one is seated in the rear seat of the mobile object C1 based on the sensor information SN1-1. For example, in the sensor information SN1-1, if a predetermined object corresponding to the external shape of a person is not included in the position corresponding to the rear seat in the mobile object C1, the estimation unit 132 determines that the user is not seated in the rear seat. It is estimated that

(Decision unit 133)
The determining unit 133 determines various information. The determining unit 133 generates various information. The determining unit 133 determines various information based on the various information stored in the storage unit 120. The determining unit 133 generates various information based on the various information stored in the storage unit 120. The determining unit 133 determines various information based on the user information storage unit 121, the POI information storage unit 122, the content information storage unit 123, the mobile information storage unit 124, the sensor information storage unit 125, and the like. The determining unit 133 generates various information based on the user information storage unit 121, the POI information storage unit 122, the content information storage unit 123, the mobile information storage unit 124, the sensor information storage unit 125, and the like. The determining unit 133 determines various information based on the various information acquired by the acquiring unit 131. The determining unit 133 generates various information based on the various information acquired by the acquiring unit 131. The determining unit 133 determines various information based on the various information determined by the determining unit 133. The determining unit 133 generates various information based on the various information determined by the determining unit 133.

The determining unit 133 determines various information. The determining unit 133 determines various information based on the various information stored in the storage unit 120. The determining unit 133 determines various information based on the user information storage unit 121, the POI information storage unit 122, the content information storage unit 123, the mobile information storage unit 124, the sensor information storage unit 125, and the like. The determining unit 133 determines various information based on the various information acquired by the acquiring unit 131. The determining unit 133 determines various information based on the various information determined by the determining unit 133.

Based on the target position information acquired by the acquisition unit 131, the determining unit 133 selects a directional speaker that has directionality and outputs audio toward the position of the target user to correspond to the target user. The output target speaker is determined to be a directional speaker that outputs audio related to the content. The determining unit 133 determines to cause only the output target speaker to output audio related to the content.

The determining unit 133 determines content according to the target user. The determining unit 133 determines content based on the target user's attribute information. The determining unit 133 determines the content based on the attribute information of the target user estimated based on the image information of the target user. The determining unit 133 determines the output target speaker based on the target position information indicating the position of the target user estimated by the estimating unit 132. Based on the target position information, the determining unit 133 determines a directional speaker that outputs audio toward the target user's position as an output target speaker that outputs audio related to content that is uttered by another user.

The determining unit 133 determines the timing to output audio related to the content. The determining unit 133 determines the timing for outputting audio related to the content based on the moving object position information. The determining unit 133 determines the timing based on the mobile object position information and the POI position information. The determining unit 133 determines the timing based on a comparison between the mobile object position information and the POI position information. The determining unit 133 determines to output audio related to the content when the mobile object is located within a predetermined range from the POI.

In the example of FIG. 1, the determining unit 133 determines the target user. For example, the determining unit 133 determines a passenger other than the driver as the target user among the plurality of users located in the mobile object C1. The determining unit 133 determines the child user CU sitting in the passenger seat of the mobile object C1 as the target user.

The determining unit 133 determines content. The determining unit 133 determines the content based on the position of the mobile object C1 and the content output conditions. The determining unit 133 determines the content to be provided to the child user CU based on the position LC1-2 of the moving object C1 and each output condition shown in the content information storage unit 123. The determining unit 133 determines the content based on the attributes of the target user and the output conditions regarding the output timing of the content. The determining unit 133 determines content that satisfies output conditions regarding target and timing as content to be output to the terminal device TM1-1.

If the attributes of the target user correspond to the target user of the output condition, the determining unit 133 determines that the target user satisfies the target user of the output condition. The determining unit 133 determines whether the target user satisfies the target user output condition by comparing the attributes of the target user and the output condition "target user" of each content. Since the target user is a child user CU, the determining unit 133 determines that the target user "child" of the content CT1 is satisfied.

Further, the determining unit 133 determines whether the output condition "timing" of the content CT1 is satisfied based on the position of the moving body C1. For example, if the position LC1-2 of the moving body C1 is located within the timing "range AR1" of the content CT1, the determining unit 133 determines that the output condition regarding the timing of the content CT1 is satisfied. It is determined that the content CT1 satisfies the output conditions regarding target and timing. Therefore, the determining unit 133 determines the content to be provided to the child user CU as the content CT1.

The determining unit 133 determines the speaker that outputs the content CT1. For example, the determining unit 133 determines, among the directional speakers 20 of the mobile object C1, the directional speaker 20 that outputs audio toward the position of the child user CU as the output target speaker that outputs the audio related to the content CT1. The determining unit 133 determines the directional speaker DS1-2 corresponding to the passenger seat where the child user CU is seated as the output target speaker.

(Providing unit 134)
The providing unit 134 provides various information. The providing unit 134 provides various information to an external information processing device. The providing unit 134 provides various information to an external information processing device such as the terminal device 10. The providing unit 134 transmits various information to the terminal device 10. The providing unit 134 delivers various information to the terminal device 10. The providing unit 134 provides various information based on the various information acquired by the acquiring unit 131. The providing unit 134 provides various information based on the various information determined by the determining unit 133. The providing unit 134 provides various services based on the various information determined by the determining unit 133. The providing unit 134 provides various information based on the various information determined by the determining unit 133. For example, the providing unit 134 provides various information to the directional speaker 20. For example, the providing unit 134 provides various information to the directional speaker 20 via the terminal device 10. For example, the providing unit 134 transmits various information to the directional speaker 20. For example, the providing unit 134 transmits various information to the directional speaker 20 via the terminal device 10.

The providing unit 134 provides audio related to the content to the target user through the output target speaker. In the example of FIG. 1, the providing unit 134 provides the content CT1 to the directional speaker DS1-2. The providing unit 134 transmits (distributes) the content CT1 to the directional speaker DS1-2. The providing unit 134 may provide the content CT1 to the directional speaker DS1-2 via the terminal device TM1-1.

[3. Information processing flow]
Next, the procedure of information processing by the information processing system 1 according to the embodiment will be described using FIG. 9. FIG. 9 is a flowchart illustrating an example of information processing according to the embodiment. Specifically, FIG. 9 is a flowchart illustrating an example of output control processing.

As shown in FIG. 9, the information processing apparatus 100 acquires target position information of a target user within a predetermined moving body (step S101). Then, the information processing device 100 determines an output target speaker to output audio related to the content corresponding to the target user based on the target position information (step S102). Then, the information processing device 100 provides the target user with audio related to the content using the output target speaker (step S103). In the example of FIG. 1, the information processing device 100 provides the content CT1 to the directional speaker DS1-2 of the mobile body C1 determined as the output target speaker, thereby providing the content CT1 to the target, which is a child sitting in the passenger seat of the mobile body C1. The content CT1 is outputted to the user by the directional speaker DS1-2.

[4. effect〕
As described above, the information processing apparatus 100 according to the embodiment includes the acquisition section 131 and the determination section 133. The acquisition unit 131 acquires target position information indicating the position of a target user to whom information is to be provided within a predetermined moving body. Based on the target position information acquired by the acquisition unit 131, the determining unit 133 selects a directional speaker that has directionality and outputs audio toward the position of the target user to correspond to the target user. The output target speaker is determined to be a directional speaker that outputs audio related to the content.

Thereby, the information processing apparatus 100 according to the embodiment is an output target that outputs audio related to the content corresponding to the target user based on the target position information indicating the position of the target user who is the target of information provision within a predetermined moving object. By determining the speaker, it is possible to output audio to the user using an appropriate directional speaker. Therefore, the information processing apparatus 100 can provide appropriate information according to the position of the target user within the moving body.

Furthermore, in the information processing apparatus 100 according to the embodiment, the acquisition unit 131 acquires target position information indicating the position of a target user among a plurality of users located within a predetermined moving object. The determining unit 133 determines to cause only the output target speaker to output audio related to the content.

As a result, the information processing apparatus 100 according to the embodiment determines that only the output target speaker outputs the audio related to the content, thereby suppressing audio output to other users in the moving body, and also suppresses audio output to the target user. It can output audio. Therefore, the information processing apparatus 100 can provide appropriate information according to the position of the target user within the moving object.

Furthermore, in the information processing apparatus 100 according to the embodiment, the determining unit 133 determines content according to the target user.

Thereby, the information processing apparatus 100 according to the embodiment can output content with appropriate content to the user by determining the content according to the target user. Therefore, the information processing apparatus 100 can provide appropriate information according to the position of the target user within the moving body.

Furthermore, in the information processing apparatus 100 according to the embodiment, the determining unit 133 determines content based on the target user's attribute information.

Thereby, the information processing apparatus 100 according to the embodiment can output content to the user with appropriate content according to the user attribute by determining the content based on the target user's attribute information. Therefore, the information processing apparatus 100 can provide appropriate information according to the position of the target user within the moving object.

Furthermore, in the information processing apparatus 100 according to the embodiment, the determining unit 133 determines content based on the attribute information of the target user estimated based on the image information of the target user.

Thereby, the information processing apparatus 100 according to the embodiment determines the content based on the attribute information of the target user estimated based on the image information of the target user, thereby determining the content appropriate for the user attribute. content can be output to the user. Therefore, the information processing apparatus 100 can provide appropriate information according to the position of the target user within the moving object.

Furthermore, in the information processing apparatus 100 according to the embodiment, the determining unit 133 determines the timing to output audio related to the content.

Thereby, the information processing apparatus 100 according to the embodiment can output the audio to the user at an appropriate timing by determining the timing to output the audio related to the content. Therefore, the information processing apparatus 100 can provide appropriate information according to the position of the target user within the moving body.

Furthermore, in the information processing apparatus 100 according to the embodiment, the acquisition unit 131 acquires mobile body position information indicating the position of a predetermined mobile body. The determining unit 133 determines the timing for outputting audio related to the content based on the moving object position information.

Thereby, the information processing apparatus 100 according to the embodiment determines the timing to output the audio related to the content based on the mobile body position information of the predetermined mobile body, so that the information processing apparatus 100 can output the audio related to the content at an appropriate timing according to the position of the mobile body. Audio can be output to the user. Therefore, the information processing apparatus 100 can provide appropriate information according to the position of the target user within the moving body.

Furthermore, in the information processing apparatus 100 according to the embodiment, the acquisition unit 131 acquires POI position information indicating the position of a POI related to content. The determining unit 133 determines the timing based on the mobile object position information and the POI position information.

As a result, the information processing apparatus 100 according to the embodiment determines the timing of outputting the audio related to the content based on the mobile location information and the POI location information indicating the location of the POI related to the content. It is possible to output audio to the user at an appropriate timing depending on the positional relationship between the POI and the POI. Therefore, the information processing apparatus 100 can provide appropriate information according to the position of the target user within the moving object.

Furthermore, in the information processing apparatus 100 according to the embodiment, the determining unit 133 determines the timing based on a comparison between the moving body position information and the POI position information.

As a result, the information processing device 100 according to the embodiment determines the timing based on the comparison between the mobile body position information and the POI position information, thereby determining the timing at an appropriate timing according to the positional relationship between the mobile body and the POI. Audio can be output to the user. Therefore, the information processing apparatus 100 can provide appropriate information according to the position of the target user within the moving body.

Furthermore, in the information processing apparatus 100 according to the embodiment, the determining unit 133 determines to output audio related to the content when the mobile object is located within a predetermined range from the POI.

As a result, the information processing apparatus 100 according to the embodiment determines to output audio related to the content when the mobile object is located within a predetermined range from the POI, and thereby determines to output audio related to the content appropriately according to the positional relationship between the mobile object and the POI. It is possible to output audio to the user at the appropriate timing. Therefore, the information processing apparatus 100 can provide appropriate information according to the position of the target user within the moving object.

Furthermore, in the information processing apparatus 100 according to the embodiment, the acquisition unit 131 acquires target position information indicating the position of a target user among users located in a predetermined moving object, such as an automobile.

As a result, the information processing apparatus 100 according to the embodiment generates audio related to the content corresponding to the target user based on the target position information indicating the position of the target user among the users located in the automobile, which is a predetermined moving object. By determining the output target speaker to be output, it is possible to output audio to the user in the car using an appropriate directional speaker. Therefore, the information processing apparatus 100 can provide appropriate information according to the position of the target user within the moving object.

In the information processing apparatus 100 according to the embodiment, the acquisition unit 131 also includes a target position indicating the position of a target user who is a passenger other than the driver among a plurality of users located in a car that is a predetermined moving object. Get information.

As a result, the information processing apparatus 100 according to the embodiment is able to calculate the information based on the target position information indicating the position of the target user who is a passenger other than the driver among the plurality of users located in the automobile, which is a predetermined moving object. By determining the output target speaker that outputs the audio related to the content corresponding to the target user, even if there are multiple users in the car, the audio is output to the target user using an appropriate directional speaker. be able to. Therefore, the information processing apparatus 100 can provide appropriate information according to the position of the target user within the moving object.

In the information processing apparatus 100 according to the embodiment, the acquisition unit 131 acquires target position information indicating the position of a target user who is a driver among a plurality of users located in a car that is a predetermined moving object. .

As a result, the information processing apparatus 100 according to the embodiment is able to locate the target user based on the target position information indicating the position of the target user, who is the driver, among the plurality of users located in the automobile, which is a predetermined moving object. By determining the output target speaker that outputs the audio related to the corresponding content, even if there are multiple users in the car, it is possible to output the audio to the target user using an appropriate directional speaker. Therefore, the information processing apparatus 100 can provide appropriate information according to the position of the target user within the moving body.

Further, the information processing device 100 according to the embodiment includes an estimation unit 132. The estimation unit 132 estimates the position of the target user within a predetermined moving body. The determining unit 133 determines the output target speaker based on the target position information indicating the position of the target user estimated by the estimating unit 132.

As a result, the information processing apparatus 100 according to the embodiment estimates the position of the target user within a predetermined moving object, and determines the output target speaker based on the target position information indicating the estimated position of the target user. Sound can be output to the user using appropriate directional speakers. Therefore, the information processing apparatus 100 can provide appropriate information according to the position of the target user within the moving body.

Furthermore, in the information processing apparatus 100 according to the embodiment, the acquisition unit 131 acquires an in-vehicle image that is image information captured inside a predetermined moving body. The estimation unit 132 estimates the position of the target user within a predetermined moving body based on the inside moving body image.

Thereby, the information processing apparatus 100 according to the embodiment estimates the position of the target user in a predetermined moving body based on the in-vehicle image, and estimates the position of the target user in the output target based on the target position information indicating the estimated position of the target user. By determining the speaker, it is possible to output audio to the user using an appropriate directional speaker. Therefore, the information processing apparatus 100 can provide appropriate information according to the position of the target user within the moving object.

Further, the information processing device 100 according to the embodiment includes a providing unit 134. The providing unit 134 provides audio related to the content to the target user using the output target speaker.

Thereby, the information processing apparatus 100 according to the embodiment can output audio to the user using an appropriate directional speaker by providing audio related to the content to the target user using the output target speaker. Therefore, the information processing apparatus 100 can provide appropriate information according to the position of the target user within the moving object.

Furthermore, in the information processing apparatus 100 according to the embodiment, the acquisition unit 131 acquires target position information of a target user who is a voice dialogue partner of another user located outside a predetermined moving body. Based on the target position information, the determining unit 133 determines a directional speaker that outputs audio toward the target user's position as an output target speaker that outputs audio related to content that is uttered by another user.

As a result, the information processing apparatus 100 according to the embodiment can detect the utterances of other users based on the target position information indicating the position of the target user who is the other user's voice dialogue partner located outside the predetermined moving body. By determining the output target speaker that outputs the audio related to a certain content, it is possible to output the audio of the other party in the audio dialogue to the user using an appropriate directional speaker. Thereby, the information processing device 100 can appropriately provide services related to voice dialogue between the inside and outside of the mobile body. Therefore, the information processing apparatus 100 can provide appropriate information according to the position of the target user within the moving object.

Furthermore, in the information processing apparatus 100 according to the embodiment, the acquisition unit 131 acquires target position information of a target user who is a voice dialogue partner of another user located in a predetermined residence.

As a result, the information processing apparatus 100 according to the embodiment can detect the utterances of other users based on the target position information indicating the position of the target user who is the other user's voice dialogue partner located in a predetermined residence. By determining the output target speaker that outputs the audio related to a certain content, it is possible to output the audio of the other party in the audio dialogue to the user using an appropriate directional speaker. Thereby, the information processing apparatus 100 can appropriately provide a service related to voice dialogue between a mobile object and a residence. Therefore, the information processing apparatus 100 can provide appropriate information according to the position of the target user within the moving object.

Furthermore, in the information processing apparatus 100 according to the embodiment, the acquisition unit 131 acquires target location information of a target user corresponding to a destination from a terminal device used by another user.

Thereby, the information processing apparatus 100 according to the embodiment outputs audio related to the content that is uttered by another user based on the target location information of the target user corresponding to the destination from the terminal device used by the other user. By determining the output target speakers, it is possible to output the voice of the other party in the voice dialogue to the user using an appropriate directional speaker. Thereby, the information processing device 100 can appropriately provide services related to voice dialogue between the inside and outside of the mobile body. Therefore, the information processing apparatus 100 can provide appropriate information according to the position of the target user within the moving body.

[5. Hardware configuration]
The information processing apparatus 100 according to the embodiments described above is realized by, for example, a computer 1000 having a configuration as shown in FIG. 11. FIG. 11 is a hardware configuration diagram showing an example of a computer that implements the functions of the information processing device. Computer 1000 has CPU 1100, RAM 1200, ROM 1300, HDD (Hard Disk Drive) 1400, communication interface (I/F) 1500, input/output interface (I/F) 1600, and media interface (I/F) 1700.

CPU 1100 operates based on a program stored in ROM 1300 or HDD 1400, and controls each section. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 is started, programs depending on the hardware of the computer 1000, and the like.

The HDD 1400 stores programs executed by the CPU 1100, data used by the programs, and the like. Communication interface 1500 receives data from other devices via network N and sends it to CPU 1100, and sends data generated by CPU 1100 to other devices via network N.

The CPU 1100 controls output devices such as a display and a printer, and input devices such as a keyboard and mouse via an input/output interface 1600. CPU 1100 obtains data from an input device via input/output interface 1600. Further, CPU 1100 outputs the generated data to an output device via input/output interface 1600.

Media interface 1700 reads programs or data stored in recording medium 1800 and provides them to CPU 1100 via RAM 1200. CPU 1100 loads this program from recording medium 1800 onto RAM 1200 via media interface 1700, and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase change rewritable disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory. etc.

For example, when the computer 1000 functions as the information processing device 100 according to the embodiment, the CPU 1100 of the computer 1000 realizes the functions of the control unit 130 by executing a program loaded onto the RAM 1200. The CPU 1100 of the computer 1000 reads these programs from the recording medium 1800 and executes them, but as another example, these programs may be acquired from another device via the network N.

Some of the embodiments and modifications of the present application have been described above in detail based on the drawings, but these are merely examples, and various modifications can be made based on the knowledge of those skilled in the art, including the embodiments described in the disclosure section of the invention. It is possible to implement the present invention in other forms with modifications and improvements.

[6. others〕
Furthermore, among the processes described in the above embodiments and modified examples, all or part of the processes described as being performed automatically can be performed manually, or may be described as being performed manually. All or part of this processing can also be performed automatically using known methods. In addition, information including the processing procedures, specific names, and various data and parameters shown in the above documents and drawings may be changed arbitrarily, unless otherwise specified. For example, the various information shown in each figure is not limited to the illustrated information.

Further, each component of each device shown in the drawings is functionally conceptual, and does not necessarily need to be physically configured as shown in the drawings. In other words, the specific form of distributing and integrating each device is not limited to what is shown in the diagram, and all or part of the devices can be functionally or physically distributed or integrated in arbitrary units depending on various loads and usage conditions. Can be integrated and configured.

Furthermore, the above-described embodiments and modifications can be combined as appropriate within a range that does not conflict with the processing contents.

Further, the above-mentioned "section, module, unit" can be read as "means", "circuit", etc. For example, the acquisition unit can be read as an acquisition means or an acquisition circuit.

1 Information processing system 100 Information processing device 121 User information storage unit 122 POI information storage unit 123 Content information storage unit 124 Mobile information storage unit 125 Sensor information storage unit 130 Control unit 131 Acquisition unit 132 Estimation unit 133 Determination unit 134 Provision unit 10 Terminal device 20 Directional speaker N Network

Claims (15)

A content and an output condition for the content, which includes an attribute condition indicating an attribute of a target user to whom the content is output, and a timing condition indicating a timing to output the content, are stored in association with each other. , a content information storage unit, wherein the attribute condition is an attribute condition related to the age of the target user, and the timing condition is a timing condition for stopping a conversation within a predetermined moving body;
acquiring information stored in the content information storage unit, target position information indicating the position of the target user within a predetermined moving body, attribute information of the target user, and information for determining the timing condition. an acquisition department;
Among the plurality of contents, when the attribute information of the target user satisfies the attribute condition and the information for determining the timing condition satisfies the timing condition, the content associated with the output condition is selected. The content is determined to be provided to the target user, and based on the target location information, a directional speaker having directionality that outputs audio toward the target user's position is set to be a directional speaker related to the content. a determining unit that determines an output target speaker that is a directional speaker that outputs audio;
a providing unit that transmits the content to the output target speaker;
An information processing device comprising: The acquisition unit includes:
obtaining the target position information indicating the position of the target user among the plurality of users located in the predetermined moving object;
The determining unit is
The information processing apparatus according to claim 1, wherein the information processing apparatus determines that only the output target speaker outputs audio related to the content. The determining unit is
The information processing apparatus according to claim 1 or 2 , wherein the content is determined based on attribute information of the target user estimated based on image information of the target user. The determining unit is
The information processing apparatus according to any one of claims 1 to 3 , further comprising determining a timing for outputting audio related to the content. The acquisition unit includes:
obtaining mobile body position information indicating the position of the predetermined mobile body;
The determining unit is
The information processing apparatus according to claim 4 , wherein a timing for outputting audio related to the content is determined based on the moving body position information. The acquisition unit includes:
Obtaining POI location information indicating the location of a POI related to the content,
The determining unit is
The information processing apparatus according to claim 5 , wherein a timing for outputting audio related to the content is determined based on the mobile object position information and the POI position information. The determining unit is
The information processing apparatus according to claim 6, wherein a timing for outputting audio related to the content is determined based on a comparison between the mobile object position information and the POI position information. The determining unit is
The information processing apparatus according to claim 6 or 7 , wherein when the mobile object is located within a predetermined range from the POI, it is determined to output audio related to the content. The acquisition unit includes:
The information processing according to any one of claims 1 to 8 , characterized in that the target position information indicating the position of the target user among users located in the predetermined moving object, ie, an automobile, is acquired. Device. The acquisition unit includes:
10. The target position information indicating the position of the target user who is a passenger other than the driver among a plurality of users located in the predetermined moving object, ie, an automobile, is acquired. information processing equipment. The acquisition unit includes:
The information processing device according to claim 9 , wherein the information processing device acquires the target position information indicating the position of the target user who is a driver among a plurality of users located in a car that is the predetermined moving object. . an estimation unit that estimates the position of the target user within the predetermined moving body;
Furthermore,
The determining unit is
The information processing device according to any one of claims 1 to 11 , wherein the output target speaker is determined based on the target position information indicating the target user's position estimated by the estimation unit. . The acquisition unit includes:
Obtaining an in-vehicle image that is image information captured inside the predetermined moving body;
The estimation unit is
The information processing apparatus according to claim 12 , wherein the position of the target user within the predetermined moving body is estimated based on the image within the moving body. A content and an output condition for the content, which includes an attribute condition indicating an attribute of a target user to whom the content is output, and a timing condition indicating a timing to output the content, are stored in association with each other. , the attribute condition may be an attribute condition related to the age of the target user, and the timing condition may be a timing condition for stopping a conversation within a predetermined moving body, executed by a computer equipped with a content information storage unit. An information processing method,
acquiring information stored in the content information storage unit, target position information indicating the position of the target user within a predetermined moving body, attribute information of the target user, and information for determining the timing condition. acquisition process,
Among the plurality of contents, when the attribute information of the target user satisfies the attribute condition and the information for determining the timing condition satisfies the timing condition, the content associated with the output condition is selected. The content is determined to be provided to the target user, and based on the target location information, a directional speaker having directionality that outputs audio toward the target user's position is set to be a directional speaker related to the content. a determination step of determining an output target speaker that is a directional speaker that outputs audio;
a providing step of transmitting the content to the output target speaker;
An information processing method characterized by comprising: A content and an output condition for the content, which includes an attribute condition indicating an attribute of a target user to whom the content is output, and a timing condition indicating a timing to output the content, are stored in association with each other. , the attribute condition may be an attribute condition related to the age of the target user, and the timing condition may be a timing condition for stopping a conversation within a predetermined moving body;
acquiring information stored in the content information storage unit, target position information indicating the position of the target user within a predetermined moving body, attribute information of the target user, and information for determining the timing condition. Acquisition procedure and
Among the plurality of contents, when the attribute information of the target user satisfies the attribute condition and the information for determining the timing condition satisfies the timing condition, the content associated with the output condition is selected. The content is determined to be provided to the target user, and based on the target location information, a directional speaker having directionality that outputs audio toward the target user's position is set to be a directional speaker related to the content. a determination procedure for determining an output target speaker that is a directional speaker that outputs audio;
a provision step of transmitting the content to the output target speaker;
An information processing program that executes .

Images