JP7001648B2 - Estimator, estimation method and estimation program - Google Patents

Description

The present invention relates to an estimation device, an estimation method and an estimation program.

Conventionally, various techniques using images taken by a terminal device arranged on a mobile body operated by a user have been proposed. As an example of such a technique, a technique for detecting a stolen vehicle from an image taken by a navigation device installed in a vehicle is known.

Japanese Unexamined Patent Publication No. 2008-070978

On the other hand, in order to provide appropriate information to the user, for example, a process of determining the information to be provided according to the context of the user's movement such as the user's position history and action history can be considered. However, in the above-mentioned conventional technique, the vehicle number of the stolen vehicle registered in advance is only detected. Therefore, it cannot be said that the information is provided according to the behavior of the user who uses each vehicle.

The present application has been made in view of the above, and an object thereof is to provide more appropriate information for the user.

The estimation device according to the present application is based on a specific unit that identifies the vehicle number of the photographed vehicle from a plurality of images individually captured by the plurality of in-vehicle devices, and a photographed image in which a predetermined vehicle number is captured. It is characterized by having the predetermined vehicle number and an estimation unit for estimating the behavior of the driver of the corresponding vehicle.

According to one aspect of the embodiment, there is an effect that more appropriate information can be provided to the user.

FIG. 1 is a diagram showing an example of estimation processing according to an embodiment. FIG. 2 is a diagram showing a configuration example of an information providing system according to an embodiment. FIG. 3 is a diagram showing a configuration example of the information providing device according to the embodiment. FIG. 4 is a diagram showing an example of an image database according to an embodiment. FIG. 5 is a diagram showing an example of a driver database according to an embodiment. FIG. 6 is a diagram showing an example of a linked database according to an embodiment. FIG. 7 is a flowchart showing an example of the procedure of the estimation process according to the embodiment. FIG. 8 is a hardware configuration diagram showing an example of a computer that realizes the function of the information providing device.

Hereinafter, a mode for implementing the estimation device, the estimation method, and the estimation program according to the present application (hereinafter referred to as “embodiment”) will be described with reference to the drawings. It should be noted that this embodiment does not limit the estimation device, estimation method and estimation program program according to the present application. Further, in the following embodiments, the same parts are designated by the same reference numerals, and duplicate explanations are omitted.

[1. Embodiment]
The estimation process realized by the estimation device and the like of the present embodiment will be described with reference to FIG. FIG. 1 is a diagram showing an example of estimation processing according to an embodiment. In FIG. 1, it is assumed that the information providing device 10, which is an example of the estimation device according to the present application, realizes the estimation process according to the embodiment.

Prior to the description of FIG. 1, the information providing system 1 according to the embodiment will be described with reference to FIG. FIG. 2 is a diagram showing a configuration example of an information providing system according to an embodiment. As shown in FIG. 2, the information providing system 1 according to the embodiment includes an information providing device 10, a terminal device 100, and an external device 200. The information providing device 10 and the terminal device 100 are connected to each other so as to be able to communicate with each other by wire or wirelessly via the network N. The network N is, for example, a WAN (Wide Area Network) such as the Internet. The information providing system 1 shown in FIG. 2 may include a plurality of information providing devices 10, a plurality of terminal devices 100, and a plurality of external devices 200.

The information providing device 10 estimates the behavior of the driver of the vehicle captured in the image based on the image (still image, moving image) captured by the in-vehicle device, and outputs various information based on the estimated behavior to the driving. It is an information processing device provided to a user who is presumed to be the same as the person. For example, the information providing device 10 manages an image taken by an in-vehicle device installed in each vehicle. Further, the information providing device 10 manages the driver's behavior estimated based on the image taken by the in-vehicle device. Further, the information providing device 10 manages the correspondence relationship (association) between the driver and the user.

Further, the information providing device 10 may function as a distribution device that distributes control information to the terminal device 100. Here, the control information is described in, for example, a script language such as Javascript (registered trademark) or a style sheet language such as CSS (Cascading Style Sheets). The predetermined application itself distributed from the terminal device 100 may be regarded as control information.

The terminal device 100 is an information processing device used by the user. The terminal device 100 is realized by, for example, a smartphone, a tablet terminal, a notebook PC (Personal Computer), a desktop PC, a mobile phone, a PDA (Personal Digital Assistant), or the like. In the example shown in FIG. 1, the terminal device 100 is a smart device such as a smartphone or a tablet used by a user.

Further, the terminal device 100 displays the information provided by the information providing device 10 by a web browser or an application. When the terminal device 100 receives the control information that realizes the information display processing from the information providing device 10, the terminal device 100 realizes the display processing according to the control information.

The external device 200 is a server device that provides a service (web service) to the user via the network N and manages the user's usage history in the provided web service. The web services provided by the external device 200 include, for example, a navigation service, an electronic payment service, a search service, a news distribution service, an auction service, a weather forecast service, a shopping service, a finance service, a route search service, a map providing service, and a travel service. It may be a service, a restaurant introduction service, a facility reservation service, an SNS (Social Networking Service) service, a web blog service, or the like. Further, the external device 200 may provide, for example, a web service for distributing contents related to various applications installed in the terminal device 100. Specifically, navigation app, electronic payment app, portal app, news app, auction site, weather forecast app, shopping app, finance (stock) app, route search app, map providing app, travel app, restaurant introduction app, You may provide a service that distributes contents related to a facility reservation application, an SNS application, a blog browsing application, and the like.

Hereinafter, the determination process performed by the information providing device 10 will be described with reference to FIG. In the following description, the terminal device 100 is a smart device such as a smartphone or a tablet used by the user U1. Further, in the following description, the terminal device 100 may be equated with the user U1. That is, in the following, the user U1 can be read as the terminal device 100.

Further, in the following description, it is assumed that each vehicle (automobile) is equipped with an in-vehicle device which is a device having an image pickup unit and can communicate various information with the information providing device 10.

First, each in-vehicle device captures an image of the vehicle while traveling (step S1). For example, in the example of FIG. 1, each in-vehicle device captures an image of the surroundings of the installed vehicle while traveling, and obtains position information indicating the position when the image is captured by GPS (Global Positioning System) or geomagnetism. It is specified by using various positioning technologies such as.

Subsequently, the information providing device 10 acquires the image captured by the vehicle-mounted device, the position information indicating the position where the image was captured, and the date and time information indicating the date and time when the image was captured from the vehicle-mounted device (step S2). For example, in the example of FIG. 1, the information providing device 10 has a plurality of images individually captured by the plurality of vehicle-mounted devices, position information indicating the position where each image was captured, and a date and time indicating the date and time when each image was captured. Get information and.

Subsequently, the information providing device 10 identifies the vehicle number from the image (step S3). For example, in the example of FIG. 1, the information providing device 10 specifies the vehicle number of the vehicle included in the image acquired in step S2 as a shooting target by using an arbitrary image recognition technique. In the example of FIG. 1, the information providing device 10 was individually photographed by an in-vehicle device installed in a plurality of vehicles (vehicles C2 and C3 in the example of FIG. 1) traveling on the same route R1 as the vehicle C1. It is assumed that the vehicle number of the vehicle C1 is specified from a plurality of images.

Subsequently, the information providing device 10 estimates the driver's behavior from the history of the position where the vehicle number is taken (step S4). For example, in the example of FIG. 1, the information providing device 10 estimates the position of the vehicle C1 based on the position information corresponding to the image in which the vehicle number of the vehicle C1 is specified (photographed) among the images acquired in step S2. do. Then, the information providing device 10 describes the driver of the vehicle C1 (hereinafter referred to as "driver D1") based on the history of the estimated position of the vehicle C1 and the date and time information corresponding to the image in which each position is estimated. Estimate the behavior of). To give a specific example, the information providing device 10 is based on a time-series change (transition) in the position of the vehicle C1, and the route and the purpose of the movement (for example,) in which the driver D1 boarded the vehicle C1 and moved. The visited facility) is estimated as the behavior of driver D1.

Subsequently, the external device 200 collects the usage history of each user in various web services provided by the external device 200 (step S5). For example, in the example of FIG. 1, the external device 200 is a route searched by a user in a navigation service, contents related to a facility browsed by a user in a restaurant introduction service or a facility reservation service, and a user in a search service or an SNS service. Information such as the entered character string is collected in association with the date and time when the user used the web service.

Subsequently, the information providing device 10 acquires the usage history of each user from the external device 200 (step S6). For example, in the example of FIG. 1, the information providing device 10 acquires the usage history of each user and the identification information (user ID) of the corresponding user from the external device 200.

Subsequently, the information providing device 10 associates the presumed driver and the user with each other based on the relationship between the characteristics of the usage history and the estimated behavior of the driver (step S7). For example, in the example of FIG. 1, the information providing device 10 relates the user's behavior estimated based on the usage history to the driver's behavior estimated based on the image in which the vehicle number is specified. Based on this, the driver presumed to be the same and the user (user ID) are associated with each other.

To give a specific example, the information providing device 10 is used with the driver based on the degree of coincidence between the history of the user's position positioned according to the use of the web service and the history of the driver's position. Associate with a person. Further, the information providing device 10 associates the driver with the user based on the degree of coincidence between the route searched by the user in the navigation service and the route traveled by the driver in the vehicle. Further, the information providing device 10 is based on the degree of agreement between the facility corresponding to the content browsed by the user, the visited destination estimated from the usage history (purchase history) of the electronic payment service, and the purpose of the driver's movement. And link the driver and the user. Further, the information providing device 10 has a route from the user's base (for example, home, commuting destination, etc.) to the facility presumed to be the user's visit destination, and a route in which the driver boarded the vehicle and moved. The driver and the user are linked based on the degree of agreement.

It should be noted that the determination of the degree of coincidence between the characteristics of the usage history and the behavior of the driver is not limited to determining whether or not the position and the date and time indicated by the usage history and the behavior of the driver completely match. .. For example, the information providing device 10 may determine whether or not the difference between the position indicated by the usage history and the position indicated by the driver's behavior is within a predetermined range (for example, 10 meters or 50 meters). .. Further, the information providing device 10 may determine whether or not the difference between the date and time indicated by the usage history and the date and time indicated by the driver's behavior is within a predetermined range. To give a specific example, when the usage history of the information providing device 10 indicates the position of the user positioned according to the use of the web service or the route searched by the user in the navigation service ( In other words, when the usage history indicates the position or route where the user actually moved), the difference between the date and time indicated by the usage history and the date and time indicated by the driver's behavior corresponds to the characteristics of the usage history. It is determined whether or not it is within the range (for example, 5 minutes and 10 minutes). Further, in the information providing device 10, when the feature of the usage history indicates a facility corresponding to the content browsed by the user (in other words, when the feature of the usage history indicates the action schedule of the user). The difference between the date and time indicated by the usage history (for example, the viewing date and time of the content) and the date and time indicated by the driver's behavior is within the range corresponding to the characteristics of the usage history (for example, 3 days and 1 week). Judge whether or not.

Subsequently, the information providing device 10 provides various information according to the associating result (step S8). Here, in the example of FIG. 1, it is assumed that the information providing device 10 associates the user U1 with the driver D1. In this case, the information providing device 10 provides information based on the usage history of various web services of the user U1 to the in-vehicle device of the vehicle C1, and provides information based on the behavior of the driver D1 to the terminal device 100. To give a specific example, the information providing device 10 causes the in-vehicle device of the vehicle C1 to output guidance information indicating a movement route to a facility corresponding to the content viewed by the user U1. Further, the information providing device 10 acquires information on a coupon that can be used at the store visited by boarding the vehicle C1 of the driver D1 from the external device 200, and provides the information to the terminal device 100.

The external device 200 may be managed by the same manager (business operator) as the information providing device 10, or by an administrator having a relationship with the manager of the information providing device 10.

As described above, the information providing device 10 according to the embodiment links the users of various web services with the driver, and the information based on the web service and the information based on the information acquired according to the driving of the vehicle. And provide. As a result, the information providing device 10 according to the embodiment is, for example, even when the application for acquiring probe data is not installed in the terminal device 100 when the user (driver) drives the vehicle. , Enables information provision based on probe data. Further, the information providing device 10 according to the embodiment is accumulated by the user using the terminal device 100 even when the in-vehicle device of the vehicle driven by the user and the terminal device 100 are not connected. Information based on the usage history of various web services can be provided to in-vehicle devices. That is, the information providing device 10 according to the embodiment can provide more appropriate information for the user.

[2. Configuration of information providing device]
Next, the configuration of the information providing device 10 will be described with reference to FIG. FIG. 3 is a diagram showing a configuration example of the information providing device according to the embodiment. As shown in FIG. 3, the information providing device 10 includes a communication unit 20, a storage unit 30, and a control unit 40.

(About communication unit 20)
The communication unit 20 is realized by, for example, a NIC (Network Interface Card) or the like. Then, the communication unit 20 is connected to the network N by wire or wirelessly, and transmits / receives information to / from the terminal device 100, the external device 200, and the like.

(About the storage unit 30)
The storage unit 30 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory (Flash Memory), or a storage device such as a hard disk or an optical disk. As shown in FIG. 3, the storage unit 30 has an image database 31, a driver database 32, and an association database 33.

(About image database 31)
The image database 31 stores various information related to images taken by the vehicle-mounted device. Here, an example of the information stored in the image database 31 will be described with reference to FIG. FIG. 4 is a diagram showing an example of an image database according to an embodiment. In the example of FIG. 4, the image database 31 has items such as "image ID", "image data", "position information", "date and time information", and "specific number".

The "image ID" indicates identification information for identifying an image. "Image data" indicates data of an image taken by an in-vehicle device. In the example shown in FIG. 5, an example in which conceptual information such as "data # 1" is stored in "image data" is shown, but in reality, still images, moving images, etc., or their locations are shown. The URL (Uniform Resource Locator), the file path name indicating the storage location, etc. are stored.

"Position information" indicates the position where the in-vehicle device has taken an image. "Date and time information" indicates the date and time when the in-vehicle device took an image. "Specific number" indicates the vehicle number specified from the captured image.

That is, in FIG. 4, the image of "data # 1" identified by the image ID "image # 1" is taken at "date and time # 1" at "position # 1", and "number # 1" is obtained from the image. Here is an example identified.

(About driver database 32)
The driver database 32 stores various information about the driver estimated based on the image taken by the vehicle-mounted device. Here, an example of the information stored in the driver database 32 will be described with reference to FIG. FIG. 5 is a diagram showing an example of a driver database according to an embodiment. In the example of FIG. 5, the driver database 32 has items such as "driver ID", "estimated position history", and "estimated behavior history".

The "driver ID" indicates identification information for identifying the driver. The "estimated position history" indicates the position of the driver estimated based on the information stored in the image database 31 and the date and time information corresponding to the position. The "estimated behavior history" indicates the driver's behavior estimated based on the estimated position history.

That is, FIG. 5 shows an example in which the driver ID is identified by the driver ID “driver # 1”, the estimated position history of the driver is “estimated position # 1”, and the estimated action history is “estimated action # 1”.

(About the linked database 33)
The association database 33 stores information indicating the correspondence (association) between the driver and the user. Here, an example of the information stored in the association database 33 will be described with reference to FIG. FIG. 6 is a diagram showing an example of a linked database according to an embodiment. In the example of FIG. 6, the association database 33 has items such as "user ID", "usage history", and "estimated driver".

The "user ID" indicates identification information for identifying the user. "Usage history" indicates the usage history of various services of the user. The "estimated driver" indicates identification information for identifying a driver who is presumed to be the same as the user.

That is, in FIG. 6, the usage history of various services of the user identified by the user ID "user # 1" is "usage history # 1", and the user is identified by "driver # 1". Here is an example that is presumed to be the same as the driver.

(About control unit 40)
The control unit 40 is a controller, and for example, various programs stored in a storage device inside the information providing device 10 by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like have a RAM as a work area. It is realized by executing as. Further, the control unit 40 is a controller, and is realized by, for example, an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). As shown in FIG. 3, the control unit 40 according to the embodiment includes an acquisition unit 41, a specific unit 42, an estimation unit 43, a linking unit 44, and a provision unit 45, and information processing described below is described. Realize or execute the functions and actions of.

(About acquisition unit 41)
The acquisition unit 41 acquires an image and position information indicating the position where the image was taken from the in-vehicle device. For example, in the example of FIG. 1, the acquisition unit 41 acquires an image taken by the in-vehicle device, position information indicating the position where the image was taken, and date and time information indicating the date and time when the image was taken from the in-vehicle device, and obtains an image. Store in database 31. The acquisition unit 41 may acquire the image taken by the vehicle-mounted device and the position information from the terminal device 100 communicably connected to the vehicle-mounted device.

Further, the acquisition unit 41 may acquire the vehicle number specified from the image taken by the in-vehicle device from the in-vehicle device. For example, the acquisition unit 41 acquires the vehicle number specified by the in-vehicle device by using an arbitrary image recognition technique. The acquisition unit 41 may acquire information according to the accuracy of the vehicle number specified by the in-vehicle device. For example, when the accuracy of the vehicle number specified by the vehicle-mounted device is equal to or less than a predetermined threshold value, the acquisition unit 41 acquires the vehicle number and the image specifying the vehicle number from the vehicle-mounted device.

Further, the acquisition unit 41 may acquire the usage history of the user in the predetermined service. For example, in the example of FIG. 1, the acquisition unit 41 acquires the usage history of each user and the identification information of the corresponding user from the external device 200 and stores them in the association database 33.

(About the specific part 42)
The identification unit 42 identifies the vehicle number of the photographed vehicle from a plurality of images individually captured by the plurality of vehicle-mounted devices. For example, in the example of FIG. 1, the specifying unit 42 identifies the vehicle number of the vehicle included as a shooting target in the image shot by the in-vehicle device by using an arbitrary image recognition technique, and stores it in the image database 31. ..

(About estimation unit 43)
The estimation unit 43 estimates the behavior of the driver of the corresponding vehicle corresponding to the predetermined vehicle number based on the captured image in which the predetermined vehicle number is taken. For example, in the example of FIG. 1, the estimation unit 43 estimates the behavior of the driver D1 of the vehicle C1 based on the image (photographed image) in which the vehicle number of the vehicle C1 is specified among the images taken by the vehicle-mounted device. .. To give a specific example, when the estimation unit 43 indicates that the image in which the vehicle number of the vehicle C1 is specified is within the area of the facility (for example, a parking lot), the estimation unit 43 takes an action corresponding to the facility (for example, a parking lot). The behavior corresponding to the facility "restaurant A""meal at restaurant A") is estimated as the behavior of the driver D1.

Further, the estimation unit 43 may estimate the history of the position of the corresponding vehicle based on the position where the captured image is taken by the vehicle-mounted device, and may estimate the behavior of the driver based on the history of the estimated position. For example, in the example of FIG. 1, the estimation unit 43 estimates the position of the vehicle C1 based on the position information corresponding to the image in which the vehicle number of the vehicle C1 is specified, and stores it in the driver database 32. Then, the estimation unit 43 estimates the behavior of the driver D1 of the vehicle C1 based on the history of the estimated position of the vehicle C1, and stores it in the driver database 32.

Further, the estimation unit 43 may estimate the position where the captured image is captured based on the position information, and may estimate the driver's behavior based on the history of the estimated position. For example, in the example of FIG. 1, the estimation unit 43 refers to the image database 31, estimates the position of the vehicle C1 based on the position information acquired by the acquisition unit 41, and estimates the position of the vehicle C1 based on the history of the estimated position. The behavior of the driver D1 is estimated.

Further, the estimation unit 43 may estimate the position where the captured image is captured based on the subject captured in the captured image, and may estimate the behavior of the driver based on the history of the estimated position. For example, the estimation unit 43 estimates the position where the captured image is captured based on the subject (for example, a landmark) captured in the captured image by using an arbitrary image recognition technique, and records the estimated position in the history. Based on this, the driver's behavior is estimated.

Further, the estimation unit 43 may estimate the purpose of the driver's movement as the driver's behavior. For example, in the example of FIG. 1, the estimation unit 43 estimates the route traveled by the driver D1 on the vehicle C1 and the purpose of the travel (for example, the facility visited) as the behavior of the driver D1.

Further, the estimation unit 43 may estimate the facility visited by the driver and estimate the purpose of the driver's movement based on the estimated facility. For example, the estimation unit 43 allows the driver to perform the driver's behavior history (for example, the history of facilities visited by the user in the past), the travel direction estimated based on the driver's position history, and the like. Estimate the facilities visited and estimate the purpose of the driver's movement based on the estimated facilities.

(About the tying part 44)
The linking unit 44 links the driver with the user of the predetermined service based on the user's usage history and the driver's behavior estimated by the estimation unit. For example, in the example of FIG. 1, the linking unit 44 is based on the relationship between the user behavior estimated based on the usage history and the driver behavior estimated based on the image in which the vehicle number is specified. The driver and the user, which are presumed to be the same, are associated with each other and stored in the association database 33.

Further, the linking unit 44 may link the user of the usage history highly related to the behavior of the driver estimated by the estimation unit 43 to the driver. For example, in the example of FIG. 1, the linking unit 44 is a driver and a user based on the degree of coincidence between the history of the user's position positioned according to the use of the web service and the history of the driver's position. And link.

(About the provider 45)
The providing unit 45 provides the driver with information based on the usage history of the user associated with the driver, or provides the user with the behavior of the driver associated with the user. Provide information based on. For example, in the example of FIG. 1, the providing unit 45 provides information based on the usage history of various web services of the user U1 to the in-vehicle device of the vehicle C1, and provides information based on the behavior of the driver D1 to the terminal device 100. do. To give a specific example, when the user's alcohol intake is estimated based on the user's usage history, the provider 45 relates to a driving agent for the driver associated with the user. Provide information.

[3. Estimating processing flow]
Here, the procedure of the estimation process of the information providing apparatus 10 according to the embodiment will be described with reference to FIG. 7. FIG. 7 is a flowchart showing an example of the procedure of the estimation process according to the embodiment.

As shown in FIG. 7, the information providing device 10 acquires an image from each in-vehicle device (step S101). Subsequently, the information providing device 10 identifies the vehicle number from the acquired image (step S102). Subsequently, the information providing device 10 estimates the driver's behavior based on the history of the vehicle position corresponding to the vehicle number (step S103).

Subsequently, the information providing device 10 acquires the usage history of each user in various services (step S104). Subsequently, the information providing device 10 associates the user with the driver whose behavior is presumed to be related to the user's usage history (step S104), and ends the process.

[4. Modification example]
The above embodiment shows an example, and various modifications and applications are possible.

[4-1. About the vehicle]
In the above-described embodiment, the estimation unit 43 shows an example of estimating the behavior of the driver who drives the moving vehicle based on the image taken by the in-vehicle device installed in the automobile, but the function of the estimation unit 43 is The present invention is not limited to such an example, and the behavior of the driver who drives various vehicles may be estimated based on the images taken by the in-vehicle devices installed in various vehicles such as motorcycles and bicycles.

[4-2. About identification of face image]
In the above-described embodiment, the specific unit 42 has shown an example of specifying the vehicle number of the vehicle from the image taken by the in-vehicle device, but the function of the specific unit 42 is not limited to such an example. For example, the identification unit 42 may specify the face image of the driver driving the vehicle from the image taken by the in-vehicle device based on an arbitrary face recognition technique. Then, the linking unit 44 links the driver with the user corresponding to the face image of the driver.

[4-3. About vehicle number estimation]
In the above-described embodiment, the specific unit 42 has shown an example in which the vehicle number of the vehicle included in the image captured by the in-vehicle device is specified by using an arbitrary image recognition technique. The function of is not limited to such an example. For example, the specifying unit 42 may specify the vehicle number estimated based on the captured image as the vehicle number of the vehicle included as the imaging target. To give a specific example, for example, an image including a vehicle A (preceding vehicle of vehicle B), vehicle B and vehicle C (following vehicle of vehicle B) traveling on the same route (road) as an in-vehicle device is an in-vehicle device. It is assumed that the vehicle number 42 of the vehicle AC is specified as "1100", "1111", and "1122" from the image taken by # 1. Further, the vehicle D (vehicle) traveling on the same route by the vehicle-mounted device # 2 different from the vehicle-mounted device # 1 within a predetermined range (for example, 100 m, 500 m) from the position where the image is taken by the vehicle-mounted device # 1. An image including the preceding vehicle of E), the vehicle E and the vehicle F (the vehicle following the vehicle E) is photographed, and the specific unit 42 sets the vehicle number of the vehicle D to "1100" from the image and the vehicle of the vehicle F. While the number is specified as "1122", it is assumed that part or all of the vehicle number of vehicle E cannot be specified. In this case, in the specific unit 42, the vehicle A and the vehicle C are the same as the vehicle D and the vehicle F, respectively, and the vehicle E traveling between the vehicle D and the vehicle F is the same as the vehicle B (in other words, the vehicle of the vehicle E). It is estimated that the number is the same as that of the vehicle B), and the vehicle number of the vehicle E is specified as "1111". That is, the specifying unit 42 estimates the vehicle number of the target vehicle based on the information of the vehicle traveling around the target vehicle (for example, the preceding vehicle, the following vehicle, etc.), and identifies the estimated vehicle number as the vehicle number of the target vehicle. You may.

[4-4. Behavior pattern estimation]
In the above-described embodiment, the estimation unit 43 has shown an example of estimating the driver's behavior based on the history of the estimated position, but the function of the estimation unit 43 is not limited to such an example. For example, the estimation unit 43 may estimate the driver's behavior pattern based on the driver's behavior history. Then, the linking unit 44 associates the user with the usage history, which is highly related to the behavior pattern of the driver estimated by the estimation unit 43, with the driver.

[5. effect〕
As described above, the information providing device 10 according to the embodiment includes an acquisition unit 41, a specific unit 42, an estimation unit 43, a linking unit 44, and a providing unit 45. The acquisition unit 41 acquires an image and position information indicating the position where the image was taken from the in-vehicle device. In addition, the acquisition unit 41 acquires the usage history of the user in the predetermined service. The identification unit 42 identifies the vehicle number of the photographed vehicle from a plurality of images individually captured by the plurality of vehicle-mounted devices. The estimation unit 43 estimates the behavior of the driver of the corresponding vehicle corresponding to the predetermined vehicle number based on the captured image in which the predetermined vehicle number is taken. Further, the estimation unit 43 estimates the position where the captured image is captured based on the position information, and estimates the driver's behavior based on the history of the estimated position. The linking unit 44 links the driver with the user of the predetermined service based on the user's usage history and the driver's behavior estimated by the estimation unit. The providing unit 45 provides the driver with information based on the usage history of the user associated with the driver, or provides the user with the behavior of the driver associated with the user. Provide information based on.

As a result, the information providing device 10 according to the embodiment links the driver and the user and provides the user with information based on the driver's behavior, in addition to the service usage history, according to the driving. Since it is possible to provide information by utilizing the accumulated information, it is possible to provide more appropriate information for the user.

Further, in the information providing device 10 according to the embodiment, for example, the estimation unit 43 estimates the history of the position of the corresponding vehicle based on the position where the captured image is taken by the in-vehicle device, and based on the history of the estimated position. , Estimate the driver's behavior. Further, the estimation unit 43 estimates the position where the captured image is captured based on the subject captured in the captured image, and estimates the behavior of the driver based on the history of the estimated position. Further, the estimation unit 43 estimates the purpose of the driver's movement as the driver's behavior. Further, the estimation unit 43 estimates the facility visited by the driver, and estimates the purpose of the driver's movement based on the estimated facility. Then, the linking unit 44 associates the user with the usage history, which is highly related to the driver's behavior estimated by the estimation unit 43, with the driver.

As a result, the information providing device 10 according to the embodiment can estimate the behavior of the driver in more detail and accurately associate the driver with the user, thereby providing more appropriate information for the user. be able to.

[6. Hardware configuration]
Further, the information providing device 10 according to each of the above-described embodiments is realized by, for example, a computer 1000 having a configuration as shown in FIG. Hereinafter, the information providing device 10 will be described as an example. FIG. 8 is a hardware configuration diagram showing an example of a computer that realizes the function of the information providing device. The computer 1000 has a CPU 1100, a ROM 1200, a RAM 1300, an HDD 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F) 1700.

The CPU 1100 operates based on a program stored in the ROM 1200 or the HDD 1400, and controls each part. The ROM 1200 stores a boot program executed by the CPU 1100 when the computer 1000 is started, a program depending on the hardware of the computer 1000, and the like.

The HDD 1400 stores a program executed by the CPU 1100, data used by such a program, and the like. The communication interface 1500 receives data from another device via the communication network 500 (corresponding to the network N of the embodiment) and sends the data to the CPU 1100, and the communication interface 1500 receives data generated by the CPU 1100 via the communication network 500 to another device. Send to the device.

The CPU 1100 controls an output device such as a display or a printer, and an input device such as a keyboard or a mouse via the input / output interface 1600. The CPU 1100 acquires data from the input device via the input / output interface 1600. Further, the CPU 1100 outputs the data generated via the input / output interface 1600 to the output device.

The media interface 1700 reads a program or data stored in the recording medium 1800 and provides the program or data to the CPU 1100 via the RAM 1300. The CPU 1100 loads the program from the recording medium 1800 onto the RAM 1300 via the media interface 1700, and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or PD (Phase change rewritable Disk), a magneto-optical recording medium such as MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory. And so on.

For example, when the computer 1000 functions as the information providing device 10, the CPU 1100 of the computer 1000 realizes the function of the control unit 40 by executing the program loaded on the RAM 1300. Further, the HDD 1400 stores each data in the storage device of the information providing device 10. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, these programs may be acquired from another device via a predetermined communication network.

[7. others〕
Although some of the embodiments of the present application have been described in detail with reference to the drawings, these are examples, and various modifications are made based on the knowledge of those skilled in the art, including the embodiments described in the disclosure column of the invention. It is possible to carry out the present invention in other modified forms.

Further, the configuration of the above-mentioned information providing device 10 can be flexibly changed, such as by calling an external platform or the like by API (Application Programming Interface), network computing, or the like depending on the function.

Further, the "part" described in the claims can be read as "means" or "circuit". For example, the acquisition unit can be read as an acquisition means or an acquisition circuit.

10 Information provider 20 Communication unit 30 Storage unit 31 Image database 32 Driver database 33 Linked database 40 Control unit 41 Acquisition unit 42 Specific unit 43 Estimate unit 44 Linked unit 45 Provider unit 100 Terminal device 200 External device

Claims (10)

A specific part that identifies the vehicle number of the vehicle that was taken from multiple images taken individually by multiple in-vehicle devices,
An estimation unit that estimates the behavior of the driver of the corresponding vehicle corresponding to the predetermined vehicle number based on the captured image in which the predetermined vehicle number is taken .
The second acquisition unit that acquires the usage history of the user in the specified service,
A linking unit that links the driver to the user of the predetermined service based on the usage history of the user and the behavior of the driver estimated by the estimation unit.
An estimation device characterized by having. The estimation unit
The claim is characterized in that the history of the position of the corresponding vehicle is estimated based on the position of the photographed image taken by the vehicle-mounted device, and the behavior of the driver is estimated based on the history of the estimated position. The estimation device according to 1. It has a first acquisition unit that acquires the image and the position information indicating the position where the image was taken from the in-vehicle device.
The estimation unit
The estimation device according to claim 2, wherein the position where the captured image is captured is estimated based on the position information, and the behavior of the driver is estimated based on the history of the estimated position. The estimation unit
2. The estimation device described. The estimation unit
The estimation device according to any one of claims 1 to 4, wherein the driver's behavior is to estimate the purpose of the driver's movement. The estimation unit
The estimation device according to claim 5, wherein the facility visited by the driver is estimated, and the purpose of the driver's movement is estimated based on the estimated facility. The tying part is
The estimation according to any one of claims 1 to 6 , wherein the user of the usage history highly related to the behavior of the driver estimated by the estimation unit is associated with the driver. Device. Provide the driver with information based on the usage history of the user associated with the driver, or provide the user with information based on the behavior of the driver associated with the user. The estimation device according to any one of claims 1 to 7, wherein the provision unit is provided. It is an estimation method performed by the estimation device.
A specific process to identify the vehicle number of the vehicle taken from multiple images taken individually by multiple in-vehicle devices, and
An estimation process for estimating the behavior of the driver of the corresponding vehicle corresponding to the predetermined vehicle number based on the captured image of the predetermined vehicle number, and
The second acquisition process to acquire the usage history of the user in the predetermined service, and
Based on the usage history of the user and the behavior of the driver estimated by the estimation process, the linking process of linking the driver with the user of the predetermined service.
An estimation method characterized by including. A specific procedure for identifying the vehicle number of the vehicle taken from multiple images taken individually by multiple in-vehicle devices, and
An estimation procedure for estimating the behavior of the driver of the corresponding vehicle corresponding to the predetermined vehicle number based on the captured image of the predetermined vehicle number, and the estimation procedure .
The second acquisition procedure to acquire the usage history of the user in the predetermined service, and
Based on the usage history of the user and the behavior of the driver estimated by the estimation procedure, the linking procedure for associating the driver with the user of the predetermined service.
An estimation program to make a computer run.

Images