JP6981051B2 - Information processing equipment, information processing system, information processing method and information processing program - Google Patents

Description

The present invention relates to an information processing device, an information processing system, an information processing method and an information processing program for processing information related to vehicle operation.

In recent years, there have been increasing opportunities for multiple people to use one vehicle, such as rental cars and car sharing, for the purpose of cost reduction and alleviation of traffic congestion. On the other hand, vehicles having an automatic driving function that combines various safety technologies that have been conventionally equipped with new technologies are being put into practical use. In particular, in an autonomous driving taxi that applies the automatic driving function to a taxi, it is possible to get on the vehicle alone and reach the destination regardless of whether or not a driver's license is obtained.

Patent Document 1 extracts a person image from image data associated with position information, and when a person included in the person image is determined to be a prospective customer, notifies the taxi of the associated position information and image data. Discloses the same person verification program that determines whether or not the person specified by the prospect information indicating the prospect extracted from the above and the person photographed by the photographing device installed in the taxi are the same person.

Japanese Unexamined Patent Publication No. 2016-218895

As mentioned above, vehicles used by various people are highly convenient because they can be used for various purposes depending on the passenger, but unexpected use may lead to incidents or accidents, or unexpected costs. May occur. For example, children and the elderly may take an autonomous taxi by themselves and get off in an area where the security of unknown land is not sufficient.

The present disclosure is made in view of the above circumstances, and provides an information processing device, an information processing system, an information processing method, and an information processing program that can make a vehicle used by various people more safely used. The purpose is.

The information processing device according to one aspect of the present disclosure acquires the attribute information and the operation range storage unit (220) stored in association with the operation range information which is the information of the operation range of the vehicle with respect to the attribute information of the occupant. An information processing device including an operation range acquisition unit (214) that acquires the operation range information corresponding to the attribute information acquired from the operation range storage unit, and the information acquired from the passenger. An attribute determination unit (210) for determining the attribute information from a certain occupant information is further provided, and the occupant information is biometric information and property record information recorded in the occupant's property, and the attribute determination. In the case where the first attribute information, which is the attribute information determined based on the biometric information, and the second attribute information, which is the attribute information determined based on the possession record information, conflict with each other. Is an information processing device that acquires the passenger information different from the acquired passenger information.

With the above-mentioned configuration, the information processing device can make the vehicle used by various people more safely used.

It is a figure which shows the example of the information processing system which concerns on one Embodiment of this disclosure. It is a figure which shows the structural example of the information processing apparatus which concerns on one Embodiment of this disclosure. It is a figure which shows the example of the database structure of the operation range storage part. It is a flowchart which shows the example of the processing of an information processing system. It is a flowchart which shows the example of the attribute determination processing. It is a flowchart which shows the example of the operation range acquisition processing. It is a flowchart which shows the example of the destination determination processing. It is a flowchart which shows the example of the advertisement decision processing. It is a figure which shows the configuration example when the information processing apparatus makes a communication connection with an in-vehicle network via wireless communication. It is a figure which shows the configuration example in the case where a part of the configuration of an information processing apparatus is independently connected to an in-vehicle network.

Hereinafter, the configurations and functions of the information processing apparatus 200 and the information processing system 100 of the present invention will be described with reference to the drawings. The present invention means the invention described in the section of the scope of claims or the means for solving the problem, and is not limited to the following embodiments. Further, the words in the brackets mean the words described in the section of the scope of claims or the means for solving the problem, and are not limited to the following embodiments. Further, the configuration and method described in the dependent clause of the claims, the method of the embodiment corresponding to the configuration and method described in the dependent clause, and the configuration and method described only in the embodiment without description in the claims are , Arbitrary configuration and method in the present invention. The problem described in the problem to be solved by the invention is not a known problem, but is independently discovered by the present inventor, and is a fact that affirms the inventive step of the invention together with the means of the present invention.

As shown in FIG. 1, the information processing system 100 includes an information processing device 200 and a passenger information acquisition device 310. These may be connected by an in-vehicle network 110 that communicates with each other. Here, another control unit such as an ECU (Electronic Control Unit) 105 or a wireless communication unit such as a DCM (Data Communication Module) 103 may be connected to the vehicle-mounted network 110. Further, the in-vehicle network 110 is connected to a display device 104 including a liquid crystal display device and an organic EL (Electroluminescence) display device for the passenger to confirm information on the screen, and a vehicle control unit 600 for controlling the operation of the vehicle. It may have been done. Further, the DCM may be configured to be able to connect to a public network 120 such as the Internet or a public wireless communication network via wireless communication. The public network 120 may be further connected to the operator terminal 130, and the operator terminal 130 may be configured to be able to make a telephone call with the "operator" by being connected to the telephone terminal in the vehicle by telephone. The "operator" of the present invention may be a person who manages the information processing system 100 or a person who manages the operation of the vehicle, and changes information such as the destination of the vehicle. Can be someone who can. For wireless communication, communication conforming to various public wireless network standards, wireless LAN (Local Area Network) communication standards, short-range wireless standards and other wireless standards can be used. Here, the "passenger information acquisition device" 310 can acquire passenger information from the passenger. The "passenger information acquisition device" of the present invention includes a camera, a microphone, a card reader, a short-range wireless communication device, a weight measuring instrument and other devices for acquiring various information, and includes, for example, a fingerprint, a palm shape, a retina, and an iris. , A device for acquiring biological information such as face, blood vessel, voice, height, and weight, and a device for acquiring information from information communication devices such as magnetic cards, IC cards, and smartphones.

The information processing device 200 and the passenger information acquisition device 310 may each be configured as one ECU, or may be combined with these or other ECUs to be configured as one ECU. Further, the information processing device 200 and the passenger information acquisition device 310 may be configured to be incorporated in a control unit other than the ECU or a communication unit such as a DCM or a gateway. The information processing device 200 and the passenger information acquisition device 310 are, for example, so-called information processing devices that are mainly composed of semiconductor devices and have a volatile storage unit such as a CPU (Central Processing Unit) and a RAM (Random Access Memory). It may be configured as. The information processing device may further include a non-volatile storage unit such as a flash memory, a network interface unit connected to a communication network, and the like. Further, such an information processing device may be a packaged semiconductor device or may have a configuration in which each semiconductor device is connected by wiring on a wiring board. For the in-vehicle network 110, LAN communication standards and other communication standards such as Ethernet (registered trademark) and Wi-Fi (registered trademark) can be used.

As shown in FIG. 2, the information processing apparatus 200 has an operation range storage unit 220 and an operation range acquisition unit 214. The operation range storage unit 220 stores the operation range information, which is the information of the "operation range" of the vehicle, in association with the "attribute information of the passenger". The operation range acquisition unit 214 acquires the attribute information, and acquires the operation range information corresponding to the acquired attribute information from the operation range storage unit 220. Here, the "passenger attribute information" of the present invention is information indicating the rider's attributes, and may include, for example, age, gender, affiliation organization, preference, and the like. Further, the "operating range" of the present invention includes not only a distance range but also a time range and other ranges. For example, each range such as distance, destination, boarding time, amount of money and boarding time can be included. In addition, the operating range information is when the operating range for a specific passenger is stipulated by laws and regulations including the ordinance, for example, when the use of self-driving taxis by minors is restricted by local ordinances at midnight. Can be used as operating range information in accordance with the law. The information processing device 200 configured in this way can make vehicles used by various people more safely used.

As shown in FIG. 3, the operation range storage unit 220 has a structure in which the operation range information is determined, for example, with respect to the attribute information. For example, gender and age are exemplified as the attribute information, but the attribute information is not limited to these. Further, as the operation range information, the usage time range, the destination range, and the travel distance range are selected, but the operation range information is not limited to these. The usage time range may define a range of times that the passenger can board. The destination range may indicate a predetermined area or multiple destinations that are acceptable as a destination, or may indicate an area that cannot be selected as a destination or a destination that cannot be selected. There may be. The range of destinations may include, for example, stations, homes, cram schools, libraries and other public facilities, for example. The travel distance range can be a distance range indicating the distance from the position where the passenger is at the time of selection to the selected destination.

In this way, the operation range storage unit 220 can use the attribute information as the age range and the operation range information as any one of the usage time range, the destination range, the travel distance range, or a combination thereof. By setting the attribute information in the age range, for example, it is possible to identify minors who should be alerted depending on the destination. In addition, by defining the operation range information by any one of the usage time range, the destination range, the travel distance range, or a combination thereof, the operation range can be set to a safer area or time zone.

Further, as shown in FIG. 2, the information processing apparatus 200 may further include an attribute determination unit 210 for determining attribute information from "passenger information" which is information acquired from the passenger. Here, the "passenger information" of the present invention can be biological information such as fingerprint, palm shape, retina, iris, face, blood vessel, voice, height or weight. Further, the "passenger information" of the present invention can be possession record information recorded in the possession of the passenger such as a magnetic card, an IC (Integrated Circuit) card, or an information communication device such as a smartphone.

Further, the attribute determination unit 210 can determine the age range as the attribute information based on the biological information as the passenger information. By determining the attribute information in the age range based on the biological information in this way, it is possible to suppress boarding due to a false age declaration. Further, the preference or the like may be determined as the attribute information. By determining the preference, it is possible to propose or suggest a destination that matches the preference.

Further, the information processing apparatus 200 may further have a destination determination unit 216 for determining a destination by referring to the operation range information. As a result, the information processing apparatus 200 can confirm whether or not the destination entered by the passenger is within the operating range indicated in the operating range information, and can provide safer operation. Further, the destination determination unit 216 may process the call connection with the operator terminal 130 when the received destination candidate is not within the operation range information. By connecting to the operator by telephone, it is possible to deal with cases where the determination of the attribute information is not appropriate or when the operation is exceptionally out of the operation range.

Further, the information processing device 200 may further have an advertisement determination unit 218 that determines an advertisement to be displayed on the display device 104 in the vehicle based on the attribute information and displays the determined advertisement on the display device 104. .. As a result, it is possible to display an advertisement that matches the attribute information of the occupant in the vehicle.

In FIG. 2, the operation range storage unit 220, the operation range acquisition unit 214, the attribute determination unit 210, the destination determination unit 216, and the advertisement determination unit 218 are exemplified as configurations included in one information processing device 200. However, for example, they may be configured as separate ECUs or other information processing devices via the vehicle-mounted network 110, or a plurality of them may be configured as one information processing device. Further, even if the information processing device 200 does not have the attribute determination unit 210, the destination determination unit 216, and the advertisement determination unit 218, as shown in the information processing device 200 of FIGS. 9 and 10, for example. good.

As shown in FIG. 4, the passenger information acquisition device 310 first acquires passenger information in step S101. The passenger information can be various biological information as described above, property information recorded in the property of the passenger, or information obtained by combining these, and is suitable for acquiring such information. The person information acquisition device 310 can be used. Next, the attribute determination unit 210 executes the attribute determination process S200 using the passenger information.

In the attribute determination process S200, as shown in FIG. 5, for example, the feature amount may be extracted from the passenger information in step S201, and the attribute information may be determined using the feature amount extracted in step S202. Here, the attribute determination unit 210 has a database in which the range of the feature amount and the attribute information are related, and by referring to this database, the attribute information may be determined or the candidate of the attribute information may be extracted. good. For example, the passenger information is an image of the passenger, and the height and facial features as feature quantities can be extracted by image processing, and can be used as, for example, one of the information for determining the age range as attribute information. Further, when the voice of the passenger is acquired, the average frequency of the voice can be extracted as a feature amount and used as, for example, one of the information for determining the age range as attribute information. Further, when the size of the occupant's hand is acquired, the length and area can be extracted as feature quantities, and can be used as, for example, one of the information for determining the age range as attribute information. Even in these cases, the database of the attribute information corresponding to the feature amount can be stored, the corresponding attribute information in the database can be determined, and the attribute information can be used as a candidate.

Here, the attribute determination unit 210 can directly determine the attribute information from the passenger information without using the feature amount. For example, when the passenger information is information such as age and gender and the attribute information is age range and gender, the passenger information can be used as it is as attribute information. In this way, by directly determining the attribute information and performing the determination based on the feature amount based on the passenger information, a more accurate determination standard can be obtained.

Further, the attribute determination unit 210 may accumulate passenger information and feature quantities, and update the attribute information determination criteria by machine learning such as SVM (Support Vector Machine) or deep learning. Further, the attribute determination unit 210 may accumulate passenger information and feature quantities and update the attribute information determination criteria by a statistical method. By updating the judgment criteria empirically in this way, it is possible to obtain more accurate and detailed judgment criteria as passenger information and feature quantities are accumulated. Further, one or more attribute information candidates each having a likelihood may be extracted from the passenger information, and the attribute information having the highest likelihood may be determined as the attribute information of the passenger. This makes it possible to determine more probable attribute information.

Returning to FIG. 4, the attribute determination unit 210 determines the presence / absence of the attribute information determined in step S103, and if there is no attribute information, proceeds to step S104 and inquires the passenger whether to talk to the operator. Processing may be performed. In this case, if the option not to talk to the operator is received, the process returns to step S101 and the process of acquiring the passenger information can be performed again. On the other hand, when the selection to talk with the operator is received, the process of connecting the call terminal in the vehicle and the operator terminal 130 in a call can be performed in step S105, and the process can be terminated. In this way, when the process of acquiring the passenger information is performed again, the attribute information of the passenger can be determined more accurately. Further, when the process of connecting to the operator terminal 130 by telephone is performed, the destination can be set even for a passenger whose attribute information is difficult to determine.

If there is determined attribute information in step S103, the attribute determination unit 210 decides to perform step S106, which is a process of determining whether or not the same passenger has already determined attribute information. May be good. In this case, if there is a conflict, the process of shifting to step S104, which is a process of inquiring the passenger whether or not to make a call with the operator, may be performed. Further, in the process of step S103, for example, the attribute information determined based on the biological information (corresponding to the "first attribute information" of the present invention) and the attribute information determined based on the possession record information (the present invention). When there is a conflict with the "second attribute information"), the process may be shifted to the process S101 for acquiring the passenger information different from the acquired passenger information. In this way, by determining the case where the attribute information based on the biometric information and the attribute information based on the possession record information are different, it is possible to further perform a procedure for clarifying the attribute information of the occupant. .. On the other hand, if the attribute information based on biometric information and the attribute information based on property record information match, it can be used as more reliable attribute information, so the empirical judgment criteria are updated by statistics and machine learning. Can be used as a basis for.

If it is determined in step S106 that they do not conflict with each other, the process proceeds to the operation range acquisition process S300 in step S300. As shown in FIG. 6, in the operation range acquisition process S300, the attribute information is first acquired in step S301, and then the operation range information corresponding to the attribute information acquired from the operation range storage unit 220 is acquired in step S302. .. The process of step S106 may be performed not by the attribute determination unit 210 but by another processing unit such as the destination determination unit 216.

Subsequently, the process proceeds to step S400, and the destination determination unit 216 executes the destination determination process S400. As shown in FIG. 7, the destination determination process S400 first compares the use time range of the operation range with the current time in step S401, and determines whether or not the destination is within the use time range. If it is not within the usage time range, the destination determination process S400 is terminated without determining the destination. If it is within the usage time range, the process proceeds to step S402, and it is determined whether or not the destination range of the operating range is limited. When there are restrictions on destinations, for example, when candidate destinations are determined, the candidate destinations are displayed on the display device 104 in step S403, and the destination selected by the passenger in step S404 is received. .. Then, the destination selected in step S405 is determined as the destination, and the destination determination process S400 is terminated. In addition, when it is not in the usage time range, it may be possible to process the call connection with the operator terminal 130. As a result, although it is not within the usage time range, it is possible to perform appropriate processing in consideration of the circumstances in which the passenger needs to operate the vehicle.

On the other hand, if the destination range is not limited in step S402, the destination input by the passenger is received in step S406. Next, in step S407, it is determined whether or not the distance between the received destination and the current position is within the travel distance range of the operating range. If it is within the travel distance range, the destination received in step S405 is determined as the destination, and the destination determination process S400 is terminated. If it is determined in step S407 that the travel distance range has been exceeded, for example, a display indicating that the travel distance has been exceeded is displayed on the display device 104 (S408), the process returns to step S406, and the destination entered by the passenger again. May be received.

In this way, the destination determination unit 216 receives the destination input by the passenger while referring to the operation range, so that the destination can be determined along the operation range. Further, when the received destination candidate is not within the operation range information, the call connection with the operator terminal 130 may be processed. As a result, the information processing system 100 can respond even when the attribute information is incorrect or when the operation is exceptionally out of the operation range. In the destination determination process S400 in the flowchart of FIG. 7, the determination is made using all the operation range information of the usage time range, the destination range, and the travel distance range. However, the destination determination process S400 may use any one of these operating range information, or may use other operating range information.

Returning to FIG. 4, in step S112, the destination determination unit 216 determines whether or not there is a determined destination. If there is no determined destination, the process of connecting the telephone terminal in the vehicle and the "operator" terminal 130 by telephone can be performed in step S105, and the process can be terminated. Further, if there is a determined destination in step S112, the destination may be set for the vehicle control unit 600 and the process may be terminated.

Further, as shown in FIG. 8, the advertisement determination unit 218 first acquires the attribute information in step S500, and then determines the advertisement corresponding to the attribute information acquired in step S502. Subsequently, in S503, it is possible to give an instruction to display the determined advertisement on the display device 104. The above processing may be executed following the processing of S113 or S105 of FIG. Here, the advertisement corresponding to the attribute information may have a storage device having a database structure in which the identifier of the advertisement associated with the attribute information is stored. As a result, it is possible to display an advertisement that matches the attribute information of the occupant in the vehicle.

In the above description, the information processing device 200 of the information processing system 100 has been described as being connected to the vehicle-mounted network 110. However, as illustrated in FIG. 9, the information processing apparatus 200 is connected to the public network 120, and the ECUs and the like connected to the vehicle-mounted network 110 by making a communication connection with the vehicle-mounted network 110 via wireless communication. It may be configured to be connected to communication with. Even when configured in this way, it has the same effect as the information processing apparatus 200 described above. Further, the processing load including the processing speed and the storage capacity of the system mounted on the vehicle can be reduced, and the processing capacity, cost and size of the information processing equipment such as the ECU mounted on the vehicle can be suppressed. Further, as shown in FIG. 10, a part of the configuration of the information processing apparatus 200 may be arranged on the vehicle-mounted network 110, and the other part may be arranged on the public network 120. In FIG. 10, the attribute determination unit 210, the destination determination unit 216, and the advertisement determination unit 218 are directly connected to the vehicle-mounted network 110 as the attribute determination device 330, the destination determination device 340, and the advertisement determination device 350, respectively.

Here, the operation range storage unit 220 and the operation range acquisition unit 214 may be configured as one piece of hardware housed in one housing. Further, the operation range storage unit 220 and the operation range acquisition unit 214 are respectively configured as a plurality of hardware connected to each other via a communication network (for example, an information processing terminal connected via an ECU or a wireless network). May be. The operation range storage unit 220 and the operation range acquisition unit 214 may be incorporated in an information processing device or the like connected via an ECU having other functions or a wireless network. The passenger information acquisition device 310, the attribute determination device 330, the information processing device 200, the destination determination device 340, and the vehicle control unit 600 are used as hardware such as information processing devices connected via separate ECUs and wireless networks. It may be configured. Further, the passenger information acquisition device 310, the attribute determination device 330, the information processing device 200, the destination determination device 340, and the vehicle control unit 600 are connected to each other via an integrated ECU or a wireless network. It may be configured as hardware such as a processing device.

For each process described in the above-mentioned flowchart or the like, the program is stored in a non-transitional substantive recording medium which is a recording medium such as a semiconductor memory, and a method corresponding to the program is executed in a processing device such as a CPU. It can be processed by. Further, the processing is not limited to software, and processing by hardware including digital circuits or analog circuits, or processing by collaboration between software and hardware can be performed.

The information processing apparatus, information processing system, information processing method, and information processing program according to the embodiment of the present invention have been described above.

The information processing device of the present invention corresponds to all of various in-vehicle electronic control units (ECUs). Further, examples of the form of the information processing apparatus of the present invention include semiconductors, electronic circuits, modules, and microcomputers. In addition, necessary functions such as an antenna and a communication interface may be added to these. It can also take the form of a car navigation system, smartphone, personal computer, mobile information terminal.

In addition, the present invention can be realized not only by the above-mentioned dedicated hardware (for example, "information processing device" as an ECU), but also a program recorded on a recording medium such as a memory or a hard disk, and can execute the program. It can also be provided for dedicated or general purpose hardware. This ensures that you always have the latest features through program upgrades. That is, the present invention also includes an information processing program capable of executing an information processing method of an information processing apparatus by a computer.

The information processing apparatus, information processing system, information processing method, and information processing program of the present invention have been described with the ECU mounted on the automobile in mind in the embodiment, but are moving bodies such as motorcycles, ships, railroads, and aircraft. It can be applied to all (corresponding to the "vehicle" of the present invention). In addition, it can be applied not only to mobile objects but also to all products including microcomputers.

200 Information processing device, 214 Operation range acquisition unit, 220 Operation range storage unit

Claims (10)

The operation range storage unit (220), which is stored in association with the operation range information which is the information of the operation range of the vehicle with respect to the attribute information of the passenger,
An information processing device including an operation range acquisition unit (214) that acquires the attribute information and acquires the operation range information corresponding to the acquired attribute information from the operation range storage unit.
Further, an attribute determination unit (210) for determining the attribute information from the passenger information which is the information acquired from the passenger is further provided.
The passenger information is biometric information and property record information recorded in the property of the passenger.
The attribute determination unit includes first attribute information, which is the attribute information determined based on the biometric information, and second attribute information, which is the attribute information determined based on the possession record information. An information processing device that acquires the passenger information different from the acquired passenger information in the case of conflicting cases. The attribute information is in the age range.
The information processing device according to claim 1, wherein the operation range information is information obtained by combining any or any of a usage time range, a destination range, and a travel distance range. The information processing device according to claim 1, wherein the attribute determination unit determines an age range as attribute information based on biological information as passenger information. The information processing device according to claim 1, wherein the attribute determination unit acquires passenger information again when there is no attribute information to be determined. The information processing device according to claim 1, wherein the attribute determination unit connects to the operator terminal (130) by telephone when there is no attribute information to be determined. The information processing device according to any one of claims 1 to 5 , which makes a communication connection with the in-vehicle network (110) via wireless communication. Any of claims 1 to 6 , further comprising an advertisement determination unit (218) that determines an advertisement to be displayed on the display unit in the vehicle based on the attribute information and displays the determined advertisement on the display unit. The information processing device according to paragraph 1. A passenger information acquisition device (310) that acquires passenger information from passengers, and
Attribute determination devices (210, 330) that determine attribute information from the passenger information, and
An information processing device (200) that acquires operating range information, which is information on the operating range of a vehicle, from the attribute information.
It is equipped with a destination determination device (216, 340) that determines a destination with reference to the operation range information.
The information processing device is
The operation range storage unit (220) stored in association with the operation range information with respect to the attribute information, and
The operation range acquisition unit (214) that acquires the attribute information and acquires and transmits the operation range information corresponding to the acquired attribute information from the operation range storage unit is provided.
The passenger information is biometric information and property record information recorded in the property of the passenger.
In the attribute determination device, the first attribute information which is the attribute information determined based on the biometric information and the second attribute information which is the attribute information determined based on the possession record information are provided. An information processing system that acquires passenger information that is different from the acquired passenger information in the case of conflicting information. The operation range storage unit stores the operation range information, which is the information of the operation range of the vehicle, in association with the attribute information of the passenger.
An information processing method in which an operation range acquisition unit that has acquired the attribute information acquires the operation range information corresponding to the acquired attribute information from the operation range storage unit.
The attribute determination unit determines the attribute information from the passenger information which is the information acquired from the passenger, and determines the attribute information.
The passenger information is biometric information and property record information recorded in the property of the passenger.
The attribute determination unit includes first attribute information, which is the attribute information determined based on the biometric information, and second attribute information, which is the attribute information determined based on the possession record information. An information processing method for acquiring the passenger information different from the acquired passenger information in the case of conflicting cases. The process of associating the operating range information, which is the information of the operating range of the vehicle, with the attribute information of the passenger and storing it in the operating range storage unit, and
An information processing program for causing a processing device to execute a process of acquiring the attribute information and acquiring the operation range information corresponding to the acquired attribute information from the operation range storage unit.
Further, it has a step of determining the attribute information from the passenger information which is the information acquired from the passenger.
The passenger information is biometric information and property record information recorded in the property of the passenger.
In the step of determining the attribute information, the first attribute information which is the attribute information determined based on the biometric information and the second attribute which is the attribute information determined based on the possession record information are used. An information processing program that acquires passenger information that is different from the acquired passenger information when the information conflicts with the information.

Images