JP2020155036A - Vehicle control circuit, vehicle, and data input/output method - Google Patents

Abstract

To improve convenience of a driver during driving by efficiently performing processing required for utilization of a commodity or service for adaptively improving a state of the driver without hindering safe driving of the driver.SOLUTION: A vehicle control circuit comprises: an input part which inputs a detection result of a state from at least one sensor which is loaded on a vehicle and detects the state of a driver during driving; a recommendation processing part which outputs recommendation data regarding utilization of a commodity or service for improving the state of the driver during driving shown by the detection result to a notification device which is loaded on the vehicle; a settlement processing part which executes settlement processing of the utilization of corresponding commodity or service according to input from the driver to the recommendation data; and a guidance processing part which guides a route to a provision destination of the utilization of the commodity or the service via the notification device on the basis of completion of the settlement processing.SELECTED DRAWING: Figure 1

Description

The present disclosure relates to vehicle control circuits, vehicles and data input / output methods.

Patent Document 1 discloses a technique for providing a service to a customer by processing each of the following in the order of distribution of news for customers, ordering, visiting a store, and serving customers in order to streamline the sales activities of restaurants. ing. In the distribution of news for customers, news for customers with coupons describing the contents of store sales promotion campaigns and the like is distributed from the store terminal to the customer terminal via the ordering support server device and displayed on the customer terminal. In ordering, the order is input to the order screen displayed on the customer terminal by the operation of the customer who understands the contents of the news for the customer, and the order input information is sent to the ordering store terminal via the ordering support server device. Sent. When there is a response from the store terminal to accept the order, the order information is sent to the customer terminal via the ordering support server device and displayed on the customer terminal. At the store visit, the customer who arrives at the desired pick-up date and time displays the two-dimensional barcode in the order information on the customer terminal and presents it to the store staff. In customer service, a two-dimensional barcode is photographed by the camera of the store terminal, and the corresponding order confirmation screen is displayed. When the store staff confirms that the price has been paid through the order confirmation screen, the ordered item is delivered to the customer. The store terminal sends a transaction completion notification to the ordering support server device.

Japanese Unexamined Patent Publication No. 2015-127858

However, in the technique disclosed in Patent Document 1, when a customer performs an order input process, it is premised that the operation is performed while looking at the order screen displayed on the customer terminal. Therefore, for example, in order to enhance the convenience of the driver while driving, the driver applies the technology disclosed in this document to a customer terminal (for example, an in-vehicle device such as a car navigation device or a smartphone owned by the driver). When applied to support the processing of orders for goods, etc., the driver may look away from the front of the vehicle, even temporarily, at the stage of ordering. Therefore, there is a problem that the safe driving of the driver may be hindered.

The present disclosure has been devised in view of the conventional circumstances described above, and efficiently performs the processing necessary for using a product or service for adaptively improving the driver's condition without hindering the safe driving of the driver. It is an object of the present invention to provide a vehicle control circuit, a vehicle, and a data input / output method that improve the convenience of the driver while driving.

The present disclosure is a vehicle control circuit mounted on a vehicle on which a driver rides, and inputs the detection result of the state from at least one sensor mounted on the vehicle and detecting the driving state of the driver. An input unit, a recommended processing unit that outputs recommended data regarding the use of a product or service for improving the driving state of the driver indicated by the detection result to a notification device mounted on the vehicle, and the recommended data. A route to the payment processing unit that executes the payment processing for the use of the corresponding product or service in response to the input from the driver to the destination of the use of the product or service based on the completion of the payment processing. Provide a vehicle control circuit including a guidance processing unit that guides the vehicle via the notification device.

Further, the present disclosure is a vehicle including a vehicle control circuit, at least one sensor for detecting a driving state of a driver, and a notification device, and the vehicle control circuit is in the state from the sensor. An input unit for inputting a detection result, a recommended processing unit for outputting recommended data regarding the use of a product or service for improving the driving state of the driver indicated by the detection result to the notification device, and the recommended data. A route to the payment processing unit that executes the payment processing for the use of the corresponding product or service in response to the input from the driver to the destination of the use of the product or service based on the completion of the payment processing. Provide a vehicle having a guidance processing unit that guides the vehicle via the notification device.

Further, the present disclosure is a data input / output method executed by a vehicle control circuit mounted on a vehicle on which a driver rides, and at least one sensor mounted on the vehicle and detecting a driving state of the driver. Therefore, the detection result of the state is input, and the recommended data regarding the use of the product or service for improving the driving state of the driver indicated by the detection result is output to the notification device mounted on the vehicle. In response to the input from the driver for the recommended data, the payment process for the use of the corresponding product or service is executed, and based on the completion of the payment process, the route to the provider of the use of the product or service is set. , Provide a data input / output method for guiding via the notification device.

According to the present disclosure, it is possible to efficiently perform the processing necessary for using a product or service for adaptively improving the driver's condition without hindering the safe driving of the driver, and to improve the convenience of the driver while driving. Can be improved.

The figure which shows the system configuration example of the vehicle control system including the vehicle which mounted the vehicle control circuit which concerns on Embodiment 1. A diagram showing an example of the inside of a vehicle in front of a vehicle equipped with a vehicle control circuit. Figure showing example of registration contents of recommended table Diagram showing an example of registered contents in the purchase history table A flowchart showing an example of an operation procedure of the vehicle control circuit according to the first embodiment. A diagram showing an example of an image displayed by a display circuit mounted on a vehicle according to the first embodiment and an example of a sound output by a speaker mounted on the vehicle. The figure which shows typically an example of the traveling route which the vehicle which concerns on Embodiment 1 travels.

Hereinafter, embodiments in which the configuration and operation of the vehicle control circuit, vehicle, and data input / output method according to the present disclosure are specifically disclosed will be described in detail with reference to the drawings as appropriate. However, more detailed explanation than necessary may be omitted. For example, detailed explanations of already well-known matters and duplicate explanations for substantially the same configuration may be omitted. This is to avoid unnecessary redundancy of the following description and to facilitate the understanding of those skilled in the art. It should be noted that the accompanying drawings and the following description are provided for those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

<Outline of Embodiment 1>
In the first embodiment, the vehicle control circuit mounted in the vehicle is in a physical condition of the driver while riding in the vehicle (for example, drowsiness, high emotions, poor physical condition (for example, coldness, cough), etc.). Is detected. Based on this detection result, the vehicle control circuit identifies an appropriate product or service to improve the driver's condition indicated by the detection result and recommends it to the driver. When the vehicle control circuit detects the driver's approval operation (for example, the operation of ordering the recommended product by the driver), the vehicle control circuit guides the driver to the payment processing related to the order of the product and the route to the store where the product can be received. .. In this way, the driver can easily receive products that can improve his / her condition by simple operation without looking away from the front even while driving, so the vehicle control circuit is effective for safe driving by the driver. Can be supported.

An example of a product for improving a driver's condition is coffee or an energy drink, which is a caffeinated beverage when the driver is drowsy. If the driver is ill (eg, having a cold, coughing, etc.), a cold or a cold remedy to control the cough can be mentioned. If the driver's emotions are high, gum or soft drinks can be mentioned.

As an example of a service for improving a driver's condition, when the driver is drowsy, warehousing in a parking lot where the vehicle can be parked and rested can be mentioned. If the driver is in poor physical condition (see above), referral to a hospital where he / she can see the doctor immediately can be mentioned. If the driver's emotions are high, relaxing massage and massage can be mentioned.

Needless to say, the products or services for improving the driver's condition are not limited to the above-mentioned examples.

<Vehicle control system configuration>
FIG. 1 is a diagram showing a system configuration example of a vehicle control system 5 including a vehicle 3 on which the vehicle control circuit 11 according to the first embodiment is mounted. The vehicle control system 5 includes a vehicle 3, a server 40, and a store terminal 50. The vehicle 3, the server 40, and the store terminal 50 are connected to each other via the network NW.

The vehicle 3 includes a vehicle control circuit 11, a memory 12, a recording unit 13, a wireless communication circuit 14 to which the antenna An1 is connected, a display circuit 15, an operation circuit 16, a speaker 17, and a GPS receiver 18. including.

The vehicle control circuit 11 is composed of, for example, an ECU (Electronic Control Unit). The vehicle control circuit 11 detects the state of the driver's body surface based on the detection outputs from various sensors (see below) mounted in the vehicle 3. The vehicle control circuit 11 recommends a product (for example, coffee for drowsiness awakening) for improving the driver's condition when, for example, a detection output indicating that the driver is drowsy is acquired from the sensor.

The ECU constituting the vehicle control circuit 11 is specifically configured by using one or more processors, and comprehensively controls the operation of each part of the vehicle 3. The vehicle control circuit 11 specifically realizes and executes various functions by reading the processing program stored in the memory 12 from the memory 12 and executing the vehicle control circuit 11. The processor includes, for example, an MPU (Micro Processing Unit), a CPU (Central Processing Unit), a DSP (Digital Signal Processor), a GPU (Graphical Processing Unit), and the like.

The processor stores the driver's face image captured by the camera 21 in advance, the driver's voice picked up by the microphone 22, and the driver's physical condition in association with each other in the recording unit 13. The recording unit 13 records and holds a template of a face image for each state of the driver, which is prepared in advance to correspond to various states of the driver. The processor determines the state of the driver's body surface based on the degree of similarity between the face image corresponding to this template and the face image actually captured by the camera 21.

Further, the processor performs machine learning such as deep learning in advance as teacher data in which the driver's face image or the driver's voice and the driver's state are associated with each other, which is stored in the recording unit 13, and is used as an input layer of the neural network. , The weighting coefficient of the neurons used in each of the intermediate layer and the output layer may be optimized to generate a trained model used as artificial intelligence. The processor may detect (identify) the state of the driver by inputting either the image captured by the camera 21 or the audio data picked up by the microphone 22 into the trained model.

In addition, the processor similarly performs machine learning such as deep learning in advance as teacher data that associates the driver state with a product or service for improving the driver state, and generates a trained model. May be good. The processor may input the driver's state into this trained model to identify a product or service suitable for the driver's state. When using artificial intelligence, the processor (in other words, the vehicle control circuit 11) can generate a trained model optimized for the driver in the passenger compartment, recommending individual driver-specific state detection and recommended products or services. It is possible.

The memory 12 is configured by using, for example, a RAM (Random Access Memory) and a ROM (Read Only Memory), and temporarily stores a program necessary for executing the operation of the vehicle 3 and data or information generated during the operation. Save to. The RAM is, for example, a work memory used when the vehicle control circuit 11 operates. The ROM stores, for example, a program for controlling the vehicle control circuit 11 in advance. Further, the memory 12 has an image such as an icon for indicating the driver's state (for example, a drowsiness mark indicating a sleepy state) and an image for a product or the like for improving the driver's state (for example, various drawing data such as a coffee mark). Is saved. Further, although the details will be described later with reference to FIG. 6, the memory 12 stores various voice data synthesized in advance for voice output from the speaker 17. In addition, the memory 12 stores information (for example, a personal name, a credit card number, and an expiration date printed on the driver's credit card) necessary for payment processing unique to the driver.

The recording unit 13 is composed of a secondary storage device (for example, HDD (Hard Disk Drive) or SSD (Solid State Drive)) and a tertiary storage device (for example, an optical disk or SD card). The recording unit 13 has a map database 130 that stores information on the road on which the vehicle 3 travels and map data having map information. In FIG. 1, the database is abbreviated as "DB" for convenience. The map data may be acquired in the latest state from the server 40 in which the vehicle control circuit 11 is connected to the network NW via the wireless communication circuit 14, or is map data previously stored in the map database 130. May be good. The recording unit 13 stores a recommendation table Tb1 (see FIG. 3) in which information on various products or services recommended according to the driver's condition is registered. The recording unit 13 stores the purchase history table Tb2 (see FIG. 4) in which the purchase history of the product or service that the driver has processed (that is, purchased) in the past is registered. In addition, the recording unit 13 stores the feature amount of the face image or the feature amount of the voice used for personal authentication of the driver.

The wireless communication circuit 14 performs wireless communication with a server 40 or a store terminal 50 connected to a network NW via an antenna An1 for wireless communication and a wireless base station BS1 provided by a cellular device or the like. That is, the wireless communication circuit 14 can perform wireless communication of data or information with the server 40 or the store terminal 50 by wireless communication. Here, the network NW may include a wide area communication network such as a local area network (LAN), a wide area network (WAN), a mobile network, a power line communication network, and the Internet.

The display circuit 15 as an example of the notification device is composed of a display device such as a liquid crystal display device or an organic EL (Electroluminescence) device. The display circuit 15 may be a single display device, a car navigation device, or a display unit for display audio.

The operation circuit 16 is a touch panel that can be touch-operated by each occupant including the driver. The operation circuit 16 is not limited to the touch panel, and may include input devices such as a mouse, keyboard, and touch pad. The touch panel may be an interface device in which an operation circuit and a display circuit are integrated.

The speaker 17 acoustically outputs, for example, sound in an audible range (frequency band of 20 Hz to 20 kHz). The speaker 17 may be a condenser speaker or a diaphragm speaker. The speaker may be a directional speaker having excellent directivity or an omnidirectional speaker.

The GPS (Global Positioning System) receiver 18 has a GPS antenna, receives signals transmitted from GPS satellites and quasi-zenith satellites, and is in the current position of the vehicle 3 while the ignition of the vehicle 3 is on. Information is constantly acquired and output to the vehicle control circuit 11.

Further, the vehicle 3 includes a camera 21, a microphone 22, a thermo sensor 23, a vehicle operation unit 24, and a steering sensor 25.

The camera 21 as an example of the sensor mounted in the vehicle 3 has a solid-state image sensor such as a CCD (Charged Coupled Devices) or a CMOS (Complementary Metal-Oxide-Semiconductor), and emits light from the subject onto the image pickup surface. An image is formed, the formed optical image is converted into an electric signal, and a video signal is output. The camera 21 outputs the image data of the captured image of the driver to the vehicle control circuit 11. The camera 21 performs predetermined image processing on the captured image of the driver, determines that the driver is in a sleepy state based on, for example, the driver's face image, and determines the determination result (that is, the driver) together with the captured image of the driver. Information indicating that the driver is in a sleepy state) may be output to the vehicle control circuit 11. In this case, the camera 21 may hold a template of the driver's face image and determine the drowsiness state of the driver based on the similarity between the template and the captured face image. Further, the camera 21 determines the drowsiness state of the driver based on the input face image using a learned model in which the face image in which the driver is drowsy is learned by machine learning such as deep learning. You may.

The microphone 22 as an example of the sensor mounted in the vehicle 3 picks up the voice emitted by the driver and outputs the voice data of the picked up voice to the vehicle control circuit 11. The microphone 22 is composed of, for example, a directional microphone having a direction near the driver's face as a directivity direction. The microphone 22 may be a single high-quality compact electret condenser microphone (ECM: Electret Condenser Microphone) or a microphone array composed of a plurality of ECMs.

The vehicle control circuit 11 can determine, for example, whether or not the driver is drowsy based on the sound picked up by the microphone 22. The microphone 22 picks up the voice of "Ah, I want to sleep" that is emitted when yawning, and the voice of "Goo, Goo" that is emitted when I fall asleep momentarily. Even when an occupant other than the driver is drowsy, the drowsiness may be transmitted to the driver, so that the microphone 22 may pick up the sound of the other occupant during drowsiness. In this case, the microphone 22 may be an omnidirectional microphone. Further, the microphone 22 may perform voice recognition on the voice emitted by the driver and output the voice recognition result to the vehicle control circuit 11. For example, it is assumed that the driver uses the microphone 22 to input voice in response to various inquiries and button operations displayed on the display circuit 15 of the vehicle control circuit 11.

The thermosensor 23, which is an example of a sensor mounted in the vehicle 3, senses infrared light emitted from the driver's face or the like, and detects the driver's body temperature based on the color of the infrared light. The thermosensor 23 outputs the detection result of the driver's body temperature to the vehicle control circuit 11. The detection result of the driver's body temperature is used when determining the state of the driver in the vehicle control circuit 11.

The vehicle operation unit 24 as an example of the sensor mounted in the vehicle 3 includes, for example, an accelerator pedal, a brake pedal, a blinker, and the like. The amount of depression of the accelerator pedal, the presence or absence of brake operation, and the state of the blinker switch are input to the vehicle control circuit 11 and are used when determining the state of the driver.

The steering sensor 25 as an example of the sensor mounted in the vehicle 3 detects the steering angle of the steering 29 (see FIG. 2) and outputs it to the vehicle control circuit 11. The vehicle control circuit 11 detects changes in the steering angle and steering angular velocity, and determines the driver's state based on the presence or absence of staggering driving due to sudden steering or unstable steering, which is thought to be caused by, for example, drowsiness or a cold.

The server 40 is configured by using a high-performance computer device, and includes a control circuit 41, a memory 42, a recording unit 43, and a communication circuit 44. The server 40 provides a coupon stored in the store coupon database 431 when sending a coupon that can be used in a store (for example, a coffee shop 58) to the vehicle 3 via the network NW. Further, when the coupon of the store near the current location of the vehicle 3 is not stored in the store coupon database 431, the server 40 inquires at the store terminal 50 via the network NW, obtains the coupon each time, and sends it to the vehicle 3. Good.

In addition, the server 40 communicates with the vehicle 3 via the network NW, and in response to a request from the vehicle 3, in addition to the coupon, a store such as a coffee shop or a pharmacy nearby from the current location of the vehicle 3 The information is specified and taught using the map data stored in the recording unit 13.

The control circuit 41 is composed of, for example, a processor. The control circuit 41 comprehensively controls the operation of each part of the server 40. The control circuit 41 specifically realizes and executes various functions by, for example, a processor reading a processing program stored in the memory 42 from the memory 42 and executing the program. Processors include, for example, MPUs, CPUs, DSPs, GPUs and the like.

The memory 42 is configured by using, for example, RAM and ROM, and temporarily stores a program necessary for executing the operation of the server 40, and data or information generated during the operation. The RAM is, for example, a work memory used when the control circuit 41 operates. The ROM stores, for example, a program for controlling the control circuit 41 in advance.

The recording unit 43 is composed of a secondary storage device (for example, HDD (Hard Disk Drive) or SSD (Solid State Drive)). The recording unit 43 has a store coupon database 431 in which coupons that can be used at each store are registered for each store.

The communication circuit 44 performs wireless communication of data or information between the vehicle 3 connected via the network NW and the wireless base station BS1 and the store terminal 50 connected via the network NW.

The store terminal 50 is an information processing terminal such as a PC (Personal Computer) installed in a store such as a coffee shop 58 or a pharmacy. When an order for using a product or service is received from a vehicle 3 connected via a network NW and a wireless base station BS1, the store terminal 50 processes a predetermined payment with the vehicle 3 on which the driver is riding. I do.

FIG. 2 is a diagram showing an example of the state of the vehicle interior in front of the vehicle 3 on which the vehicle control circuit 11 is mounted. In the vehicle interior, various sensors and the like for detecting the state of the driver hm who looks ahead through the windshield 9 and drives are arranged.

A camera 21, a microphone 22, and a thermosensor 23 are arranged on the rim portion near the shaft of the steering wheel 29, respectively. The camera 21 captures an image of the driver hm near the face. The microphone 22 collects the sound emitted by the driver hm. The thermosensor 23 detects the body temperature near the face of the driver hm. Further, inside the shaft column of the steering 29, a steering sensor 25 (see FIG. 1) for detecting the steering angle of the steering wheel operated by the driver hm is arranged.

Further, a vehicle control circuit 11 is built in the upper part of the center console 7 that separates the driver's seat and the passenger's seat near the dashboard 6. The display circuit 15 capable of displaying various images and the operation circuit 16 for receiving the operation of the driver hm, which are included in the vehicle control circuit 11, are installed so as to be exposed above the center console 7. Further, a drive recorder 27 capable of photographing the front and rear of the vehicle 3 is arranged in the vicinity of the room mirror 8 attached to the upper part of the windshield 9.

FIG. 3 is a diagram showing an example of registered contents of the recommended table Tb1. In the recommended table Tb1, information (for example, a name, a provider of the product or service) regarding a product or service for improving the driver's condition corresponding to the driver's condition is registered in advance. For example, if the driver is drowsy, coffee that is expected to awaken when drunk is registered. Information about a plurality of stores offering coffee may be registered. In addition, nutritional drinks that are expected to give you energy when you drink them are registered. Information about a plurality of shops selling energy drinks may be registered. In addition, information (for example, name, location information) about the parking lot where the driver can take a rest and take a nap is registered.

FIG. 4 is a diagram showing an example of registered contents of the purchase history table Tb2. In the purchase history table Tb2, the purchase history related to the product purchased or the service used by the driver during the past driving is registered and updated. The purchase history includes information about the date and time of purchase, the status of the driver, and the goods purchased or services used. As an example, the history of "October 0th sleepy coffee", "△ month △ day cold remedy", etc. is registered.

<Operation of vehicle control system>
Next, the operation procedure of the vehicle control circuit 11 of the vehicle 3 according to the first embodiment will be described.

FIG. 5 is a flowchart showing an example of an operation procedure of the vehicle control circuit 11 according to the first embodiment. When the ignition is turned on after the driver hm has boarded the vehicle 3, the vehicle control circuit 11 mounted on the vehicle 3 starts the operation (process) shown in FIG.

In FIG. 5, the vehicle control circuit 11 inputs the face image of the driver hm captured by the camera 21. Further, the vehicle control circuit 11 inputs the voice of the driver hm picked up by the microphone 22. The vehicle control circuit 11 authenticates the driver personally based on the input face image and voice (S1).

The vehicle control circuit 11 compares the feature amount of the face image of the driver hm stored in the recording unit 13 with the feature amount of the input face image, and the similarity is a predetermined threshold value (specifically, the face image). It is determined whether or not it is within the threshold value used for determining the feature amount of. Further, the vehicle control circuit 11 compares the voice feature amount of the driver hm registered in the recording unit 13 with the input voice feature amount, and the similarity is a predetermined threshold value (specifically, the voice feature amount). It is determined whether or not it is within the threshold value (threshold value used for feature quantity determination). The vehicle control circuit 11 determines that the result of the personal authentication is approval (OK) when the degree of similarity is within the corresponding threshold value as a result of the determination based on the face image and the voice.

When it is determined that the result is OK as a result of personal authentication, the vehicle control circuit 11 detects the state of the driver hm (S2). Here, as an example, a state in which the driver is drowsy is illustrated, but it goes without saying that the state is not limited to this state. In the vehicle control circuit 11, when the face image captured by the camera 21 includes, for example, an image in which the driver yawns with his mouth wide open or the driver's eyes remain half-open, the driver hm becomes drowsy. Judge that Further, in the vehicle control circuit 11, when the voice picked up by the microphone 22 includes, for example, a voice of "Ah, I want to sleep" or a snoring voice of "Goo, Goo" emitted when I fall asleep momentarily. It is determined that the driver hm is drowsy.

Further, the vehicle control circuit 11 may determine that the driver hm is drowsy when the steering angle detected by the steering sensor 25 shows a change that appears during drowsiness. In addition, as an indicator of the state of the driver hm other than drowsiness, for example, in the vehicle control circuit 11, when the body temperature of the driver hm detected by the thermosensor 23 is as high as 38 ° C. You may judge that.

When the driver is in a drowsy state, the vehicle control circuit 11 displays an image (for example, an icon) showing the driver's state on the display circuit 15 (S3). Further, the vehicle control circuit 11 outputs a default voice (in other words, an announcement voice for notifying the driver) indicating the driver's state from the speaker 17.

FIG. 6 is a diagram showing an example of an image displayed by the display circuit 15 mounted on the vehicle 3 according to the first embodiment and an example of the sound output by the speaker 17 mounted on the vehicle 3. The display circuit 15 displays the drowsiness mark mk1 as an image showing the state in which the driver is drowsy. The drowsiness mark mk1 is an image imitating the face of a sleepy person. In addition, the speaker 17 outputs a voice of "Are you a little sleepy?" As a voice indicating a state in which the driver is drowsy.

The vehicle control circuit 11 displays an image representing a product or service as a measure for improving the driver's condition on the display circuit 15 (S4). Further, the vehicle control circuit 11 outputs a sound indicating a measure for improving the driver's condition from the speaker 17. As an image showing measures for improving the driver's condition, the display circuit 15 displays a coffee mark mk2 representing coffee having an awakening effect. In addition, the speaker 17 outputs a voice of "How about coffee?" As a voice indicating a measure for improving the driver's condition. The speaker 17 may output the voice "The coffee shop will arrive in 1 minute after 300 m". In this case, the vehicle control circuit 11 predicts the approximate distance and arrival time based on the information on the current position of the vehicle 3 and the position of the coffee shop obtained by the GPS receiver 18.

The vehicle control circuit 11 displays the coffee order screen on the display circuit 15. On this order screen, an "usual" order button bt1 and an "another" order button bt2 that can be operated by the driver hm are arranged. The "usual" order button bt1 is a button for selecting the same type of coffee purchased in the past or frequently purchased based on the purchase history table Tb2 of the driver hm. The "another" order button bt2 is a button that selects a recommended type of coffee that has not been purchased in the past or is purchased infrequently, based on the recommended table Tb1. Further, the "usual" order button bt1 is highlighted with the background color being yellow (dot display in the figure) and the character color being black, for example, for the characters "order". On the other hand, the "another" order button bt2 is displayed inconspicuously with the background color being white and the character color being gray. In this way, the vehicle control circuit 11 preferentially displays the products registered in the purchase history table Tb2 over the products registered in the recommended table Tb1. In addition, there are various modes of preferentially displaying, such as changing the size of characters. Further, here, the vehicle control circuit 11 simultaneously displays the products registered in the recommended table Tb1 and the products registered in the purchase history table Tb2. The vehicle control circuit 11 displays the products registered in the purchase history table Tb2 first, and if the order is not made immediately, the vehicle control circuit 11 also displays the products registered in the recommended table Tb1 later, thereby displaying the purchase history table. The products registered in Tb2 may be displayed preferentially.

Further, the vehicle control circuit 11 outputs a voice of "Should I order the usual coffee?" From the speaker 17, and then outputs a voice of "Would you like to order another coffee?". In this way, the vehicle control circuit 11 outputs the product registered in the purchase history table Tb2 by voice first, and outputs the product registered in the recommended table Tb1 by voice later, thereby outputting the purchase history table. The product registered in Tb2 may be preferentially output by voice. In addition, there are various modes in which voice is preferentially output. For example, the vehicle control circuit 11 may output the product registered in the purchase history table Tb2 from the speaker 17 at a louder volume than the product registered in the recommended table Tb1. That is, the speaker 17 outputs the voice of "Would you like to order your usual coffee?" At a loud volume, and outputs the voice of "Would you like another coffee?" At a low volume.

In the vehicle control circuit 11, whether or not the driver hm is prompted by the screen display and the voice output to select the operation circuit 16 to get coffee, that is, the "usual" order button bt1 or the "another" order. It is determined whether or not the button bt2 is pressed (S5). If the driver hm does not select to obtain coffee, the vehicle control circuit 11 ends this process as it is.

On the other hand, when the driver hm selects to obtain coffee via the operation circuit 16 in step S5, the vehicle control circuit 11 orders coffee from the coffee shop and makes a payment for buying and selling coffee (S6). .. This settlement is done automatically at the same time as the order. The vehicle control circuit 11 may settle using a settlement agency that specializes in settlement services. The payment agency can handle various payments such as credit card payments, convenience store payments, carrier payments, and electronic money. Further, the vehicle control circuit 11 may make a credit payment directly with the credit card company. When making a credit card payment, the vehicle control circuit 11 transmits data of a credit number, an expiration date, a name, and a security code via a wireless communication circuit 14. Further, in the case of a store where bar code payment is possible, which has recently started a service, the vehicle control circuit 11 activates a code payment application. The code payment app creates code information, including cash payments for the coffee ordered, and sends it to the store. In this case, the store terminal 50 receives the code information and confirms the payment to the settlement institution. The vehicle control circuit 11 may receive code information sent from the store at the same time as accepting an order for coffee via the wireless communication circuit 14, and may request a payment institution to remit money using this information. Further, as another payment, the vehicle control circuit 11 may make a payment by remittance of virtual currency to the store.

When the settlement is completed, the vehicle control circuit 11 registers the history of the information (date and time, coffee type, state) related to the coffee purchased this time in the purchase history table Tb2 of the driver hm in the purchase history table Tb2.

In this way, when the driver hm presses the "usual" order button bt1 to order the same coffee as usual, the settlement of this order is automatically performed. The operation of the driver hm is simple with only one action. Therefore, the driver hm can drive safely without causing any trouble in the driving operation.

When the payment is completed, the vehicle control circuit 11 automatically sets a travel route to the store selling coffee (S7). In the automatic setting of the travel route, the vehicle control circuit 11 acquires the current position of the vehicle 3 obtained by the GPS receiver 18. The vehicle control circuit 11 reads map data including the current position of the vehicle 3 and the position of the coffee shop from the map database 130 of the recording unit 13. The vehicle control circuit 11 sets an optimum travel route from the current position of the vehicle 3 to the position of the coffee shop on the map data. The vehicle control circuit 11 generates screen data in which the current position of the vehicle 3, the traveling route to the coffee shop, the distance, the arrival time, and the navigation are superimposed on the map data image, and displays the screen data on the display circuit 15. An image in which the vehicle mark cm representing the current position of the vehicle 3 is guided to the store mark sm representing the coffee shop along the traveling route rt11 is superimposed on the map mp displayed on the display circuit 15.

Further, the vehicle control circuit 11 outputs a voice voice from the speaker 17 to guide the progress of the vehicle 3 along the traveling route to the coffee shop. At the start of navigation, the speaker 17 outputs a voice of "start guidance".

In FIG. 6, the information to be notified to the driver hm was both the image displayed by the display circuit 15 and the sound output by the speaker 17, but the image displayed by the display circuit 15 and the sound output by the speaker 17 Either one may be used. Further, the driver hm may select either the image displayed by the display circuit 15 or the sound output by the speaker 17.

FIG. 7 is a diagram schematically showing an example of a traveling route on which the vehicle 3 according to the first embodiment travels. It is assumed that the vehicle 3 driven by the driver hm is traveling toward the destination pf along the traveling route rt0. When the drowsiness of the driver hm is detected by the vehicle control circuit 11 at the position p1 during traveling, the vehicle control circuit 11 changes the traveling route to a detour rud rt1 that stops at the coffee shop 58 according to the navigation guidance. ..

When the vehicle 3 arrives at the coffee shop 58, the driver hm receives the ordered coffee. At this time, the staff on the coffee shop side may provide coffee in the store to the driver hm who entered the store, or may provide coffee by drive-through to the driver hm who is sitting in the driver's seat. ..

In this way, in the vehicle control circuit 11, the driver can receive a product that is effective for improving his / her condition while enforcing safe driving. Conventionally, when using a smartphone to provide a product that is effective for the driver's condition, the driver must launch the smartphone application and stare at the touch panel with a small screen size to operate it, and the driver's condition is detected. And it takes time to order products. In addition, the operation of the smartphone becomes an obstacle to safe driving. On the other hand, in the vehicle control circuit 11 of the present disclosure, the operation is simple without starting the application in advance. If the product recommended by the vehicle control circuit 11 is the usual order, the driver can obtain the recommended product with a single action of pressing a button. Therefore, the driver does not interfere with the driving even while the vehicle is running.

In addition, the vehicle control circuit 11 can guide the vehicle on which the driver rides to a store that provides the product or service recommended to the driver. On the store side, potential demand can be stimulated, customer turnover can be improved, and sales of products or services can be expected to increase. It is also possible to return a part of the increase in profit obtained on the store side to the side that provides the vehicle control system 5.

(Other case 1)
When the vehicle control circuit 11 detects drowsiness of the driver hm, the vehicle control circuit 11 may connect to the server 40 or the store terminal 50 via the network NW and obtain a digital coupon from the server 40 or the store terminal 50. At this time, the vehicle control circuit 11 outputs a voice of "Would you like to order your usual coffee? You can use a sandwich set coupon at a nearby coffee shop at this time." When the driver hm pronounces "I'll ask", the vehicle control circuit 11 acquires the voice recognition result, setstles this order, and then guides the driver hm along the travel route to the coffee shop. ..

The store terminal 50 of the coffee shop 58 acquires the current position of the running vehicle 3 via the network NW, and notifies the staff when the vehicle 3 approaches the store. The staff will prepare hot coffee and sandwiches. When the vehicle 3 arrives at the coffee shop 58, the driver hm can receive hot coffee and sandwiches without waiting. Driver hm wakes up with coffee. In this way, the vehicle control circuit 11 can perform pre-ordering and settlement using coupons. On the store side, we can expect high-priced set sales.

(Other case 2)
When it is detected that the driver has a cold as the driver's condition, the vehicle control circuit 11 may recommend the driver to stop by a pharmacy or go straight to the hospital as a measure for improving the condition.

As described above, the vehicle control circuit 11 of the present embodiment is mounted on the vehicle 3 on which the driver hm rides. The vehicle control circuit 11 (an example of an input unit) is mounted on the vehicle 3 and detects the driving state of the driver hm. The detection result of the driving state of the driver hm, for example, the driver hm causes drowsiness. Input the captured image of the state. The vehicle control circuit 11 (an example of a recommended processing unit) mounts a coffee mark mk2 (an example of recommended data regarding the use of a product or service), which is an image recommending coffee for improving the drowsiness of the driver hm, on the vehicle 3. Output to the display circuit 15 to be displayed. The vehicle control circuit 11 (an example of the payment processing unit) executes the corresponding coffee payment processing in response to the order input from the driver hm for the coffee mark mk2. The vehicle control circuit 11 (an example of a guidance processing unit) displays a travel route rt11 to a store mark sm (an example of a destination for using a product or service) representing a coffee shop based on the completion of payment processing. Display on and guide.

As a result, the vehicle control circuit 11 or the vehicle 3 can efficiently perform the processing necessary for using the product or service for adaptively improving the driver's condition without hindering the safe driving of the driver, and is driving. It is possible to improve the convenience of the driver in.

Further, the vehicle control circuit 11 is connected between the recording unit 13 that records the recommended table Tb1 showing the correspondence between the driving state of the driver hm and the coffee recommended according to this state. Based on the recommended table Tb1, the vehicle control circuit 11 generates a coffee mark mk2 that recommends coffee for improving the drowsiness of the driver hm corresponding to the detection result of the driving state of the driver hm. This allows the driver to immediately notice what to do to improve his drowsiness.

Further, the vehicle control circuit 11 stores the purchase history in which the purchase and date / time (information about the product or service) of the coffee that has been settled and the drowsiness state of the driver are associated with the purchase history table Tb2 stored in the recording unit 13. Record. The vehicle control circuit 11 generates the "usual" order button bt1 corresponding to the drowsiness state of the driver based on the purchase history table Tb2 in preference to the recommended table Tb1. This allows the driver to easily order and settle coffee with a single action of pressing the "usual" order button bt1. Therefore, the driver can order coffee and drive safely without disturbing the driving operation.

Further, the vehicle control circuit 11 as an example of the state notification unit notifies the driver hm of the detection result of the state of the driver hm via at least one of the display circuit 15 and the speaker 17. As a result, the driver can notice changes in his / her physical condition such as drowsiness and a cold. The driver can drive according to his / her physical condition.

Further, the vehicle control circuit 11 inputs information from the camera 21 that the driver hm is in a sleepy state as a state based on the captured image of the driver hm. As a result, the vehicle control circuit 11 can grasp that the driver hm is in a drowsy state based on the captured image. In addition, the vehicle control circuit 11 can immediately take measures when the driver hm is in a drowsy state. Therefore, dangerous driving in which the driver drives in a sleepy state is avoided.

Further, the vehicle control circuit 11 inputs information indicating that the driver hm is in a sleepy state as a state based on the voice of the driver hm picked up by the microphone 22. As a result, the vehicle control circuit 11 can grasp that the driver is in a drowsy state based on the voice uttered by the driver. In addition, the vehicle control circuit 11 can immediately take measures when the driver is in a drowsy state. Therefore, dangerous driving in which the driver drives in a sleepy state is avoided.

Further, the vehicle control circuit 11 outputs the drawing data of the drowsiness mark mk1 to the display circuit 15 connected to the vehicle control circuit 11 and displays it on the display circuit 15. This allows the driver to visually notice his drowsiness.

Further, the vehicle control circuit 11 outputs voice data to the speaker 17 connected to the vehicle control circuit 11, and causes the speaker 17 to output the voice of "Are you a little sleepy?". This allows the driver to audibly notice his drowsiness.

Further, the vehicle control circuit 11 is connected to the recording unit 13 that stores the map DB 130 in which the map data is registered (recorded). The vehicle control circuit 11 uses the map data registered in the map DB 130 to guide the travel route rt11 to the coffee shop that provides coffee (the destination of the use of the product or service) by image or voice by the navigation function. .. As a result, the driver hm can drive to the coffee shop according to the guided driving route with the same feeling as the car navigation that he is accustomed to. Therefore, the driver hm can drive safely.

Although the embodiments have been described above with reference to the drawings, it goes without saying that the present disclosure is not limited to such examples. It is clear that a person skilled in the art can come up with various modification examples, modification examples, replacement examples, addition examples, deletion examples, and equal examples within the scope of claims. It is understood that it naturally belongs to the technical scope of the present disclosure. Further, each component in the above-described embodiment may be arbitrarily combined as long as the gist of the invention is not deviated.

For example, in the first embodiment described above, the vehicle control circuit 11 has shown a case where the vehicle control circuit 11 detects the driver's condition and provides a product or service for improving the driver's condition. On the other hand, the same operation may be performed.

Further, in the above-described first embodiment, the driver ordered the recommended product by touching the operation circuit with a finger, but when the vehicle control circuit is equipped with the voice recognition function, the finger is used. You may order the product by voice input without touch operation.

The present disclosure efficiently performs the processing necessary for using products or services for adaptively improving the driver's condition without hindering the safe driving of the driver, and improves the convenience of the driver while driving. It is useful as a vehicle control circuit, vehicle and data input / output method.

3 Vehicle 5 Vehicle control system 11 Vehicle control circuit 12 Memory 13 Recording unit 14 Wireless communication circuit 15 Display circuit 16 Operation circuit 17 Speaker 18 GPS receiver 21 Camera 22 Microphone 23 Thermo sensor 24 Vehicle operation unit 25 Steering sensor 40 Server 50 Store Terminal 130 Map database NW network

Claims (11)

It is a vehicle control circuit mounted on the vehicle on which the driver rides.
An input unit that inputs the detection result of the state from at least one sensor mounted on the vehicle and detecting the driving state of the driver.
A recommended processing unit that outputs recommended data regarding the use of products or services for improving the driving state of the driver indicated by the detection result to the notification device mounted on the vehicle.
A payment processing unit that executes payment processing for the use of the corresponding product or service in response to input from the driver to the recommended data.
A guidance processing unit that guides a route to a destination of use of the product or service based on the completion of the payment processing via the notification device is provided.
Vehicle control circuit. It is connected between the driving state of the driver and a recording unit that records a recommendation table showing the correspondence between the recommended product or service according to the state.
The recommended processing unit generates the recommended data regarding the use of the product or service corresponding to the detection result based on the recommended table.
The vehicle control circuit according to claim 1. The payment processing unit records in the recording unit a purchase history in which information about the product or service for which payment processing has been processed and the detection result are associated with each other.
The recommended processing unit generates the recommended data regarding the use of the product or service corresponding to the detection result based on the purchase history in preference to the recommended table.
The vehicle control circuit according to claim 2. A state notification unit for notifying the driver of the detection result of the state is further provided.
The vehicle control circuit according to claim 1. The input unit inputs information from the camera as the sensor to the effect that the driver is in a sleepy state as a state based on the captured image of the driver.
The vehicle control circuit according to claim 1. The input unit inputs information to the effect that the driver is in a sleepy state as a state based on the voice of the driver from the microphone as the sensor.
The vehicle control circuit according to claim 1. The recommended processing unit outputs the recommended data to the notification device connected to the vehicle control circuit and displays it on the notification device.
The vehicle control circuit according to claim 1. The recommended processing unit outputs the recommended data to a speaker connected to the vehicle control circuit and causes the speaker to output voice.
The vehicle control circuit according to claim 1. It is connected to the recording unit that records map data,
The guidance processing unit uses the map data to guide the route to the destination of the use of the product or service via an image or voice.
The vehicle control circuit according to claim 1. Vehicle control circuit and
At least one sensor that detects the driver's driving condition,
A vehicle equipped with a notification device
The vehicle control circuit
An input unit that inputs the detection result of the state from the sensor, and
A recommended processing unit that outputs recommended data regarding the use of products or services for improving the driving state of the driver indicated by the detection result to the notification device, and
A payment processing unit that executes payment processing for the use of the corresponding product or service in response to input from the driver to the recommended data.
It has a guidance processing unit that guides a route to a destination of use of the product or service via the notification device based on the completion of the payment processing.
vehicle. A data input / output method executed by a vehicle control circuit mounted on a vehicle on which a driver rides.
The detection result of the state is input from at least one sensor mounted on the vehicle and detecting the driving state of the driver.
The recommended data regarding the use of the product or service for improving the driving state of the driver indicated by the detection result is output to the notification device mounted on the vehicle.
In response to the input from the driver for the recommended data, the payment process for the use of the corresponding product or service is executed.
Based on the completion of the payment process, the route to the provider of the use of the product or service is guided via the notification device.
Data input / output method.

Images