KR20230140642A - Apparatus and method for providing an in-vehicle interface - Google Patents

Abstract

This disclosure relates to a method and device for providing an in-vehicle interface. The method according to an embodiment of the present disclosure may provide a first interface before the vehicle starts driving, a second interface after the vehicle starts driving, and a third interface after the vehicle is completed.

Description

Apparatus and method for providing an in-vehicle interface {APPARATUS AND METHOD FOR PROVIDING AN IN-VEHICLE INTERFACE}

The present invention relates to an apparatus and method for providing an in-vehicle interface.

Smartization of vehicles is rapidly progressing due to the convergence of information and communication technology and the vehicle industry. Due to smartization, vehicles are evolving from simple mechanical devices to smart cars, and in particular, autonomous driving is attracting attention as a core technology for smart cars. Autonomous driving is a technology that allows a vehicle to reach its destination on its own without the driver having to operate the steering wheel, accelerator pedal, or brakes.

Additionally, with the development of IT technology, infotainment is emerging as a big issue in daily life. Infotainment is a compound word of information and entertainment, and refers to a phenomenon or strategy that combines information and fun.

These infotainment functions not only combine in-vehicle navigation, audio and video, and the Internet, but also, with the recent popularization of smartphones and tablet PCs and the development of information technology (IT), mobile office, smart navigation, vehicle tracking, gesture recognition, and vehicle tracking. The area is expanding to include interconnection communication (V2V) and cloud access.

Recently, there has been a demand for research into ways to combine autonomous driving technology and infotainment functions.

The above-mentioned background technology is technical information that the inventor possessed for deriving the present invention or acquired in the process of deriving the present invention, and cannot necessarily be said to be known art disclosed to the general public before filing the application for the present invention.

The present invention provides an apparatus and method for providing an in-vehicle interface. The problem to be solved by the present invention is not limited to the problems mentioned above, and other problems and advantages of the present invention that are not mentioned can be understood through the following description and can be understood more clearly through the examples of the present invention. It will be. In addition, it can be seen that the problems and advantages to be solved by the present invention can be realized by the means and combinations thereof indicated in the patent claims.

As a technical means for achieving the above-described technical problem, a first aspect of the present disclosure is a method of providing an in-vehicle interface in a device, comprising: providing a first interface before the vehicle starts driving; providing a second interface after the vehicle starts driving; and providing a third interface after completion of driving of the vehicle, wherein providing the first interface includes providing an authentication interface through which the passenger can authenticate himself or herself. And after authenticating the passenger, providing a reservation information interface that displays the origin, departure time, destination, and arrival time included in the reservation information of the authenticated passenger; including, providing the second interface. Providing a driving road interface that displays the road on which the vehicle is traveling and information on other vehicles around the vehicle recognized from a sensor mounted on the vehicle; and providing the driving road interface with a message notifying that the driving mode of the vehicle has been switched from the automatic driving mode to the manual driving mode in response to the vehicle entering a predetermined road section. 3. The step of providing an interface may provide a method including providing an arrival information interface that provides information on the total travel time and destination information required to travel from the departure point to the destination point.

A second aspect of the present disclosure is a device that provides an in-vehicle interface, wherein the device includes: a memory storing at least one program; and a processor that performs an operation by executing the at least one program, wherein the processor provides a first interface before the vehicle starts driving and a second interface after the vehicle starts driving. After completing the driving, a third interface is provided, and in the process of providing the first interface, the processor provides an authentication interface through which the passenger can authenticate himself, and after authenticating the passenger, the authenticated passenger Provides a reservation information interface that displays the origin, departure time, destination, and arrival time included in the reservation information, and in the process of providing the second interface, the road on which the vehicle is traveling and the sensor mounted on the vehicle Provides a driving road interface that displays information on other vehicles around the recognized vehicle, and notifies that the driving mode of the vehicle has been switched from the automatic driving mode to the manual driving mode in response to the vehicle entering a predetermined road section. Provides a device that provides the driving road interface on which a message is displayed, and in the process of providing the third interface, provides an arrival information interface that provides information on the total travel time and destination information required to travel from the origin to the destination. can do.

A third aspect of the present disclosure may provide a computer-readable recording medium recording a program for executing the method according to the first aspect on a computer.

In addition, another method for implementing the present invention, another system, and a computer-readable recording medium storing a computer program for executing the method may be further provided.

Other aspects, features and advantages in addition to those described above will become apparent from the following drawings, claims and detailed description of the invention.

According to the problem solving means of the present disclosure described above, the present disclosure can improve the convenience of passengers using the vehicle by providing infotainment services to electronic devices centered on passengers riding in the vehicle.

1 to 3 are diagrams for explaining an autonomous driving method according to an embodiment.
4 is an exemplary diagram of an authentication interface provided to a passenger before the vehicle starts driving according to an embodiment.
Figure 5 shows a reservation information interface provided to passengers before the vehicle starts driving according to an embodiment.
FIG. 6 is an exemplary diagram of a driving road interface provided to passengers while driving a vehicle according to an embodiment.
FIG. 7 is another exemplary diagram of a driving road interface provided to passengers while driving a vehicle according to an embodiment.
FIG. 8 is an exemplary diagram of an entertainment interface provided to passengers while driving a vehicle according to an embodiment.
FIG. 9 is an exemplary diagram of a driving road interface displaying restaurant information around a driving route according to an embodiment.
10 is an exemplary diagram of a menu ordering interface according to an embodiment.
11 is an exemplary diagram of a control interface provided to passengers while driving a vehicle according to an embodiment.
FIG. 12 is a flowchart illustrating a method of providing an in-vehicle interface according to an embodiment.
Figure 13 is a block diagram of an interface providing device according to an embodiment.

The advantages and features of the present invention and methods for achieving them will become clear by referring to the embodiments described in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments presented below, but may be implemented in various different forms, and should be understood to include all conversions, equivalents, and substitutes included in the spirit and technical scope of the present invention. . The embodiments presented below are provided to ensure that the disclosure of the present invention is complete and to fully inform those skilled in the art of the scope of the invention. In describing the present invention, if it is determined that a detailed description of related known technologies may obscure the gist of the present invention, the detailed description will be omitted.

The terms used in this application are only used to describe specific embodiments and are not intended to limit the invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as “comprise” or “have” are intended to designate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, but are not intended to indicate the presence of one or more other features. It should be understood that this does not exclude in advance the possibility of the existence or addition of elements, numbers, steps, operations, components, parts, or combinations thereof.

Some embodiments of the present disclosure may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented in various numbers of hardware and/or software configurations that perform specific functions. For example, the functional blocks of the present disclosure may be implemented by one or more microprocessors, or may be implemented by circuit configurations for certain functions. Additionally, for example, functional blocks of the present disclosure may be implemented in various programming or scripting languages. Functional blocks may be implemented as algorithms running on one or more processors. Additionally, the present disclosure may employ prior art for electronic environment setup, signal processing, and/or data processing, etc. Terms such as “mechanism,” “element,” “means,” and “configuration” will be used broadly. It can be done and is not limited to mechanical and physical configurations.

Additionally, connection lines or connection members between components shown in the drawings merely exemplify functional connections and/or physical or circuit connections. In an actual device, connections between components may be represented by various replaceable or additional functional connections, physical connections, or circuit connections.

Hereinafter, 'vehicle' may refer to any type of transportation used to move people or objects with engine, such as a car, bus, motorcycle, kickboard, or truck.

Hereinafter, the present disclosure will be described in detail with reference to the attached drawings.

1 to 3 are diagrams for explaining an autonomous driving method according to an embodiment.

Referring to FIG. 1, the autonomous driving device according to an embodiment of the present invention can be mounted on a vehicle to implement an autonomous vehicle 10. The autonomous driving device mounted on the autonomous vehicle 10 may include various sensors for collecting surrounding situation information. For example, the autonomous driving device may detect the movement of the preceding vehicle 20 running in front through an image sensor and/or an event sensor mounted on the front of the autonomous vehicle 10. The self-driving device may further include sensors for detecting not only the front of the self-driving vehicle 10, but also other driving vehicles 30 running in the lane next to the self-driving vehicle 10 and pedestrians around the self-driving vehicle 10.

At least one of the sensors for collecting situational information around the autonomous vehicle may have a predetermined field of view (FoV), as shown in FIG. 1 . For example, when a sensor mounted on the front of the autonomous vehicle 10 has a field of view (FoV) as shown in FIG. 1, information detected at the center of the sensor may have relatively high importance. This may be because the information detected at the center of the sensor includes most of the information corresponding to the movement of the preceding vehicle 20.

The self-driving device processes information collected by the sensors of the self-driving vehicle 10 in real time to control the movement of the self-driving vehicle 10, while storing at least some of the information collected by the sensors in a memory device. .

Referring to FIG. 2, the autonomous driving device 40 may include a sensor unit 41, a processor 46, a memory system 47, and a vehicle body control module 48. The sensor unit 41 includes a plurality of sensors 42-45, and the plurality of sensors 42-45 may include an image sensor, an event sensor, an illumination sensor, a GPS device, an acceleration sensor, etc.

Data collected by sensors 42-45 may be transmitted to processor 46. The processor 46 stores the data collected by the sensors 42-45 in the memory system 47 and controls the vehicle body control module 48 based on the data collected by the sensors 42-45 to control the vehicle body control module 48. movement can be determined. The memory system 47 may include two or more memory devices and a system controller for controlling the memory devices. Each of the memory devices may be provided as one semiconductor chip.

In addition to the system controller of the memory system 47, each of the memory devices included in the memory system 47 may include a memory controller, and the memory controller may include an artificial intelligence (AI) operation circuit such as a neural network. The memory controller may generate calculation data by assigning a predetermined weight to data received from the sensors 42 - 45 or the processor 46 and store the calculation data in a memory chip.

Figure 3 is a diagram showing an example of image data acquired by a sensor of an autonomous vehicle equipped with an autonomous driving device. Referring to FIG. 3, image data 50 may be data acquired by a sensor mounted on the front of an autonomous vehicle. Therefore, the image data 50 may include the front part 51 of the autonomous vehicle, the preceding vehicle 52 in the same lane as the autonomous vehicle, the vehicles 53 and the background 54 around the autonomous vehicle. .

In the image data 50 according to the embodiment shown in FIG. 3, the data in the area where the front part 51 and the background 54 of the autonomous vehicle appear are data that are unlikely to affect the operation of the autonomous vehicle. It can be. In other words, the front 51 and background 54 of the autonomous vehicle can be considered data with relatively low importance.

On the other hand, the distance to the preceding vehicle 52 and the lane change movement of the driving vehicle 53 may be very important factors in the safe operation of an autonomous vehicle. Accordingly, in the image data 50, data in an area including the preceding vehicle 52 and the driving vehicle 53 may have relatively high importance in the operation of the autonomous vehicle.

The memory device of the autonomous driving device may store the image data 50 received from the sensor by assigning different weights to each region. For example, a high weight is given to data in an area that includes the preceding vehicle 52 and the driving vehicle 53, and a low weight is given to data in an area where the front 51 and background 54 of an autonomous vehicle appear. can be given.

4 is an exemplary diagram of an authentication interface provided to a passenger before the vehicle starts driving according to an embodiment.

Users can call a vehicle to travel from the departure point to the destination. When the called vehicle arrives at the departure location, the user boards the vehicle, and after boarding the vehicle, the user may be referred to as a passenger.

A device that provides an interface (hereinafter referred to as an 'interface providing device') can provide various interfaces necessary for passengers before, during, and after the vehicle starts driving. The interface providing device may provide an interface to the passenger through a display placed in the vehicle, or may provide the interface to the passenger through the passenger's terminal (eg, a smartphone). Passengers can interact with the interface provided by the interface providing device.

The interface providing device may provide the first interface 400 before the vehicle starts driving. The first interface 400 may include an authentication interface 410.

Referring to FIG. 4, before the vehicle starts driving from the origin to the destination, the interface providing device may provide an authentication interface 410 to confirm whether the passenger corresponds to the user who called the vehicle.

The interface providing device may request the passenger to input a unique identifier through the authentication interface 410. The unique identifier may be information entered in advance by the passenger before calling the vehicle, or information on the last digits of the passenger's mobile number or date of birth of the passenger that can be obtained from passenger information, but is not limited thereto.

The interface providing device can use the unique identifier entered by the passenger to determine whether the passenger corresponds to the user who called the vehicle. When the passenger corresponds to the user who called the vehicle, the interface providing device may provide a message indicating to start driving to the driver terminal. If the passenger does not respond to the user who called the vehicle, the interface providing device may provide a message indicating not to start driving to the driver terminal.

The first interface 400 may include a boarding conditions interface 420.

The boarding conditions may include first boarding conditions applied according to the vehicle operation policy. For example, the first boarding condition may include CCTV filming conditions, mask wearing conditions, and eating prohibition conditions.

Additionally, the boarding condition may include a second boarding condition requested by the passenger. For example, the second boarding condition may include an air conditioner operation condition, a heater operation condition, and a conversation prohibition condition. The second boarding condition may be a condition preset by the relevant passenger. Alternatively, the passenger may set new or change the second boarding condition by interacting with the boarding condition interface 420.

In one embodiment, the passenger may request a change to the first boarding conditions. If the first boarding condition that the passenger has requested to change is a required condition, the interface providing device may apply the previously set first boarding condition despite the change request. On the other hand, when the first boarding condition that the passenger requests to change is a selection condition, the interface providing device can apply the changed first boarding condition. For example, among the first boarding conditions, the wearing of a mask condition may be a mandatory condition, and the CCTV shooting condition may be an optional condition. In this case, the interface providing device can change the CCTV shooting conditions from filming to not filming in response to a request to change the CCTV filming conditions.

Meanwhile, depending on the vehicle operation policy, certain boarding conditions may be required or optional.

5 is an exemplary diagram of a reservation information interface provided to passengers before the vehicle starts driving according to an embodiment.

The interface providing device may provide the first interface 500 before the vehicle starts driving. The first interface 500 may include a reservation information interface 510.

In one embodiment, in response to determining that the passenger corresponds to the user who called the vehicle in the authentication interface 410 of FIG. 4, the interface providing device may provide the reservation information interface 510 to the passenger.

The interface providing device may display the departure location, departure time, arrival location, and arrival time included in the reservation information of the authenticated passenger through the reservation information interface 510. Additionally, the interface providing device can display the time required, guidance information, etc. through the reservation information interface 510.

The first interface 500 may include a departure confirmation interface 520.

Passengers can check the information entered at the time of reservation for the displayed vehicle through the reservation information interface 510. If the reservation information in the reservation information interface 510 is accurate, the passenger can request vehicle departure by interacting with the departure confirmation interface 520. The interface providing device may convert the provided interface from the first interface 500 to the second interface in response to receiving the passenger's input through the departure confirmation interface 520.

FIG. 6 is an exemplary diagram of a driving road interface provided to passengers while driving a vehicle according to an embodiment.

The interface providing device may provide the second interface 600 while the vehicle is driving after the vehicle starts driving. The second interface 600 may include a driving road interface 610.

Referring to FIG. 6, a driving road interface 610 may be provided that displays the road on which the vehicle is traveling and objects around the vehicle recognized from sensors mounted on the vehicle. Objects around the vehicle may include other vehicles, pedestrians, traffic lights, crosswalks, etc.

In one embodiment, the vehicle may drive in various driving modes. Driving modes may include automatic driving mode and manual driving mode. In autonomous driving mode, the vehicle can drive along a set route without separate control from the driver by the autonomous driving device. In manual driving mode, the vehicle can be driven under the control of the driver.

The driving mode of the vehicle may be switched from the automatic driving mode to the manual driving mode in response to entering a predetermined road section while the vehicle is driving in the automatic driving mode. The interface providing device may provide a driving road interface 610 on which a message 620 notifying that the driving mode of the vehicle has been switched from the automatic driving mode to the manual driving mode is displayed.

Additionally, the driving mode of the vehicle may be switched from the manual driving mode to the automatic driving mode in response to passing a predetermined road section while the vehicle is driving in the manual driving mode. The interface providing device may provide a driving road interface 610 on which a message notifying that the driving mode of the vehicle has been switched from the manual driving mode to the automatic driving mode is displayed.

Meanwhile, the message 620 may include information about the reason for switching from the automatic driving mode to the manual driving mode. For example, the message 620 may include information that the vehicle's driving mode has been switched from the automatic driving mode to the manual driving mode as the vehicle enters the child protection zone. Additionally, the message 620 may include information about the remaining time and remaining distance until entering a predetermined road section where the vehicle's driving mode is switched from the automatic driving mode to the manual driving mode. For example, the message 620 may include information that there are 5 seconds left or 200 meters left until the vehicle enters the child protection zone. For example, the interface providing device can predict the remaining distance until entering a predetermined section and provide a guidance message 200m before entering as visual and auditory information.

In the present disclosure, passengers are notified through an interface of at least one of whether the vehicle's driving mode is switched, the reason for driving mode switching, and the remaining time/distance until driving mode switching, so that passengers can more accurately perceive the driving situation. You can.

FIG. 7 is another exemplary diagram of a driving road interface provided to passengers while driving a vehicle according to an embodiment.

The interface providing device may provide the second interface 700 while the vehicle is driving after the vehicle starts driving. The second interface 700 may include a driving road interface.

At least one of a lane-level driving path 710 and a road-level driving path 720 may be displayed on the driving road interface.

Referring to FIG. 7 , a lane-level driving path 710 is displayed on the left side of the driving road interface, and a road-level driving path 720 is displayed on the right side.

The driving path 710 at the lane level may display the lane in which the vehicle is currently traveling among a plurality of lanes included in the road and objects around the vehicle recognized from sensors mounted on the vehicle. Objects around the vehicle may include other vehicles, pedestrians, traffic lights, crosswalks, etc. In the lane-level driving path 710, the path on which the vehicle is traveling and the path on which it is scheduled to travel may be displayed at the lane level.

The driving path 720 at the road level may display the starting point, current location, destination, travel route from the starting point to the destination, and travel route from the current location to the destination at the road level.

In one embodiment, a widget 721 may be included in the road-level driving path 720. The interface providing device may display the widget 721 on the road level driving path 720 according to default settings. Alternatively, the interface providing device may determine at least one of information, number, and arrangement structure included in the widget 721 based on the passenger's settings. For example, as a function that provides information user convenience included in the widget 721, functions such as weather, overall route, and sound can be provided.

FIG. 8 is an exemplary diagram of an entertainment interface provided to passengers while driving a vehicle according to an embodiment.

The interface providing device may provide the second interface 800 while the vehicle is driving after the vehicle starts driving. The second interface 800 may include an entertainment interface 810.

The interface providing device can provide various entertainment information that passengers can enjoy in the vehicle, such as movies, dramas, games, and music, through the entertainment interface 810.

In one embodiment, the interface providing device may provide an entertainment interface 810 that recommends customized entertainment information based on passenger information. Passenger information may include biographical information such as the passenger's age and gender. Specifically, the interface providing device can recommend videos/games that are popular according to the passenger's age and gender through the entertainment interface 810. Additionally, passenger information may include preferred entertainment information stored by the passenger. The interface providing device can recommend videos/games corresponding to the passenger's preferred category through the entertainment interface 810. Additionally, the passenger information may include the passenger's entertainment history information. The interface providing device can recommend videos that the passenger has watched in the past or games that the passenger has played through the entertainment interface 810.

In another embodiment, the interface providing device may provide an entertainment interface 810 that recommends customized entertainment information based on the passenger's reservation information. Reservation information may include origin, departure time, destination, and arrival time. Specifically, the interface providing device may recommend different entertainment information through the entertainment interface 810 depending on whether the departure time/arrival time is morning/morning/afternoon/evening/midnight. Additionally, the interface providing device may recommend entertainment information through the entertainment interface 810 by considering the time it takes to arrive at the destination from the current location. For example, if the time required is 1 hour, the interface providing device may recommend a video with a running time of 1 hour through the interface 810. Additionally, the interface providing device can recommend different entertainment information through the entertainment interface 810 depending on whether the destination is home/work/travel.

In another embodiment, the interface providing device may provide an entertainment interface 810 that recommends customized entertainment information based on vehicle driving information. Driving information may include information about the driving road, information about traffic conditions, etc. Specifically, the interface providing device may recommend different entertainment information through the entertainment interface 810 depending on whether the current driving road is a highway/general road. Additionally, the interface providing device can recommend video/music with a calm sensibility when there is heavy traffic, and can recommend video/music with an exciting sensibility when traffic is smooth.

Meanwhile, the interface providing device may provide an entertainment interface 810 that recommends customized entertainment information based on at least one of the passenger information, the passenger reservation information, and the vehicle driving information. Additionally, the interface providing device can set different weights between passenger information, reservation information, and driving information, and recommend more customized entertainment information based on criteria with higher weights.

FIG. 9 is an exemplary diagram of a driving road interface displaying restaurant information around a driving route according to an embodiment.

The interface providing device may provide the second interface 900 while the vehicle is driving after the vehicle starts driving. The second interface 900 may include a driving road interface.

The driving road interface may display information about restaurants around the driving route. The driving road interface displays the lane-level driving path 910 and the road-level driving path 920, and restaurant information around the driving path is displayed among the lane-level driving path 910 and the road-level driving path 920. Can be displayed in at least one. Referring to FIG. 9, restaurant information around the driving route is displayed on the driving route 920 at the road level.

Alternatively, the passenger may interact with the second interface 900 and adjust the display size of the lane-level driving route 910 and the road-level driving route 920, and depending on the display size, restaurant information around the driving route may be displayed in the lane-level driving route 910. It may be displayed on the driving path 910 at the level or the driving path 920 at the road level.

In one embodiment, information on restaurants around the driving route may be displayed on the driving road interface based on the passenger's input. For example, passengers can input their order intention, restaurant category, restaurant name, etc. by voice or text. The interface providing device may determine restaurants around the driving route corresponding to the input voice or text, and provide a driving road interface displaying information about the determined restaurants.

In one embodiment, the interface providing device may display information on restaurants in which the additional time required to arrive at the destination when passing through a restaurant is less than or equal to a standard value, on the driving road interface. For example, when passing through a restaurant, information about restaurants that require an additional time of 5 minutes or less to reach the destination can be displayed on the driving road interface. The standard value can be changed by the passenger.

The interface providing device selects a plurality of restaurants around the driving route from the departure point to the destination. Input from passengers selecting a certain restaurant can be received. Additionally, the interface providing device may provide passengers with a menu display interface that displays menus sold at the selected restaurant. The interface providing device may receive an input from a passenger who selects at least one menu from the selected restaurant.

The interface providing device may inform the passenger of at least one of the additional time required for passing through the selected restaurant, the additional travel distance, and the additional payment amount. Additionally, the interface providing device may inform the passenger of at least one of the additional time required for ordering the selected menu, the additional travel distance, and the additional payment amount. The interface providing device may determine the additional time required or additional payment amount for ordering the selected menu based on the cooking time of the selected menu and inform the passenger of this.

In response to receiving an input from the passenger authorizing stopping at the selected restaurant, the interface providing device may display the selected restaurant as a stopping point on the driving road interface. Additionally, in response to receiving an input authorizing ordering of the selected menu from the passenger, the interface providing device may order the selected menu.

Meanwhile, the interface providing device can check the category of the restaurant selected by the passenger. In one embodiment, the restaurant may be a first category or a second category restaurant. Restaurants in the first category correspond to restaurants where passengers can receive the food they ordered while on board the vehicle without getting off the vehicle, and restaurants in the second category correspond to restaurants where passengers can receive the food they ordered after getting off the vehicle.

If the restaurant selected by the passenger is a restaurant of the second category, the interface providing device may check possible stopping points around the selected restaurant and provide a driving road interface displaying possible stopping points.

Meanwhile, in FIG. 9, the driving road interface that displays information on restaurants around the driving route is explained. However, in the driving road interface, in addition to restaurants, information on various destinations such as gas stations and shopping malls may be displayed according to the passenger's request. In FIG. 9, The above can be equally applied to various destinations.

10 is an exemplary diagram of a menu ordering interface according to an embodiment.

The interface providing device may provide the second interface 1000 while the vehicle is driving after the vehicle starts driving. The second interface 1000 may include a menu order interface 1010.

Based on the passenger's input, information on restaurants around the driving route may be displayed on the driving road interface. For example, passengers can input their order intention, restaurant category, restaurant name, etc. by voice or text.

In one embodiment, the interface providing device compares the time it takes to arrive at a restaurant around the driving route from the current location of the vehicle with the spare time available for ordering for each restaurant, and provides information on restaurants where the spare time is longer than the required time. It can be provided through the menu order interface 1010 or the driving road interface. For example, the available ordering time for each restaurant may be set to the average cooking time, or may vary depending on the menu the passenger wishes to order.

The interface providing device may provide a menu ordering interface 1010 through which passengers can select a menu to order at a restaurant and proceed with an in-app payment for the selected menu. The interface providing device may receive payment information from the passenger when ordering a menu, or may process payment using the passenger's previously stored payment information.

Alternatively, the interface providing device may execute the application of the selected restaurant in response to the passenger selecting a restaurant, thereby allowing the passenger to order and pay for the menu through the restaurant application.

11 is an exemplary diagram of a control interface provided to passengers while driving a vehicle according to an embodiment.

The interface providing device may provide the second interface 1100 while the vehicle is driving after the vehicle starts driving. The second interface 1100 may include a control interface.

Passengers can interact with the control interface to create an environment inside the vehicle that makes them feel more comfortable while driving. The control interface may include an air conditioning control interface 1110, an audio control interface 1120, and a lighting control interface (not shown), but the types of interfaces included in the control interface are not limited to the above-described examples.

In one embodiment, the interface providing device may recommend customized controls for air conditioning/sound/lighting/seats based on passenger information. Customized control may mean providing personalized customization features and controlling each setting. Passenger information may include biographical information such as the passenger's age and gender. For example, the interface providing device may recommend songs that are popular for the passenger's age and gender through the sound control interface 1120. Alternatively, the interface providing device may recommend the vehicle interior temperature considering the age and gender of the passengers through the air conditioning control interface 1110.

In another embodiment, the interface providing device may recommend customized controls for air conditioning/sound/lighting/seats based on the passenger's reservation information. Reservation information may include origin, departure time, destination, arrival time, weather, etc. For example, the interface providing device recommends appropriate lighting brightness for each time zone through a lighting control interface (not shown), depending on whether the departure time/arrival time is morning/morning/afternoon/evening/midnight, or recommends appropriate lighting brightness for each time zone through a sound control interface (1120). ), you can recommend appropriate songs for each time zone. Alternatively, the interface providing device may recommend the temperature inside the vehicle considering the weather on the day of reservation through the air conditioning control interface 1110.

In another embodiment, the interface providing device may recommend customized controls for air conditioning/sound/lighting/seats based on driving information of the vehicle. Driving information may include information about the driving road, information about traffic conditions, etc. For example, the interface providing device may recommend an appropriate song through the sound control interface 1120 depending on whether the current driving road is a highway/general road.

FIG. 12 is a flowchart illustrating a method of providing an in-vehicle interface according to an embodiment.

Referring to FIG. 12, in step 1210, the interface providing device may provide the first interface before the vehicle starts driving.

In one embodiment, an interface providing device may provide an authentication interface through which a passenger can authenticate himself or herself. Additionally, after authenticating the passenger, the interface providing device may provide a reservation information interface that displays the departure location, departure time, arrival location, and arrival time included in the authenticated passenger's reservation information.

In step 1020, the interface providing device may provide the second interface after the vehicle starts driving.

In one embodiment, the interface providing device may provide a driving road interface that displays the road on which the vehicle is traveling and information on other vehicles around the vehicle recognized from sensors mounted on the vehicle.

Additionally, the interface providing device may provide the driving road interface with a message notifying that the driving mode of the vehicle has been switched from the automatic driving mode to the manual driving mode in response to the vehicle entering a predetermined road section.

Additionally, the interface providing device may provide a driving road interface displaying at least one of a lane-level driving path and a road-level driving path.

Additionally, the interface providing device may provide an entertainment interface that recommends customized entertainment information based on the passenger's passenger information.

Additionally, the interface providing device may provide an entertainment interface that recommends customized entertainment information based on the departure location, departure time, destination, and arrival time included in the reservation information.

Additionally, the interface providing device may provide an entertainment interface that displays customized entertainment information based on driving information of the vehicle.

Additionally, the interface providing device may provide a driving road interface that displays information on restaurants around the driving route from the departure point to the destination.

Additionally, the interface providing device may receive an input from a passenger who selects a certain restaurant from among a plurality of restaurants around the driving route from the departure point to the destination. The interface providing device may provide a driving road interface that displays at least one of the additional time required for passing through the selected restaurant, the additional travel distance, and the additional payment amount.

Additionally, the interface providing device may provide a menu ordering interface through which a menu that can be ordered from a selected restaurant can be selected and an in-app payment for the selected menu can be made.

In step 1030, the interface providing device may provide a third interface after the vehicle has completed driving.

In one embodiment, the interface providing device may provide an arrival information interface displaying the actual arrival time, the difference between the actual arrival time and the expected arrival time, destination information, payment information, etc. to the passenger.

Figure 13 is a block diagram of an interface providing device according to an embodiment.

Referring to FIG. 13, the interface providing device 1300 may include a communication unit 1310, a processor 1320, and a DB 1330. In the interface providing device 1300 of FIG. 13, only components related to the embodiment are shown. Accordingly, those skilled in the art can understand that other general-purpose components may be included in addition to the components shown in FIG. 13.

The communication unit 1310 may include one or more components that enable wired/wireless communication with an external server or external device. For example, the communication unit 1310 may include at least one of a short-range communication unit (not shown), a mobile communication unit (not shown), and a broadcast receiver (not shown).

The DB 1330 is hardware that stores various data processed within the interface providing device 1300, and can store programs for processing and control of the processor 1320.

The DB 1330 is a random access memory (RAM) such as dynamic random access memory (DRAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), CD- It may include ROM, Blu-ray or other optical disk storage, a hard disk drive (HDD), a solid state drive (SSD), or flash memory.

The processor 1320 controls the overall operation of the interface providing device 1300. For example, the processor 1320 can generally control the input unit (not shown), display (not shown), communication unit 1310, DB 1330, etc. by executing programs stored in the DB 1330. The processor 1320 may control the operation of the interface providing device 1300 by executing programs stored in the DB 1330.

The processor 1320 may control at least some of the operations of the interface providing device 1300 described above with reference to FIGS. 1 to 12 .

The processor 1320 includes application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, and microcontrollers. It may be implemented using at least one of micro-controllers, microprocessors, and other electrical units for performing functions.

In one embodiment, the interface providing device 1300 may be a mobile electronic device. For example, the interface providing device 1300 may be implemented as a smartphone, tablet PC, PC, smart TV, personal digital assistant (PDA), laptop, media player, navigation, device equipped with a camera, and other mobile electronic devices. there is. Additionally, the interface providing device 1300 may be implemented as a wearable device such as a watch, glasses, hair band, or ring equipped with a communication function and data processing function.

In another embodiment, the interface providing device 1300 may be an electronic device embedded in a vehicle. For example, the interface providing device 1300 may be an electronic device inserted into a vehicle through tuning after the production process.

In another embodiment, the interface providing device 1300 may be a server located outside the vehicle. A server may be implemented as a computer device or a plurality of computer devices that communicate over a network to provide commands, codes, files, content, services, etc. The server may receive data necessary to determine the vehicle's movement path from devices mounted on the vehicle, and determine the vehicle's movement path based on the received data.

In another embodiment, the process performed by the interface providing device 1300 may be performed by at least some of a mobile electronic device, an electronic device embedded in the vehicle, and a server located outside the vehicle.

Embodiments according to the present invention may be implemented in the form of a computer program that can be executed through various components on a computer, and such a computer program may be recorded on a computer-readable medium. At this time, the media includes magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and ROM. , RAM, flash memory, etc., may include hardware devices specifically configured to store and execute program instructions.

Meanwhile, the computer program may be designed and configured specifically for the present invention, or may be known and available to those skilled in the art of computer software. Examples of computer programs may include not only machine language code such as that created by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like.

According to one embodiment, methods according to various embodiments of the present disclosure may be included and provided in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. The computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)) or through an application store (e.g. Play StoreTM) or between two user devices. It may be distributed in person or online (e.g., downloaded or uploaded). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

Unless there is an explicit order or statement to the contrary regarding the steps constituting the method according to the invention, the steps may be performed in any suitable order. The present invention is not necessarily limited by the order of description of the above steps. The use of any examples or illustrative terms (e.g., etc.) in the present invention is merely to describe the present invention in detail, and unless limited by the claims, the scope of the present invention is limited by the examples or illustrative terms. It doesn't work. Additionally, those skilled in the art will recognize that various modifications, combinations and changes may be made depending on design conditions and factors within the scope of the appended claims or their equivalents.

Therefore, the spirit of the present invention should not be limited to the above-described embodiments, and the scope of the patent claims described below as well as all scopes equivalent to or equivalently changed from the scope of the claims are within the scope of the spirit of the present invention. It will be said to belong to

Claims (11)

A method of providing an in-vehicle interface in a device, comprising:
providing a first interface before starting driving of the vehicle;
providing a second interface after the vehicle starts driving; and
providing a third interface after completion of driving of the vehicle;
Including,
The step of providing the first interface includes:
Providing an authentication interface through which passengers can authenticate themselves; and
After authenticating the passenger, providing a reservation information interface that displays the departure point, departure time, destination, and arrival time included in the authenticated passenger's reservation information,
The step of providing the second interface is,
Providing a driving road interface that displays the road on which the vehicle is traveling and information on other vehicles around the vehicle recognized from a sensor mounted on the vehicle; and
In response to the vehicle entering a predetermined road section, providing the driving road interface with a message notifying that the driving mode of the vehicle has been switched from the automatic driving mode to the manual driving mode,
The step of providing the third interface is,
Providing an arrival information interface that provides information on the total travel time and destination information required to travel from the departure point to the destination;
Method, including. According to claim 1,
The step of providing the second interface is,
providing the driving road interface displaying at least one of a lane-level driving path and a road-level driving path;
Method, including. According to claim 1,
The step of providing the second interface is,
providing an entertainment interface that recommends customized entertainment information based on the passenger's passenger information;
Method, including. According to claim 1,
The step of providing the second interface is,
Providing an entertainment interface that recommends customized entertainment information based on the departure location, departure time, destination, and arrival time included in the reservation information;
Method, including. According to claim 1,
The step of providing the second interface is,
Providing an entertainment interface that displays customized entertainment information based on driving information of the vehicle;
Method, including. According to claim 1,
The step of providing the second interface is,
providing the driving road interface displaying restaurant information around the driving route from the starting point to the destination;
Method, including. According to claim 1,
The above method is,
Receiving an input from the passenger to select a predetermined restaurant from among a plurality of restaurants around the driving route from the departure point to the destination;
It further includes,
The step of providing the second interface is,
providing a driving road interface displaying at least one of additional time required for passing through the selected restaurant, additional travel distance, and additional payment amount;
Method, including. According to claim 7,
The step of providing the second interface is,
Providing a menu ordering interface through which you can select a menu that can be ordered from the selected restaurant and proceed with an in-app payment for the selected menu;
A method further comprising: According to claim 1,
The step of providing the second interface is,
Providing a control interface that recommends customized control for air conditioning/sound/lighting/seats based on at least one of the passenger's passenger information, the passenger's reservation information, and the vehicle's driving information;
may include. In a device that provides an in-vehicle interface,
The device is,
a memory in which at least one program is stored; and
A processor that performs calculations by executing the at least one program,
The processor,
Providing a first interface before starting driving of the vehicle,
Provides a second interface after the vehicle starts driving,
Providing a third interface after completion of driving of the vehicle,
The processor,
In the process of providing the first interface,
Provides an authentication interface that allows passengers to authenticate themselves,
After authenticating the passenger, a reservation information interface is provided that displays the departure location, departure time, destination, and arrival time included in the certified passenger's reservation information,
In the process of providing the second interface,
Providing a driving road interface that displays the road on which the vehicle is traveling and information on other vehicles around the vehicle recognized from sensors mounted on the vehicle,
Providing the driving road interface on which a message notifying that the driving mode of the vehicle has been switched from the automatic driving mode to the manual driving mode in response to the vehicle entering a predetermined road section is displayed,
In the process of providing the third interface,
A device that provides an arrival information interface that provides destination information and the total travel time required to travel from the origin to the destination. A computer-readable recording medium recording a program for executing the method of claim 1 on a computer.

Images