KR20200083901A - Method, Device and Storage Medium for Evaluating Human Machine Interface of Take-over Request for Autonomous driving - Google Patents

Abstract

According to an embodiment of the present disclosure, provided is a device for evaluating a human machine interface (HMI), which comprises: a memory; a variable instrument panel; a sensor circuit installed inside/outside a vehicle which can autonomously travel; a communication unit which can communicate with a vehicle network; and a processor. The processor generates vehicle state information and surrounding environment information through at least one component of the communication unit and the sensor circuit, checks whether the switching of a control right for vehicle traveling is necessary based on the vehicle state information and the surrounding environment information, guides the switching of the control right through the variable instrument panel when the switching of the control right is necessary, and generates information related to a response of a driver for the switching of the control right on the basis of information collected through the at least one component to store the same in the memory. According to the present invention, it is possible to evaluate interaction between a driver and a vehicle in a vehicle environment.

Description

Switching control of autonomous vehicles HMI evaluation device, method and storage medium for evaluating human machine interface of take-over request for autonomous driving

Various embodiments disclosed in this document relate to an autonomous vehicle evaluation technology.

Autonomous driving should not only limit the driver's activity while providing stability and convenience for the driver. However, autonomous driving must be clearly defined when and who is responsible for what, if not (in the case of partial autonomous driving), a misunderstanding of the driver or the driving system can have tragic consequences. Therefore, unless the vehicle is fully autonomous (partially autonomous), the driver must drive at a specific point in time, so this situation must be clearly recognized.

To this end, a vehicle to which level 3 of the autonomous driving system is applied needs to guide or request control switching to the driver before switching control. For example, the autonomous vehicle system may provide an interface between the vehicle and the driver, so that a driver who has not performed driving can be prepared for driving again.

In the process of switching the control right of the partial autonomous driving, the driver's non-acceptance can cause a large vehicle accident, and the interface should be provided to increase the visibility and acceptability of the driver. Therefore, the interface needs to be tested or evaluated even in the driving simulator and the actual driving environment (vehicle environment). However, an interface evaluation device (hereinafter, referred to as an HMI evaluation device) has not been implemented in an actual driving environment (vehicle environment).

Various embodiments disclosed in this document may provide an HMI evaluation device, method, and storage medium capable of evaluating driver-vehicle interaction in a vehicle environment.

In one embodiment disclosed in this document, a human machine interface (HMI) evaluation device includes: a memory; Variable instrument panel; A sensor circuit installed inside/outside a vehicle capable of autonomous driving; A communication unit capable of communicating with the vehicle network; And a processor, wherein the processor generates vehicle state information and surrounding environment information through at least one component of the communication unit and the sensor circuit, and is configured to drive the vehicle based on the vehicle state information and the surrounding environment information. Check whether a control right change is required, and when the control right change is required, guide the control right change through the variable instrument panel, and the driver's reaction to the control right change based on information collected through the at least one component Information can be generated and stored in the memory.

In addition, the HMI evaluation method according to an embodiment disclosed in the present disclosure includes: generating vehicle state information and surrounding environment information based on at least one component of a vehicle network and a sensor circuit provided inside/outside the vehicle; An operation of determining whether a control right for a vehicle driving needs to be switched based on the vehicle status information and the surrounding environment information; If it is necessary to switch the control right, an operation of guiding the control right change through a variable instrument panel; And generating information related to a driver's reaction to the control right change based on information collected through the at least one component.

In addition, a computer-readable storage medium storing instructions according to an embodiment disclosed in the present document causes a processor of the HMI evaluation device when the instructions are executed: among a vehicle network and a sensor circuit provided inside/outside the vehicle Vehicle state information and surrounding environment information are generated through at least one component, and it is determined whether control right switching for vehicle driving is necessary based on the vehicle state information and the surrounding environment information. The control panel may be guided through the control panel, and information related to the driver's reaction to the control panel may be stored based on information collected through the at least one component.

According to various embodiments disclosed in the present document, an interaction between a driver and a vehicle in a vehicle environment may be evaluated. In addition, various effects that can be directly or indirectly identified through this document may be provided.

1 illustrates an implementation environment of an electronic device according to an embodiment.
2 is a flowchart of an HMI evaluation method according to an embodiment.
Figure 3 shows an exemplary guide through a variable instrument panel according to an embodiment.
4 shows an exemplary view of an output device according to an embodiment.
5 illustrates a UI screen related to scenario setting according to an embodiment.
In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

1 illustrates an implementation environment of an electronic device according to an embodiment.

Referring to FIG. 1, a human machine interface (HMI) evaluation device 100 according to an embodiment includes a sensor circuit 110, a communication unit 120, a variable instrument panel 130, an input device 140, and an output device 150 ), a memory 160 and a processor 170. In an embodiment, the HMI evaluation device 100 may omit some components or further include additional components. In one embodiment, some of the components of the HMI evaluation device 100 are combined to be configured as one entity, and the functions of the corresponding components before combining may be performed in the same way. For example, the variable instrument panel 130 and the output device 150 may be connected through the communication unit 120 or another communication unit.

According to an embodiment, the sensor circuit 110 may be installed inside/outside of an autonomous vehicle (hereinafter, referred to as a "vehicle"). The sensor circuit 110 may include a GPS sensor capable of checking the GPS coordinates of the vehicle, a camera capable of photographing the exterior of the vehicle, and at least one of a radar and a LIDAR capable of detecting objects around the vehicle. According to various embodiments, the sensor circuit 110 may include another camera or infrared camera capable of photographing the driver's gaze and behavior, and a biological sensor capable of sensing a biosignal of the driver. The biosensor may further include a sensor capable of detecting at least one biosignal of the driver's brain wave, driver's pulse wave, electrocardiogram, skin conductivity (GSR), and respiratory volume.

According to an embodiment, the communication unit 120 may communicate with a vehicle network (eg, a controller area network (CAN)). The communication unit 120 may receive vehicle status information according to a command of the processor 170. The vehicle state information may include, for example, at least one of vehicle speed information, operation state information of an accelerator pedal, operation state information of a brake pedal, steering torque information, and pressure information applied to a steering wheel. have. The communication unit 120 may communicate with other devices of the vehicle by other communication methods (eg, USB, LIN, LAN, FlexRay, MOST, Ethernet, RS-232, HDMI).

According to an embodiment, the variable dashboard 130 is provided in a cluster of a vehicle driver's seat, and according to a command of the processor 170, the dashboard information corresponding to the driving mode of the vehicle and control information switching guidance or autonomous driving mode or manual At least one image among driving modes may be output.

According to an embodiment, the input device 140 may include at least one of a microphone for detecting a voice input and a button for detecting a user input. The input device 140 may be included in the touch screen display provided in the head unit.

According to an embodiment, the output device 150 may include at least one output device of the vibration circuit 155 and the speaker 151. The vibration circuit 155 may be installed in at least one of a driver's seat (for example, in a lower seat of the driver's seat) or a steering wheel. The vibration circuit 155 may output vibration related to the control right switching guide. The speaker 151 may output a guide sound related to the control right switching guide.

The memory 160 may store, for example, commands or data related to at least one other component of the HMI evaluation device 100. For example, the memory 160 may store instructions related to HMI evaluation. For example, the commands may be used to switch control from a vehicle to a driver or a driver to a vehicle according to a driving scenario including control right switching conditions, and to determine whether to accept control switching by the driver based on the reaction of the driver after switching the control right. Commands. The commands may include, for example, commands to evaluate the HMI based on the driver's reaction before/after switching control. For another example, the memory 160 may store at least one of a plurality of images, a plurality of vibration amount information, and a plurality of guide sounds related to the control right switching guide. The plurality of images may include dashboard images displayed differently according to a driving mode. The plurality of dashboard images may include images having different information on at least one of a dashboard color, a border of the dashboard, and a guide symbol for switching control rights. The plurality of vibration amount information may include information related to a pulse width modulation (PWM) signal for vibration control of the vibration circuit 155 (for example, control of at least one of vibration intensity, vibration frequency, and vibration pattern). The plurality of guide sound information may include information related to guide sound control through the speaker 151 (eg, the number of times the guide sound is output and the size of the guide sound). The memory 160 may be volatile memory (eg, RAM, etc.), non-volatile memory (eg, ROM, flash memory, etc.) or a combination thereof.

The processor 170 may execute operations or data processing related to control and/or communication of at least one other component of the HMI evaluation device 100 using instructions stored in the memory 160. The processor 170 includes, for example, a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor, an application processor, an application specific integrated circuit (ASIC), and field programmable gate arrays (FPGAs). )), and may have a plurality of cores. For example, the processor 170 may include a processor for controlling the variable instrument panel 130, a processor for setting a driving scenario, a processor related to switching control of vehicle driving, and a processor for confirming driver reaction.

According to an embodiment, the processor 170 may generate vehicle status information through a vehicle network. The vehicle status information may include, for example, at least one of vehicle speed information, operation status information of the accelerator pedal, operation status information of the brake pedal, steering torque information, and pressure information applied to the steering wheel. At least some of the vehicle status information may be used to check a driver's reaction.

According to an embodiment, the processor 170 may generate surrounding environment information based on at least one of information or images obtained through the sensor circuit 110. For example, the processor 170 may check current location information (GPS coordinates) based on the GPS sensor. The processor 170 may generate the relative distance information of the surrounding vehicle based on the vehicle and the relative speed information of the surrounding vehicle based on the vehicle based on the reflection signal obtained through at least one of the radar and the lidar. The processor 170 may generate curvature radius information of the road on which the vehicle is driving and lane information of the road based on the surrounding vehicle and the road image acquired through the camera.

According to an embodiment, the processor 170 acquires a control command of a user (eg, a driver, an experiment control agent) through the input device 140, and the obtained control command is temporally related to vehicle status information and surrounding environment information. Can be saved in sync. The control command may include, for example, a request to switch control rights, and a control command related to setting a driving scenario. In this regard, the processor 170 provides an interface for setting any one of a plurality of driving scenarios that can be set through the variable instrument panel 130 and stores the driving scenarios set by the driver through the interface in the memory 160. have. Thereafter, the processor 170 may perform control related to switching of control rights based on the set driving scenario until the driving scenario is changed and set.

According to an embodiment, the processor 170 may control the vehicle in a plurality of driving modes according to the control right of the vehicle. For example, the processor 170 may drive an autonomous driving mode in which the vehicle control right is in a vehicle (eg, an autonomous driving system of the vehicle), a manual driving mode in which the control right is in the driver, or a control right switching state. The control right switching state may be a state in which control is switched from a vehicle to a driver or a driver to a vehicle. The control right switching state may include, for example, a time period until the control right switching is actually completed after the control right switching is determined by the processor 170.

According to an embodiment, the processor 170 may determine whether a control right change for a vehicle driving is necessary based on vehicle state information and surrounding environment information. For example, the processor 170 may control at least one vehicle condition among a vehicle position, a vehicle speed, a relative distance, a relative speed road curvature, and a road lane based on vehicle status information and surrounding environment information, to a control right switching condition according to a driving scenario. You can check if it matches. The conditions for switching the control right may include, for example, a situation where the vehicle is at a designated position (for example, a position where a branch point is located at a predetermined distance ahead), a situation where the vehicle speed is greater than (or less than) a specified speed, and a distance at which a relative distance between vehicles in front is specified An abnormal (or less) situation, a relative speed between vehicles ahead (or less) a specified distance, a road curvature greater than or less than a specified curvature, an accident on the road ahead, or under construction , It may correspond to at least one of a situation in which it is difficult to recognize a driving lane due to a poor lane of a forward driving road and a situation in which the autonomous driving control system has failed. For another example, when the first specified condition according to the driving scenario is met in the autonomous driving mode, the processor 170 may determine that it is necessary to switch control from the vehicle to the driver. Alternatively, when the second specified condition is met in the manual driving mode, the processor 170 may determine that it is necessary to switch control from the driver to the vehicle.

According to an embodiment, if it is determined that the control right switching for vehicle driving is necessary, the processor 170 may guide the control right switching through the variable instrument panel 130. For example, the processor 170 may select one of a plurality of images related to the control right switching guide and output the selected image to the variable instrument panel to guide the control right switching of the vehicle driving. For another example, the processor 170 selects one vibration amount information among a plurality of vibration amount information related to the control right switching guide, and controls the vibration circuit 155 based on the selected vibration amount information, thereby controlling the vehicle driving right. Can guide the transition. As another example, the processor 170 may select one guiding sound among a plurality of guiding sounds related to the guiding switching control, and control the speaker 151 based on the selected guiding sound, thereby guiding the switching of the control right of the vehicle driving. have. In this regard, the processor 170 may provide a screen for setting details related to the control right switching guide, and may guide (or request control switch) control switching according to the details set through the provided screen. The details may include at least one of an image selection (or setting) related to switching control, selection of vibration amount information (or setting), and selection of guide sound (or setting).

According to an embodiment, the processor 170 may check the driver's reaction based on the information collected through at least one component of the sensor circuit 110 and the communication unit 120 after guiding control switching. The processor 170 may generate the reaction-related information of the identified driver. For example, the processor 170 may be operated by at least one driver of the operation of the accelerator pedal, the operation of the brake and the operation of the steering wheel (detectable by the steering torque), and the pressure applied to the steering wheel (the pressure at which the driver holds the steering wheel). The reaction can be confirmed. The driver response may be, for example, a response to whether to accept (or succeed) the control switch.

According to an embodiment, the processor 170 may store the driver's reaction-related information generated based on the collected information in the memory 160 in relation to the set driving scenario and guide history information. The guide history information may include, for example, an image output through the variable instrument panel 130 in connection with a control right switching guide, vibration amount information output through the vibration circuit 155 and guide sound information output through the speaker 151. It may include at least one guide history information.

According to an embodiment of the present disclosure, the processor 170 may perform the control right switching by guiding the control right switching and confirming the driver's acceptance of the control right switching based on the driver's reaction. For example, the processor 170 guides the control from the vehicle to the driver in autonomous driving mode, and then presses the accelerator pedal, presses the brake, operates the steering wheel, and applies pressure to the steering wheel based on the collected information. If at least one driver response of (the driver's pressure holding the steering wheel) is confirmed, it can be confirmed by the driver's acceptance of the control switch to the driver. For another example, the processor 170 may guide the control from the driver to the vehicle in the manual driving mode, and then release at least one of the release of the accelerator pedal, release of the brake, release of the steering wheel, and release of pressure applied to the steering wheel. If the driver response is confirmed, it can be confirmed by the driver's acceptance of the control control switch to the vehicle.

According to an embodiment, the processor 170 may perform control control switching for driving in the manner described above, and evaluate the HMI based on driver reaction before and after guidance (or request) of control control switching. The HMI evaluation scale may include, for example, a time required from a control right change request to a control right change and a time required to stabilize after the control right change. For example, the processor 170 tracks the driver's gaze based on the image captured by the driver after requesting control control, and the driver's gaze stays on the visual HMI (eg, an image (guidance image) related to control control switching). You can check a point of time. The processor 170 may evaluate the visual HMI based on the identified time point and the driver reaction described above. For another example, the processor 170 may use an audible HMI (eg, a guide sound output through a speaker) and a tactile HMI (eg, a vibration guide through a vibration circuit) in addition to the visual HMI to request control switching. The processor 170 may evaluate the auditory HMI and the tactile HMI based on the driver reaction described above. The processor 170 may measure the brainwaves of the driver to measure the driver's recognition time and judgment time for the control switch request. The processor 170 may evaluate the visual HMI, the auditory HMI, and the tactile HMI based on the recognition time point and the judgment time point. The processor 170 may measure a driver's stable state during manual driving and autonomous driving based on bio signals such as pulse wave, electrocardiogram, skin conductivity, and respiratory volume, and store the stable state information in the memory 160. The processor 170 may measure the time required for stabilization after switching control right by using the stable state information as reference information. As another example, the processor 170 may store a driver's upper body image (hereinafter referred to as an NDRT image) in a memory 160 that performs a non-driving related task (NDRT) before requesting control switch. . The processor 170 may check the relationship between the HMI evaluation index with the NDRT image.

According to the above-described embodiment, the HMI evaluation device 100 may collect information inside/outside the vehicle to guide control control switching in the vehicle situation according to the set scenario, and generate and store information related to the driver's reaction to the guidance details. .

In addition, according to the above-described embodiment, the HMI evaluation device 100 guides the control right switching in a consistent situation according to the driving scenario in the vehicle driving environment having various variables, and evaluates the interaction between the vehicle and the driver related to the control right switching guidance. It is possible to provide a vehicle environment.

2 is a flowchart of an HMI evaluation method according to an embodiment.

Referring to FIG. 2, in operation 210, the HMI evaluation device 100 may generate vehicle status information and surrounding environment information based on at least one component of a vehicle network and sensor circuits provided in/outside the vehicle. . The vehicle status information may include, for example, at least one of vehicle speed information, operation status information of the accelerator pedal, operation status information of the brake pedal, steering torque information, and pressure information applied to the steering wheel. The surrounding environment information includes, for example, current location information (GPS coordinates), relative distance information of a surrounding vehicle based on a vehicle and relative speed information of a surrounding vehicle based on a vehicle, curvature radius information of a driving road, and lanes of a driving road It may include at least one of the information.

In operation 220, the HMI evaluation device 100 may determine whether it is necessary to switch control rights for driving the vehicle based on the vehicle state information and the surrounding environment information. For example, the HMI evaluation device 100 controls the vehicle situation according to the driving scenario in at least one of the vehicle position, vehicle speed, relative distance, relative speed, road curvature, and road lane based on vehicle status information and surrounding environment information. You can check if the conversion conditions are met.

In operation 230, the HMI evaluation device 100 may guide the control right change through the variable instrument panel when control right change is required. For example, the HMI evaluation device 100 may output a selected image among a plurality of images related to the control right switching guide to the variable dashboard. For another example, the processor 170 controls the vibration circuit 155 based on the selected vibration amount information among the plurality of vibration amount information, or a speaker based on the selected guide sound among one of the plurality of guide sounds (151) can be controlled.

In operation 240, the HMI evaluation device 100 may generate and store driver-related information on the control right change based on the information collected through at least one component. For example, the HMI evaluation device 100 checks at least one driver response among the operation of the accelerator pedal, the operation of the brake, the operation of the steering wheel, and the pressure information applied to the steering wheel, and generates and stores the information related to the identified driver response. Can. In operation 240, the HMI evaluation device 100 may determine whether to accept (or succeed) the control switch based on the driver's reaction. The HMI evaluation device 100 may generate and store driver response-related information including success or failure of control switching.

3 is a diagram illustrating a guide through a variable instrument panel according to an embodiment.

Referring to FIG. 3, the processor 170 according to an embodiment may selectively output a plurality of images (eg, 131, 132, 133) related to the control right switching guide through the variable instrument panel 130. The plurality of images may be images in which at least one of a color of a dashboard, a border of a dashboard, and a guide symbol for switching control rights are different. For example, in the autonomous driving mode, the processor 170 may output a symbol image 133a that induces the steering wheel operation of the driver in connection with the guidance of the control right change from the vehicle to the driver.

4 shows an exemplary view of an output device according to an embodiment.

Referring to FIG. 4, the vibration circuit 155 according to an embodiment may include a motor provided under the driver's seat and a motor controller for controlling the motor. The speaker 151 according to an embodiment may be, for example, a speaker provided in a vehicle head unit.

5 illustrates a UI screen related to scenario setting according to an embodiment.

Referring to FIG. 5, the processor 170 according to an embodiment provides a first screen 510 for setting a driving scenario to be evaluated for HMI, and a second screen 520 for setting details related to control control switching guidance. Can. The first screen 510 may include, for example, an interface for setting control right switching conditions. In this regard, when the details are set through the second screen 520, the processor 170 may guide the control right switching according to the set details. The details may include at least one of an image selection (or setting) related to switching control, selection of vibration amount information (or setting), and selection of guide sound (or setting).

It should be understood that various embodiments of the document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, and include various modifications, equivalents, or substitutes of the embodiment. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "A, Each of the phrases such as “at least one of B or C” may include any of the items listed together in the corresponding phrase of the phrases, or any possible combination thereof. Terms such as “first”, “second”, or “first” or “second” can be used to simply distinguish a component from other components, and to separate components from other aspects (eg, importance or Order). Any (eg first) component is referred to as a “coupled” or “connected” to another (eg second) component, with or without the term “functionally” or “communically” If mentioned, it means that any of the above components can be connected directly to the other components (eg, by wire), wirelessly, or through a third component.

As used herein, the term "module" may include units implemented in hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic blocks, components, or circuits. The module may be an integrally configured component or a minimum unit of the component or a part thereof performing one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document are one stored in a storage medium (eg, internal memory or external memory) (memory 160) readable by a machine (eg, HMI evaluation device 100). It may be implemented as software (eg, a program) including the above instructions. For example, a processor (e.g., processor 170) of a device (e.g., HMI evaluation device 100) can invoke and execute at least one of one or more commands stored from a storage medium. It is possible to be operated to perform at least one function according to the at least one instruction called The one or more instructions may include code generated by a compiler or code executable by an interpreter. A storage medium that can be read by can be provided in the form of a non-transitory storage medium, where'non-transitory' is a device that the storage medium is tangible and signals (eg, Electromagnetic wave), and the term does not distinguish between data that is stored semi-permanently and temporarily.

According to one embodiment, a method according to various embodiments disclosed in this document may be provided as being included in a computer program product. Computer program products can be traded between sellers and buyers as products. The computer program product is distributed in the form of a device-readable storage medium (e.g. compact disc read only memory (CD-ROM)), or through an application store (e.g. Play ^StoreTM ) or two user devices ( For example, it can be distributed directly (e.g., downloaded or uploaded) between smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored at least temporarily in a storage medium readable by a device such as a memory of a manufacturer's server, an application store's server, or a relay server, or may be temporarily generated.

According to various embodiments, each component (eg, module or program) of the above-described components may include a singular or a plurality of entities. According to various embodiments, one or more components or operations of the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, modules or programs) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components the same or similar to that performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be executed in a different order, or omitted Or, one or more other actions can be added.

Claims (20)

In the human machine interface (HMI) evaluation device,
Memory;
Variable instrument panel;
A sensor circuit installed inside/outside a vehicle capable of autonomous driving;
A communication unit capable of communicating with the vehicle network; And
Including a processor,
The processor,
Generating vehicle state information and surrounding environment information through at least one component of the communication unit and the sensor circuit,
Based on the vehicle status information and the surrounding environment information, it is checked whether control control for vehicle driving is necessary,
If it is necessary to switch the control right, the control panel is guided through the variable instrument panel,
The HMI evaluation device generates and stores information related to a driver's reaction to the control right change based on the information collected through the at least one component, and stores the driver-related information in the memory. The method according to claim 1, wherein the processor,
Based on the vehicle status information and the surrounding environment information, check the vehicle status of at least one of the vehicle position, vehicle speed, relative distance, relative speed, road curvature and road lane,
And checking whether the at least one vehicle condition meets the specified condition. The method according to claim 1,
The memory stores a set driving scenario,
The processor,
Based on the vehicle status information and the surrounding environment information, it is checked whether a vehicle condition meets a specified condition according to the driving scenario,
If the vehicle condition satisfies the specified condition, the HMI evaluation device determines that the control right switching is necessary. The method according to claim 3, wherein the processor,
Provides an interface for selecting any one of a plurality of driving scenarios through the variable instrument panel,
The HMI evaluation device stores the driving scenario set by the driver through the interface in the memory. The method according to claim 1, wherein the processor,
Based on the information collected through the at least one component, the operating state of the accelerator pedal, the operating state of the brake pedal, the steering torque, and the pressure applied to the steering wheel HMI evaluation device for confirming the reaction of the driver, including at least one. The method according to claim 1, wherein the processor,
If the first specified condition is met in the autonomous driving mode, it is determined that the control right needs to be switched from the vehicle to the driver,
If the second specified condition is met in the manual driving mode, the HMI evaluation device determines that it is necessary to switch control from the driver to the vehicle. The method according to claim 1,
The memory stores a plurality of images related to the guidance of the control right switching, and the processor,
If it is necessary to switch the control, the plurality of images are selectively output to the variable instrument panel,
HMI evaluation device for confirming the reaction of the driver to the plurality of images. The method according to claim 1,
Further comprising a vibration circuit installed on at least one part of the driver's seat or the steering wheel,
The memory stores a plurality of vibration amount information related to the guidance of the control right switching, and the processor,
If it is necessary to switch the control, the vibration circuit is controlled by selectively using the plurality of vibration amount information,
HMI evaluation device for confirming the reaction of the driver to the plurality of vibration amount information. The method according to claim 1,
Further comprising a speaker provided in the vehicle,
The memory stores a plurality of guide sounds related to the guidance of switching the control right, and the processor includes:
If it is necessary to switch the control, the plurality of guide sounds are selectively output through the speaker,
HMI evaluation device for confirming the reaction of the driver to the plurality of guide sounds. The method according to claim 1, wherein the processor,
After guiding the control right switching, if the driver's acceptance of the control right switching is confirmed based on the collected information, the control right switching is performed. In the HMI evaluation method for autonomous vehicles,
Generating vehicle state information and surrounding environment information based on at least one component of a vehicle network and a sensor circuit provided inside/outside the vehicle;
An operation of determining whether a control right for a vehicle driving needs to be switched based on the vehicle status information and the surrounding environment information;
If it is necessary to switch the control right, an operation of guiding the control right change through a variable instrument panel; And
And generating information related to a driver's reaction to the control right change based on the information collected through the at least one component. The method of claim 11, wherein the operation of checking whether the control right switching is necessary is
Checking a vehicle condition of at least one of a vehicle position, a vehicle speed, a relative distance, a relative speed, a road curvature, and a road lane based on the vehicle condition information and the surrounding environment information; And
And checking whether the at least one vehicle condition meets a specified condition according to a set driving scenario. The method according to claim 11,
Providing an interface for selecting any one of a plurality of driving scenarios through the variable instrument panel; And
And storing the driving scenario set by the driver through the interface. The method according to claim 11, The operation of confirming the reaction of the driver,
And an operation of confirming the reaction of the driver including at least one of an operation state of an accelerator pedal, an operation state of a brake pedal, a steering torque, and a pressure applied to the steering wheel based on information collected through the at least one component. How to do, HMI evaluation. The method of claim 11, wherein the operation of checking whether the control right switching is necessary is
Determining that it is necessary to switch control from the vehicle to the driver when the first specified condition is met in the autonomous driving mode; And
And determining that it is necessary to switch control from the driver to the vehicle when the second specified condition is met in the manual driving mode. The method according to claim 11,
The guiding operation includes an operation of selectively outputting a plurality of images related to the guidance of the control right switching to the variable instrument panel,
The operation of generating reaction-related information of the driver includes generating and storing the reaction-related information in relation to an output image among the plurality of images. The method according to claim 11,
The guiding operation includes an operation of controlling a vibration circuit installed in at least one of a driver's seat or a steering wheel by selectively using a plurality of vibration amount information related to the guidance of switching the control right,
The operation of generating reaction-related information of the driver includes generating and storing the reaction-related information in relation to the vibration amount information output among the plurality of vibration amount information, HMI evaluation method. The method according to claim 11,
The guiding operation includes an operation of selectively outputting a plurality of guiding sounds related to the guiding of the control right switching through a speaker,
The operation of generating reaction-related information of the driver includes generating and storing the reaction-related information in relation to the guide sound output among the plurality of guide sounds, HMI evaluation method. The method according to claim 11,
And confirming the driver's acceptance of the control right switching based on the collected information, further comprising performing the control right switching. A computer-readable storage medium storing instructions executable by a processor, comprising:
The above instructions, when executed, cause the processor of the HMI evaluation device to:
Vehicle state information and surrounding environment information are generated through at least one component of a vehicle network and a sensor circuit provided inside/outside the vehicle,
Based on the vehicle status information and the surrounding environment information, it is checked whether control control for vehicle driving is necessary,
If it is necessary to switch the control, the control panel is guided through the variable instrument panel,
A computer-readable storage medium for storing information related to a driver's reaction to the control right change based on information collected through the at least one component.

Images