KR102174863B1 - Autonomous Vehicle Exterior Display Interaction Apparatus and Method - Google Patents

Abstract

According to the present invention, disclosed are an exterior display interaction device of an autonomous vehicle, which can personalize the exterior of the vehicle and change the exterior in various ways, and a method thereof. The exterior display interaction device of an autonomous vehicle includes: a design management unit that stores and manages at least one color and pattern information of the vehicle; and a display control unit that selects a pattern and a color according to user input by the design management unit and controls a display device to display the user input and an interaction message.

Description

Autonomous Vehicle Exterior Display Interaction Apparatus and Method

The present invention relates to a display interaction apparatus and method of a vehicle, and more particularly, to an external display interaction apparatus and method of an autonomous vehicle.

Vehicles often include various systems such as infotainment and navigation systems. These systems are typically provided with displays, around which machine control elements are arranged to provide a user interface mounted on the dashboard of the vehicle cabin for access by the driver and front seat occupants. do.

In addition, recently, a user identification subsystem capable of detecting a user of a vehicle, and an interactive display subsystem capable of generating an output for display on a vehicle window in response to the detection of the user have been developed.

Accordingly, as the importance of autonomous vehicles and infotainment grows, there is a need for a technology that can personalize the exterior of the vehicle, change it in various ways, and enable safe driving through interaction with pedestrians.

The present invention is an external display interaction device and method of an autonomous vehicle, a design management unit that stores and manages at least one color and pattern information of the vehicle, and selects a pattern and color according to a user's input from the design management unit, and An object of the present invention is to personalize the exterior of a vehicle, including a display control unit that controls the display device to display an interaction message, and to make various changes.

In addition, it includes an interaction control unit that determines the driving situation of the vehicle based on the surrounding environment of the vehicle and predicts the detected movement situation of the pedestrian, and provides an interaction message to the pedestrian, enabling safe driving through interaction with the pedestrian. It has another purpose.

Still other objects, not specified, of the present invention may be additionally considered within the range that can be easily deduced from the following detailed description and effects thereof.

In order to solve the above problem, in an external display interaction device of an autonomous vehicle, a display device that is located outside the vehicle and visually displays a user input, and the user input for changing the color and pattern of the vehicle from a user terminal An input receiving unit, a design management unit that stores and manages at least one color and pattern information of the vehicle, determines the driving situation of the vehicle based on the surrounding environment of the vehicle, and predicts the detected movement situation of the pedestrian, An interaction control unit providing an interaction message and receiving the user input from the input unit, selecting a pattern and color according to the user's input in the design management unit, and controlling the display device to display the user input and the interaction message It includes a display control unit.

In addition, it further comprises a sensor unit located in the front or rear of the vehicle to detect the surrounding environment of the vehicle, the interaction control unit, based on the object detected by the sensor unit and the surrounding environment of the vehicle, An environment recognition unit that recognizes moving object information, a movement determination unit that determines the driving situation of the vehicle according to the road, infrastructure, and moving object information recognized by the environment recognition unit and predicts the detected movement situation of a pedestrian, and the movement And an interaction message generator that generates an interaction message to be displayed on the display device according to the determination of the determination unit.

Here, the display device is provided in the form of a skin surrounding the exterior of the vehicle, and the display control unit is adjacent to the pedestrian among the left display, the right display, the front display, and the rear display according to the position of the pedestrian around the vehicle. By selecting a display of the location, a location to display the interaction message generated by the interaction message generator is selected, and when the pedestrian moves, the display device moves the interaction message according to the pedestrian's moving path to display the contents. Indicate.

Here, the environment recognition unit recognizes a distance between the pedestrian and the vehicle, and the display controller changes the size of the interaction message displayed on the display device according to the distance between the pedestrian and the vehicle.

In the external display interaction device of an autonomous vehicle according to an embodiment of the present invention, an environment recognition unit recognizing information around the vehicle, and a movement determination unit according to the road, infrastructure, and moving object information recognized by the environment recognition unit. Determining the driving situation of the vehicle and predicting the detected movement of the pedestrian, the interaction message generating unit checking the messages registered in the server, generating an interaction message according to the predicted movement of the pedestrian, and a display control unit A step of selecting a display corresponding to a location to be displayed on the display device to display the interaction message, and moving the interaction message according to the movement path of the pedestrian.

As described above, according to embodiments of the present invention, a design management unit that stores and manages at least one color and pattern information of the vehicle, a design management unit selects a pattern and color according to a user's input, The exterior of the vehicle may be personalized and variously changed, including a display controller that controls the display device to display an interaction message.

In addition, it includes an interaction control unit that determines the driving situation of the vehicle based on the surrounding environment of the vehicle and predicts the detected movement situation of the pedestrian, and provides an interaction message to the pedestrian, enabling safe driving through interaction with the pedestrian. can do.

Even if it is an effect not explicitly mentioned herein, the effect described in the following specification expected by the technical features of the present invention and the provisional effect thereof are treated as described in the specification of the present invention.

1 is a block diagram showing an external display interaction device for an autonomous vehicle according to an embodiment of the present invention.
2 is a block diagram illustrating a design management unit of an external display interaction device for an autonomous vehicle according to an embodiment of the present invention.
3 is a block diagram showing an interaction control unit of an external display interaction device for an autonomous vehicle according to an embodiment of the present invention.
4 is a diagram showing the configuration of an external display interaction device for an autonomous vehicle according to an embodiment of the present invention.
5 is a diagram showing a configuration of a sensor unit of an external display interaction device of an autonomous vehicle according to an embodiment of the present invention.
6 is a diagram illustrating a process of an interaction control unit of an external display interaction device of an autonomous vehicle according to an embodiment of the present invention.
7 is a diagram showing an interaction message of an external display interaction device of an autonomous vehicle according to an embodiment of the present invention for each situation.
8 is a diagram showing characteristics of an interaction message of an external display interaction device of an autonomous vehicle according to an embodiment of the present invention.
9 to 12 are flowcharts illustrating an external display interaction method of an autonomous vehicle according to an embodiment of the present invention.
13 is a diagram illustrating an external display of an external display interaction device of an autonomous vehicle according to an embodiment of the present invention for each situation.

Hereinafter, an external display interaction apparatus and method for an autonomous vehicle according to the present invention will be described in more detail with reference to the drawings. However, the present invention may be implemented in various different forms, and is not limited to the described embodiments. In addition, in order to clearly describe the present invention, parts irrelevant to the description are omitted, and the same reference numerals in the drawings indicate the same members.

When a component is referred to as being "connected" or "connected" to another component, it is understood that it may be directly connected or connected to the other component, but other components may exist in the middle. Should be.

The suffixes “module” and “unit” for components used in the following description are given or used interchangeably in consideration of only the ease of preparation of the specification, and do not have distinct meanings or roles by themselves.

Terms such as first and second may be used to describe various components, but the components should not be limited by terms. These terms are used only for the purpose of distinguishing one component from another component.

The present invention relates to an external display interaction apparatus and method for an autonomous vehicle.

1 is a block diagram showing an external display interaction device for an autonomous vehicle according to an embodiment of the present invention.

Referring to FIG. 1, the external display interaction device 10 of an autonomous vehicle according to an embodiment of the present invention includes an input unit 100, a design management unit 200, an interaction control unit 300, a sensor unit 400, and a display. The controller 500 and the display device 600 are included.

The external display interaction device 10 of an autonomous vehicle according to an embodiment of the present invention is a display or LED of a special form (Stretchable Display, LED, Flexible Display, etc.) applied to the exterior of a vehicle or autonomous vehicle to protect the exterior of the vehicle. It is a device that allows the user to customize as desired, and enables safe driving through interaction with pedestrians.

An application may be installed on the user terminal 20, and a user interface between the user terminal 20 and the external display interaction device 10 may be formed through the installed application or the cloud server 30.

In addition, arrows in FIG. 1 may mean that data can be transmitted/received through wired/wireless networks.

The display device 600 is located outside the vehicle and visually displays a user input. The display device is preferably provided in the form of a skin surrounding the exterior of the vehicle. In the form of a skin surrounding the exterior of the vehicle, a message displayed on the display can be checked even when looking at any side of the vehicle, and the entire vehicle can be customized.

The input unit 100 receives the user input for changing the color and pattern of the vehicle from a user terminal.

The design management unit 200 stores and manages at least one color and pattern information of the vehicle.

By using the design management unit 200, the exterior skin of the autonomous vehicle can be changed as desired by the user, and various contents can be used by using the screen of the external display.

The interaction controller 300 determines the driving situation of the vehicle based on the surrounding environment of the vehicle, predicts the detected movement situation of the pedestrian, and provides an interaction message to the pedestrian.

The interaction control unit 300 implements a V2P interaction using an external display of an autonomous vehicle. Here, V2P (Vehicle to Pedestrian communication) means vehicle and pedestrian communication. That is, it means wireless communication between mobile terminal devices possessed by a pedestrian or a cyclist. For example, a vehicle can recognize the smartphone of a pedestrian crossing the street and send a pedestrian approach warning to the driver to prevent an accident. V2P is a major technology for vehicle and thing communication (V2X: Vehicle to Everything), along with vehicle-to-vehicle communication (V2V) and vehicle-to-infrastructure communication (V2I), and can implement intelligent transportation services.

The sensor unit 400 is located in the front or rear of the vehicle to detect the surrounding environment of the vehicle.

The display controller 500 receives the user input from the input unit, selects a pattern and color according to the user input from the design management unit, and controls the display device to display the user input and the interaction message.

The display control unit 500 selects a display located close to the pedestrian among the left display, the right display, the front display, and the rear display according to the position of the pedestrian around the vehicle, and generates an interaction message generated by the interaction message generator. A location to be displayed is selected, and when the pedestrian moves, the display device displays the contents by moving the interaction message according to the pedestrian's moving path.

2 is a block diagram illustrating a design management unit of an external display interaction device for an autonomous vehicle according to an embodiment of the present invention.

Referring to FIG. 2, the design management unit 200 of the external display interaction device 10 of an autonomous vehicle according to an embodiment of the present invention includes a style management unit 210, a pattern management unit 220, a photo management unit 230, It includes a skin option generator 240.

The design management unit 200 stores and manages at least one color and pattern information of the vehicle.

By using the design management unit 200, the exterior skin of the autonomous vehicle can be changed as desired by the user, and various contents can be used by using the screen of the external display.

The style management unit 210 manages colors by accessing the cloud server 30 using the user terminal 20 so that the vehicle exterior display implements a style exterior skin.

Here, the user terminal 20 includes a smart watch or a smart phone. Specifically, when the input unit recognizes a smart watch or smartphone, the smart watch or smartphone is used to access the cloud server, and when the user photographs the user with a user terminal wearing or carrying, the style management unit 210 Color is extracted from the photographed clothes. Here, the camera performs an automatic recognition function, and when accessing the cloud using a smart watch or smartphone, the camera attached to the outside of the vehicle photographs the user, and the style management unit 210 captures the color of the user's clothes in the captured image. Will extract them.

When the skin option generator 240 creates several skin options with the extracted colors and provides them to the user terminal 20, the user selects a skin option displayed on the user terminal 20, and the display controller 500 is an external display. The device 600 controls the vehicle appearance to change with the selected skin color.

The pattern management unit 220 connects to the cloud server 30 using the user terminal 20 so that the vehicle exterior display implements the pattern exterior skin, and stores and manages the pattern and skin in the server or the database 201 of the design management unit. And, when the skin option generation unit 240 provides the stored patterns and skins to the user terminal 20, the user selects a skin option displayed on the user terminal 20, and the display control unit 500 performs an external display device ( 600) is controlled to change the appearance of the vehicle with the selected pattern and skin.

The photo management unit 230 connects to the cloud server 30 using the user terminal 20 so that the vehicle exterior display implements a photo exterior skin to take a desired background or store and manage a photo stored in a photo album. When the skin option generation unit 240 provides the photographed background or a picture stored in the photo book to the user terminal 20, the user selects a skin option displayed on the user terminal 20, and the display control unit 500 is external The display device 600 controls the vehicle appearance to change with the selected image.

The skin option generation unit 240 generates skin options to be displayed on the exterior, and provides the generated skin options to the user terminal 20, the user selects the skin options displayed on the user terminal 20, and the display control unit ( 500) controls the external display device 600 to change the appearance of the vehicle as a selected option.

3 is a block diagram showing an interaction control unit of an external display interaction device for an autonomous vehicle according to an embodiment of the present invention.

Referring to FIG. 3, the interaction control unit 300 of the external display interaction device 10 of an autonomous vehicle according to an embodiment of the present invention includes an environment recognition unit 310, a movement determination unit 320, and an interaction message generation unit. Includes 330.

The interaction controller 300 determines the driving situation of the vehicle based on the surrounding environment of the vehicle, predicts the detected movement situation of the pedestrian, and provides an interaction message to the pedestrian.

The environment recognition unit 310 recognizes road, infrastructure, and moving object information based on the object sensed by the sensor unit and the surrounding environment of the vehicle.

The movement determination unit 320 determines the driving situation of the vehicle according to the road, infrastructure, and moving object information recognized by the environment recognition unit and predicts the detected movement situation of the pedestrian.

The interaction message generation unit 330 generates an interaction message to be displayed on the display device according to the determination of the movement determination unit.

4 is a diagram showing the configuration of an external display interaction device for an autonomous vehicle according to an embodiment of the present invention.

Referring to FIG. 4, the external display interaction device of an autonomous vehicle according to an embodiment of the present invention includes a style management unit, a pattern management unit, a photo management unit, and an interaction control unit (V2P) for expressing vehicle interaction messages. ).

The style management unit 210 manages colors by accessing the cloud server 30 using the user terminal 20 so that the vehicle exterior display implements a style exterior skin.

Here, the user terminal 20 includes a smart watch or a smart phone. Specifically, when the input unit recognizes a smart watch or smartphone, the smart watch or smartphone is used to access the cloud server, and the automatic color extraction unit 211 automatically extracts colors from the user's style, or the user wears it. When a user is photographed with a user terminal being carried or carried, the style management unit 210 extracts a color from the clothes photographed by the camera photographing unit 212 using the color extraction unit 213.

Here, the camera performs an automatic recognition function, and when accessing the cloud using a smart watch or smartphone, the camera attached to the outside of the vehicle photographs the user, and the style management unit 210 captures the color of the user's clothes in the captured image. Will extract them.

When the skin option generator 240 creates several skin options with the extracted colors and provides them to the user terminal 20, the user selects a skin option displayed on the user terminal 20, and the display controller 500 is an external display. The device 600 controls the vehicle appearance to change with the selected skin color.

The pattern management unit 220 connects to the cloud server 30 using the user terminal 20 so that the vehicle exterior display implements the pattern exterior skin, and stores and manages the pattern and skin in the server or the database 201 of the design management unit. The skin option generation unit 240 selects patterns and skins stored through the pattern selection unit 221 and provides them to the user terminal 20, the user selects a skin option displayed on the user terminal 20, and The display controller 500 controls the external display device 600 to change the appearance of the vehicle with the selected pattern and skin.

The photo management unit 230 connects to the cloud server 30 using the user terminal 20 so that the vehicle exterior display implements a photo exterior skin, and takes a desired background through the photo shoot unit 232 or is stored in a photo album. Save and manage photos. When the skin option generation unit 240 selects a background taken through the album photo selection unit 231 or a photo stored in the photo book and provides it to the user terminal 20, the user can use the skin option displayed on the user terminal 20. Then, the display controller 500 controls the external display device 600 to change the appearance of the vehicle with the selected image.

The skin option generation unit 240 generates skin options to be displayed on the exterior, and provides the generated skin options to the user terminal 20, the user selects the skin options displayed on the user terminal 20, and the display control unit ( 500) controls the external display device 600 to change the appearance of the vehicle as a selected option.

The interaction controller 300 determines the driving situation of the vehicle based on the surrounding environment of the vehicle, predicts the detected movement situation of the pedestrian, and provides an interaction message to the pedestrian.

The interaction control unit 300 connects to the cloud server 30 using the user terminal 20 so that the vehicle exterior display displays the interaction message, and creates a message that the user wants according to the situation to control the interaction (V2P) list 301 Save and manage.

When the situation recognition unit 311 of the environment recognition unit 310 recognizes the situation based on road, infrastructure, and moving object information based on the surrounding environment of the vehicle, the message creation unit 331 of the interaction message generation unit 330 Generates an interaction message to be displayed on the display device by combining the messages based on the interaction control (V2P) list, and automatically displays the message (crosswalk, in transit, etc.) according to the situation. In addition, the user may directly select and display a message using the user terminal 20.

5 is a diagram showing a configuration of a sensor unit of an external display interaction device of an autonomous vehicle according to an embodiment of the present invention.

5, the sensor unit 400 of the external display interaction device of an autonomous vehicle according to an embodiment of the present invention includes front radars 401a and 401b, a camera 402, a 360 degree radar 403, It includes rear radars 404a, 404b.

The external display 600 is implemented in the form of a skin surrounding the entire vehicle.

The front radars 401a and 401b are detection sensors that use electromagnetic waves to measure the distance, speed, and angle of an object in front of the vehicle.

The camera 402 is a sensor that collects a lane or a pedestrian as an image, analyzes it, and detects it.

The 360 degree lidar 403 measures 360 degrees around the vehicle using light, and it can measure even the blind spot, thereby realizing precise measurement.

The rear radars 404a and 404b are detection sensors that use electromagnetic waves to measure the distance, speed, and angle of an object behind the vehicle.

The external display 600 processes data from sensors through a display controller and then displays a message to a pedestrian.

6 is a diagram illustrating a process of an interaction control unit of an external display interaction device of an autonomous vehicle according to an embodiment of the present invention.

Referring to FIG. 6, the interaction control unit of the external display interaction device of an autonomous vehicle according to an embodiment of the present invention includes a process of recognizing, determining, and executing three steps.

The sensor unit 400 is located in the front or rear of the vehicle to detect the surrounding environment of the vehicle. The camera, rider, and radar are used to collect and analyze data around the driving vehicle. The sensor unit 400 is preferably implemented as an ADAS sensor (Advanced Driver Assistance System), and may determine the driving situation of the vehicle and determine the behavior of the vehicle using a sensor capable of recognizing the surrounding environment while the vehicle is driving. .

In addition, by using the V2X (additional information) collection unit 410 that collects V2X (additional information) together with the sensor unit 400, additional information is collected and analyzed through inter-vehicle communication and infrastructure communication. V2X is a technology that provides information through wired and wireless networks centering on vehicles. V2X is a wireless communication between vehicle and vehicle (V2V: Vehicle to Vehicle), wireless communication between vehicle and infrastructure (V2I: Vehicle to Infrastructure), in-vehicle wired and wireless networking (IVN: In-Vehicle Networking), communication between vehicle and mobile terminal. (V2P: Vehicle to Pedestrian) is a generic term. V2X can be used to improve the information environment, stability, and convenience of vehicles and roads.

The environment recognition unit 310 includes a road and infrastructure recognition unit 312 and a moving object recognition unit 313, and an object detected based on information from a sensor unit and a V2X (additional information) collection unit and the surrounding environment of the vehicle. It recognizes information on roads, infrastructure, and moving objects.

The road and infrastructure recognition unit 312 recognizes sidewalks, crosswalks, tunnels, and overpasses.

The moving object recognition unit 313 recognizes vehicles, pedestrians, and animals.

The movement determination unit 320 determines the driving situation of the vehicle according to the road, infrastructure, and moving object information recognized by the environment recognition unit and predicts the detected movement situation of the pedestrian. For example, passing, left/right turn, stopping, and pedestrian movement can be predicted.

The interaction message generation unit 330 generates an interaction message to be displayed on the display device according to the determination of the movement determination unit.

The generated interaction message determines the direction in which the vehicle exterior display is to be used in the display controller 500 according to the position of the pedestrian, and may set the V2P phrase. Specifically, according to the location of the pedestrian around the vehicle, a display located close to the pedestrian is selected among the left display, the right display, the front display, and the rear display, and a location to display the interaction message generated by the interaction message generator is selected. And, when the pedestrian moves, the display device displays the contents by moving the interaction message according to the pedestrian's moving path. In addition, the size of the interaction message can be adjusted according to the distance and speed of the pedestrian.

7 is a diagram showing an interaction message of an external display interaction device of an autonomous vehicle according to an embodiment of the present invention for each situation.

The display device 600 of the external display interaction device of an autonomous vehicle according to an embodiment of the present invention is located outside the vehicle and visually displays a user input. The display device is preferably provided in the form of a skin surrounding the exterior of the vehicle.

The display controller 500 selects a display located close to the pedestrian among the left display 601, the right display 603, the front display 602, and the rear display 604 according to the position of the pedestrian around the vehicle. , Selecting a location to display the interaction message generated by the interaction message generator, and when the pedestrian moves, the display device moves the interaction message according to the movement path of the pedestrian to display the content.

7A is a case in which the crosswalk traffic light is red on a road with a crosswalk, and an interaction message is displayed on the display 603 on the right side of the vehicle by recognizing a pedestrian located on the right side of the vehicle. In this situation,'don't cross. It is desirable to display a message that reads'passed by.'

7(b) is a case where the crosswalk traffic light is red on a road with a crosswalk, and an interaction message is displayed on the vehicle front display 602 by recognizing a pedestrian crossing without permission. In this situation,'I will stop. It is desirable to display a message saying,'Do not run.'

The situation of FIG. 7C is a case in which the crosswalk traffic light is green on a road with a crosswalk, but is about to change, and an interaction message is displayed on the vehicle front display 602 by recognizing a pedestrian crossing in a hurry. In this situation, it is desirable to display a message saying'I will wait until I cross over'.

7(d) is a road without a crosswalk, and an interaction message is displayed on the vehicle front display 602 by recognizing a pedestrian who is going to cross or not. In this situation, it is desirable to display a message saying'I will wait until I cross over'.

8 is a diagram showing characteristics of an interaction message of an external display interaction device of an autonomous vehicle according to an embodiment of the present invention.

The environment recognition unit 310 recognizes road, infrastructure, and moving object information based on the object sensed by the sensor unit and the surrounding environment of the vehicle. The environment recognition unit recognizes the distance between the pedestrian and the vehicle, and the display control unit 500 changes the size of the interaction message displayed on the display device according to the distance between the pedestrian and the vehicle.

Referring to FIG. 8, in order to see the sign at 30m, the first interaction message when the distance between the pedestrian 40 and the first vehicle is D1 (60-70m) is because it must be viewed as about 15cm in height and 9cm in width per letter. When the width (W1) of 611 is 250 to 260 cm, and the distance between the pedestrian 40 and the second vehicle is D2 (30 to 40 m), the width (W2) of the second interaction message 612 is 110 to 120 cm. It is desirable to change the size of the interaction message according to the distance between the vehicle and the pedestrian. In addition, it is preferable that the width of the display device is 110 cm or more.

In addition, in order to prevent a situation in which pedestrians cannot see the interaction message due to light reflection, it is desirable to use black and white with the highest contrast.

9 to 12 are flowcharts illustrating an external display interaction method of an autonomous vehicle according to an embodiment of the present invention.

Referring to FIG. 9, in step S110, the environment recognition unit recognizes information around the vehicle.

In step S120, the movement determination unit determines the driving situation of the vehicle according to the road, infrastructure, and moving object information recognized by the environment recognition unit, and predicts the detected movement situation of the pedestrian.

In step S130, the interaction message generator checks the messages registered in the server, and generates an interaction message according to the predicted movement situation of the pedestrian.

In step S140, the display controller selects a display corresponding to a position to be displayed on the display device to display the interaction message, and in step S150 moves the interaction message according to the movement path of the pedestrian.

10 is a diagram illustrating a step of performing a style management unit 210 of an external display interaction method of an autonomous vehicle according to an embodiment of the present invention.

Referring to FIG. 10, in step S210, a user is recognized through a sensor mounted on a vehicle or a vehicle key.

In step S220, the user is photographed as an image through the camera, and when the image captured in step S230 is dark, the lighting may be corrected.

Color (RGB) data is extracted from the image captured in step S240, and a color is suggested to the user based on the color data extracted in step S250.

In step S260, the data is processed so that the exterior is applied with the color selected by the user.

11 is a diagram illustrating a step of performing a pattern management unit 220 of an external display interaction method of an autonomous vehicle according to an embodiment of the present invention.

Referring to FIG. 11, in step S310, a user accesses a library implemented as a server through a user terminal.

If the pattern and skins stored in step S320 are provided to the user terminal, the user selects a skin option displayed on the user terminal.

In step S330, the data is processed to apply the exterior with the color selected by the user.

12 is a diagram illustrating a step of performing a photo management unit 230 in an external display interaction method of an autonomous vehicle according to an embodiment of the present invention.

In step S410, the user takes a picture with the smart device.

The background taken in step S420 or the picture stored in the photo book is provided to the user terminal, and data is processed to apply exterior to the image selected by the user in step S430.

The performing step of the external display interaction method of an autonomous vehicle according to an embodiment of the present invention shown in FIGS. 9 to 12 may be implemented in each processor or may be implemented in one processor.

13 is a diagram illustrating an external display of an external display interaction device of an autonomous vehicle according to an embodiment of the present invention for each situation.

In the external display interaction device and method of an autonomous vehicle according to an embodiment of the present invention, a display or LED of a special form (Stretchable Display, LED, Flexible Display, etc.) is applied to the exterior of a vehicle or autonomous vehicle, so that the exterior of the vehicle is user It enables customization as desired, and is implemented including four functions as shown in (a) to (d) of FIG. 13.

13A shows that a pattern stored in a cloud server is selected and applied to the exterior. The user selects the skin option 221b displayed on the user terminal 21 from the stored pattern 221a, and the external display device 600 changes the appearance of the vehicle to the selected pattern 221c.

13(b) shows that the user's style is recognized and colors are extracted and applied to the exterior. When the automatic color extraction unit automatically extracts colors from the user's style 211a or photographs the user with the user terminal, the style management unit 210 extracts the color 211b from the captured clothes 211a using the color extraction unit. . The exterior of the vehicle is changed with the selected color 211c.

13(c) shows the selection of a background by taking a photo album or a picture.

The user terminal 21 takes a desired background through the photo taking unit 232 or selects a photo 231a stored in the photo album, and the appearance of the vehicle is changed to the selected photo 231b.

13D shows a case of changing the exterior of a vehicle and an interaction with a pedestrian through vehicle pedestrian communication (V2P). Depending on the situation, the message creation unit 331 generates an interaction message to the pedestrian 40 and automatically displays the message.

Accordingly, it is possible to provide differentiated functions (services), personalization for each passenger, and communication with pedestrians, thereby enabling safe driving.

In addition, there is provided a computer-readable recording medium in which a program for executing on a computer is recorded, in which a program for performing an external display interaction method of an autonomous vehicle is recorded on a computer.

Such a computer-readable medium may include program instructions, data files, data structures, and the like alone or in combination. The program instructions recorded on the recording medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floppy disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of the program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The above-described hardware device may be configured to operate as one or more software modules to perform the operation of the present invention, and vice versa.

The above description is only an embodiment of the present invention, and those of ordinary skill in the technical field to which the present invention pertains may be implemented in a modified form without departing from the essential characteristics of the present invention. Therefore, the scope of the present invention is not limited to the above-described embodiments, and should be construed to include various embodiments within the scope equivalent to those described in the claims.

Claims (5)

A display device positioned outside the vehicle and provided in the form of a skin surrounding the exterior of the vehicle to visually display a user input;
An input unit for receiving the user input for changing the color and pattern of the vehicle from a user terminal;
A design management unit that stores and manages at least one color and pattern information of the vehicle;
An interaction control unit determining a driving situation of the vehicle based on the surrounding environment of the vehicle, predicting the detected movement situation of the pedestrian, and providing an interaction message to the pedestrian; And
A display control unit configured to control the display device to receive the user input from the input unit, select a pattern and color according to the user input by the design management unit, and display the user input and the interaction message, and
The display control unit selects a display located close to the pedestrian among the left display, the right display, the front display and the rear display from the exterior of the vehicle according to the position of the pedestrian around the vehicle, And when the pedestrian moves, the display device moves the interaction message according to the pedestrian's moving path to display the contents,
The design management unit may include a pattern management unit connected to a cloud server to store and manage patterns and skins in a server or a database of the design management unit; And a skin option generator that provides stored patterns and skins to the user terminal,
Wherein the user selects a skin option displayed on the user terminal, and the display controller controls the display device to change the appearance of the vehicle with the selected pattern and skin. The method of claim 1,
A sensor unit positioned in front or rear of the vehicle to sense the surrounding environment of the vehicle; further comprising,
The interaction control unit,
An environment recognition unit for recognizing road, infrastructure, and moving object information based on the object sensed by the sensor unit and the surrounding environment of the vehicle;
A movement determination unit that determines a driving situation of the vehicle according to the road, infrastructure, and moving object information recognized by the environment recognition unit and predicts a movement situation of the detected pedestrian; And
And an interaction message generator configured to generate an interaction message to be displayed on the display device according to the determination of the movement determination unit. delete The method of claim 2,
The environment recognition unit recognizes the distance between the pedestrian and the vehicle,
Wherein the display control unit changes a size of an interaction message displayed on the display device according to a distance between the pedestrian and the vehicle. In the interaction method of a display device that is located outside the vehicle and provided in the form of a skin surrounding the exterior of the vehicle, and visually displays a user input,
Receiving, by an input unit, the user input for changing the color and pattern of the vehicle from a user terminal;
Storing and managing color and pattern information of at least one vehicle by a design management unit;
Determining, by an interaction controller, a driving situation of the vehicle based on the surrounding environment of the vehicle, predicting the detected movement situation of the pedestrian, and providing an interaction message to the pedestrian; And
And controlling the display device to receive, by a display control unit, the user input from the input unit, select a pattern and color according to the user input by the design management unit, and display the user input and the interaction message; and ,
Providing the interaction message to the pedestrian,
Recognizing, by the environment recognition unit, information around the vehicle; Determining a driving situation of the vehicle according to road, infrastructure and moving object information recognized by the environment recognition unit and predicting a detected movement situation of the pedestrian; And checking the messages registered in the server by the interaction message generator, and generating an interaction message according to the predicted movement situation of the pedestrian; including,
Controlling the display device to display the user input and the interaction message,
Depending on the location of the pedestrian around the vehicle, an interaction message generated by the interaction message generator may be displayed by selecting a display located close to the pedestrian among the left display, the right display, the front display, and the rear display of the vehicle. Select a location,
When the pedestrian moves, the display device displays the contents by moving the interaction message according to the pedestrian's moving path,
The step of storing and managing color and pattern information of at least one or more vehicles,
Connecting to a cloud server and storing and managing patterns and skins in a database of a server or a design management unit; And providing the stored patterns and skins to the user terminal; Including,
Wherein the user selects a skin option displayed on the user terminal, and the display controller controls the display device to change the appearance of the vehicle with the selected pattern and skin.

Images