WO2022103036A1

WO2022103036A1 - In-vehicle electronic device and display method in in-vehicle electronic device

Info

Publication number: WO2022103036A1
Application number: PCT/KR2021/015435
Authority: WO
Inventors: 안효인; 윤여준; 이수정; 천가원
Original assignee: 삼성전자 주식회사
Priority date: 2020-11-16
Filing date: 2021-10-29
Publication date: 2022-05-19
Also published as: KR20220067606A

Abstract

According to various embodiments, an in-vehicle electronic device comprises: a display including a main area and a plurality of extended areas in a plurality of directions extending, from the main area, in each of the plurality of directions; a sensor unit; a communication unit; a memory; and at least one processor, wherein the memory can store instructions configured so that, when executed, the at least one processor identifies a display extending direction on the basis of whether second display data associated with a second application is being displayed in the main area when first display data associated with a first application to be displayed in the display is received, and displays first information in the extended area based on the identified extending direction from among the plurality of extended areas in the plurality of extending directions. Other embodiments are possible.

Description

In-vehicle electronic device and display method in in-vehicle electronic device

Various embodiments relate to an in-vehicle electronic device and a display method in the in-vehicle electronic device.

A vehicle refers to a means of transportation capable of moving a person or a load by using kinetic energy. A typical example of a vehicle is a vehicle. For the safety and convenience of users using the vehicle, various vehicle-related devices are mounted on the vehicle, and the functions of the vehicle are being diversified. For example, a vehicle is being developed to include various functions, such as a convenience function for the convenience of a driver, and a safety function for promoting the safety of a driver and/or pedestrians, in addition to a simple movement function. In addition, various types of displays are provided inside the vehicle, and the vehicle device helps to provide various functions to passengers by controlling information output to the display.

In a vehicle, it can be important to ensure that information can be provided to occupants comfortably without compromising driving safety. It may be required that the configuration and/or display method of the display screen be appropriately implemented so that information is effectively provided while driving safety is maintained. For example, when information is provided in a vehicle, a vehicle-related display environment (eg, driver or/and passenger boarding information, driving information, vehicle information (on-board diagnostics (OBD), display information type, or/and vehicle surrounding information)) may be required to properly reflect.

According to various embodiments, there are provided an in-vehicle electronic device capable of providing a main area and an extended area extending in at least one direction from the main area to display information by appropriately reflecting various vehicle environments and a display method in the in-vehicle electronic device. can provide

According to various embodiments, the main area and at least the main area according to driver or/and passenger occupancy information, driving information, on-board diagnostics (OBD), display information type, or/and vehicle surroundings information An in-vehicle electronic device that displays information using one extended area and a display method in the in-vehicle electronic device may be provided.

According to various embodiments, when other information display is requested during information display using the main area, designated criteria (eg, driver and/or passenger boarding information, driving information, and vehicle information (OBD (on-board)) diagnostics)), display information type, or/and vehicle surrounding information), selecting an extension direction, and selecting an in-vehicle electronic device and a display method in the in-vehicle electronic device to display other information in the extension area based on the selected extension direction. can provide

An electronic device in a vehicle according to various embodiments of the present disclosure includes a display, a sensor unit, a communication unit, a memory, and at least one processor including a main area and a plurality of expansion areas in a plurality of directions extending from the main area in a plurality of directions, respectively. including, wherein the memory determines whether second display data associated with a second application is being displayed in the main area when receiving first display data associated with a first application to be displayed on the display when the at least one processor is executing based on the identification of a display extension direction, and store instructions configured to display the first information in an extension area based on the identified extension direction among a plurality of extension areas in the plurality of extension directions.

A method of displaying information in an in-vehicle electronic device according to various embodiments includes receiving first display data related to a first application to be displayed on a display of the electronic device, wherein the display includes a main area and a plurality of pieces from the main area An operation of including a plurality of extension areas in a plurality of directions extending in each direction, and identifying a display extension direction based on whether second data related to a second application is being displayed in the main area when the first display data is received , displaying the first display data in an extension area based on the identified extension direction among a plurality of extension areas in the plurality of extension directions.

According to various embodiments, in a non-volatile storage medium storing instructions, the instructions are configured to cause the at least one processor to perform at least one operation when the instructions are executed by the at least one processor. The operation may include receiving first display data associated with a first application for display on a display of the electronic device, wherein the display includes a main area and a plurality of directions extending in each of a plurality of directions from the main area. and identifying a display extension direction based on whether second data related to a second application is being displayed in the main area when the first display data is received, and a plurality of extension areas in the plurality of extension directions. and displaying the first display data in an extension area based on the identified extension direction among them.

According to various embodiments, a reduction in fluorescence in ultraviolet reflected light on the skin is obtained and visible. According to various embodiments, a main region and an extended region extending from the main region in at least one direction in a display of an electronic device in a vehicle are provided. Information can be displayed by appropriately reflecting the vehicle environment.

According to various embodiments, using the main area and at least one extended area on the display of the electronic device in the vehicle, driver and/or passenger boarding information, driving information, and vehicle information (on-board diagnostics (OBD)) ), the type of display information, and/or the information around the vehicle to display the information in a convenient manner.

According to various embodiments, when another information display is requested during information display using the main area on the display of the electronic device in the vehicle, a specified criterion (eg, driver or/and passenger boarding information, driving information, vehicle By selecting an extension direction according to information (on-board diagnostics (OBD)), display information type, or/and vehicle surroundings information, and having other information to be displayed in an extension area based on the selected extension direction, driving is not disturbed. You can also ensure that you are provided with appropriate information.

Effects obtainable in the present disclosure are not limited to the above-mentioned effects, and other effects not mentioned may be clearly understood by those of ordinary skill in the art to which the present disclosure belongs from the description below. will be.

1 is a view illustrating the exterior and interior of a vehicle according to an exemplary embodiment.

2 is a view for explaining a display area of an electronic device in a vehicle according to an exemplary embodiment.

3 is a block diagram illustrating a configuration of an electronic device according to an exemplary embodiment.

4 is an operation flowchart illustrating a method of displaying information in an electronic device according to an exemplary embodiment.

5A, 5B, 5C, 5D, and 5E are diagrams illustrating examples of a main area and an extended area extending from the main area in an electronic device according to an exemplary embodiment.

6 is an operation flowchart illustrating a method of displaying first information based on whether to maintain second information being displayed when receiving first information in an electronic device according to an exemplary embodiment;

7A, 7B, 7C, 7D, and 7E are diagrams illustrating examples of displaying the first information based on whether the second information being displayed is maintained when the electronic device receives the first information, according to an embodiment.

8 is an operation flowchart illustrating a method of displaying first information based on whether the electronic device is driving when receiving the first information, according to an exemplary embodiment.

FIG. 9A is a diagram for describing first information received through UWB communication with an external electronic device in an electronic device according to an exemplary embodiment;

9B is a diagram illustrating a display example of first information received through an external electronic device and UWB in an electronic device according to an exemplary embodiment;

10A is a diagram for describing first information received through another electronic device and UWB inside the electronic device, according to an exemplary embodiment.

FIG. 10B is a diagram illustrating an example in which first information received through UWB and another electronic device inside the electronic device is displayed in a first extended area, according to an exemplary embodiment.

10C is a diagram illustrating an example in which first information received through UWB and another electronic device inside the electronic device is displayed in a second extended area, according to an exemplary embodiment.

11A is a diagram for describing first information received through V2X communication in an electronic device according to an embodiment.

11B is a diagram illustrating an example in which first information received through V2X communication is displayed in a first extended area in an electronic device according to an embodiment;

11C is a diagram illustrating an example in which first information received through another electronic device and V2X inside the electronic device is displayed in a second extended area, according to an exemplary embodiment.

12A is a diagram for describing first information obtained based on vehicle diagnosis information from an OBD inside a vehicle in an electronic device according to an exemplary embodiment.

12B is a diagram illustrating an example in which first information obtained based on vehicle diagnosis information from OBD is displayed in an extended area according to an exemplary embodiment.

13 is a diagram for describing various input methods related to selection of an extension direction in an electronic device according to an exemplary embodiment.

14A is a diagram illustrating an example of selecting an extension direction when receiving a voice command in an electronic device according to an exemplary embodiment.

14B is a diagram illustrating an example in which a first extended area is displayed when a driver direction is selected by a voice command in the electronic device according to an exemplary embodiment;

14C is a diagram illustrating an example in which a second extended area is displayed when a passenger direction is selected by a voice command in the electronic device according to an exemplary embodiment;

15A is a diagram illustrating an example of displaying a first extended area by a touch of a first area of a dashboard in an electronic device according to an exemplary embodiment;

15B is a diagram illustrating an example of displaying a second extended area by a touch of a second area of a dashboard in an electronic device according to an exemplary embodiment.

16A is a diagram illustrating an example of displaying a first extended area by a touch of a first area of a main area in an electronic device according to an exemplary embodiment;

16B is a diagram illustrating an example of displaying a second extended area by touching the second area of the main area in the electronic device according to an exemplary embodiment.

In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

Terms used in this document are only used to describe specific embodiments, and may not be intended to limit the scope of other embodiments. The singular expression may include the plural expression unless the context clearly dictates otherwise. All terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by one of ordinary skill in the art of the present invention. Terms defined in general used in the dictionary may be interpreted as having the same or similar meaning as the meaning in the context of the related art, and unless explicitly defined in this document, it is not interpreted in an ideal or excessively formal meaning. . In some cases, even terms defined in this document cannot be construed to exclude embodiments of the present invention.

Referring to FIG. 1 , a vehicle 100 according to an exemplary embodiment may be a device for moving in a direction desired by a user who rides it, and may include, for example, a car. According to an embodiment, the vehicle 100 has a dashboard 105, a steering wheel 111, an instrument panel 113, a shift gear 115, an air conditioner (not shown), an audio system (not shown), necessary for driving therein. It may include various instrument components (or instruments), or/and an electronic device (eg, an electronic device or an electronic device) in a vehicle (not shown). According to an embodiment, the electronic device may include a display 117 , and the display 117 may be disposed in a center fascia between the driver's seat and the passenger seat or in a position close to the center fascia, and the display 117 may be located between the main area and the main area. A display area including a plurality of extended extension areas may be included.

2 is a diagram for describing a display area of an electronic device according to an exemplary embodiment.

Referring to FIG. 2 , the display 117 of the electronic device according to an exemplary embodiment may include a main area 210 at the center of the entire display area 201 , and may move in a plurality of directions from the main area 210 . It may include a plurality of extended extension regions.

According to an exemplary embodiment, the display area 201 of the display 117 includes a main area 210 , a first extension area 211 extending in a first direction (eg, a left direction or a driver's seat direction) from the main area 210 . , and a second extension area 212 extending in a second direction (eg, a right direction or a passenger seat direction) from the main area 210 . According to an embodiment, the display area 201 includes a third extension area 213 extending from the first extension area 211 in the first direction and a fourth extension area 213 extending from the second extension area 212 in the second direction. An extension region 214 may be further included. According to an embodiment, the display area 201 may further include one or more additional extension areas extending from the main area 210 or the first to fourth extension areas 211 to 214 .

According to an embodiment, the size (or length) of each of the main region 210 and the extension regions 211 - 214 may be a specified size or a size variable according to conditions. According to an embodiment, the length of each of the main area 210 and the extended areas 211 - 214 may be determined based on a content aspect ratio, a continuous command depth, and a location of a user (eg, a vehicle occupant).

According to an embodiment, different information is displayed in each of the main area 210 and the extended areas 211 - 214 , or a plurality of areas of the main area 210 and the extended areas 211 - 214 are used. Thus, one piece of information may be displayed.

Referring to FIG. 3 , the electronic device 300 (eg, the electronic device in the vehicle 100 of FIG. 1 ) according to an embodiment may include a body 301 and a head part 302 .

The main body 301 according to an embodiment includes a plurality of electric control units (ECUs) 311 to 313 , on-board diagnostics (OBD) (or OBD II) 315 , a sensor unit 317 , and/or A power supply unit 319 may be included.

The plurality of ECUs 311 to 313 according to an embodiment may include a plurality of electronic control devices for controlling respective functions of various vehicles, such as a vehicle powertrain, a chassis, and a door. The main ECU 311 among the ECUs 311 to 313 may control the remaining

ECUs

312 and 313 . The ECUs 311 to 313 may provide vehicle information according to the performance of each function of the vehicle. The ECUs 311-313 may further include an additional ECU, or an integrated ECU may also be possible.

The OBD 315 according to an embodiment may be a vehicle diagnosis device. The OBD 315 according to an embodiment receives information according to the performance of each function of the vehicle from the ECUs 311 to 313, determines whether there is a malfunction or a normal operation, and provides vehicle diagnosis information according to the performance of each function of the vehicle. It may be provided to the head unit 302 (or the processor 320 ). For example, vehicle diagnostic information may include catalyst or/and catalyst heater diagnostic information, air ratio sensor information, engine misfire monitoring system information, EGR-system diagnostic information, fuel tank ventilation system (evaporated gas system) diagnostic information, secondary air It may include at least one of system diagnostic information, electric circuit diagnostic information of exhaust gas-related parts, and tire pressure information, and may further include information related to vehicle diagnosis.

The sensor unit 317 according to an embodiment may include sensors for sensing various types of vehicle-related information. According to an embodiment, some of the sensors are a tire pressure monitoring system (TPMS), a bio-metric/on seats/belts sensor, an eye/head-tracking sensor, a start button sensor, a speedometer, a transmission, a clock, a voice button sensor, and a knob sensor. or all of them. In addition to this, the sensors may further include other sensors capable of sensing various information in the vehicle. For example, as a tire pressure monitoring sensor, the TPMS may be equipped with a vehicle radio wave identification sensor to detect tire pressure and temperature. The biometric sensor may be a biometric sensor. The biometric sensor may sense the user's biometric information, such as a fingerprint or an iris. The on seats sensor may detect occupants in seats of the vehicle. The belts sensor may detect whether the occupant is wearing a belt. The eye/head-tracking sensor may track the state of the driver's or passenger's eyes and head, and may detect whether the driver or passenger is drowsy by using the tracking result. The start button sensor may detect whether the vehicle is started through whether or not the vehicle start button is pressed. The speedometer can detect the driving speed of the vehicle. The transmission can detect whether the vehicle has shifted gears and which gears have been shifted. clock may provide a reference clock as a clock sensor. The voice button may recognize a voice as a voice recognition sensor. The Knob is a sensor disposed on the dashboard 105 or a handle of a vehicle door, and may recognize an input of a user (a driver or a passenger), whether the user holds the handle, a fingerprint of the user's finger, and the like.

The power supply unit 319 according to an embodiment may supply power to each of the respective parts of the vehicle in the vehicle.

The head unit 302 according to an embodiment includes a processor 320 , a display 322 , a communication unit 324 , a camera 326 , an audio unit 328 , an advanced driver assistance system (ADAS) 340 , and a memory ( 342 ), and/or an external device interface 344 .

The processor 320 according to an embodiment includes at least some components of the main body 310 (eg, the OBD 315 , the sensor unit 317 , the power supply unit 319 , and/or other components) and electrical components. It may be connected to the to transmit/receive information or to receive power, and may control overall components of the head unit 302 . When receiving the first display data associated with the first application to be displayed on the display 322 , the processor 320 according to an embodiment is configured to display the main display area (eg, the display area 201 of FIG. 2 ) of the display 322 . A display extension direction is identified based on whether second display data related to a second application is being displayed in an area (eg, the main area 210 of FIG. 1 ), and the identification among a plurality of extension areas in the plurality of extension directions It may be set to display the first display data in an extended area based on the extended direction.

The display 322 according to an embodiment may include a display area 201 and display information in the main area 210 and/or at least one extended area based on the control of the processor 320 . The display 322 according to an embodiment is, for example, a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, or a microelectromechanical system (MEMS) display, or an electronic paper (electronic) display. paper) may include a display. The display 322 may, for example, display various content (eg, text, images, videos, icons, and/or symbols, etc.) to the user. The display 322 may include a touch screen, and may receive, for example, a touch using a part of the user's body, a gesture, or a proximity input.

The communication unit 324 according to an embodiment may include at least one antenna and at least one communication module. According to an embodiment, the at least one antenna may include at least one of an external antenna and an internal antenna. At least one communication module is a cellular module (cellular module), GPS module (global positioning system module), WiFi module (WiFi module), Bluetooth module (bluetooth module), NFC module (near field communication module), UWB (ultra wide band) ) module, and may include at least one of a V2X module. In addition, it may further include another communication module. For example, the V2X module is a module that performs V2X communication, and V2X communication is one of V2V (vehicle to vehicle), V2I (vehicle to infrastructure), V2P (vehicle to pedestrian), and V2C (vehicle to cloud (or network)). may contain at least one

The camera 326 according to an embodiment is a device capable of capturing still images and moving images, and may include one or more image sensors, lenses, image signal processors (ISPs), or flashes (eg, LEDs or xenon lamps, etc.). there is.

The audio unit 328 according to an embodiment may convert a sound into an electric signal or convert an electric signal into a sound. The audio unit 328 may process sound information input or output through, for example, a speaker, a receiver, an earphone, or a microphone.

The ADAS 340 according to an embodiment may provide various types of intelligent driver assistance information related to driving to a driver in a vehicle as an intelligent driver assistance system. ADAS 340 according to an embodiment uses vehicle-related information acquired through the camera 326 , the sensor unit 317 , or/and the communication unit 324 and other additional components to detect people, vehicles, obstacles, etc. It can identify in advance and provide control information to prevent accidents by utilizing brakes and steering wheel. For example, ADAS 340 may provide a variety of intelligent driver assistance functions such as distance warning, autonomous cruise control, collision avoidance, parking assistance, blind spot monitoring, drowsiness prevention, adaptive lighting, or/and night vision. .

The memory 342 may store at least one or more applications that may be executed by the processor 320 and instructions for executing at least one or more of the applications.

The external device interface 344 may provide an interface connectable to an external device. The external device interface 344 includes a universal serial bus (USB) interface, a serial advanced technology attachment (SATA) interface, a secure digital (SD) card interface, a compact disc (CD)/digital versatile disc (DVD) interface, and a camera. It may include interfaces.

According to various embodiments, the in-vehicle electronic device (or electronic device) (eg, the electronic device 300 of FIG. 3 ) has a main area (eg, the main area 210 of FIG. 2 ) and a plurality of directions from the main area. A display (eg, the display 117 of FIG. 1 , or the display 322 of FIG. 3 , and a sensor unit (eg, the sensor unit 317 of FIG. 3 )) including a plurality of expansion areas in a plurality of directions each extending in each direction , a communication unit (eg, the communication unit 324 of FIG. 3 ), a memory (eg, the memory 342 of FIG. 3 ), and at least one processor (eg, the processor 320 of FIG. 3 ), the memory comprising: When the at least one processor is executed, when receiving the first display data associated with the first application to be displayed on the display, the display extension direction is identified based on whether the second display data associated with the second application is being displayed in the main area and instructions configured to display the first display data in an extension area based on the identified extension direction among a plurality of extension areas in the plurality of extension directions.

According to various embodiments, the plurality of extension directions may include a first extension area extending from the main area in a first direction and a second extension area extending from the main area in a second direction.

According to various embodiments, the plurality of extension directions may further include a third extension area extending from the first extension area in a first direction, and a fourth extension area extending from the second extension area in a second direction. can

According to various embodiments, the first direction may be a driver's seat direction, and the second direction may be a passenger's seat direction.

According to various embodiments, the at least one processor identifies a user associated with the first presentation data, identifies whether the user associated with the first presentation data is a driver or a passenger, and the user associated with the first presentation data is a driver In the case of , the display extension direction may be identified as the driver's seat direction, and if the user associated with the first display data is a passenger, the display extension direction may be identified as the passenger's seat direction.

According to various embodiments, the at least one processor identifies whether the information type of the first display data is driving-related information or driving-related information, and if the information type of the first display data is driving-related information, the display expansion direction is identified as the driver's seat direction, and when the information type of the first display data is driving-unrelated information, the display extension direction may be set to identify the passenger's seat direction.

According to various embodiments, the at least one processor identifies input information associated with the first display data, and identifies the display extension direction associated with the first display data based on the input information associated with the first display data can do.

According to various embodiments, the input information related to the first display data may include at least one of a voice input, a button or knob input, a touch input, and a camera-based input.

According to various embodiments, the at least one processor may receive the first display data from the outside of the vehicle through the communication unit.

According to various embodiments, the electronic device further includes on-board diagnostics (OBD) and an advanced driver assistance system (ADAS), and the at least one processor is configured to receive the first indication data through the OBD or ADAS. can

Referring to FIG. 4 , the processor 320 of the electronic device (eg, the electronic device 300 of FIG. 3 ) according to an embodiment may perform at least one of operations 410 to 450 .

In operation 410 , the processor 320 according to an embodiment may receive first information. The first information according to an embodiment may be information to be displayed on a display (eg, the display 117 of FIG. 1 or the display 322 of FIG. 3 ). For example, the first information may be received from the inside of the electronic device 300 (eg, the OBD 315 , the sensor unit 317 , the audio unit 328 , the ADAS 340 , or other components) or electronically. It may be information received from the outside of the device 300 through at least one communication module of the communication unit 324 . For example, the first information is a cellular module (cellular module), GPS module (global positioning system module), WiFi module (WiFi module), Bluetooth module (bluetooth module), NFC module (near field communication module), UWB (ultra) It may be information received using at least one of a wide band) module, a V2X module, or another communication module in addition to it. For example, the first information may include first display data associated with a first application for display on the display 322 . For example, the first application may be an application not related to driving (or driving) (eg, a music playback application, a call application, or other applications).

In operation 420 , the processor 320 according to an embodiment may determine whether the second information is being displayed on the main area of the display 322 (eg, the main area 210 of FIG. 2 ). For example, the second information may be various information such as driving-related information, information related to various contents (movies, music, applications), and vehicle information provided by the vehicle. For example, the second information may include second display data associated with a second application different from the first application. For example, the second application may be an application (eg, a navigation application or a map application) related to driving (or driving).

In operation 430 , the processor 320 according to an exemplary embodiment may determine the expansion direction of the display area based on checking whether the second information is being displayed on the main area 210 of the display 322 . According to an embodiment, when the second information is being displayed on the main area 210, the processor 320 checks whether the display of the second information is maintained, and when it is confirmed that the second information is information to be displayed and maintained, the expansion direction is changed. can be checked According to an embodiment, when the second information is driving (or driving) related information displayed while driving (or driving), it may be identified as information to be displayed and maintained. According to an embodiment, the processor 320 may identify a user (or a passenger) associated with the first information and confirm the direction (eg, a driver's seat direction or a passenger's seat direction) of the user associated with the first information as an extension direction. According to an embodiment, the processor 320 may check the information type of the first information to determine the extension direction (eg, the driver's seat direction or the passenger's seat direction) associated with the information type (eg, driving-related information or non-driving information). . According to an embodiment, the processor 320 may check the expansion direction based on an input (eg, a voice input, a button/knob input, a touch input, a camera-based input) related to the first information. The processor 320 according to an embodiment of the present invention may be configured such that the second information is not being displayed in the main area 210 or information having a priority in which the first information is displayed in the main area 210 (eg, driving-related information). In this case, the first information may be displayed in the main area 210 .

In operation 440 , the processor 320 according to an embodiment may select an extension region from among a plurality of extension regions in an extension direction extending from the main region based on the identified extension direction. According to an exemplary embodiment, the processor 320 is configured to include a first extension area 211 extending from the main area 210 in a first direction (eg, a left direction or a driver's seat direction) and a second direction (eg, from the main area 210 ). : One of the second extension areas 212 extending in the right direction or the passenger seat direction) may be selected. According to an embodiment, the processor 320 may select the first extension area 211 and the third extension area 213 extending from the first extension area 211 in the first direction together, and the second extension area 212 and the fourth extension region 214 extending in the second direction from the second extension region 212 may be selected together. According to an embodiment, the size (or length) of each of the main region 210 and the extension regions 211 to 214 may be a specified size or a size variable according to conditions. According to an embodiment, the length (eg, horizontal length) of each of the main area 210 and the extended areas 211 - 214 is based on a content UI ratio, a continuous command level (depth), and a location of a user (or a passenger). can be decided.

In operation 450, the processor 320 according to an embodiment may display the first information in the selected extended area. For example, the processor may display the first display data associated with the first application in the selected extension area. For example, the first application may be an application not related to driving (or driving) (eg, a music playback application, a call application, or other applications).

According to various embodiments, a method for displaying information in an in-vehicle electronic device (or electronic device) (eg, the electronic device 300 of FIG. 3 ) includes displaying first display data associated with a first application for displaying on a display of the electronic device. Receiving operation, wherein the display includes a main area and a plurality of extension areas in a plurality of directions extending from the main area in each of a plurality of directions, and a second application and a second application in the main area when the first display data is received identifying a display extension direction based on whether the associated second display data is being displayed, displaying the first display data in an extension area based on the identified extension direction among a plurality of extension areas in the plurality of extension directions It can include actions.

According to various embodiments, the method includes identifying a user associated with the first presentation data, identifying whether the user associated with the first presentation data is a driver or a passenger, wherein the user associated with the first presentation data is a driver case, identifying the display extension direction as the driver's seat direction, and identifying the display extension direction as the passenger's seat direction when the user associated with the first display data is a passenger.

According to various embodiments, the method includes an operation of identifying whether the information type of the first display data is driving-related information or driving-related information, and when the information type of the first display data is driving-related information, the display extension direction is the The method may include an operation of identifying the driver's seat direction and, if the information type of the first display data is non-driving information, identifying the display extension direction as a passenger seat direction.

According to various embodiments, the method includes an operation of identifying input information associated with the first display data, and identifying the display extension direction associated with the first display data based on the input information associated with the first display data may include

According to various embodiments, the method may receive the first display data from the outside of the vehicle through the communication unit.

According to various embodiments, the electronic device may further include on-board diagnostics (OBD) and an advanced driver assistance system (ADAS), and the method may receive the first indication data through the OBD or ADAS.

5A to 5E are diagrams illustrating examples of a main area and an extended area extending from the main area in an electronic device according to an exemplary embodiment.

Referring to FIG. 5A , a processor 320 according to an exemplary embodiment may include a display area 501 (eg, the display area 201 of FIG. 2 ) of a display 517 (eg, the display 117 of FIG. 1 ). Information may be displayed in the main area 510 (eg, the main area 210 of FIG. 2 ). According to an embodiment, the processor 320 displays the first information based on the reception of the first information in a state where there is no information being displayed in the main area 510 or information being displayed in the main area 510 (eg, the second information). information), if the second information is not driving-related information, or if the received first information is designated to be displayed on the main area 510 (or has priority), the received first information is displayed instead of the displayed second information. can be displayed For example, the first information may include first display data associated with a first application for display on the display 322 . For example, the first application may be an application not related to driving (or driving) (eg, a music playback application, a call application, or other applications). For example, the second information may include second display data associated with a second application different from the first application. For example, the second application may be an application (eg, a navigation application or a map application) related to driving (or driving).

Referring to FIG. 5B , in the processor 320 according to an embodiment, the direction of the user (or passenger) associated with the received first information in a state where the second information is displayed on the main area 510 is the second direction (eg: direction), the type of first information received is information not related to driving, or an input associated with the first information (eg, voice input, button/knob input, touch input, camera-based input) In the second direction, the first information may be displayed on the second extended area 512 in the second direction.

Referring to FIG. 5C , in the processor 320 according to an embodiment, the user's direction associated with the received first information in a state where the second information is displayed on the main area 510 is the first direction (eg, the left or the driver's seat direction). ), or the type of first information received is driving-related information, or an input associated with the first information (eg, voice input, button/knob input, touch input, camera-based input) is in the first direction (left or driver's seat) direction), the first information may be displayed on the first extended area 511 in the first direction.

Referring to FIG. 5D , in the processor 320 according to an embodiment, the first information is received while the second information is displayed in the main area 510 and the third information is displayed in the second extended area 512 . In this case, the direction of the user associated with the received first information is the second direction (eg, the right side or the passenger seat direction), the type of the received first information is information not related to driving, or the input associated with the first information ( For example, if the voice input, button/knob input, touch input, camera-based input) is in the second direction (right or passenger seat direction), the first information may be displayed in the fourth extended area 514 in the second direction.

Referring to FIG. 5E , in the processor 320 according to an embodiment, the first information is received while the second information is displayed in the main area 510 and the third information is displayed in the first extended area 511 . case, the direction of the user associated with the received first information is the first direction (eg, left or driver direction), the type of the received first information is information related to driving, or an input (eg, the input associated with the first information) When the voice input, button/knob input, touch input, camera-based input) is in the first direction (left or driver direction), the first information may be displayed in the third extended area 513 in the first direction.

According to an embodiment, the size (or length) of each of the main region 510 and the extension regions 511 - 514 may be a specified size or a size variable according to conditions. According to an embodiment, the length of each of the main area 510 and the extended areas 511 - 514 may be determined based on a content UI ratio, a continuous command depth (depth), and a location of a user (or a passenger). According to an embodiment, the location of the main area 510 may be moved within the display area 501 according to the expansion direction, and the location of each of the expansion areas 511 - 514 according to the movement of the main area 510 is also shown. It can be moved or resized.

Referring to FIG. 6 , the processor 320 of the electronic device (eg, the electronic device 300 of FIG. 3 ) according to an embodiment may perform at least one of operations 612 to 634 .

In operation 612 , the processor 320 according to an embodiment may receive first information. The first information according to an embodiment may be information to be displayed on a display (eg, the display 117 of FIG. 1 or the display 322 of FIG. 3 ). For example, the first information may be received from the inside of the electronic device 300 (eg, the OBD 315 , the sensor unit 317 , the audio unit 328 , the ADAS 340 , or other components) or electronically. It may be information received from the outside of the device 300 through at least one communication module of the communication unit 324 . For example, the first information is a cellular module (cellular module), GPS module (global positioning system module), WiFi module (WiFi module), Bluetooth module (bluetooth module), NFC module (near field communication module), UWB (ultra) It may be information received using at least one of a wide band) module, a V2X module, or another communication module in addition to it. For example, the first information may include first display data associated with a first application for display on the display 322 . For example, the first application may be an application not related to driving (or driving) (eg, a music playback application, a call application, or other applications).

In operation 614 , the processor 320 according to an embodiment may determine whether the second information is being displayed. The processor 320 according to an embodiment determines whether there is no second information being displayed, whether the second information is being displayed in the main area (eg, the main area 210 of FIG. 2 or the main area 510 of FIG. 5 ); It may be checked whether the second information is being displayed in the main area 510 and the third information is being displayed in the extended area (eg, at least one of the first to fourth extended areas 211 to 214 or 511 to 514 ). For example, the second information may include second display data associated with a second application different from the first application. For example, the second application may be an application (eg, a navigation application or a map application) related to driving (or driving).

In operation 616 , when there is no second information being displayed, the processor 320 may display the received first information in the main area 510 . For example, a case in which there is no second information being displayed may include a case in which the display is turned off.

In operation 618 , when the second information is being displayed in the main area 510 , the processor 320 may determine whether the second information should be displayed and maintained in the main area 510 in operation 618 . According to an embodiment, when the second information is information designated to be displayed on the main area 510 or the second information is driving (or driving) related information displayed during driving (or driving), the processor 320 may display to be maintained. information can be verified. When the second information does not need to be displayed on the main area 510 , the processor 320 according to an embodiment may display the received first information in the main area 510 in operation 616 .

In operation 620 , the processor 320 according to an exemplary embodiment may identify a display extension direction when the second information needs to be displayed in the main area 510 . According to an embodiment, the processor 320 may check the user associated with the first information and confirm the direction of the user associated with the first information (eg, the driver's seat direction or the front passenger's seat direction) as an extension direction. According to an embodiment, the processor 320 may check the information type of the first information to determine the extension direction (eg, the driver's seat direction or the passenger's seat direction) associated with the information type (eg, driving-related information or non-driving information). . According to an embodiment, the processor 320 may check the expansion direction based on an input (eg, a voice input, a button/knob input, a touch input, a camera-based input) related to the first information.

In operation 622 , the processor 320 according to an embodiment may select at least one extension area from among the plurality of extension areas expandable from the main area based on the extension direction. According to an exemplary embodiment, the processor 320 is configured to include a first extension area 511 extending from the main area 510 in a first direction (eg, a left direction or a driver's seat direction) and a second direction (eg, from the main area 510 ). : One of the second extended areas 512 extending in the right direction or the passenger seat direction) may be selected. According to an embodiment, the processor 320 may select both the first extension area 511 and the third extension area 513 extending from the first extension area 511 in the first direction, and the second extension area 512 and the fourth extension region 514 extending in the second direction from the second extension region 512 may be selected together. According to an embodiment, the size (or length) of each of the main region 510 and the extension regions 511 - 514 may be a specified size or a size variable according to conditions. According to an embodiment, the length of each of the main area 510 and the extended areas 511-514 may be determined based on a content UI ratio, a continuous command depth, and a user's location.

In operation 624, the processor 320 according to an embodiment may display the first information in the selected extended area.

In operation 626 , when the second information is being displayed on the main area 510 and the third information is displayed on the extension area (eg, at least one of the first to fourth extension areas), the processor 320 according to an embodiment It may be checked whether the second information and the third information are to be displayed and maintained. According to an embodiment, the processor 320 displays when the second information and the third information are designated information to be displayed and maintained or the second information and the third information are driving (or driving) related information displayed while driving (or driving). It can be confirmed as information that must be maintained.

In operation 628 , when the display of the second information and the third information does not need to be maintained, the processor 320 according to an embodiment determines the main area 510 and/or the extended area (eg, among the first to fourth extended areas). At least one) may display the received first information.

In operation 630, when the display of the second information and the third information is to be maintained, the processor 320 according to an embodiment may check a display extension direction. According to an embodiment, the processor 320 may check the user associated with the first information and confirm the direction of the user (or passenger) associated with the first information (eg, the driver's seat direction or the passenger's seat direction) as an extension direction. According to an embodiment, the processor 320 may check the information type of the first information to determine the extension direction (eg, the driver's seat direction or the passenger's seat direction) associated with the information type (eg, driving-related information or non-driving information). . According to an embodiment, the processor 320 may check the expansion direction based on an input (eg, a voice input, a button/knob input, a touch input, a camera-based input) related to the first information.

In operation 632 , the processor 320 according to an embodiment may select another extension area from among the extension areas expandable from the main area and/or the extension area based on the extension direction.

In operation 634, the processor 320 according to an embodiment may display the received first information in another selected extension area.

7A to 7E are diagrams illustrating an example of displaying the first information based on whether to maintain the displayed second information when receiving the first information in the electronic device according to an exemplary embodiment;

Referring to FIG. 7A , the processor 320 according to an embodiment receives the first information in the main area 710 when there is no displayed information (eg, second information), for example, when the display is turned off. The first information 71 may be displayed. For example, the first information 71 may include first display data associated with a first application for display on the display 322 .

Referring to FIG. 7B , the processor 320 according to an embodiment may check whether the display of the second information 72 is maintained when the second information 72 is being displayed on the main area 710 when the first information is received. there is. For example, the second information 72 may include second display data associated with a second application different from the first application.

When the processor 320 according to an embodiment does not maintain the display of the second information 72 , the processor 320 stops displaying the second information 72 in the main area 710 and displays the first information 71 . can For example, when the second information 72 is not information related to driving, it may be confirmed that the display is not maintained. The processor 320 according to an embodiment may display the second information 72 and the first information 71 in a multi-screen without stopping the display of the second information 72 on the main area 710 . .

Referring to FIG. 7C , when the processor 320 according to an embodiment receives the first information, the second information 72 is being displayed on the main area 710 and the second information is displayed while the electronic device 300 is in a driving state. When 72 is driving-related information (eg, navigation information), the first information 71 may be displayed in the extended area while maintaining the display of the second information 72 in the main area 710 . According to an embodiment, when the direction associated with the first information is the second direction (eg, the right side or the front passenger's seat), the processor 320 may display the first information 71 in the second extended area 712 in the second direction. can According to an embodiment, when the direction associated with the first information is the first direction (eg, left or driver's seat), the processor 320 may display the first information 71 in the first extended area 711 in the first direction. can

Referring to FIG. 7D , when the processor 320 according to an embodiment receives the first information, the second information 72 is being displayed in the main area 710 and the third information 73 is displayed in the second expansion area 712 . ) is being displayed and only the display of the second information 72 of the main area 710 is maintained, the display of the third information 73 of the second extended area 712 is stopped and the display of the third information 73 of the first extended area 711 is maintained. The first information 71 may be displayed.

Referring to FIG. 7E , in the processor 320 according to an embodiment, upon receiving the first information, the second information 72 is being displayed in the main area 710 and the third information 73 is displayed in the second expansion area 712 . ) is being displayed and the display of the second information 72 and the third information 73 is maintained, the first information 71 may be displayed in the fourth extended area 714 .

Referring to FIG. 8 , the processor 320 of the electronic device (eg, the electronic device 300 of FIG. 3 ) according to an embodiment may perform at least one of operations 812 to 826 .

In operation 812 , the processor 320 according to an embodiment may receive first information. The first information according to an embodiment may be information to be displayed on a display (eg, the display 116 of FIG. 1 or the display 322 of FIG. 3 ). For example, the first information may be received from the inside of the electronic device 300 (eg, the OBD 315 , the sensor unit 317 , the audio unit 328 , the ADAS 340 , or other components) or electronically. It may be information received from the outside of the device 300 through at least one communication module of the communication unit 324 . For example, the first information is a cellular module (cellular module), GPS module (global positioning system module), WiFi module (WiFi module), Bluetooth module (bluetooth module), NFC module (near field communication module), UWB (ultra) It may be information received using at least one of a wide band) module, a V2X module, or another communication module in addition to it.

In operation 814 , the processor 320 according to an embodiment may determine whether the display is being displayed. The processor 320 according to an embodiment may check whether there is information being displayed (eg, second information).

In operation 816 , the processor 320 according to an embodiment may display the received first information in the main area 510 when there is no information being displayed. For example, a case in which there is no information being displayed may include a case in which the display is turned off. For example, the first information may include first display data associated with a first application for display on the display 322 .

In operation 818 , the processor 320 according to an embodiment may determine whether the electronic device 300 is being driven when there is information being displayed. When there is information being displayed but the electronic device 300 is not driving, the processor 320 according to an embodiment stops displaying the information being displayed, and in operation 816 , the received first information is displayed in the main area 510 . can be displayed.

In operation 820 , if there is information being displayed and the electronic device 300 is driving, the processor 320 may check whether second information related to driving is being displayed in the main area 510 in operation 820 . For example, the second information may include second display data associated with a second application different from the first application. For example, the second application may be an application (eg, a navigation application or a map application) related to driving (or driving). For example, if there is information being displayed and the second information related to driving is not being displayed in the main area 510 while the electronic device 300 is driving, the processor 320 may display the received information in the main area 510 . The first information may be displayed.

In operation 822 , when there is information being displayed, the electronic device 300 is driving, and second information related to driving is being displayed in the main area 510 , the processor 320 according to an embodiment sets the display extension direction to the driver. direction can be determined.

In operation 824 , the processor 320 according to an exemplary embodiment may select an extension area from among a plurality of extension areas extending from the main area based on the driver's direction.

FIG. 9A is a diagram for explaining first information received through UWB communication with an external electronic device of an electronic device according to an exemplary embodiment, and FIG. 9B is a view for explaining first information received through UWB with an external electronic device in the electronic device according to an exemplary embodiment; It is a diagram showing an example of the display of the first information.

Referring to FIG. 9A , an electronic device 900 (eg, the electronic device 300 of FIG. 3 ) according to an embodiment may perform UWB communication with an external electronic device 901 . The electronic device 900 according to an exemplary embodiment determines the existence of an external electronic device 901 close to the electronic device 900 through UWB communication with the external electronic device 901 while driving, and the electronic device 900 and the external electronic device ( 901) can be measured. The electronic device 900 according to an embodiment may receive (or acquire) first information corresponding to the collision avoidance alarm information based on the distance between the electronic device 900 and the external electronic device 901 . For example, the first information may include first display data associated with a first application for display on the display 322 . For example, the external electronic device 901 may be one of a portable electronic device (eg, a smart phone) carried by a pedestrian, another vehicle, an intersection device, or a device installed in a blind area. For example, the electronic device 900 measures the distance between the electronic device 900 and the pedestrian through UWB communication with the external electronic device 901 of a pedestrian who is jaywalking while driving (eg, driving on a road), and the electronic device ( 900) may receive (or acquire) first information corresponding to the collision avoidance alarm information based on the distance between the pedestrian and the pedestrian.

Referring to FIG. 9B , the electronic device 900 according to an embodiment may display driving-related information (eg, second information) 92 on the main area 910 of the display while driving, and may display driving-related information (eg, second information) 92 while driving. The distance between the electronic device 900 and the external electronic device 901 is measured through UWB communication with the external electronic device 901 among the display of the driving-related second information 92 in the main area 910 , and the electronic device 900 ) and the external electronic device 901, when receiving (or acquiring) the first information corresponding to the collision avoidance alarm information based on the distance from the main area 910 to the driver's direction (eg, the first direction) extended area The first information 91 corresponding to the collision avoidance alarm information may be displayed at 911. For example, the second information may include second display data associated with a second application different from the first application. For example, the second application may be an application (eg, a navigation application or a map application) related to driving (or driving).

According to an embodiment, the external electronic device 901 also measures the distance between the electronic device 900 and the external electronic device 901 through UWB communication, and the electronic device 900 and the external electronic device ( 901), anti-collision alarm information may be acquired based on the distance between can provide

10A is a diagram for explaining first information received through UWB with another electronic device inside the electronic device according to an embodiment, and FIG. 10B is another electronic device inside the electronic device according to an embodiment and through UWB. It is a diagram illustrating an example in which received first information is displayed in a first extended area, and FIG. 10C is a view in which first information received through another electronic device and UWB inside the electronic device according to an embodiment is displayed in a second extended area It is a drawing showing an example in which

Referring to FIG. 10A , an electronic device 1000 (eg, the electronic device 300 of FIG. 3 ) according to an embodiment includes a first electronic device 1001 inside a vehicle and/or a second electronic device (eg, the electronic device 300 of FIG. 3 ) inside the vehicle. 1002) and UWB communication. The electronic device 1000 according to an embodiment is configured to communicate with the first electronic device 1001 and/or the vehicle second electronic device 1002 inside the vehicle through UWB communication with the first electronic device 1001 and/or the second electronic device 1001 . The first information may be received from the device 1002 . For example, the first information may include first display data associated with a first application for display on the display 1017 . According to an embodiment, the first electronic device 1001 is the driver's electronic device and may exist in the driver's seat direction based on the position of the display 1017 , and the second electronic device 1002 is the electronic device of the passenger and the display 1017 . ) may exist in the direction of the passenger seat based on the position of According to an embodiment, the electronic device 1000 may check the existence and location of the first electronic device 1001 through UWB communication with the first electronic device 1001 , and perform UWB communication with the second electronic device 1002 . The presence and direction (or location) of the second electronic device 1002 may be checked through the .

Referring to FIG. 10B , the electronic device 1000 according to an embodiment displays the second information 12 (eg, navigation information) in the main area 1010 with the first electronic device 1001 through UWB communication with the driver. When the first electronic device 1001 of the direction is checked and the first information 11 (call reception information) is received from the first electronic device 1001 , the first information is stored in the first extended area 1011 corresponding to the driver's direction. can be displayed. For example, the second information may include second display data associated with a second application different from the first application. For example, the second application may be an application (eg, a navigation application or a map application) related to driving (or driving).

Referring to FIG. 10C , the electronic device 1000 according to an embodiment displays the second information 12 (eg, navigation information) on the main area 1010 in the passenger seat through UWB communication with the second electronic device 1002 . The second electronic device 1002 in the direction is checked, and when the first information 13 (call reception information) is received from the second electronic device 1002 , the first information is displayed in the first extended area 1012 corresponding to the passenger seat direction. Information 11 can be displayed.

11A is a diagram for explaining first information received through V2X communication in an electronic device according to an embodiment, and FIG. 11B is a diagram illustrating first information received through V2X communication in the electronic device according to an embodiment. It is a diagram showing an example of displaying in the extended area, and FIG. 11C is a diagram showing an example in which the first information received through the electronic device and V2X inside the electronic device according to an embodiment is displayed in the second extended area.

Referring to FIG. 11A , an electronic device 1100 (eg, the electronic device 300 of FIG. 3 ) according to an embodiment may perform V2X communication with an external device or an external network using a V2X communication module. According to an embodiment, V2X communication is a vehicle to vehicle (V2V) 1151, a vehicle to infrastructure (V2I) 1153, a vehicle to pedestrian (V2P) 1155, a vehicle to cloud (V2C) (or a vehicle to network)) (1157). For example, the V2V 1151 may be communication between the electronic device 1100 and an electronic device in a vehicle of another vehicle. The V2I 1153 may be communication between the electronic device 1100 and an installation device on road infrastructure. The V2P 1155 may be communication between the electronic device 1100 and a pedestrian device. The V2C 1157 may be communication between the electronic device 1100 and a network (cloud). The electronic device 1100 according to an embodiment may receive first information through communication of at least one of a V2V 1151 , a V2I 1153 , a V2P 1155 , and a V2C 1157 . For example, the first information may include first display data associated with a first application for display on the display 1017 . For example, the first information may include information associated with a driver or information associated with a passenger. For example, the information associated with the driver may include real-time traffic information (RTTI) or/and detour recommendation information. For example, information associated with a passenger may include service information associated with traffic information and/or detour recommendation information. For example, the service information may include accident information based on traffic information and/or detour recommendation information, and service information for changing a place reservation time according to a delay in arrival time at a specific place based on traffic information and/or detour road recommendation information. .

Referring to FIG. 11B , the electronic device 1100 according to an embodiment displays the second information 15 (eg, driving-related information) on the main area 1110 , the first information received from the outside of the vehicle through V2X communication. Check (16), and if the first information is information related to the driver, the first information, for example, real-time traffic information (RTTI (real time 　 traffic information)) or / and detour road recommendation information (16) of the driver's direction It may be displayed in the first extended area 1111 .

Referring to FIG. 11C , the electronic device 1100 according to an embodiment displays the second information 15 (eg, driving-related information) on the main area 1110 , the first information received from the outside of the vehicle through V2X communication. After checking (17), if the first information is information related to the passenger, the first information, for example, accident information 17, may be displayed on the second extended area 1112 in the direction of the passenger. For example, the second information may include second display data associated with a second application different from the first application. For example, the second application may be an application (eg, a navigation application or a map application) related to driving (or driving).

The electronic device 1100 according to an embodiment may further receive the additional information 18 in addition to the first information 17 through V2X communication from outside the vehicle, and upon receiving the additional information, the received additional information, for example, The service information 18 for changing the place reservation time according to the delay of arrival time at a specific place based on traffic information and/or detour recommendation information may be further displayed in the fourth extended area 1114 in the direction of the passenger.

12A is a diagram for explaining first information obtained based on vehicle diagnosis information from OBD inside a vehicle in an electronic device according to an embodiment, and FIG. 12B is a diagram for explaining vehicle diagnosis information from OBD according to an embodiment It is a diagram illustrating an example in which the obtained first information is displayed in the extended area.

Referring to FIG. 12A , an electronic device (eg, the electronic device 300 of FIG. 3 ) in a vehicle 1200 according to an embodiment has an OBD (or OBD II) 1215 (eg, the OBD ( 315)), vehicle diagnosis information may be received. For example, the OBD (or OBD II) 1215 may provide vehicle diagnosis information based on information obtained from each component or sensor or circuit of the vehicle. For example, vehicle diagnostic information may include catalyst or/and catalyst heater diagnostic information, air ratio sensor information, engine misfire monitoring system information, EGR-system diagnostic information, fuel tank ventilation system (evaporated gas system) diagnostic information, secondary air It may include at least one of system diagnostic information, electric circuit diagnostic information of exhaust gas-related parts, and tire pressure information, and may further include information related to vehicle diagnosis. The in-vehicle electronic device 300 according to an embodiment may acquire first information to be displayed in association with vehicle diagnosis based on vehicle diagnosis information. For example, the first information may include first display data associated with a first application for display on the display 322 .

Referring to FIG. 12B , the electronic device 300 according to an embodiment displays an OBD (or OBD II) 1215 (eg: The first information 21 received based on the vehicle diagnosis information is checked from the OBD 315 of FIG. 3 , and the first information, for example, tire pressure information, is displayed on the first extended area 1211 in the driver's direction. can do. For example, the second information may include second display data associated with a second application different from the first application. For example, the second application may be an application (eg, a navigation application or a map application) related to driving (or driving).

The electronic device 1200 according to an embodiment may further receive (or acquire) the additional information 23 using the service related to the first information 21 based on the first information 21 , and receive the additional information In this case, the received additional information, for example, the service center information 23 associated with the tire pressure may be further displayed in the third extended area 1213 in the driver's direction. For example, when navigation information is displayed on the second information 22 while displaying the service center information 23 on the third extended area 1213 , the electronic device 1200 may automatically change the navigation destination to the service center. there is.

Referring to FIG. 13 , an electronic device according to an embodiment (eg, the electronic device 300 of FIG. 3 , the electronic device 900 of FIG. 9 , the electronic device 1000 of FIG. 10 , and the electronic device 1100 of FIG. 11 ) ), the electronic device 1200 of FIG. 12 may select (or confirm) the expansion direction of the display using at least one of a voice command, sound recognition, button or knob input, touch input, and camera-based user recognition.

A method of using a voice command according to an embodiment is to select an extension direction with a voice command input after inputting a voice button in the vehicle or a voice command (eg, right, left, driver's seat direction, or front passenger's seat direction) while performing AI voice recognition. it can be the way

The sound recognition method according to an embodiment recognizes the target (driver or passenger) of the received voice signal by analyzing the received voice signal after receiving the voice signal in the vehicle, and selects the extension direction by checking the direction of the target of the voice signal It could be a way to

The button or knob input method according to an embodiment may be a method of selecting an extension direction based on an input signal received through a button or knob input provided in the vehicle.

The touch input method according to an embodiment is a method of selecting an expansion direction based on the touched area when a designated area of the dashboard (or housing) in the vehicle is touched, or a method of selecting an extension direction based on the touched area when a designated area of the display area is touched based on the touched area may be a method of selecting an extension direction with .

The camera-based user recognition method according to an embodiment may be a method of recognizing a gesture or activity of a user (or a passenger) in a vehicle photographed by a camera and selecting an extension direction based on the recognized gesture or activity.

14A is a diagram illustrating an example of selecting an extension direction when a voice command is received by the electronic device according to an embodiment, and FIG. 14B is a view showing a first extension region when a driver direction is selected by a voice command in the electronic device according to an embodiment 14C is a diagram illustrating an example in which the second extended area is displayed when a passenger direction is selected by a voice command in the electronic device according to an exemplary embodiment.

Referring to FIG. 14A , an electronic device according to an embodiment (eg, the electronic device 300 of FIG. 3 , the electronic device 900 of FIG. 9 , the electronic device 1000 of FIG. 10 , and the electronic device 1100 of FIG. 11 ) )) may receive a voice command after the button or knob 1403 is input during the display of the second information in the main area 1410 , or may receive a voice command while being executed in the AI service without the button or knob 1403 input. For example, the second information may include second display data associated with a second application different from the first application.

When a voice command is received after the button or knob 1403 is input, the electronic device 300 according to an embodiment may select the extension direction as the driver's direction. When a voice command is received while the AI service is being executed, the electronic device 300 according to an embodiment may determine whether the target of the received voice command is a driver or a passenger, and may select an extension direction as the identified driver or passenger direction. The electronic device 300 according to an embodiment may receive (or acquire) the first information corresponding to the voice command and display the received first information in the selected extension direction. For example, the first information may include first display data associated with a first application for display on the display 322 .

Referring to FIG. 14B , an electronic device according to an embodiment (eg, the electronic device 300 of FIG. 3 , the electronic device 900 of FIG. 9 , the electronic device 1000 of FIG. 10 , and the electronic device 1100 of FIG. 11 ) )) recognizes the driver who uttered the voice command when a voice command of “I want to know the nearest gas station” is received among the display of the second information 42 in the main area 1410 , and sets the extension direction to the first direction , and the first information 41 received based on a voice command, for example, information about the nearest gas filling station, may be displayed on the first extended area 1411 in the first direction.

Referring to FIG. 14C , an electronic device according to an embodiment (eg, the electronic device 300 of FIG. 3 , the electronic device 900 of FIG. 9 , the electronic device 1000 of FIG. 10 , and the electronic device 1100 of FIG. 11 ) )) recognizes the passenger who uttered the voice command when a voice command of “Play music, in your eyes” is received among the display of the second information 42 in the main area 1410 , and selects the expansion direction as the second direction and the third information 43 received based on a voice command, for example, information for playing music in your eyes, may be displayed on the second extension area 1412 in the second direction.

15A is a diagram illustrating an example of a display of a first extended area by a touch of a first area of a dashboard in an electronic device according to an embodiment It is a diagram showing an example of displaying the second extended area by

15A , an electronic device according to an embodiment (eg, the electronic device 300 of FIG. 3 , the electronic device 900 of FIG. 9 , the electronic device 1000 of FIG. 10 , or the electronic device of FIG. 11 ( 1100)), when a left area (eg, first area) of the main area 1501 among areas of the dashboard 1505 among the second information display areas in the main area 1510 is touched, the extension direction is changed to the first direction (eg, the first area). : left direction), and the first information may be displayed in the first extension area 1511 corresponding to the selected first direction.

15B , an electronic device according to an embodiment (eg, the vehicle device 300 of FIG. 3 , the vehicle device 900 of FIG. 9 , the vehicle device 1000 of FIG. 10 , or the vehicle device of FIG. 11 ) 1100)), when a right area (eg, second area) of the main area 1501 among areas of the dashboard 1505 among the areas of the dashboard 1505 among the second information display in the main area 1510 is touched, the extension direction is changed to the second direction (eg, the second area). : right direction), and the first information may be displayed on the second extension area 1512 corresponding to the selected second direction.

16A is a diagram illustrating an example of a display of a first extended area by a touch of a first area of a main area in an electronic device according to an embodiment, and FIG. 16B is a view showing an example of a display of a first extended area by a touch of a second area of the main area in the electronic device according to an embodiment It is a diagram showing an example of displaying the second extended area by

Referring to FIG. 16A , an electronic device according to an embodiment (eg, the electronic device 300 of FIG. 3 , the electronic device 900 of FIG. 9 , the electronic device 1000 of FIG. 10 , or the electronic device of FIG. 11 ( 1100)), when the first area 1610 - 1 (eg, the lower left area) of the areas of the main area 1610 of the second information display in the main area 1610 is touched, the extension direction is changed to the first direction (eg: left direction), and the first information may be displayed on the first extension area 1611 corresponding to the selected first direction. For example, the first information may include first display data associated with a first application for display on the display 322 . For example, the second information may include second display data associated with a second application different from the first application.

Referring to FIG. 16B , an electronic device according to an embodiment (eg, the electronic device 300 of FIG. 3 , the electronic device 900 of FIG. 9 , the electronic device 1000 of FIG. 10 , or the electronic device of FIG. 11 ( 1100)), when the second area 1610-2 (eg, the lower right area) of the areas of the main area 1610 among the second information displays in the main area 1610 is touched, the extension direction is changed to the second direction (eg: right direction), and the first information may be displayed on the second extension area 1612 corresponding to the selected second direction.

It should be understood that various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, and include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. In this document, "A or B", "at least one of A and B", "at least one of A or B," "A, B or C," "at least one of A, B and C," and "A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish the element from other elements in question, and may refer to elements in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

As used herein, the term “module” may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic block, component, or circuit. A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document include one or more stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101). It may be implemented as software (eg, the program 140) including instructions. For example, a processor (eg, processor 120 ) of a device (eg, electronic device 101 ) may call at least one command among one or more commands stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to an embodiment, the method according to various embodiments disclosed in this document may be included in a computer program product and provided. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store ^TM ) or on two user devices (eg It can be distributed online (eg download or upload), directly between smartphones (eg smartphones). In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, a module or a program) of the above-described components may include a singular or a plurality of entities. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations are executed in a different order, omitted, or , or one or more other operations may be added.

According to various embodiments, in a non-volatile storage medium storing instructions, the instructions are configured to cause the at least one processor to perform at least one operation when executed by the at least one processor, The operations may include receiving first information to be displayed on a display of the electronic device, determining whether second information is displayed on a main area of the display when the first information is received, and displaying the second information on the main area Checking the display extension direction based on whether the display is being expanded, selecting an extension area from among a plurality of extension areas extending from the main area based on the confirmed extension direction, and selecting an extension area in the selected extension area It may include an operation of displaying the first information.

And, the embodiments of the present invention invented in the present specification and drawings are merely provided for specific examples to easily explain the technical contents according to the embodiments of the present invention and help the understanding of the embodiments of the present invention, and the scope of the embodiments of the present invention It is not intended to limit Therefore, in the scope of various embodiments of the present invention, in addition to the embodiments disclosed herein, all changes or modifications derived from the technical ideas of various embodiments of the present invention should be interpreted as being included in the scope of various embodiments of the present invention. do.

Claims

In an electronic device in a vehicle,

a display including a main area and a plurality of expansion areas in a plurality of directions extending from the main area in each of a plurality of directions;

sensor unit;

communication department;

Memory; and

At least one processor, wherein the memory is executed when the at least one processor is executed;

When receiving first display data associated with a first application for display on the display, identify a display extension direction based on whether second display data associated with a second application is being displayed in the main area;

The in-vehicle electronic device stores instructions configured to display the first display data in an extension area based on the identified extension direction among a plurality of extension areas in the plurality of extension directions.
According to claim 1,

The plurality of extension directions include a first extension area extending from the main area in a first direction and a second extension area extending from the main area in a second direction.
3. The method of claim 2,

The plurality of extension directions further include a third extension area extending from the first extension area in a first direction, and a fourth extension area extending from the second extension area in a second direction.
3. The method of claim 2,

The first direction is a driver's seat direction, and the second direction is a passenger seat direction.
5. The method of claim 4,

The at least one processor identifies a user associated with the first indication data, identifies whether the user associated with the first indication data is a driver or a passenger, and if the user associated with the first indication data is a driver, the display extension direction The in-vehicle electronic device is configured to identify in the driver's seat direction, and identify the display extension direction as the passenger's seat direction when the user associated with the first display data is a passenger.
5. The method of claim 4,

The at least one processor identifies whether the information type of the first display data is driving-related information or non-driving information, and if the information type of the first display data is driving-related information, identifies the display extension direction as the driver's seat direction and, when the information type of the first display data is driving-unrelated information, the in-vehicle electronic device is configured to identify the display extension direction as a passenger seat direction.
According to claim 1,

the at least one processor identifies input information associated with the first display data, and identifies the display extension direction associated with the first display data based on the input information associated with the first display data;

The in-vehicle electronic device, wherein the input information related to the first display data includes at least one of a voice input, a button or knob input, a touch input, and a camera-based input.
According to claim 1,

on-board diagnostics (OBD); and

ADAS (advanced driver assistance system) further comprising,

The at least one processor receives the first display data from the outside of the vehicle through the communication unit, or receives the first display data through the OBD or the ADAS in-vehicle electronic device.
A method for displaying information in an electronic device in a vehicle, the method comprising:

Receiving first display data associated with a first application for display on a display of the electronic device, wherein the display has a main area and a plurality of extension areas in a plurality of directions extending from the main area in each of a plurality of directions including;

identifying a display extension direction based on whether second display data related to a second application is being displayed in the main area when the first display data is received;

and displaying the first display data in an extension area based on the identified extension direction among a plurality of extension areas in the plurality of extension directions.
10. The method of claim 9,

The plurality of extension directions include a first extension area extending from the main area in a first direction, a second extension area extending from the main area in a second direction, and a third extension area extending from the first extension area in a first direction. An extension region, and a fourth extension region extending in a second direction from the second extension region,

The first direction is a driver's seat direction, and the second direction is a passenger seat direction.
11. The method of claim 10,

identifying a user associated with the first presentation data;

identifying whether the user associated with the first indication data is a driver or a passenger;

identifying the display extension direction as the driver's seat direction when the user associated with the first display data is a driver; and

and identifying the display extension direction as a passenger seat direction when the user associated with the first display data is a passenger.
11. The method of claim 10,

identifying whether the information type of the first display data is driving-related information or non-driving information;

identifying the display extension direction as the driver's seat direction when the information type of the first display data is driving-related information; and

and when the information type of the first display data is non-driving information, identifying the display extension direction as a passenger seat direction.
10. The method of claim 9,

checking input information related to the first display data; and

Further comprising the operation of confirming the display extension direction associated with the first display data based on the input information associated with the first display data,

The input information associated with the first display data includes at least one of a voice input, a button or knob input, a touch input, and a camera-based input.
10. The method of claim 9,

Receive the first display data from the outside of the electronic device through the communication unit of the electronic device, or receive the first display data through on-board diagnostics (OBD) or advanced driver assistance system (ADAS) of the electronic device How to.
A non-volatile storage medium having stored thereon instructions, wherein the instructions are configured to cause the at least one processor to perform at least one operation when executed by the at least one processor, the at least one operation comprising:

Receiving first display data associated with a first application for display on a display of the electronic device, wherein the display has a main area and a plurality of extension areas in a plurality of directions extending from the main area in each of a plurality of directions including;

identifying a display extension direction based on whether second data related to a second application is being displayed in the main area when the first display data is received;

and displaying the first display data in an extension area based on the identified extension direction among a plurality of extension areas in the plurality of extension directions.