KR20210068386A - Vehicle display device for controlling a vehicle interface using a portable terminal and method for controlling the same - Google Patents

Abstract

According to an embodiment of the present invention, an operating method of a vehicle display device includes the steps of: applying all or part of a control authority to a portable terminal, when the vehicle display device detecting a connection to a portable terminal; providing, by the vehicle display device, vehicle motion information to the portable terminal; receiving and outputting, by the vehicle display device, a vehicle interface generated and provided by the portable terminal; receiving, by the vehicle display device, a vehicle interface control signal from the portable terminal; and controlling, by the vehicle display device, the vehicle interface according to the received control signal. Accordingly, it is possible to easily realize the vehicle interface control provided to the vehicle display device without a separate installation process or at low cost.

Description

Vehicle display device for controlling a vehicle interface using a portable terminal and method for controlling the same

The present invention relates to a vehicle display device for controlling a vehicle interface using a portable terminal and an operating method thereof.

A vehicle multimedia device including an audio device, an audio and video (AV) device, and a digital multimedia broadcasting (DMB) terminal is installed in the vehicle for the convenience of the user, in addition to the navigation system described above. Images related to various operations of the multimedia apparatus for a vehicle are displayed by a display apparatus, and the display apparatus is generally installed in a center fascia between a driver's seat and a passenger seat in a vehicle.

In addition, the vehicle display device may include a navigation system, which is a system embodied in an Intelligent Transport System (ITS), which introduces location information using a Global Positioning System (GPS) satellite to the vehicle, It is a system that provides the vehicle driver with information about the surrounding road conditions based on the location.

For example, a vehicle navigation system refers to a system that detects vehicle location information using GPS information received from a GPS satellite, and provides map information corresponding to the location information with the detected vehicle location information.

In general, such manipulation of a vehicle display or navigation is performed by a touch or a button input located around the screen. However, if the driver manipulates the navigation system while driving the vehicle or operates it to view video, the driver's attention sharply decreases and the risk of an accident increases. Accordingly, display manipulation through touch while driving is regulated by law, have.

Accordingly, in order to easily operate the vehicle display device, an auxiliary control device such as a jog wheel is provided on the lower left or right lower side of the driver in luxury vehicles. However, the penetration rate is very low due to the problem of installation cost, etc., and it is connected to key elements such as ECU to support operation such as gears of the vehicle, so it is easy to install or modify it except at the time when the vehicle manufacturer produces the vehicle. Therefore, there is a problem that it is difficult to use.

Accordingly, there is a need to provide an interface that can easily support the operation of the vehicle display device without increasing the cost and installation, as well as increasing the risk of a vehicle accident.

The present invention is to solve the above problems, and by using a user input of the portable terminal, a portable terminal capable of easily realizing a vehicle interface control provided to a vehicle display device without a separate installation process or at low cost and an operation thereof The purpose is to provide a method.

In addition, the present invention relates to a vehicle display device for controlling a vehicle interface using a portable terminal that allows the portable terminal to control a vehicle interface by authorizing a vehicle interface control authority to a portable device connected to the vehicle display device in terms of a vehicle display device, and a vehicle display device and its An object of the present invention is to provide a method of operation.

A method of controlling a vehicle display apparatus according to an embodiment of the present invention for solving the above problems includes: providing a vehicle interface generated by the vehicle display apparatus; when the vehicle display device detects a connection to the portable terminal, applying all or part of the control authority to the portable terminal; receiving, by the vehicle display device, a vehicle interface control signal from the portable terminal; and controlling the vehicle interface according to the received control signal by the vehicle display apparatus.

In addition, the present invention allows the portable terminal to control the vehicle interface provided by the vehicle display device as described above, and allows the portable terminal to control the vehicle interface while providing the vehicle interface generated by the portable terminal device to the vehicle display device. You may.

In addition, the vehicle display device according to the present invention includes one or more modules that enable wireless communication between the vehicle display device and the wireless communication system or between the vehicle display device and the network in which the portable terminal is located, and communicates with the portable terminal or the vehicle. a communication unit including an interface unit that enables; AV (Audio/Video) input unit for receiving an audio signal or video signal input through a microphone or a camera; a user input unit for generating input data for a user to control an operation of the vehicle display apparatus; an output unit for outputting information processed by the vehicle display device through the display module; a vehicle information acquisition unit configured to acquire vehicle information including vehicle motion information and driving information for providing a vehicle interface; Controls the operation of the vehicle display device based on user input data input through the user input unit, provides a vehicle interface through the output unit, and detects a connection to the portable terminal through authentication with the connected portable terminal. and a controller configured to check whether the terminal has the interface control authority, apply the vehicle interface control authority to the corresponding portable terminal when authenticated, and receive a vehicle interface control signal from the portable terminal to control the vehicle interface.

According to an embodiment of the present invention, it is possible to easily realize the vehicle interface control provided to the vehicle display device without a separate installation process or at low cost by using various user inputs for the portable terminal.

1 schematically shows an entire system according to an embodiment of the present invention.
2 is a block diagram illustrating a detailed configuration of a portable terminal according to an embodiment of the present invention.
3 is a block diagram illustrating a detailed configuration of a vehicle display apparatus according to an embodiment of the present invention.
4 is a flowchart illustrating an operation of a portable terminal according to an embodiment of the present invention.
5 is a flowchart illustrating an operation of a portable terminal according to another embodiment of the present invention.
6 to 10 show various implementations of controlling a vehicle interface provided to a vehicle display device according to a user input of a portable terminal according to an embodiment of the present invention.
11 is a flowchart illustrating an operation of a vehicle display apparatus according to another embodiment of the present invention.

The following is merely illustrative of the principles of the invention. Therefore, those skilled in the art will be able to devise various devices which, although not explicitly described or shown herein, embody the principles of the present invention and are included within the spirit and scope of the present invention. In addition, it should be understood that all conditional terms and examples listed herein are, in principle, expressly intended only for the purpose of understanding the inventive concept and are not limited to the specifically enumerated embodiments and states as such. do.

Moreover, it is to be understood that all detailed description reciting specific embodiments, as well as principles, aspects, and embodiments of the present invention, are intended to cover structural and functional equivalents thereof. It is also to be understood that such equivalents include not only currently known equivalents, but also equivalents developed in the future, i.e., all devices invented to perform the same function, regardless of structure.

Thus, for example, the block diagrams herein are to be understood as representing conceptual views of illustrative circuitry embodying the principles of the present invention. Similarly, all flowcharts, state transition diagrams, pseudo code, etc. may be tangibly embodied on a computer-readable medium and be understood to represent various processes performed by a computer or processor, whether or not a computer or processor is explicitly shown. should be

The functions of the various elements shown in the figures including a processor or functional blocks represented by similar concepts may be provided by the use of dedicated hardware as well as hardware having the ability to execute software in association with appropriate software. When provided by a processor, the functionality may be provided by a single dedicated processor, a single shared processor, or a plurality of separate processors, some of which may be shared.

In addition, clear use of terms presented as processor, control, or similar concepts should not be construed as exclusively referring to hardware having the ability to execute software, and without limitation, digital signal processor (DSP) hardware, ROM for storing software. It should be understood to implicitly include (ROM), RAM (RAM) and non-volatile memory. Other common hardware may also be included.

In the claims of the present specification, a component expressed as a means for performing the function described in the detailed description includes, for example, a combination of circuit elements that perform the function or software in any form including firmware/microcode, etc. It is intended to include all methods of performing the functions of the device, coupled with suitable circuitry for executing the software to perform the functions. Since the present invention defined by these claims is combined with the functions provided by the various enumerated means and combined in a manner required by the claims, any means capable of providing the functions are equivalent to those contemplated from the present specification. should be understood as

The above-described objects, features and advantages will become more apparent through the following detailed description in relation to the accompanying drawings, and accordingly, those of ordinary skill in the art to which the present invention pertains can easily implement the technical idea of the present invention. There will be. In addition, in the description of the present invention, if it is determined that a detailed description of a known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted.

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 schematically shows an entire system according to an embodiment of the present invention.

The vehicle display apparatus 200 to be described below may be implemented as various devices provided or mounted in a vehicle. For example, the vehicle display apparatus 200 may include a navigation system capable of guiding a route to a specific point, a black box that stores or transmits image information by photographing the surroundings of the vehicle, a smart phone, a tablet computer, a notebook computer, and a PDA ( It may be implemented in various devices such as a personal digital assistant, a portable multimedia player (PMP), and the like. When the vehicle display apparatus 200 is implemented as a vehicle black box, it may be implemented by itself or integrally with the navigation system.

The vehicle display apparatus 200 according to an embodiment of the present invention capable of performing such an operation may be, for example, a vehicle navigation system or implemented as a vehicle black box or augmented reality system.

When the vehicle display apparatus 200 is a vehicle navigation system or an augmented reality system, the vehicle display apparatus 200 may refer to a system that notifies the driver and passengers of the vehicle with various data related to operation and maintenance of the vehicle. In this case, the vehicle display apparatus 200 may be a vehicle navigation system itself, and may be viewed as a concept including various display apparatuses that operate in connection with the portable terminal 100 providing a vehicle interface through wired/wireless communication.

In particular, the portable terminal 100 may constitute an integrated system by providing various types of information that the vehicle display device 200 may provide, supplement, and increase the vehicle navigation function. The portable terminal 100 in the entire system may be implemented as a smart phone, a tablet computer, a notebook computer, a personal digital assistant (PDA), a portable multimedia player (PMP), etc. that can access a mobile communication network.

And, in the first mode, the portable terminal 100 according to an embodiment of the present invention may output a first interface capable of controlling a basic function of the portable terminal 100 by itself. In the first mode, the portable terminal 100 may basically perform functions provided to the user by the portable terminal 100 irrespective of the function of the vehicle display apparatus 200 . For example, the basic function may include a call function, a text function, an Internet function, a memo function, or a schedule function.

In addition, the portable terminal 100 according to an embodiment of the present invention may be connected to the vehicle display apparatus 200 . In this case, the portable terminal 100 may output a vehicle interface to the vehicle display apparatus 200 and switch to the second mode for controlling the vehicle interface. In particular, in the second mode, the portable terminal 100 may control the vehicle interface according to a vehicle interface control input determined according to a user input to the portable terminal 100 .

On the other hand, the mounting device 300 can be used to easily determine the wheel input while the portable terminal 100 is mounted. For example, in an embodiment of the present invention, the mounting device 300 may include a wireless charging circuit. In addition, the portable terminal 100 may use motion information of the holding device 300 in determining a user input. The cradle 300 may be used to fix the portable terminal 100 so that it can rotate at a specific position, and may be connected to a charging terminal. However, the mounting device 300 is not essential in the embodiment of the present invention, but may be used as an auxiliary configuration or may be used essential in other embodiments.

As described above, the entire system network including the portable terminal 100 , the vehicle display device 200 , and the mounting device 300 according to an embodiment of the present invention may be connected by a wired or wireless network. For wired, it can be connected with HDMI, VGA, sRGB, USB interface, or other cable interface, and for wireless, Bluetooth, RFID (Radio Frequency Identification), Infrared Communication (IrDA, Infrared Data Association), UWB (Ultra WideBand) , ZigBee, etc. can be connected to the network.

Hereinafter, the configuration and operation of the portable terminal 100 and the vehicle display apparatus 200 will be described in more detail.

2 is a block diagram illustrating a detailed configuration of a portable terminal according to an embodiment of the present invention.

Referring to FIG. 2 , the portable terminal 100 according to an embodiment of the present invention includes a wireless communication unit 110 , a user input unit 130 , a sensor unit 140 , an output unit 150 , a storage unit 160 , and a vehicle. It may include a system connection unit 170 , a control unit 180 , a vehicle interface generation unit 182 , a control mode switching unit 183 , a vehicle interface vehicle interface control input determination unit 185 , a power supply unit 190 , and the like. . Since the components shown in FIG. 2 are not essential, the portable terminal 100 having more or fewer components may be implemented.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the portable terminal 100 and a wireless communication system or between the portable terminal 100 and a network in which the vehicle display apparatus 200 is located. For example, the wireless communication unit 110 may include a broadcast reception module, a mobile communication module, a wireless Internet module, a short-range communication module, a location information module, and the like.

In particular, the mobile communication module transmits and receives a radio signal to and from at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission/reception of a voice call signal, a video call signal, or a text/multimedia message.

In addition, the wireless Internet module refers to a module for wireless Internet access, and may be built-in or external to the portable terminal 100 . As wireless Internet technologies, wireless LAN (WLAN) (Wi-Fi), wireless broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), etc. may be used.

And, the short-range communication module refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, etc. may be used as short range communication technologies.

The location information module is a module for acquiring the location of the portable terminal, and a representative example thereof is a Global Position System (GPS) module, and the location information may be used to generate a vehicle interface.

The user input unit 130 generates input data for the user to control the operation of the portable terminal 100 . The user input unit 130 may include a keypad, a dome switch, a touch pad (static pressure/capacitance), a jog wheel, a jog switch, and the like. The user input unit 130 may be implemented integrally with the display unit 151 to be described later to constitute a touch screen.

The sensor unit 140 controls the operation of the portable terminal 100 or the operation of the vehicle interface by detecting the current state of the portable terminal 100, such as the orientation of the portable terminal of the portable terminal 100, acceleration/deceleration of the portable terminal, etc. to generate a sensing signal for In addition, it is also possible to sense whether the power supply unit 190 is supplied with power, whether the vehicle system connection unit 170 is coupled to an external device, and the like. Meanwhile, the sensor unit 140 may include a proximity sensor.

The sensor unit 140 may include, for example, an altitude sensor, an acceleration sensor, a geomagnetic sensor, a gyro sensor, an air pressure sensor, and the like. The altitude sensor may sense the altitude of the portable terminal 100 , and the acceleration sensor may sense a change in 3-axis acceleration of the portable terminal 100 . In addition, the geomagnetic sensor may sense a change in the surrounding magnetic field. The gyro sensor may sense a motion according to a change in gravity applied to the portable terminal 100 . Also, in an embodiment, the geomagnetic sensor of the sensor unit 140 may sense a change in a magnetic field generated according to the movement of the mounting device 300 .

The output unit 150 is for generating an output related to visual, auditory or tactile sense, and may include a display unit 151 and a sound output module 152 .

The display unit 151 displays (outputs) information processed by the portable terminal 100 according to the control mode of the portable terminal 100 under the control of the control unit 180 . For example, when the portable terminal is in the first mode, a user interface (UI) or graphic user interface (GUI) related to a call may be displayed among basic functions. Also, when the portable terminal 100 is in the second mode in which the vehicle interface is provided, a UI or GUI related to the vehicle interface may be displayed.

Also, in an embodiment of the present invention, the display unit 151 may switch all or part of the display unit to an OFF state when the display unit is switched to the second mode under the control of the controller 180 . Also, in the second mode, the display unit 151 may display a graphic object capable of user touch input on a portion of the display unit that is not turned off.

Here, the graphic object may include at least one of an arrow button for controlling the vehicle interface in the second mode, a jog wheel image, and a vehicle function button.

The display unit 151 is a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display (flexible). display) and at least one of a three-dimensional display (3D display).

When the display unit 151 and the sensor for sensing a touch operation (hereinafter, referred to as a 'touch sensor') form a layered structure (hereinafter referred to as a 'touch screen'), the display unit 151 may be used in addition to the output device. It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like. When there is a touch input to the touch sensor, a signal(s) corresponding thereto is sent to the touch controller. The touch controller processes the signal(s) and then transmits corresponding data to the controller 180 . Accordingly, the controller 180 can know which area of the display unit 151 has been touched, and the like.

For example, the display unit 151 may receive a user touch input input corresponding to the display unit in a state in which all or part of the display unit is turned off in the second mode through the touch screen.

The sound output module 152 may output audio data received from the vehicle system connection unit 170 or the wireless communication unit 110 or stored in the storage unit 160 in the first mode or the second mode. The sound output module 152 also outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the portable terminal 100 . The sound output module 152 may include a receiver, a speaker, a buzzer, and the like.

The storage unit 160 may store a program for the operation of the control unit 180 and may temporarily store input/output data. For example, the storage unit 160 may store data for providing a vehicle interface, and may store control data for vehicle interface control and wheel input.

The storage unit 160 includes a flash memory type, a hard disk type, a multimedia card micro type, and a card type storage unit (eg, an SD or XD storage unit). etc.), Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), It may include at least one type of storage medium among a magnetic storage unit, a magnetic disk, and an optical disk.

The vehicle system connection unit 170 serves as a passage with the vehicle system connected to the portable terminal 100 . The vehicle system connection unit 170 receives data from the vehicle system, receives power and transmits it to each component inside the portable terminal 100 , or transmits data including the vehicle interface inside the portable terminal 100 to the vehicle system. can be sent.

For example, the vehicle system connection unit 170 includes a wired/wireless headset port, an external charger port, a wired/wireless data port, a storage card (memory card) port, a port for connecting a device equipped with an identification module, an audio I/ An input/output (O) port, a video input/output (I/O) port, an earphone port, etc. may be included in the vehicle system connection unit 170 . For example, the vehicle display apparatus 200 may be connected to the portable terminal 100 through the vehicle system connection unit 170 . However, the vehicle display apparatus 200 may be connected to the portable terminal 100 through a network through the wireless communication unit 110 .

The vehicle system connection unit 170 may be a passage through which power from the mounting device 300 is supplied to the portable terminal 100 when the portable terminal 100 is connected to the mounting device 300 . In addition, various signals input from the mounting device 300 or the vehicle display device 200 may be a passage through which the portable terminal 100 is transmitted. Various signals or power input from the mounting device 300 may be operated as signals for recognizing that the portable terminal 100 is correctly mounted on the mounting device 300 .

Meanwhile, the controller 180 typically controls the overall operation of the portable terminal, and may perform an operation of generating a vehicle interface and providing the vehicle interface to the vehicle display apparatus 200 . In addition, the vehicle interface provided to the vehicle display apparatus 200 may be controlled by determining the wheel input of the portable terminal 100 according to various motion information.

In particular, the controller 180 controls the overall operation of the typical portable terminal 100 in the first mode, and when a mode change signal from the control mode switching unit 183 is recognized, the vehicle interface is configured to the vehicle display apparatus 200 . ) can be switched to the second mode provided by

When the vehicle display apparatus 200 is connected to the vehicle system connection unit 170 by wire or wirelessly, the control mode conversion unit 183 detects the connection and transmits a mode conversion signal to the control unit 180 to perform mode conversion. can induce

A vehicle interface according to an embodiment of the present invention includes a GUI that provides various information required by a driver of a vehicle. For example, the vehicle interface includes a navigation interface capable of guiding a route to a specific point, a black box interface that stores or transmits image information by photographing the surroundings of the vehicle, and a vehicle interface that outputs status information of various electronic units (ECUs) in the vehicle. It may be configured to include various interfaces such as a status information interface and a control interface for controlling each electric unit (ECU).

In addition, the controller 180 may generate data corresponding to the vehicle interface and provide it to the vehicle display apparatus 200 , and the vehicle display apparatus 200 may decode the data and output the vehicle interface. The data may have various formats for outputting the vehicle interface from the vehicle display apparatus 200 .

In the second mode, the controller 180 may control the vehicle interface generating unit 182 , the control mode switching unit 183 , and the vehicle interface control input determining unit 185 .

The vehicle interface generator 182 generates vehicle interface data. The vehicle interface data may be transmitted to the vehicle display apparatus 200 through the vehicle system connection unit 170 .

Also, the controller 180 may generate a control signal for controlling the vehicle interface. The controller 180 may control the vehicle interface based on the control signal. To this end, the controller 180 may control the vehicle interface by identifying at least one of a touch input, a wheel input, and a gesture input determined through the vehicle interface control input determiner 185 .

Then, the controller 180 generates a control signal and transmits it to the vehicle display device 200, or the controller 180 generates a vehicle interface screen controlled according to the control signal through the vehicle interface generator 182, and , the controlled vehicle interface screen may be provided to the vehicle display apparatus 200 .

In order to generate the control signal as described above, the vehicle interface control input determiner 185 may include a touch input determiner 185A, a wheel input determiner 185B, and a gesture determiner 185C.

The touch input determiner 185A may determine a touch input for vehicle interface control based on a user input input through the user input unit 130 or a touch sensor of the display unit 151 . The touch input determiner 185A receives a selection input or a swipe input of the graphic object according to a user input for the graphic object corresponding to the vehicle interface menu, and the touch input based on the selection input or the swipe input can be decided The controller 180 may generate a control signal for controlling the vehicle interface according to the touch input.

Meanwhile, the wheel input determining unit 185B may include at least one of the user input unit 130 , the touch sensor of the display unit 151 , vehicle motion information, motion information of the mounting device 300 , or information sensed by the sensing unit 140 . A wheel input capable of controlling the vehicle interface may be determined based on one. The controller 180 may generate a control signal for vehicle interface control according to a wheel input.

In addition, the gesture determiner 185C may determine a gesture input for vehicle interface control based on a user input input through the user input unit 130 or a touch sensor of the display unit 151 . When receiving a user input to the user input unit 130 or the display unit 151, the gesture determiner 185C may determine a gesture corresponding to the user input. The controller 180 may generate a control signal for controlling the vehicle interface according to the gesture.

For example, in the second mode, the portable terminal 100 may be placed on one side of the driver's seat. In addition, in a state in which all or part of the display unit 151 of the portable terminal 100 is turned off, the user may operate the portable terminal 100 to control the vehicle interface. Accordingly, the vehicle interface control input determiner 185 may determine a control input for controlling the vehicle interface and transmit it to the controller 180 . The controller 180 may generate a control signal for controlling the vehicle interface based on at least one of the determined touch input, wheel input, and gesture.

Operations such as menu selection and function execution of the vehicle interface output from the vehicle display apparatus 200 may be controlled by the control signal generated by the controller 180 . Accordingly, the user easily manipulates the portable terminal 100 to control the vehicle interface, thereby enabling safe driving as well as improving user convenience.

Meanwhile, the power supply unit 190 receives external power and internal power under the control of the control unit 180 to supply power required for operation of each component. The power supply unit 190 may receive wireless power through the mounting device 300 . The power supply unit 190 may be connected to the vehicle battery through the vehicle system connection unit 170 to receive operating power or charging power from the vehicle.

3 is a block diagram illustrating a detailed configuration of a vehicle display apparatus according to an embodiment of the present invention.

Hereinafter, the configuration of the vehicle display apparatus 200 will be described with reference to FIG. 3 .

The vehicle display apparatus 200 includes a control unit 210 , a communication unit 220 , an AV input unit 230 , a user input unit 240 , an output unit 250 , a vehicle information acquisition unit 260 , a storage unit 270 , and a power supply unit. (280).

The communication unit 220 of the vehicle display apparatus 200 may include one or more devices that enable wireless communication between the vehicle display apparatus 200 and a wireless communication system or between the vehicle display apparatus 200 and a network in which the portable terminal 100 is located. It may include a module, and may include an interface unit that enables communication with the portable terminal 100 or the vehicle.

Also, the communication unit 220 may be connected to the portable terminal 100 through the aforementioned wireless Internet module or short-range communication module. The communication unit 220 may receive vehicle interface data received from the portable terminal 100 wirelessly or by wire.

Meanwhile, the communication unit 220 may obtain the location of the vehicle including the location information module. A representative example is a Global Position System (GPS) module.

In particular, when the vehicle display device 200 is driven by itself as a navigation device, the vehicle display device 200 calculates the current location of the vehicle based on location data received from satellites through the GPS module, and the vehicle It is also possible to output video data and audio data corresponding to the map screen indicating the current location of the .

The AV (Audio/Video) input unit 230 is for inputting an audio signal or a video signal, and may include a camera (not shown) and a microphone (not shown). The camera may process an image frame such as a still image or a moving image obtained by an image sensor in a photographing mode to acquire at least one image of front, rear, left, and right of the vehicle.

The microphone receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, and the like, and processes it as electrical voice data.

The user input unit 240 generates input data for the user to control the operation of the vehicle display apparatus 200 . The user input unit 160 may include a keypad, a dome switch, a touch pad (static pressure/capacitance), a jog wheel, a jog switch, and the like.

The output unit 250 is for generating an output related to visual, auditory or tactile sense, and may include a display module and an audio output module as shown in FIG. 3 .

The output unit 250 displays (outputs) information processed by the vehicle display apparatus 200 through the display module. For example, when the vehicle display apparatus 200 provides navigation through a vehicle interface, a user interface (UI) or graphic user interface (GUI) related thereto may be displayed.

Also, according to an embodiment, the display module of the output unit 250 may display the vehicle interface received from the portable terminal 100 . The display module includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display. , may include at least one of a 3D display, and may be displayed in the form of a Head Up Display (HUD).

The audio output module of the output unit 250 may output a voice such as navigation provided through a vehicle interface or audio data stored in the storage unit 270 . The audio output module 250 may include a receiver, a speaker, a buzzer, and the like.

The controller 210 controls the overall operation of the vehicle display apparatus 200 .

In particular, the controller 210 may provide a vehicle interface through the output unit 250 and may control the vehicle interface based on a control signal received from the portable terminal 100 .

Also, in an embodiment of the present invention, the controller 210 may receive audio and video (AV) data corresponding to the vehicle interface from the portable terminal 100 and output only the audio and video data through the output unit 250 . In this case, when the portable terminal 100 controls the vehicle interface according to the wheel input and transmits AV data corresponding to the control result, the control unit 210 receives the AV data through the output unit 250 . can be printed out.

Also, the controller 210 may collect vehicle motion information acquired through the vehicle information acquisition unit 260 and transmit it to the portable terminal 100 . The vehicle motion information may be used to accurately determine a vehicle interface control input in the portable terminal 100 .

For example, the portable terminal 100 determines a wheel input based on the motion information of the portable terminal 100 and the vehicle motion information, and controls the vehicle interface or the vehicle display device ( 200) may be transmitted to the controller 210.

Meanwhile, the vehicle information acquisition unit 260 may acquire vehicle information for providing a vehicle interface. The vehicle information obtaining unit 260 may include a vehicle motion sensing module 261 and a driving information detecting unit 262 . The vehicle information acquisition unit 260 may transmit the acquired vehicle information to the control unit 210 . The vehicle information may include, for example, vehicle motion information and driving information.

The vehicle motion sensing module 261 senses the vehicle motion information. The vehicle motion sensing module 261 may generate a sensing signal by sensing the motion of the vehicle display device 200 according to the position, orientation, acceleration, or deceleration of the vehicle display device 200 of the vehicle display device 200 . . The vehicle motion information may be used by the portable terminal 100 to accurately determine a wheel input.

The driving information detection unit 262 may be connected to an ECU (Electronic Control Unit), which is an air conditioning control system of a vehicle, and detects driving information from the vehicle. The driving information may include, for example, at least one of speed, time, temperature, driving distance, fuel amount, and engine oil life.

Meanwhile, the storage 270 may store various information for providing a vehicle interface. For example, the storage unit 270 may temporarily store AV data corresponding to the vehicle interface received from the portable terminal 100 . Also, the storage unit 270 may store vehicle motion information and driving information obtained by the vehicle information acquisition unit 260 .

The power supply unit 280 supplies power for the overall operation of the vehicle display apparatus 200 . The vehicle display apparatus 200 may be connected to a vehicle battery to receive operating power.

On the other hand, as described above, the communication between the components inside the vehicle display apparatus 200 or the communication between the vehicle display apparatus 200 and an external module may be made using a CAN (Controller Area Network) communication method, and the CAN communication can refer to a standard communication standard designed for microcontrollers or devices to communicate with each other in a vehicle without a host computer.

4 is a diagram illustrating an operation of a portable terminal according to an embodiment of the present invention.

Referring to FIG. 4 , first, the portable terminal 100 operates in a first mode providing a basic function ( S101 ).

The output unit 150 may output a first interface capable of controlling a basic function of the terminal through the display unit 151 .

Then, the portable terminal 100 detects whether it is connected to the vehicle display apparatus 200 (S103).

The sensing unit 140 may detect an interface connection with the vehicle display apparatus 200 to detect a connection with the vehicle display apparatus 200 . Also, the sensing unit 140 may detect a connection between the portable terminal 100 and the mounting device 300 to detect a connection with the vehicle display device 200 .

Also, the portable terminal 100 may be connected to the vehicle display apparatus 200 through the wireless communication unit 110 . In this case, authentication between the portable terminal 100 and the vehicle display apparatus 200 may be performed, and connection with the vehicle display apparatus 200 may be detected only when approved.

Then, when the portable terminal 100 is connected to the vehicle display apparatus 200, the portable terminal 100 outputs a vehicle interface to the vehicle display apparatus and switches to the second mode for controlling the vehicle interface (S105) ).

And, in the second mode, the portable terminal 100 turns off all or part of the display unit 151 (S107).

As described above, the portable terminal 100 may prepare for receiving the vehicle interface control input by turning all or part of the display unit 151 into an OFF state in the second mode. The display unit 151 may display a GUI including a graphic object for vehicle interface control on a non-OFF partial area of the display unit 151 in a state in which all or part of the display unit is turned OFF.

Then, the portable terminal 100 determines a vehicle interface control input for controlling the vehicle interface based on the user input (S113), and generates a control signal for controlling the vehicle interface according to the control input (S115). .

The controller 180 may generate a control signal for vehicle interface control, and the control signal may include at least one of a touch input, a gesture input, and a wheel input. Here, the touch input may include the aforementioned selection input or swipe input. In addition, the wheel input may be determined according to the touch input or may be determined according to the rotational movement of the portable terminal 100 or the rotational movement of the mounting device 300 . In addition, the gesture input may be determined according to the touch input or may be determined according to the user's movement information sensed by the sensing unit 140 .

The controller 180 may generate various control signals, such as menu movement, menu switching, and function call, based on at least one of the selection input, swipe input, gesture input, and wheel input. The controller 180 may control the vehicle interface based on the generated control signal or transmit the generated control signal to the vehicle display apparatus 200 .

In particular, when determining the wheel input, the controller 180 obtains motion information of the vehicle in which the terminal is located, and removes the vehicle motion information from the motion information of the terminal to obtain the control signal corresponding to the wheel input. can create More specifically, the sensing unit 140 detects the movement of the portable terminal 100 for wheel input, but since the portable terminal 100 is located inside the vehicle, it is directly affected by changes in vehicle speed and acceleration. Therefore, in order to detect only the movement of the portable terminal 100 by the user's intention, regardless of the movement information of the vehicle, the controller 180 further performs a process of removing the movement information of the vehicle from the movement information of the terminal. can be done

5 is a flowchart illustrating an operation of a portable terminal according to another embodiment of the present invention.

Referring to FIG. 5 , the portable terminal 100 first switches to the second mode for providing the vehicle interface ( S201 ), and determines whether the remaining battery level is less than or equal to a predetermined standard ( S203 ).

When the power supply unit 190 is switched to the second mode providing the vehicle interface under the control of the controller 180 , the power supply unit 190 may measure the remaining battery amount, and the controller 180 may measure the remaining battery amount when the second mode is switched based on this can be judged

In addition, when the remaining battery level of the portable terminal 100 is less than or equal to a certain standard, the portable terminal 100 switches all the states of the display unit 151 of the portable terminal 100 to OFF (S207). is determined (S209).

On the other hand, the portable terminal 100, when the remaining battery level exceeds a predetermined standard, switches a part of the display unit 151 of the portable terminal 100 to OFF (S211), and a graphic object for vehicle interface control in the non-OFF area is output (S213), and a vehicle interface control input is determined based on the user input corresponding to the graphic object (S15).

As described above, as the portable terminal 100 is changed to the second mode for vehicle interface control, the controller 180 may switch the state of the display unit 151 to all or part OFF. In particular, when the battery is below a certain standard, fast charging of the portable terminal 100 may be required or the function may not operate smoothly. Accordingly, when the portable terminal 100 is switched to the second mode, all of the display units 151 are turned OFF, and only the gesture input for the display units 151 that are all OFF can be received. To this end, the power supply unit 190 of the portable terminal 100 may reduce or block power supply to modules other than the touch sensor of the display unit 151 .

On the other hand, when the battery of the portable terminal 100 is not lower than a predetermined standard, the controller 180 may output a graphic object for vehicle interface control on a part of the display unit 151 . The portable terminal 100 may receive various inputs such as a touch input corresponding to a graphic object and a wheel input.

Thereafter, the portable terminal 100 controls the vehicle interface according to the determined control input (S217).

6 to 10 show various implementations of controlling a vehicle interface provided to a vehicle display device according to a user input of a portable terminal according to an embodiment of the present invention.

As shown in FIG. 6 , according to an embodiment of the present invention, the portable terminal 100 may be mounted on the mounting device 300 , and may be connected to the vehicle display device 200 by wire or wirelessly.

On the other hand, the mounting device 300 may include a circular structure so that the portable terminal 100 is rotatably mounted. In addition, the mounting device 300 may further include an interface hole (not shown) so that the portable terminal 100 is connected to the vehicle display device 200 and the cable 105 . In addition, the mounting device 300 may include a wireless charging circuit to provide vehicle power to the portable terminal 100 even when not connected by a cable.

In addition, when the portable terminal 100 is connected to the vehicle display apparatus 200 , it may provide a vehicle interface to the vehicle display apparatus 200 and receive a control input for controlling the vehicle interface.

6 illustrates a case in which a selection input is received among control inputs. In order to receive the selection input, the portable terminal 100 may display at least one graphic object 101 , 103 , and 105 on a part of the display unit 151 . In addition, the shaded portion in FIG. 6 may indicate that it is OFF. Accordingly, battery consumption can be minimized.

Then, the user may input a selection input by touching the graphic objects 101 , 103 , and 105 . When the touch input determining unit 185A detects a user's touch, the touch input determining unit 185A may determine a selection input of the graphic object according to a distance from the graphic object 101 , 103 , and 105 . In addition, the controller 180 may control the vehicle display output to the vehicle display apparatus 200 . 6 illustrates that the selector 205 of the vehicle interface output to the vehicle display apparatus 200 is controlled according to a user selection input. The selector 205 may be provided operably by a user to execute a function of the vehicle interface, and may be moved in units of menu items corresponding to each function.

As shown in FIG. 6 , the user selects a single-stage move menu 103 for a one-stage movement, a two-stage movement menu 105 for a two-stage movement, or a selector 205 in units of menu items of the selector 205 . At least one of the confirmation buttons 101 for executing the located menu item may be selected.

Accordingly, the controller 180 moves the selector 205 of the vehicle interface output to the vehicle display device 200 one or two steps in a specific direction or controls a function corresponding to the menu item in which the selector 205 is located. can be run

And, FIG. 7 shows a case in which a swipe input is received among control inputs. In order to receive the swipe input, the portable terminal 100 may display at least one graphic object 101 , 103 , and 105 on a part of the display unit 151 . In addition, the shaded portion in FIG. 7 may indicate that it is OFF. Accordingly, battery consumption can be minimized.

In addition, the user may input a swipe input corresponding to the graphic objects 101 , 103 , and 105 as a continuous touch. The touch input determiner 185A may determine a swipe input based on at least one of a direction and a length identified from a user's continuous touch. In addition, the controller 180 may control the vehicle display output to the vehicle display apparatus 200 according to a swipe input. 7 illustrates that the selector 205 of the vehicle interface output to the vehicle display apparatus 200 is controlled according to a swipe input.

For example, the vehicle interface may include a plurality of menu items, and the controller 180 identifies a swipe input indicating movement of the selector 205 to select the menu items from the continuous touch input. and the movement of the selector 205 may be controlled according to the swipe input.

As shown in FIG. 7 , the user may select the moving direction of the selector 205 for controlling the vehicle interface and the unit of the menu item to be moved at once by a swipe input. For example, when the user continuously touches and swipe input from the center to the two-stage movement menu 105 at a time, the portable terminal 100 moves the selector 205 in units of two or more items. can

For example, the controller 180 may move the selector 205 in units of one menu item when the swipe input is equal to or less than a predetermined value, and when the swipe input is equal to or greater than a predetermined value, the selector 205 may be moved in units of a predetermined second menu item larger than the unit of one menu item.

Here, the controller 180 may identify a direction of the swipe input and, when the swipe input corresponds to a predetermined direction, execute a first function of the vehicle interface corresponding to the predetermined direction.

In addition, the controller 180 identifies the length of the swipe input, and when the swipe input corresponds to the predetermined direction and the length is greater than the predetermined length, the controller 180 identifies a first function different from the first function of the vehicle interface. 2 functions can be executed.

Accordingly, the controller 180 may move the selector 205 of the vehicle interface output to the vehicle display device 200 in a specific direction in units of one or more menu items based on the user's swipe input. , it is possible to execute a variety of different functions.

Meanwhile, FIG. 8 illustrates another embodiment of a graphic object of the portable terminal 100 for receiving a selection input among control inputs.

As shown in FIG. 8 , the portable terminal 100 may separately generate and display a vehicle interface remote control screen 107 for controlling the vehicle display apparatus 200 for vehicle interface control. Accordingly, the user may input a selection input for controlling the vehicle interface by touching at least one of the menu items displayed on the vehicle interface remote control screen 107 . Meanwhile, the display unit 151 in the shaded area where the vehicle interface remote control screen 107 is not displayed may be controlled in an OFF state.

Accordingly, the controller 180 may execute a function corresponding to a menu item selected on the vehicle interface remote control screen 107 , and may output a vehicle interface controlled according to this to the vehicle display apparatus 200 .

9 illustrates another embodiment of a graphic object of the portable terminal 100 for receiving a wheel input among control inputs.

Meanwhile, the vehicle interface displayed on the vehicle display apparatus 200 may be controllable through a wheel input. For example, the vehicle interface may be implemented in a controllable form through a currently commercialized jog wheel or the like. In this case, the portable terminal 100 according to an embodiment of the present invention may improve user convenience by displaying the graphic object in a form that is easy for wheel manipulation.

Accordingly, as shown in FIG. 9 , the portable terminal 100 may separately generate and display a wheel screen 109 for controlling the vehicle display apparatus 200 by using a wheel input. For example, the wheel screen 109 may include a circular jog wheel image. The user may input a rotation touch to rotate the jog wheel image displayed on the wheel screen. Accordingly, the wheel input determining unit 185B may determine the wheel input according to the rotation angle and rotation direction of the wheel image identified from the rotation touch.

When the wheel input is determined, the controller 180 may control the vehicle interface according to the wheel input. For example, the controller 180 may control the rotation direction and degree of rotation of the selector 205 according to a wheel input, thereby helping the user to easily select or execute a vehicle eat-in-face function.

Also, in the present embodiment, the display unit 151 in the shaded area where the wheel screen 109 is not displayed may be controlled to be OFF.

10 illustrates an embodiment of the portable terminal 100 for receiving a gesture input among control inputs.

In order to control the vehicle interface output to the vehicle display apparatus 200 , the portable terminal 100 may receive a gesture input.

The gesture input may be preferably received when the display unit 151 is all turned off. Since the driver may interfere with safe driving the moment the driver looks at the portable terminal 100 , it may be desirable that the display unit 151 be all turned off. Accordingly, when the graphic object is not displayed at all, the vehicle interface may operate depending on the gesture input input only through the touch sensor.

Accordingly, the gesture determiner 185C may determine a gesture input for controlling the vehicle interface from the user's touch input. The controller 180 may control the vehicle interface based on the gesture input.

To this end, as shown in FIG. 10 , the vehicle display apparatus 200 may display a gesture guide for each menu for inputting a gesture to the vehicle interface. In addition, the user may input the same gesture as the gesture displayed on the guide. Accordingly, the portable terminal 100 can control the vehicle interface by executing a menu corresponding to the gesture.

Meanwhile, in the present embodiment, since all outputs of the display unit 151 are maintained in an OFF state, power efficiency can be improved. In addition, as described above, since the driver's view is not obstructed, safe driving can be achieved.

11 is a flowchart illustrating an operation of a vehicle display apparatus according to another embodiment of the present invention.

As described above, the vehicle display apparatus 200 may receive the vehicle interface generated by the portable terminal 100 and output only the image and sound signals through the output unit 250. In this case, the portable terminal 100 The vehicle interface may be controlled by generating a control signal for controlling the vehicle interface according to a user input, and the vehicle display apparatus 200 may output the control result.

Also, according to another embodiment of the present invention, the vehicle display apparatus 200 provides a vehicle interface generated by the vehicle display apparatus 200 , and when the portable terminal 100 is connected, the wheel of the portable terminal 100 is connected. A vehicle interface control of the vehicle display apparatus 200 may be performed by receiving a control signal generated according to an input.

Referring to FIG. 11 , the vehicle display apparatus 200 according to another embodiment of the present invention first provides a vehicle interface ( S301 ).

The control unit 210 may receive or generate vehicle interface data and provide it through the output unit 250 .

Then, when the connection with the portable terminal 100 is detected (S203), the vehicle display apparatus 200 applies all or part of the control authority to the portable terminal 100 (S305).

The control unit 210 may determine whether the terminal has the vehicle interface control authority through authentication with the connected portable terminal 100 , and may apply the vehicle interface control authority if authenticated.

In addition, the vehicle display apparatus 200 provides vehicle motion information to the portable terminal 100 . The vehicle information acquisition unit 260 may acquire vehicle information including vehicle motion information, and the vehicle motion information may be used by the portable terminal 100 to determine an accurate control input.

Thereafter, the vehicle display apparatus 200 receives a vehicle interface control signal from the portable terminal 100 (S311).

The portable terminal 100 may determine a control input using the methods described above through the vehicle interface control input determiner 185 and may generate a control signal according to the control input. The control signal may be transmitted to the vehicle display apparatus 200 through the vehicle system connection unit 170 or the wireless communication unit 110 .

Then, the vehicle display apparatus 200 controls the vehicle interface according to the received control signal (S311).

According to the embodiment of the present invention as described above, by using the user input of the portable terminal, it is possible to easily realize the vehicle interface control provided to the vehicle display device without a separate installation process or at low cost.

Meanwhile, the above-described methods according to various embodiments of the present invention may be implemented as program codes and provided to each server or device while being stored in various non-transitory computer readable media.

The non-transitory readable medium refers to a medium that stores data semi-permanently, rather than a medium that stores data for a short moment, such as a register, cache, memory, etc., and can be read by a device. Specifically, the above-described various applications or programs may be provided by being stored in a non-transitory readable medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

In addition, although preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention as claimed in the claims In addition, various modifications may be made by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or perspective of the present invention.

100: portable terminal
200: vehicle display device
300: mount

Claims (7)

A method of operating a vehicle display device, comprising:
providing a vehicle interface generated by the vehicle display device;
when the vehicle display device detects a connection to the portable terminal, applying all or part of the control authority to the portable terminal;
receiving, by the vehicle display device, a vehicle interface control signal from the portable terminal;
controlling the vehicle interface according to the received control signal by the vehicle display device;
A method of operating a vehicle display device.
The method of claim 1,
The vehicle display device,
When the connection with the portable terminal is detected, it is checked whether the terminal has the vehicle interface control authority through authentication with the connected portable terminal, and when authenticated, the vehicle interface control authority is applied to the corresponding portable terminal.
A method of operating a vehicle display device.
The method of claim 1,
The vehicle display device,
After the vehicle interface control authority is applied to the portable terminal, the vehicle display device providing vehicle motion information to the portable terminal.
A method of operating a vehicle display device.
The method of claim 1,
The portable terminal is
when the portable terminal is connected to a vehicle display device, receiving permission for controlling a vehicle interface from the vehicle display device, and switching to a second mode for controlling the vehicle interface; and
in the second mode, controlling the vehicle interface according to a user input for vehicle interface control corresponding to the vehicle interface
A method of operating a vehicle display device.
A method of operating a vehicle display device, comprising:
when the vehicle display device detects a connection to the portable terminal, applying all or part of the control authority to the portable terminal;
providing, by the vehicle display device, vehicle motion information to the portable terminal;
receiving and outputting, by the vehicle display device, a vehicle interface generated and provided by the portable terminal;
receiving, by the vehicle display device, a vehicle interface control signal from the portable terminal;
controlling the vehicle interface according to the received control signal by the vehicle display device;
A method of operating a vehicle display device.
The method of claim 1,
The vehicle display device,
When the connection with the portable terminal is detected, it is checked whether the terminal has the vehicle interface control authority through authentication with the connected portable terminal, and when authenticated, the vehicle interface control authority is applied to the corresponding portable terminal.
A method of controlling a vehicle display device.
A vehicle display device comprising:
a communication unit including one or more modules enabling wireless communication between the vehicle display device and the wireless communication system or between the vehicle display device and a network in which the portable terminal is located, and including an interface unit enabling communication with the portable terminal or vehicle;
AV (Audio/Video) input unit for receiving an audio signal or video signal input through a microphone or a camera;
a user input unit for generating input data for a user to control an operation of the vehicle display apparatus;
an output unit for outputting information processed by the vehicle display device through the display module;
a vehicle information acquisition unit configured to acquire vehicle information including vehicle motion information and driving information for providing a vehicle interface;
Controls the operation of the vehicle display device based on user input data input through the user input unit, provides a vehicle interface through the output unit, and detects a connection to the portable terminal through authentication with the connected portable terminal. A control unit that checks whether the terminal has the interface control authority, applies the control authority of the vehicle interface to the corresponding portable terminal if it is authenticated, and receives a vehicle interface control signal from the portable terminal to control the vehicle interface;
vehicle display device.

Images