KR20220135571A - Vehicle infotainment system and operating method thereof - Google Patents

Abstract

The present invention relates to a vehicle infotainment system and an operation method thereof. The vehicle infotainment system according to one embodiment may comprise: a communication unit which performs communication with a user terminal; a control unit receiving at least one of screen information and control command information for a vehicle-linked application installed in the user terminal from the user terminal through the communication unit; and a display unit providing at least one of the screen information and the control command information to the exterior. Provided are the infotainment system providing various functions of a smart phone, and the operation method thereof.

Description

Vehicle infotainment system and operating method thereof

Various embodiments according to the present disclosure relate to a vehicle infotainment system and an operating method thereof, and more particularly, to a vehicle infotainment system that receives and displays screen information and control command information from a user terminal.

With the recent development of information and communication technology, the automobile industry is actively conducting research on smart cars equipped with ICT technology. In particular, in the case of an infotainment system that provides functions such as audio, video, and navigation, a technology such as a mirror link can be applied, so the infotainment system field is the field that can provide the driver's convenience and usability most directly. to be.

However, in the conventional mirroring technology, only a limited number of functions of the smartphone can be transmitted to the infotainment device, and there is a disadvantage that the screen cannot be changed according to the user's taste.

Patent Document 1: Korean Patent Publication No. 10-1685060

Various embodiments according to the present disclosure may provide an infotainment system that provides various functions of a smartphone using a vehicle linkage application installed on a user's smartphone, and an operating method thereof.

In addition, it is possible to provide an infotainment system that performs two-way communication for transmitting and receiving data with a smart phone and an operating method thereof.

Also, it is possible to provide an infotainment system that provides screen information changed based on a user's frequency of use and an operating method thereof.

The technical problems to be achieved by the present disclosure are not limited to the technical problems as described above, and other technical problems may be inferred from the following embodiments.

A vehicle infotainment system according to an embodiment includes a communication unit that communicates with a user terminal, a control unit that receives at least one of screen information and control command information for a vehicle-linked application installed in the user terminal from the user terminal through the communication unit, and It may include a display unit that provides at least one of screen information and control command information to the outside.

In an embodiment, the screen information may be information about an execution user interface (UI) of a vehicle-linked application executed based on a user input to the user terminal.

In an embodiment, the execution UI of the vehicle interworking application may include at least one of a radio application, an audio application, a video application, a navigation application, a call application, a message application, and a control application.

In an embodiment, the control unit may receive screen information rearranged according to an arrangement order set based on the frequency of use of the vehicle user from the user terminal for a plurality of objects included in the vehicle interworking application, and display it through the display unit have.

In an embodiment, the control command information may include at least one of a control command corresponding to a user's touch input to the display of the user terminal and a control command corresponding to a user's voice input to the microphone of the user terminal.

In an embodiment, when receiving the control command information from the user terminal, the control unit may transmit the control command information to the vehicle driving unit for controlling the operation of the component device of the vehicle.

A method of operating a vehicle infotainment system according to an embodiment includes an operation of performing communication with a user terminal, an operation of receiving at least one of screen information and control command information for a vehicle-linked application installed in the user terminal from the user terminal, and It may include an operation of providing at least one of screen information and control command information to the outside.

In an embodiment, the screen information may be information about an execution user interface (UI) of a vehicle-linked application executed based on a user input to the user terminal.

In an embodiment, the execution UI of the vehicle interworking application may include at least one of a radio application, an audio application, a video application, a navigation application, a call application, a message application, and a control application.

In an embodiment, the method of operating a vehicle infotainment system includes receiving screen information rearranged according to an arrangement order set based on a vehicle user's frequency of use from a user terminal for a plurality of objects included in a vehicle interworking application and displaying the received information from a user terminal. It may further include an action.

In an embodiment, the control command information may include at least one of a control command corresponding to a user's touch input to the display of the user terminal and a control command corresponding to a user's voice input to the microphone of the user terminal.

In an embodiment, the method of operating a vehicle infotainment system may further include, when receiving control command information from a user terminal, transmitting the control command information to a vehicle driving unit that controls the operation of a component device of the vehicle.

A user terminal according to an embodiment includes a communication unit that communicates with a vehicle infotainment system, a memory for storing a vehicle-linked application including a plurality of applications set to interwork with the vehicle infotainment system, and screen information for the vehicle-linked application and The control unit may include a control unit that transmits at least one of the control command information to the vehicle infotainment system through the communication unit.

In an embodiment, the screen information may be information about an execution user interface (UI) of a vehicle-linked application executed based on a user input.

In an embodiment, the controller sets an arrangement order for a plurality of objects included in the vehicle interworking application based on the frequency of use of the vehicle user, and transmits screen information rearranged according to the set arrangement order to the vehicle infotainment system. can

In an embodiment, the display device further includes a display for receiving a user's touch input, and a microphone for receiving a user's voice input, wherein the control command information includes a control command corresponding to the user's touch input on the display and the user's response to the microphone. It may include at least one of a control command corresponding to a voice input.

The vehicle infotainment system and the operating method thereof according to various embodiments of the present disclosure may receive updated functions through a vehicle linkage application installed in the user's smartphone without performing a separate software update.

In addition, since the vehicle infotainment system and its operating method according to various embodiments of the present disclosure can perform two-way communication with a smartphone, the smartphone can transmit vehicle control commands as well as data on the control result. You may receive it immediately.

In addition, the vehicle infotainment system and the operating method thereof according to various embodiments of the present disclosure may provide screen information on which user customization is performed through a vehicle interworking application installed in a smartphone.

Effects according to various embodiments of the present disclosure are not limited to the above-described effects, and effects not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the present specification and accompanying drawings. will be able

1 is a block diagram illustrating components of a vehicle according to various embodiments of the present disclosure;
2 is a block diagram of a vehicle infotainment system and a user terminal according to an exemplary embodiment.
3 is a conceptual diagram illustrating a vehicle infotainment system and a user terminal according to an exemplary embodiment.
4A illustrates a first UI state of a user terminal according to an embodiment.
4B illustrates a second UI state of a user terminal according to an embodiment.
4C illustrates a third UI state of a user terminal and a display screen state of a vehicle infotainment system according to an exemplary embodiment.
4D illustrates a fourth UI state of a user terminal and a display screen state of a vehicle infotainment system according to an exemplary embodiment.
5A illustrates a fifth UI state of a user terminal according to an embodiment.
5B illustrates a sixth UI state of a user terminal and a display screen state of a vehicle infotainment system according to an embodiment.
6A illustrates a seventh UI state of a user terminal according to an embodiment.
6B illustrates an eighth UI state of a user terminal according to an embodiment.
6C illustrates a ninth UI state of a user terminal according to an exemplary embodiment.
6D illustrates a tenth UI state of a user terminal according to an embodiment.
6E illustrates an eleventh UI state of a user terminal according to an embodiment.
6F illustrates a twelfth UI state of a user terminal and a display screen state of a vehicle infotainment system according to an exemplary embodiment.

Terms used in the embodiments are selected as currently widely used general terms as possible while considering functions in the present embodiments, but may vary according to intentions or precedents of those of ordinary skill in the art, emergence of new technologies, and the like. In addition, in a specific case, there is a term arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the corresponding embodiments. Therefore, the terms used in the present embodiments should be defined based on the meaning of the term and the overall contents of the present embodiments, rather than the name of a simple term.

In the entire specification, when a part "includes" or "includes" a certain component, it means that other components may be further included, rather than excluding other components, unless otherwise stated. In addition, terms such as “…unit” and “…module” described in the specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software, or a combination of hardware and software.

Hereinafter, with reference to the accompanying drawings, the embodiments will be described in detail so that those of ordinary skill in the art to which the embodiments pertain can easily implement them. However, the embodiments may be implemented in several different forms and are not limited by the embodiments described herein.

Throughout the specification, an 'embodiment' is an arbitrary division for easily describing the invention in the present specification, and each of the embodiments is not necessarily mutually exclusive. For example, components disclosed in one embodiment may be applied and implemented in other embodiments, and may be changed and applied and implemented without departing from the spirit and scope of the present specification.

Meanwhile, the terms used herein are for the purpose of describing the embodiments and are not intended to limit the present embodiments. In this specification, the singular also includes the plural, unless specifically stated otherwise in the phrase.

Hereinafter, the present disclosure will be described in detail with reference to the accompanying drawings.

1 is a block diagram illustrating components of a vehicle according to various embodiments of the present disclosure;

Referring to FIG. 1 , a vehicle 100 according to various embodiments includes a communication unit 110 , an input unit 120 , a sensing unit 125 , a memory 130 , an output unit 140 , a vehicle driving unit 150 , and a vehicle. It may include a driving assistance system (ADAS) 160 , a control unit 170 , an interface unit 180 , and a power supply unit 190 .

The communication unit 110 may include a short-range communication module, a location information module, an optical communication module, and a V2X communication module.

The input unit 120 may include a driving operation means, a camera, a microphone, and a user input unit.

The driving operation means receives a user input for driving the vehicle 100 . The driving operation means may include a steering input means, a shift input means, an acceleration input means, and a brake input means.

The acceleration input means receives an input for acceleration of the vehicle 100 from a user. The brake input means receives an input for decelerating the vehicle 100 from a user.

The camera may include an image sensor and an image processing module. The camera can process still images or moving images obtained by an image sensor (eg, CMOS or CCD). The image processing module may process a still image or a moving image obtained through an image sensor, extract necessary information, and transmit the extracted information to the controller 170 .

Meanwhile, the vehicle 100 may include a front camera for photographing an image of the front of the vehicle, an around-view camera for photographing an image around the vehicle, and a rear camera for photographing an image of the rear of the vehicle. Each camera may include a lens, an image sensor and a processor. The processor may computer-process the captured image to generate data or information, and transmit the generated data or information to the controller 170 . The processor included in the camera may be controlled by the controller 170 . In an embodiment, the camera captures a QR code affixed to a parking area or around a parking area of an aggregation building, for example on the floor or a pillar of the parking area.

The camera may include a stereo camera. In this case, the processor of the camera may detect the distance to the object, the relative speed to the object detected in the image, and the distance between the plurality of objects by using a disparity difference detected in the stereo image.

The camera may include a Time of Flight (TOF) camera. In this case, the camera may include a light source (eg, infrared or laser) and a receiver. In this case, the processor of the camera detects the distance to the object, the relative speed to the object, and the distance between the plurality of objects based on the time (TOF) until the infrared or laser emitted from the light source is reflected by the object and received. can do.

Meanwhile, the rear camera may be disposed in the vicinity of the rear license plate or the trunk or tailgate switch, but the position where the rear camera is disposed is not limited thereto.

Each image captured by the plurality of cameras may be transmitted to a processor of the camera, and the processor may synthesize the respective images to generate an image around the vehicle. In this case, the image around the vehicle may be displayed through the display unit as a top view image or a bird's eye image.

The sensing unit 125 senses various situations of the vehicle 100 . To this end, the sensing unit 125 includes a collision sensor, a wheel sensor, a speed sensor, an inclination sensor, a weight sensor, a heading sensor, a yaw sensor, and a gyro sensor. , position module, vehicle forward/reverse sensor, battery sensor, fuel sensor, tire sensor, steering sensor by steering wheel rotation, vehicle interior temperature sensor, vehicle interior humidity sensor, ultrasonic sensor, illuminance sensor, radar, lidar, etc. may include

Accordingly, the sensing unit 125 may include vehicle collision information, vehicle direction information, vehicle location information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle inclination information, vehicle forward/reverse information, and battery information. , fuel information, tire information, vehicle lamp information, vehicle internal temperature information, vehicle internal humidity information, steering wheel rotation angle, and sensing signals for external illumination of the vehicle may be acquired.

The memory 130 is electrically connected to the control unit 170 . The memory 130 may store basic data for the unit, control data for operation control of the unit, and input/output data. The memory 130 may be a variety of storage devices such as ROM, RAM, EPROM, flash drive, hard drive, etc. in terms of hardware. The memory 130 may store various data for the overall operation of the vehicle 100 , such as a program for processing or controlling the controller 170 .

The output unit 140 is for outputting information processed by the control unit 170 , and may include a display unit, a sound output unit, and a haptic output unit.

The display unit may display information processed by the control unit 170 . For example, the display unit may display vehicle-related information. Here, the vehicle-related information may include vehicle state information indicating the current state of the vehicle or vehicle operation information related to the operation of the vehicle. For example, the display unit may display the current speed (or speed) of the vehicle, the speed (or speed) of the surrounding vehicle, and distance information between the current vehicle and the surrounding vehicle.

Meanwhile, the display unit may include a cluster so that the driver can check vehicle state information or vehicle operation information while driving. The cluster may be located above the dashboard. In this case, the driver may check the information displayed on the cluster while keeping the gaze in front of the vehicle.

The sound output unit converts the electric signal from the controller 170 into an audio signal and outputs the converted signal. To this end, the sound output unit may include a speaker or the like.

The vehicle driving unit 150 may control operations of various devices of the vehicle. The vehicle driving unit 150 may include a power source driving unit, a steering driving unit, a brake driving unit, a lamp driving unit, an air conditioning driving unit, a window driving unit, an airbag driving unit, a sunroof driving unit, and a suspension driving unit.

The power source driving unit may perform electronic control of the power source in the vehicle 100 . For example, when a fossil fuel-based engine (not shown) is a power source, the power source driving unit may electronically control the engine. Thereby, the output torque of an engine, etc. can be controlled. When the power source driving unit is the engine, the speed of the vehicle may be limited by limiting the engine output torque under the control of the controller 170 .

The brake driving unit may perform electronic control of a brake apparatus (not shown) in the vehicle 100 . For example, the speed of the vehicle 100 may be reduced by controlling the operation of a brake disposed on the wheel. As another example, the moving direction of the vehicle 100 may be adjusted to the left or right by changing the operation of the brakes respectively disposed on the left wheel and the right wheel.

The lamp driving unit may control turning on/off of lamps disposed inside and outside the vehicle. In addition, it is possible to control the intensity and direction of the light of the lamp. For example, control of a direction indicator lamp, a brake lamp, and the like may be performed.

The controller 170 may control the overall operation of each unit in the vehicle 100 . The control unit 170 may be referred to as an Electronic Control Unit (ECU). The above-described accident determination apparatus may be driven by the control unit 170 .

The control unit 170, in hardware, ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays), processors ( processors), controllers, micro-controllers, microprocessors, and other electrical units for performing other functions may be implemented using at least one.

In one embodiment, the control unit 170 extracts an identification image from the identification code photographed through the camera, and when the extracted identification image is recognizable, extracts information corresponding to the photographed identification code, and transmits the extracted information to the communication network transmitted to the user terminal through Here, the extracted information may include location information for a parking area in which the vehicle is parked, guide information for an assembly building, parking payment information, or reservation and payment information within the assembly building.

The interface unit 180 may serve as a passage with various types of external devices connected to the vehicle 100 . For example, the interface unit 180 may have a port connectable to a mobile terminal (not shown), and may be connected to a mobile terminal (not shown) through the port. In this case, the interface unit 180 may exchange data with the mobile terminal.

The power supply unit 190 may supply power required for the operation of each component under the control of the control unit 170 . In particular, the power supply unit 190 may receive power from a battery (not shown) inside the vehicle.

2 is a block diagram of a vehicle infotainment system 200 and a user terminal 240 according to an exemplary embodiment.

Referring to FIG. 2 , the vehicle infotainment system 200 may include a communication unit 210 , a control unit 220 , and a display unit 230 . The vehicle infotainment system 200 may be expressed in terms such as “infotainment device”, “AVN device” or “head unit”.

In an embodiment, the communication unit 210 may communicate with the user terminal 240 . In an embodiment, the communication unit 210 may include a wireless communication module (eg, a cellular communication module, a short-range wireless communication module, etc.). The communication unit 210 including the wireless communication module may communicate with the user terminal 240 through a short-range communication network such as Bluetooth, WIFI direct, or infrared data association (IrDA).

In an embodiment, the controller 220 may receive at least one of screen information and control command information for the vehicle-linked application 246 installed in the user terminal 240 . In an embodiment, the screen information may refer to information on an execution user interface (UI) of the vehicle interworking application 246 executed based on a user input to the user terminal 240 . In an embodiment, the control command information may mean information about a control command corresponding to at least one of a user touch input and a user voice input. For example, the control command corresponding to the user's touch input may mean a control command according to the touch input to the display 250 of the user terminal 240 . As another example, the control command corresponding to the user's voice input may mean a control command according to the voice input to the microphone 252 of the user terminal 240 .

In an embodiment, the display 230 may provide at least one of screen information and control command information received from the user terminal 240 to the outside. In an embodiment, the control unit 220 may adaptively change the screen information received from the user terminal 240 with respect to the screen size of the vehicle infotainment system 200 and provide it to the outside through the display unit 230 . have. For example, when screen information of a 16:9 ratio is received from the user terminal 240 and the screen size of the vehicle infotainment system 200 is optimal for a 4:3 ratio, the control unit 220 receives the received 16: The screen information of the 9 ratio may be changed to the 4:3 ratio and provided to the outside through the display unit 230 . As another example, when screen information of a 16:9 ratio is received from the user terminal 240 and the screen size of the vehicle infotainment system 200 is optimal for a 4:3 ratio, the controller 220 may control the received 16:9 ratio. Screen information of a :9 ratio may be maintained and provided to the outside through the display unit 230 . In this case, the display unit 230 of the vehicle infotainment system 200 may display an area other than an area in which screen information of a 16:9 ratio is displayed in an arbitrary color (eg, black).

In an embodiment, the user terminal 240 may include a communication unit 242 , a memory 244 , a control unit 248 , a display 250 , and a microphone 252 .

In an embodiment, the communication unit 242 may communicate with the vehicle infotainment system 200 . In an embodiment, the communication unit 242 may support establishment of a direct (eg, wired) communication channel or a wireless communication channel between the user terminal 240 and the vehicle infotainment system 200 and performing communication through the established communication channel. . In one embodiment, the communication unit 242 of the user terminal 240 is a wireless communication module (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (eg, LAN) (local area network) communication module, or a power line communication module).

In an embodiment, the memory 244 may store the vehicle interworking application 246 including a plurality of applications set to interwork with the vehicle infotainment system. In an embodiment, the vehicle interworking application 246 may include a plurality of applications suitable for operation while driving a vehicle, and may be variously changed according to a software setting of a manufacturer.

In an embodiment, the controller 248 may transmit at least one of screen information and control command information for the vehicle interworking application 246 to the vehicle infotainment system 200 . In one embodiment, the control unit 248 checks the communication state between the communication unit 242 of the user terminal 240 and the communication unit 210 of the vehicle infotainment system 200, and when the communication state is suitable, screen information and control commands At least one of the information may be transmitted to the vehicle infotainment system 200 .

In an embodiment, the controller 248 may receive a user's touch input through the display 250 and generate control command information corresponding to the user's touch input. In another embodiment, the controller 248 may receive a user's voice input through the microphone 252 and generate control command information corresponding to the user's voice input.

According to an embodiment, the vehicle infotainment system 200 may further include a vehicle driving unit (eg, the vehicle driving unit 150 of FIG. 1 ) that controls the operation of a component of the vehicle. For example, when receiving control command information from the user terminal 240 , the controller 220 of the vehicle infotainment system 200 may transmit the received control command information to the vehicle driving unit 150 .

3 is a conceptual diagram illustrating a vehicle infotainment system 300 and a user terminal 340 according to an exemplary embodiment.

Referring to FIG. 3 , the vehicle infotainment system 300 may be provided in the front center portion of the interior of the vehicle. In addition, as the cradle 350 is provided in the periphery of the vehicle infotainment system 300 , the user terminal 340 (eg, a smartphone, a tablet PC, etc.) may be mounted and detached. In an embodiment, as the vehicle infotainment system 300 and the user terminal 340 are located in a short distance, the vehicle infotainment system 300 and the user terminal 340 communicate with each other through short-range communication (eg, WIFI, Bluetooth, etc.) can be connected to each other. At this time, the user terminal 340 and the vehicle infotainment system 300 may be connected through any one of two-way communication (full duplex communication) or one-way communication (simple communication). For example, when connected through one-way communication, the user terminal 340 may transmit information (eg, screen information, control command information) to the vehicle infotainment system 300 , but any I cannot receive any information either. For another example, when connected through two-way communication, the user terminal 340 transmits information (eg, screen information, control command information) to the vehicle infotainment system 300 , and information from the vehicle infotainment system 300 . (eg, aspect ratio change information, object arrangement order change information, information on vehicle control result, etc.) can be received.

4A illustrates a state of a first UI 400 of a user terminal according to an exemplary embodiment. 4B illustrates a state of the second UI 410 of the user terminal according to an embodiment. 4C illustrates a state of a third UI 420 of a user terminal and a state of a display screen 430 of a vehicle infotainment system according to an exemplary embodiment. 4D illustrates a state of a fourth UI 440 of a user terminal and a state of a display screen 450 of a vehicle infotainment system according to an exemplary embodiment. In the description of FIGS. 4A to 4D , contents identical to, corresponding to, or similar to those described above may be omitted.

Referring to FIG. 4A , the user terminal (eg, the user terminal 240 of FIG. 2 ) may display the state of the first UI 400 through a display (eg, the display 250 of FIG. 2 ).

In an embodiment, the first UI 400 may include visual objects corresponding to a plurality of applications. For example, the first UI 400 may include a visual object (eg, an icon) corresponding to each of the watch application, the calculator application, the video application, the SNS application, the camera application, and the vehicle interworking application 402 . However, this is only an example, and the first UI 400 may include visual objects corresponding to various applications installed by the user.

In an embodiment, upon receiving the user input 404 for the vehicle interworking application 402 , the user terminal 240 may display the second UI state through the display 250 . However, although the user input for the vehicle interworking application 402 in FIG. 4A is illustrated as a touch input, the present invention is not limited thereto. In another embodiment, upon receiving the user's voice input (eg, "Turn on the CAR APP"), the user terminal 240 may display the second UI state through the display 250 .

Referring to FIG. 4B , the second UI 410 is a visual display that displays the remaining time until the communication connection between the user terminal 240 and the vehicle infotainment system (eg, the vehicle infotainment system 200 of FIG. 2 ) is completed. It may include an object 412 . For example, the second UI 410 may include a car icon corresponding to the vehicle infotainment system 200 and a visual object 412 (eg, a plurality of circle shapes) surrounding the car icon. At this time, the shaded display of the visual object 412 surrounding the car icon means the remaining time (eg, 10 seconds) until the communication connection between the user terminal 240 and the vehicle infotainment system 200 is completed. can In an embodiment, the second UI 410 may include a visual object 414 for releasing a communication connection between the user terminal 240 and the vehicle infotainment system 200 .

Referring to FIG. 4C , when the communication connection between the user terminal 240 and the vehicle infotainment system 200 is completed, the user terminal 240 may display the third UI 420 state through the display 250 . have.

In an embodiment, the third UI 420 may include an execution screen of the vehicle-linked application 402 executed through the user input 404 . For example, the vehicle interworking application 402 may include a plurality of applications suitable for operation while driving a vehicle. Accordingly, the third UI 420 may include a plurality of objects corresponding to each of a radio application, an audio application, a video application, a navigation application, a call application, a message application, and a control application.

In an embodiment, the screen information of the user terminal 240 displayed on the third UI 420 may be displayed on the display screen 430 of the vehicle infotainment system 200 . In an embodiment, the display screen 430 of the vehicle infotainment system 200 may display a screen in which arrangement information of a plurality of applications included in the third UI 420 is changed. For example, in the third UI 420 , a plurality of applications are arranged in two columns to suit the user terminal 240 in the portrait mode, but the third UI 420 is displayed on the display screen 430 of the vehicle infotainment system 200 in the landscape mode. A plurality of applications included in the UI 420 may be arranged in four columns. In another embodiment, the display screen 430 of the vehicle infotainment system 200 may display the same screen as screen information displayed on the third UI 420 . At this time, the user terminal 240 may automatically change the screen state to the landscape mode when the vehicle interworking application 402 is executed.

Referring to FIG. 4D , the controller of the user terminal 240 (eg, the controller 248 of FIG. 2 ) may set the arrangement order for a plurality of objects included in the vehicle interworking application based on the frequency of use of the vehicle user. have. Also, the controller 248 may transmit the rearranged screen information to the vehicle infotainment system 200 according to the arrangement order set based on the frequency of use of the vehicle user.

In an embodiment, the controller 248 may store the user's frequency of use of a plurality of applications included in the vehicle-linked application in a memory (eg, the memory 244 of FIG. 2 ). For example, the controller 248 has the highest frequency of use by the user for the navigation application among the plurality of applications, and the user's frequency of use decreases in the order of a call application, a control application, a video application, a message application, and a radio application. , that the user has the lowest frequency of use for the audio application may be stored in the memory 244 .

In an embodiment, the controller 248 sets the arrangement order for the plurality of applications based on the frequency of use of the user stored in the memory 244 , and the fourth UI in which the plurality of applications are rearranged according to the set arrangement order (440) screen may be displayed. In this case, the controller 248 sets the size of the object (eg, a “navigation” icon) corresponding to the application most frequently used by the user to be larger than the size of the object corresponding to the remaining applications to display (eg, FIG. 2 ). It can be displayed through the display 250 of the.

In an embodiment, the controller 248 may transmit screen information of the user terminal 240 displayed on the screen of the fourth UI 440 in which a plurality of applications are rearranged to the vehicle infotainment system 200 . In an embodiment, the display screen 450 of the vehicle infotainment system 200 may display a screen in which arrangement information of a plurality of applications included in the fourth UI 440 is changed. This is the same as the method in which the display screen 430 of the vehicle infotainment system 200 displays a screen in which arrangement information of a plurality of applications included in the third UI 420 is changed in FIG. 4C , so a detailed description may be omitted. have.

5A illustrates a state of a fifth UI 500 of a user terminal according to an exemplary embodiment. 5B illustrates a state of a sixth UI 510 of a user terminal and a state of a display screen of a vehicle infotainment system according to an embodiment. In the description of FIGS. 5A and 5B , contents identical to, corresponding to, or similar to those described above may be omitted.

Referring to FIG. 5A , the user terminal (eg, the user terminal 240 of FIG. 2 ) may display a vehicle-linked application (eg, the vehicle-linked application 402 of FIG. 4A ) through a display (eg, the display 250 of FIG. 2 ). ) may display the executed fifth UI 500 state. In this case, the vehicle infotainment system (eg, the infotainment system 200 of FIG. 2 ) may display a display screen (not shown) corresponding to the fifth UI 500 .

In an embodiment, the user terminal 240 may receive a user input for one object among a plurality of objects included in the vehicle interworking application 402 through the display 250 . For example, the user terminal 240 may receive the user input 502 for an object corresponding to the navigation application through the display 250 . In another embodiment, the user terminal 240 may receive a user input through a microphone (eg, the microphone 252 of FIG. 2 ). For example, the user terminal 240 may receive a user voice input (eg, "turn on navigation") for executing a navigation application through the microphone 252 .

According to an embodiment, the user terminal 240 may display a sixth UI state upon receiving a user input (eg, a user input 502 or a voice input).

Referring to FIG. 5B , the user terminal 240 may display the state of the sixth UI 510 , which is an execution screen of an application executed according to a user input (eg, a user input 502 or a voice input). For example, the sixth UI 510 may include an execution screen of a navigation application.

In an embodiment, screen information of the user terminal 240 displayed on the sixth UI 510 may be displayed on the display screen 520 of the vehicle infotainment system 200 . In an embodiment, the display screen 520 of the vehicle infotainment system 200 may display a screen in which the direction of screen information displayed on the sixth UI 510 is changed. For example, the sixth UI 510 may display map data of a navigation application to be suitable for the user terminal 240 in the portrait mode. At this time, the control unit (eg, the control unit 220 of FIG. 2 ) of the vehicle infotainment system 200 converts the screen information of the sixth UI 510 in the vertical mode received from the user terminal 240 to the screen information in the horizontal mode. can be changed Accordingly, the display screen 520 of the vehicle infotainment system 200 may display a screen in which the direction of the screen information displayed on the sixth UI 510 is changed to the landscape mode.

6A illustrates a state of a seventh UI 600 of a user terminal according to an exemplary embodiment. 6B illustrates a state of the eighth UI 610 of the user terminal according to an embodiment. 6C illustrates a state of the ninth UI 620 of the user terminal according to an embodiment. 6D illustrates a state of a tenth UI 630 of a user terminal according to an embodiment. 6E illustrates a state of an eleventh UI 640 of a user terminal according to an exemplary embodiment. 6F illustrates a state of a twelfth UI 650 of a user terminal and a state of a display screen 660 of a vehicle infotainment system according to an exemplary embodiment. In the description of FIGS. 6A to 6F , contents identical to, corresponding to, or similar to those described above may be omitted.

Referring to FIG. 6A , the user terminal (eg, the user terminal 240 of FIG. 2 ) may display a vehicle-linked application (eg, the vehicle-linked application 402 of FIG. 4A ) through a display (eg, the display 250 of FIG. 2 ). ) may display the executed seventh UI 600 state. In this case, the vehicle infotainment system (eg, the infotainment system 200 of FIG. 2 ) may display a display screen (not shown) corresponding to the seventh UI 600 .

In an embodiment, the user terminal 240 may receive a user input for one object among a plurality of objects included in the vehicle interworking application 402 through the display 250 . For example, the user terminal 240 may receive the user input 602 for the object corresponding to the control application through the display 250 . In an embodiment, the user terminal 240 may display the eighth UI state upon receiving the user input 602 .

Referring to FIG. 6B , the user terminal 240 may display the state of the eighth UI 610 , which is an execution screen of an application executed according to a user input 602 . For example, the eighth UI 610 may include an execution screen of a control application.

In an embodiment, the eighth UI 610 including the execution screen of the control application includes a first area 612 for controlling the vehicle ignition on/off function and a second area for controlling a window state of the vehicle ( 614) may be included. For example, the first area 612 of the eighth UI 610 includes a first visual object 616 (eg, "START") capable of controlling the starting of the vehicle in the on state and the starting of the vehicle in the off state. It may include a second visual object 618 (eg, "STOP") that can be controlled by . At this time, the arrangement of the eighth UI 610 and the shape of the object are only examples, and the arrangement structure of the first area 612 and the second area 614 , the first visual object 616 and the second visual object 616 are only examples. It is obvious that the shape of the object 618 may be variously changed according to the software design of the manufacturer.

Referring to FIG. 6C , the ninth UI 620 may include a first visual object 616 that moves in a right direction according to a touch input of the user 622 . In this case, as the first visual object 616 moves in the right direction, the vehicle infotainment system 200 may receive control command information for controlling the starting state to the on state from the user terminal 240 . Also, the vehicle infotainment system 200 may transmit the received control command information to a vehicle driving unit (eg, the vehicle driving unit 150 of FIG. 1 ).

Referring to FIG. 6D , the tenth UI 630 may include a third visual object 632 for executing a voice input. For example, the user terminal 240 may receive a user input for the third visual object 632 through a display (eg, the display 250 ). In an embodiment, as the user terminal 240 receives a user input for the third visual object 632 , the microphone of the user terminal 240 (eg, the microphone 252 of FIG. 2 ) is switched to an active state. can be

Referring to FIG. 6E , the user terminal 240 may receive a user's voice input through the microphone 252 switched to the active state. For example, the user terminal 240 may receive a user voice input such as “open all the right windows of the front seat” through the microphone 252 . In an embodiment, the eleventh UI 640 may correspond to a screen displayed by converting a user's voice input received through the microphone 252 of the user terminal 240 into text. In an embodiment, the vehicle infotainment system 200 may receive control command information corresponding to a user's voice input from the user terminal 240 , and transmit the received control command information to the vehicle driving unit 150 . For example, when the vehicle infotainment system 200 receives control command information corresponding to the user's voice input of "Open all the right windows of the front seat" from the user terminal 240, the vehicle infotainment system 200 is the vehicle driving unit ( 150), the received control command information may be transmitted.

Referring to FIG. 6F , the twelfth UI 650 may include data on a control result performed by the vehicle driving unit 150 . In an embodiment, the user terminal 240 receives data on the control result of the vehicle driving unit 150 from the vehicle infotainment system 200 , and includes the data on the control result through the display 250 . A UI 650 may be displayed. For example, the twelfth UI 650 may include a pop-up window including a message about the control result (eg, "The right window of the front seat has been opened."). Also, the twelfth UI 650 may include a visual object 652 representing a control result. At this time, the visual object 652 may be an object representing a component of the vehicle on which the control is performed, and when the control corresponding to the control command information is completed, the visual object 652 may be displayed as a shade or a color. .

In an embodiment, screen information of the user terminal 240 displayed on the twelfth UI 650 may be displayed on the display screen 660 of the vehicle infotainment system 200 . In an embodiment, the display screen 660 of the vehicle infotainment system 200 may display a screen in which the direction of screen information displayed on the twelfth UI 650 is changed. For example, the twelfth UI 650 may be arranged so that a pop-up window including a visual object 652 indicating a control result and a message about the control result is not overlapped so as to be suitable for the user terminal 240 in the portrait mode. In this case, the controller 220 of the vehicle infotainment system 200 may change the screen information of the twelfth UI 650 in the vertical mode received from the user terminal 240 to the screen information in the landscape mode. Accordingly, the display screen 660 of the vehicle infotainment system 200 may display a screen in which the direction of the screen information displayed on the twelfth UI 650 is changed to the landscape mode, and a visual object 652 and A pop-up window including a message about the control result may be partially overlapped.

Various embodiments according to the present disclosure may be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by a computer. Computer-readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. Also, computer-readable media may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes computer readable instructions, data structures, other data in modulated data signals, such as program modules, or other transport mechanisms, and includes any information delivery media.

Also, in the present disclosure, “unit” may be a hardware component such as a processor or circuit, and/or a software component executed by a hardware component such as a processor.

The foregoing description of the present disclosure is for illustration, and those of ordinary skill in the art to which the present disclosure pertains can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present disclosure. There will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and likewise components described as distributed may also be implemented in a combined form.

The scope of the present embodiment is indicated by the claims to be described later rather than the detailed description, and it should be construed to include all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts.

Claims (16)

In the vehicle infotainment system,
a communication unit for performing communication with the user terminal;
a control unit configured to receive at least one of screen information and control command information for a vehicle-linked application installed in the user terminal from the user terminal through the communication unit; and
and a display unit providing at least one of the screen information and control command information to the outside. According to claim 1,
The screen information is information about an execution UI (user interface) of the vehicle-linked application executed based on a user input to the user terminal, the vehicle infotainment system. 3. The method of claim 2,
The execution UI of the vehicle-linked application includes at least one of a radio application, an audio application, a video application, a navigation application, a call application, a message application, and a control application. The method of claim 1,
The control unit is
For a plurality of objects included in the vehicle-linked application, screen information rearranged according to an arrangement order set based on a frequency of use of a vehicle user is received from the user terminal and displayed through the display unit. The method of claim 1,
The control command information includes at least one of a control command corresponding to a user's touch input to the display of the user terminal and a control command corresponding to a user's voice input to the microphone of the user terminal. According to claim 1,
The control unit is
Upon receiving the control command information from the user terminal, the vehicle infotainment system transmits the control command information to a vehicle driving unit that controls an operation of a component device of the vehicle. A method of operating a vehicle infotainment system, the method comprising:
performing communication with the user terminal;
receiving, from the user terminal, at least one of screen information and control command information for a vehicle-linked application installed in the user terminal; and
and providing at least one of the screen information and control command information to the outside. 8. The method of claim 7,
The method of operating a vehicle infotainment system, wherein the screen information is information about an execution UI (user interface) of the vehicle-linked application executed based on a user input to the user terminal. 9. The method of claim 8,
The method of operating the vehicle infotainment system, wherein the execution UI of the vehicle-linked application includes at least one of a radio application, an audio application, a video application, a navigation application, a call application, a message application, and a control application. 8. The method of claim 7,
The vehicle infotainment system further comprising: receiving from the user terminal screen information rearranged according to an arrangement order set based on the frequency of use of the vehicle user with respect to the plurality of objects included in the vehicle interworking application from the user terminal and displaying the plurality of objects how it works. 8. The method of claim 7,
The control command information includes at least one of a control command corresponding to a user's touch input to the display of the user terminal and a control command corresponding to a user's voice input to the microphone of the user terminal. Way. 8. The method of claim 7,
When receiving the control command information from the user terminal, the operation method of the vehicle infotainment system further comprising the operation of transmitting the control command information to a vehicle driving unit that controls the operation of the component device of the vehicle. In the user terminal,
a communication unit configured to communicate with the vehicle infotainment system;
a memory for storing a vehicle interworking application including a plurality of applications set to interwork with the vehicle infotainment system; and
A user terminal comprising a control unit for transmitting at least one of screen information and control command information for the vehicle interworking application to the vehicle infotainment system through the communication unit. 14. The method of claim 13,
The screen information is information about an execution UI (user interface) of the vehicle-linked application executed based on a user input, a user terminal. 14. The method of claim 13,
The control unit is
For a plurality of objects included in the vehicle-linked application, a user sets an arrangement order based on the frequency of use of a vehicle user, and transmits screen information rearranged according to the set arrangement order to the vehicle infotainment system terminal. 14. The method of claim 13,
a display for receiving a user's touch input; and
Further comprising a microphone for receiving the user's voice input,
The control command information includes at least one of a control command corresponding to a user's touch input to the display and a control command corresponding to a user's voice input to the microphone, the user terminal.

Images