KR102057936B1 - Termincal device mauntable in a car, mobile device, and methods for providing service thereof - Google Patents

Abstract

A mobile device is disclosed. The mobile device includes a display unit, a communication unit for performing communication with a terminal device displaying items classified into a plurality of groups in a list form, and when communication with the terminal device is connected, according to a touch operation performed on a screen of the display unit. And a controller for hopping a group of items displayed on the terminal device. Accordingly, various services may be provided in cooperation with a terminal device mounted on the vehicle.

Description

A terminal device that can be mounted in a vehicle, a mobile device interoperating with the same, and a service providing method thereof {TERMINCAL DEVICE MAUNTABLE IN A CAR, MOBILE DEVICE, AND METHODS FOR PROVIDING SERVICE THEREOF}

The present invention relates to an on-vehicle system and a mobile device connected thereto and a service providing method thereof, and more particularly, an on-vehicle system and a mobile device capable of providing various services through a communication connection with each other, and a method for providing the service. It is about.

With the development of electronic technology, various types of mobile devices are being developed and spread. The mobile device provides various services such as a call service, a mail service, a web search service, and the like by using various hardware or software included in the mobile device.

However, when the mobile device is implemented as a portable device, the size, number, and type of hardware that can be mounted in the device may be limited. Therefore, the kind of services that can be provided using the mobile device is also limited.

On the other hand, in recent years, a vehicle-mounted system that provides various services such as a navigation function or a multimedia content reproduction function to a mobile means such as a vehicle is often mounted. Such a vehicle-mounted system can provide various convenience functions to a user of a vehicle. However, in-vehicle systems also had a limited number of services due to their hardware and software limitations.

Accordingly, there is a need for a technology for providing a variety of services by interlocking a vehicle-mounted system with a mobile device.

SUMMARY OF THE INVENTION The present invention is in accordance with the above-described needs, and an object of the present invention is to provide a vehicle-mounted system, a mobile device connectable thereto and a service providing method using the same, thereby improving user convenience and satisfaction.

According to an embodiment of the present invention for achieving the above object, the mobile device, a display unit, a communication unit for performing communication with the terminal device for displaying the items divided into a plurality of groups in the form of a list, the terminal device And a communication unit for hopping a group of items displayed on the terminal device according to a touch manipulation performed on a screen of the display unit when communication with the communication unit is established.

Here, when a preset first touch manipulation is performed on the screen of the display unit, the controller hops a group of items displayed on the screen of the terminal device to a previous group or a next group, thereby selecting an item belonging to the hopping group. The terminal device may be controlled to display.

Alternatively, the controller switches to a handwriting recognition mode when a preset second touch manipulation is performed on the screen of the display unit, and when text is drawn on the screen of the display unit in the handwriting recognition mode, the controller hops to a group corresponding to the text. Thus, the terminal device can be controlled to display an item belonging to the hopped group.

When the controller is switched to the handwriting recognition mode, the controller may display an affordance GUI for inducing a user drawing on the display unit.

The controller may return to the touch control mode of controlling the terminal device according to the first touch operation when the user drawing is not input for a preset time after the switch to the handwriting recognition mode.

Meanwhile, according to another embodiment of the present disclosure, the mobile device may further include a storage unit in which metadata including location information is stored. The controller may provide the metadata to the terminal device so that a service screen based on location information in the metadata is displayed on the terminal device.

Alternatively, the mobile device may further include a voice input unit for receiving a user voice. In this case, when the user voice is input, the controller sets search criteria differently according to a user state, searches for at least one destination corresponding to the user voice using the set search criteria, and retrieves the search result. The terminal may be provided to the terminal device through the communication unit.

Here, when the user is in a driving state, the controller may set a search criterion for first searching for a destination providing a service related to the vehicle.

Alternatively, the mobile device may further include a storage unit in which user schedule information is stored. In this case, the controller checks a subsequent schedule of the user based on the user schedule information, and if the following schedule exists, A search criteria for searching for the destination may be set according to a schedule time or place.

According to another embodiment of the present invention, when the address information is received from the terminal device, the controller accesses a server device corresponding to the address information to receive the web page data, and uses the web page data to receive the web page data. A screen adaptive to the terminal device may be configured and provided to the terminal device through the communication unit.

On the other hand, the terminal device control method of a mobile device according to an embodiment of the present invention, the step of performing communication with the terminal device for displaying a list of items divided into a plurality of groups, the screen of the display unit provided in the mobile device Detecting a touch operation made on the terminal; and controlling a group of items displayed on the terminal device according to the touch operation.

Herein, when the preset first touch manipulation is detected, the terminal hops a group of items displayed on the screen of the terminal device to a previous group or a next group to display the items belonging to the hopping group. You can control the device.

Alternatively, the control may include switching to a handwriting recognition mode when a preset second touch manipulation is detected; when text is drawn on a screen of the display unit in the handwriting recognition mode, the user hops to a group corresponding to the text and hops. And controlling the terminal device to display an item belonging to the group.

Alternatively, when switching to the handwriting recognition mode, the method may further include displaying an affordance GUI for inducing a user drawing on the display unit.

The method may further include returning to the touch control mode when the user drawing is not input for a preset time after the switch to the handwriting recognition mode.

Meanwhile, according to another exemplary embodiment, the method may further include providing metadata including location information to the terminal device so that a service screen based on the location information in the metadata is displayed on the terminal device. have.

Or receiving a user voice, setting a search criterion differently according to a user state, searching for at least one destination corresponding to the user voice by using a set search criterion, and displaying the search result in the terminal device. It may further comprise the step of providing.

Here, in the setting of the search criterion, if the user is in a driving state, the search criterion for first searching for a destination providing a service related to the vehicle may be set.

Alternatively, the setting of the search criteria may set a search criterion for searching for the destination according to a subsequent schedule time or location if a subsequent schedule of the user exists.

On the other hand, according to another embodiment of the present invention, when the address information is received from the terminal device, accessing the server device corresponding to the address information, receiving the web page data, using the web page data The method may further include configuring a screen adaptive to the terminal device and providing the screen to the terminal device.

According to various embodiments of the present disclosure as described above, a user may use various services by connecting communication between the on-vehicle system and the mobile device. Accordingly, the convenience and satisfaction of the user can be greatly improved.

1 is a view showing the configuration of a vehicle control system according to an embodiment of the present invention;
2 is a diagram for describing communication between a terminal device and a mobile device;
3 is a block diagram showing a configuration of a mobile device according to an embodiment of the present invention;
4 is a diagram illustrating an example of an operation of a mobile device of FIG. 3;
5 is a diagram illustrating still another operation example of the mobile device of FIG. 3;
6 and 7 illustrate screen examples of a mobile device;
8 is a diagram illustrating an example of a screen of a mobile device in a mode switching process;
9 illustrates another example of controlling an operation of a terminal device using a mobile device;
10 is a view for explaining screen switching of a mobile device according to a movement;
11 is a flowchart illustrating a terminal device control method according to an embodiment of the present invention;
12 is a timing diagram for describing an operation of a mobile device and a terminal device;
13 is a block diagram showing the configuration of a control device according to another embodiment of the present invention;
14 is a view for explaining a control process using the control device of FIG. 13;
15 is a diagram illustrating an example of an external configuration of a control device;
16 to 18 are diagrams for explaining an interlocking process between a control device and a terminal device;
19 is a view for explaining a screen switching method using a control device;
20 is a view for explaining the appearance of a control apparatus attachable to a vehicle steering wheel;
21 is a flowchart for explaining a control method using a control apparatus according to another embodiment of the present invention;
22 is a flowchart illustrating a method of operating a control apparatus according to another embodiment of the present invention;
23 to 26 are views for explaining a button color change process of the control device;
27 and 28 are diagrams showing examples of button indicators of a control device according to another embodiment of the present invention;
29 is a diagram illustrating an example of a screen configuration of a terminal device for matching a button and a menu;
30 is a timing diagram for explaining an operation in a vehicle control system according to another embodiment of the present invention;
31 is a block diagram showing the configuration of a mobile device and a terminal device included in the vehicle control system of FIG. 30;
32 is a view for explaining operations of the mobile device and the terminal device of FIG. 31;
33 is a view for explaining an example of the screen configuration in the terminal device of FIG.
34 is a timing diagram for describing an operation of a vehicle control system according to another embodiment of the present invention;
35 is a block diagram showing the configuration of a mobile device and a terminal device included in the vehicle control system of FIG. 34;
36 is a block diagram showing a configuration of a mobile device according to another embodiment of the present invention;
FIG. 37 is a diagram illustrating an example of a screen configuration of a terminal device controlled by the mobile device of FIG. 36;
38 is a view for explaining an operation of a vehicle control system controlled according to a user voice;
39 and 40 are flowcharts illustrating various examples of a control method of controlling a terminal device according to a user voice;
41 is a block diagram showing a configuration of a vehicle control system according to an embodiment of the present invention;
42 is a flowchart for explaining an example of an operation of a vehicle control system of FIG. 41;
43 is a diagram illustrating an example of a screen configuration of a terminal device mirrored with a mobile device;
44 is a diagram illustrating an example of a screen configuration of a terminal device according to the method of FIG. 42;
45 is a flowchart for explaining another example of an operation of the vehicle control system of FIG. 41;
46 is a diagram illustrating an example of a screen configuration of a terminal device according to the method of FIG. 45;
47 is a block diagram illustrating a comprehensive configuration of a mobile device according to various embodiments of the present disclosure.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a view showing the configuration of a vehicle control system according to an embodiment of the present invention. According to FIG. 1, the system includes a mobile device 100, a terminal device 200, and a server device 300.

The mobile device 100 refers to various devices that a user can carry and use. Specifically, the mobile device 100 may be implemented as various portable devices such as a mobile phone, a tablet PC, a laptop PC, a PDA, an MP3 player, an electronic notebook, and the like. The mobile device 100 may communicate with the terminal device 200 or the server device 300. Although only one mobile device 100 is illustrated in FIG. 1, a plurality of mobile devices 100 may be included in the system.

The terminal device 100 refers to a system mounted on a moving means such as the vehicle 10 to provide various services. Alternatively, the terminal device 100 may also be referred to as a vehicle head unit, a center fascia, a vehicle control system, a vehicle control device, a multimedia device, or the like. Hereinafter, for convenience of description, the terminal device 100 may be referred to as a terminal device 100. Explain. In addition, although the terminal device 100 is illustrated as being mounted in a vehicle in FIG. 1, the terminal device 100 is not necessarily limited to the vehicle, and may be mounted and used in various moving means such as a cycle, a motorcycle, a ship, and an airplane.

The server device 300 is a device that communicates with the mobile device 100 to transmit and receive various signals. The server device 300 may be a device connected to the mobile device 100 through various networks such as a web server, a communication company server, a cloud server, and the like. In addition, when the terminal device 200 has its own communication unit, the terminal device 200 may also communicate with the terminal device 200.

Meanwhile, the mobile device 100 may be connected to the terminal device 200 through various communication methods to perform communication.

2 is a diagram illustrating a specific communication connection method between the terminal device 200 and the mobile device 100.

According to FIG. 2, the terminal device 200 may include various devices such as hands free kits (HFK), a navigation device, a multimedia playback device, and the like. Each device may be suitably distributed in the room of the vehicle. The terminal device 200 may transmit / receive various signals, data, contents, etc. with the mobile device 100 through various communication methods such as Bluetooth, Wi-Fi, and USB.

Specifically, when the mobile device 100 receives or makes a call, the hands free kit of the terminal device 200 is connected to the mobile device 100 by Bluetooth. The hands free kit, when the mobile device 100 receives the voice signal uttered by the telephone counterpart and outputs it to the hands free kit, amplifies the signal and converts the signal into a voice signal through various speakers (not shown) mounted in the vehicle. . In addition, the hands free kit amplifies the voice signal of the user through a microphone (not shown) mounted in the vehicle and transmits the amplified voice signal to the mobile device 100 to transmit it to the call counterpart. Accordingly, the user may make a call without holding the mobile device 100 while driving.

In addition, the mobile device 100 may transmit and receive various data with the terminal device 200 according to the Wi-Fi method. Specifically, the mobile device 100 may execute the digital living network alliance (DLNA) function and provide it to the terminal device 200. The terminal device 200 may receive various contents from the mobile device 100. Accordingly, the terminal device 200 may display various content screens through the built-in display unit.

In addition, the terminal device 200 may receive a control signal from the mobile device 100 according to Bluetooth, Wi-Fi, and various other wired and wireless communication methods. The terminal device 200 may perform various control operations according to the received control signal.

In addition, the terminal device 200 may be connected to the mobile device 100 through an interface such as USB to perform a tethering function, and may perform other data and signal exchange.

As shown in FIG. 1 and FIG. 2, the mobile device 100 may provide various services in cooperation with the terminal device 200 and the server device 300. Hereinafter, the services that can be provided by such a system will be described in detail for each embodiment.

<Example using a mobile device as an input means>

3 is a block diagram illustrating a configuration of a mobile device according to an embodiment of the present invention. According to FIG. 3, the mobile device 100 includes a communication unit 110, a control unit 120, and a display unit 130.

The display unit 130 is a component for displaying various screens. The display 130 may be implemented in an appropriate size and shape to be mounted on the mobile device 100. According to the type of the mobile device 100, the display unit 130 may be implemented as various types of displays such as a liquid crystal display (LCD), an organic light emitting diodes (OLED) display, a plasma display panel (PDP), and the like. In addition, the display unit 130 may also include a driving circuit, a backlight unit, and the like, which may be implemented in the form of an a-si TFT, a low temperature poly silicon (LTPS) TFT, an organic TFT (OTFT), and the like.

The communication unit 110 is a component for performing communication with various external devices including the terminal device 200. The communication unit 110 may be a variety of devices such as Wi-Fi, Bluetooth, Zigbee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), Long Term Evoloution (LTE), Near Field Communcation (NFC), etc. Communication may be performed using a wireless communication method or a wired communication method such as a USB or a serial interface.

When the communication unit 120 communicates with the terminal device 200 through the communication unit 110, the control unit 120 operates in the touch control mode. The touch control mode refers to a mode of controlling the operation of the terminal device according to a touch manipulation performed on the screen of the display unit 130. The touch operation may include various operations such as simple touch, double touch, multi touch, touch and drag, touch and flick, drawing operation, and the like. The simple touch refers to an operation of touching the screen of the display unit 130, the double touch refers to an operation of touching twice in succession, and the multi-touch refers to an operation of simultaneously touching a plurality of points. In addition, touch and drag refers to an operation of moving a touch point by touching the display screen, and touch and flick refers to an operation of rapidly moving in one direction after touching the screen and releasing the touch. In addition, the drawing operation means an operation of drawing a symbol, a character, a symbol, a number, etc. by touching the screen.

Under the touch control mode, the controller 120 may detect a user's touch manipulation using a touch sensor embedded in the lower portion of the display 130. The touch sensor may be implemented in various forms such as capacitive, pressure sensitive, and piezoelectric. When a user touches an arbitrary point on the screen of the display unit 130, the controller 120 detects x and y coordinate values of the touch point. Accordingly, the controller 120 may determine which menu on the screen is selected. In addition, when the x and y coordinate values are changed, the controller 120 may continuously detect the changed coordinate values to check the touch trajectory. Accordingly, the controller 120 may detect touch and drag, touch and flick, drawing manipulation, and the like.

As such, when various touch manipulations are detected, the controller 120 may transmit a control signal corresponding to the touch manipulations to the terminal device 200.

For example, a first touch manipulation for group hopping may be performed on the screen of the display unit 130 while the terminal device 200 displays items sorted in a list form by being divided into a plurality of groups. Here, the item means various contact information, user information, address information, photo, location information, advertisement information, product stored in the terminal device 200 or the user terminal device 100 or stored in the external server device 300. Various information such as information, applications, etc. may be used. These items can be divided into various groups according to the nature of the items. For example, contact information, address information, user information, location information, etc., which are described in text, may be grouped for each alphabet. Alternatively, the phone number information may be grouped by area code or country code. Alternatively, in the case of an application, the application may be grouped by application genre.

When the first touch manipulation is performed while the at least one group is displayed on the screen of the terminal device 200, the controller 120 hops the currently displayed group to the previous group or the next group, and hopping. The terminal device 200 may be controlled to display an item belonging to the group.

For example, when the terminal device 200 displays contact information corresponding to the C group among the contact information grouped in alphabetical order, a simple touch-and-drag operation is performed or when the direction button is pressed, the controller 120 According to the drag direction or the direction button, other contact information in the C group can be scrolled and displayed sequentially. On the other hand, when the first touch manipulation is made in this state, the controller 120 immediately proceeds to the contact information corresponding to the previous group B or the next group D according to the direction or form of the first touch manipulation. The contact information of the group can be displayed. Therefore, the user can quickly and easily find the desired contact information.

The controller 120 may change the mode according to the user's selection. For example, when the user performs a second touch manipulation for handwriting recognition on the screen of the display 130, the controller 120 may switch to the handwriting recognition mode. The handwriting recognition mode refers to a mode in which a user recognizes handwriting content drawn on a screen of the display unit 130 and performs an operation corresponding thereto. When the user performs a drawing on the screen of the display unit 130 in the switch to the handwriting recognition mode, the controller 120 recognizes the drawn content. For example, if the user draws the text C, the controller 120 hops to a group corresponding to C drawn by the user from among a plurality of groups provided by the terminal device 200 and belongs to the hoped group. The terminal device 200 is controlled to immediately display an item.

In such embodiments, the form of the first touch operation or the second touch operation may be set as a default or set by a user. Hereinafter, examples of each touch operation and operations according thereto will be described in detail.

4 is a diagram for describing an operation in a touch control mode. 4 illustrates a case in which the user touches the screen with a plurality of fingers is set as the first touch operation. In addition, in FIG. 4, a portion of group A and group B is displayed on one screen 410 in the terminal device 200. For example, the A group and the B group may be divided by the first letter of the registered person name.

In this state, when the user touches a plurality of points T1 and T2 with two fingers 50 on the screen of the display unit 130 of the mobile device 100, the controller 120 issues a hopping command to the terminal device ( 200). Accordingly, the terminal device 200 performs group hopping to display a screen 420 in which the group B, which is the next group of the group A currently displayed as the highest, is disposed at the top. As shown in FIG. 4, when the number of items included in one group is small, a plurality of groups may be displayed on one screen. In this case, as shown in FIG. 4, the hopping group may be displayed at the top.

Alternatively, according to another embodiment of the present invention, hopping may be performed in a plurality of group units. That is, when the first touch manipulation is performed while the A group and the B group are both displayed on one screen 410 in FIG. 4, the control unit 130 immediately hops to the next group C which is not displayed. Can also give As such, the hopping does not necessarily need to be performed in a group unit, but may also be performed in a unit shown on the screen.

5 is a diagram for describing an operation in a handwriting recognition mode. Referring to FIG. 5, the terminal device 200 displays a screen 510 including a part of a B group and an A group. In this state, when the text 511 of C is drawn on the display unit 130 of the mobile device 100, the controller 120 recognizes the drawn text and transmits the recognition result to the terminal device 200. Accordingly, the text C 512 that is the same as the text drawn by the user is displayed on the screen 510 of the terminal device 200.

Then, the terminal device 200 hops to a group corresponding to the text 512 of C, and displays a screen 520 including an item belonging to the hopping group. In FIG. 5, the group C and the group D are displayed on one screen 520.

Meanwhile, in the mobile device 100, a point drawn by a user may be represented by a graphical user interface (GUI).

6 illustrates an example of a screen configuration displayed on the mobile device 100. According to FIG. 6, when communication is connected with the terminal device 200 through the communication unit 110, the controller 120 displays a screen 600 corresponding to the touch control mode. In the screen 600, a message indicating that the touch pad is displayed and an area in which the user can touch may be displayed. When the user performs a touch manipulation within the screen 600, the controller 120 displays the graphic object 610 as much as the touch area at the point touched by the user.

7 illustrates an example of a screen configuration when the mobile device 100 operates in the handwriting recognition mode. According to FIG. 7, when the controller 120 switches from the touch recognition mode to the handwriting recognition mode, the controller 120 displays a screen 700 corresponding to the handwriting recognition mode. The relevant screen 700 may display affordance GUIs 710 and 720 for guiding a user drawing. In FIG. 7, the display 130 displays the affordance GUI 710 in the form of a line and the affordance GUI 720 in the form of a writing instrument so that the display 130 may feel as if it is a note or memo. Although not shown, a message indicating that the writing state is available on the screen 700 of FIG. 7 may be displayed in the form of a pop-up window or a watermark.

As described above, the controller 130 may operate in various modes such as a touch control mode and a handwriting recognition mode. The controller 130 may switch modes in various ways.

8 is a view for explaining a process of performing a mode switch. Referring to FIG. 8, when a user performs a predefined second touch operation while the touch control mode screen 600 is displayed (S810), the controller 120 switches to the handwriting recognition mode and the handwriting recognition mode screen 700. ) Is displayed. In FIG. 8, the second touch operation is illustrated as an operation of touching two points on the screen and then lowering them to the lower side, but the present invention is not limited thereto and may be defined in various forms.

If the user drawing is not input for a preset time after switching to the handwriting recognition mode (S820), the controller 120 may return to the touch control mode. Accordingly, the touch control mode screen 600 is displayed again. Although FIG. 8 illustrates a case in which the mode is automatically returned as time passes, the controller 120 may return to the touch control mode even when the first touch manipulation is performed on the handwriting recognition mode screen 700. .

As described above, the user may freely change the screen displayed on the terminal device 200 using the mobile device 100. When the terminal device 200 is attached to a moving means such as a vehicle, and the user is driving the vehicle, the terminal device 200 may be operated while watching the screen of the terminal device 200, resulting in an accident risk. In particular, when searching for a destination to set the navigation function, various address information in a list form is shown. In this case, when the user scrolls the screen one by one to search for a desired destination, the time and effort required for the search are increased, thereby increasing the risk of an accident. On the other hand, according to the above-described embodiments, the user can easily hop to a desired group by inputting a touch manipulation or handwriting using the mobile device 100 familiar to the hand, without looking at the screen of the terminal device 200. . Therefore, the desired destination can be searched easily and quickly.

Meanwhile, in the above-described embodiments, the group itself is hopped by a predetermined touch manipulation or writing, but in addition, the user touches the display 130 of the mobile device 100 connected to the terminal device 200 as if the group itself is hopping. You can use it like a pad to perform a variety of controls. That is, when hopping is completed and a specific group is displayed, more detailed operation may be required to select a desired item and execute a function in the corresponding group.

9 is a diagram for describing another method of controlling an operation of a terminal device using a mobile device. According to FIG. 9, a user may touch or drag a flick after touching one point on the screen 130 of the mobile device 100 with one finger. The controller 120 scrolls the screen 910 of the terminal device 200 according to the drag or flick direction of the user and the moving distance thereof. As illustrated in FIG. 9, when the user drags in the d1 direction, the screen 910 of the terminal device 200 is also scrolled in the d1 direction.

As described above, when a user searches for a desired group by group hopping, the user scrolls to find a desired item within the group. Accordingly, when a desired item is found, the user may double-touch the screen of the mobile device 100 to select the item or directly select the item on the screen of the terminal device 200. As in the above-described example, assuming that each item is destination information, the controller 120 may set the item selected by the user as a destination and immediately execute a navigation function to the set destination.

On the other hand, the user can freely use the mobile device 100 by rotating in the desired direction. 10 illustrates a state in which the mobile device is rotated.

According to FIG. 10, in a state in which the mobile device 100 is placed in the vertical direction, an indicator 1011 indicating that the touch pad is displayed on an upper end of the screen 1010 is displayed, and a touch area 1012 is displayed below.

In this state, when the mobile device 100 is rotated in the horizontal direction, the indicator 1021 is displayed again on the upper portion of the screen 1020 in the rotated state, and the touch area 1022 is displayed on the lower portion thereof. That is, the shape of the touch area is changed according to the rotation.

According to such an embodiment, the mobile device 100 may further include a motion detection sensor such as a geomagnetic sensor, a gyro sensor, an acceleration sensor, or the like. The controller 120 may change the display direction of the screen according to the detection result of the motion detection sensor. In addition, when a user's touch manipulation is performed on the changed screen, the controller 120 may determine the direction of the touch manipulation based on the changed screen.

11 is a flowchart illustrating a control method of a mobile device according to an embodiment of the present invention. According to FIG. 11, when communication with the terminal device 200 is connected (S1110), the mobile device 100 automatically switches to the touch control mode (S1120). In this state, when the user inputs a predetermined touch operation (S1130), the mobile device 100 may transmit a control signal corresponding to the touch operation to the terminal device 200 to control the operation of the terminal device 200. There is (S1140). The control signal may include various signals such as a menu selection signal, a screen switching signal, a scroll signal, as well as a hopping signal for hopping a group displayed on the terminal device 200 to a previous or next group.

Accordingly, the user may conveniently control the terminal device 200 by using the mobile device 100 as if it is a remote control means for controlling the terminal device 200.

On the other hand, if the condition to switch to the handwriting recognition mode is satisfied (S1150), the mobile device 100 performs mode switching. In this state, the mobile device 100 receives a user drawing (S1160). When the user drawing is input, the mobile device 100 recognizes the drawn text (S1170), and transmits the recognized text to the terminal device 200 (S1180). Accordingly, the terminal device 200 can provide various services using the corresponding text.

12 is a timing diagram for describing an operation of the mobile device 100 and the terminal device 200. According to FIG. 12, in a state in which a list of a plurality of items is displayed in the terminal device 200 (S1200), communication may be connected between the mobile device 100 and the terminal device 200 (S1210). In FIG. 12, the list is displayed before the communication connection, but the list may be displayed after the communication is first connected.

When the first touch manipulation is input from the mobile device 100 while the communication is connected as described above (S1220), the mobile device 100 transmits a hopping command (S1230).

The terminal device 200 hops to the previous group or the next group according to the hopping command, and displays an item belonging to the hopping group (S1240).

Meanwhile, when the user inputs the second touch manipulation (S1250), the mobile device 100 switches to the handwriting recognition mode (S1260). When the user performs drawing in the handwriting recognition mode, the mobile device 100 recognizes the drawn writing content (S1270) and transmits the recognized text (S1280). The terminal device 200 may immediately hop to a group corresponding to the text and display an item belonging to the group (S1290).

Meanwhile, in the above-described exemplary embodiments, the mobile device 100 recognizes a user operation and transmits an appropriate signal corresponding to the operation to the terminal device 200. However, the present disclosure is not necessarily implemented as described above. That is, according to another embodiment of the present invention, the mobile device 100 may function only as a simple input means of the terminal device 200. In this case, when the mobile device 100 is connected to the terminal device 200 and the user touches the screen of the display unit 130 of the mobile device 100, the control unit 120 of the mobile device 100 may indicate The coordinate value of the touched point may be transmitted to the terminal device 200 as it is. The terminal device 200 may recognize the user manipulation using the transmitted coordinate value, and accordingly, may perform operations such as group hopping, scrolling, item selection, and function execution.

Meanwhile, in the above-described embodiments, a case in which the terminal device 200 is controlled by using the display unit 130 of the mobile device 100 as a touch pad has been described. It may be used to control the terminal device 200. Such a control device may be implemented in various forms. Hereinafter, the configuration of the control device capable of controlling the terminal device 200 and embodiments of its operation will be described in detail.

<Control device for controlling terminal device>

13 is a block diagram illustrating a configuration of a control device according to an embodiment of the present invention. According to FIG. 13, the control device 400 includes a plurality of buttons 410-1 to 410-n, a control unit 420, and a communication unit 430.

The plurality of buttons 410-1 to 410-n may be arranged in a continuous alignment along at least one line. Each of the buttons 410-1 to 410-n may be implemented in various forms such as a push button, a touch button, a wheel button, and a jog shuttle button.

The communication unit 430 is a component for performing communication with an external device. Specifically, the communication unit 430 includes Wi-Fi, Bluetooth, Zigbee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), Long Term Evoloution (LTE), and Near Field Communcation (NFC). By using a variety of wireless communication methods such as) or a wired communication method such as USB, serial interface, etc., it is possible to perform communication with the terminal device 200 mounted on a mobile means such as a vehicle.

The terminal device 200 is provided with a display means to display various screens 210. One side of the screen 210 may display a plurality of menus 211-1 to 211-n arranged to correspond to buttons 410-1 to 410-n disposed on the control device 400.

The controller 420 transmits a control signal corresponding to a button selected by a user from among the plurality of buttons 410-1 to 410-n to the terminal device 200 through the communication unit 430, thereby operating the terminal device 200. Can be controlled. Specifically, when one button is selected, the controller 420 displays a menu having the same position or shape as the button selected from the menus 211-1 to 211-n displayed on the screen 210 of the terminal device 200. A control signal can be sent for execution.

The terminal device 200 may not only display one screen but also selectively display screens of several different pages. For example, when a navigation menu is selected on the main page, a navigation screen page may be displayed. Or, if the multimedia playback menu is selected, the multimedia playback page may be displayed. In this way, the screen is divided into a plurality of different pages, and different pages are displayed on each page. For example, a navigation menu, a multimedia playback menu, a setting menu, etc. may be displayed on a main page, and a destination setting menu, a current location display menu, an option menu, etc. may be displayed on a navigation screen page, and a content list menu, content may be displayed on a multimedia playback page. A search menu, a playback menu, and the like may be displayed.

When the terminal device 200 is changed from one page to another page, the menu to be used on the changed screen may also be displayed in a sorted form as buttons 410-1 to 410-n. The user may conveniently select each menu provided in each page by using the same number of buttons 410-1 to 410-n.

14 illustrates an appearance configuration of the control device 400 and an example of a control operation according thereto. According to FIG. 14, the control device 400 may be implemented in a form including three buttons 410-1, 410-2, and 410-3, and the terminal device 200 may include each button 410-1, The screen 210 including the plurality of menus 211-1, 211-2, and 211-3 arranged in the same pattern as the 410-2 and 410-3 may be displayed. 14 shows a state where a content playback screen is displayed.

In this state, when the user selects the left button 410-1, the controller 420 transmits a control signal for executing the left menu 211-1 to the terminal device 200. 14 shows a case where a control signal for executing rewind is transmitted.

On the other hand, when the user selects the middle button 410-2, the controller 420 recognizes that the middle menu 211-2 is selected, and outputs a playback signal corresponding to the middle menu 211-2 to the terminal device 200. To send). As such, the control device 400 and the terminal device 200 may operate in conjunction with each other.

15 shows another example of the external configuration of the control device 400. According to FIG. 15, six buttons 410-1 to 410-6 may be arranged in two rows. Among these buttons, the lower three buttons 410-1, 410-2, and 410-3 are buttons that dynamically change function in conjunction with a menu displayed on the screen of the terminal device 200, and the upper three buttons 410-. 4, 410-5, and 410-6) are buttons for performing a fixed function.

The lower three buttons 410-1, 410-2, and 410-3 may basically be mapped to a content playback function. For example, the first button 410-1 may be mapped to the previous music play function, the second button 410-2 may be mapped to the music play / pause function, and the third button 410-3 may be mapped to the next music play function. have. Therefore, when the first to third buttons are selected while the menu corresponding to each button is not displayed, the controller 420 may play the music content corresponding to the selected button.

Meanwhile, when the terminal device 200 displays a screen including a plurality of menus, the controller 420 displays a function mapped in the lower three buttons 410-1, 410-2, and 410-3 in the screen. Change to the function corresponding to each menu. For example, if a navigation screen page is displayed and a navigation menu, a multimedia playback menu, and a setting menu are sequentially displayed within the page, the controller 420 may control the first to third buttons 410-1, 410-2, and 410-. 3) The navigation menu, the multimedia playback menu, and the setup menu are mapped respectively.

Meanwhile, a fixed function may be mapped to the fourth to sixth buttons 410-4 to 410-6 separately from the first to third buttons 410-1 to 410-3. For example, the fourth button 410-4 may move to the previous screen, the fifth button 410-5 may scroll or select, and the sixth button 410-6 may map a menu display / close function. Can be.

As illustrated in FIG. 15, when the fifth button 410-5 is implemented in the form of a wheel button, the controller 420 controls to scroll the screen in the vertical direction according to the wheel movement when the wheel button moves in the vertical direction. The signal is transmitted to the terminal device 200. Alternatively, when the wheel button is clicked, the controller 420 transmits a control signal to the terminal device 200 to select an item on which the current cursor is located on the screen of the terminal device 200.

As described above, the function mapped to the first to third buttons 410-1 to 410-3 is changed according to the type of menu displayed on the changed screen when the terminal device 200 changes the screen. 16-18 illustrate examples of modified menus.

16 illustrates an example of a configuration of a main screen 1600 of the terminal device 200. In the main screen 1600, various information such as date information 1610, weather information 1620, schedule information 1630, and the like, and information 1640 on playable content may be displayed. In the content display area 1640, menus 1641, 1642, and 1643 for controlling content reproduction may be displayed. The controller 420 may basically match the first to third buttons 410-1, 410-2, and 410-3 with the menus 1641, 1642, and 1643.

Meanwhile, when a call is received in this state, the terminal device 200 may delete the content display area 1640 and display the call reception information 1650 at the location.

17 shows an example of a screen configuration of a terminal device in a state where a call is received. According to FIG. 17, a caller name and time may be displayed on the call reception information 1650, and various menus 1651, 1652, and 1653 related to call reception may be displayed. More specifically, a menu 1651, a mute menu 1652, and a call rejection menu 1653 for performing a call using a headset may be displayed. The controller 420 may match the first to third buttons 410-1, 410-2, and 410-3 with the menus 1651, 1652, and 1653.

18 illustrates an example of a screen configuration of a terminal device in a state where a message is received. According to FIG. 18, the terminal device 200 may display a notification message notifying the fact that the message has been received on the lower side of the main screen 1600. In the notification message, a confirmation menu 1660 for confirming the corresponding message and a rejection menu 1601 for rejecting the confirmation of the message may be displayed. In this case, the controller 420 commonly matches the confirmation menu 1660 with respect to the first button 410-1 and the second button 410-2, and rejects the menu with the third button 410-3. 1166 may be matched.

As such, the number of menus displayed on the screen does not necessarily need to be the same as the number of buttons, and may be smaller. If there are fewer menus, a plurality of buttons may be matched to one menu, and the corresponding menu may be executed regardless of which button is selected. On the other hand, when the number of menus is larger than the number of buttons, when one button is selected, a plurality of menus may be simultaneously executed.

The user may also input a swipe operation to sequentially select each button in one direction on the first to third buttons 410-1 to 410-3.

19 is a view for explaining a swipe operation and the operation according thereto.

When the swipe operation is detected, the controller 420 transmits a control signal to the terminal device 200 for switching the screen to another screen according to the direction of the swipe operation. The swipe operation refers to an operation of sequentially selecting the user by swiping the finger from the first button to the third button direction d2 or from the third button to the first button direction d1.

In FIG. 19, when a swipe operation is performed in the direction d1, the controller 420 transmits a control signal to the terminal device 200 to switch to the next screen 1910 -C of the current screen 1910 -B. On the contrary, when the swipe manipulation is performed in the d2 direction, the controller 420 transmits a control signal to the terminal device 200 to switch to the previous screen 1910 -A of the current screen 1910 -B.

Such a screen switching operation may be performed at any time when there is no notification message at the bottom of the screen.

In this way, by providing various buttons on the control device 400, even if the user does not directly touch the terminal device 200, moving between applications (application), screen switching, list selection and movement, music control, notification control, function Various operations such as control and menu selection can be performed. In addition, since the menus and buttons displayed on the screen are consistently disposed, the control apparatus 200 may control the user even if the user does not directly view the screen of the terminal device 200.

The control device 400 as described above may be installed at any location within the vehicle that is easily accessible to the user. For example, it can be fixed to a handle and used.

20 shows a configuration of a control device 400 fixed to a steering wheel of a vehicle. According to FIG. 20, the control device 400 may further include a fixing part 440. The fixing part 440 fixes the control device 400 to the handle 15 of the vehicle. The fixing part 440 may be implemented as a C-shaped groove that can be fitted to the vehicle handle 15, or a fastening part for tightening the opening after being inserted into the vehicle handle 15 through an opening part. It may be implemented in a form including (not shown).

21 is a flowchart illustrating a control method of controlling a terminal device using a control device according to an embodiment of the present invention. According to FIG. 21, when the user selects one of the buttons provided in the control device 400 (S2110), the control device 400 transmits a control signal for executing a function matched to the button to the terminal device 200. (S2110). When the screen displayed on the terminal device 200 is changed and a new menu is displayed on the changed screen, the control device 400 again matches a function corresponding to the new menu to each button. Accordingly, when the button is selected again, a control signal for executing a newly matched function is transmitted to the terminal device 200.

On the other hand, when the user performs a swipe operation on a plurality of buttons (S2130), the control device 400 transmits a screen change signal for changing to the previous screen or the next screen according to the swipe direction to the terminal device 200. (S2140). Accordingly, the user can conveniently control the function of the terminal device 200 without reaching for the screen of the terminal device 200 or the main body button of the terminal device 200.

Meanwhile, according to another exemplary embodiment of the present disclosure, the backlight may be provided to the button so that the user may easily recognize the matching relationship between the button and the function.

22 is a flowchart illustrating a control method of the control apparatus according to the embodiment. According to FIG. 22, when the control device 400 is powered on (S2210), the basic button may be activated (S2220). The basic button means a button to which fixed functions are matched. For example, if the control device 400 of the form as shown in FIG. 15, the fourth to sixth buttons 410-4 to 410-6 correspond to basic buttons.

The controller 420 may turn on the backlight unit provided below the activated basic button to provide color light to each basic button. That is, the control device 400 may further include a plurality of backlight units disposed under each of the plurality of buttons 410-1 to 410-n to provide color light for each button. The backlight unit may be implemented as an LED.

In this state, when communication is connected between the terminal device 200 and the communication unit 430 (S2230), the control unit 420 activates a control button (S2240). The control button refers to a button whose function is dynamically changed among a plurality of buttons. For example, in the case of the control device 400 of the type shown in FIG. 15, the first to third buttons 410-1 to 410-3 correspond to the control buttons. The controller 420 may also turn on the backlight provided under the activated control button to provide color light to each control button.

When a user lights up each button, the user may recognize that the button is activated.

On the other hand, the control unit 420 takes into account various situations such as the state of the control device 400, the state of the terminal device 200, the type of menu displayed on the terminal device 200, and the like. You can change each button individually.

Accordingly, the controller 420 may periodically monitor whether the state changes (S2250). As a result of the check, if the state is changed, the color of the button is changed to correspond to the changed state (S2260).

23 to 25 are diagrams for describing a lighting state of each button. 23 shows the power off state. In the power off state, each button is disabled, so no light is provided.

24 illustrates a state in which communication is not connected in a power-on state. In this case, light is provided only to the basic buttons 410-4 to 410-6 among the buttons, and thus is displayed brightly.

25 shows a state connected from the power on state to communication. In this case, not only the basic buttons 410-4 to 410-6 but also the control buttons 410-1 to 410-3 are all displayed brightly.

The light provided to the basic buttons 410-4 to 410-6 may be provided with the same color and brightness, but the light provided to the control buttons 410-1 to 410-3 may have various colors and brightness depending on the situation. Can be provided. For example, an orange color of (R: 186, G: 69, B: 4), a green color of (R: 0, G: 118, B: 91), (R: 14, G: 66, B: 145) Light of various colors, such as a blue color, a gray color (R: 160, G: 160, B: 160), and the like may be provided to each button individually.

This color may vary depending on the importance of the menu displayed on the screen or the importance of the notification message. For example, in a state where the content reproduction function is basically matched, the first to third buttons 410-1 to 410-3 may be commonly displayed in blue color. In this state, when a call is received, a green color may be displayed, and when a message is received, an orange color may be sequentially displayed.

Alternatively, the color of each button may be changed according to the characteristics of the menu matched to each button. For example, as shown in FIG. 17, when the first to third buttons 410-1 to 410-3 match to different menus 1651, 1652, and 1653, the first to third buttons 410 may be used. The colors of -1 to 410-3) may be expressed differently. On the other hand, as shown in FIG. 18, when the same menu is matched to the first and second buttons 410-1 and 410-2, and different menus are matched to the third button 410-3, the same menu is matched. The same color may be displayed on the first and second buttons 410-1 and 410-2, and only different colors may be displayed on the third button 410-3. As shown in FIG. 18, the gray color is displayed for the third button 410-3 to which the rejection indication is matched and may be turned on.

FIG. 26 illustrates a case where the first to third buttons 410-1 to 410-3 are displayed in different colors. The controller 420 may adjust the color by inputting appropriate driving pulses to the R, G, and B LEDs provided under the first to third buttons 410-1 to 410-3, respectively. Alternatively, the color may be changed using a white LED and a color filter.

Meanwhile, in the above embodiments, the buttons provided in the control device 200 are shown to have a fixed shape, but each button may be implemented as a touch button for displaying a deformable indicator. The controller 420 may transform the indicator of each button to correspond to each menu displayed on the terminal device.

27 and 28 illustrate an operation of a control apparatus according to an embodiment using a touch button.

27 shows three buttons 410-1 to 410-3 matched with a rewind function, a play / pause function, and a fast forward function respectively displayed on the content playback screen. The controller 420 may display the indicators 2710, 2720, and 2730 indicating the respective functions on the touch buttons 410-1 to 410-3. The touch buttons 410-1 to 410-3 may be implemented as a touch screen to display various graphic objects.

Fig. 28 shows a state in which the headset use function, the mute function, and the reject call function displayed on the call reception screen are matched to the buttons 410-1 to 410-3. In this case, the controller 420 deletes the previous indicators 2710, 2720, and 2730, and displays the indicators 2810, 2820, and 2830 corresponding to the headset use function, the mute function, and the reception rejection function, respectively. Each indicator may be displayed in the form of an icon.

According to the exemplary embodiment described with reference to FIGS. 27 and 28, the user may know the state of the terminal device 200 only with the control device 400 without looking at the screen of the terminal device 200, and may immediately control it.

Meanwhile, according to another embodiment of the present invention, an identifier is added to a menu displayed on the screen of the terminal device 200 instead of the button of the control device 400 so that the user can easily know which button is matched. You may.

29 is a view for explaining the operation of the control device 400 and the terminal device 200 according to this embodiment. According to FIG. 29, the buttons 410-1 to 410-3 of the control device 400 may display a number or a mark for specifying each button.

In this state, when the screen including the plurality of menus 1660 and 1661 is displayed, the terminal device 200 displays an identifier for referring to the matching button for each menu 1660 and 1661. According to FIG. 29, a confirmation menu 1660 for confirming a received message and a reject menu 1641 for rejecting confirmation of the message are displayed on the notification message informing that the message is received. As described above, the first and second buttons 410-1 and 410-2 are matched with the confirmation menu 1660, and the third button 410-3 is matched with the reject menu 1661. Accordingly, the confirmation menu 1660 displays first and second identifiers 2910 and 2920 indicating that the first and second buttons 410-1 and 410-2 matched, and the reject menu 1661 displays a third A third identifier 2930 is displayed indicating that the button 410-3 has matched. The user can easily identify the matching relationship between the button and the menu by looking at the identifier.

According to the above embodiments, the user can conveniently and safely control the function of the terminal device 200 mounted in the vehicle by using a separately provided control device.

Meanwhile, as described above, when the terminal device 200 and the mobile device 100 interoperate, an execution screen of an application executed by the mobile device 100 may be displayed on the terminal device 200. However, since the size and shape of the display unit 130 provided in the mobile device 100 and the display size and shape of the terminal device 200 do not coincide with each other, the screen of the mobile device 100 remains as it is. There was a problem that it is difficult to display in 200).

Hereinafter, another embodiment for solving this problem will be described in detail.

<Example for Screen Optimization of Terminal Device>

30 is a timing diagram illustrating a screen optimization method in a system according to another embodiment of the present invention.

According to FIG. 30, when communication is connected between the mobile device 100 and the terminal device 200 (S3010), the mobile device 100 displays a list of applications configured through a web application programming interface (API). Provided in (S3020). For example, the mobile device 100 may provide an API based on HTML5 (Hyper Text Markup Language 5).

 The terminal device 200 displays an icon of each application on the screen according to the provided list. In this state, if one icon is selected (S3030). The terminal device 200 requests the mobile device 100 for a web page corresponding to the selected icon (S3040).

When the web page request is received, the mobile device 100 requests the web page again from the corresponding server device 300 (S3050), and when the web page data is received (S3060), the mobile device 100 transmits the web page data to the terminal device 200 ( S3070).

When the webpage data is received, the terminal device 200 may generate a screen according to its display size (S3080) and display the screen (S3090).

FIG. 31 is a block diagram illustrating a configuration of a terminal device that performs an operation according to the embodiment of FIG. 30. According to FIG. 31, the terminal device 200 includes a display 3110, a controller 3120, and a communicator 3130.

The display 3110 is a diagram for displaying various screens. The display 3110 may be implemented in various sizes and shapes according to the price, type, usage environment, etc. of the terminal device.

The communication unit 3130 is a component for performing communication with the mobile device 100. When the communication unit 3130 is connected to the mobile device, the communication unit 3130 may access a web server using a web API provided by the mobile device. Accordingly, the web page data transmitted from the web server can be received.

The controller 3120 may configure a screen corresponding to the screen size of the display unit using the web page data and display the screen on the display unit 3110.

Specifically, when the mobile device 100 is connected, the controller 3120 receives a list of applications installed in the mobile device 100 and displays the list on the display 3110. When the user selects one of the applications displayed in the list, the controller 3120 requests web page data for the selected application. The mobile device 100 relays the web page data from the web server according to the request. When the web page data is received through the mobile device 100, the controller 3120 may configure a screen suitable for the display 3110 according to the web page data.

By configuring the screen using a web-based technology such as HTML5 (Hyper Text Markup Language 5), even if the display size and shape of the terminal device 200 are different from those of the mobile device 100, the mobile device 100 is installed in the mobile device 100. An execution screen of the same application as the application may be optimized and displayed on the terminal device 200.

Meanwhile, the mobile device 100 that communicates with the terminal device 200 includes a communication unit 110, a control unit 120, and a storage unit 140. For convenience of description, the same name and reference numerals are described for components that overlap with the mobile device 100 described in the embodiment of FIG. 3.

The communicator 110 may communicate with the communicator 3130 of the terminal device 200.

When the communication is connected, the controller 120 generates a list of applications installed in the storage 140 and transmits the list to the terminal device 200 through the communication unit 110. In addition, the controller 120 may provide the terminal device 200 with photo or video content, an address book, schedule information, and social network service (SNS) information stored in the storage 140.

Thereafter, when one application is selected in the terminal device 200, the web page data is downloaded from the web server corresponding to the selected application and transferred to the terminal device 200. Accordingly, the terminal device 200 may adaptively configure and display the application screen of the mobile device according to its display characteristics.

32 is a diagram for describing a process of the terminal device 200 displaying a screen using a web-based technology. According to FIG. 32, the terminal device 200 connects communication with the mobile device 100 according to various communication methods such as USB, Wi-Fi, and Bluetooth. The mobile device 100 may access the service and content provider server 3210 or the web application store 3220 through the Internet 3200. The terminal device 200 receives web page data provided from the service and content provider server 3210 or the web application store 3220 through the mobile device 100.

The controller 3120 of the terminal device 200 configures and displays a screen of an application using the provided web page data.

33 illustrates an example of a screen configuration displayed on the terminal device 200. According to FIG. 33, the mobile device 100 transmits various additional information to the terminal device 200 together with the web application list. The additional information may include gallery information including photo or video content, address book information, schedule information, SNS information, and the like.

The terminal device 200 displays icons 3310-1 to 3310-5 for applications installed in the mobile device 100 according to the web application list. In this state, when one icon 3310-5 is selected, the terminal device 200 receives web page data corresponding to the icon 3310-5 from the server device through the mobile device 100. Accordingly, the terminal device 200 configures the screen 3320 using the received web page data. The screen 3320 may also display additional information stored in the mobile device 100. That is, if the icon 3310-5 selected in FIG. 33 is a contact icon, the terminal device 200 displays a screen 3320 including address book information among additional information provided from the mobile device 100.

According to the exemplary embodiment as described above, the terminal device 200 may display a screen optimized for the terminal device 200 while using an application and information installed in the mobile device 100.

Meanwhile, according to another exemplary embodiment of the present disclosure, the mobile device 200 may control the terminal device 100 even without installing a specific application for controlling the terminal device 100. Hereinafter, the operation of the mobile device for controlling the terminal device using the web browser will be described.

<Example of Controlling a Terminal Device Using a Web Browser>

34 is a diagram for describing an operation of a mobile device for controlling a terminal device according to another exemplary embodiment.

According to FIG. 34, the mobile device 100 receives a URL from the terminal device 200 in operation S3410. Uniform Resource Locator (URL) means an address for a server device corresponding to the terminal device 200. The terminal device 200 previously stores a URL for a server device operated by the manufacturer of the terminal device 200 or the manufacturer of software or other content used in the terminal device 200, and then the mobile device 100. When communication with the server is provided, the URL is provided. The terminal device 200 may provide a URL through an NFC communication method.

When the URL is provided, the mobile device 100 executes a web browser and accesses the URL. Accordingly, the UI provided by the server device 300 is received (S3430), and the received UI is displayed on the web browser (S3440).

The user may control the terminal device 200 using the displayed UI. That is, if there is a user input on the UI (S3450), the mobile device 100 transmits a control signal corresponding to the user input (S3460).

When the control signal is received, the terminal device 200 performs an operation corresponding to the control signal (S3470). For example, various operations such as turn on, volume up, volume down, channel change, content play, stop, fast forward, rewind, content change, navigation function execution, destination setting, and the like can be performed.

Although FIG. 34 illustrates that the terminal device receives address information, that is, a URL, and receives a UI from the URL, the mobile device 100 may receive web page data from the URL. Accordingly, the mobile device 100 may transmit the received web page data to the terminal device 200. The terminal device 200 may configure and display an adaptive screen suitable for its display characteristics using a web browser. Alternatively, the mobile device 100 may directly configure the screen adaptive to the terminal device 200 by using the received web page data and provide the same to the terminal device 200. As such, according to an embodiment, the mobile device 100 may perform various functions using address information stored in the terminal device 200, that is, URL.

FIG. 35 is a block diagram illustrating the configuration of the mobile device 100 and the terminal device 200 according to the embodiment of FIG. 34.

According to FIG. 35, the mobile device 100 includes a communication unit 110, a control unit 120, a display unit 130, and a short range communication unit 150. In addition, the terminal device 200 includes a display unit 3110, a controller 3120, a communication unit 3130, a storage unit 3140, and a short range communication unit 3150.

When the near field communication unit 150 of the mobile device 100 is tagged with the near field communication unit 3150 of the terminal device 200, data may be transmitted and received according to an NFC scheme. Specifically, the short range communication unit 150 of the mobile device 100 may read the URL information stored in the storage unit 3140 of the terminal device 200.

The short range communication unit 150 of the mobile device provides the read URL information to the control unit 120. The controller 120 controls the communication unit 110 to access the read URL and receive the web page data. Web page data means data for configuring a UI screen. Also, the short range communication unit 150 of the mobile device 100 and the short range communication unit 3150 of the terminal device 200 may be formed of NFC tags and NFC readers, respectively. Accordingly, the controller 120 executes a web browser and displays the UI screen according to the received web page data on the display 130.

Thereafter, when the user selects a certain menu on the UI screen displayed on the display 130, the controller 120 transmits a control signal for executing the selected menu to the terminal device 200 through the communication unit 110.

The communication unit 3130 of the terminal device 200 receives the transmitted control signal and transmits it to the control unit 3120. The controller 3120 may display various screens on the display 3110 according to the received control signal.

As described above, although the mobile device 100 and the terminal device 200 are different types of devices, the mobile device 100 and the terminal device 200 may provide various services in cooperation with each other.

In the above embodiments, the terminal device 200 does not necessarily need to be mounted on a moving means such as a vehicle, and the above-described embodiments may be applied as long as the device is a different type of device from the mobile device.

On the other hand, according to another embodiment of the present invention, the operation of the terminal device 200 may be controlled using the user's voice. Hereinafter, an embodiment of controlling by using a user's voice will be described in detail.

<Example of Controlling Using a User's Voice>

36 is a block diagram illustrating a configuration of a mobile device according to another embodiment of the present invention. According to FIG. 36, the mobile device 100 includes a communication unit 110, a control unit 120, a storage unit 140, and a voice input unit 160. For convenience of description, the same components as those of the mobile device described in the above-described other embodiments among the components illustrated in FIG. 36 are described with the same names and reference numerals, but the functions are implemented differently according to the embodiments. Can be.

In FIG. 36, the communication unit 110 may communicate with the terminal device 200 installed in the vehicle. Since a specific communication method has already been mentioned in the above-mentioned part, duplicate description thereof will be omitted.

The voice input unit 160 is a component for receiving a user voice. The voice input unit 160 may include various components such as a microphone (not shown), an amplifier (not shown), a noise filtering circuit (not shown), and the like. The voice input unit 160 transmits the input user voice to the controller 120.

The storage 140 is a component that stores various programs and data used in the mobile device 100.

The controller 120 may control the overall functions of the mobile device 100 using the programs and data stored in the storage 140.

In detail, the controller 120 sets search criteria differently according to a state of a user who uses the mobile device 100. When the user voice is input through the voice input unit 160, the controller 120 analyzes the input user voice. User speech analysis can be done in a variety of ways. For example, the controller 120 may calculate the energy of the received user voice, classify the energy level of the voice signal according to the calculated energy, and detect the voice section through dynamic programming. In addition, the phoneme is generated by detecting a phoneme, which is the minimum unit of the voice, based on an acoustic model in the detected voice section, and applying a HMM (Hidden Markov Model) probability model to the generated phoneme data. Can be converted to text. The controller 120 may detect a command and a search word from the converted text. Specifically, the controller 120 detects text registered in a command database stored in the storage 140 as a command. Also, unregistered text is detected as a search word. The controller 120 may perform various functions by using the detected command and the search word.

For example, when a command for searching for a destination is detected, the controller 120 searches for a destination corresponding to a search word. In this case, the search criteria for searching for the destination may be set according to the state of the user as described above.

The controller 120 searches for at least one destination corresponding to the user voice using the set search criteria. The control unit 120 provides the search result to the terminal device 200 through the communication unit 110. Accordingly, the destination candidates selected in consideration of the user voice and the user state may be displayed on the terminal device 200. When the user selects one of the destination candidates, the selected destination candidate is determined as the final destination, and the terminal device 200 may perform a navigation function to the determined final destination.

Here, the user state may mean whether the user is driving or walking or resting. Alternatively, the user status may be determined based on various information such as the current location of the user, a future schedule, and the like. If it is determined that the user is in a driving state, the controller 120 may set a search criterion for first searching for a destination providing a service related to the vehicle. On the other hand, if the user has a tight subsequent schedule, a search criterion for preferentially searching for a destination providing a quick service may be set. Alternatively, when the user is not a special situation, the controller 120 may search for a destination according to a typical navigation destination setting option such as a shortest distance criterion, a shortest time criterion, an optimal distance criterion, and the like.

37 is a diagram illustrating an example of a destination search process. 37 illustrates a screen configuration of the terminal device 200 controlled by the mobile device 100.

When the user drives and says, "Where do you eat?", The voice input unit 160 of the mobile device 100 receives the voice and provides the voice to the controller 120. As described above, the controller 120 converts the input voice into text and displays the same through the display 130.

If the communication unit 110 of the mobile device 100 is in communication with the terminal apparatus 200 installed in the vehicle, the controller 120 may determine that the user is driving or preparing to drive. In addition, the word "where" in the user's voice may be detected as a command meaning a search command, and "bob" may be detected as a search word. The controller 120 may also detect a related search word in addition to the search word directly detected. For example, in the case of "bob", the controller 120 may detect various words such as "restaurant", "food store", "food court", and the like as related search terms.

The controller 120 determines a place for providing a service related to a vehicle in consideration of a driving state, and searches for a restaurant related to a search word according to the search criteria. For example, you can search for a restaurant with a parking lot where you can park a car, a restaurant that is a drive-in restaurant where you can get food while passing through a car, a restaurant near a car repair shop or a car wash.

In FIG. 37, a state in which the user says "where should I stop for lunch" is shown. The controller 120 converts the voice pronounced by the user into text, and transmits the converted text 3711, a search word, and a command to the terminal device 200. The search term also includes a related search term.

The terminal device 200 displays a screen 3710 including the received text 3711 on the display unit. The screen 3710 may also display a phrase 3712 indicating that the search is in progress. In addition, the terminal device 200 executes a navigation program to detect destination candidates including the received search word. The terminal device 200 displays a screen 3720 including detected destination candidates. In FIG. 37, the searched destination candidates are displayed in consideration of the driving state of the vehicle. When the user selects one of the destination candidates, the terminal device 200 determines the selected destination candidate as the destination, and executes a navigation function from the current location to the determined destination.

Meanwhile, the user schedule information may be stored in the storage 140. In this case, the controller 120 may check a subsequent schedule of the user based on the user schedule information. As a result of the check, if there is a subsequent schedule, the controller 120 may set a search criterion for searching for a destination according to a subsequent schedule time or place. That is, if the subsequent schedule time is shortly remaining from the current time, the controller 120 may set a search criterion to search for a fast food restaurant or a drive-in restaurant first. Alternatively, the controller 120 may set a search criterion to preferentially search for a restaurant located in a moving path to the subsequent schedule place if the next schedule place is stored.

In addition, the controller 120 may search for a destination by itself when a user voice is input while communication with the terminal device 200 is not connected. When the display unit is provided in the mobile device 100, the controller 120 may display a navigation screen up to the searched destination on the display unit. On the other hand, if the display unit does not exist, the controller 120 may output a guide voice for guiding the searched destination through the speaker. In this case, the search criterion may be set to the shortest distance, the shortest time, or the like. Alternatively, the search criterion may be set to search based on a place selected by a plurality of users or a popularity ranking.

In FIG. 36 and FIG. 37, the mobile device 100 analyzes the user voice to determine a determination criterion. However, the mobile device 100 transmits the user voice to an external server device to perform such an operation in the server device. It may be implemented to.

38 shows a configuration of a network system according to this embodiment. According to FIG. 38, when a voice of a user is input, the mobile device 100 may transmit the voice, user status information, location information, and the like to the server device 300 through the Internet. Here, the server device 300 may be implemented as a server device that provides a voice analysis service, a navigation service, and the like. The server device 300 may search for a destination and provide a search result to the mobile device 100 based on the provided user voice, user status information, location information, and the like. The mobile device 100 may transmit the provided search result to the terminal device 200 so that the terminal device 200 displays the screen 3710.

39 is a flowchart illustrating a search method of searching for a destination according to an embodiment of the present invention. Referring to FIG. 39, when a user's voice is input (S3910), the mobile device 100 determines whether the user is driving (S3920). In brief, when the communication with the terminal device 200 is connected, it may be determined that the device is in operation. Alternatively, if the coordinates provided from the GPS chip of the vehicle on which the terminal device 200 is mounted may be changed, it may be determined that the driver is driving.

If it is determined that the user is driving, the mobile device 100 sets a first search criterion (S3930). Specifically, a first search criterion may be set to first search for destination candidates providing a service related to a vehicle among destination candidates including a search word. On the other hand, if it is determined that the user is not driving, the mobile device 200 may set a second search criterion (S3940). Here, the second search criterion may be a general navigation search option such as a shortest time, a shortest distance, an optimal route, and the like.

The mobile device 100 performs a search based on the set search criteria in operation S3950. The search result is provided through the terminal device 200 (S3960).

40 is a flowchart illustrating a search method for searching for a destination according to another embodiment of the present invention. Referring to FIG. 40, when a user's voice is input (S4010), the mobile device 100 determines whether a subsequent schedule exists (S4020).

Accordingly, if a subsequent schedule exists, a first search criterion is set (S4030). If a subsequent schedule does not exist, a second search criterion is set (S4040). Here, the first search criterion refers to a criterion for searching for a destination candidate in consideration of a subsequent schedule time or place, and the second search criterion refers to a general navigation search option as described above. When the search criteria are determined, the mobile device performs a search based on the determined search criteria (S4050), and provides the search results accordingly through the terminal device 200 (S4060).

As described above, an appropriate destination search can be made according to the user's situation. Meanwhile, in the above-described embodiments, the description has been made based on a case in which the user inputs a voice. However, even when the user directly inputs the text, the search criteria may be set differently according to the user's state. In addition, in the above-described embodiments, the mobile device 100 receives a voice, sets a search criterion, and detects a search word or a command, but is not necessarily limited thereto. For example, as described with reference to FIG. 38, the external server apparatus 300 may perform such an operation, or the terminal apparatus 200 directly receives a user's voice without the intervention of the mobile device 100, and sets a search criterion. The search may be performed accordingly.

Meanwhile, according to another exemplary embodiment of the present disclosure, the terminal device 200 may provide a location based service using metadata stored in the mobile device 100. Hereinafter, an embodiment using meta data will be described in detail.

<Example using metadata of mobile device>

FIG. 41 is a block diagram illustrating an embodiment of providing various services using metadata of a mobile device.

According to FIG. 41, the mobile device 100 may provide metadata to the terminal device 200. The terminal device 200 includes a display 3110, a controller 3120, a communicator 3130, and a storage 3140.

Various applications may be installed in the storage unit 3140. Specifically, a navigation program, a multimedia content playback program, a schedule management program, and the like may be installed. In addition, the storage unit 3140 may also store map data, address book information, schedule information, and multimedia contents used in each application.

The communication unit 3130 is a component for receiving metadata by performing communication with a mobile device. The communication unit 3130 provides the received metadata to the control unit 3120. Meta data refers to data that is additionally provided for various data such as a picture, a video, an address book, schedule information, and the like stored in the mobile device. For example, in the case of content such as a picture or a video, a place where the picture or a video is taken, a shooting date and time, and the like may be stored in the form of metadata. In addition, even in the case of schedule information, location information about a place where the schedule is performed may be stored together in the form of metadata.

When the metadata is received through the communication unit 3130, the controller 3120 configures various screens using the metadata and displays the various screens on the display 3110. Specifically, the controller 3120 executes an application installed in the storage 3140 and provides metadata as an input for the application. Accordingly, the application executes a function based on the metadata. When the application configures an execution screen using metadata, the controller 3120 displays the execution screen on the display 3110.

The application to be executed can be selected by the user. That is, when the terminal device 200 is powered on, the controller 3120 may display an icon corresponding to the application installed in the storage 3140 on the display 3110. When the user touches the screen of the display 3110 or selects an icon by using the mobile device 100 or the user voice as described above, the controller 3120 executes an application corresponding to the selected icon, The execution screen is displayed on the display 3110. In this case, the controller 3120 may change the execution screen by using the location information in the metadata provided by the mobile device 100.

Meanwhile, when communication with the mobile device 100 is connected, the controller 3120 displays an icon corresponding to an application installed in the mobile device 100 together with an icon corresponding to an application installed in the terminal device 200. ) Can be displayed. When the user selects an icon corresponding to an application installed in the mobile device 100, the controller 3120 composes a screen using location information corresponding to the selected icon and displays it on the display 3110.

Meanwhile, according to FIG. 41, the mobile device 100 includes a communication unit 110, a control unit 120, and a storage unit 140. The communication unit 110 is a component for performing communication with the terminal device 200.

The storage 140 is a component in which various applications and data can be stored. In detail, the storage 140 may store metadata including location information.

The controller 120 provides the metadata to the terminal device 200 when the communication with the terminal device 200 is connected. In this case, the controller 120 may automatically transmit the entire metadata to the terminal device 200 when a communication connection is made. Alternatively, when an event in which an icon of an application installed on the mobile device is selected on the screen of the terminal device 200 occurs, all metadata related to the application may be transmitted to the terminal device 200 at that time. Alternatively, when one content is selected while the execution screen of a specific application is mirrored and displayed on the terminal device 200, only metadata of the corresponding content may be transmitted to the terminal device 200.

As such, when the metadata is provided to the terminal device 200, the terminal device 200 may display a service screen based on location information.

42 is a flowchart illustrating a method of using metadata of a terminal device according to an embodiment of the present invention. According to FIG. 42, when communication with the mobile device 100 is connected (S4210), the terminal device 200 displays an icon related to the mobile device on the screen (S4220). Subsequently, when the displayed icon is selected (S423), the terminal device 200 detects location information from metadata corresponding to the selected icon (S4240). For example, when an icon corresponding to a gallery program is selected, location information on a location where the photo or video is captured may be detected from metadata of the photo or video content included in the gallery program. When there are a plurality of pictures or videos managed by the gallery program, only the location information of the content selected by the user may be detected among the plurality of contents.

When the location information is detected, the terminal device 200 reconfigures the screen using the detected location information (S4250). Specifically, the terminal device 200 may automatically set the detected location information as a destination, and configure a navigation screen for guiding a moving route to the destination. The terminal device 200 may display the reconstructed screen in operation S4260. As such, the terminal device 200 may provide various services using location information stored in the mobile device 100.

43 illustrates an example of a screen configuration of the terminal device 200 connected to the mobile device 100. Referring to FIG. 43, when the terminal device 200 is connected to the mobile device 100, the mobile device 100 is added to the screens 4300 of the terminal device 200 in addition to the existing icons 4310-1 and 4310-2. ) Icons 4310-3 and 4310-4 corresponding to applications installed on the screen are displayed. These icons 4310-1 to 4310-4 may be displayed in a list or tile view form in alphabetical order, chronological order, or the like.

In FIG. 43, although the icons 4310-1 to 4310-4 are displayed in the main screen 4300, they need not be implemented in this manner. For example, icons 4310-3 and 4310-4 associated with the mobile device 100 may be displayed only when a navigation function is executed in the terminal device 200 or a menu for checking a current location is selected.

FIG. 44 illustrates a screen change when one of the icons 4310-4 related to the mobile device 100 is selected in the main screen 4300 of the terminal device 200. In FIG. 44, it is assumed that an icon 4310-4 corresponding to a gallery program is selected. In this case, the screen 4400 including thumbnail images of various contents managed by the gallery program is displayed on the terminal device 200. That is, the mobile device 100 may configure a screen of contents managed by the gallery program and provide the screen to the terminal device 200. In this state, when the user selects one image 4410, the terminal device 200 detects location information from metadata corresponding to the selected image 4410. The controller 3120 of the terminal device 200 automatically sets the detected location information as the destination 4510 and displays the navigation screen 4500 up to the destination.

45 is a flowchart for explaining a method of using metadata according to another embodiment of the present invention. According to FIG. 45, the terminal device 200 displays an icon corresponding to an already installed application (S4510). In this state, when the user selects one icon (S4520), the terminal device 200 displays an execution screen of a program corresponding to the selected icon (S4530). For example, if a navigation program is executed, a map screen may be displayed.

The terminal device 200 may display at least one indicator corresponding to the location information in the metadata provided by the mobile device 100 in the execution screen (S4540). If the map screen is displayed as described above, the terminal device 200 may display an indicator for displaying a point corresponding to each location information on the map screen. Accordingly, when the user selects one indicator, the terminal device 200 may automatically set location information corresponding to the selected indicator as a destination and execute a navigation function.

46 is a view for explaining an example of the screen configuration of the terminal device shown in FIG. 46, in the screen 4300 of the terminal device 200, icons 4310-1 and 4310-2 for the application installed in the terminal device 200 and the mobile device 100 correspond to each other. Icons 4310-3 and 4310-4 may be displayed together. The icons 4310-3 and 4310-4 corresponding to the mobile device 100 may include icons corresponding to various information stored in the mobile device 100 as well as icons corresponding to applications installed in the mobile device 100. have. For example, the mobile device 100 may store various personal profile information such as a photo, an address book, schedule information, a purchase wish list, and a visit area.

The user may select any icon among icons displayed on the screen 4300. 46 illustrates a case where an icon 4310-2 of an application installed in the terminal device 200 is selected. Assuming that the selected icon 4310-2 is an icon corresponding to a navigation program, the terminal device 200 displays a map screen 4600 and displays a selectable menu list 4610 on the map screen 4600. do. The menu list 4610 also includes a menu 4611 corresponding to the mobile device 100.

In this state, when the user selects the menu 4611, the indicators 4620 and 4630 based on various types of information stored in the mobile device 100 are displayed. According to FIG. 46, text 4620 indicating various location information stored in the mobile device 100 and an icon 4630 of an application using the location information are displayed on the map screen 4600. When the user selects such a text or icon, the terminal device 200 may automatically set location information corresponding to the selected text or icon as a destination, and perform a navigation function to the set destination.

As described above, according to the present embodiment, the terminal device 200 may provide various services by using metadata provided from the mobile device 100.

According to various exemplary embodiments as described above, the mobile device 100 may not only control the terminal device 200 by interworking with the terminal device 200, but also provide various services. The mobile device 100 may be implemented in various types of products such as a mobile phone, a tablet PC, a PDA, an MP3 player, a notebook PC, and the like, and the terminal device 200 may also be detachable to a vehicle head unit or a vehicle mounted in a vehicle. It may be implemented as a device. In addition, the terminal device 200 may be implemented as a portable device such as a mobile phone, a tablet PC, a PDA, an MP3 player, a notebook PC.

Hereinafter, a general configuration of the mobile device 100 implemented in a form capable of supporting various functions such as a mobile phone or a tablet PC will be described in detail.

According to FIG. 47, the mobile device 100 includes a communication unit 110, a control unit 120, a display unit 130, a storage unit 140, a short range communication unit 150, a voice input unit 160, and a GPS chip 171. , A video processor 172, an audio processor 173, a button 174, a camera unit 175, a speaker unit 176, and a detection unit 177.

The detector 177 is a component for detecting a user's touch manipulation with respect to the display 130. The sensing unit 177 may include a touch sensor. The display 130 and the detector 177 may be integrally formed to form one touch screen. Accordingly, the sensing unit 177 detects a user operation on the surface of the display unit 130 and notifies the control unit 120.

The controller 130 controls the overall operation of the mobile device 100 using various programs and data stored in the storage 140. Specific operations of the controller 130 may be different for each of the above-described embodiments.

The communication unit 110 is a component that communicates with various types of external devices including the terminal device 200 according to various types of communication methods. The communication unit 110 may include a Wi-Fi chip 111, a Bluetooth chip 112, a wireless communication chip 113, and the like.

The Wi-Fi chip 111 and the Bluetooth chip 112 communicate with each other through a WiFi method and a Bluetooth method. In the case of using the Wi-Fi chip 111 or the Bluetooth chip 112, various connection information such as SSID and session key may be transmitted and received first, and then various communication information may be transmitted and received using the same. The wireless communication chip 113 refers to a chip that performs communication according to various communication standards such as IEEE, Zigbee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), Long Term Evoloution (LTE), and the like.

The short range communication unit 150 is a component that transmits and receives data to and from external devices including the terminal device 200 through a near field communication (NFC) method. The NFC method refers to a method of transmitting and receiving data using a 13.56 MHz band among various RF-ID frequency bands such as 135 kHz, 13.56 MHz, 433 MHz, 860-960 MHz, and 2.45 GHz. The controller 120 may receive information such as a URL of the terminal device 200 through the local area communication unit 150, access the URL, and receive a control UI for the terminal device.

As such, the controller 120 communicates with various external devices by using the communication unit 150. Accordingly, the operation as described in the aforementioned various embodiments can be performed.

The GPS chip 171 is a component for receiving a GPS signal from a Global Positioning System (GPS) satellite and calculating a current position of the mobile device 100. When the navigation function is selected, the controller 120 may determine the current position of the mobile device 100 using the GPS chip 171 and automatically set the current position as a starting point.

The video processor 172 is a component for processing video data included in content received through the communicator 150 or content stored in the storage 140. The video processor 172 may perform various image processing such as decoding, scaling, noise filtering, frame rate conversion, resolution conversion, and the like on the video data. When the image is a photo or video content, the video processor 172 may perform the above-described image processing on the content and convert the image into a form that can be additionally displayed on the map screen.

The audio processor 173 is a component for processing audio data included in content received through the communication unit 150 or content stored in the storage 140. The audio processor 173 may perform various processing such as decoding, amplification, noise filtering, and the like on the audio data. The audio processor 173 may generate various voice guidance messages, notification sounds, and the like, which are required during navigation.

When the playback program for the multimedia content is executed, the controller 120 may drive the video processor 172 and the audio processor 173 to play the content. The display 110 may display an image frame generated by the video processor 172.

In addition, the speaker unit 176 outputs audio data generated by the audio processor 173. In particular, various navigation guide messages, notification sounds, and the like may be output while the navigation is in progress.

The button 174 may be various types of buttons such as a mechanical button, a touch pad, a wheel, and the like formed on an arbitrary area such as a front portion, a side portion, a back portion, etc. of the main body exterior of the mobile device 100.

The voice input unit 160 is a component for receiving a user voice or other sound and converting the same into audio data. As described above, according to an embodiment of controlling the terminal device 200 according to a user's voice, the controller 120 analyzes a user's voice input through the voice input unit 160 and performs a control operation corresponding to the voice. Can be done.

The camera unit 175 is a component for capturing a still image or a moving image under the control of a user. The camera unit 175 may be implemented in plurality, such as a front camera and a rear camera.

When the camera unit 175 and the voice input unit 160 are provided, the controller 120 may perform a control operation according to a user voice input through the voice input unit 160 or a user motion recognized by the camera unit 175. It may be. That is, the mobile device 100 may operate in a motion control mode or a voice control mode. When operating in the motion control mode, the controller 120 activates the camera unit 175 to capture the user, track the motion change of the user, and perform a control operation corresponding thereto. When operating in the voice control mode, the controller 120 may operate in a voice recognition mode that analyzes a user voice input through the voice input unit 160 and performs a control operation according to the analyzed user voice.

In addition, although not illustrated in FIG. 47, according to an embodiment, various external input ports for connecting to various external terminals such as a headset, a mouse, a LAN, or a USB port may be connected to a USB connector in the mobile device 100. Of course, it may further include a DMB chip for receiving and processing a Digital Multimedia Broadcasting (DMB) signal.

Meanwhile, although the above-described embodiments have been described separately for each embodiment, at least one or more embodiments may be implemented together. For example, the mobile device may include a display unit 130, a communication unit 120 which communicates with a terminal device displaying items classified into a plurality of groups in a list form, and communication with the terminal device. The controller 110 may hop a group of items displayed on the terminal device according to a touch operation performed on the terminal device. Here, since the method of the user's touch operation and the hopping operation accordingly have been described in detail in the above-described embodiment, redundant description thereof will be omitted.

As described above with respect to such embodiments, embodiments using location data may be combined together. In this case, the mobile device 100 further includes a storage unit 140 in which metadata including location information is stored, and the controller 120 provides the metadata to the terminal device 200 to store the metadata in the metadata. The service screen based on the location information may be displayed on the terminal device 200. Since an embodiment of providing a service using meta data has been described above in detail, duplicate description thereof will be omitted.

Alternatively, embodiments in which the operation of the terminal device is controlled using a user voice may be combined. Specifically, the mobile device 100 may further include a voice input unit for receiving a user voice. When the user voice is input, the controller 120 may set search criteria differently according to the user state. The controller 120 may search for at least one destination corresponding to the user voice by using the set search criteria, and provide the search result to the terminal device 200 through the communication unit 110.

If the user is in a driving state, the controller 120 may set a search criterion for first searching for a destination providing a service related to the vehicle. If the mobile device 100 further includes a storage unit 140 in which user schedule information is stored, the controller 120 checks a subsequent schedule of the user based on the user schedule information, and if there is a subsequent schedule, It is also possible to set search criteria for searching for the destination according to a subsequent schedule time or location.

When the address information of the terminal device is received from the terminal device 200, the controller 120 accesses the server device corresponding to the address information, receives the web page data, and uses the web page data to send the terminal device to the terminal device. An adaptive screen may be configured and provided to the terminal device 200 through a communication unit.

Various embodiments as described above may be implemented in the form of a terminal device control method. Detailed flowcharts and descriptions of these methods have already been described in the above-described embodiments, and thus redundant descriptions thereof will be omitted.

As described above, according to various embodiments of the present disclosure, various operations may be performed by interworking a mobile terminal and a terminal device that can be installed in a vehicle. Accordingly, the user can use a more secure and convenient service.

The terminal device control method or the service providing method according to the various embodiments described above may be coded in software and stored in a non-transitory readable medium. Such non-transitory readable media can be mounted and used in a variety of devices.

Specifically, performing communication with a terminal device displaying a list of items divided into a plurality of groups in the form of a list, detecting a touch manipulation performed on a screen of a display unit provided in the mobile device, according to the touch manipulation Program code for performing a control method including a control step of hopping a group of items displayed at the terminal device may be stored and provided in a non-transitory readable medium.

The non-transitory readable medium refers to a medium that stores data semi-permanently and is readable by a device, not a medium storing data for a short time such as a register, a cache, a memory, and the like. Specifically, it may be a CD, a DVD, a hard disk, a Blu-ray disk, a USB, a memory card, a ROM, or the like.

In addition, while the above has been shown and described with respect to preferred embodiments of the present invention, the present invention is not limited to the specific embodiments described above, the technical field to which the invention belongs without departing from the spirit of the invention claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or the prospect of the present invention.

100: mobile device 110: communication unit
120: control unit 130: display unit
140: storage unit 200: terminal device

Claims (20)

In a mobile device,
A display unit;
A communication unit for communicating with a terminal device displaying an item included in a first group of a plurality of groups;
And a controller configured to control the terminal device to display an item included in a second group of the plurality of groups according to a touch operation performed on the screen of the display unit when communication with the terminal device is connected. Mobile device. The method of claim 1,
The control unit,
When the preset first touch manipulation is performed on the screen of the display unit, the terminal device is controlled to display the items included in the previous group or the next group of the first group corresponding to the item displayed on the screen of the terminal device. Mobile devices. The method of claim 2,
The control unit,
When a preset second touch manipulation is performed on the screen of the display unit, the display unit switches to a handwriting recognition mode, and when text is drawn on the screen of the display unit in the handwriting recognition mode, displaying an item included in a group corresponding to the text. A mobile device, characterized in that for controlling the terminal device. The method of claim 3,
The control unit,
And displaying a graphical user interface (GUI) for inducing a user drawing on the display unit when the user is switched to the handwriting recognition mode. The method of claim 3,
The control unit,
And if the user drawing is not input for a preset time after the switch to the handwriting recognition mode, the mobile device returns to the touch control mode of controlling the terminal device according to the first touch manipulation. The method of claim 1,
Further comprising: a storage unit for storing metadata including location information;
The control unit,
And providing the metadata to the terminal device so that a service screen based on location information in the metadata is displayed on the terminal device. The method of claim 1,
Further comprising a; voice input unit for receiving a user voice,
The control unit,
When the user voice is input, search criteria are differently set according to a user state, and at least one destination corresponding to the user voice is searched using the set search criteria, and the search result is transmitted through the communication unit. Mobile device, characterized in that provided by. The method of claim 7, wherein
The control unit,
And when the user is driving the vehicle, setting search criteria for preferentially searching for a destination providing a service related to the vehicle. The method of claim 7, wherein
And a storage unit in which user schedule information is stored.
The control unit,
Confirming a subsequent schedule of the user based on the user schedule information, and setting a search criterion for searching for the destination according to a subsequent schedule time or place if the subsequent schedule exists. The method of claim 1,
The control unit,
When the address information is received from the terminal device, the server device corresponding to the address information is accessed to receive the web page data, and the screen is adapted to the terminal device using the web page data to configure the screen through the communication unit. A mobile device, characterized in that provided to the terminal device. In the terminal device control method of a mobile device,
Communicating with a terminal device displaying an item included in a first group of the plurality of groups;
Detecting a touch manipulation made to a screen of a display unit provided in the mobile device;
And transmitting, by the terminal device, a control signal to the terminal device to display an item included in a second group of the plurality of groups according to the touch manipulation. The method of claim 11,
The step of transmitting the control signal,
When a preset first touch manipulation is detected, a control signal is transmitted to the terminal device to display an item included in a previous group or a next group of the first group corresponding to the item displayed on the screen of the terminal device. Terminal device control method. The method of claim 12,
The step of transmitting the control signal,
Switching to a handwriting recognition mode when a preset second touch manipulation is detected;
And controlling the terminal device to display an item included in a group corresponding to the text when the text is drawn on the screen of the display unit in the handwriting recognition mode. The method of claim 13,
And displaying a graphical user interface (GUI) for inducing a user drawing on the display unit when switching to the handwriting recognition mode. The method of claim 13,
And returning to the touch control mode if the user drawing is not input for a preset time after the switch to the handwriting recognition mode. The method of claim 11,
And providing meta data including location information to the terminal device, so that a service screen based on the location information in the metadata is displayed on the terminal device. The method of claim 11,
Receiving a user voice;
Setting search criteria differently according to a user state;
Searching for at least one destination corresponding to the user voice using a set search criterion; And
And providing the search result to the terminal device. The method of claim 17,
Setting the search criteria,
And when the user is driving the vehicle, setting a search criterion for preferentially searching for a destination providing a service related to the vehicle. The method of claim 17,
Setting the search criteria,
And a search criterion for searching for the destination according to a subsequent schedule time or place if the user has a subsequent schedule. The method of claim 11,
When address information is received from the terminal device, accessing a server device corresponding to the address information and receiving web page data;
And constructing a screen adaptive to the terminal device using the web page data and providing the screen to the terminal device.

Images