KR20140117248A - termincal device mauntable in a car, mobile device, and methods for providing service thereof - Google Patents

Abstract

A mobile device is disclosed. The mobile device includes: a display part; a communication part to perform communication with a terminal device which displays an item with a list type; and a control part which hops the group of the item displayed on the terminal device in accordance to a touch manipulation on the screen of the display part when communication with the terminal is connected. Thereby, various services interworking with the terminal device installed on a car can be provided.

Description

TECHNICAL FIELD [0001] The present invention relates to a terminal device capable of being mounted on a vehicle, a mobile device interlocked with the terminal device, and a service providing method of the terminal device.

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a vehicle mounted system, a mobile device connected thereto and a service providing method thereof, and more particularly to a vehicle mounted system and a mobile device capable of providing various services through mutual communication connection, Lt; / RTI >

Due to the development of electronic technology, various types of mobile devices have been developed and popularized. The mobile device provides various services such as a call service, a mail service, and a web search service by using various hardware or software provided therein.

However, when a mobile device is implemented as a portable type, the size, number and type of hardware that can be mounted in the device are limited. Accordingly, the types of services that can be provided using the mobile device are also limited.

On the other hand, in recent years, a vehicle-mounted system that provides various services such as a navigation function, a multimedia content reproduction function, and the like to a moving means such as a vehicle is often mounted. Such a vehicle-mounted system can provide various convenience functions to the user of the vehicle. However, due to the hardware and software limitations of vehicle-mounted systems, the types of services that can be provided are limited.

Accordingly, a need has arisen for a technology that can provide a variety of services by linking a vehicle-mounted system and a mobile device.

It is an object of the present invention to provide a vehicle-mounted system, a mobile device connectable thereto, and a method of providing a service using the same, thereby improving user's convenience and satisfaction.

According to an aspect of the present invention, there is provided a mobile device including a display unit, a terminal unit displaying items classified into a plurality of groups in a list form, a communication unit communicating with the terminal unit, And a control unit for hopping a group of items displayed on the terminal according to a touch operation performed on the screen of the display unit.

Here, when the predetermined first touch operation is performed on the screen of the display unit, the control unit hopping a group of items displayed on the screen of the terminal device to a previous group or a next group, The terminal apparatus can be controlled to display the terminal apparatus.

Alternatively, the control unit switches to a handwriting recognition mode when a predetermined second touch operation is performed on the screen of the display unit, and when the text is drawn on the screen of the display unit in the handwriting recognition mode, And control the terminal device to display an item belonging to the hopped group.

The control unit may display an affordance GUI for guiding a user drawing on the display unit when the handwriting recognition mode is switched to.

The control unit may return to the touch control mode for controlling the terminal device according to the first touch operation if the user drawing is not input for a predetermined time after switching to the handwriting recognition mode.

According to another embodiment of the present invention, the mobile device may further include a storage unit for storing metadata including location information. The control unit may provide the metadata to the terminal apparatus so that a service screen based on the location information in the meta data is displayed on the terminal apparatus.

Alternatively, the mobile device may further include a voice input unit for receiving a user voice. In this case, when the user voice is input, the control unit sets search criteria differently according to the user state, searches for at least one destination corresponding to the user voice using the set search criteria, And may be provided to the terminal device through the communication unit.

Here, if the user is in operation, the control unit may set a search criterion for preferentially searching for a destination providing a service related to the vehicle.

Alternatively, the mobile device may further include a storage unit for storing user schedule information. In this case, the control unit may check the user's subsequent schedule based on the user schedule information, and if the subsequent schedule exists, A search criterion for searching the destination according to a schedule time or a place can be set.

According to another embodiment of the present invention, when the address information is received from the terminal device, the controller accesses the server device corresponding to the address information to receive the web page data, A screen adaptive to the terminal device may be configured and provided to the terminal device through the communication unit.

Meanwhile, a method of controlling a terminal device of a mobile device according to an exemplary embodiment of the present invention includes performing communication with a terminal device displaying items classified into a plurality of groups in a list form, And a control step of hopping a group of items displayed on the terminal according to the touch operation.

Here, the control step may include a step of hopping a group of items displayed on the screen of the terminal device to a previous group or a next group when a predetermined first touch operation is detected, The device can be controlled.

Alternatively, the control step may include a step of switching to a handwriting recognition mode when a predetermined second touch operation is detected, a step of hopping a group corresponding to the text when the text is drawn on the screen of the display unit in the handwriting recognition mode, And controlling the terminal device to display an item belonging to the group.

Alternatively, the method may further include displaying an affordance GUI for guiding the user drawing on the display unit when the handwriting recognition mode is switched to.

The method may further include returning to the touch control mode if the user drawing is not input for a predetermined time after the handwriting recognition mode is switched.

According to another embodiment of the present invention, there is provided a method of providing metadata including positional information to the terminal device so that a service screen based on positional information in the metadata is displayed on the terminal device have.

Receiving a user voice, setting a search criterion differently according to a user status, searching at least one destination corresponding to the user voice using a set search criterion, To < / RTI >

The step of setting the search criterion may set a search criterion for preferentially searching for a destination providing a service related to the vehicle when the user is in operation.

Alternatively, the step of setting the search criterion may set a search criterion for searching for the destination according to a subsequent schedule time or place if a subsequent schedule of the user exists.

According to another embodiment of the present invention, there is provided a method for accessing a web page, comprising the steps of: receiving address information from the terminal device, accessing a server device corresponding to the address information and receiving web page data; And configuring a screen adaptive to the terminal apparatus and providing the screen to the terminal apparatus.

According to various embodiments of the present invention as described above, the user can use various services by connecting the communication between the vehicle-mounted system and the mobile device. Accordingly, convenience and satisfaction of the user can be greatly improved.

1 is a diagram showing a configuration of a vehicle control system according to an embodiment of the present invention;
2 is a diagram for explaining communication between a terminal device and a mobile device,
3 is a block diagram showing a configuration of a mobile device according to an embodiment of the present invention,
4 is a diagram illustrating an example of the operation of the mobile device of FIG. 3;
Figure 5 is a diagram illustrating another example of operation of the mobile device of Figure 3;
6 and 7 are diagrams showing examples of screens of mobile devices,
8 is a view showing an example of a screen of a mobile device in a mode switching process,
9 is a diagram illustrating another example of controlling the operation of a terminal device using a mobile device,
10 is a diagram for explaining screen switching of a mobile device according to a motion,
11 is a flowchart illustrating a method of controlling a terminal device according to an embodiment of the present invention.
12 is a timing diagram for explaining the operation of the mobile device and the terminal device;
13 is a block diagram showing a configuration of a control apparatus according to another embodiment of the present invention,
FIG. 14 is a diagram for explaining a control process using the control device of FIG. 13;
15 is a view showing an example of the external configuration of the control device,
16 to 18 are diagrams for explaining an interlocking process of the control device and the terminal device,
19 is a diagram for explaining a screen switching method using a control device,
20 is a view for explaining an appearance of a control device attachable to a vehicle handle,
FIG. 21 is a flowchart illustrating a control method using a control device according to another embodiment of the present invention. FIG.
FIG. 22 is a flowchart illustrating a method of operating a control apparatus according to another embodiment of the present invention. FIG.
23 to 26 are diagrams for explaining the button color changing process of the control device,
27 and 28 show examples of button indicators of a control device according to another embodiment of the present invention;
29 is a view showing an example of screen configuration of a terminal device for matching buttons and menus;
30 is a timing diagram for explaining an operation in a vehicle control system according to another embodiment of the present invention;
31 is a block diagram showing a configuration of a mobile device and a terminal device included in the vehicle control system of Fig. 30,
FIG. 32 is a view for explaining the operation of the mobile device and terminal device of FIG. 31;
FIG. 33 is a diagram for explaining an example of the screen configuration in the terminal device of FIG. 31;
34 is a timing chart for explaining the operation of the vehicle control system according to another embodiment of the present invention;
FIG. 35 is a block diagram showing a configuration of a mobile device and a terminal device included in the vehicle control system of FIG. 34;
36 is a block diagram showing a configuration of a mobile device according to another embodiment of the present invention;
37 is a diagram showing a screen configuration example of a terminal device controlled by the mobile device of Fig. 36,
38 is a view for explaining the operation of a vehicle control system controlled in accordance with a user voice,
39 and 40 are flowcharts for explaining various examples of a control method of controlling a terminal apparatus according to a user voice,
41 is a block diagram showing a configuration of a vehicle control system according to an embodiment of the present invention,
42 is a flowchart for explaining an example of the operation of the vehicle control system of FIG. 41;
43 is a diagram showing an example of the screen configuration of the mobile device and the mirrored terminal device,
44 is a diagram showing a screen configuration example of the terminal device according to the method of FIG. 42,
FIG. 45 is a flowchart for explaining another example of the operation of the vehicle control system of FIG. 41;
FIG. 46 is a diagram showing an example of the screen configuration of the terminal device according to the method of FIG. 45,
47 is a block diagram illustrating a general configuration of a mobile device according to various embodiments of the present invention.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram showing a configuration of a vehicle control system according to an embodiment of the present invention. 1, the present system includes a mobile device 100, a terminal device 200, and a server device 300. [

The mobile device 100 refers to various devices that a user can use while carrying. Specifically, the mobile device 100 may be implemented as a portable device such as a mobile phone, a tablet PC, a laptop PC, a PDA, an MP3 player, an electronic notebook, and the like. The mobile device 100 can perform communication with the terminal device 200 or the server device 300. [ Although only one mobile device 100 is shown in FIG. 1, a plurality of mobile devices 100 may be included in the system.

The terminal device 100 refers to a system mounted on a moving means such as the vehicle 10 and providing various services. Alternatively, the terminal device 100 may be referred to as a vehicle head unit, a center fascia, a vehicle control system, a vehicle control device, a multimedia device, and the like. Explain. 1, the terminal device 100 is mounted on a vehicle. However, the terminal device 100 is not necessarily limited to a vehicle, and may be mounted on various moving means such as a cycle, a motorcycle, a ship, an airplane, or the like.

The server device 300 is a device that communicates with the mobile device 100 to transmit and receive various signals. The server device 300 may be a device connected to the mobile device 100 through various networks such as a web server, a communication company server, and a cloud server. Further, when the terminal apparatus 200 itself has a communication unit, it can perform communication with the terminal apparatus 200 as well.

Meanwhile, the mobile device 100 can communicate with the terminal device 200 through various communication methods.

2 is a diagram for explaining a concrete communication connection method between the terminal device 200 and the mobile device 100. As shown in FIG.

2, the terminal device 200 may include various devices such as a hands-free kit (HFK), a navigation device, a multimedia player, and the like. The respective devices can be appropriately distributed in the room of the moving means. The terminal device 200 can transmit and receive various signals, data, contents, and the like to and from the mobile device 100 through various communication methods such as Bluetooth, Wi-Fi, and USB.

Specifically, when the mobile device 100 receives or transmits a call, the handsfree kit of the terminal device 200 is connected to the mobile device 100 via Bluetooth. When the mobile device 100 receives the voice signal uttered by the other party of the phone and outputs the voice signal to the handsfree kit, the handsfree kit amplifies the signal and converts it into a voice signal through various speakers (not shown) . In addition, the hands-free kit amplifies the voice signal of the user, which is converted through a microphone (not shown) mounted in the vehicle, and transmits the amplified voice signal to the mobile device 100 to be transmitted to the other party. Accordingly, the user can make a call without holding the mobile device 100 during operation.

In addition, the mobile device 100 can transmit / receive various data to / from the terminal device 200 according to the Wi-Fi system. Specifically, the mobile device 100 can implement the Digital Living Network Alliance (DLNA) function and provide it to the terminal device 200. The terminal device 200 can receive various contents from the mobile device 100. [ Accordingly, the terminal device 200 can display various content screens through the built-in display unit.

Also, the terminal device 200 may receive control signals from the mobile device 100 according to Bluetooth, Wi-Fi, and various wired / wireless communication methods. The terminal device 200 can perform various control operations according to the received control signal.

Also, the terminal device 200 may be connected to the mobile device 100 via an interface such as a USB to perform a tethering function, and exchange other data and signals.

As shown in FIGS. 1 and 2, the mobile device 100 can provide various services in cooperation with the terminal device 200 and the server device 300. Hereinafter, the services that can be provided by such a system will be described in detail for each embodiment.

≪ Embodiment using mobile device as input means >

3 is a block diagram illustrating a configuration of a mobile device according to an embodiment of the present invention. Referring to FIG. 3, the mobile device 100 includes a communication unit 110, a control unit 120, and a display unit 130.

The display unit 130 is a component for displaying various screens. The display unit 130 may be implemented in a suitable size and shape so as to be mountable to the mobile device 100. Depending on the type of mobile device 100, the display unit 130 may be implemented as various types of displays such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a plasma display panel (PDP) In addition, a driving circuit, a backlight unit, and the like that can be implemented in the form of an a-si TFT, a low temperature poly silicon (LTPS) TFT, an OTFT (organic TFT)

The communication unit 110 is a component for performing communication with various external devices including the terminal device 200. [ The communication unit 110 may include a variety of devices such as WiFi, Bluetooth, Zigbee, 3G (Third Generation), 3GPP (Third Generation Partnership Project), LTE (Long Term Evolution) It is possible to perform communication using a wireless communication system, a wired communication system such as a USB, a serial interface, or the like.

The controller 120 operates in the touch control mode when the communication with the terminal 200 is connected through the communication unit 110. [ The touch control mode is a mode for controlling the operation of the terminal according to a touch operation performed on the screen of the display unit 130. [ The touch operation may include various operations such as a simple touch, a double touch, a multi-touch, a touch and drag, a touch and flick, and a drawing operation. The simple touch means an operation of touching the screen of the display unit 130, the double touch means an operation of touching twice continuously, and the multi-touch means an operation of simultaneously touching a plurality of points. Touch and drag is an operation to move a touch point by touching a display screen. Touch and flick refers to an operation of touching a screen and rapidly moving in one direction and then releasing the touch. In addition, the drawing operation refers to an operation of drawing symbols, letters, symbols, numbers, etc. by touching the screen.

In the touch control mode, the controller 120 can detect a touch operation of a user by using a touch sensor built in the lower portion of the display unit 130. The touch sensor can be implemented in various forms such as an electrostatic type, a pressure sensitive type, a piezoelectric type, and the like. When the user touches an arbitrary point on the screen of the display unit 130, the control unit 120 detects x, y coordinate values of the touch point. Accordingly, the control unit 120 can determine which menu on the screen is selected. Also, when the x and y coordinate values are changed, the control unit 120 can continuously detect the changed coordinate values to confirm the touch trajectory. Accordingly, the control unit 120 may detect touch and drag, touch and flick, drawing operation, and the like.

In this manner, when various touch operations are detected, the control unit 120 can transmit a control signal corresponding to the touch operation to the terminal device 200. [

For example, a first touch operation for group hopping may be performed on the screen of the display unit 130 while the terminal device 200 is divided into a plurality of groups and displaying items arranged in a list form. Here, the item may be various contact information, user information, address information, photograph, location information, advertisement information, product information stored in the terminal device 200 or the user terminal device 100 or stored in the external server device 300 Information, application, and the like. These items can be divided into various groups depending on the nature of the items. For example, the contact information, the address information, the user information, the location information, and the like described in text may be grouped by each alphabet. Or in the case of telephone number information, it may be grouped by each area code or country code. Alternatively, if the application is an application, it may be grouped by application genre.

When at least one group is displayed on the screen of the terminal device 200, when the first touch operation is performed, the control unit 120 hops the currently displayed group to the previous group or the next group, The user can control the terminal device 200 to display the items belonging to the group.

For example, when the terminal device 200 displays the contact information corresponding to the C group among the contact information grouped in alphabetical order, if the simple touch and drag operation is performed or the direction button is pressed, the control unit 120 The other contact information in the C group can be sequentially scrolled and displayed in accordance with the drag direction or direction button. On the other hand, when the first touch operation is performed in this state, the controller 120 moves directly to the contact information corresponding to the B group as the previous group or the D group as the next group according to the direction or form of the first touch operation, The contact information of the group can be displayed. Thus, the user can easily and quickly find the desired contact information.

Meanwhile, the controller 120 may change the mode according to the user's selection. For example, when the user performs the second touch operation for handwriting recognition on the screen of the display unit 130, the control unit 120 can switch to the handwriting recognition mode. The handwriting recognition mode refers to a mode in which the user recognizes the handwriting drawn on the screen of the display unit 130 and performs an operation corresponding thereto. When the user performs the drawing on the screen of the display unit 130 in the state of being switched to the handwriting recognition mode, the control unit 120 recognizes the drawn contents. For example, if the user draws the text C, the control unit 120 hops to a group corresponding to the C drawn by the user among the plurality of groups provided by the terminal apparatus 200, And controls the terminal device 200 to display the item immediately.

In these embodiments, either the first touch operation or the second touch operation mode is set to the default or can be set by the user. Hereinafter, an example of each touch operation and its operation will be described in detail.

4 is a diagram for explaining operations in the touch control mode. 4 shows a case where a user touches the screen with a plurality of fingers is set to the first touch operation. 4, a part of the group A and the group B is displayed on one screen 410 in the terminal device 200. In FIG. For example, group A and group B may be distinguished by the first letter of the previously registered person's name.

In this state, when the user touches the plurality of points T1 and T2 with two fingers 50 on the screen of the display unit 130 of the mobile device 100, the controller 120 transmits a hopping command to the terminal device 200). Accordingly, the terminal device 200 performs a group hopping and displays a screen 420 for placing the B group, which is the next group of the A group currently displayed at the highest level, at the highest level. As shown in FIG. 4, when the number of items included in one group is small, a plurality of groups may be displayed on one screen. In this case, as shown in Fig. 4, the hopped group can be displayed at the top.

Alternatively, according to another embodiment of the present invention, hopping may be performed in units of a plurality of groups. That is, if the first touch operation is performed in a state where both the A group and the B group are displayed on one screen 410 in FIG. 4, the controller 130 directly hopes to the next group C group which is not displayed You can give it. As described above, hopping does not necessarily have to be performed on a group basis, but may be performed on a unit shown on the screen.

5 is a diagram for explaining the operation in the handwriting recognition mode. Referring to FIG. 5, a terminal device 200 displays a screen 510 including a part of a group B and an A group. In this state, when the text C 511 is drawn on the display unit 130 of the mobile device 100, the control unit 120 recognizes the drawn text and transmits the recognition result to the terminal device 200. Accordingly, the text C 512 of the text drawn by the user is displayed on the screen 510 of the terminal device 200.

Then, the terminal device 200 hopes to the group corresponding to the text C 512 and displays the screen 520 including the items belonging to the hopped group. In FIG. 5, the C group and the D group are displayed in one screen 520.

Meanwhile, in the mobile device 100, a point drawn by the user can be represented by a GUI (Graphic User interface).

6 shows an example of a screen configuration displayed on the mobile device 100. In FIG. Referring to FIG. 6, the controller 120 displays a screen 600 corresponding to the touch control mode when communication is established with the terminal 200 through the communication unit 110. In the screen 600, a message indicating the touch pad and an area that the user can touch can be displayed. When the user performs a touch operation within the screen 600, the control unit 120 displays a graphic object 610 corresponding to the touch area at a point touched by the user.

7 shows an example of a screen configuration when the mobile device 100 operates in the handwriting recognition mode. 7, the controller 120 displays the screen 700 corresponding to the handwriting recognition mode when the handwriting recognition mode is changed from the touch recognition mode to the handwriting recognition mode. And an affordance GUI (710, 720) for guiding the user drawing can be displayed on the screen 700. 7 shows a state in which a line-shaped affordance GUI 710 and a writing instrument type affordance GUI 720 are displayed so that the display unit 130 can feel as if it is a notebook or a notebook. Although not shown, on the screen 700 of FIG. 7, a message indicating that writing is possible may be displayed in a pop-up window or a watermark form.

As described above, the control unit 130 can operate in various modes such as a touch control mode and a handwriting recognition mode. The control unit 130 can perform mode switching in various manners.

8 is a diagram for explaining a process of performing mode switching. 8, when the user performs a predefined second touch operation in a state where the touch control mode screen 600 is displayed (S810), the control unit 120 switches to the handwriting recognition mode, and the handwriting recognition mode screen 700 ). In FIG. 8, the second touch operation is illustrated as an operation of touching two points on the screen and then lowering it downward, but the present invention is not limited thereto and may be defined in various forms.

If the user drawing is not input for a preset time after the handwriting recognition mode is switched on (S820), the control unit 120 can return to the touch control mode. Accordingly, the touch control mode screen 600 is displayed again. Although FIG. 8 shows a case where the mode is automatically returned according to the elapse of time, when the first touch operation is performed on the handwriting recognition mode screen 700, the control unit 120 can also return to the touch control mode .

As described above, the user can freely change the screen displayed on the terminal device 200 using the mobile device 100. When the terminal device 200 is attached to a moving means such as a vehicle and the user operates the vehicle, there is an accident risk if the terminal device 200 is operated while viewing the screen of the terminal device 200. [ In particular, when a destination is searched to set the navigation function, various address information in the form of a list is displayed. In this case, if the user scrolls the screen one by one and searches for a desired destination, the time and effort required for the search become large, which increases the risk of accidents. On the other hand, according to the above-described embodiments, the user can easily perform a hopping operation to a desired group by inputting a touch operation or a handwriting using the mobile device 100 familiar to the hand without looking at the screen of the terminal device 200 . Therefore, a desired destination can be searched easily and quickly.

In the above embodiments, the user hops the display unit 130 of the mobile device 100 connected to the terminal device 200 as if touching the group itself by a predetermined touch operation or handwriting. However, It can be used as a pad to perform various controls. That is, when hopping is completed and a specific group is displayed, more detailed operation may be required to select the item desired by the user and execute the function in the group.

9 is a view for explaining another method of controlling the operation of the terminal device using the mobile device. Referring to FIG. 9, a user can touch a point on the screen 130 of the mobile device 100 with a finger and then drag or flick it. The control unit 120 scrolls the screen 910 of the terminal device 200 according to the drag or flick direction of the user and the movement distance thereof. As shown in FIG. 9, when the user drags in the direction d1, the screen 910 of the terminal device 200 is also scrolled in the direction d1.

The user performs group hopping as described above, and if a desired group is found, scrolls to find a desired item in the group. Accordingly, when a desired item is found, the user can double-touch the screen of the mobile device 100 to select the item or directly select the item on the screen of the terminal device 200. [ As described above, assuming that each item is destination information, the control unit 120 sets the item selected by the user as a destination, and can immediately execute the navigation function to the set destination.

Meanwhile, the user can freely use the mobile device 100 by rotating the mobile device 100 in a desired direction. 10 shows a state in which the mobile device is rotated.

10, when the mobile device 100 is placed in the vertical direction, an indicator 1011 indicating a touch pad is displayed at the upper end of the screen 1010, and a touch area 1012 is displayed below the indicator 1011. [

In this state, when the mobile device 100 is rotated in the horizontal direction, the indicator 1021 is displayed on the upper part of the screen 1020 in a rotated state, and the touch area 1022 is displayed below the indicator 1021. That is, the shape of the touch region varies depending on the rotation.

According to this embodiment, the mobile device 100 may further include a motion detection sensor such as a geomagnetic sensor, a gyro sensor, an acceleration sensor, or the like. The control unit 120 can change the display direction of the screen according to the detection result of the motion detection sensor. In addition, when the user touches the changed screen, the controller 120 can determine the direction of the touch operation based on the changed screen.

11 is a flowchart illustrating a method of controlling a mobile device according to an embodiment of the present invention. Referring to FIG. 11, when communication with the terminal device 200 is connected (S1110), the mobile device 100 automatically switches to the touch control mode (S1120). In this state, when the user inputs a predetermined touch operation (S1130), the mobile device 100 transmits a control signal corresponding to the touch operation to the terminal device 200 to control the operation of the terminal device 200 (S1140). The control signal may include various signals such as a menu selection signal, a screen switching signal, a scroll signal, and the like, as well as a hopping signal for hopping a group displayed on the terminal device 200 to the previous or next group.

Accordingly, the user can conveniently control the terminal device 200 by using the mobile device 100 as a remote control means for controlling the terminal device 200.

On the other hand, when the condition for switching to the handwriting recognition mode is satisfied (S1150), the mobile device 100 performs mode switching. In this state, the mobile device 100 receives the user drawing (S1160). When the user drawing is input, the mobile device 100 recognizes the drawn text (S1170), and transmits the recognized text to the terminal device 200 (S1180). Accordingly, the terminal device 200 can provide various services using the text.

12 is a timing chart for explaining the operation of the mobile device 100 and the terminal device 200. As shown in FIG. 12, communication can be connected between the mobile device 100 and the terminal device 200 in a state in which a list of a plurality of items is displayed in the terminal device 200 (S1200) (S1210). In FIG. 12, the list is displayed before the communication connection, but the list may be displayed after the communication is first connected.

If the first touch operation is input in the mobile device 100 in the state where the communication is connected (S1220), the mobile device 100 transmits a hopping command (S1230).

The terminal device 200 hopes to the previous group or the next group according to the hopping command, and displays the items belonging to the hopped group (S1240).

On the other hand, when the user inputs the second touch operation (S1250), the mobile device 100 switches to the handwriting recognition mode (S1260). When the user performs drawing in the handwriting recognition mode, the mobile device 100 recognizes the drawn handwriting content (S1270) and transmits the recognized text (S1280). The terminal device 200 may directly hop to the group corresponding to the text and display the item belonging to the group (S1290).

Meanwhile, in the above-described various embodiments, it has been described that the mobile device 100 recognizes the user's operation and transmits an appropriate signal corresponding to the operation to the terminal device 200, but this is not necessarily implemented. That is, according to another embodiment of the present invention, the mobile device 100 may function only as a simple input means of the terminal device 200. [ In this case, when the mobile device 100 communicates with the terminal device 200 and the user touches the screen of the display unit 130 of the mobile device 100, the control unit 120 of the mobile device 100 determines whether the user The coordinates of the touched point may be directly transmitted to the terminal device 200. [ The terminal device 200 recognizes the contents of the user operation using the transmitted coordinate values, and can perform operations such as group hopping, scrolling, item selection, function execution, and the like by itself.

In the above embodiments, the case where the display unit 130 of the mobile device 100 is used as a touch pad to control the terminal device 200 has been described. However, in addition to the mobile device 100, To control the terminal device 200. [ Such control devices can be implemented in various forms. Hereinafter, a configuration of a control device capable of controlling the terminal device 200 and embodiments thereof will be described in detail.

≪ Control device for controlling the terminal device >

13 is a block diagram showing a configuration of a control apparatus according to an embodiment of the present invention. 13, the control device 400 includes a plurality of buttons 410-1 to 410-n, a control unit 420, and a communication unit 430. [

The plurality of buttons 410-1 to 410-n may be arranged in a continuous alignment along at least one line. Each of the buttons 410-1 to 410-n may be implemented in various forms such as a push button, a touch button, a wheel button, a jog shuttle button, and the like.

The communication unit 430 is a component for performing communication with an external device. Specifically, the communication unit 430 may be a WiFi, a Bluetooth, a Zigbee, a 3G, a 3GPP, an LTE (Long Term Evolution) ) And the like, or a wired communication method such as a USB or a serial interface, etc., can be used to perform communication with the terminal device 200 mounted on a moving means such as a vehicle.

The terminal device 200 is provided with a display means, and displays various screens 210. A plurality of menus 211-1 to 211-n aligned so as to correspond to the buttons 410-1 to 410-n arranged in the control device 400 may be displayed on one side of the screen 210. [

The control unit 420 transmits a control signal corresponding to the button selected by the user among the plurality of buttons 410-1 to 410-n to the terminal device 200 through the communication unit 430, Can be controlled. More specifically, when one button is selected, the control unit 420 displays menus of the same position or type as the buttons selected from the menus 211-1 to 211-n displayed in the screen 210 of the terminal device 200 It is possible to transmit a control signal for execution.

The terminal device 200 can selectively display a plurality of different page screens instead of displaying only one screen. For example, when the navigation menu is selected on the main page, the navigation screen page can be displayed. Alternatively, when the multimedia playback menu is selected, the multimedia playback page can be displayed. As described above, the screen is divided into a plurality of different pages, and different menus are displayed on each page. For example, a navigation menu, a multimedia playback menu, a setting menu, and the like may be displayed on the main page, and a destination setting menu, a current location display menu, and an option menu may be displayed on the navigation screen page. A search menu, a playback menu, and the like may be displayed.

When the terminal device 200 is changed from one page to another page, the menu to be used in the changed screen can be displayed in the same form as the buttons 410-1 to 410-n. The user can conveniently select each of the menus provided in each page by using the same number of buttons 410-1 to 410-n.

14 shows an example of the external configuration of the control device 400 and the control operation accordingly. 14, the control device 400 may be implemented as including three buttons 410-1, 410-2, and 410-3, and the terminal device 200 may include buttons 410-1, 210-2, and 211-3, which are arranged in the same pattern as the first menus 410-1, 410-2, and 410-3. 14 shows a state in which a content reproduction screen is displayed.

In this state, if the user selects the left button 410-1, the control unit 420 transmits a control signal for executing the left menu 211-1 to the terminal device 200. [ 14 shows a case where a control signal for executing rewinding is transmitted.

On the other hand, when the user selects the middle button 410-2, the controller 420 recognizes that the middle menu 211-2 is selected, and transmits the reproduction signal corresponding to the middle menu 211-2 to the terminal 200 ). Thus, the control device 400 and the terminal device 200 can operate in conjunction with each other.

Fig. 15 shows another example of the external configuration of the control device 400. Fig. According to FIG. 15, the buttons 410-1 to 410-6 may be arranged in two rows in total of six. Of these buttons, the three lower buttons 410-1, 410-2, and 410-3 are buttons that dynamically change functions in conjunction with the menu displayed on the screen of the terminal device 200, and the upper three buttons 410- 4, 410-5, and 410-6 are buttons for performing a fixed function.

The three lower buttons 410-1, 410-2, and 410-3 can be basically mapped to a content playback function. For example, the first button 410-1 may be a previous music playback function, the second button 410-2 may be a music playback / pause function, and the third button 410-3 may be mapped to a next music playback function have. Accordingly, when the first to third buttons are selected while the menu corresponding to each button is not displayed, the controller 420 can reproduce the music content corresponding to the selected button.

On the other hand, when the terminal device 200 displays a screen including a plurality of menus, the control unit 420 displays the functions mapped to the three lower buttons 410-1, 410-2, and 410-3 on the screen Change to the function corresponding to each menu. For example, if the navigation screen page is displayed and the navigation menu, the multimedia playback menu, and the setting menu are sequentially displayed in the page, the control unit 420 displays the first to third buttons 410-1, 410-2, 3) to the navigation menu, the multimedia playback menu, and the setting menu, respectively.

Meanwhile, the fixed functions may be mapped to the fourth to sixth buttons 410-4 to 410-6 separately from the first to third buttons 410-1 to 410-3. For example, the fourth button 410-4 may be moved to a previous screen, the fifth button 410-5 may be scrolled or selected, and the sixth button 410-6 may be mapped to a menu display / close function .

15, when the fifth button 410-5 is implemented as a wheel button, the controller 420 controls to scroll the screen in the vertical direction according to the wheel movement when the wheel button moves in the vertical direction And transmits the signal to the terminal device 200. Alternatively, when the wheel button is clicked, the control unit 420 transmits a control signal to the terminal device 200 for selecting an item in which the current cursor is positioned on the screen of the terminal device 200. [

As described above, the functions mapped to the first to third buttons 410-1 to 410-3 are changed according to the type of the menu displayed on the changed screen when the terminal device 200 changes the screen. Figs. 16 to 18 show examples of changed menus. Fig.

16 shows a configuration example of the main screen 1600 of the terminal device 200. As shown in Fig. Various information such as date information 1610, weather information 1620, schedule information 1630 and the like can be displayed on the main screen 1600 and information 1640 on reproducible contents can be displayed. In the content display area 1640, menus 1641, 1642, and 1643 for adjusting content playback may be displayed. The control unit 420 can basically match the first to third buttons 410-1, 410-2, and 410-3 with the menus 1641, 1642, and 1643, respectively.

On the other hand, when the telephone is received in this state, the terminal device 200 can delete the content display area 1640 and display the telephone receiving information 1650 at the position.

17 shows an example of the screen configuration of the terminal device in a state in which a telephone is received. 17, the caller's name and time are displayed in the call reception information 1650, and various menus 1651, 1652, and 1653 related to the call reception can be displayed. Specifically, a menu 1651 for performing a call using the headset, a mute menu 1652, and a call rejection menu 1653 may be displayed. The control unit 420 may match the first to third buttons 410-1, 410-2, and 410-3 with the menus 1651, 1652, and 1653, respectively.

18 shows a screen configuration example of the terminal device in a state in which a message is received. 18, the terminal device 200 may display a notification message on the lower side of the main screen 1600 to inform the user of the message reception. In the notification message, a confirmation menu 1660 for confirming the message and a rejection menu 1661 for rejecting the message confirmation may be displayed. In this case, the control unit 420 commonly matches the confirmation menu 1660 with respect to the first button 410-1 and the second button 410-2, (1661) can be matched.

As described above, the number of menus displayed on the screen does not necessarily have to be the same as the number of buttons, and may be smaller. When there are fewer menus, a plurality of buttons are matched to one menu, and the menus can be executed regardless of which of the buttons is selected. On the other hand, when the number of menus is larger than the number of buttons, a plurality of menus may be simultaneously executed when one button is selected.

On the other hand, the user may input a swipe operation for sequentially selecting each button on the first to third buttons 410-1 to 410-3 in one direction.

19 is a diagram for explaining a swipe operation and an operation therefor.

When the swipe operation is detected, the control unit 420 transmits a control signal for switching the screen to another screen in accordance with the direction of the swipe operation to the terminal device 200. The swipe operation refers to an operation in which the user sequentially selects from the first button to the third button direction (d2) or from the third button to the first button direction (d1) as if the user fingers.

The controller 420 transmits a control signal to the terminal 200 to switch to the next screen 1910-C of the current screen 1910-B. Conversely, when the swipe operation is performed in the direction d2, the control unit 420 transmits a control signal for switching to the previous screen 1910-A of the current screen 1910-B to the terminal device 200. [

Such a screen switching operation can be performed at any time when there is no notification message at the bottom of the screen.

The control device 400 may be provided with various buttons so that even if the user does not directly touch the terminal device 200, he / she can move between applications, change screens, select and move the list, Control, menu selection, and the like. In addition, since the menu and the buttons displayed on the screen coincide with each other, the control device 200 can be used to control the screen even if the user does not directly view the screen of the terminal device 200.

The control device 400 as described above can be installed at any position within the vehicle that is easily accessible by the user. For example, it may be fixed to a handle.

20 shows the configuration of the control device 400 fixed to the handle of the vehicle. According to FIG. 20, the control device 400 may further include a fixing portion 440. The fixing portion 440 serves to fix the control device 400 to the handle 15 of the vehicle. The fixing portion 440 may be formed as a C-shaped groove that can be fitted in the vehicle handle 15 or may be formed as a fastening portion that can tighten the opening after being fitted to the vehicle handle 15 through an open part. (Not shown).

21 is a flowchart for explaining a control method of controlling a terminal device using a control device according to an embodiment of the present invention. 21, when the user selects one of buttons provided in the control device 400 (S2110), the control device 400 transmits a control signal for executing the function matched to the button to the terminal device 200 (S2110). When the screen displayed on the terminal device 200 is changed and a new menu is displayed on the changed screen, the controller 400 re-matches the function corresponding to the new menu to each button. Accordingly, when the button is selected again, a control signal for executing a newly matched function is transmitted to the terminal device 200.

On the other hand, when the user performs a swipe operation on the plurality of buttons (S2130), the control device 400 transmits a screen change signal for changing to the previous screen or the next screen in accordance with the swipe direction to the terminal device 200 (S2140). Accordingly, the user can conveniently control the functions of the terminal device 200 without having to reach the screen of the terminal device 200 or the main body button of the terminal device 200.

Meanwhile, according to another embodiment of the present invention, a button may be provided with a backlight so that a user can easily recognize a matching relationship between the button and the function.

22 is a flowchart for explaining a control method in the control apparatus according to this embodiment. Referring to FIG. 22, when the controller 400 is powered on (S2210), the basic button can be activated (S2220). A basic button means a button whose fixed function is matched. For example, in the control device 400 of FIG. 15, the fourth through sixth buttons 410-4 through 410-6 correspond to basic buttons.

The control unit 420 may turn on the backlight provided below the activated basic button to provide color light for each basic button. That is, the control device 400 may further include a plurality of backlight units disposed below the plurality of buttons 410-1 to 410-n, respectively, for providing color light to the respective buttons. The backlight portion may be implemented with an LED.

If communication is established between the terminal device 200 and the communication unit 430 in this state (S2230), the control unit 420 activates the control button (S2240). The control button means a button whose function is dynamically changed among a plurality of buttons. For example, in the control device 400 of FIG. 15, the first to third buttons 410-1 to 410-3 correspond to control buttons. The control unit 420 may also turn on the backlight provided under the activated control button to provide color light to each control button.

The user can recognize that the corresponding button is activated when a light enters each button.

The control unit 420 controls the color of the color light provided to each button in consideration of various conditions such as the state of the control device 400, the state of the terminal device 200, the type of menu displayed on the terminal device 200, Can be individually changed for each button.

Accordingly, the control unit 420 may periodically monitor the state change (S2250). If the status is changed, the color of the button is changed to correspond to the changed status (S2260).

23 to 25 are diagrams for explaining the lighting state of each button. 23 shows the power-off state. In the power off state, each button is inactivated, so no light is provided.

Fig. 24 shows a state in which communication is not connected in a power-on state. In this case, only the basic buttons 410-4 to 410-6 among the buttons are provided with light and displayed brightly.

Fig. 25 shows a state in which the power-on state is connected to the communication. In this case, all of the basic buttons 410-4 to 410-6 as well as the control buttons 410-1 to 410-3 are activated and displayed brightly.

The light provided to the basic buttons 410-4 to 410-6 may be provided in the same color and brightness, but the light provided to the control buttons 410-1 to 410-3 may have various colors and brightness depending on the situation Can be provided. (R: 14, G: 66, B: 145), which is an orange color (R: 0, G: 118, B: 91) And a gray color such as blue color, (R: 160, G: 160, B: 160), etc., can be separately provided for each button.

These colors may vary depending on the importance of the menu displayed on the screen and the importance of the notification message. For example, the first to third buttons 410-1 to 410-3 may be displayed in blue color in a state where the content reproduction function is basically matched. In this state, a green color may be displayed when a telephone is received, and an orange color may be displayed when a message is received.

Alternatively, the color of each button can be changed according to the characteristics of the menu matched to each button. For example, when the first to third buttons 410-1 to 410-3 are mapped to different menus 1651, 1652, and 1653 as shown in FIG. 17, the first to third buttons 410 -1 to 410-3) may be represented differently. On the other hand, as shown in FIG. 18, if the same menu is matched for the first and second buttons 410-1 and 410-2 and the other menu is matched for the third button 410-3 The first and second buttons 410-1 and 410-2 may display the same color and the third button 410-3 may be displayed differently. As shown in FIG. 18, gray color is displayed for the third button 410-3 where rejection is matched, and can be turned on.

26 shows a case where the first to third buttons 410-1 to 410-3 are displayed in different colors. The controller 420 may adjust the colors by inputting appropriate driving pulses to the R, G, and B LEDs provided under the first to third buttons 410-1 to 410-3, respectively. Alternatively, the color may be changed using a white LED and a color filter.

In the above embodiments, the buttons provided on the controller 200 are shown as being fixed. However, each of the buttons may be implemented as a touch button for displaying deformable indicators. The control unit 420 may change the indicator of each button to correspond to each menu displayed on the terminal device.

27 and 28 show the operation of the control apparatus according to the embodiment using the touch buttons.

FIG. 27 shows a state in which the three buttons 410-1 to 410-3 are respectively matched with the rewind function, the playback / pause function, and the fast forward function displayed on the content playback screen. The control unit 420 may display the indicators 2710, 2720, and 2730 indicating the respective functions on the touch buttons 410-1 to 410-3. The touch buttons 410-1 to 410-3 may be implemented as a touch screen to display various graphic objects.

28 shows a state in which the headset using function, the mute function, and the rejection function displayed on the telephone receiving screen match the buttons 410-1 to 410-3. In this case, the control unit 420 deletes the previous indicators 2710, 2720, and 2730 and displays indicators 2810, 2820, and 2830 corresponding to the headset use function, the mute function, and the rejection function, respectively. Each indicator may be displayed in the form of an icon.

27 and 28, the user can know the state of the terminal device 200 only by the control device 400 without looking at the screen of the terminal device 200, and can immediately control the state thereof.

According to another embodiment of the present invention, an identifier may be added to the menu displayed on the screen of the terminal device 200 instead of the button of the control device 400 so that the user can easily know which button is matched. You may.

FIG. 29 is a diagram for explaining the operation of the control device 400 and the terminal device 200 according to this embodiment. 29, the buttons 410-1 to 410-3 of the control device 400 can display a number or a mark capable of specifying each button.

In this state, when the screen including the plurality of menus 1660 and 1661 is displayed, the terminal device 200 displays an identifier for designating a button that is matched with respect to each of the menus 1660 and 1661. Referring to FIG. 29, a confirmation message 1660 for confirming a received message and a rejection menu 1661 for rejecting the message confirmation are displayed in a notification message informing that the message is received. As described above, the first and second buttons 410-1 and 410-2 may be matched with the confirmation menu 1660, and the third button 410-3 may be matched with the rejection menu 1661. [ The first and second identifiers 2910 and 2920 indicating that the first and second buttons 410-1 and 410-2 are matched are displayed in the confirmation menu 1660 and the first and second identifiers 2910 and 2920 are displayed in the reject menu 1661, A third identifier 2930 indicating that the button 410-3 is matched is displayed. The user can easily see the matching relationship between the button and the menu by viewing the identifier.

According to the embodiment as described above, the user can conveniently and safely control the function of the terminal device 200 mounted on the vehicle by using a separate control device.

Meanwhile, when the terminal device 200 and the mobile device 100 are interlocked as described above, an execution screen of an application to be executed by the mobile device 100 may be displayed on the terminal device 200. [ However, since the size and shape of the display unit 130 included in the mobile device 100 and the display size and shape of the terminal device 200 do not coincide with each other, 200). ≪ / RTI >

Hereinafter, another embodiment for solving such a problem will be described in detail.

≪ Embodiment for Screen Optimization of Terminal Apparatus >

30 is a timing chart for explaining a screen optimization method in a system according to another embodiment of the present invention.

30, when communication is established between the mobile device 100 and the terminal device 200 in step S3010, the mobile device 100 transmits a list of applications configured through the Web API (Application Programming Interface) to the terminal device 200 (S3020). For example, the mobile device 100 may provide an API according to HTML5 (Hyper Text Markup Language 5).

 The terminal device 200 displays an icon of each application on the screen according to the provided list. If one icon is selected in this state (S3030). The terminal device 200 requests the web page corresponding to the selected icon to the mobile device 100 (S3040).

When the web page request is received, the mobile device 100 requests the web server 300 again for the web page (S3050). When the web page data is received (S3060), the mobile device 100 transmits the web page to the terminal 200 S3070).

When the web page data is received, the terminal device 200 generates a screen according to its own display size (S3080) and displays the screen (S3090).

31 is a block diagram showing a configuration of a terminal device that performs an operation according to the embodiment of FIG. 31, the terminal apparatus 200 includes a display unit 3110, a control unit 3120, and a communication unit 3130. [

The display unit 3110 displays various screens. The display unit 3110 may be implemented in various sizes and forms according to the price, type, usage environment, and the like of the terminal device.

The communication unit 3130 is a component for performing communication with the mobile device 100. When the communication unit 3130 is connected to the mobile device, the communication unit 3130 can access the web server using the Web API provided by the mobile device. Accordingly, the web page data transmitted from the web server can be received.

The control unit 3120 can form a screen corresponding to the screen size of the display unit using the web page data and display the screen on the display unit 3110. [

More specifically, when the mobile device 100 is connected, the control unit 3120 receives a list of applications installed in the mobile device 100, and displays the list on the display unit 3110. If the user selects one of the applications displayed in this list, the control unit 3120 requests the web page data for the selected application. The mobile device 100 relays the web page data from the web server according to the request. When the web page data is received through the mobile device 100, the control unit 3120 can configure a screen suitable for the display unit 3110 according to the web page data.

Even if the display size and the type of the terminal device 200 are different from that of the mobile device 100 by configuring the screen using a web-based technology such as HTML5 (Hyper Text Markup Language 5) The execution screen of the same application as the application can be optimally displayed on the terminal device 200. [

The mobile device 100 that communicates with the terminal device 200 includes a communication unit 110, a control unit 120, and a storage unit 140. For the sake of convenience of description, the same names and reference numerals are used for the components overlapping with the mobile device 100 described in the embodiment of FIG.

The communication unit 110 can perform communication with the communication unit 3130 of the terminal device 200.

When the communication is established, the control unit 120 generates a list of applications installed in the storage unit 140, and transmits the list to the terminal device 200 through the communication unit 110. In addition, the control unit 120 may provide the terminal 200 with photograph or moving picture contents, address book, schedule information, and social network service (SNS) information stored in the storage unit 140.

Thereafter, when one application is selected in the terminal device 200, the web page data is downloaded from the web server corresponding to the selected application and transmitted to the terminal device 200. Accordingly, in the terminal device 200, the application screen of the mobile device can be adaptively configured and displayed according to the display characteristics of the mobile device.

32 is a diagram for explaining a process in which the terminal device 200 displays a screen using a web-based technology. Referring to FIG. 32, the terminal device 200 connects communication with the mobile device 100 according to various communication methods such as USB, Wi-Fi, Bluetooth and the like. The mobile device 100 may access the service and content provider server 3210 or the web application store 3220 via the Internet 3200. [ The terminal device 200 receives web page data provided from the service and content provider server 3210 or the web application store 3220 through the mobile device 100. [

The control unit 3120 of the terminal device 200 constructs and displays a screen of the application using the provided web page data.

33 shows an example of the screen configuration displayed on the terminal device 200. Fig. 33, the mobile device 100 transmits various additional information to the terminal device 200 together with the web application list. The additional information may include gallery information including photograph or moving picture contents, address book information, schedule information, SNS information, and the like.

The terminal device 200 displays icons 3310-1 to 3310-5 for the application installed in the mobile device 100 according to the web application list. When one icon 3310-5 is selected in this state, the terminal device 200 receives web page data corresponding to the icon 3310-5 from the server device through the mobile device 100. [ Accordingly, the terminal device 200 forms the screen 3320 using the received web page data. Additional information stored in the mobile device 100 may also be displayed on the screen 3320. That is, if the icon 3310-5 selected in FIG. 33 is the contact icon, the terminal device 200 displays the screen 3320 including the address book information among the additional information provided from the mobile device 100. FIG.

According to the embodiment as described above, the terminal device 200 can display a screen optimized for the terminal device 200 using the application and information installed in the mobile device 100. [

According to another embodiment of the present invention, the mobile device 200 can control the terminal device 100 without installing a specific application for controlling the terminal device 100. Hereinafter, the operation of a mobile device that controls a terminal device using a web browser will be described.

≪ Embodiment to control the terminal device using the web browser >

FIG. 34 is a diagram for explaining the operation of a mobile device for controlling a terminal device according to another embodiment of the present invention.

34, the mobile device 100 receives a URL from the terminal device 200 (S3410). The URL (Uniform Resource Locator) refers to an address of a server device corresponding to the terminal device 200. The terminal device 200 stores in advance the URL of the manufacturer of the terminal device 200 or the server device operated by the manufacturer of the software used by the terminal device 200 or the manufacturer of the content, The URL is provided. The terminal device 200 can provide a URL in an NFC communication manner.

When the URL is provided, the mobile device 100 executes the web browser and accesses the URL. Accordingly, the UI provided by the server apparatus 300 is received (S3430), and the received UI is displayed on the web browser (S3440).

The user can control the terminal device 200 using the displayed UI. That is, if there is a user input on the UI (S3450), the mobile device 100 transmits a control signal corresponding to the user input (S3460).

When the terminal device 200 receives the control signal, the terminal device 200 performs an operation corresponding to the control signal (S3470). For example, various operations such as turn-on, volume up, volume down, channel change, content play, stop, fast forward, rewind, content change, navigation function, destination setting, and the like can be performed.

In FIG. 34, the address information, that is, the URL is received from the terminal device and the UI is received from the URL. However, the mobile device 100 may receive the web page data from the URL. Accordingly, the mobile device 100 may transmit the received web page data to the terminal device 200. The terminal device 200 can construct and display an adaptive screen according to the display characteristic of the terminal device 200 using a web browser. Alternatively, the mobile device 100 may directly configure an adaptive screen in the terminal device 200 using the received web page data, and then provide the screen to the terminal device 200. As described above, according to the embodiment, the mobile device 100 can perform various functions using the address information stored in the terminal device 200, that is, the URL.

FIG. 35 is a block diagram showing the configuration of the mobile device 100 and the terminal device 200 in the embodiment as shown in FIG.

35, the mobile device 100 includes a communication unit 110, a control unit 120, a display unit 130, and a local communication unit 150. The terminal device 200 includes a display unit 3110, a control unit 3120, a communication unit 3130, a storage unit 3140, and a local communication unit 3150.

The short range communication unit 150 of the mobile device 100 can transmit and receive data according to the NFC method when tagged with the short range communication unit 3150 of the terminal device 200. [ Specifically, the local area communication unit 150 of the mobile device 100 can read the URL information stored in the storage unit 3140 of the terminal device 200.

The local communication unit 150 of the mobile device provides the read URL information to the control unit 120. [ The control unit 120 controls the communication unit 110 to access the read URL, and receives web page data. Web page data refers to data for constituting a UI screen. The local communication unit 150 of the mobile device 100 and the local communication unit 3150 of the terminal device 200 may be composed of an NFC tag and an NFC reader. Accordingly, the control unit 120 executes the web browser and displays the UI screen corresponding to the received web page data on the display unit 130. [

When the user selects an arbitrary menu on the UI screen displayed on the display unit 130, the control unit 120 transmits a control signal for executing the selected menu to the terminal device 200 through the communication unit 110. [

The communication unit 3130 of the terminal device 200 receives the transmitted control signal and transmits the received control signal to the control unit 3120. The control unit 3120 can display various screens on the display unit 3110 according to the received control signals.

As described above, the mobile device 100 and the terminal device 200 are different kinds of devices, but can provide various services in cooperation with each other.

In the above-described embodiments, the terminal device 200 does not necessarily have to be mounted on a moving means such as a vehicle, and the above-described embodiments can be applied as long as the device is a device of a different type from the mobile device.

Meanwhile, according to another embodiment of the present invention, the operation of the terminal device 200 may be controlled using a user's voice. Hereinafter, an embodiment in which control is performed using a user's voice will be described in detail.

≪ Embodiment to control using user's voice >

36 is a block diagram illustrating a configuration of a mobile device according to another embodiment of the present invention. 36, the mobile device 100 includes a communication unit 110, a control unit 120, a storage unit 140, and a voice input unit 160. For convenience of explanation, the same components as those of the mobile device described in the above-described other embodiments among the components shown in FIG. 36 are described with the same names and reference numerals, but the functions are implemented differently .

In FIG. 36, the communication unit 110 can perform communication with the terminal device 200 installed in the vehicle. Since the concrete communication method has already been mentioned in the above-mentioned section, a duplicate description will be omitted.

The voice input unit 160 is a component for receiving a user voice. The voice input unit 160 may include various configurations such as a microphone (not shown), an amplifier (not shown), a noise filtering circuit (not shown), and the like. The voice input unit 160 transmits the input user voice to the control unit 120.

The storage unit 140 is a component in which various programs and data used in the mobile device 100 are stored.

The control unit 120 may control the overall functions of the mobile device 100 using programs and data stored in the storage unit 140. [

Specifically, the control unit 120 sets the search criteria differently according to the status of the user using the mobile device 100. When the user's voice is inputted through the voice input unit 160, the control unit 120 analyzes the inputted user voice. User speech analysis can be done in a variety of ways. For example, the control unit 120 may calculate the energy of the received user voice, classify the energy level of the voice signal according to the calculated energy, and detect the voice interval through dynamic programming. Then, phonemic data is generated by detecting a phoneme as a minimum unit of speech based on an acoustic model within the detected speech interval, and HMM (Hidden Markov Model) probability model is applied to the generated phoneme data to generate user voice Can be converted into text. The control unit 120 can detect an instruction and a search word from the converted text. Specifically, the control unit 120 detects the text registered in the command database stored in the storage unit 140 as an instruction word. In addition, unregistered text is detected as a search term. The control unit 120 may perform various functions using the detected commands and search terms.

For example, when an instruction for searching for a destination is detected, the control unit 120 searches for a destination corresponding to the search term. In this case, the search criteria for searching for the destination may be set according to the state of the user as described above.

The control unit 120 searches for at least one destination corresponding to the user's voice using the set search criteria. The control unit 120 provides the search result to the terminal device 200 through the communication unit 110. [ Accordingly, the destination candidates selected in consideration of the user's voice and the user's state can be displayed on the terminal device 200. When the user selects one of the destination candidates, the selected destination candidate is determined as the final destination, and the terminal device 200 can perform the navigation function to the determined final destination.

Here, the user state may mean that the user is in the driving state, or is in the walking or resting state. Alternatively, the user state may be determined based on various information such as the user's current location, future schedules, and the like. If it is determined that the user is in operation, the control unit 120 may set a search criterion for preferentially searching for a destination providing a service related to the vehicle. On the other hand, when the user has a short schedule, he or she can set a search criterion for preferentially searching for a destination providing a fast service. Alternatively, when the user is not in a special situation, the control unit 120 may search for a destination according to a conventional navigation destination setting option such as a shortest distance reference, a shortest time reference, an optimum distance reference, or the like.

37 is a diagram showing an example of a destination search process. 37 shows a screen configuration of the terminal device 200 controlled by the mobile device 100. Fig.

When the user speaks "Where to eat?" While the user is driving, the voice input unit 160 of the mobile device 100 receives the voice and provides the voice to the control unit 120. As described above, the control unit 120 converts the input voice into text and displays the converted voice on the display unit 130.

The control unit 120 may determine that the user is driving or preparing to operate if the communication unit 110 of the mobile device 100 communicates with the terminal device 200 installed in the vehicle. Further, the word "anywhere" in the user voice can be detected by a command meaning a search command, and "rice" can be detected by a search word. The control unit 120 can detect a related search term as well as the directly detected search term. For example, in the case of "rice", the control unit 120 can detect various words such as "restaurant", "food store", "food court"

The control unit 120 determines a place where a service related to the vehicle is provided in consideration of a state of being in operation as a search criterion and searches a restaurant associated with the search term according to a search criterion. For example, you can search for a restaurant that has a car park where you can park your car, a restaurant that drives you to get food while you drive with your car, and a restaurant near a car repair shop or car wash.

In FIG. 37, the user indicates a state of "where should I stop for lunch". The control unit 120 converts the voice pronounced by the user into text, transmits the converted text 3711, a search word, and a command word to the terminal device 200. Here, the search term also includes related search terms.

The terminal device 200 displays a screen 3710 including the received text 3711 on the display unit. The screen 3710 may also be accompanied by a phrase 3712 indicating that the search is in progress. Further, the terminal device 200 executes a navigation program and detects destination candidates including the received search word. The terminal device 200 displays a screen 3720 including the detected destination candidates. FIG. 37 shows a state in which destination candidates retrieved in consideration of the vehicle driving state are displayed. When the user selects one of the destination candidates, the terminal device 200 determines the selected destination candidate as the destination and executes the navigation function from the current position to the determined destination.

Meanwhile, the storage unit 140 may store user schedule information. In this case, the control unit 120 can confirm the user's subsequent schedule based on the user schedule information. As a result of checking, if there is a subsequent schedule, the control unit 120 may set a search criterion for searching for a destination according to a subsequent schedule time or place. That is, if the subsequent schedule time is not a short time from the current time, the control unit 120 can set a search criterion so that the fast food restaurant, the drive restaurant, and the like are preferentially searched. Alternatively, the control unit 120 may set a search criterion so as to preferentially search a restaurant located in the movement route to the next schedule site if the next schedule site is stored.

In addition, when the user's voice is input in a state where communication with the terminal device 200 is not connected, the control unit 120 may search for a destination by itself. When the mobile device 100 is provided with a display unit, the control unit 120 may display a navigation screen to the searched destination on the display unit. On the other hand, if the display unit does not exist, the control unit 120 may output a guidance voice to the searched destination through the speaker. In this case, the search criterion may be set to the shortest distance, the shortest time, or the like, or alternatively, a search criterion may be set to search based on a place or popularity rank selected by a plurality of users.

36 and 37, the mobile device 100 determines the determination criterion by analyzing the user's voice. However, the mobile device 100 transmits the user's voice to the external server device and performs the operation in the server device .

38 shows a configuration of a network system according to this embodiment. 38, when the user's voice is input, the mobile device 100 can transmit the voice, user status information, location information, and the like to the server device 300 via the Internet. Here, the server device 300 may be implemented as a server device that provides a voice analysis service, a navigation service, and the like. The server device 300 can search for a destination and provide search results to the mobile device 100 based on the provided user voice, user status information, location information, and the like. The mobile device 100 may transmit the provided search result to the terminal device 200 so that the terminal device 200 displays the screen 3710. [

39 is a flowchart illustrating a search method for searching for a destination according to an embodiment of the present invention. Referring to FIG. 39, when the user's voice is input (S3910), the mobile device 100 determines whether the user is driving (S3920). In brief, it can be judged that the vehicle is in operation when the communication with the terminal device 200 is connected. Alternatively, if the coordinates provided from the GPS chip of the vehicle on which the terminal device 200 is mounted are changed, it may be determined that the vehicle is in operation.

If it is determined that the user is driving, the mobile device 100 sets a first search criterion (S3930). Specifically, a first search criterion for preferentially searching destination candidates for providing services related to the vehicle among destination candidates including a search word can be set. On the other hand, if it is determined that the user is not driving, the mobile device 200 may set a second search criterion (S3940). Here, the second search criterion may be a general navigation search option such as a shortest time, a shortest distance, an optimal path, and the like.

The mobile device 100 performs a search based on the set search criteria (S3950). Then, the search result is provided through the terminal device 200 (S3960).

40 is a flowchart illustrating a search method for searching for a destination according to another embodiment of the present invention. Referring to FIG. 40, when the user's voice is input (S4010), the mobile device 100 determines whether there is a subsequent schedule (S4020).

Accordingly, if there is a subsequent schedule, a first search criterion is set (S4030), and if a subsequent schedule does not exist, a second search criterion is set (S4040). Here, the first search criterion refers to a criterion for searching for a destination candidate considering a subsequent schedule time or place, and the second search criterion refers to a general navigation search option as described above. When the search criteria are determined, the mobile device performs search using the determined search criteria (S4050), and provides the search result through the terminal device 200 (S4060).

As described above, an appropriate destination search can be performed in accordance with the user's situation. Meanwhile, in the above-described embodiment, the case where the user inputs the voice is described as a basis. However, even when the user directly inputs the text, the user can search by setting the search criteria differently according to the user's condition. In the above-described embodiments, the mobile device 100 is configured to receive a voice, set a search criterion, and detect a search word or a command word. However, the present invention is not limited thereto. 38, the external server apparatus 300 may perform such an operation, or the terminal apparatus 200 may receive the user voice directly without intervention of the mobile device 100, set the search criteria , And search may be performed accordingly.

Meanwhile, according to another embodiment of the present invention, the terminal device 200 may provide the location-based service using the metadata stored in the mobile device 100. Hereinafter, an embodiment using metadata will be described in detail.

≪ Embodiment Using Meta Data of Mobile Device >

41 is a block diagram for explaining an embodiment for providing various services using metadata of a mobile device.

Referring to FIG. 41, the mobile device 100 may provide metadata to the terminal device 200. FIG. The terminal device 200 includes a display unit 3110, a control unit 3120, a communication unit 3130, and a storage unit 3140.

Various applications may be installed in the storage unit 3140. Specifically, a navigation program, a multimedia content reproduction program, a schedule management program, and the like can be installed. In addition, map data, address book information, schedule information, multimedia contents, and the like used in each application can be stored in the storage unit 3140 as well.

The communication unit 3130 is a component for communicating with the mobile device to receive the metadata. The communication unit 3130 provides the received metadata to the control unit 3120. Metadata refers to data provided additionally to various data such as photographs, moving pictures, address books, schedule information, and the like stored in a mobile device. For example, in the case of a content such as a photograph or a moving image, the place where the photograph or the moving image was photographed, the photographing date and the like can be stored in the form of metadata. Also, in the case of the schedule information, the location information of the place where the schedule is made may be stored together with the meta data.

When the metadata is received through the communication unit 3130, the control unit 3120 displays various images on the display unit 3110 using the metadata. More specifically, the control unit 3120 executes an application installed in the storage unit 3140 and provides metadata as input to the application. Accordingly, the application executes the function based on the metadata. The control unit 3120 displays the execution screen on the display unit 3110 when the application forms an execution screen using the metadata.

The application to be executed can be selected by the user. That is, when the terminal device 200 is powered on, the control unit 3120 can display an icon corresponding to the application installed in the storage unit 3140 on the display unit 3110. When the user touches the screen of the display unit 3110 or selects the icon in a manner that uses the mobile device 100 or the user's voice as described above, the control unit 3120 executes the application corresponding to the selected icon, And displays the execution screen on the display unit 3110. [ At this time, the controller 3120 can change the execution screen by using the location information in the meta data provided by the mobile device 100. [

When the communication with the mobile device 100 is established, the control unit 3120 displays an icon corresponding to the application installed in the mobile device 100, together with an icon corresponding to the application installed in the terminal device 200, ). ≪ / RTI > When the user selects an icon corresponding to the application installed in the mobile device 100, the control unit 3120 forms a screen using the position information corresponding to the selected icon, and displays the screen on the display unit 3110.

41, the mobile device 100 includes a communication unit 110, a control unit 120, and a storage unit 140. The communication unit 110 is a component for performing communication with the terminal device 200.

The storage unit 140 is a component that can store various applications and data. Specifically, the storage unit 140 may store metadata including location information.

The control unit 120 provides metadata to the terminal device 200 when communication is established with the terminal device 200. At this time, the control unit 120 may automatically transmit the entire metadata to the terminal device 200 when a communication connection is established. Alternatively, when an event of selecting an icon of an application installed in the mobile device is selected on the screen of the terminal device 200, all the metadata related to the application may be transmitted to the terminal device 200. Alternatively, when one content is selected while the execution screen of a specific application is mirrored and displayed on the terminal device 200, only the meta data of the content may be transmitted to the terminal device 200.

In this manner, when metadata is provided to the terminal device 200, the terminal device 200 can display a service screen based on the location information.

FIG. 42 is a flowchart illustrating a method of using metadata of a terminal according to an embodiment of the present invention. Referring to FIG. 42, when communication with the mobile device 100 is connected (S4210), the terminal device 200 displays an icon associated with the mobile device on the screen (S4220). Thereafter, when the displayed icon is selected (S423), the terminal device 200 detects the position information from the metadata corresponding to the selected icon (S4240). For example, when an icon corresponding to the gallery program is selected, position information on the position where the photograph or moving image is captured can be detected from the metadata of the photograph or moving picture content included in the gallery program. When there are a plurality of photographs or moving pictures managed by the gallery program, only the location information of the contents selected by the user among the plurality of contents can be detected.

When the location information is detected, the terminal device 200 reconstructs the screen using the detected location information (S4250). Specifically, the terminal device 200 can automatically set the detected position information as a destination, and configure a navigation screen to guide a moving route to the destination. The terminal device 200 can display the reconfigured screen (S4260). In this manner, the terminal device 200 can provide various services using the location information stored in the mobile device 100.

FIG. 43 shows an example of the screen configuration of the terminal device 200 connected to the mobile device 100. FIG. 43, when the terminal device 200 is connected to the mobile device 100, the screen 4300 of the terminal device 200 may be added to the existing icons 4310-1 and 4310-2, The icons 4310-3 and 4310-4 corresponding to the application installed in the display unit 4310 are displayed. These icons 4310-1 through 4310-4 can be displayed in a list or a tile view in alphabetical order, chronological order, or the like.

In FIG. 43, the icons 4310-1 to 4310-4 are displayed in the main screen 4300, but they need not necessarily be embodied. For example, the icons 4310-3 and 4310-4 associated with the mobile device 100 may be displayed only when the navigation function is executed in the terminal device 200 or a menu for confirming the current position is selected.

FIG. 44 shows a screen change when one of the icons 4310-4 related to the mobile device 100 is selected in the main screen 4300 of the terminal device 200. FIG. In FIG. 44, it is assumed that the icon 4310-4 corresponding to the gallery program is selected. In this case, a screen 4400 including a thumbnail image of various contents managed by the gallery program is displayed on the terminal device 200. That is, the mobile device 100 may configure a screen of content managed by the gallery program and provide the screen to the terminal device 200. In this state, when the user selects one image 4410, the terminal device 200 detects the location information from the metadata corresponding to the selected image 4410. The control unit 3120 of the terminal device 200 automatically sets the detected location information to the destination 4510 and displays the navigation screen 4500 to the destination.

45 is a flowchart illustrating a method of using metadata according to another embodiment of the present invention. 45, the terminal device 200 displays an icon corresponding to the installed application (S4510). If the user selects one icon in this state (S4520), the terminal device 200 displays the execution screen of the program corresponding to the selected icon (S4530). As an example, if the navigation program has been executed, a map screen may be displayed.

The terminal device 200 may display at least one indicator corresponding to the location information in the meta-data provided by the mobile device 100 in the execution screen (S4540). If the map screen is being displayed as described above, the terminal device 200 can display an indicator that indicates a point corresponding to each location information on the map screen. Accordingly, when the user selects one indicator, the terminal device 200 can automatically set the position information corresponding to the selected indicator to the destination and execute the navigation function.

FIG. 46 is a view for explaining an example of the screen configuration of the terminal device according to FIG. 45; FIG. 46, icons 4310-1 and 4310-2 for an application installed in the terminal device 200 and icons 4310-1 and 4310-2 corresponding to the mobile device 100 are displayed in the screen 4300 of the terminal device 200, Icons 4310-3 and 4310-4 may be displayed together. The icons 4310-3 and 4310-4 corresponding to the mobile device 100 may include not only icons corresponding to the applications installed in the mobile device 100 but also icons indicating various information stored in the mobile device 100 have. For example, the mobile device 100 may store various personal profile information such as a photograph, an address book, schedule information, a purchase hope list, and a visiting area.

The user can select an arbitrary icon from the icons displayed on the screen 4300. [ 46 shows a case where the icon 4310-2 of the application installed in the terminal device 200 is selected. Assuming that the selected icon 4310-2 is an icon corresponding to the navigation program, the terminal device 200 displays the map screen 4600 and displays a selectable menu list 4610 on the map screen 4600 do. The menu list 4610 also includes a menu 4611 corresponding to the mobile device 100.

When the user selects the menu 4611 in this state, the indicators 4620 and 4630 based on various information stored in the mobile device 100 are displayed. 46, a text 4620 indicating various types of location information stored in the mobile device 100 and an icon 4630 of an application in which the location information is used are superimposed on the map screen 4600 and displayed. When the user selects such a text or icon, the terminal device 200 automatically sets the location information corresponding to the selected text or icon as a destination, and performs a navigation function to the set destination.

As described above, according to the present embodiment, the terminal device 200 can provide various services by using the metadata provided from the mobile device 100.

According to various embodiments as described above, the mobile device 100 can control the terminal device 200 in cooperation with the terminal device 200, and can provide various services. Such a mobile device 100 may be implemented by various types of products such as a mobile phone, a tablet PC, a PDA, an MP3 player, a notebook PC, and the like, and the terminal device 200 may be a vehicle head unit mounted on a vehicle, Device. ≪ / RTI > In addition, the terminal device 200 may be implemented as a portable device such as a mobile phone, a tablet PC, a PDA, an MP3 player, and a notebook PC.

Hereinafter, a general configuration of the mobile device 100 implemented in a form capable of supporting various functions such as a mobile phone and a tablet PC will be described in detail.

47, the mobile device 100 includes a communication unit 110, a control unit 120, a display unit 130, a storage unit 140, a short range communication unit 150, a voice input unit 160, a GPS chip 171, A video processor 172, an audio processor 173, a button 174, a camera unit 175, a speaker unit 176, and a sensing unit 177.

The sensing unit 177 is a component for sensing a touch operation of the user with respect to the display unit 130. [ The sensing unit 177 may include a touch sensor. The display unit 130 and the sensing unit 177 may be integrally formed to form a single touch screen. Accordingly, the sensing unit 177 senses a user operation performed on the surface of the display unit 130, and notifies the control unit 120 of the sensed user operation.

The control unit 130 generally controls the operation of the mobile device 100 using various programs and data stored in the storage unit 140. The specific operation of the control unit 130 may be different according to the embodiment as described above.

The communication unit 110 is configured to perform communication with various types of external devices including the terminal device 200 according to various types of communication methods. The communication unit 110 may include a Wi-Fi chip 111, a Bluetooth chip 112, a wireless communication chip 113, and the like.

The Wi-Fi chip 111 and the Bluetooth chip 112 perform communication using the WiFi method and the Bluetooth method, respectively. When the WiFi chip 111 or the Bluetooth chip 112 is used, various connection information such as an SSID and a session key may be transmitted and received first, and communication information may be used to transmit and receive various information. The wireless communication chip 113 refers to a chip that performs communication according to various communication standards such as IEEE, ZigBee, 3G (3rd Generation), 3GPP (Third Generation Partnership Project), LTE (Long Term Evolution)

The short-range communication unit 150 is a component that transmits and receives data to and from external devices including the terminal device 200 in an NFC (Near Field Communication) method. The NFC method refers to a method of transmitting and receiving data using a 13.56 MHz band among various RF-ID frequency bands such as 135 kHz, 13.56 MHz, 433 MHz, 860 to 960 MHz, and 2.45 GHz. The control unit 120 receives information such as the URL of the terminal device 200 through the short-range communication unit 150, and accesses the URL to receive the control UI for the terminal device.

In this manner, the control unit 120 performs communication with various external devices using the communication unit 150. [ Accordingly, the operations as described in the above-described various embodiments can be performed.

The GPS chip 171 is a component for receiving the GPS signal from a GPS (Global Positioning System) satellite and calculating the current position of the mobile device 100. When the navigation function is selected, the control unit 120 determines the current position of the mobile device 100 using the GPS chip 171, and can automatically set the current position as a start point.

The video processor 172 is a component for processing the content received through the communication unit 150 or the video data included in the content stored in the storage unit 140. [ The video processing unit 172 may perform various image processing such as decoding, scaling, noise filtering, frame rate conversion, resolution conversion, and the like on the video data. If the image is a photograph or moving image content, the video processing unit 172 may perform the above-described image processing on the content and convert the image into a form that can be additionally displayed on the map screen.

The audio processor 173 is a component for processing the content received through the communication unit 150 or the audio data included in the content stored in the storage unit 140. [ In the audio processor 173, various processes such as decoding or amplification of audio data, noise filtering, and the like may be performed. The audio processor 173 can generate various voice guidance messages, notification sounds, and the like required during navigation.

When the playback program for the multimedia contents is executed, the controller 120 drives the video processor 172 and the audio processor 173 to play the corresponding content. The display unit 110 may display an image frame generated by the video processor 172.

The speaker unit 176 outputs the audio data generated by the audio processor 173. In particular, during navigation, various voice announcement messages and alert sounds can be output.

The buttons 174 may be various types of buttons, such as mechanical buttons, touch pads, wheels, etc., formed in any area such as the front or side of the body exterior of the mobile device 100,

The voice input unit 160 is a configuration for receiving a user voice or other voice and converting it into audio data. As described above, according to the embodiment in which the terminal device 200 is controlled according to the user's voice, the control unit 120 analyzes the user's voice input through the voice input unit 160 and performs a control operation corresponding to the voice Can be performed.

The camera unit 175 is a configuration for capturing a still image or a moving image under the control of the user. The camera unit 175 may be implemented as a plurality of cameras such as a front camera and a rear camera.

When the camera unit 175 and the voice input unit 160 are provided, the control unit 120 performs a control operation according to a user voice input through the voice input unit 160 or a user motion recognized by the camera unit 175 It is possible. That is, the mobile device 100 may operate in a motion control mode or a voice control mode. When operating in the motion control mode, the control unit 120 activates the camera unit 175 to pick up a user, tracks the motion change of the user, and performs a corresponding control operation. When operating in the voice control mode, the controller 120 may analyze the user voice input through the voice input unit 160 and operate in a voice recognition mode for performing a control operation according to the analyzed user voice.

47, according to the embodiment, a USB port through which a USB connector can be connected in the mobile device 100, various external input ports for connecting with various external terminals such as a headset, a mouse, a LAN, , A DMB chip for receiving and processing a DMB (Digital Multimedia Broadcasting) signal, and the like.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, the mobile device includes a display unit 130, a communication unit 120 that communicates with a terminal device that displays items in a plurality of groups in a list form, communication with a terminal device, And a controller 110 for hopping a group of items displayed in the terminal device according to a touch operation performed on the terminal device. Here, the manner of the touch operation by the user and the hopping operation according to the user has been described in detail in the above-mentioned embodiment, and thus redundant description will be omitted.

Embodiments using position data as described above for this embodiment can be combined together. In this case, the mobile device 100 further includes a storage unit 140 in which metadata including location information is stored, and the control unit 120 provides the metadata to the terminal device 200, The service screen based on the location information can be displayed on the terminal device 200. Embodiments of providing a service using metadata are described in detail in the above section, and thus duplicate description will be omitted.

Alternatively, an embodiment in which the operation of the terminal apparatus is controlled using the user's voice may be combined. Specifically, the mobile device 100 may further include a voice input unit for receiving a user voice. When the user's voice is input, the control unit 120 can set a search criterion differently according to the user's state. The control unit 120 searches at least one destination corresponding to the user's voice using the set search criteria and provides the search result to the terminal device 200 through the communication unit 110. [

The control unit 120 may set a search criterion for preferentially searching for a destination providing a service related to the vehicle, if the user is in operation. If the mobile device 100 further includes a storage unit 140 storing user schedule information, the control unit 120 checks the user's subsequent schedule based on the user schedule information, and if there is a subsequent schedule And may set a search criterion for searching the destination according to a subsequent schedule time or place.

On the other hand, when the address information of the terminal apparatus is received from the terminal apparatus 200, the control unit 120 accesses the server apparatus corresponding to the address information, receives the web page data, and transmits the web page data to the terminal apparatus An adaptive screen may be configured and provided to the terminal device 200 through the communication unit.

Various embodiments as described above may be implemented in the form of a terminal device control method. Detailed flow charts and descriptions thereof have already been described in the above embodiments, and redundant explanations are omitted.

As described above, according to various embodiments of the present invention, various operations can be performed by interlocking a mobile device with a terminal device that can be installed in a vehicle. Accordingly, the user can use a more secure and convenient service.

The terminal control method, the service providing method, and the like according to the above-described various embodiments may be software-coded and stored in a non-transitory readable medium. Such non-transiently readable media can be used in various devices.

Specifically, the method includes performing communication with a terminal device displaying items classified into a plurality of groups in a list form, detecting a touch operation performed on a screen of a display unit provided in the mobile device, Program code for performing a control method including a control step of hopping a group of items displayed in the terminal device may be stored in a non-transitory readable medium.

A non-transitory readable medium is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the apparatus. Specifically, it may be a CD, a DVD, a hard disk, a Blu-ray disk, a USB, a memory card, a ROM, or the like.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

100: mobile device 110: communication unit
120: control unit 130:
140: storage unit 200: terminal device

Claims (20)

In a mobile device,
A display unit;
A communication unit for performing communication with a terminal device displaying items classified into a plurality of groups in a list form;
And a controller for hopping a group of items displayed in the terminal according to a touch operation performed on a screen of the display unit when communication with the terminal apparatus is connected. The method according to claim 1,
Wherein,
Wherein when the predetermined first touch operation is performed on the screen of the display unit, a group of items displayed on the screen of the terminal device is hopped to a previous group or a next group to display an item belonging to the hopped group, A mobile device that controls. 3. The method of claim 2,
Wherein,
Wherein when the predetermined second touch operation is performed on the screen of the display unit, the mode is switched to the handwriting recognition mode, and when the text is drawn on the screen of the display unit in the handwriting recognition mode, And controls the terminal device to display the belonging item. The method of claim 3,
Wherein,
And displays an affordance GUI for guiding the user drawing on the display unit when the mode is switched to the handwriting recognition mode. The method of claim 3,
Wherein,
And returns to the touch control mode for controlling the terminal device according to the first touch operation if the user drawing is not input for a predetermined time after switching to the handwriting recognition mode. The method according to claim 1,
And a storage unit for storing metadata including location information,
Wherein,
And providing the metadata to the terminal device so that a service screen based on the location information in the metadata is displayed on the terminal device. The method according to claim 1,
And a voice input unit for receiving a user voice,
Wherein,
And a search unit configured to search the at least one destination corresponding to the user's voice using the set search criteria and to transmit the search result to the terminal device through the communication unit, To the mobile device. 8. The method of claim 7,
Wherein,
And sets a search criterion for preferentially searching for a destination providing a service related to the vehicle when the user is in operation. 8. The method of claim 7,
And a storage unit for storing user schedule information,
Wherein,
Confirms a user's subsequent schedule based on the user schedule information, and sets a search criterion for searching for the destination according to a subsequent schedule time or location when the subsequent schedule exists. The method according to claim 1,
Wherein,
Wherein the address information is received from the terminal device, accesses the server device corresponding to the address information to receive web page data, forms an adaptive screen on the terminal device using the web page data, To the terminal device. A method for controlling a terminal device of a mobile device,
Performing communication with a terminal device displaying items divided into a plurality of groups in a list form;
Detecting a touch operation performed on a screen of a display unit of the mobile device;
And hopping a group of items displayed in the terminal according to the touch operation. 12. The method of claim 11,
Wherein the control step comprises:
And controls the terminal device to display an item belonging to the hopped group by hopping a group of items displayed on the screen of the terminal device to a previous group or a next group when a predetermined first touch operation is detected The terminal device control method comprising: 13. The method of claim 12,
Wherein the control step comprises:
Switching to a handwriting recognition mode when a predetermined second touch operation is detected;
And controlling the terminal device to display an item belonging to the hopped group by hopping to a group corresponding to the text when the text is drawn on the screen of the display unit in the handwriting recognition mode. Device control method. 14. The method of claim 13,
And displaying an affordance GUI for guiding a user drawing on the display unit when the handwriting recognition mode is switched to the handwriting recognition mode. 14. The method of claim 13,
And returning to the touch control mode if the user drawing is not input for a predetermined period of time after the handwriting recognition mode is switched to the handwriting recognition mode. 12. The method of claim 11,
And providing metadata including location information to the terminal device so that a service screen based on location information in the meta data is displayed on the terminal device. 12. The method of claim 11,
Receiving a user voice;
Setting search criteria differently according to a user state;
Searching at least one destination corresponding to the user voice using a set search criterion;
And providing the search result to the terminal device. 18. The method of claim 17,
Wherein the setting of the search criteria comprises:
And setting a search criterion for preferentially searching for a destination providing a service related to the vehicle when the user is in operation. 18. The method of claim 17,
Wherein the setting of the search criteria comprises:
And setting a search criterion for searching for the destination according to a subsequent schedule time or location if the user's subsequent schedule exists. 12. The method of claim 11,
Receiving address information from the terminal device, accessing a server device corresponding to the address information and receiving web page data;
Further comprising: constructing a screen adaptive to the terminal device using the web page data and providing the screen to the terminal device.

Images