KR20130138662A - Service providing system including display device and mobile device and method of providing service thereof - Google Patents

Abstract

A display device is disclosed. The display device comprises: a communication unit for communication with a mobile device; a control unit for acquiring a keyword included in a phone conversation if a call is connected in the mobile device; and a display unit for displaying additional information corresponding to the keyword. Accordingly, the display device can conveniently provide a service associated with a keyword of a phone conversation. [Reference numerals] (100) Display device;(200) Mobile device;(300) Electronic control device

Description

SERVICE PROVIDING SYSTEM INCLUDING DISPLAY DEVICE AND MOBILE DEVICE AND METHOD OF PROVIDING SERVICE THEREOF}

The present invention relates to a service providing system and a service providing method including a display device and a mobile device, and more particularly, to a display device for easily providing a service related to a call content, a service providing system including a mobile device, and a service providing method. .

Recently, with the development of communication technology and electronic device technology, various portable terminal devices and display devices have been developed. Many people own a personal terminal device, and a display device that performs various functions is installed in a vehicle or a street.

The display device installed in the vehicle displays the state information of the vehicle, and displays a menu such as temperature control to receive a control command from the user. It also includes navigation features to help users find their way. The personal mobile communication device performs a function of a call and a text message transmission and reception with the counterpart.

While driving a vehicle, a user may talk to the other party, try to talk to a third party, or change a destination. In general, in order for a user to attempt a call with a third party, a user must enter a third party's telephone number or perform a search in a stored telephone number list using a portable communication device and then connect the call. In order to change the destination, after inputting the destination in the display device, if the destination is found, the searched destination must be selected. In a special situation, such as when driving, such an input and search process may be dangerous, and a typo may occur while inputting a third party's information or destination. Thus, there is an increasing need for a method of simply making a call to a third party or changing a destination while driving.

In addition, when talking to the other party to talk about the field of interest in many cases, even if you do not dare to search for information on the field of interest, you want to be provided with information on the subject of interest.

Accordingly, there is a need for a technology for simplifying a call with a third party and changing a destination by using a display device and receiving interest information.

The present invention has been made in accordance with the above-described needs, and the present invention provides a display apparatus, a service providing system including a mobile device, and a service providing method, which display additional information based on contents of a call of a user and easily provide a corresponding service. It aims to provide.

According to an embodiment for achieving the above object of the present invention, a display device mounted on a mobile body includes a communication unit for communicating with a mobile device, and when a call is made in the mobile device, acquires a keyword included in the call content ( and a display for displaying additional information corresponding to the keyword.

The additional information includes advertisement information corresponding to the keyword, and when the communication unit transmits advertisement information corresponding to the keyword from a server device that stores an advertisement database, the transmitted advertisement information is transmitted through the mobile device. The controller may display the received advertisement information through the display unit.

In addition, when the displayed additional information is selected, the controller may provide a service corresponding to the selected additional information.

The additional information may include at least one of place information, contact information, multimedia content, and advertisement information. When the place information is selected, the controller may provide a route guidance service to the place information as a destination, and the contact information. If is selected, provides a phone service for performing a telephone connection to the contact information, if the multimedia content is selected, provides a playback service for the multimedia content, if the advertisement information is selected to display a screen containing detailed advertising information It can provide a display advertising service.

The display apparatus may further include a storage unit, and the controller may further include at least one of a server device, the mobile device, a communication counterpart that performs a call with the mobile device, and information corresponding to the keyword among information stored in at least one of the storage unit. You can search for information.

When the contents of the call of the mobile device are received through the communication unit, the controller may extract and obtain the keywords from the contents of the call and search for the additional information based on the acquired keywords.

According to an embodiment for achieving the above object of the present invention, the mobile device transmits a communication unit for communicating with a display device mounted on a mobile body, a call connection unit for communicating with a communication counterpart device, and a call content to a server device. And a controller configured to receive advertisement information corresponding to a keyword included in the call content and transmit the advertisement information to the display device.

According to an embodiment for achieving the above object of the present invention, a service providing system is a mobile device that performs a call with a communication counterpart device, when a call is made in the mobile device, performs communication with the mobile device, and the call And a display device for acquiring a keyword included in the content, wherein the display device displays additional information corresponding to the keyword.

According to an exemplary embodiment of the present invention, there is provided a method of providing a service of a display apparatus, the method comprising: communicating with a mobile device; when a call is made in the mobile device, obtaining a keyword included in the call content ( acquiring) and displaying additional information corresponding to the keyword.

The additional information includes advertisement information corresponding to the keyword, and when the server apparatus storing an advertisement database transmits advertisement information corresponding to the keyword, receiving the transmitted advertisement information through the mobile device. And displaying the received advertisement information.

The service providing method of the display apparatus may further include providing a service corresponding to the selected additional information when the displayed additional information is selected.

The additional information may include at least one of place information, contact information, multimedia content, and advertisement information. The providing of the service may include providing a route guidance service using the place information as a destination when the place information is selected. And, if the contact information is selected, provide a telephone service for performing a telephone connection to the contact information, if the multimedia content is selected, provide a reproduction service for the multimedia content, and if the advertisement information is selected, detailed advertisement information is provided. An advertisement service for displaying a screen including the same may be provided.

The method of providing a service of the display apparatus may include searching for the additional information corresponding to the keyword among at least one of information stored in at least one of a server apparatus, the mobile device, a communication counterpart having a call with the mobile device, and a storage unit. It may further include.

The method of providing a service of the display apparatus may further include extracting and obtaining the keyword from the call content when the call content of the mobile device is received, and searching for the additional information based on the obtained keyword. .

According to an embodiment of the present invention, a method of providing a service of a mobile device may include: performing communication with a display apparatus mounted on a mobile body, performing a call with a communication counterpart device, and a call content; And receiving advertisement information corresponding to a keyword included in the call content, and transmitting the advertisement information to the display device.

As described above, according to various embodiments of the present disclosure, a service providing system including a display apparatus and a mobile device may display additional information based on a call content of a user and provide a corresponding service.

1 is a view for explaining a service providing system mounted on a moving object according to an embodiment of the present invention.
2 is a diagram illustrating a system between a server and a mobile device according to an embodiment of the present invention;
3 is a block diagram of a display device according to an embodiment of the present invention;
4 is a block diagram of a communication device according to an embodiment of the present invention.
5 is a block diagram of a server according to an embodiment of the present invention.
6 is a timing diagram illustrating a method of extracting a keyword during a call and displaying additional information on a display device according to the first embodiment of the present invention.
7 is a timing diagram illustrating a method of extracting a keyword during a call and displaying additional information on a display device according to a second embodiment of the present invention.
8 is a timing diagram illustrating a method of extracting a keyword during a call and displaying additional information on a display device according to a third embodiment of the present invention.
9 is a timing diagram illustrating a method of extracting a keyword during a call and displaying additional information on a display device according to a fourth embodiment of the present invention.
10 is a timing diagram illustrating a method of extracting a keyword during a call and displaying additional information on a display device according to a fifth embodiment of the present invention.
11 is a view for explaining additional information display according to an embodiment of the present invention;
12 is a diagram illustrating a destination change service according to an embodiment of the present invention.
FIG. 13 illustrates a call connection service to a third party according to an embodiment of the present invention. FIG.
14 is a block diagram illustrating a configuration of a display apparatus according to another exemplary embodiment.
15 is a timing diagram illustrating a method of providing an advertisement service according to an embodiment of the present invention.
16 is a timing diagram illustrating a method of providing an advertisement service according to another embodiment of the present invention.
FIG. 17 is a diagram for one embodiment of using a mobile device and a display device connected to a vehicle according to one embodiment of the present invention; FIG.
18 is a diagram illustrating a service providing method including a plurality of terminal devices according to an exemplary embodiment.
19 illustrates a data frame format of a controller area network (CAN) according to an embodiment of the present invention.
20 is a flowchart illustrating a service providing method of a display apparatus according to an exemplary embodiment.
21 is a flowchart illustrating a service providing method of a mobile device according to an embodiment of the present invention.

Various embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. The following terms are defined in consideration of the functions of the present invention, and may be changed according to the intentions or customs of the user, the operator, and the like. Therefore, the definition should be based on the contents throughout this specification.

1 is a view for explaining a service providing system mounted on a moving object according to an embodiment of the present invention.

Referring to FIG. 1, the service providing system 1000 includes a display apparatus 100, a mobile device 200, and an electronic control unit (ECU) 300.

The display device 100 may be in a form embedded in the vehicle or in a detachable form. For example, the display device 100 may be an H / U (Head Unit) in a vehicle, a navigator, a tablet PC, an electronic frame, and the like. The display device 100 may display various status information and a control menu of the vehicle received from the electronic control device 300 or may display an application or the like transmitted from the mobile device 200. [

The mobile device 200 may be a cellular phone, a smart phone, a PDA, or the like, which includes a cellular communication module (not shown). The cellular communication module uses radio access technology according to a cellular communication protocol to connect with an external device through a base station of a cellular system via at least one or more antennas (not shown). The communication device 200 transmits / receives a wireless call including a voice call, a video call, and a message to another communication device having an input telephone number.

The electronic control device 300 refers to an embedded system that controls one or more of the vehicle's electrical system or subsystems. The types of the electronic control unit 300 include an electric / engine control module, a powertrain control module, a transmission control module, a brake control module, a central control module, a central timing control module, a general electronic module, a body control module, . Accordingly, the electronic control unit 300 receives information from various sensors included in the vehicle and controls all parts of the vehicle such as an automatic transmission, a driving system, a braking system, and a steering system.

The display device 100 may be connected to the mobile device 200 and the electronic control device 300 using various communication methods. For example, the display device 100 may be connected to the mobile device 200 through a wired connection using a USB or the like. Alternatively, they may be connected wirelessly using a short-range wireless communication method such as Wi-Fi or Bluetooth. The mobile device 200 connected to the display device 100 may transmit the received call, various data including a message, and the like to the display device 100. The display device 100 may store various data received from the mobile device 200 and display the data. Alternatively, the display device 100 may send the data and the transmission command to the mobile device 200 when the display device 100 receives the data transmission command to the outside. The mobile device 200 can transmit data received from the display device 100 to an external device according to a transmission command. The display device 100 and the mobile device 200 can send and receive mutual rights information and can encrypt and transmit the transmitted message. The display device 100 or the mobile device 200 receiving the data when transmitting and receiving data can prevent malfunction due to other devices or erroneous data transmission by checking the rights information and performing the corresponding operation.

The display device 100 may be connected to the electronic control unit 300. In one embodiment, the display device 100 and the electronic control unit 300 may be connected by a CAN (Controller Area Network) method. The CAN will be described later. The electronic control unit 300 may be connected to the display device 100 to transmit the sensed vehicle state information to the display device 100 and the display device 100 may display or store the transmitted vehicle state information. Alternatively, the display device 100 may display a vehicle control menu, and may transmit the received control command to the electronic control unit 300 when receiving the vehicle control command from the user. For example, the user can control the vehicle such as headlight on / off, in-vehicle temperature setting, etc. through the display device 100. The electronic control unit 300 receiving the control command can perform control on the corresponding module.

The mobile device 200 may perform an operation corresponding to a command received by connecting to an external communication device or a server with respect to a call command, a message transmission command, and a data transmission / reception command received from the display apparatus 100.

2 is a diagram illustrating a system between a server and a mobile device according to an embodiment of the present invention.

Referring to FIG. 2, first and second mobile devices 200-1, 200-2 and server 400 are shown.

The first and second mobile devices 200-1 and 200-2 include a cellular communication module (not shown) as described in FIG. Accordingly, the first mobile device 200-1 and the second mobile device 200-2 are connected using a radio access technology according to a general cellular communication protocol. The first and second mobile devices 200-1 and 200-2 are capable of voice call, video call, message transmission, and data transmission. The first and second mobile devices 200-1 and 200-2 may communicate with the server 400. [

In the system 2000 illustrated in FIG. 2, the server 400 may be various kinds according to various functions. The first and second mobile devices 200-1 and 200-2 may perform the same function in relation to the server 400 so that the first and second mobile devices 200-1 and 200-2 Mobile device 200 will be described.

For example, when the mobile device 200 requests the place information from the server 400, the server 400 may be a map data server that stores map related data. When the mobile device 200 requests the advertisement information, the server 400 may be an advertisement server. When the mobile device 200 requests traffic information from the server 400, the server 400 may be a traffic information server storing real-time traffic information. The server 400 may store various information instead of performing a specific function. Alternatively, if there is an information request from the mobile device 200, the server 400 may search for another server or web and transmit the requested information.

As another example, the server 400 may be a web such as the Internet, rather than a physically existing server. In addition, the server 400 may be a management server that generates a user profile corresponding to the user information received from the mobile device 200 and stores user related information. That is, the server 400 may receive a call content from the mobile device 200. The server 400 may store call contents in a corresponding user profile, and extract keywords from the call contents. The server 400 may search for the matching advertisement information from the advertisement server 400 using the extracted keyword and transmit the matching advertisement information to the mobile device 200.

For example, the mobile device 200 and the server 400 may be connected using a wireless LAN method such as Wi-Fi.

As such, the mobile device 200 may transmit / receive voice calls or data by connecting to another communication device using a cellular communication method, or transmit / receive data by connecting to a server using a wireless LAN method. So far, the service providing system 1000 and the system 2000 between the server 400 and the mobile device 200 have been described. Hereinafter, the display apparatus 100 and the mobile device 200 included in the service providing system will be described.

3 is a block diagram of a display apparatus according to an exemplary embodiment.

Referring to FIG. 3, the display apparatus 100 includes a display 130, a controller 140, and a communicator 150.

The communicator 150 communicates with the mobile device 200. Communication with the mobile device 200 may be performed by wire or wirelessly. When the call connection is made in the mobile device 200, the communicator 150 receives the connected call contents and transmits the user's outgoing voice to the mobile device 200. The communicator 150 may transmit the extracted keyword to the mobile device 200 and receive additional information corresponding to the keyword from the mobile device 200. Keywords mean key words such as person's name, place name, movie name, brand name, and the like. The additional information means information associated with a keyword. For example, when the keyword is a person's name, the additional information may be contact information of the person. If the keyword is a place name, the additional information may be place information. If the keyword is a movie name, the additional information may be movie advertisement information. If the keyword is a brand name, the additional information may be product advertisement information.

The display 130 displays additional information corresponding to the keyword. The display unit 130 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, And a display (3D display). A method of displaying additional information corresponding to a keyword will be described later.

When a call is made in the mobile device 200, the controller 140 obtains a keyword included in the call content. According to an embodiment of the present disclosure, the display apparatus 100 receives an analog audio signal including a user voice and converts it into a digital signal. The noise is removed from the input digital signal. The keyword is determined from the noise-free digital signal. As another example, the keyword may be determined by generating the converted digital signal as text information and analyzing the generated text information.

The controller 140 searches for additional information by using the obtained keyword. The controller 140 may search for a storage unit (not shown) of the display apparatus 100. In addition, a search command may be transmitted to the mobile device 200 to search for the server 400, the mobile device 200, or a communication counterpart device connected to the mobile device 200.

In addition, when the displayed additional information is selected, the controller 140 provides a service corresponding to the selected additional information. For example, when the place information is selected, a route guidance service using the place information as a destination may be provided. If the contact information is selected, it may provide a telephone service to perform a telephone connection to the contact information. When the multimedia content is selected, a reproduction service for the multimedia content may be provided, and when advertisement information is selected, an advertisement service may be provided. The controller 140 controls the respective components including the display unit 130 and the communication unit 150 of the display apparatus 100.

The display apparatus 100 may further include a storage unit (not shown). The storage unit may store the detected keyword, the received additional information, the telephone number or the map data.

4 is a block diagram of a communication device according to an exemplary embodiment.

Referring to FIG. 4, the mobile device 200 includes a communication unit 210, a call connection unit 220, and a control unit 230.

The communication unit 210 performs communication with the display device 100. The communication unit 210 transmits the contents of the call to the display apparatus 100 when the call is connected to the communication counterpart device. In addition, the communication unit may receive a keyword from the display apparatus 100. The additional information searched by the server, the mobile device 200, or the communication counterpart device is transmitted to the display apparatus 100 using the keyword.

The call connection unit 220 includes a cellular communication module (not shown). Therefore, the call connection unit 220, the call connection unit 220 performs a call with the communication partner device. In FIG. 4, the call connection unit 220 is illustrated as a separate component, but the call connection unit 220 may be included in the communication unit 210.

The controller 230 searches for additional information using a keyword. In some cases, when the display apparatus 100 does not perform the keyword extraction function, the controller 230 of the mobile device 200 may extract the keyword. Since the method of extracting keywords has been described above, a description thereof will be omitted. The mobile device 200 may further include a storage unit (not shown). The storage unit may store the detected keyword, the received additional information, the telephone number or the map data.

The controller 230 transmits a call content to the server 400 to receive additional information corresponding to a keyword included in the call content, and controls the communication unit 210 to transmit the received additional information to the display apparatus 100. Can be. In particular, the controller 230 may receive the advertisement information from the server 400 and may control the communication unit 210 to transmit the advertisement information to the display apparatus 100.

5 is a block diagram of a server according to an embodiment of the present invention.

Referring to FIG. 5, the server 400 includes a communication unit 410 and a control unit 420. In some cases, the server 400 may receive the content of the call, extract a keyword, and transmit the associated additional information to the mobile device 200.

The communication unit 410 receives call details and location information from the mobile device 200. The call content and location information may be transmitted by being encrypted. The server may include a storage unit (not shown), and the storage unit may store the received call contents and the location information by grouping each user or location.

The controller 420 extracts a call keyword from the call content and retrieves the advertisement information based on the call keyword and the location information. The currency keyword means a main word of the contents of the call, and is extracted by giving priority to a set of words that can be grouped into repeated words or a category. For example, when talking about a movie in a call, the word 'movie' may be repeated, and the words 'A movie', 'B movie', 'AA theater' and 'BB theater' may be extracted. In this case, the call keyword may be extracted as a call keyword for movie, A movie, B movie, AA theater, and BB theater. The controller 420 may assign and extract priority based on the number of repetitions among words extracted as the call keyword.

If the user is on the XXX street, the controller 420 searches for nearby theater information or information about the A movie by using the received location information of the XXX street and a call keyword such as the extracted A movie. The communication unit 410 may transmit the retrieved advertisement information to at least one of the display apparatus 100, the mobile device 200, and an external display apparatus located in a preset area. For example, the external display device may be a public information display (PID) installed at a distance.

The external display device in the preset area may be set as an external display device in an area within a predetermined distance, such as within 10 m from the mobile device 200, and may be the nearest external display device among the external display devices around the mobile device 200. It may be set.

Server 400 may be a simple search server. In this case, the server 400 may receive a keyword from the mobile device 200 to search for additional information related to the keyword, and transmit the retrieved additional information to the mobile device 200. The server 400 may store data about additional information in a database in a storage unit (not shown).

So far, the display apparatus 100, the mobile device 200, and the server 400 configuring the system have been described. Hereinafter, various embodiments of a service providing method of a display apparatus will be described.

6 is a timing diagram illustrating a method of extracting a keyword during a call and displaying additional information on the display device according to the first embodiment of the present invention. FIG. 6 illustrates an embodiment in which the mobile device 200 searches for a storage unit of the mobile device 200 by extracting a keyword from a call content.

Referring to FIG. 6, the mobile device 200 receives a call signal from a communication counterpart device in operation S610. The mobile device 200 transmits the received call contents to the display apparatus 100 (S620). The transmission of the call content may process the call signal in the mobile device 200 and transmit the call signal to the display apparatus 100. Alternatively, the mobile device 200 may transmit the received call signal to the display apparatus 100 as it is. In this case, the display apparatus 100 may display the same screen as the screen displayed on the mobile device 200 or may display a unique screen of the display apparatus 100 by executing a special application when receiving a call signal.

The mobile device 200 extracts a keyword from the contents of the call and retrieves additional information associated with the keyword (S630). The mobile device 200 receives an analog audio signal including a user voice and converts the audio signal into a digital signal. The noise is removed from the input digital signal. The keyword may be extracted by determining the keyword from the noise-free digital signal. Alternatively, the mobile device 200 may generate the converted digital signal as text information and then analyze the generated text information to determine a keyword.

The mobile device 200 analyzes the keyword and searches the storage of the mobile device 200. For example, a keyword may be a person's name or place name. The additional information means information associated with a keyword. For example, when the keyword is a person's name, the additional information may be contact information of the person. If the keyword is a place name, the additional information may be place information.

If the extracted keyword is a person's name, the mobile device 200 may retrieve a list of telephone numbers stored in the storage. When a matching person name is found, information such as a phone number and a picture mapped to the person name is determined as additional information. The mobile device 200 stores the map data, and names can be extracted by keywords. At this time, if the matching name is found by searching the map data, the mobile device 200 determines information such as an address and a telephone number mapped to the name as additional information.

The mobile device 200 transmits the keyword and the searched additional information to the display apparatus 100 (S640). The additional information retrieval and transmission in the mobile device 200 may be performed in real time during a call. Alternatively, the additional information search may be performed in real time during a call, and the searched additional information may be temporarily stored and transmitted to the display apparatus 100 after the call ends. The display apparatus 100 displays a keyword and the received additional information (S650). A detailed display method will be described later.

7 is a timing diagram illustrating a method of extracting a keyword during a call and displaying additional information on a display device according to a second embodiment of the present invention. FIG. 7 illustrates an embodiment in which the display apparatus 100 searches for additional information by extracting a keyword from the contents of a call.

Referring to FIG. 7, the mobile device 200 receives a call signal from a communication counterpart device in operation S710. The mobile device 200 transmits the received call contents to the display apparatus 100 (S720). When the display apparatus 100 receives the call content from the mobile device 200, the display apparatus 100 may execute a specific application and display a unique call screen.

The display apparatus 100 extracts a keyword from the call content and searches for additional information associated with the keyword (S730). Since the keyword extraction process has been described above, it will be omitted. The display apparatus 100 may search for a storage of the display apparatus 100. If the extracted keyword is a person's name, the telephone number list is searched. If the extracted keyword is a place name and the display apparatus 100 stores the map data, the stored map data is retrieved.

If the display apparatus 100 does not store the telephone number list or the map data, the display apparatus 100 may transmit a keyword to the mobile device 200. Upon receiving the keyword, the mobile device 200 can retrieve the associated additional information from the stored telephone number list or map data. As described above, when the extracted keyword is a person's name, the mobile device 200 may search the telephone number list. When a matching person name is found, information such as a phone number and a picture mapped to the person name is determined as additional information. If the extracted keyword is a place name, the map data may be searched. When the mobile device 200 searches for additional information (eg, a phone number, a photo, an address) corresponding to the keyword, the mobile device 200 transmits the searched additional information to the display apparatus 100.

The display apparatus displays the extracted keyword and additional information (S740).

8 is a timing diagram illustrating a method of extracting a keyword during a call and displaying additional information on a display device according to a third embodiment of the present invention. 8 is an embodiment in which the mobile device 200 requests the server 400 to search for additional information by extracting a keyword from the contents of the call. In general, the display apparatus 100 or the mobile device 200 stores only limited data (eg, a phone number). Therefore, content information such as advertisement information or specific place information cannot be searched by only the search of the display apparatus 100 or the mobile device 200.

Referring to FIG. 8, the mobile device 200 receives a call signal from a communication counterpart device in operation S810. The mobile device 200 transmits the received call contents to the display apparatus (S820). The mobile device 200 extracts a keyword from the call contents (S830).

The mobile device 200 transmits the extracted keyword to the server 400-1 (S840). The server 400-1 receives a keyword and performs a function of searching for information associated with the keyword (S850). There may be a plurality of keywords. For example, if the received keyword is a business name, the server 400-1 may search for an address and a phone number associated with the business name. When there are a plurality of keywords, the server 400-1 may assign a priority based on the number of repetitions, etc., and search for related additional information based on a predetermined number or less of keywords. For example, if a keyword assigned as a priority is a movie A or a BB theater, the server 400-1 may search advertisement information for the A movie or advertisement information of the BB theater as additional information.

The server 400-1 may receive a keyword in real time from the mobile device 200 and transmit the additional information retrieved in real time to the mobile device 200 (S860). The mobile device 200 transmits the keyword and the received additional information to the display apparatus 100 (S870). The display apparatus 100 displays the received keyword and additional information (S880).

9 is a timing diagram illustrating a method of extracting a keyword during a call and displaying additional information on a display device according to a fourth embodiment of the present invention. 9 illustrates an embodiment in which the mobile device 200 transmits a call content to the server 400-2 so that the server 400-2 extracts a keyword from the call content and retrieves additional information.

Referring to FIG. 9, the mobile device 200 receives a call signal from a communication counterpart device in operation S910. The mobile device 200 transmits the received call contents to the display apparatus 100 (S920).

The mobile device 200 transmits the call content to the server 400-2 (S930). At this time, the server 400-2 may be a management server that creates and manages each profile according to a user, not a general search server. The server 400-2 may generate a user profile for each user and store the received call content in a corresponding user profile. If there is a pre-generated user profile, the received call content may be stored in the corresponding pre-generated user profile. When the mobile device 200 transmits a call to the server 400-2, the mobile device 200 may transmit a unique identifier (eg, mobile device ID, phone number information, etc.) of the mobile device 200. In addition, the call content can be encrypted and transmitted for security.

The server 400-2 extracts a keyword from the contents of the call and retrieves additional information associated with the keyword (S940). Extraction of keywords and retrieval of additional information may be performed in a manner similar to that described above. The server 400-2 transmits the keyword and the searched additional information to the mobile device 200. Alternatively, only additional information may be transmitted. The mobile device 200 transmits the keyword and the additional information to the display apparatus 100 (S960). The display apparatus 100 displays the received keyword and additional information (S970).

10 is a timing diagram illustrating a method of extracting a keyword during a call and displaying additional information on a display device according to a fifth embodiment of the present invention. FIG. 10 is a flowchart illustrating a process in which a first mobile device 200-1 requests a search for a second mobile device 200-1, which is a communication counterpart. For example, when a person named AAA is mentioned in a call, the contact information of AAA is not stored in the first mobile device 200-1, but is stored in the second mobile device 200-2. have. In this case, the first mobile device 200-1 may receive contact information of AAA from the second mobile device 200-2.

Referring to FIG. 10, the first mobile device 200-1 receives a call signal from the second mobile device 200-2 (S1010). The first mobile device 200-1 transmits the received call contents to the display apparatus 100 (S1020).

The first mobile device 200-1 extracts a keyword. At this time, the person name may be extracted. First, the first mobile device 200-1 searches for a list of telephone numbers stored in its storage unit (S1030). If the matching contact information is not found, the first mobile device 200-1 requests to search for additional information on the keyword extracted by the second mobile device 200-2 (S1040). That is, the contact information corresponding to the extracted person name is requested. The second mobile device 200-2 searches for the requested additional information according to the request of the first mobile device 200-1 and transmits the requested additional information to the first mobile device 200-1 (S1050). If the second mobile device 200-2 also fails to search for the matching additional information, the second mobile device 200-2 may transmit a signal to the first mobile device 200-1 that there is no requested additional information.

The first mobile device 200-1 transmits the keyword and the received additional information to the display apparatus 100 (S1060). The display apparatus 100 displays the received keyword and additional information (S1070).

6 to 10 described various keyword extraction and additional information retrieval methods. The display apparatus 100 may display keywords and additional information included in the contents of the call in the above-described manner. In the above-described method, one method may be used or two or more methods may be used in combination. When keyword search and additional information search can be performed in a plurality of devices, priority can be determined so that only one device is performed. Alternatively, the specific additional information may be performed only on a specific device or specific devices.

11 is a diagram illustrating display of additional information according to an embodiment of the present invention.

Referring to FIG. 11 (1), the display apparatus 100 is connected to the mobile device 200. The mobile device 200 receives a call signal from the other party. The mobile device 200 transmits the received call content to the display apparatus 100. The display apparatus 100 provides a road guidance service. The display apparatus 100 may perform content playback or other operations.

When the display apparatus 100 receives a call signal from the mobile device 200, the display apparatus 100 may divide and display the display 13 into two areas. The upper area 21 displays the road guidance service, and the lower area 22 displays the contents related to the received call signal. That is, the lower area 22 may display a call notification, caller name, caller picture, caller phone number. Information on the caller may be stored in the display apparatus 100, or the mobile device 200 may transmit information on the caller while transmitting a call signal. The lower area 22 may display the receive button 23, the ignore button 24, and the busy button 25 together. If the ignore button 24 is selected, the call is rejected. When the busy button 25 is selected, a specific message is transmitted to the counterpart. If the receive button 23 is selected, the call is carried out.

Referring to FIG. 11 (2), when a call is performed, a display apparatus 100 is extracted from a call content and additional information associated with the extracted keyword is displayed. Keywords can be extracted in real time during a call. As described above, keyword extraction may be performed in at least one of the display apparatus 100, the mobile device 200, and the server 400. When the person name EEE is extracted from the call contents, the EEE additional information 31 including a picture and contact information of the EEE may be displayed. When building B is extracted from the call, the building B additional information 33 including the address of building B may be displayed. The display of the additional information may be performed in real time during a call, and the additional information retrieved after the call may be displayed simultaneously.

The display apparatus 100 may display keywords and additional information in a certain shape (eg, triangle, rectangle, pentagon, hexagon, circle). For example, if the keyword is a person's name, the person's name and phone number can be displayed in a rectangle. Alternatively, the picture may be additionally displayed. If the keyword is a place name, an icon meaning the place name and the place name can be displayed in a rectangular figure. Alternatively, the address or telephone number can be additionally displayed. As illustrated in (2) of FIG. 11, the display apparatus 100 may display additional information only when the keyword is a person name or a place name. Alternatively, additional information such as advertisement information and multimedia content may be additionally displayed as well as additional information related to a person's name or place name. Alternatively, the user may set the type of additional information to be displayed. The order in which the additional information is arranged in the display apparatus 100 may be arranged in a search order of the additional information, may be arranged according to the letter order of the keyword (eg, ABC), or may be arranged according to the type of keyword.

When the displayed additional information is selected, the display apparatus 100 performs a corresponding service.

12 is a diagram illustrating a destination change service according to an embodiment of the present invention.

Referring to (1) of FIG. 12, a display apparatus 100 in which additional information is displayed after a call is terminated is illustrated. As described with reference to FIG. 11, the display apparatus 100 displays additional information associated with the extracted keyword in the call contents. When the user selects the window close button 26, the display apparatus 100 closes the additional information display window and switches to the previous service screen. The user selects the additional information menu 33 of the B building.

Referring to Fig. 12 (2), detailed information of the B building is displayed. Detailed information of the B building may include an address and a phone number, and a destination setting button, a call button, a review button of the B building, and a sharing button may be displayed together. The user selects the destination setting button 27.

Referring to (3) of FIG. 12, the display apparatus 100 in which the destination is changed by the user selecting the destination setting button 27 is shown. That is, the display apparatus 100 performs a road guidance service by changing the destination from the existing destination to the building B selected by the user. In this way, the destination can be changed easily, so that the destination can be changed quickly and safely while driving.

13 is a diagram illustrating a call connection service to a third party according to an embodiment of the present invention.

Referring to (1) of FIG. 13, a display apparatus 100 in which additional information is displayed after a call is terminated is illustrated. As described with reference to FIG. 11, the display apparatus 100 displays additional information associated with the extracted keyword in the call contents. When the user selects the window close button 26, the display apparatus 100 closes the additional information display window and switches to the previous service screen. The user selects the additional information menu 31 of the EEE.

Referring to FIG. 13 (2), the display apparatus 100 connects a telephone to the telephone number of the EEE in response to selection of the EEE additional information. That is, when the display apparatus 100 requests a telephone connection to the EEE from the connected mobile device 200, the mobile device 200 attempts to make a call to the EEE. In this case, the display apparatus 100 may display the display 130 by dividing it into two regions. The upper area 21 may display the road guidance service, and the lower area 22 may display information about the receiver.

12 to 13 illustrate embodiments of person name and place name information as additional information. However, the additional information may be advertisement information. In this case, the display apparatus 100 may display the advertisement additional information as a menu, and corresponding advertisement information may be displayed when the user selects the advertisement additional information menu.

The display apparatus 100 performs a call connection through the mobile device 200. However, the display apparatus 100 may include a cellular communication module 151 to perform a call connection without the mobile device 200.

14 is a block diagram illustrating a configuration of a display apparatus according to another exemplary embodiment.

Referring to FIG. 14, the display apparatus 100a may include a storage 110, a detector 120, a display 130, a controller 140, a communication unit 150, a multimedia unit 160, and an imaging unit 170. , The sensor unit 180 and the input / output unit 190 are included.

The storage unit 110 stores various types of multimedia data processed by the control unit 140, content data, data received from an external source, and the like.

The storage unit 110 may store a control program and applications for controlling the display device 100a or the control unit 140. [ The term "storage unit " may include a memory card (e.g., SD card, memory stick) detachable / attachable to a ROM, RAM or display device 100a. The storage unit may also include non-volatile memory, volatile memory, a hard disk drive (HDD), or a solid state drive (SSD).

The storage unit 110 stores a plurality of templates set differently for each message type. The storage unit 110 may store a call history to be transmitted to the server 400 when a call is made in the display device 100a.

The detector 120 may detect a plurality of different state information. The detection unit 120 can receive various kinds of information from the GPS module 155, the electronic control unit 300 of the vehicle or the server 400 to detect the state information.

The display unit 130 displays multimedia contents, images, moving pictures, text, and the like under the control of the controller 140. The display unit 130 may be implemented as a general display panel having no touch input function, or may be implemented as a touch display panel capable of recognizing user operations using a proximity sensor or a touch sensor. When implemented as a touch display panel, at least one touch gesture may be input through a user's body (eg, a finger including a thumb) or a senseable input means (eg, a stylus pen).

Such a user interface may include certain touch areas, soft keys and soft menus. The display unit 130 may transmit an electronic signal corresponding to at least one touch gesture inputted through the user interface to the display unit 130 through an LCD controller (not shown). Also, the display unit 130 senses the continuous movement of the touch and transmits the electronic signal corresponding to the continuous or discontinuous movement of the touch to the LCD controller.

The display unit 130 may be implemented by, for example, a resistive method, a capacitive method, an infrared method, or an acoustic wave method.

The display unit 130 converts a sensing signal related to the user's operation sensed through the touch sensor into a digital signal (e.g., X and Y coordinates) and transmits the digital signal to the controller 140. The control unit 140 may perform a control operation corresponding to a user operation input through the display unit 130 using the received digital signal. For example, the control unit 140 may cause the soft key displayed on the display unit 130 to be selected or execute an application corresponding to the soft key in response to a user operation.

The user gesture described above is not limited to the direct contact between the display unit 130 and the user's body or touchable input means, but also includes a noncontact manner. The sensitivity of the user operation that can be detected by the display unit 130 may be changed according to the performance or structure of the display device 100a.

The control unit 140 includes a CPU and a read-only memory (ROM) in which a control program for controlling the display device 100a is stored and a signal or data input from the outside of the display device 100a, And a random access memory (RAM) used as a storage area for operations performed in the memory 100a. The CPU may include at least one of a single-core processor, a dual-core processor, a triple-core processor, and a quad-core processor. The CPU, ROM and RAM are interconnected via an internal bus.

The control unit 140 controls the storage unit 110, the detection unit 120, the display unit 130, the communication unit 150, the multimedia unit 160, the imaging unit 170, and the sensor unit 180.

The communication unit 150 includes a cellular communication module 151, a wireless LAN module 152, a short range communication module 153, a connector 154, a GPS module 155, and a broadcasting communication module 156.

The cellular communication module 151 uses the radio access technology according to the cellular communication protocol under the control of the control unit 140 so that the display device 100a can communicate with the external device via the at least one antenna (not shown) To the base station of the cellular system).

The cellular communication module 151 may also be connected to other communication devices such as a cellular phone, a smart phone, a tablet PC or other device having a phone number input to the display device 100a, a voice communication, : SMS) message or a multimedia signal (Multimedia Messaging Service: MMS) message.

The wireless LAN module 152 may be connected to the Internet at a place where a wireless access point (not shown) is installed under the control of the controller 140. [ The wireless LAN module 152 supports the IEEE 802.11x standard of the Institute of Electrical and Electronics Engineers (IEEE).

The short-range communication module 153 can perform short-range wireless communication between the display device 100a and an external device under the control of the controller 140. [ The short-range communication method may include Bluetooth, infrared communication (IrDA), NFC, and the like.

The connector 154 provides an interface with various devices such as USB 2.0, USB 3.0, HDMI, and IEEE 1394. The connector 154 can be used as an interface for connecting the display device 100a to an external device or a power source. The data stored in the storage unit 110 of the display device 100a can be transmitted to or received from the external device through the cable connected to the connector 154 under the control of the controller 140. [ Power can be input from a power source via a wired cable connected to the connector 154 or charged to a battery (not shown).

The GPS module 155 receives the radio waves from a plurality of GPS satellites (not shown) on the earth orbit and transmits a time of arrival and a GPS (not shown) from the GPS satellites (not shown) to the display device 100a. The position of the display device 100a can be calculated using the parameters.

The broadcast communication module 156 controls a broadcast signal (e.g., a TV broadcast signal, a radio broadcast signal, or a data broadcast signal) transmitted from a broadcast station through a broadcast communication antenna (not shown) under the control of the controller 140, (E. G., An Electric Program Guide (EPS) or an Electric Service Guide (ESG)).

The multimedia unit 160 includes an audio playback module 161 and a video playback module 162. The audio playback module 161 may play back a digital audio file (e.g., a file having a file extension of mp3, wma, ogg, or wav) that is stored or received under the control of the controller 140. [ The video playback module 162 supports various types of codecs for playing digital video files. That is, the video file is reproduced by the pre-stored codec according to the codec format of the video file to be reproduced. The audio playback module 161 or the video playback module 162 of the multimedia unit 160 may be included in the controller 140.

The image pickup section 170 captures a still image or a moving image under the control of the control section 140. [ The imaging unit 170 may include a plurality of cameras. The image pickup section 170 may include an auxiliary light source (e.g., a flash (not shown)) that provides an amount of light necessary for photographing.

The image sensing unit 170 transmits the sensed image to the control unit 140. The controller 140 analyzes an image to detect a user's motion or shape, and can perform a control operation corresponding to the detected motion or shape. For example, the motion of the user refers to the motion of the user's hand detected through the imaging unit 170. The shape of the user means the shape of the face of the user sensed through the image sensing unit 170.

In yet another embodiment, the display device 100a can detect movement of a user using other means such as an infrared detector, and can execute or control the application in response to the movement.

In addition, the image sensing unit 170 may be configured separately from the display device 100a. For example, the display device 100a is mounted inside the vehicle, and the image pickup unit 170 can be mounted outside the vehicle (e.g., front and rear). The display device 100a and the image pickup unit 170 may be connected to each other by wire or wireless and an image of the front or rear surface of the vehicle captured by the image pickup unit 170 may be displayed on the display device 100a.

The sensor unit 180 may include at least one of a touch sensor 181, a geomagnetic sensor 182, an acceleration sensor 183, a hinge sensor 184 and a proximity sensor 185.

The touch sensor 181 is a sensor capable of sensing a touch with respect to the display unit 130 of the user. The touch sensor 181 can be divided into an electrostatic mode and a piezoelectric mode according to a method of sensing a user's touch. The touch sensor 181 according to an embodiment of the present invention can be implemented in two ways, respectively. The touch sensor 181 may constitute a display unit together with the display panel.

The touch sensor 181 is a sensor capable of inputting an instruction displayed on the display screen by pressing the touch screen with a body such as a finger or a sensible input means. The touch sensor 181 uses a capacitance change, a resistance change, or a light amount change.

The geomagnetic sensor 182 can detect the geomagnetism and detect the azimuth angle. Therefore, the direction of the display device 100a is recognized. The acceleration sensor 183 processes the output signal and measures the dynamic force such as acceleration, vibration, shock, etc. of the object, and detects the change in the moving speed of the display device 100a or the intensity of the force. The proximity sensor 184 can detect whether or not an object is approaching the user's display device 100a.

Although not shown in FIG. 14, the sensor unit 180 of the display apparatus 100a may include a gravity sensor capable of detecting which direction gravity acts and a gyro capable of recognizing a total of six axes by inserting rotations into existing acceleration sensors. Orientation sensor that can automatically detect the horizontal and vertical frame of content such as sensor and image, and automatically rotate and align the content, Ambient light sensor that detects the amount of light around the display device 100a, and can measure atmospheric pressure At least one of an altitude measurement sensor, an RGB sensor that can detect the color of an object, a distance measurement sensor that can measure a distance using ultrasonic waves or infrared rays, and a hall sensor that uses a voltage change according to the strength of a magnetic field. can do.

Each sensor of the sensor unit 180 detects a state, generates a signal corresponding to the detection, and transmits the signal to the control unit 140. The sensor of the sensor unit 180 may be added or deleted depending on the performance of the display device 100a.

The input / output unit 190 includes a button unit 191, a microphone 192, a speaker 193, and a vibration motor 194.

The at least one button unit 191 may be formed as a push type or a touch type on the front, side, or rear side of the body of the display apparatus 100a. The at least one button unit 191 may include a power / lock button, Button, a back button, and a search button.

The microphone 192 receives a voice or a sound under the control of the controller 140 and generates an electrical signal.

The speaker 193 outputs various signals (for example, signals) of the cellular communication module 151, the wireless LAN module 152, the short range communication module 153, the multimedia unit 160 or the imaging unit 170 under the control of the controller 140 , A radio signal, a broadcast signal, a digital audio file, a digital moving picture file, or a picture) can be output to the outside of the display device 100a.

The speaker 193 can output sound corresponding to the function performed by the display device 100a (e.g., a button operation sound corresponding to a telephone call or a ring back tone). The speaker 193 may be formed at one or a plurality of positions at appropriate positions or positions of the body of the display device 100a. For example, the speaker 193 may include an internal speaker module disposed at a position suitable for approaching a user's ear during a call, and a higher output suitable for use in viewing an audio / And an external speaker module disposed at a proper position of the body of the speaker module.

The vibration motor 194 can convert an electrical signal into mechanical vibration under the control of the control unit 140. [ For example, the display device 100a in the vibration mode operates the vibration motor 194 when a voice call is received from another device (not shown). The vibration motor 194 may be formed in one or plural in the body of the display device 100a. The vibration motor 194 may operate in response to the user's touch gesture sensed on the display unit 130 and the continuous movement of the touch sensed on the display unit 130.

A power supply unit (not shown) supplies power to be used in the display device 100a. The power source unit may further include a voltage converter that can be implemented as a rechargeable battery and converts the external power source to supply the rechargeable battery.

In accordance with the power management control of the control unit 140, the power unit can supply power to the display device 100a in various modes such as a maximum performance mode, a normal mode, a power saving mode, and a standby mode.

The display device 100a can transmit the call history and the location information of the display device 100a to the server 400 and receive various information related to the call history and the location information. The constituent parts of the display device 100a described above are not necessarily all included, but only some constituent parts may be included according to the embodiment.

15 is a timing diagram illustrating a method of providing an advertisement service according to an embodiment of the present invention.

Referring to FIG. 15, the mobile device 200 receives a call signal from a communication counterpart device. The mobile device 200 transmits the received call contents to the display apparatus 100 (S1505). In addition, the mobile device 200 transmits the call content and location information to the server 400 (S1510). The location information in the mobile device 200 may be received through the GPS module. Alternatively, the display apparatus 100 may receive and transmit the data from the display apparatus 100. Call history and location information transmitted to the server 400 may be transmitted by encrypting.

The server 400 extracts a call keyword from the call contents (S1515). Currency keywords refer to key words or repeated words in the content of the call. The server 400 retrieves advertisement information from the extracted call keyword and the received location information (S1520). The call keywords may be given priority, and only call keywords having a predetermined priority may be used for searching.

The server 400 may transmit the retrieved advertisement information to the mobile device 200 (S1525). The mobile device 200 may display the received advertisement information in operation S1530. Alternatively, the server 400 may transmit the retrieved advertisement information to the external display apparatus 500 existing within the preset area with the mobile device 200 (S1535). The external display device 500 may display the received advertisement information in operation S1540. The server 400 may transmit the retrieved advertisement information to either the mobile device 200 or the external display apparatus 500, or may transmit the retrieved advertisement information to both the mobile device 200 and the external display apparatus 500. have.

The mobile device 200 may transmit the advertisement information received from the server 400 to the display apparatus 100 (S1545). The mobile device 200 and the display apparatus 100 may be connected by wire or wireless. In the case of a wireless connection, it can be connected using Bluetooth, Wi-Fi, etc. The display apparatus 100 displays the received advertisement information in operation S1550.

In FIG. 15, the advertisement information is described as an example. However, the advertisement information as the received additional information is one embodiment, and may be multimedia content, movie information, sports highlight information, and the like. In addition, it has been described that one server 400 receives location information and call history, extracts a call keyword, and retrieves advertisement information. However, the server 400 may extract the call keyword and then transmit the extracted call keyword and location information to another server so that the other server may retrieve the advertisement information.

16 is a timing diagram illustrating a method of providing an advertisement service according to another embodiment of the present invention. 16 illustrates an embodiment of extracting a keyword from a mobile device.

Referring to FIG. 16, the mobile device 200 receives a call signal from a communication counterpart device. The mobile device 200 transmits the received call contents to the display apparatus 100 (S1605). The mobile device 200 extracts a keyword from the contents of the call (S1610). The detailed process is the same as described in FIG. However, extraction of keywords is performed at the mobile device 200. When extracting a keyword from the mobile device 200, the user may set to extract only a specific keyword. For example, the keyword extraction setting may be set to extract only keywords for person names and place names, and may be set to extract only advertisement information. Alternatively, it may be set to extract all keywords, not specific keywords.

The mobile device 200 transmits the extracted keyword and location information to the server 400 (S1615). The location information in the mobile device 200 may be received through the GPS module. Alternatively, the display apparatus 100 may receive and transmit the data from the display apparatus 100.

The server 400 retrieves advertisement information from the extracted call keyword and the received location information in operation S1620. In this case, the server may be a search server that simply performs a search. The server 400 may transmit the retrieved advertisement information to the mobile device 200 (S1625). The mobile device 200 may display the received advertisement information in operation S1630. Alternatively, the server 400 may transmit the retrieved advertisement information to the mobile display 200 and the external display apparatus 500 existing within the preset area (S1635). The external display device 500 may display the received advertisement information in operation S1640. The server 400 may transmit the retrieved advertisement information to either the mobile device 200 or the external display apparatus 500, or may transmit the retrieved advertisement information to both the mobile device 200 and the external display apparatus 500. have.

The mobile device 200 may transmit the advertisement information received from the server 400 to the display apparatus 100 (S1645). The mobile device 200 and the display apparatus 100 may be connected by wire or wireless. In the case of a wireless connection, it can be connected using Bluetooth, Wi-Fi, etc. The display apparatus 100 displays the received advertisement information in operation S1650.

FIG. 17 is a diagram illustrating an example in which a mobile device and a display device are connected to a vehicle and used according to an embodiment of the present disclosure.

In FIG. 17, the display apparatus 100 and the mobile device 200 are connected in a vehicle by a wireless communication method. The display apparatus 100 and the communication apparatus 200 may be connected by wire. Although FIG. 17 illustrates a case in which the display apparatus 100 is built in a vehicle, the display apparatus 100 may be independently attached to and detached from the vehicle. In addition, although not shown in FIG. 17, the display apparatus 100 may be connected to the electronic control apparatus of the vehicle.

As shown in FIG. 17, when the display apparatus 100 and the mobile device 200 are connected, the mobile device 200 transmits the received call, message or data to the display apparatus. When the electronic control apparatus (not shown) is connected to the display apparatus 100, the electronic control apparatus transmits information about the vehicle to the display apparatus 100. The display apparatus 100 may display various data received from the mobile device 200 or the electronic control apparatus.

The display apparatus 100, the mobile device 200, or the electronic control apparatus detects the position of the vehicle using the GPS chip provided therein. That is, the location information of the display apparatus 100, the location information of the mobile device 200, or the location information of the electronic control apparatus may be regarded as the location of the vehicle.

The additional information retrieved from the server may be transmitted to the display apparatus 100 through the mobile device 200. The display apparatus 100 displays the received additional information. For example, if the advertisement information for the movie QQQ is retrieved from the server 400, the advertisement information of the movie QQQ is transmitted to the mobile device 200 and then to the display apparatus 100. The display device displays the advertisement information of the movie QQQ.

FIG. 17 illustrates an example in which one mobile device 200 owned by a driver and the display apparatus 100 are connected. However, when a plurality of passengers each own the mobile device, the display apparatus 100 uses a short range wireless communication method. The plurality of mobile devices in the vehicle may be connected to the display apparatus 100 by using the same. At this time, when the display device 100 receives the advertisement information, the display device 100 may transmit advertisement information to the plurality of mobile devices.

As described above, additional information such as advertisement information may also be transmitted to the external display apparatus 500.

18 is a diagram illustrating a service providing method including a plurality of terminal devices according to an exemplary embodiment.

According to FIG. 18 (1), there are five users near one external display device 500. The location information of the user may be retrieved using the received GPS information. In general, since the user carries the mobile device 200, the location information of the mobile device 200 is considered to be the same as the location information of the user.

According to (2) of FIG. 18, when a plurality of users call each other, the call history and location information of the plurality of users are received by the server 400. The server 400 groups users who will share the same external display apparatus 500 based on the received location information. The server 400 extracts a call keyword from the call history of the grouped users. The server 400 may extract priority call keywords for each user. In this case, separate advertisement information may be retrieved for each user. Alternatively, the server 400 may view call logs of all users as one and extract priority call keywords from call logs of a plurality of users. In this case, a plurality of advertisement information related to a call history of one user may be searched.

The server 400 may transmit the retrieved advertisement information to the mobile devices 200-1, 200-2, 200-3, 200-4, and 200-5 of each user, and the external display apparatus 500 near the plurality of users. ) Can transmit a plurality of advertisement information.

The transmission order of the advertisement information may be transmitted in the order of the advertisement information related to the call keyword having the highest priority, or may be transmitted in the order of the terminal device of the user who has completed the call the earliest.

Up to now, a description will be given of a process of easily transmitting a message by detecting current state information in the mobile device 200 and a process of receiving call information and advertisement information related to call keywords and location information by transmitting the call history and location information to the server 400. It was. Meanwhile, the mobile device 200 may be connected to the display apparatus 100, and the display apparatus 100 may be connected to an electronic control apparatus (not shown) in a vehicle. The display device 100 and the electronic control device may be connected in a controller area network (CAN) manner.

19 illustrates a data frame format of a controller area network (CAN) according to an embodiment of the present invention.

CAN refers to a vehicle network system for providing digital serial communication between various instrumentation control devices of an automobile. By replacing complex electrical wiring and relays of in-vehicle electronic components with serial communication lines, intelligence can be reduced to reduce weight and complexity. In addition, it is possible to diagnose an abnormality caused by electronic interference.

CAN is a standard for a multi-master broadcast serial bus for connecting electronic control units. Each node can send and receive messages, but can not send and receive messages at the same time. The message consists of an ID indicating the priority of the message with a maximum of 8 bytes. The devices connected to the CAN are generally sensors, actuators and other controls. These devices are not directly connected to the bus, but are connected through the host processor and the CAN controller.

The CAN protocol consists of a physical layer, a transfer layer, an object layer, and an application layer, as well as other network protocols. CAN can be set to two different message (or frame) formats. A general frame supports an identifier of 11 bits, and an extended frame supports an identifier of 29 bits.

Referring to FIG. 19, the CAN data frame format includes a 1-bit Start of frame field 1305, an 11-bit or 29-bit identifier field 1310, and a 1-bit remote transmission request. : RTR field 1315, 6-bit Control field 1320, 0-8 byte data field 1325, 15-bit Cyclic Redundancy Checking (CRC) field 1330, 1 A bit consists of a CRC delimiter field 1335, a 1-bit ACK slot 1340, a 1-bit ACK delimiter field 1345, and a 7-bit End of Frame field 1350.

Start of frame field 1305 indicates the start of frame transmission. The identifier field 1310 is for data representing message priority and is ordered according to the priority of the identifier field 1310 when two nodes try to transmit a message at the same time. When the RTR field 1315 is 0, the RTR field 1315 is dominant in the data frame, and when 1, the RTR field 1315 is inferior in the remote frame. The remote frame is a frame that the receiver outputs when requesting data to the transmitter.

The control field 1320 includes a 1-bit identifier extension bit (IDE) field, a 1-bit reserved bit field, and a 4-bit data length code field. The data field 1325 contains data to be transmitted. The CRC field 1330 checks an error by dividing it into bits of a predetermined section. If the ACK slot 1340 is 1, the transmitter sends a thirteen state.

The CRC delimiter field 1335, the ACK delimiter field 1345, and the End of Frame field 1350 should be one in thirteen states.

As described above, communication between the electronic control units is possible using the CAN, and status information of the vehicle can be transmitted to the display device 100 such as a head unit (H / U) of the vehicle.

Hereinafter, a flowchart of a service providing method will be described.

20 is a flowchart illustrating a service providing method of a display apparatus according to an exemplary embodiment.

The display apparatus communicates with the mobile device (S2010). The display device receives a call signal from the mobile device. It also requests the call or origination of the message to the mobile device. The display apparatus and the mobile device may be connected by wire or wireless.

In operation S2020, the display apparatus obtains a keyword included in the call content. The display device may obtain a keyword from the audio signal including the contents of the call, and convert the audio signal into text and then obtain the keyword from the converted text. In some cases, the display apparatus may receive and obtain a keyword extracted from a mobile device or a server.

The display apparatus displays additional information corresponding to the keyword (S2030). The display device searches for at least one of the storage unit, the mobile device, and the server. The searched additional information is displayed together with the keyword. The keyword may be a person's name, a place name, a movie, a time, an advertisement, and the like, and the additional information may be a phone number, a photo, an address, advertisement information, multimedia content, and the like. When one of the displayed additional information is selected, the display device may provide a corresponding service.

21 is a flowchart illustrating a service providing method of a mobile device according to an embodiment of the present invention.

The mobile device communicates with the display apparatus (S2110). The mobile device performs a call with the communication counterpart device in operation S2120. The mobile device receives a call signal from a communication partner device and transmits it to the display device. When a call connection is selected in the display device, the mobile device transmits the received call content to the display device.

The mobile device transmits the call content to the server to receive the advertisement information corresponding to the keyword included in the call content, and transmits the advertisement information to the display device (S2130). When the mobile device sends the call content to the server, the server may store the call content in the corresponding personal profile and extract the keyword from the call content. The server searches for the relevant additional information using the extracted keyword. The retrieved additional information is transmitted to the mobile device. The mobile device receives the advertisement information and transmits the advertisement information to the display device.

The service providing method of the display apparatus according to the above-described various embodiments may be implemented as a program and provided to the terminal device.

For example, a program for performing communication with a mobile device, acquiring a keyword included in the content of the call and displaying additional information corresponding to the keyword when a call is made in the mobile device; A stored non-transitory computer readable medium may be provided.

A non-transitory readable medium is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the apparatus. In particular, the various applications or programs described above may be stored on non-volatile readable media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM,

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

100: display device
200, 200-1, 200-2, 200-3, 200-4, 200-5: Mobile device
300: electronic control device 400: server
500: external display device
130: display unit 140, 230, 420: control unit
150, 210, 410: communication unit 220: call connection

Claims (15)

In a display device mounted on a moving object,
A communication unit for communicating with a mobile device;
A control unit acquiring a keyword included in the call content when a call is made in the mobile device; And
And a display unit configured to display additional information corresponding to the keyword. The method of claim 1,
The additional information includes advertisement information corresponding to the keyword,
Wherein,
When the server apparatus storing the advertisement database transmits the advertisement information corresponding to the keyword, the transmitted advertisement information is received through the mobile device,
The control unit,
And displaying the received advertisement information through the display unit. The method of claim 1,
The control unit,
And when the displayed additional information is selected, providing a service corresponding to the selected additional information. The method of claim 3,
The additional information,
At least one of place information, contact information, multimedia content, advertising information,
The control unit,
If the place information is selected, provide a route guidance service to the place information as a destination; if the contact information is selected, provide a telephone service for performing a telephone connection to the contact information; if the multimedia content is selected, the multimedia And a reproduction service for content, and when the advertisement information is selected, an advertisement service for displaying a screen including detailed advertisement information. The method of claim 1,
And a storage unit,
The control unit,
And display the additional information corresponding to the keyword from among information stored in at least one of a server apparatus, the mobile device, a communication counterpart making a call with the mobile device, and the storage unit. The method of claim 1,
The control unit,
And when the contents of the call of the mobile device are received through the communication unit, extracting and obtaining the keywords from the contents of the call, and searching for the additional information based on the acquired keywords. In a mobile device,
A communication unit configured to communicate with a display device mounted on the moving object;
A call connection unit for performing a call with a communication counterpart device; And
And a controller configured to transmit a call content to a server device to receive advertisement information corresponding to a keyword included in the call content, and to transmit the advertisement information to the display device. In the service providing system comprising a mobile device and a display device,
A mobile device for making a call with a communication counterpart device;
And a display device configured to communicate with the mobile device when the call is made in the mobile device, and to acquire a keyword included in the call content.
The display device includes:
And displaying additional information corresponding to the keyword. In the service providing method of the display device,
Communicating with the mobile device;
Acquiring a keyword included in the call content when a call is made in the mobile device; And
And displaying additional information corresponding to the keyword. 10. The method of claim 9,
The additional information includes advertisement information corresponding to the keyword,
Receiving the transmitted advertisement information through the mobile device when the server information storing the advertisement database transmits the advertisement information corresponding to the keyword; And
And displaying the received advertisement information. 10. The method of claim 9,
If the displayed additional information is selected, providing a service corresponding to the selected additional information. 12. The method of claim 11,
The additional information,
At least one of place information, contact information, multimedia content, advertising information,
Wherein the providing of the service comprises:
If the place information is selected, provides a route guidance service to the place information as a destination, and if the contact information is selected, provides a telephone service for performing a telephone connection to the contact information, and if the multimedia content is selected, the multimedia A service providing method of a display apparatus, comprising: providing a reproduction service for content, and displaying an screen including detailed advertisement information when the advertisement information is selected. 10. The method of claim 9,
Searching for the additional information corresponding to the keyword among information stored in at least one of a server device, the mobile device, a communication counterpart that makes a call with the mobile device, and a storage unit; and providing the service of the display device. Way. 10. The method of claim 9,
And when the contents of the call of the mobile device are received, extracting and obtaining the keywords from the contents of the call, and searching for the additional information based on the acquired keywords. In the service providing method of a mobile device,
Performing communication with a display device mounted on the moving object;
Performing a call with a communication counterpart device; And
Transmitting the call content to a server device to receive advertisement information corresponding to a keyword included in the call content, and transmitting the advertisement information to the display device.

Images