KR20190051215A - Terminal, Vehicle and method for controlling the vehicle - Google Patents

Abstract

A terminal of the present invention includes: a position receiving unit receiving a current position; a sound input unit inputting a voice uttered by a user; a control unit identifying the input user′s voice, identifying a task based on the identified voice, classifying a plurality of tasks by a category if having the plurality of tasks to group the same by a category, and searching a recommended destination based on the grouped category and the current position; a storage unit storing information of the searched recommended destination; and a communication unit performing communication with a vehicle and transmitting the information of the recommended destination, stored in the storage unit, to the vehicle. The vehicle of the present invention performs a navigation function based on the recommended destination received from the terminal.

Description

[0001] The present invention relates to a terminal,

The present invention relates to a terminal and a vehicle for performing a navigation function for recognizing a voice and guiding a route to a destination.

A vehicle is a machine that drives a wheel for the purpose of transporting a person or cargo, and moves on the road.

In addition to basic driving functions, these vehicles further include additional functions for user convenience such as audio function, video function, navigation function, air conditioning function, seat heating function, communication with external terminal, And a terminal for outputting operation information according to the operation.

The navigation function receives position information from a plurality of satellites through a plurality of global positioning systems (hereinafter referred to as " GPS "), calculates the position of the current vehicle, maps the calculated positions to a map ), Receives a destination from the user, performs a route search from the current position calculated according to a predetermined route search algorithm to the destination, displays the detected route on the map and displays the route to the destination It is a guide function.

A terminal having a navigation function can enlarge and display a graphic map so that a user can clearly recognize an entry road at an intersection where roads intersect when guiding the route to a destination, ) On one side and a graphical map on the other side showing an enlarged cross-point.

Also, the terminal having the navigation function requests the route search to the external server as the communication develops, guides the route to the destination by receiving the route that is searched from the server, and when the destination is changed during traveling, , Requests the server to re-search the route, receives a new route from the server, and guides the route to the new route.

In addition, the vehicle provides map information and location information in order to perform the navigation function, and guides the user through the provided map information and location information.

One aspect provides a terminal and a vehicle that recognizes a task based on a user's utterance, recommends a destination based on the recognized task and current position, and guides the route to the recommended destination.

Another aspect is to periodically confirm whether or not a user's task is fulfilled, and to provide a terminal and a vehicle that recommend a new destination based on whether or not the task is implemented and guide the route to a new destination.

A terminal according to one aspect includes a position receiver for receiving a current position; A sound input unit for receiving a voice uttered by a user; Recognizing a voice of an input user, recognizing a task based on the recognized voice, classifying a plurality of tasks by category and grouping them by category if a plurality of recognized tasks are present, and based on the grouped category and the current position, A search unit for searching for a search result; A storage unit for storing information of a searched recommendation destination; And a communication unit for communicating with the vehicle and transmitting the information of the recommendation destination stored in the storage unit to the vehicle.

The storage unit of the terminal according to one aspect includes: an indexing database storing indexing information; A subject database for storing subject information; A task database for storing task information; And further stores a category database for storing category information.

The control unit of the terminal according to one aspect recognizes the words based on the phonemes of the recognized voice and the indexing information stored in the indexing database and recognizes the subject of the user's utterance based on the recognized word and the topic information stored in the subject database A subject recognition unit for recognizing a task to be performed by the user based on the recognized subject and the task information of the task database; And a category recognition unit for recognizing the category of the recognized task based on the category information of the category database and for grouping the recognized task based on the recognized category by category.

The control unit of the terminal according to one aspect searches for a point of interest within a certain distance based on the current position and searches at least one recommended destination based on the searched point of interest and the grouped category and displays information of the searched at least one recommended destination And a recommendation destination search unit for outputting the recommendation destination.

The control unit of the terminal according to one aspect further includes a task fulfillment determination unit for confirming the current position and determining whether to perform the task based on the confirmed current position and the position of the recommendation destination.

The task fulfillment determination unit of the terminal according to one aspect further includes receiving settlement information from an external server and determining whether to perform the task based on the received settlement information.

The recommendation destination search unit of the terminal according to one aspect may further include searching for a new recommendation destination based on the confirmed current position and the grouped category when task failure information is received from the task fulfillment determination unit and outputting information of the searched new recommendation destination .

The recommendation destination searching unit of the terminal according to one aspect includes searching for a recommendation destination that can execute a plurality of tasks at one time if there are a plurality of recognized tasks.

The recommendation destination searching unit of the terminal according to one aspect includes searching for a recommendation destination that allows a plurality of tasks to be performed at a minimum number of destinations if there are a plurality of recognized tasks.

The recommendation destination searching unit of the terminal according to one aspect includes outputting information of a recommendation destination having a closest distance from a current position among a plurality of recommendation destinations, when the plurality of recommended destinations are searched.

The control unit of the terminal according to one aspect includes storing the information of the grouped category when the delay command of the task is received.

A vehicle according to another aspect of the present invention includes: a communication unit for performing communication with a terminal; A position receiving unit for receiving a current position; A control unit for generating a route from a current position to a recommendation destination and controlling an output of the generated route when the recommendation destination is received through the communication unit; The control unit includes a user interface for displaying a route, and when a new recommendation destination is received during driving, the control unit confirms the current position, generates a new route from the confirmed current position to the new recommendation destination, and controls the output of the generated new route .

A user interface of the vehicle according to another aspect receives the final destination, and the control includes generating a route connecting the current location, the recommendation destination, and the final destination.

The vehicle according to another aspect includes: a position receiving unit for receiving a current position; A sound input unit for receiving a voice uttered by a user; Recognizing a voice of an input user, recognizing a task based on the recognized voice, classifying a plurality of tasks by category and grouping them by category if a plurality of recognized tasks are present, and based on the grouped category and the current position, And performs a navigation function based on the retrieved reference destination information; And a user interface for displaying navigation information corresponding to the navigation function.

A vehicle according to another aspect includes an indexing database for storing indexing information; A subject database for storing subject information; A task database for storing task information; And a category database for storing category information.

The control unit of the vehicle according to the other aspect recognizes the words based on the phonemes of the recognized voice and the indexing information stored in the indexing database and recognizes the subject of the user's utterance based on the recognized words and the topic information stored in the subject database A subject recognition unit for recognizing a task to be performed by the user based on the recognized subject and the task information of the task database; And a category recognition unit for recognizing the category of the recognized task based on the category information of the category database and for grouping the recognized task based on the recognized category by category.

The controller of the vehicle according to another aspect searches for a point of interest within a certain distance based on the current position and searches for at least one recommended destination based on the searched point of interest and the grouped category and displays information of the searched at least one recommended destination And a recommendation destination search unit for outputting the recommendation destination.

The control unit of the vehicle according to another aspect further includes a task fulfillment determination unit for confirming the current position and determining whether to perform the task based on the confirmed current position and the position of the recommendation destination.

The task fulfillment determination unit of the vehicle according to another aspect further includes receiving the settlement information from the external server and determining whether to perform the task based on the received settlement information.

The recommendation destination search unit of the vehicle according to another aspect searches the new recommendation destination based on the confirmed current position and the grouped category when the task failure information is received from the task execution determination unit and outputs the information of the searched new recommendation destination .

The recommendation destination search unit of the vehicle according to another aspect includes retrieving a minimum number of recommendation destinations that allow a plurality of tasks to be performed at a minimum number of destinations if there are a plurality of recognized tasks.

The recommendation destination search unit of the vehicle according to another aspect includes outputting information of a recommendation destination closest to the current position among a plurality of recommendation destinations, when the plurality of recommendation destinations are searched.

The control portion of the vehicle according to the other aspect includes storing information of the grouped category when the delay command of the task is received.

The present invention recognizes only a task which is necessary information in a user's utterance, recognizes the category of the recognized task, and recommends at least one destination based on the recognized category and current position, thereby improving the quality of the navigation service to the destination .

In addition, the present invention can improve the convenience of the user by recommending a destination capable of executing a plurality of tasks in a minimum time in a minimum travel distance, and can minimize the task execution time of the user.

The present invention can continuously check whether or not a user performs a task on a destination recommendation based on the current location and payment history information of the card, and improve the route guidance performance by recommending a new destination when the task is not implemented.

The present invention can improve the quality of the terminal and the vehicle having the navigation function, thereby increasing the merchantability, further enhancing the satisfaction of the user, and improving the convenience of the user and the safety of the vehicle.

1 is an external view of a vehicle according to an embodiment.
2 is an internal view of a vehicle according to an embodiment.
3 is a control configuration diagram of a vehicle according to an embodiment.
4 is a detailed configuration diagram of a control unit of a vehicle according to an embodiment.
5 is an illustration of a database stored in a storage of a vehicle according to an embodiment.
6 is a control flowchart of a vehicle according to an embodiment.
FIGS. 7 to 12 are exemplary views of a route search to a recommendation destination of a vehicle and a recommendation destination of a vehicle according to an embodiment.
13 is a control configuration diagram of a terminal communicating with a vehicle according to another embodiment.
14 is a control flowchart of a terminal communicating with a vehicle according to another embodiment.
15 is a control flowchart of a vehicle according to another embodiment.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is an external view of a vehicle according to an embodiment, and FIG. 2 is an internal view of a vehicle according to an embodiment.

The vehicle 100 travels on the road by driving the wheels for the purpose of transporting people or cargo.

The vehicle 100 includes a body having a built-in and an exterior, and a chassis in which a mechanical device necessary for traveling to a remaining portion except for the vehicle body is installed.

1, the exterior 110 of the vehicle body includes a front panel 111, a bonnet 112, a roof panel 113, a rear panel 114, a trunk 115, front and rear right and left doors 116, And a window glass 117 provided on the left and right doors 116 so as to be openable and closable.

The exterior of the vehicle body further includes a filler provided at a boundary between the front panel, the bonnet, the roof panel, the rear panel, the trunk, and the window glass of the front and rear doors.

The exterior of the vehicle body further includes a side mirror that provides the driver with a field of view behind the vehicle 100. [

The enclosure of the vehicle body further includes an antenna module 118 for performing a wireless vehicle network (V2X: Vehicle to everything) such as communication (V2V) with other vehicles and communication (V2I) with the infrastructure.

2, the interior body 120 of the vehicle body includes a seat 121 on which an occupant sits, a dashboard 122, and a tachometer 120. The tachometer 120 includes a tachometer, a speedometer, a coolant thermometer, a fuel meter, (I.e., a cluster 123) in which a door open warning lamp, an engine oil warning lamp, and a fuel shortage warning lamp are arranged, and an air conditioner And a center fascia 124 in which an audio device is disposed.

The center fascia 124 is a part of the dashboard 122 located between the driver's seat and the passenger's seat. The center fascia 124 may include a head unit 125 for adjusting audio equipment, an air conditioner, and a heater, and may include a multi-terminal 126 for performing data communication between the vehicle and the user terminal 300 May be provided.

The multi terminal 126 includes a USB port and an AUX terminal and may further include an SD slot and may be disposed adjacent to the head unit 125 and may be disposed adjacent to the user interface 129, May be electrically connected to the user interface 129 and an external device via a connector or cable.

The external device includes a storage device, a user terminal 300, an MP3 player, etc., and the storage device includes a card-type memory and an external hard disk, and the user terminal 300 is a smart phone, a notebook, Wearable device and the like.

The vehicle 100 may further include an input unit 127 for receiving operation commands of various functions.

The input unit 127 may be provided in the head unit 125 and the center pacea 124 and may include at least one physical button such as an operation on-off button for various functions, a button for changing setting values of various functions can do.

The input unit 127 may receive the navigation function, may receive the final destination information from the user when performing the navigation function, and may receive any one of the recommended destinations among the destinations recommended by the control unit .

The input unit 127 includes a jog dial (not shown) or a touch pad (not shown) for inputting a command for moving a cursor displayed on the display unit of the user interface 129 and a command for selecting a button displayed on the display unit of the user interface 129, As shown in FIG.

Here, the jog dial or the touch pad may be provided in the center fascia 124.

The vehicle 100 may further include a display unit 128 provided in the head unit 125 for displaying information on functions performed in the vehicle and information input by the user.

The user interface 129 may be embedded in a dashboard or embedded in a dock.

The user interface 129 may output not only navigation functions but also images and sounds of information received from an external device or information stored in a storage device and may also perform an audio function of outputting audio signals transmitted from the outside .

The user interface 129 may include a display panel as a display unit, and may further include a touch panel as an input unit.

That is, the user interface 129 may include only a display panel, and the display panel may include a touch screen integrated with the touch panel.

When the user interface 129 is implemented using only a display panel, a button displayed on the display panel can be selected using the input unit 127 provided in the center fascia.

When the user interface 129 is implemented as a touch screen, a user's operation command can be input directly through the touch panel.

As such, the user interface 129 may include a display unit, and may further include an input unit.

The vehicle 100 further includes a position receiving unit 130 for obtaining a current position of the vehicle so as to perform a navigation function using the user interface 129. [

Here, the position receiving unit 130 includes a GPS receiver, and receives position information provided from a plurality of satellites to obtain the current position of the vehicle.

The vehicle 100 includes a communication unit (not shown) for performing communication between various internal electronic devices, communication with the user terminal 300 and communication with the storage device, and communication with an external device via the antenna module 118 140).

The external device may include at least one of the other vehicle, the server, and the infrastructure.

The server may be a traffic information providing server, a credit card company server, or a cash receipt server of the National Tax Service.

The vehicle further includes a shift lever provided at the center pedestal 124 for receiving an operation position and a parking button (EPB button) located near the shift lever and receiving an operation command of an electronic parking brake device (not shown).

The vehicle frame includes a power generating device, a power transmitting device, a traveling device, a steering device, a braking device, a suspension device, a transmission device, a fuel device, and front and rear left and right wheels 131 and the like.

The vehicle 100 includes a steering wheel 132 of the steering device for adjusting the direction of travel, a brake pedal 133 that is pressed by the user in accordance with the braking will of the user, And an accelerator pedal 134 (see Fig. 2).

The vehicle 100 may further include a start button for inputting an operation command to the start motor (not shown). That is, when the start button is turned on, the vehicle 100 operates the starter motor (not shown) and drives the engine (not shown) that is the power generator through the operation of the starter motor.

The vehicle 100 further includes a battery (not shown) electrically connected to the user interface, an audio device, an indoor unit, a starter motor, and various other electronic devices to supply driving power. Such a battery performs charging using power from the self-generator or the engine while driving.

In addition, the vehicle 100 may be a hybrid vehicle or an electric vehicle.

FIG. 3 is a control configuration diagram of a vehicle according to an embodiment, and FIG. 4 is a detailed configuration diagram of a control section of a vehicle according to an embodiment.

The vehicle 100 includes a user interface 129, a position receiving unit 130, a communication unit 140, a sound input unit 150, a control unit 160, a storage unit 170, and a sound output unit 180.

The user interface 129 receives operation commands and input information from a user and displays operation information on the function being executed.

The user interface 129 may include an input unit 129a and a display unit 129b. The present embodiment will be described in the case where the user interface 129 is a touch screen in which a touch panel, which is an input unit 129a, and a display panel, which is a display unit 129b, are integrated.

The input unit 129a receives an on / off command of at least one function among a plurality of functions, and receives an operation command for at least one input function.

The input unit 129a receives the information of the final destination when the operation command of the navigation function is inputted and can transmit the input information of the final destination to the control unit 160. The input unit 129a may transmit information of any one of at least one recommended destinations displayed on the display unit 129b The recommendation destination may be selected and the information of any one selected recommendation destination may be transmitted to the control unit 160. [

Here, the information of the final destination and the information of one recommended destination may be any one of a building name of a destination, a telephone number of a destination, an address of a destination, and a company name of a destination.

The input unit 129a transmits the input information input by the user and the selected selection information to the control unit 160. [

The display unit 129b displays operation information on the function being executed and displays selection information selectable by the user as a button or an icon.

The display unit 129b displays the video information of the navigation information.

The display unit 129b displays a Korean / English character button, a number button, a special character button, and the like for inputting a destination, and can display a route guide button for a route guide command.

The display unit 129b displays information on the recommendation destination recommended by the control unit 160. [

The display unit 129b displays a guidance message and a button or an icon having information of an operation command.

The display unit 129b may display information related to a telephone call, display an image of the content, display information related to music playback, or display an external broadcast signal as an image.

The position receiving unit 130 obtains the current position of the vehicle and transmits the obtained current position to the communication unit 150. [

The position acquiring unit 130 includes a GPS receiver.

The GPS (Global Positioning System) receiver includes an antenna for receiving signals of a plurality of GPS satellites, software for acquiring the position of the vehicle using distance and time information corresponding to the position signals of the plurality of GPS satellites, And a signal output unit for outputting position information.

The antenna of the GPS receiver may be provided inside the antenna module 118.

The communication unit 140 communicates with the external server 200 and the terminal 300.

Here, the external server may be a server of a credit card company, or a cash receipt server of the Internal Revenue Service.

The communication unit 140 can perform wired / wireless communication.

The communication unit 140 may include CAN communication, Wi-Fi communication, Bluetooth communication, and USB communication.

The communication unit 140 may be a wireless broadband, a global system for mobile communication (GSM), a code division multiple access (CDMA), a wideband code division multiple access (WCDMA), a universal mobile telecommunications system (UMTS) Access, and Long Term Evolution (LTE).

The sound input unit 150 receives the user's voice and transmits the voice information corresponding to the input voice to the control unit 160.

The sound input unit 150 includes one microphone or two or more microphones. Here, one microphone may be directional. And two or more microphones may be implemented in a microphone array.

More specifically, the sound input unit 150 collects sound, detects a sound wave of the collected sound, generates an electric signal corresponding to the sound wave, and transmits the generated electric signal to the controller 160.

That is, the sound input unit 150 transmits an electric signal corresponding to the collected sound to the control unit 160. [ Where the electrical signal may be a voice signal.

The voice signal may include voice information.

The control unit 160 controls the operation of a plurality of functions based on the input information input from the input unit 129a.

The control unit 160 can control the voice recognition function and the navigation function.

The control unit 160 confirms the final destination information input to the input unit 129a when the navigation function is performed, generates a route from the current location to the destination based on the current location information, the destination information, and the map information, Generates navigation information based on the map information and the information of the route, and controls the output of the video information and the sound information of the generated navigation information.

The control unit 160 calculates a frequency characteristic of the sound signal (i.e., speech signal) input to the sound input unit 150 on a frame-by-frame basis to extract a feature vector included in the speech signal, A phoneme lattice is formed by recognizing phonemes in a voice signal by performing phoneme recognition based on the phoneme in comparison with a model and a phoneme model, and a phoneme lattice formed by the phoneme lattice formed by the phoneme lattice formed by the phonetic lattice formed and the voice uttered by the user based on the indexing information stored in the indexing DB And recognizes the character corresponding to the character.

The control unit 160 calculates the frequency characteristics of the voice signal input to the sound input unit 150 on a frame-by-frame basis to extract a feature vector included in the voice signal and compares the vector sequence of the extracted feature vector with the previously stored acoustic model and phoneme model It is also possible to recognize a phoneme in a voice signal and to recognize a word corresponding to the voice uttered by the user using the recognized phoneme and the word model.

The control unit 160 recognizes the subject corresponding to the user utterance based on the recognized character, recognizes the task based on the recognized subject, recognizes the category corresponding to the recognized task, Based on at least one recommendation destination to be recommended to a user and controls output of information of at least one recommendation destination searched.

The control unit 160 searches for a POI (Position of Interest) based on the information of the current position received by the position receiving unit 130. Here, the point of interest may include information of the position of the building around the road.

That is, the controller 160 collects various pieces of local information on the map around the point of interest, confirms various information targeted by the location-based service, and searches for a recommended destination corresponding to the recognized category in various pieces of identified information.

The control unit 160 compares the current position with the recommended position and determines whether the vehicle has passed the recommendation destination. If it is determined that the recommendation destination has passed the recommendation destination, the control unit 160 searches the interest point based on the current position, And searches the recommendation destination again based on the category that has been selected.

That is, if it is determined that the route is out of control, the control unit 160 searches the recommendation destination again based on the current location and the recognized category.

The control unit 160 may receive the payment information from the server 200 or the terminal 300 and may determine whether the vehicle has performed the task at the recommendation destination based on the received payment information and the information of the recommendation destination.

The control unit 160 may periodically check whether payment information has been received from the server 200 or the terminal 300. [

The controller 160 may determine whether the vehicle has arrived at the recommended destination by comparing the current position with the recommended position.

The control unit 160 determines whether there is a previously stored recommended destination when the startup is on, generates a route to the recommended destination if there is a previously stored recommended destination, controls the output of the generated route, It creates a route to the destination entered by the user and controls the output of the generated route.

The control unit 160 controls the output of a message inquiring whether or not to select a recommendation destination, controls the output of a message inquiring whether or not a recommendation destination will be visited in the future if a selection command for the recommendation destination is not input, When the selection command of the recommendation destination is input, the information of the recommendation destination is stored. If the recommendation destination selection command is input, the path from the current position to the recommendation destination is generated and the output of the generated path is controlled.

If the selection instruction for the recommendation destination is not input, the control unit 160 receives the visit date and time of the recommendation destination through the input unit or the sound input unit, and generates a live route to the recommendation destination based on the received visit date and time It is also possible to control the output of the path.

In other words, the control unit 160 generates a route to a recommendation destination if the position of the vehicle when the visit date and time is the same as the position of the vehicle when the recommendation destination is searched. If the two positions are different, The recommendation destination can be searched again based on the current position of the recommendation destination.

The control unit 160 can search for the recommendation destination based on the information of the speech uttered by one user and search for the recommendation destination based on the information of the utterance uttered by two or more users.

When two or more users are speaking, the control unit 160 may recognize only the voice corresponding to the pre-registered voice among the voices input to the sound input unit to search for the recommended destination.

The control unit 160 sets a recommendation destination as a transit destination and generates a route that reaches the final destination via the transit route from the current location if the recommended destination exists beforehand when the startup is on and the final destination is input by the user It is also possible to control the output of the generated path.

The detailed configuration of the controller 160 will be described with reference to FIG.

The control unit 160 includes an indexing unit 161, a subject recognition unit 162, a category recognition unit 163, a recommended destination search unit 164, a task performance determination unit 165, and an output unit 166.

The indexing unit 161 receives voice information and performs phoneme-based voice recognition on the received voice information to form a phoneme lattice.

The subject recognition unit 162 recognizes the character corresponding to the voice uttered by the user by comparing the phoneme grating formed and the phoneme grids in the indexing information of the indexing database DB, and recognizes the character corresponding to the voice uttered by the user based on the recognized character I am aware of the theme.

For example, the subject recognition unit 162 recognizes the word " buy ", " buy ", " needed " have.

Also, the subject recognition unit 162 is a word of a place name corresponding to anywhere in the place where to go, where long, what to do, what not, what is broken, what is broken, etc., and a word And recognizes that the subject is a place to visit a specific place by recognizing the words of the verb such as go, do, do not, break, and have a network.

The subject recognition unit 162 recognizes a task corresponding to a voice uttered by the user based on the recognized subject and the task stored in the task database, and outputs the recognized task.

Here, the task may include an article name to be purchased, a place name to be moved, and an article name to be repaired.

The category recognition unit 163 recognizes the category corresponding to the recognized task based on the category database.

The category recognition unit 163 can group tasks by category by dividing a plurality of tasks into categories.

For example, the category recognizing unit 163 may group the apples, tangerines, and pears into fruit categories if a plurality of tasks are apples, tangerines, pears, toilet paper, toothbrushes, and group toilet paper and toothbrushes into categories of sanitary goods do.

The recommended destination searching unit 164 searches for a point of interest based on the current position received from the position receiving unit and searches for at least one recommended destination to be recommended to the user based on the detected interest point and the recognized category and outputs the retrieved recommended destination .

Here, the recommendation destination may be a place where a plurality of tasks can be performed in a minimum place. For example, if the task is to buy apples, pears, toilet paper, search for fruit shops, supermarkets, marts, etc. that are within a certain distance from the current location as recommended destinations, It is determined as the recommendation destination, and the nearest mat from the searched marts is determined as the recommendation destination, and the determined mart can be output as the recommendation destination.

The recommendation destination searching unit 164 checks whether or not the task is implemented. If it is determined that the task has not been executed, the recommendation destination searching unit 164 searches for a new recommendation destination based on the current location and the recommendation destination information received in the location receiver, and outputs the found recommendation destination.

That is, if it is determined that the user has not performed the task, the recommendation destination searching unit 164 searches the point of interest based on the current position and searches for at least one recommended destination to be newly recommended to the user based on the detected point of interest and the recognized category And controls the output of the searched new recommendation destination. If it is determined that the user has performed the task, the user is requested to input a new destination.

When the input information is input by the user when the plurality of recommendation destinations are searched, the recommendation destination search unit 164 confirms any one recommendation destination corresponding to the input information among the plurality of recommendation destinations, It is also possible to output it to the interface 129.

The task execution judging unit 165 judges whether or not the user fulfills the task based on the current position and the position of the recommendation destination received from the position receiving unit and outputs information on whether or not the task is implemented to the recommendation destination searching unit 164.

The task execution determiner 165 receives the payment information from the server or the terminal, and determines whether or not the user performs the task based on the received payment information and the final destination information.

For example, the task execution determiner 165 determines that the task has been fulfilled if the address corresponding to the current location in the vehicle's parking position is the same as the address of the destination, and if the mutual is the same as the recommendation destination It is judged that the task has been implemented.

Here, the payment information may include information on the card settlement, and may include information on the cash settlement.

The task execution determiner 165 may periodically determine whether or not the user is performing a task.

The output unit 166 outputs information of at least one recommended destination to the user interface 129. [

Here, the information of the recommendation destination may include an address, a business name, a telephone number, and the like.

The storage unit 170 stores map information, stores information of a final destination input by the user, stores information of at least one recommended destination generated by the control unit, and further stores music information, content information, and the like .

The storage unit 170 may include a plurality of databases for storing various kinds of information required for voice recognition and searching for a recommendation destination.

The plurality of databases includes an indexing database (DB) 171, a subject database (DB) 172, a task database (DB) 173 and a category database (DB)

An example of such a plurality of databases will be described with reference to FIG.

The indexing database (DB) 171 stores the indexing information.

The indexing information is divided indexing information including a phoneme grid generated in units of a speech interval time limit.

The indexing information includes the number of frames, the number of phonemes, the feature vector, the observation probability value of each phoneme, the time stamp, the phoneme string, and the duration of each phoneme. Here, the duration of each phoneme may be the duration of the speech signal, for example, the duration calculated from the start and end positions of the speech signal and the start and end positions.

The subject database (DB) 172 stores subject information corresponding to each word.

As shown in FIG. 5A, the subject database (DB) 172 includes words associated with a purchase subject of an article requiring purchase of the article and words related to a visiting subject at a place where a specific place is required to be visited Store topic information.

For example, a word associated with a purchase subject of an article may include a verb's word such as an article name, a buy and a need, and a word related to a visiting subject of a place may include a place name, , Not, fail, have, have, etc.

The task database (DB) 173 stores task information such as a name of a subject that is a subject of a subject. For example, the task database (DB) 173 can store the name of an article to be purchased, the name of a place to visit, and the like as task information.

As shown in FIG. 5 (b), the task database for storing the name of the article to be purchased as task information includes names of apples, toothpaste, noodles, toilet paper, Information can be stored.

As shown in FIG. 5C, the task database for storing the name of a place to visit as task information includes a name of a hospital A, a hospital B, a government office A, a baseball field, a repair shop A, and various other places Can be stored as task information.

The category database (DB) 174 stores information of a plurality of categories.

That is, the plurality of categories of the category database (DB) 174 stores similar articles and articles having the same meaning in the same category, and stores similar places and places having the same meaning in the same category.

As shown in FIG. 5D, the category database (DB) 174 stores categories of fruits, vegetables, processed food, confectionery, fish and shellfish, meat, sanitary articles and various other items, , Tax offices, parks, garages, and various other places.

For example, the category database (DB) 174 stores apples, pears, and mandarins as fruit categories, par, garlic, onions as vegetable categories, and hospitals A, B, C, , And store the government offices A, B, C, and D in the government office category.

The storage unit 170 may be a nonvolatile memory device such as a cache, a read only memory (ROM), a programmable ROM (PROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM) But is not limited to, a volatile memory device such as a RAM (Random Access Memory) or a storage medium such as a hard disk drive (HDD) and a CD-ROM.

The storage unit 170 may be a memory implemented in a chip separate from the processor described above in connection with the controller 160, and may be implemented as a single chip with the processor.

The sound output unit 180 outputs the sound information of the navigation information, amplifies the sound signal in the received sound information by a predetermined magnitude, and outputs the amplified sound signal.

In other words, the sound output unit 180 may output the path and running information as sound when the navigation function is performed, output the sound information of the content or the external broadcast, or output the sound information such as the music and the radio selected by the user .

The sound output unit 180 may output the path and driving information as sound when the navigation function is performed, and may output the music and the sound of the image selected by the user.

The sound output unit 180 may output at least one recommendation destination, output a sound to the recommendation destination selected by the user as a sound, or output a sound inquiring whether the recommendation destination is selected.

The sound output unit 180 is also capable of outputting the voice of the calling party when in the telephone communication mode.

The sound output unit 180 is a speaker, and can be positioned in front of and behind the vehicle.

The sound output unit 180 may output voice guidance information and a beep sound during voice recognition.

Fig. 6 is a control configuration of a vehicle according to an embodiment, which will be described with reference to Figs. 7 to 12. Fig.

When the vehicle is turned on (401), the vehicle supplies electric power to various electronic devices.

That is, the vehicle activates operations of a sound input unit, a control unit, a sound output unit, a user interface, and the like for performing a voice recognition function and a navigation function.

The vehicle receives (402) a sound due to an ignition of a passenger boarding the vehicle through a sound input unit.

The vehicle detects a sound wave of the collected sound, generates an electric signal corresponding to the sound wave, calculates a frequency characteristic of the generated electric signal frame by frame, extracts a feature vector included in the voice signal, Is compared with a previously stored acoustic model and a phoneme model to recognize phonemes in the electrical signal.

The vehicle recognizes phonemes based on the recognized phoneme to form a phoneme lattice and recognizes the phoneme lattice formed and the character corresponding to the voice uttered by the user based on the indexing information stored in the indexing database 171.

The vehicle recognizes (403) a subject corresponding to the voice uttered by the user based on the recognized character and the subject information stored in the subject database (172).

For example, the vehicle can recognize that the article is a purchase subject by recognizing the word of the article name corresponding to something in what to buy, what is needed, and the words of the verb such as buy and need.

Also, the vehicle has to go where, what to do for a long time, what to do, what is not, what is broken, what is broken, etc., It is possible to recognize that it is a place to visit a place to visit a specific place by recognizing the words of the verb such as,

The vehicle recognizes (404) the task based on the recognized subject and the task information stored in the task database, and recognizes (405) the category corresponding to the recognized task based on the category information stored in the category database.

Here, the task may include an article name to be purchased, a place name to be moved, and an article name to be repaired.

More specifically, the vehicle can group tasks by dividing a plurality of tasks into categories.

For example, if a plurality of tasks are apples, tangerines, pears, toilet paper, or toothbrushes, the vehicle groups apples, mandarins, and pears into fruit categories, and groups toilet paper and toothbrushes into sanitary items.

The vehicle confirms the current position received at the position receiving unit 130 and searches (406) a position of interest (POI) based on the position information of the identified current position. Here, the point of interest may include information of the position of the building around the road.

The vehicle searches 407 for recommendation destinations to be recommended to the user based on the recognized category and the current position, and outputs 408 the information of at least one recommendation destination among the retrieved recommendation destinations through the user interface 129.

For example, when the vehicle has a plurality of tasks and a plurality of recommendation destinations are searched, at least one place that allows a plurality of tasks among a plurality of recommendation destinations to be performed in one place or at a minimum is referred to as a recommendation destination And output it via the interface 129.

The vehicle confirms the input information input to the input unit (409). If the input information is the recommendation destination selection information, the vehicle generates a route from the current position to the recommendation destination, and performs guidance to the generated route (410).

As shown in FIG. 7, when the user utters 'oi, kangbang, or somen', the vehicle recognizes the task of 'purchase of cucumber, goongbang and somen', and the category of cucumber (vegetables) Processed food), and the category of the surface (processed food).

The car recognizes the cucumber as a vegetable category, and recognizes it as a processed food category.

Then, the control unit of the vehicle searches all of the searched points of interest for selling vegetables and processed foods as recommendation destinations, confirms the recommendation destinations from which all three of the searched recommendation destinations can be purchased, Through the user interface, and outputs a query as to whether to set the recommended destination identified through the user interface as the destination of the navigation function.

That is, the control unit of the vehicle can output the recommendation destination in which the most categories are matched by matching the category task and the recommendation destination.

In other words, the vehicle can buy all of the cucumber, bonbang and somen from 'Mart A' through the user interface. Would you like to set Mart A as your destination? Y / N '.

The vehicle recognizes the user's voice and sets the recommendation destination as a destination of the navigation function when a voice of 'set up' by the user is ignited.

If the 'Y' button is selected through the input unit, the vehicle is set as the destination of the navigation function and a message for confirming the destination setting ('Mart A is set as a recommendation destination') And guides the route from the current location to the destination.

In addition, when a plurality of recommendation destinations capable of performing at least one task are searched, the vehicle may output information on a recommendation destination having the closest distance from the current position through the user interface 129.

For example, the vehicle searches all of the points of interest that have been searched for vegetables (cucumbers) and processed food (go-bangs, small noodles) as recommendation destinations, identifies recommendation destinations where all three of the recommended destinations can be purchased , And if the plurality of confirmed recommended destinations are plural, the recommended destination having the closest distance from the current location among the plurality of recommended destinations can be outputted.

If the vehicle is 1km away from Mt A and the distance to Mt B is 3km, it is decided to use Mt A as a recommended destination. Then, through the user interface, 'Ctu, All are available for purchase. Would you like to set Mart A as your destination? Y / N 'can be displayed.

It is also possible for the vehicle to output the destination with the shortest travel time to the recommendation destination.

In addition, when a plurality of recommendation destinations are searched in the state that the final destination is input by the user, the vehicle can also output a recommendation destination located on the route from the current location to the final destination among the plurality of recommendation destinations.

For example, when a vehicle is located on a route to a final destination, both the recommended destinations Mart A and B can output Mart A and Mart B to a recommendation destination through a user interface.

Also, if there are a plurality of recommended destinations on the route from the current location to the final destination, the vehicle can also output the recommended destination having the closest distance from the current location among the plurality of recommended destinations on the route.

For example, if the vehicle is located on the route to the final destination of both the recommended destinations Mart A and Mart B, the Mart A is 2 km away from the current location, and Mart B is 3 km away, Mart A is set as the destination of the navigation function .

The vehicle may also output information on the searched recommendation destinations through the user interface and select any one of the searched recommendation destinations from the user.

As shown in FIG. 8, when the user utters 'toilet paper and bread loose before going home', the vehicle sets 'home' as the final destination, recognizes the subject of purchase of the article, Purchase "task, recognize the category of toilet paper (sanitary article), and the category of bread (confectionery).

Then, the control unit 160 of the vehicle searches all of the searched points of interest for selling sanitary goods and confectionery as a recommendation destination, confirms a recommendation destination where both of the searched recommendation destinations can be purchased, Outputs information on the destination via the user interface, and outputs a query as to whether to set the recommended destination identified through the user interface as the destination of the navigation function.

In other words, the vehicle is located in the user interface 'at the current location, 2m away from Mart A, and 3km away from Mart B. Mart A is in a position away from the home route from its current location, and Mart B is located on the route from home to the current location. Mart A, Mart B, please set your destination. '

When the user selects one of the recommendation destinations 'Mart A' and 'Mart B' by the user, the selected recommendation destination is set as a destination of the navigation function and guides the route from the current location to the destination.

In addition, the vehicle will display a message to confirm destination setting ('I set up a destination for Mart A as a recommended destination.') And guide you through the route from your current location to your destination.

In this way, when a plurality of recommendation destinations are searched in the state where the final destination is input by the user, the vehicle can be searched for a recommendation destination located on the route from the current position to the final destination, and the searched recommendation destination can be output through the user interface Do. In this case, the vehicle may request the user to select at least one recommended destination from among a plurality of recommended destinations if the recommended destination is a plurality of outputted ones. If at least one recommended destination is selected by the user, the selected recommended destination is set as a via , And a route having a waypoint can be generated.

The vehicle confirms the task execution information (411) while guiding the route to the recommendation destination, and determines whether or not the recommendation destination has arrived by judging whether to perform the task based on the confirmed task execution information (412).

Here, the task fulfillment information may include position information of the current position, position information of the recommendation destination, mutual information of the recommendation destination, telephone number information, and payment information.

More specifically, the vehicle checks the position information of the current position and the position information of the recommendation destination received by the position receiving unit 130, determines whether the position information of the current position is the same as the position information of the recommendation destination, And the position information of the recommendation destination are the same, it is judged that the user fulfills the task.

That is, the vehicle can determine whether the user has visited the recommendation destination from the position information of the current position and the position information of the recommendation destination.

Also, the vehicle confirms at least one of the mutual information and the telephone number of the payment information received from the server 200 or the terminal 300, and recommends the recommendation based on the mutual information of the at least one payment information and the recommendation destination, It is possible to determine whether the user has performed the task at the destination. That is, the vehicle can determine whether the user has purchased the item from the payment information.

Further, the vehicle can determine whether the user has visited the recommendation destination and purchased the item from the comparison information of the position information of the current position and the position information of the recommendation destination and the payment information.

When it is determined that the user has performed the task (412), the vehicle is determined to have reached the recommendation destination, and the route guidance is terminated (413).

On the other hand, if the vehicle is judged to be a task failure, it searches the recommendation destination based on the current position and the recognized category.

More specifically, the vehicle identifies the current location received at the location receiver, searches (414) a point of interest (414) based on the identified current location, and provides a new recommendation destination (415) and outputs (416) at least one new recommendation destination among the retrieved recommendation destinations through the user interface.

The vehicle then creates a route from the current location to the new referral destination and guides the route to the generated route (417).

The vehicle confirms the task fulfillment information while guiding the route to the new destination, and determines whether or not the task is fulfilled based on the confirmed task fulfillment information. This process is the same as that described above, so a detailed description will be omitted.

In addition, when a plurality of recommendation destinations for performing a plurality of tasks are searched, the vehicle sets a route from a recommendation destination having the closest distance from the current position, re-searches a recommendation destination capable of performing another task, You can set the route to the referral destination.

Will be described with reference to Figs. 9 to 11. Fig.

As shown in FIG. 9, the user needs' a painkiller. The vehicle recognizes the task of 'buying a painkiller' and 'visiting a workshop', and recognizes the category (medicine) of the painkiller, and the category of the breaker (repair shop).

That is, the control unit of the vehicle sells the analgesic agent among the searched points of interest, searches all the places for repairing the brakes and the like as recommendation destinations, confirms the recommendation destinations that can perform both of the searched recommendation destinations, And outputs a query as to whether to set the recommended destination identified through the user interface as the destination of the navigation function.

In other words, the vehicle can use the user interface to take the painkillers from the pharmacy inside 'Mart A', and replace the brakes, etc., at the workshop in Mart A. Would you like to set Mart A as your destination? Y / N '.

The vehicle recognizes the user's voice and sets the recommendation destination as a destination of the navigation function when a voice of 'set up' by the user is ignited.

Also, if the 'Y' button is selected through the input section, the vehicle is set as the destination of the navigation function, and a guidance message for confirming the destination setting ('Mart A is set as the destination and the route will be displayed') is displayed And guides the route from the current location to the destination.

The vehicle compares the current position of the vehicle with the current position of the vehicle during the running or the start-off, determines whether the vehicle arrives at the destination and executes the task, and checks the payment information to determine whether the user has performed the task.

As shown in FIG. 10, when the vehicle judges that the vehicle is traveling past the destination, it passes 'Mart A' through the user interface. I will search for other recommended destinations'.

At this time, the control unit of the vehicle confirms the current position of the vehicle, searches for a new recommendation destination based on the recognized position information of the current position and the recognized category (medicine, workshop), and outputs information about the recommended recommendation destination.

If it is determined that the vehicle can not simultaneously perform the purchase of the analgesic agent and the visit to the repair shop for repairing the brake, etc., the information about the recommendation destination for purchasing the analgesic agent and the recommendation destination for visiting the repair shop is output through the user interface. Outputs the distance to each recommendation destination together, and prompts the user to select a destination.

It is also possible for the vehicle to automatically set a recommendation destination closest to the current position among the plurality of recommendation destinations as a destination of the navigation function.

When the vehicle receives the voice "Select pharmacy A", pharmacy A is set as the destination of the navigation function, message indicating that pharmacy A is set as the destination and a message for route guidance are displayed, and the route from the current location to the destination And guides the route through the generated route.

It is also possible for the vehicle to output a message displayed through the user interface through a sound output unit.

The vehicle compares the current location with the location of the pharmacy A, and if it is determined that the vehicle has arrived at the pharmacy A and fulfilled the task of purchasing the painkiller, it confirms the current location of the vehicle, And then outputs information about the recommended destination that has been searched.

As shown in FIG. 11, when the vehicle arrives at the pharmacy A and it is determined that the task for the purchase of the painkiller has been performed, query information for the visit to the workshop, which is the remaining task, is output through the user interface. When the user visits the workshop, Retrieve recommendation destinations for workshop visits based on current location and recognized categories.

It is also possible for the vehicle to automatically search for recommended destinations for workshop visits.

When a plurality of recommendation destinations (i.e., workshops) are searched, the vehicle may display a distance from the current position to a plurality of recommendation destinations searched through the user interface, and request the user to select one recommendation destination.

The vehicle sets a route to a selected recommendation destination when a recommendation destination of a plurality of recommendation destinations (i.e., workshop) is selected by the user, displays a recommendation destination setup message and a route guidance message through the user interface, Guide the path to the path.

As shown in FIG. 12, when the user utters "I have to buy apples and pears and my fingers are hurt", the vehicle recognizes the task of "purchase of apples and pears" and "visit of orthopedic surgeons to the fingers" Recognize tasks, recognize categories of apples and pears (fruit), and orthopedic categories (hospitals).

The control unit of the vehicle searches all of the searched points of interest to sell the fruits to the recommended destinations, searches the orthopedic surgeries to all the recommended destinations, purchases all the recommended searched apples and pears, And identify the recommendation destination that can carry out all the visits of the user.

When it is determined that there is no recommended destination for both fruit purchase and orthopedic visit, the vehicle displays the distance from the current position to each recommendation destination, and when the distance to the different recommendation destinations is the same, Can be output together.

In addition, the vehicle can select a task to be performed first among a fruit purchase task and an orthopedic visit task, and it is also possible to display a distance from a recommendation destination of a task to be performed first to a recommendation destination of a task to be performed next , It is also possible to display service information based on the status of the user.

It is also possible for the vehicle to select a task to be performed first among the purchase task of the fruit and the visiting task of the orthopedic surgeon.

In addition, the vehicle is set as a destination to which the recommendation destination corresponding to the purchase task of the fruit and the recommended destination corresponding to the visiting task of the orthopedic surgery is one to be moved first, and the user is selected for the plurality of recommendation destinations It is also possible to receive.

The user interface of the vehicle is as follows: 'The distance from the current position to the orthopedic A is 1 km (west), the distance to the green shop is 1 km (north), the distance to Mart A is 2 km (east) The distance from orthopedic surgery A to mart A is 3 km. It is mart A where delivery is possible. Please select your destination. And a shop / mart A '.

The vehicle generates a route from the present position to the orthopedic surgeon A when a voice for the user's utterance "visit orthopedic surgery A first and go to the mart A" is generated, and a guidance message for destination setting Displays a guidance message for route creation, and guides the route through the generated route.

The vehicle compares the present location of the vehicle with the destination location to determine whether the vehicle has arrived at the destination and fulfilled the task and also confirms the payment information to determine whether the user has fulfilled the task, A route from the position of the orthopedic surgeon A (i.e., the current position of the vehicle) to the mart A is generated, a guidance message for the destination setting and a route creation message is displayed through the user interface, To guide the road.

Thus, after visiting the orthopedic surgery A, the vehicle selects one of the recommendation destinations to be visited next from the user, generates a route to the selected recommendation destination, and guides the route through the generated route.

13 is a control configuration diagram of a terminal communicating with a vehicle according to another embodiment.

The terminal 300 may be a user terminal, and may be implemented as a computer or a mobile terminal capable of accessing a vehicle through a network. Here, the computer may be, for example, a laptop equipped with a WEB browser, A personal computer (PCS), a global system for mobile communications (GSM), and the like. The portable communication terminal includes a portable communication terminal, , PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication) -2000, CDMA (Code Division Multiple Access) -2000, W- Handheld-based wireless communication devices and all kinds of watches, rings, bracelets, anklets, necklaces, glasses, contact lenses, or headphones, such as a wireless access device, a WiBro (Wireless Broadband Internet)It may include a wearable device such as a yonghyeong device (head-mounted-device (HMD).

The terminal 300 includes a user interface 310, a position receiving unit 320, a sound input unit 330, a control unit 340, a storage unit 350, a communication unit 360, and a sound output unit 370.

The user interface 310 receives operation commands and input information from a user and displays operation information on the function being performed.

The user interface 310 may include an input unit 311 and a display unit 312. The input unit may include at least one of a button, a switch, and a touch panel.

The display unit 312 may include a display panel, which may be integrated with the touch panel.

The input unit 311 receives an on / off command of at least one function among a plurality of functions possessed by the terminal, and receives an operation command for the input at least one function.

The input unit 311 can receive an operation command of the voice recognition function.

In addition, the input unit 311 may receive information of a final destination when performing a navigation function through the terminal, and may also receive a recommendation destination selection command.

Here, the information of the final destination and the information of one recommended destination may be any one of a building name of a destination, a telephone number of a destination, an address of a destination, and a company name of a destination.

The input unit 311 can receive a pairing command with the vehicle and a communication execution command with the vehicle.

The input unit 311 can receive the delay command of the task, and can input the date and time information to visit when the task is delayed.

The display unit 312 displays operation information on a function being executed, and displays selection information selectable by the user as buttons or icons.

The display unit 312 displays the video information of the navigation information.

The display unit 312 displays a Korean / English character button, a number button, a special character button, and the like for inputting a destination, and can display a route guide button for a route guide command.

The display unit 312 displays information on the recommendation destination recommended by the control unit 340. [

The display unit 312 displays a guidance message and a button or an icon having information of an operation command.

The position receiving unit 320 obtains the current position of the terminal and transmits the obtained current position to the communication unit 150. The position acquiring unit 130 includes a GPS receiver.

The GPS (Global Positioning System) receiver includes an antenna for receiving signals of a plurality of GPS satellites, software for acquiring the position of the terminal using distance and time information corresponding to the position signals of the plurality of GPS satellites, And a signal output unit for outputting position information.

The sound input unit 330 receives the user's voice and transmits the voice information corresponding to the input voice to the control unit 340.

The sound input unit 330 includes one microphone or two or more microphones. Here, one microphone may be directional. And two or more microphones may be implemented in a microphone array.

More specifically, the sound input unit 340 collects sound, detects a sound wave of the collected sound, generates an electric signal corresponding to the sound wave, and transmits the generated electric signal to the control unit 340.

That is, the sound input unit 330 transmits an electric signal corresponding to the collected sound to the control unit 340. [ Where the electrical signal may be a voice signal.

The voice signal may include voice information.

The control unit 340 controls the operation of a plurality of functions based on the input information input from the input unit 311. [

The control unit 340 can control the voice recognition function, the communication function with the vehicle, and the navigation function.

The control unit 340 performs voice recognition based on the electric signal corresponding to the voice input to the sound input unit 330 when the voice recognition function is performed.

More specifically, the control unit 340 calculates the frequency characteristics of the sound signal (that is, the speech signal) input to the sound input unit 330 on a frame-by-frame basis to extract a feature vector included in the speech signal, Is compared with a previously stored acoustic model and a phoneme model to recognize the phonemes in the speech signal and the phoneme-based speech recognition is performed on the recognized phoneme to form a phoneme lattice, and based on the formed phoneme lattice and the indexing information stored in the indexing DB, Recognizes a character corresponding to a voice uttered by the user.

The control unit 340 recognizes the subject corresponding to the user utterance based on the recognized character, recognizes the task based on the recognized subject, recognizes the category corresponding to the recognized task, Based on at least one recommendation destination to be recommended to a user and controls output of information of at least one recommendation destination searched.

The control unit 340 searches for a position of interest (POI) based on the information of the current position received by the position receiving unit 320. Here, the point of interest may include information of the position of the building around the road.

In other words, the control unit 340 collects various pieces of local information on the map around the point of interest, confirms various information targeted by the location-based service, searches for a recommended destination corresponding to the recognized category in various pieces of identified information, Stores the recommendation destination, and transmits the stored recommendation destination to the vehicle 100 when communicating with the vehicle.

The control unit 340 compares the present position and the recommended position of the vehicle 100 during travel of the vehicle 100 to determine whether the vehicle 100 has passed the recommendation destination. If it is determined that the recommendation destination has passed the recommendation destination, Searches again the recommendation destination based on the searched interest point and the recognized category, and transmits the information of the searched recommendation destination to the vehicle 100.

In other words, if it is determined that the task is a default or a route deviation, the control unit 340 searches the recommendation destination again based on the current position and the recognized category, and transmits the retrieved recommendation destination information to the vehicle 100.

The control unit 340 receives payment information from the server 200 and can determine whether the vehicle has performed the task at the recommendation destination based on the received payment information and the information of the recommendation destination.

The control unit 340 can periodically check whether payment information has been received from the server 200. [

If it is determined that the start of the vehicle is off, or the communication with the vehicle is impossible, the control unit 340 may compare the current position of the terminal with the position of the recommendation destination to determine whether the vehicle has reached the recommendation destination.

If it is determined that the start-up of the vehicle is on or the communication with the vehicle is possible, the control unit 340 determines whether a recommendation destination stored in the storage unit 350 exists. If the recommendation destination exists, And controls the communication unit 360 to transmit to the vehicle 100.

The control unit 340 controls the output of a message inquiring whether or not a recommendation destination is transmitted and whether a recommendation destination is selected and outputs a message for inquiring whether a recommendation destination is visited in the future if a transmission and selection command for the recommendation destination is not inputted. And stores the information of the recommendation destination when the transmission and visit selection command of the recommendation destination is inputted by the user in the future.

The control unit 340 may transmit the recommendation destination information to the vehicle 100 when a transmission command for the recommendation destination is inputted.

The controller 340 receives the visit date and time of the recommendation destination through the input unit 311 or the sound input unit 330 and stores the received visit date and time if the transmission and selection command for the recommendation destination is not inputted It is possible.

The control unit 340 stores the visited date and time of the recommended destination when the delay command of the task is input, and it is also possible to store the recognized category information.

The control unit 340 may control transmission of the stored recommendation destination if the current date and time are the same as the visited date and time and the current location of the terminal is the same as the location of the terminal when the recommendation destination is searched.

If the present location of the terminal differs from the location of the terminal when the current location of the terminal is searched for the recommendation destination, the controller 340 determines the recommendation destination based on the current location of the terminal and the recognized category It is also possible to control the transmission of the newly searched and retrieved recommendation destination.

The control unit 340 can search for the recommendation destination based on the information of the speech uttered by one user and search for the recommendation destination based on the information of the utterance uttered by two or more users.

When two or more users utter, the control unit 340 recognizes only the voice that matches the previously registered voice among the voices input to the sound input unit 330 and searches for the recommended destination.

When an operation command of the navigation function is input, the control unit 340 confirms the final destination information input to the input unit 311, and determines a path from the current position to the destination based on the current position information, the destination information, and the map information Generates navigation information based on the map information and the information of the route, and controls the output of the video information and the sound information of the generated navigation information.

If a recommendation destination is searched for in performing the navigation function, the control unit 340 can generate a route having a recommended destination as a destination and control the output of the generated route.

The control unit 340 includes an indexing unit, a subject recognition unit, a category recognition unit, a recommendation destination search unit, a task fulfillment determination unit, and an output unit.

The configuration of the control unit 340 of the terminal is the same as the detailed configuration of the control unit 160 of the vehicle shown in FIG. 4, and the description thereof is omitted.

The storage unit 350 may store map information, store information of a final destination input by the user, and store information of at least one recommended destination generated by the control unit 340.

The storage unit 350 may include a plurality of databases for storing various kinds of information necessary for voice recognition and searching for a recommendation destination.

The plurality of databases includes an indexing database (DB), a subject database (DB), a task database (DB), and a category database (DB).

The communication unit 360 communicates with the external server 200 and the vehicle 100.

Here, the external server may be a server of a credit card company, or a cash receipt server of the Internal Revenue Service.

The communication unit 360 can perform wired / wireless communication.

The communication unit 360 may include Wi-Fi communication, Bluetooth communication, and USB communication.

The communication unit 360 may be a wireless broadband, a global system for mobile communication (GSM), a code division multiple access (CDMA), a wideband code division multiple access (WCDMA), a universal mobile telecommunications system (UMTS) Access, and Long Term Evolution (LTE).

The sound output unit 370 outputs the sound information of the navigation information when the navigation function is performed, and amplifies the sound signal in the received sound information by a predetermined magnitude and outputs the amplified sound signal.

The sound output unit 370 may output at least one recommendation destination, output sound to the recommendation destination selected by the user, or output a sound inquiring whether the recommendation destination is selected or not.

The sound output unit 370 can output voice guidance information and beep sound during voice recognition.

When the information of the recommendation destination is received from the terminal 300 when the start-up is on, the vehicle 100 generates a route from the current position to the recommendation destination, controls the output of the generated route, It is possible to set a recommendation destination as a stopover route, to generate a route from the current location to the final destination via the stopover route, and to control the output of the generated route.

14 is a control flowchart of a terminal communicating with a vehicle according to another embodiment.

When the operation command of the voice recognition function is inputted, the terminal activates the operation of the sound input unit and receives a sound through the sound input unit (381).

The terminal detects a sound wave of the collected sound, generates an electric signal corresponding to the sound wave, calculates a frequency characteristic of the generated electric signal frame by frame, extracts a feature vector included in the voice signal, Is compared with a previously stored acoustic model and a phoneme model to recognize phonemes in the electrical signal.

The terminal forms phoneme grids by performing phoneme-based speech recognition on the recognized phonemes and recognizes the characters corresponding to the phonetic voices of the user based on the formed phoneme grids and the indexing information stored in the indexing database.

The terminal recognizes (382) a subject corresponding to the voice uttered by the user based on the recognized character and the subject information stored in the subject database.

For example, it is possible to recognize that the article is a purchase subject by recognizing the words of the article name corresponding to something in the clear, something to buy, what is needed, and the words of the verb such as sadah and need.

Also, the terminal has to go where, what to do for a long time, what to do, what is not, what is broken, what is broken, etc., It is possible to recognize that it is a place to visit a place to visit a specific place by recognizing the words of the verb such as,

That is, the terminal moves to a specific place through the vehicle during the user's utterance, and performs the task to recognize the subject.

The terminal recognizes (383) a task based on the recognized subject and task information stored in the task database, and recognizes (384) a category corresponding to the recognized task based on the category information stored in the category database.

Here, the task may include an article name to be purchased, a place name to be moved, and an article name to be repaired.

More specifically, the terminal can group tasks by dividing a plurality of tasks into categories.

For example, the terminal groups the apples, tangerines, and pears into fruit categories, and groups the toilet paper and the toothbrush into the category of sanitary goods, if a plurality of tasks are purchases of apples, oranges, pears, toilet paper or toothbrushes.

The terminal confirms the current position received by the position receiver 320 and searches for a position of interest (POI) 385 based on the position information of the confirmed current position. Here, the point of interest may include information of the position of the building around the road.

The terminal searches 386 for recommendation destinations to be recommended to the user based on the recognized category and point of interest, determines at least one recommendation destination to be transmitted to the vehicle among the retrieved recommendation destinations, stores the determined recommendation destination information 387, do.

For example, when the terminal has a plurality of tasks and a plurality of recommendation destinations are searched, at least one place that allows a plurality of tasks among a plurality of recommendation destinations to be performed in one place or a minimum place is determined as a recommendation destination And stores information of the determined recommendation destination.

The terminal determines whether communication with the vehicle is possible (388). If it is determined that communication with the vehicle is possible, the terminal transmits the stored information of the recommended destination to the vehicle (389).

The terminal confirms the task fulfillment information 390 during running of the vehicle, and determines whether or not the recommendation destination has arrived by determining 391 whether to perform the task based on the confirmed task fulfillment information.

Here, the task fulfillment information may include position information of the current position, position information of the recommendation destination, mutual information of the recommendation destination, telephone number information, and payment information.

More specifically, the terminal confirms the position information of the current position and the position information of the recommendation destination received in the position receiver 320, determines whether the position information of the current position is the same as the position information of the recommendation destination, And the position information of the recommendation destination are the same, it is judged that the user fulfills the task.

That is, the terminal can determine whether the user has visited the recommendation destination from the location information of the current location and the location information of the recommendation destination.

Also, the terminal checks at least one of the mutual information and the telephone number of the payment information received from the server 200, and based on mutual information and telephone number information of at least one of the confirmed payment information and the recommendation destination, It is possible to judge whether or not it has been implemented. That is, the terminal can determine whether the user has purchased an item from the payment information.

Further, the terminal can determine whether the user has visited the recommendation destination and purchased the item from the comparison information of the current location location information and the recommendation destination location information and the payment information.

When the terminal determines that the user has performed the task (391), it determines that the user has arrived at the recommendation destination and terminates the communication with the vehicle (392).

On the other hand, if it is determined that the task is a failure, the terminal searches the recommendation destination again based on the current position and the recognized category.

More specifically, the terminal checks the current position received at the position receiving unit 320, searches (393) a point of interest based on the identified current position, and recommends the user based on the detected point of interest and the recognized category (394) new recommendation destinations and transmits (395) at least one new recommendation destination among the retrieved recommendation destinations to the vehicle.

The terminal confirms task fulfillment information during running of the vehicle and determines whether or not to perform the task based on the confirmed task fulfillment information. This process is the same as that described above, so a detailed description will be omitted.

15 is a control flowchart of a vehicle according to another embodiment.

When the vehicle is turned on (421), the vehicle performs communication with the terminal (422).

If it is possible to communicate with the terminal, the vehicle receives the information of the recommended destination from the terminal (423).

The vehicle identifies the current location and generates a path from the identified current location to the recommendation destination (424), and guides the road to the generated path (425).

If it is determined that the information of the new recommendation destination is not received (426), if it is determined that the information of the new recommendation destination is not received (427), it is determined whether the current position is the recommendation destination position The route guide is terminated (step 428).

If it is determined that the information of the new recommendation destination has been received from the terminal, the vehicle generates a new route from the current location to the new destination (429) and guides the route to the new route (430).

If the current position is determined to be the position of the new recommendation destination, the vehicle ends (428).

1: vehicle 130: position acquiring unit
140: communication unit 150: sound input unit
160: control unit 170:
180: sound output unit 200: server
300:

Claims (23)

A position receiving unit for receiving a current position;
A sound input unit for receiving a voice uttered by a user;
Recognizing the input voice of the user, recognizing the task based on the recognized voice, classifying a plurality of tasks according to categories when there are a plurality of recognized tasks, grouping them according to categories, A control unit for searching for a destination;
A storage unit for storing information of the searched recommendation destination; And
And a communication unit for communicating with the vehicle and transmitting information of a recommendation destination stored in the storage unit to the vehicle. 2. The apparatus according to claim 1,
An indexing database for storing indexing information;
A subject database for storing subject information;
A task database for storing task information;
A terminal further storing a category database for storing category information. 3. The apparatus of claim 2,
Recognizing a word based on the phoneme of the recognized voice and the indexing information stored in the indexing database, recognizing the subject of the utterance of the user based on the recognized word and the subject information stored in the subject database, A task recognition unit for recognizing a task to be performed by the user based on a subject and task information of the task database;
And a category recognition unit for recognizing the category of the recognized task based on the category information of the category database and for grouping the recognized task by category based on the recognized category. The apparatus of claim 3,
Searching for a point of interest within a predetermined distance based on the current position, searching at least one recommended destination based on the searched interest point and the grouped category, and outputting information of at least one recommended destination searched for Further comprising a terminal. 5. The apparatus of claim 4,
And a task execution determiner for determining a current position and determining whether to perform the task based on the confirmed current position and the position of the recommendation destination. 6. The system according to claim 5,
Further comprising receiving settlement information from an external server and determining whether to perform the task based on the received settlement information. 7. The apparatus of claim 6, wherein the recommendation destination search unit comprises:
And when the task failure information is received from the task fulfillment determination unit, searching for a new recommendation destination based on the confirmed current position and the grouped category, and outputting information of the found new recommendation destination. 5. The apparatus of claim 4, wherein the recommendation destination search unit comprises:
And searching for a recommended destination capable of performing a plurality of tasks at a time if the recognized tasks are plural. 5. The apparatus of claim 4, wherein the recommendation destination search unit comprises:
And searching for a recommendation destination enabling a plurality of tasks to be performed at a minimum number of destinations if the recognized tasks are a plurality of tasks. 5. The apparatus of claim 4, wherein the recommendation destination search unit comprises:
And outputting information on a recommendation destination closest in distance from the current position among the plurality of recommendation destinations if the plurality of recommended destinations are searched. The apparatus of claim 1,
And storing the information of the grouped category when a delay command of the task is received. A communication unit for performing communication with the terminal;
A position receiving unit for receiving a current position;
A control unit for generating a route from the current position to the recommendation destination and controlling the output of the generated route when the recommendation destination is received through the communication unit;
And a user interface for displaying the path,
Wherein the control unit confirms the current position when a new recommendation destination is received while driving, generates a new route from the recognized current position to a new recommendation destination, and controls the output of the generated new route. 13. The method of claim 12,
The user interface receives the final destination,
Wherein the control unit comprises generating a route connecting the current location, the recommendation destination, and the final destination. A position receiving unit for receiving a current position;
A sound input unit for receiving a voice uttered by a user;
Recognizing the input voice of the user, recognizing the task based on the recognized voice, classifying a plurality of tasks according to categories when there are a plurality of recognized tasks, grouping them according to categories, A control unit for searching for a destination and performing a navigation function based on the retrieved recommended destination information;
And a user interface for displaying navigation information corresponding to the navigation function. 15. The method of claim 14,
An indexing database for storing indexing information;
A subject database for storing subject information;
A task database for storing task information; And
And a category database for storing category information. 16. The apparatus of claim 15,
Recognizing a word based on the phoneme of the recognized voice and the indexing information stored in the indexing database, recognizing the subject of the utterance of the user based on the recognized word and the subject information stored in the subject database, A task recognition unit for recognizing a task to be performed by the user based on a subject and task information of the task database;
And a category recognition unit for recognizing the category of the recognized task based on the category information of the category database and for grouping the recognized task by category based on the recognized category. 17. The apparatus of claim 16,
Searching for a point of interest within a predetermined distance based on the current position, searching at least one recommended destination based on the searched interest point and the grouped category, and outputting information of at least one recommended destination searched for Further included vehicles. 18. The apparatus of claim 17,
And a task execution determination unit for determining a current position and determining whether to perform the task based on the confirmed current position and the position of the recommendation destination. 19. The system according to claim 18,
Further comprising receiving settlement information from an external server and determining whether to perform the task based on the received settlement information. The apparatus of claim 19, wherein the recommendation destination search unit comprises:
And when the task failure information is received from the task fulfillment determination unit, searching for a new recommendation destination based on the confirmed current position and the grouped category, and outputting information of the searched new recommendation destination. 18. The apparatus of claim 17, wherein the recommendation destination search unit comprises:
And searching for a minimum number of recommendation destinations that allow a plurality of tasks to be fulfilled at a minimum number of destinations if the number of recognized tasks is plural. 18. The apparatus of claim 17, wherein the recommendation destination search unit comprises:
And outputting information of a recommendation destination closest in distance from the current position among a plurality of recommendation destinations if the plurality of recommendation destinations are searched. 15. The apparatus of claim 14,
And storing the information of the grouped category when a delay command of the task is received.

Images