KR20150053276A - Voice processing system and method using mobile terminal and vehicle head unit - Google Patents

Voice processing system and method using mobile terminal and vehicle head unit Download PDF

Info

Publication number
KR20150053276A
KR20150053276A KR1020130128916A KR20130128916A KR20150053276A KR 20150053276 A KR20150053276 A KR 20150053276A KR 1020130128916 A KR1020130128916 A KR 1020130128916A KR 20130128916 A KR20130128916 A KR 20130128916A KR 20150053276 A KR20150053276 A KR 20150053276A
Authority
KR
South Korea
Prior art keywords
voice
mobile communication
communication terminal
head unit
command
Prior art date
Application number
KR1020130128916A
Other languages
Korean (ko)
Inventor
조성오
Original Assignee
현대자동차주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 현대자동차주식회사 filed Critical 현대자동차주식회사
Priority to KR1020130128916A priority Critical patent/KR20150053276A/en
Publication of KR20150053276A publication Critical patent/KR20150053276A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/28—Constructional details of speech recognition systems
    • G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B2201/00—Indexing scheme relating to details of transmission systems not covered by a single group of H04B3/00 - H04B13/00
    • H04B2201/69—Orthogonal indexing scheme relating to spread spectrum techniques in general
    • H04B2201/713—Frequency hopping
    • H04B2201/71346—Bluetooth

Abstract

The present invention relates to a method and a system for treating voice. The method and system controls operation of a mobile communication terminal through user voice inputs and commands and control operations of a vehicle AVN system and a head unit thereof. To achieve the above-described purpose, the system of the present invention provides a method and a system for treating voice, wherein the method and system are connected with a mobile communication terminal and a vehicle heat unit. The system comprises: a voice recognizing server for receiving voice data according to user voice commands, recognizing user voice commands from the received voice data, and transmitting command data information for performing the voice commands; a head unit of an AVN system for transmitting voice data according to user voice commands inputted through a microphone; and a mobile communication terminal connected with the head unit to be communicated and transmitting the voice data received from the head unit to a voice recognizing server. The mobile communication terminal transmits command data information received from the voice recognizing server to the head unit, and the head unit controls operation according to the command data received from the mobile communication terminal.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a voice processing method and a voice processing method using a mobile communication terminal and a vehicle head unit,

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a voice processing method and system, and more particularly, to a voice processing method and a system thereof in which a mobile communication terminal and a vehicle head unit are associated.

The development of multimedia technology today is driving the evolution of comfortable cars and convenience cars that can provide infotainment to drivers, and the evolution of these vehicles is the development of information technology for drivers. It is continuing.

In addition, due to the complexity of the car and various driving patterns, the driver has to operate more devices while driving, and more information is requested from inside and outside the car. Also, the type of information can be voice, data, The trend is diversified.

The AVN (Audio Video Navigation) system installed in the vehicle satisfies the needs of the driver by providing useful information to the driver in cooperation with the driver's information system (DIS) and the telematics system.

An ANV system, particularly an audio system, provided in a vehicle includes an AM / FM radio receiver, a CD (Compact Disk) player, and an MP3 (MPEG-1 Audio Layer 3) player.

In recent vehicles, when a portable storage device (such as a USB memory or a memory card) in which MP3 files are stored is connected to an audio system, an MP3 file can be provided to an audio system and played back.

Meanwhile, since the mobile communication terminal has been made more compact and lighter due to the development of electronic and communication technology, it provides convenience of carrying and mobility, and its use is continuously increasing. The use of a smartphone capable of performing various functions by installing and executing a mobile phone has been exploding.

Among the additional functions of the mobile communication terminal, a voice recognition function for performing telephone call through voice input and controlling various operations of the terminal (controlling various functions of the terminal or providing user request information) has existed in the past. It is a technology that recognizes human voice signals by using a machine, that is, a computer, and grasps the embedded language information and executes necessary tasks.

Among the voice recognition functions, the telephone dialing function is a function of automatically dialing a telephone number of a contact when a user inputs a specific voice to the mobile communication terminal after storing a telephone number or the like in a memory of the mobile communication terminal .

A hands-free vehicle is a device for supporting a driver to talk without lifting a mobile phone while driving a vehicle. A mobile communication terminal is connected to a hands-free device while a hands-free device is installed in the vehicle, So that the user can make a call using the mobile communication terminal.

However, in the conventional handsfree system for a vehicle, the user must directly check the mobile communication terminal in order to search the phone book of the mobile communication terminal or to check incoming calls or texts in order to make a telephone call. there was.

In order to solve such a problem, Korean Patent Laid-Open No. 10-2013-0011464 (Jan. 30, 2013) discloses a mobile communication terminal equipped with a voice recognition engine and a hands- There is known a system capable of minimizing the risk of accidents during operation by performing dialing of communication terminals.

However, in using the voice recognition function of a mobile communication terminal such as a smart phone, it is possible to control the operation of the mobile communication terminal through voice input and command, but the operation control of the head unit of the vehicle AVN system (or audio system) It has no limit.

Accordingly, in order to perform an operation such as switching the audio receiving channel, adjusting the volume, and switching the function mode (radio, CD, MP3 mode, etc.), the operator must operate the direct button or dial, There was a problem of increasing the risk of accident by interfering.

Korean Patent Publication No. 10-2013-0011464 (Jan. 30, 2013)

SUMMARY OF THE INVENTION Accordingly, the present invention has been made keeping in mind the above problems occurring in the prior art, and it is an object of the present invention to provide an AVN system and a head unit thereof, A method and a system.

According to an aspect of the present invention, there is provided a voice recognition system comprising: a voice recognition server for receiving voice data according to a user voice command, recognizing a user voice command from the received voice data and transmitting command data information for performing the voice command; A head unit of an AVN system for transmitting voice data according to a user voice command input through a microphone; And a mobile communication terminal communicably connected to the head unit and transmitting voice data received at the head unit to a voice recognition server, wherein the mobile communication terminal transmits command data information received from the voice recognition server to the head unit And the head unit is provided so as to perform an operation control according to command data received from the mobile communication terminal, wherein the mobile communication terminal is connected to the vehicle head unit.

Here, when the mobile communication terminal determines that the mobile communication terminal is a command to be executed by the voice recognition server, the voice communication server is provided with operation control according to the command data information.

In addition, when the command of the command data information received by the voice recognition server is a telephone call, the mobile communication terminal transmits the data information about the command to the head unit and executes the telephone call according to the command, And the head unit inputs and outputs the user's voice through the microphone and the speaker in the head unit while exchanging the voice data during the communication.

Also, the command data information received from the mobile communication terminal by the head unit includes any one of command data for switching an audio receiving channel, volume adjustment, and function mode switching.

The voice recognition server searches for and extracts usable voice recognition commands from the voice data received from the mobile communication terminal, and transmits the extracted command data information to the mobile communication terminal.

When the user executes the application program in the mobile communication terminal after boarding the vehicle, the mobile communication terminal and the head unit are paired with Bluetooth. When the user operates the voice recognition button, The voice recognition start signal is transmitted to the mobile communication terminal so that the mobile communication terminal is activated to the voice recognition preparation step in which voice data can be received. When the user again presses the voice recognition button, the head unit receives the button operation signal, And the voice processing operation is terminated while a signal is transmitted to the mobile communication terminal.

According to another aspect of the present invention, The head unit of the vehicle AVN system transmits voice data according to a voice command input through a microphone and transmits voice data received from the head unit to the mobile communication terminal; Receiving voice data according to a voice command from the voice recognition server, recognizing a user voice command from the received voice data, and transmitting command data information for performing the voice command; And a step in which the mobile communication terminal transmits command data information received from the voice recognition server to the head unit and the head unit is operated in accordance with the command data received from the mobile communication terminal, Unit provides a combined voice processing method.

Accordingly, according to the voice processing method and system of the present invention, the mobile communication terminal and the head unit of the AVN system are configured to perform the voice processing process associated therewith, thereby controlling the operation of the mobile communication terminal as well as the AVN system System and its head unit can be controlled through user's voice input and command. Particularly, it is possible to carry out a process such as channel switching, volume adjustment, audio mode switching, etc. by voice input without hindering safe operation There is an advantage in reducing the risk of accidents.

In addition, since the voice recognition is performed through the server interlocked with the mobile communication terminal, the performance and the function update (the updated function can be implemented only by updating the server) can be easily performed and the vehicle control can be performed, It is possible to overcome the problem.

1 is a configuration diagram showing a speech processing system according to an embodiment of the present invention.
2 is a chart showing a voice processing process according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art to which the present invention pertains.

1 is a block diagram illustrating a voice processing system according to an embodiment of the present invention. The voice processing apparatus of the embodiment includes a user's mobile communication terminal 11 on which an application program (App.) For performing voice processing is mounted.

Here, the mobile communication terminal 11 stores names and telephone numbers, and can perform functions such as telephone dialing, call, and text message transmission / reception through a mobile communication network, and downloads and executes application programs to perform various additional functions It can be a smart device such as a smart phone that can be performed.

In addition, the application program can be an application that can be produced and distributed by a car manufacturer or a related company providing voice processing service of the embodiment and executed in a smart device.

In the embodiment, the mobile communication terminal 11 transmits voice data (voice data according to a user voice command) transmitted from the head unit 20 of the AVN system, which will be described later, to a voice recognition server through a network communication network And receives command data information for controlling the operation of the mobile communication terminal 11 or the head unit 20 from the voice recognition server 10 in accordance with the voice input of the user (driver).

In addition, the voice processing apparatus of the embodiment includes a head unit 20 that is paired with the mobile communication terminal 11 in bluetooth to perform voice processing.

A head unit 20 (serving as a control unit and a communication terminal) of an AVN system in a conventional vehicle is connected to a vehicle network system and has a Bluetooth module and is paired with a user's mobile communication terminal 11 or a Bluetooth handsfree, So that communication can be performed.

In addition, the head unit 20 of the embodiment transmits voice data input through the in-vehicle microphone 21 to the user's mobile communication terminal 11 as described later, And to transmit and receive voice data to and from the mobile communication terminal through the Bluetooth when the communication function is performed.

Particularly, the voice data inputted through the microphone 21 is transmitted to the user's mobile communication terminal 11 via the Bluetooth, and voice data transmitted from the mobile communication terminal 11 through the Bluetooth during the call is transmitted to the speaker 22 ) So that the user can hear the other party's voice.

In addition, the voice processing apparatus of the embodiment analyzes the voice data (voice data according to the user voice command) transmitted from the mobile communication terminal 11 during the voice processing process, and performs processing on the result data, that is, And a voice recognition server 10 for transmitting the command data information to the mobile communication terminal 11.

The voice recognition server 10 is a component for performing a voice recognition function for user voice input. The voice recognition server 10 utilizes a stored database (DB) Voice recognition command) from the database and extracts the extracted command data information to the mobile communication terminal 11.

At this time, when the mobile communication terminal 11 determines that it is an executable command from the received command data information, it transmits the data information about the command to the head unit 20 through the Bluetooth, Etc.).

For example, when the user speaks a voice command for making a telephone call including a destination name (for example, "Call Hong Gil Dong"), the head unit 20 receives the voice command via the microphone 21, To the mobile communication terminal 11 via Bluetooth.

The mobile communication terminal 11 transmits the voice data inputted by the user to the voice recognition server 10 through the network communication network and the voice recognition server 10 transmits the corresponding command data information (command) in response thereto .

At this time, if the mobile communication terminal 11 receives the command data information related to the telephone call, the mobile communication terminal transmits the data information related to the command to the head unit 20 and is connected to the name matched with the command data information Extract the telephone number and execute the dialing function.

Of course, at the time of a call, the mobile communication terminal 11 and the head unit 20 exchange voice data at the time of a call, and a user voice input is made through the microphone 21 and the speaker 22 connected to the head unit 20, The other party's voice output is performed.

On the other hand, if the mobile communication terminal 11 receives a command that can be executed by the head unit 20 such as an audio reception channel switching, a volume adjustment, a function mode switching, etc. from the voice recognition server 10, To the head unit 20 via Bluetooth, and allows the head unit to execute the function for the command.

Hereinafter, a speech processing procedure according to the embodiment will be described.

2 is a chart showing a voice processing process according to an embodiment of the present invention.

First, when a user executes an application program in a mobile communication terminal (e.g., a smartphone) 11 after boarding a vehicle, the mobile communication terminal and the head unit 20 mounted on the vehicle are paired with Bluetooth to perform Bluetooth communication .

Then, when the user (driver) presses the voice recognition button of the steering remote control mounted on the steering wheel in the driver's seat, the mobile communication terminal 11 paired with the Bluetooth in the head unit 20 of the vehicle, The mobile communication terminal 11 activates the voice recognition preparation step to receive the voice data.

When the user speaks a command (voice command), the head unit 20 receiving the command (voice command) transmits the voice data to the mobile communication terminal 11 via Bluetooth and the mobile communication terminal 11 And transmits the received voice data to the voice recognition server 10 outside the vehicle.

After the voice recognition server 10 performs voice recognition, the voice recognition server 10 transmits voice recognition result data, that is, command data, to the mobile communication terminal 11 in response to the voice command of the user, The control unit 11 selects the execution subject and executes the operation and the function according to the command data or the command data information to the head unit 20 so that the head unit 20 executes the operation and the function according to the command data .

As a result, the head unit 20 performs operations such as switching of an audio receiving channel in which the user has input audio, volume adjustment, and switching of the function mode according to the command data.

When the user again presses the voice recognition button, the head unit 20 receives the button operation signal and transmits the voice recognition end signal to the mobile communication terminal 11 via the Bluetooth. The head unit 20 also performs the voice processing operation Lt; / RTI >

In this way, according to the voice processing method and system of the embodiment, the mobile communication terminal and the head unit of the AVN system are configured to perform the voice processing process associated therewith, thereby controlling the operation of the mobile communication terminal as well as the AVN system Audio system) and operation of the head unit can be controlled through both user's voice input and command. Particularly, it is possible to switch the audio reception channel, volume adjustment, and function mode switching only by voice input without impeding safe operation And the risk of accident can be reduced.

In addition, since the voice recognition is performed through the server interlocked with the mobile communication terminal, the performance and the function update (the updated function can be implemented only by updating the server) can be easily performed and the vehicle control can be performed, It is possible to overcome the problem.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the scope of the present invention is not limited to the disclosed exemplary embodiments. Modified forms are also included within the scope of the present invention.

10: voice recognition server 11: mobile communication terminal
20: head unit 21: microphone
22: Speaker

Claims (12)

A speech recognition server for receiving speech data according to a user voice command, recognizing a user voice command from the received voice data, and transmitting command data information for performing the voice command;
A head unit of an AVN system for transmitting voice data according to a user voice command input through a microphone;
A mobile communication terminal communicably connected to the head unit and transmitting voice data received at the head unit to a voice recognition server;
Wherein the mobile communication terminal transmits command data information received from the voice recognition server to the head unit, and the head unit is provided to perform operation control according to command data received from the mobile communication terminal A voice processing system in which a mobile communication terminal and a vehicle head unit are associated.
The method according to claim 1,
Wherein the mobile communication terminal is provided to perform operation control according to the command data information when the mobile communication terminal determines that the mobile communication terminal is an instruction to be executed by itself from the command data information received by the voice recognition server. Processing system.
The method of claim 2,
When the command of the command data information received by the speech recognition server is a telephone call,
The mobile communication terminal transmits the data information about the command to the head unit,
Wherein the mobile communication terminal and the head unit communicate with each other while voice data is exchanged, and the head unit inputs the user's voice through the microphone and the speaker and outputs the other party's voice. Processing system.
The method according to claim 1,
Wherein the command data information received by the head unit from the mobile communication terminal includes any one of command data for switching an audio receiving channel, volume adjustment, and function mode switching. ≪ / RTI >
The method according to claim 1,
Wherein the voice recognition server searches and extracts usable voice recognition commands from the voice data received from the mobile communication terminal and transmits the extracted command data information to the mobile communication terminal. This associated voice processing system.
The method according to claim 1,
When the user executes the application program in the mobile communication terminal after boarding the vehicle, the mobile communication terminal and the head unit are paired with the Bluetooth,
When the user operates the voice recognition button, the head unit receiving the button operation signal transmits a voice recognition start signal to the mobile communication terminal, so that the mobile communication terminal is activated to the voice recognition preparation step in which voice data can be received.
When the user presses the voice recognition button again, the head unit receives the button operation signal and the voice recognition end signal is transmitted to the mobile communication terminal, and the voice processing operation is terminated. ≪ / RTI >
Performing voice input by a user speaking a voice command;
The head unit of the vehicle AVN system transmits voice data according to a voice command input through a microphone and transmits voice data received from the head unit to the mobile communication terminal;
Receiving voice data according to a voice command from the voice recognition server, recognizing a user voice command from the received voice data, and transmitting command data information for performing the voice command; And
The mobile communication terminal transmits command data information received from the voice recognition server to the head unit, and the operation of the head unit is controlled according to command data received from the mobile communication terminal;
Wherein the mobile communication terminal and the vehicle head unit are associated with each other.
The method of claim 7,
Wherein the mobile communication terminal executes operation control according to the command data information when determining that the command is data to be executed by the mobile communication terminal from the command data information received by the voice recognition server. .
The method of claim 8,
When the command of the command data information received by the speech recognition server is a telephone call,
The mobile communication terminal transmits the data information about the command to the head unit,
Wherein the mobile communication terminal and the head unit communicate with each other while voice data is exchanged, and the head unit inputs the user's voice through the microphone and the speaker and outputs the other party's voice. Processing method.
The method of claim 7,
Wherein the command data information received by the head unit from the mobile communication terminal includes any one of command data for switching an audio receiving channel, volume adjustment, and function mode switching. / RTI >
The method of claim 7,
Wherein the voice recognition server searches and extracts usable voice recognition commands from the voice data received from the mobile communication terminal and transmits the extracted command data information to the mobile communication terminal. ≪ / RTI >
The method of claim 7,
When the user executes the application program in the mobile communication terminal after boarding the vehicle, the mobile communication terminal and the head unit are paired with the Bluetooth,
When the user operates the voice recognition button, the head unit receiving the button operation signal transmits a voice recognition start signal to the mobile communication terminal, so that the mobile communication terminal is activated to the voice recognition preparation step in which voice data can be received.
When the user again presses the voice recognition button, the head unit receives the button operation signal and transmits the voice recognition end signal to the mobile communication terminal, and terminates the voice processing operation. A voice processing method.




KR1020130128916A 2013-10-29 2013-10-29 Voice processing system and method using mobile terminal and vehicle head unit KR20150053276A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020130128916A KR20150053276A (en) 2013-10-29 2013-10-29 Voice processing system and method using mobile terminal and vehicle head unit

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020130128916A KR20150053276A (en) 2013-10-29 2013-10-29 Voice processing system and method using mobile terminal and vehicle head unit

Publications (1)

Publication Number Publication Date
KR20150053276A true KR20150053276A (en) 2015-05-18

Family

ID=53389878

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020130128916A KR20150053276A (en) 2013-10-29 2013-10-29 Voice processing system and method using mobile terminal and vehicle head unit

Country Status (1)

Country Link
KR (1) KR20150053276A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018048268A1 (en) * 2016-09-11 2018-03-15 엘지전자(주) Method and apparatus for connecting device by using bluetooth technology
WO2019039873A1 (en) * 2017-08-22 2019-02-28 삼성전자 주식회사 System and electronic device for generating tts model
KR20220104869A (en) * 2021-01-19 2022-07-26 주식회사 엘지유플러스 Voice recognition based vehicle control method and system therefor

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018048268A1 (en) * 2016-09-11 2018-03-15 엘지전자(주) Method and apparatus for connecting device by using bluetooth technology
US10560974B2 (en) 2016-09-11 2020-02-11 Lg Electronics Inc. Method and apparatus for connecting device by using Bluetooth technology
WO2019039873A1 (en) * 2017-08-22 2019-02-28 삼성전자 주식회사 System and electronic device for generating tts model
KR20190021136A (en) * 2017-08-22 2019-03-05 삼성전자주식회사 System and device for generating TTS model
US11361750B2 (en) 2017-08-22 2022-06-14 Samsung Electronics Co., Ltd. System and electronic device for generating tts model
KR20220104869A (en) * 2021-01-19 2022-07-26 주식회사 엘지유플러스 Voice recognition based vehicle control method and system therefor

Similar Documents

Publication Publication Date Title
US20140106734A1 (en) Remote Invocation of Mobile Phone Functionality in an Automobile Environment
JP5327284B2 (en) Information management system and information management method
US8554831B2 (en) System and method for executing hands-free operation of an electronic calendar application within a vehicle
JP5245894B2 (en) Mobile communication device
US20160329060A1 (en) Speech processing apparatus, speech processing system, speech processing method, and program product for speech processing
US8867997B2 (en) Short-range communication system, in-vehicle apparatus, and portable communication terminal
US9532160B2 (en) Method of determining user intent to use services based on proximity
US9641625B2 (en) Method and system for executing an internet radio application within a vehicle
CN102882921B (en) Vehicular communication system, mobile communication terminal and vehicle fitting
CN104363331A (en) Method and vehicular multimedia device allowing cellphone APP (application) startup by cellphone interconnection
US8521235B2 (en) Address book sharing system and method for non-verbally adding address book contents using the same
CN103617795A (en) A vehicle-mounted voice recognition control method and a vehicle-mounted voice recognition control system
CN107257420A (en) System and method for signaling upcoming input
JP4918179B2 (en) Car information system
JP5570641B2 (en) Portable terminal device, vehicle-mounted device, information presentation method, and information presentation program
US8825115B2 (en) Handoff from public to private mode for communications
CN104954423A (en) In-vehicle telematics upgrades
US9234764B2 (en) Navigation system initiating conversation with driver
KR20150053276A (en) Voice processing system and method using mobile terminal and vehicle head unit
CN105818759A (en) Vehicle-mounted device and control method for display picture and output voice of vehicle-mounted device
CN106888147B (en) Vehicle-mounted instant messaging hands-free system
JP5350567B1 (en) Portable terminal device, vehicle-mounted device, information presentation method, and information presentation program
KR20120009189A (en) System for displaying state of vihicle and method for displaying state of mobile terminal thereof
CN206195899U (en) Automotive bluetooth calling equipment
US8452349B2 (en) In-vehicle apparatus

Legal Events

Date Code Title Description
E902 Notification of reason for refusal
E601 Decision to refuse application