KR20230042835A - Audio device and thereof control method with built-in jukebox function to respond to driver's emotions - Google Patents

Abstract

The present invention relates to an audio device with a built-in driver emotional response jukebox function and a control method thereof, which stores the driver's preferred music by emotional theme in internal memory, an external memory device (USB), or a smartphone, and automatically plays music that corresponds to the driver's emotions while driving to relieve driver stress and promote safe driving at the same time, playback of sound sources optimized for the driver's emotional state is performed by receiving input from the driver's emotional state, recognizing the input emotional state, selecting a sound source device that stores sound sources for each emotional theme corresponding to the emotional state, selecting the sound source device where the sound source for each emotional theme is stored based on the recognized emotional state and the selected sound source device, and extracting and playing sound sources corresponding to emotions from the selected sound source device.

Description

Audio device and its control method with built-in jukebox function to respond to driver's emotions}

The present invention relates to a vehicle audio with a built-in jukebox function for responding to driver emotions, and in particular, the driver's preferred music is stored in an internal memory, an external memory device (USB), or a smartphone for each emotion theme, and the driver's emotions while driving are stored. An audio device having a built-in jukebox function for responding to driver's emotions and a method for controlling the same, which automatically reproduces music corresponding to the driver's emotions to relieve the driver's stress and promote safe driving.

[0002] As vehicle culture has become commonplace with the recent improvement in living standards, the amount of time a driver stays inside a vehicle is gradually increasing due to long-distance driving or traffic jams.

In bad weather conditions such as snow, rain, fog, etc., drivers drive more nervously than in clear weather conditions. In addition, the driver has to repeat acceleration and deceleration in the congested section, so he is more nervous than when driving at constant speed. In addition, as the driving time increases, the driver's fatigue accumulates, resulting in stress. In addition, repeated sudden stops in order to cope with the driver's driving habit or the risk of an accident may act as stress to the driver.

As such, the driver receives considerable stress depending on the driving environment of the vehicle while driving the vehicle. An increase in driver's stress not only causes an increase in driver's fatigue, but also can be a factor that increases the risk of an accident. Drivers need to properly relieve their stress while driving a vehicle.

An audio device is a representative device that helps a driver relieve stress while driving. A driver can reduce stress while driving by listening to the radio through an audio device or music stored in a storage medium while driving. Drivers will be able to further reduce their stress by listening to music that matches their mood, that is, their state of stress.

However, since a general audio device (audio device, AVN) installed in a vehicle simply reproduces only radio programs or music stored in a storage medium, the stress state or emotion of the driver is not considered. Here, music that does not match the driver's stress state or emotion is not very helpful in reducing the driver's stress.

Therefore, there is a need for a method capable of providing music suitable for the driver's stress state and emotion in consideration of the driver's stress state and emotion.

The following <Patent Document 1> to <Patent Document 4> are prior art for reproducing music corresponding to the driver's emotion by being installed in a vehicle.

<Patent Document 1> provides a vehicle driver's emotion control system that detects changes in the driver's emotion in the vehicle and adjusts the emotion according to the driver's emotional state.

In addition, <Patent Document 2> provides an in-vehicle music recommendation system that provides music suitable for the driver's stress state in consideration of the driver's stress state.

In addition, <Patent Document 3> provides a music recommendation system for a vehicle that recommends and provides at least one piece of music based on a list of music listened to by a driver and driving situation information.

In addition, <Patent Document 4> provides a driver's emotion control device that recognizes a user's emotion through voice and driving information used for voice recognition and then adjusts the vehicle environment according to the user's emotion.

However, the prior art as described above does not respond to the driver's emotion by using only music in response to the driver's emotion, but responds to the driver's emotion by using the vehicle's audio device, air conditioning device, and voice device in a complex manner. The disadvantage is that complex algorithms are required and system configuration is complex.

In addition, the prior art disclosed in <Patent Document 2> is a technique for relieving driver's stress using only music, but this prior art collects information around the vehicle and vehicle information in a complex manner, analyzes it, and determines stress. Therefore, there are disadvantages in that various information collection devices are required and complicated algorithms for stress analysis are required.

Republic of Korea Patent No. 10-1173944 (2012.08.08 registration) (Vehicle driver's emotion control system and method) Korean Registered Patent No. 10-1427926 (2014.08.01 registration) (vehicle music recommendation system and method) Republic of Korea Patent Publication No. 10-2016-0051922 (published on May 12, 2016) (vehicle music recommendation system and method) Republic of Korea Patent No. 10-1619257 (registered on May 2, 2016) (driver emotion control device and method)

Therefore, the present invention has been proposed to solve the disadvantages of reproducing a pre-registered sound source regardless of the driver's emotion in a general vehicle audio device as described above and various problems occurring in the prior art, and provides the driver's preferred music Driver Emotion Response Juke, which is saved by emotional theme in internal memory, external memory device (USB) or smartphone, and automatically plays music corresponding to the driver's emotions while driving to relieve the driver's stress and promote safe driving. An object of the present invention is to provide an audio device having a built-in box function and a method for controlling the same.

Another object of the present invention is to identify the driver's emotion through voice recognition and automatically play music corresponding to the determined emotion to relieve the driver's stress and to respond to the driver's emotion that promotes safe driving while meeting the driver's needs. An audio device with a built-in jukebox function and a control method thereof are provided.

In order to achieve the above object, the "audio device with a built-in jukebox function corresponding to driver's emotion" according to the present invention,

an emotional state input unit for inputting a driver's emotional state;

an emotional state recognizing unit recognizing the emotional state input through the emotional state input unit;

a sound source device selection unit that selects a sound source device in which sound sources for each emotional theme corresponding to the emotional state are stored;

An interface unit that interfaces an external device in which a sound source is stored;

Based on the emotional state recognized by the emotional state recognizing unit and the sound source device selected through the sound source device selection unit, a sound source device storing sound sources for each emotional theme is selected, and a sound source corresponding to emotion is extracted from the selected sound source device and playback is controlled. a control unit; and

It is characterized in that it includes an emotional music reproducing unit for reproducing the extracted sound source under the control of the controller and transmitting it through a speaker.

In the above, the emotional state input unit,

It is characterized in that the emotional state is input by voice or video using a camera.

In the above, the emotional state recognition unit,

It is characterized in that the input emotional state is recognized using a voice recognition or image processing algorithm.

In the above, the sound source device,

It is characterized in that at least one or more of an internal memory provided in the audio device, an external memory USB connected through a USB port, and a smart phone linked through an external device interlocking unit.

In the above, the internal memory, USB and smartphone,

Each emotional theme sound source folder in which sound sources are classified and stored for each emotional theme is provided,

The emotional theme sound source folder,

It is characterized in that it includes at least one or more of a drowsiness sound source folder, a joy sound source folder, a sad sound source folder, a loneliness sound source folder, and an anger sound source folder.

In addition, the "audio device control method with built-in jukebox function corresponding to driver's emotion" according to the present invention,

(a) receiving a driver's emotional state;

(b) recognizing the input emotional state;

(c) selecting a sound source device storing sound sources for each emotional theme corresponding to the emotional state;

(d) selecting a sound source device storing sound sources for each emotion theme based on the recognized emotional state and the selected sound source device, and extracting a sound source corresponding to emotion from the selected sound source device; and

(e) reproducing the extracted sound source as an emotional sound source corresponding to the driver's emotion.

In the above, the sound source device includes at least one of an internal memory, USB, and a smart phone, and each sound source device has an emotional theme sound source folder in which sound sources are classified and stored according to emotional themes, and the emotion theme sound source folder It is characterized in that it includes at least one or more of a drowsiness sound source folder, a joy sound source folder, a sad sound source folder, a loneliness sound source folder, and an anger sound source folder.

According to the present invention, the driver's preferred music is stored in an internal memory, an external memory device (USB), or a smartphone for each emotional theme, and automatically plays music corresponding to the driver's emotions while driving to relieve the driver's stress. At the same time, there is an effect that can promote safe driving.

In addition, according to the present invention, the driver's emotion is determined through voice recognition, and music corresponding to the determined emotion is automatically played to relieve the driver's stress and promote safe driving while meeting the driver's needs. .

1 is a conceptual diagram of an audio device with a built-in jukebox function for responding to driver emotions and a control method thereof according to the present invention;
2 is a block diagram of an audio device having a built-in jukebox function for responding to driver emotions according to the present invention;
3 is a flow chart showing a method for controlling an audio device having a built-in jukebox function for responding to driver emotions according to the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an audio device having a built-in jukebox function for responding to driver emotions and a control method thereof according to a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

The terms or words used in the present invention described below should not be construed as being limited to a conventional or dictionary meaning, and the inventor may appropriately define the concept of the term in order to explain his/her invention in the best way. It should be interpreted as a meaning and concept consistent with the technical spirit of the present invention based on the principle that it can be.

Therefore, the embodiments described in this specification and the configurations shown in the drawings are only preferred embodiments of the present invention, and do not represent all of the technical spirit of the present invention, so various equivalents and equivalents that can replace them at the time of the present application It should be understood that variations may exist.

1 is a conceptual diagram of an audio device with a built-in jukebox function for responding to driver emotions and a control method thereof according to a preferred embodiment of the present invention, in which the driver's emotional state is detected by confirming the driver's emotions with voice or video using a camera. The emotional sound source corresponding to the emotion is extracted through the sound source device in which the emotional theme sound source corresponding to the recognized driver's emotional state is stored. Subsequently, the extracted emotional sound source is reproduced and transmitted through a speaker installed in the vehicle. In this way, a juke box corresponding to the driver's emotion is implemented in the vehicle.

2 is a block configuration diagram of an “audio device 100 with a built-in jukebox function corresponding to driver emotions” according to the present invention, including an emotional state input unit 101, an emotional state recognition unit 102, and a sound source device selection unit 103 ), a memory 104, a USB 105, an external device interlocking unit 106, an interface unit 107, an emotional music reproducing unit 109, and a speaker 110.

The emotional state input unit 101 serves to input the driver's emotional state, and can input the emotional state through voice or video using a camera. A separate voice input button (switch) can be used to input an emotional state through voice input.

The emotional state recognizing unit 102 serves to recognize the emotional state input through the emotional state input unit 101, and may use a voice recognition algorithm or an image processing algorithm or both.

The sound source device selector 103 serves to select a sound source device in which sound sources for each emotional theme corresponding to the driver's emotional state are stored. Here, sound sources for each emotion theme according to emotion can be separately stored in various sound source devices, and one of these sound source devices is selected through the sound source device selector 103 .

The memory 104 is a storage device built into the “audio device 100 with a built-in jukebox function corresponding to driver emotions” according to the present invention, and the driver can separate and store sound sources for each emotion theme for emotion in advance.

The USB 105 is an external memory device in which the driver separates and stores sound sources for each emotion theme for emotion. By connecting this USB to the USB port, the sound source for each emotional theme stored in the USB 105 can be used according to the driver's emotion.

The external device interlocking unit 106 plays a role of interlocking external devices in which the driver has previously separated and stored sound sources for each emotional theme. The external device may be a mobile device such as a smart phone.

The memory 104, the USB 105, and an external device such as a smart phone each have an emotional theme sound source folder in which sound sources are classified and stored according to emotional themes.

The emotional theme sound source folder may include at least one of a drowsiness sound source folder, a joy sound source folder, a sad sound source folder, a loneliness sound source folder, and an anger sound source folder. In the present invention, five emotional themes such as drowsiness, joy, sadness, loneliness, and anger are explained, but the present invention is not limited thereto, and more emotional theme folders are implemented according to the driver's taste to respond to the corresponding emotions. It will be obvious to those skilled in the art that the sound source to be stored can be stored.

The interface unit 107 serves to interface the USB 105 in which the sound source is stored and the sound source of the external device interlocking unit 106.

Based on the emotional state recognized by the emotional state recognizing unit 102 and the sound source device selected through the sound source device selector 103, the control unit 108 selects a sound source device storing sound sources for each emotional theme, and selects the selected sound source device. It plays a role in controlling playback by extracting sound sources corresponding to emotions from

The emotional music reproducing unit 109 plays a role of reproducing the extracted sound source under the control of the control unit 108 and transmitting it through the speaker 110 . This emotional music reproducing unit 109 can be referred to as a normal sound source player.

3 is a flow chart showing a "method for controlling an audio device with a built-in jukebox function corresponding to driver's emotion" according to the present invention, (a) receiving an input of the driver's emotional state (S101 - S102), (b) inputting the emotion Recognizing the state (S103), (c) selecting a sound source device storing sound sources for each emotional theme corresponding to the emotional state (S104), (d) each emotional theme based on the recognized emotional state and the selected sound source device Selecting a sound source device in which a sound source is stored, extracting a sound source corresponding to emotion from the selected sound source device (S105 to S109), and (e) reproducing the extracted sound source as an emotion sound source corresponding to the driver's emotion ( S110).

An "audio device having a built-in jukebox function corresponding to driver's emotions and a control method thereof" according to the present invention configured as described above will be described in detail.

First, the driver turns on the audio device to relieve stress by automatically playing a sound source corresponding to his emotion while driving, and promotes safe driving by making his emotion the best according to the sound source ( S101), the emotional state of the driver is input through the emotional state input unit 101 (S102).

Here, as a method of inputting the driver's emotional state, as is well known, the voice corresponding to the emotional theme, that is, sleepy/happy/angry/sad/lonely, etc. is input through voice, or the emotional state is selected through video selection. can be entered. In the case of inputting the emotional state by voice, the voice input button is operated in the on state and the voice is input, and in the case of inputting the emotional state by video, only the video input button is selected. When the video input button is selected, the installed camera takes a picture of the driver and inputs it as emotional state information.

When the driver inputs emotional state information, the emotional state recognizing unit 102 recognizes the input emotional state (S103). That is, if the input emotional state information is a voice, the input voice is recognized by a preset voice recognition algorithm, and the emotional state information corresponding to the recognition result is transmitted to the control unit 108 . For example, when a user inputs a voice having a meaning such as "I'm sleepy" as emotional state information, feature information is extracted from the input voice and finally the emotional state such as "I'm sleepy" is recognized.

In addition, if the input emotional state information is an image, the feature of the image is extracted using a preset image recognition algorithm, and the emotional state of the input image is compared with the extracted image feature and the image for image theme analysis already registered for each emotional theme. to determine That is, the characteristics of the image, such as the head moving back and forth when the driver is asleep, the shape of the mouth opening when laughing, the wrinkles on the forehead when angry, the size of the eyes or tears around the eyes when sad, etc. Recognize the emotional state of the driver using the image using the back.

In addition, the driver selects a sound source device in which sound sources for each emotional theme corresponding to the emotional state are stored through the sound source device selector 103 (S104). Here, the source device may be an internal memory 104, a USB 105, or an external device such as a smart phone.

The driver may create an emotional theme sound source folder in the internal memory, USB, or a sound source device such as a smart phone in advance, and classify and store sound sources for each emotion theme in the emotion theme sound source folder. Here, the emotional theme sound source folder can be set to a drowsiness sound source folder, a joy sound source folder, a sad sound source folder, a loneliness sound source folder, an anger sound source folder, and the like.

The control unit 108 selects a sound source device storing sound sources for each emotional theme based on the emotional state recognized through the emotional state recognizing unit 102 and the selected sound source device, and extracts a sound source corresponding to the emotion from the selected sound source device. (S105 - S109).

That is, when the driver selects the internal memory 104 as the sound source device and the recognized emotional state is the drowsy state, after finding the drowsy sound source folder in the emotional theme sound source folder, the sound source stored in the drowsy sound source folder is reproduced in the emotional state. extract the sound source. Here, when a plurality of sound sources are stored in the drowsy sound source folder, sound sources for sequential reproduction may be extracted in the stored order, or sound sources for sequential reproduction may be extracted in the reverse order of the stored order, or reproduced sound sources may be extracted in a random manner.

The control unit 108 transfers the sound source corresponding to the driver's current emotion selected as described above to the emotional music reproducing unit 109.

The emotional music reproducing unit 109 reproduces the transmitted emotional sound source using the sound source playback player, transmits the emotional sound source through the speaker 110, and outputs the emotional sound source corresponding to the driver's emotion (S110).

In this way, the present invention recognizes the driver's emotional state in the audio device of the vehicle, and extracts and plays sound sources registered for each emotional theme from sound source folders of various sound source storage devices, so that the audio device can be operated in the form of a jukebox. It will be. In other words, when only the driver's emotions are recognized, sound sources for each emotion theme are extracted from the stored sound source device and reproduced in the form of a jukebox, thereby relieving the driver's stress and at the same time reproducing the driver's emotions by reproducing sound sources that match the driver's emotions. We make it the best, and through this, we promote safe driving.

Although the invention made by the present inventors has been specifically described according to the above embodiments, the present invention is not limited to the above embodiments, and it is common knowledge in the art that various changes can be made without departing from the gist of the present invention. It is self-evident to those who have

100: Audio device with built-in driver emotion response jukebox function
101: emotional state input unit 102: emotional state recognition unit
103: sound source device selection unit 104: memory
105: USB 106: External device interlocking unit
107: interface unit 108: control unit
109: emotional music player 110: speaker

Claims (6)

an emotional state input unit for inputting a driver's emotional state;
an emotional state recognizing unit recognizing the emotional state input through the emotional state input unit;
a sound source device selection unit that selects a sound source device in which sound sources for each emotional theme corresponding to the emotional state are stored;
An interface unit that interfaces an external device in which a sound source is stored;
Based on the emotional state recognized by the emotional state recognizing unit and the sound source device selected through the sound source device selection unit, a sound source device storing sound sources for each emotional theme is selected, and a sound source corresponding to emotion is extracted from the selected sound source device and playback is controlled. a control unit; and
An audio device with a built-in jukebox function corresponding to the driver's emotion, characterized in that it comprises a emotional music reproducing unit for reproducing the extracted sound source under the control of the controller and transmitting it through a speaker.
In claim 1, the emotional state input unit,
An audio device with a built-in jukebox function for responding to driver emotions, characterized in that an emotional state is input by voice or video using a camera.
In claim 1, the emotional state recognizing unit,
An audio device with a built-in jukebox function for responding to driver's emotion, characterized in that it recognizes an input emotional state using a voice recognition or image processing algorithm.
The sound source device of claim 1, wherein the sound source device is any one of an internal memory, a USB device, and a smart phone, and the sound source device includes an emotional theme sound source folder in which sound sources are classified and stored for each emotion theme, and the emotion theme sound source folder includes a drowsiness sound source folder; An audio device with a built-in jukebox function for responding to driver emotions, characterized in that it includes at least one of a joy sound source folder, a sad sound source folder, a loneliness sound source folder, and an anger sound source folder.
A method for controlling an audio device having a built-in jukebox function for responding to driver emotions according to any one of claims 1 to 4, comprising:
(a) receiving a driver's emotional state;
(b) recognizing the input emotional state;
(c) selecting a sound source device storing sound sources for each emotional theme corresponding to the emotional state;
(d) selecting a sound source device storing sound sources for each emotion theme based on the recognized emotional state and the selected sound source device, and extracting a sound source corresponding to emotion from the selected sound source device; and
(e) reproducing the extracted sound source as an emotional sound source corresponding to the driver's emotion.
The sound source device of claim 5 , wherein the sound source device includes at least one of an internal memory, USB, and a smart phone, and the sound source device includes an emotion theme sound source folder in which sound sources are classified and stored for each emotion theme, and the emotion theme sound source folder A method for controlling an audio device with a built-in jukebox function corresponding to driver emotion, characterized in that it includes at least one of a drowsiness sound source folder, a joy sound source folder, a sad sound source folder, a loneliness sound source folder, and an anger sound source folder.

Images