KR102219000B1 - The apparatus and method of developing emotion - Google Patents

Abstract

An emotional development apparatus according to an embodiment of the present invention includes: an input unit receiving a signal including a vital sound of a specific person and voice content; And a processing unit for extracting a vital sound from a signal including the vital sound of the specific person and processing the voice content; And a band characteristic determination unit determining band characteristics of the vital sound and the audio content; And an output unit for independently outputting the vital sound and the audio content through a frequency band allocated to each of the vital sounds. And a control unit for allocating the frequency band corresponding to each of the vital sound and the band characteristic of the voice content.

Description

Emotional development device and emotional development method {THE APPARATUS AND METHOD OF DEVELOPING EMOTION}

The present invention relates to an emotional development device and a method for developing emotions, and more specifically, to an emotional development device and a method for developing emotions capable of developing the emotions of children by multiple outputting human vital sounds and various types of audio contents. .

Currently, our society is facing a social situation such as an increase in double-income couples, an increase in only children due to the progress of nuclear family, and an increase in households separated in various forms. Accordingly, the amount of time spent with parents and siblings during the early childhood period is absolutely reduced, and early childhood children are exposed to various external educational environments such as kindergartens, day care centers, and kindergartens. As a result, infants and children tend to have insufficient attachment and bond with their parents, and emotional anxiety such as separation anxiety is likely to increase.

In order to care for the emotions of children, parents' heart sounds can be recorded and heard, or a method of mixing and playing other sound sources with the recorded heart sounds can be used. In this case, heart sounds and sounds of similar bands included in different sound sources to be mixed may interfere with each other, resulting in distortion due to amplification or cancellation. Such distorted sound can cause serious confusion in emotional stability of children who have not yet fully developed emotions.

In addition, when the results of different recording environments are mixed with each other, the sound of the heart in the final output sound is remarkably small, or indistinguishable from the sound of other sound sources, or not clearly audible, which has an effect on the emotional stability of children. There is a problem that it is insignificant.

Public Utility Model Publication 20-1998-0046223 (1998.09.25)

The present invention provides an emotional development device and an emotional development method capable of efficiently developing the emotions of children by clearly realizing the vital sounds by distinguishing them from other sounds by multiplying the vital sounds of parents and the like and various types of voice contents. It aims to provide.

In addition, an object of the present invention is to provide an emotional development device and an emotional development method capable of preventing distortion between output sounds by outputting through different output channels in response to the band characteristics of vital sound and audio content. .

The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems that are not mentioned are obvious to those of ordinary skill in the technical field to which the embodiments proposed by the following description belong. Can be understood.

An emotional development apparatus according to an embodiment of the present invention includes: an input unit receiving a signal including a vital sound of a specific person and voice content; And a processing unit for extracting a vital sound from a signal including the vital sound of the specific person and processing the voice content; And a band characteristic determination unit determining band characteristics of the vital sound and the audio content; And an output unit for independently outputting the vital sound and the audio content through a frequency band allocated to each of the vital sounds. And a control unit for allocating the frequency band corresponding to each of the vital sound and the band characteristic of the voice content.

In addition, the emotional development method according to an embodiment of the present invention includes the steps of receiving a signal including a vital sound of a specific person and audio content; And extracting a vital sound from a signal including the vital sound of the specific person and processing the voice content; And determining band characteristics of the vital sound and the audio content; And allocating a frequency band corresponding to each of the vital sound and the band characteristic of the voice content; And independently outputting the vital sound and the audio content through the frequency band allocated to each.

According to the embodiments according to the present invention, it is possible to efficiently develop a child's emotion by clearly implementing the vital sound by distinguishing it from other sounds.

Further, according to embodiments of the present invention, it is possible to prevent distortion between vital sound and audio content.

1 is a block diagram showing the configuration of an emotional development apparatus according to an embodiment of the present invention.
2A to 2C are diagrams for explaining an example in which the emotional development apparatus according to an embodiment of the present invention outputs vital sound and audio content in multiple notes.
3 is a diagram showing an emotional development process according to an embodiment of the present invention.
4 is a diagram illustrating a case in which sound output from an emotional development device is transmitted to a user's ear according to an embodiment of the present invention.
5 is a diagram illustrating an example of a network including an emotional development device according to an embodiment of the present invention.
6 is a view showing a process of operating the emotional development device according to an embodiment of the present invention in FIG.

Hereinafter, specific embodiments of the present invention will be described in detail with reference to the drawings. However, the technical idea of the present invention is not limited by the embodiments described below, and other inventions that are regressive by addition, change, and deletion of other components, or other embodiments included within the scope of the technical idea of the present invention Can be easily suggested.

As for terms used in the present invention, as far as possible, general terms that are currently widely used in connection with the technology have been selected, but in special cases, there are terms arbitrarily selected by the applicant. Therefore, it should be noted in advance that the present invention should be grasped as a meaning of a term, not a simple name. In the following description, the word'comprising' does not exclude the presence of elements or steps other than those listed.

1 is a block diagram showing the configuration of an emotional development apparatus according to an embodiment of the present invention.

The emotion development apparatus 100 according to an embodiment of the present invention may independently output a vital sound of a specific person and various audio contents so that the vital sound of a specific person can be clearly implemented. To this end, the emotion development apparatus 100 may include an input unit 110, a processing unit 120, a band characteristic determination unit 130, an output unit 140, and a control unit 150.

The input unit 110 may receive at least one of a signal and/or audio content including a vital sound of a specific person. Here, the specific person is a person who is psychologically or emotionally attached to and ties with a child who is a subject of emotional development (for example, a parent or a sibling, etc.), or a specific object in which the child has curiosity or intimacy (for example, It may be a character or an animation protagonist). In addition, signals including vital sounds may include conversation, singing, breathing, and sleeping sounds.

The vital sound may be extracted from a signal including the vital sound. In this case, the vital sound may include a breath sound (breathing sound), a heartbeat sound, a pulse sound, a voice tone, and the like.

The input unit 110 may receive signals including vital sounds and audio contents through various methods. In this case, the input unit 110 loads signals and/or audio contents including vital sounds previously stored in the emotion development device 100, or a user interface (ex: voice microphone, etc.) provided in the emotion development device 100 Through the signal and/or audio content including vital sound may be input, or a signal including vital sound and/or audio content may be received from an electronic device (eg, a smart phone) connected through a network.

According to an embodiment, the input unit 110 may further receive image content.

The processing unit 120 may process vital sound and audio content.

Specifically, the processing unit 120 may recognize and process a signal including vital sounds, and may extract a plurality of vital sounds from the signal. To this end, the processing unit 120 may perform processing such as waveform extraction, analog-to-digital conversion, encoding, band characteristic extraction, amplification, noise removal, gain control, digital-to-analog conversion, and the like on a signal including vital sound.

The processing unit 120 may process audio content. In this case, the processing unit 120 may perform processing such as waveform extraction, analog-to-digital conversion, encoding, band characteristic extraction, amplification, noise removal, gain control, and digital-to-analog conversion on the audio content. According to an embodiment, the processor 120 may recognize various sounds included in the audio content, respectively, and separate and extract only sounds of a specific object (eg, a character or an animation hero) therefrom.

The band characteristic determination unit 130 may determine a band characteristic of at least one of vital sound and/or audio content. Here, the band characteristic may include a frequency band, an amplitude, and a period.

The output unit 140 may independently output vital sound and audio (sound) content through frequency bands allocated to each. According to an embodiment, the output unit 140 may independently output vital sound and audio content corresponding to each of a plurality of channels.

Specifically, the output unit 140 configures an output line of sound using each unique channel according to the band characteristics of the vital sound and the audio content, thereby multiplying the vital sound and the audio content (e.g. , Triplet, quartet, etc.) Can be output at the same time. This will be described in detail in the description of FIGS. 2A to 2C.

In this case, the output unit 140 may output vital sound and audio content through different channels, respectively.

The controller 150 may allocate a frequency band corresponding to each of the audio content and the vital sound based on the band characteristics.

According to an embodiment, the vital sound includes a plurality of sub vital sounds, and the control unit 150 may select at least one of the plurality of sub vital sounds suitable for a band characteristic of voice content.

According to another embodiment, the audio content includes a plurality of sub audio content, and the control unit 150 may select at least one of the plurality of sub audio content suitable for a band characteristic of a vital sound.

According to another embodiment, the audio content includes a plurality of sub-audio contents by different subjects, and the control unit 150 may select one of the plurality of sub-audio contents by a specific subject.

In general, a device for caring for the emotions of a child is played by recording a parent's heart sound, or mixing the parent's voice with another sound source and playing it to the child. However, in this case, since several sounds having different characteristics are integrated and outputted into one, the unique characteristics of each sound cannot be expressed. Further, there is a problem in that sounds of similar bands interfere with each other, causing distortion due to amplification or cancellation.

The emotional development device 100 according to an embodiment of the present invention outputs various sounds as a sound source using each unique channel according to the band characteristics, thereby accurately expressing the characteristics of vital sounds through real-time time control and This can effectively make you listen to vital sounds.

2A to 2C are diagrams for explaining an example in which the emotional development apparatus according to an embodiment of the present invention outputs vital sound and audio content in multiple notes.

The emotion development apparatus 100 according to an embodiment of the present invention may simultaneously output vital sound and audio content in multiple notes. To this end, the output unit 140 may configure a sound output line by using each unique channel according to the band characteristics of the vital sound and the audio content.

The emotional development device 100 uses a multi-note method, a phenomenon expressed by [two ears effect] and [cocktail party effect] in sound image fusion of acoustics (that is, a counterpart in which many people's voices or various noises are mixed in a crowded atmosphere). The phenomenon of being able to understand the voice and communicate) can be implemented. To this end, the emotional development device 100 configures the output unit 140 with a structure of digital control and [sound source-medium-listener model], and uses hearing and other senses to listen to the sound [free space listening]. Can be implemented.

Specifically, FIG. 2A shows an example in which voice content and heart sound are output through respective unique channels.

The audio content is content that children want to listen to, and may be content for education, learning, exercise or entertainment.

Heart sounds may be extracted from signals including vital sounds. For example, assume that a signal containing vital sound is a parent's conversation. In the conversation of parents, vital sound consisting of the voice of the mother, the tone of the voice of the father, the voice of the mother, the breath of the father, the pulse of the mother, the pulse of the father, the heartbeat of the mother, the heartbeat of the father, etc. Can be included. In this case, the processing unit 120 extracts a plurality of vital sounds.

The band characteristic determination unit 130 determines the band characteristics of each of the voice content and the plurality of vital sounds. Each of the plurality of vital sounds has different band characteristics. Accordingly, the controller 150 may select a specific vital sound suitable for the band characteristic of the voice content from among the plurality of vital sounds. For example, if the speaker of the voice content is a woman, a vital sound related to a mother, who is a woman, can be selected so as to match well with the voice content. In addition, when the voice content corresponds to a low frequency band, a heart sound, which is a vital sound having a relatively low frequency band, may be selected so as to be output in harmony with the voice content. In this case, the output unit 140 outputs audio content through a frequency band A, and outputs a heart sound through a frequency band B.

2B illustrates an example in which voice content, heart sounds, and breath sounds are output through their own channels, respectively.

In FIG. 2B, it is assumed that the audio content is a lullaby, and a signal including a vital sound is a sound that the mother makes when sleeping. The sound a mother makes during sleep may include a vital sound consisting of a mother's breathing sound (breathing sound), a mother's heartbeat, and a mother's pulse. In this case, the processing unit 120 may extract a plurality of vital sounds from the sound the mother makes during sleep.

The band characteristic determination unit 130 determines the band characteristics of the lullaby, heart sound, and breathing sound. In this case, the controller 150 may extract at least one or more of the plurality of vital sounds based on the band characteristics of the voice content. For example, if the audio content has a low frequency band as a lullaby, it is possible to select a heart sound and a breathing sound, which are vital sounds having a low frequency band, so that they can be harmoniously output.

According to an embodiment, the controller 150 may extract a plurality of vital sounds in response to characteristics of voice content. For example, if the voice content has the purpose of calming children as a lullaby, the controller 150 may extract the mother's heart sounds and breathing sounds that have an effect of stabilizing the emotions of the children.

In this case, the output unit 140 outputs the audio content through the A frequency band, the heart sound through the B frequency band, and the breathing sound through the C frequency band.

2C shows an example in which two audio contents and heart sounds are output through their own channels, respectively.

The controller 150 may divide the audio content into first audio content and second audio content, select any one, and select a vital sound corresponding to the selected audio content. In this case, the controller 150 may independently output the first audio content, the second audio content, and the vital sound through different channels.

When it is assumed that the audio content is an animation animation, the processing unit 120 may separate the animation animation into a first audio content that is a voice of a protagonist and a second audio content that is an extra voice.

The band characteristic determination unit 130 determines the band characteristics of the first voice content, the second voice content, and the vital sound. In this case, the controller 150 may select a vital sound suitable for the first voice content familiar to children. In Fig. 2c, heart sounds are selected.

In this case, the output unit 140 outputs the first audio content through the A1 frequency band, the second audio content through the A2 frequency band, and outputs the heart sound through the B frequency band.

As described above, according to the present embodiment, the emotion development apparatus 100 can clearly implement the vital sound by outputting the voice content and the vital sound through the unique channel based on the band characteristics.

3 is a diagram showing an emotional development process according to an embodiment of the present invention.

According to an embodiment of the present invention, a method for developing emotions includes receiving a signal including a vital sound of a specific person and audio content; And extracting a vital sound from a signal including the vital sound of the specific person and processing the voice content; And determining band characteristics of the vital sound and the audio content; And allocating a frequency band corresponding to each of the vital sound and the band characteristic of the voice content; And independently outputting the vital sound and the audio content through the frequency band allocated to each. Hereinafter, a process of performing this method will be described in detail.

Voice content is input (S301).

The vital sound is input (S302).

The input unit 110 may receive a signal including a specific person's vital sound and audio content. Here, the specific person is a person who is psychologically or emotionally attached to and ties with a child who is a subject of emotional development (for example, a parent or a sibling, etc.), or a specific object in which the child has curiosity or intimacy (for example, It may be a character or an animation protagonist). In addition, the signal including the vital sound may include conversation, singing, breathing, and the like.

The processing unit 120 may recognize and process a signal including vital sounds, and extract a plurality of vital sounds from the signal. To this end, the processing unit 120 may perform processing such as waveform extraction, analog-to-digital conversion, encoding, band characteristic extraction, amplification, noise removal, gain control, digital-to-analog conversion, and the like on a signal including vital sound.

The processing unit 120 may process audio content. In this case, the processing unit 120 may perform processing such as waveform extraction, analog-to-digital conversion, encoding, band characteristic extraction, amplification, noise removal, gain control, digital-to-analog conversion, and the like on the voice content. According to an embodiment, the processing unit 120 may recognize various sounds included in voice content, respectively, and separate and extract only sounds of a specific object (eg, a character or an animation protagonist) therefrom.

Band characteristics of the voice content and vital sound are determined (S303).

The band characteristic determination unit 130 may determine the band characteristics of vital sound and voice content. Here, the band characteristic may include a frequency band, an amplitude, and a period.

A frequency band is allocated to each of the voice content and the vital sound (S304).

The controller 150 may allocate a frequency band corresponding to each of the audio content and the vital sound based on the band characteristics.

The voice content and the vital sound are each independently output through the assigned frequency band (S305).

The output unit 140 may independently output audio content and vital sound through a channel corresponding to a frequency band allocated to each.

4 is a diagram illustrating a case in which sound output from an emotional development device is transmitted to a user's ear according to an embodiment of the present invention.

Voice content and vital sound are output independently through channels assigned to each. In this case, the controller 150 may allocate channels to each of the voice content and the vital sound based on the band characteristics of the voice content and the vital sound, the characteristics of the voice content, and the characteristics of the vital sound.

Referring to FIG. 4, audio content is output through a first channel 410 and transmitted to the eardrum 405 of a user's ear 400. The vital sound is output through the second channel 420 and transmitted to the eardrum 405 of the ear 400 of the user. In this case, the voice content and the vital sound may be delivered to the eardrum 405 of the user's ear 400 while maintaining their own characteristics. Accordingly, problems such as disappearance of intrinsic characteristics or distortion caused by interference, which occur when audio content and vital sound are mixed and output, can be solved.

5 is a diagram illustrating an example of a network including an emotional development device according to an embodiment of the present invention.

In the emotional development apparatus according to an embodiment of the present invention, even in a state in which a guardian and a child are separated from each other because they exist in different spaces or time zones, the infants can feel emotional stability and achieve stable emotional development according to their growth.

As shown in FIG. 5, the emotion development apparatuses 510, 520, 530, and 540 may be connected to the guardian's mobile terminals 511, 541 or the server 550 through a network. In this case, the emotional development devices 510, 520, 530, and 540 may be carried by children who are targets of emotional development, respectively. In FIG. 5, A child A is an emotional development device 510, a B child is a B emotional development device 520, a C child C is a C emotional development device 530, and Z is the Z emotional development device 540. Carry.

Each of the emotional development devices 510, 520, 530, and 540 may be connected in correspondence with the mobile terminals 511 and 541 possessed by the guardian of the child. In the case of FIG. 5, the A emotional development device 510 is paired with the smart phone 511 of the parent A, and the Z emotional development device 540 is paired with the smart phone 541 of the Z parent to exchange information.

Each of the emotion development devices 510, 520, 530, and 540 may receive at least one of audio content and/or vital sound from the server 550. To this end, the server 550 may include a central processing unit 551, a shared audio content DB 552, and an individual vital sound DB 553. Here, the public audio content DB 552 may be provided to the emotion development apparatuses 510, 520, 530, and 540, and may store and manage public audio content that can be shared with each other. In addition, the individual vital sound DB 553 may store and manage unique vital sounds that are provided only to one of the emotion development devices 510, 520, 530, and 540 and cannot be shared with each other. For example, it is possible to store vital sounds that can be provided only to any one of child A and parent A, child B and parent B, child C and parent C, child Z and parent Z.

In this case, the emotion development devices 510, 520, 530, and 540 receive voice content from the shared audio content DB 552 of the server 550, and their own vital sound DB 553 of the server 550 After receiving the vital sound for the parent, each is independently output in correspondence with the characteristics of each band.

6 is a view showing a process of operating the emotional development device according to an embodiment of the present invention in FIG.

The vital sound of the parent is recorded (S601).

Each of the emotional development devices 510, 520, 530, and 540 records a parent's vital sound. In this case, each of the emotional development devices 510, 520, 530, and 540 may receive a signal including vital sound through various methods. Specifically, a signal including vital sound is received through an equipped user interface (ex: voice microphone, etc.), or a signal including vital sound is received from an electronic device (ex: a parent's smartphone, etc.) connected through a network. Can receive. In this case, the emotional development devices 510, 520, 530, and 540 may record a parent's vital sound.

Contents preferred by the parent's child are selected (S602).

Each of the emotional development devices 510, 520, 530, and 540 may select content that the child of the parent prefers. In this case, the content may be directly selected by the corresponding emotional development device (510, 520, 530, 540), or the content may be selected by control of a corresponding parent's smart phone.

The vital sound is stored in the server (S603).

The emotional development devices 510, 520, 530, and 540 transmit vital sounds to the server and store them in the server.

According to an embodiment, the emotion development devices 510, 520, 530, and 540 may deliver the selected content to the server and share the content with other emotion development devices 510, 520, 530, and 540.

Vital sound is downloaded from the server (S604).

The emotion development apparatuses 510, 520, 530, and 540 access the server and download vital sounds from the server. In this case, the emotional development devices 510, 520, 530, and 540 may have access rights only to the vital sounds stored by each.

Vital sound and the selected content are each played (S605).

The emotion development apparatuses 510, 520, 530, and 540 each independently output vital sounds and content in response to band characteristics.

As described above, according to the present invention, by using the vital sound of the parents to solve the symptoms of separation anxiety in children frequently occurring in children's homes, kindergartens, and schools, and to minimize the psychological problems of children that may occur from separation anxiety for a long time, By making it possible to obtain stability even in various environmental changes, it is possible to develop the emotional regulation ability of children.

In addition, stable emotional development of young children can reduce work stress on parental care or teacher education.

Meanwhile, the above-described method can be written as a program that can be executed on a computer, and can be implemented in a general-purpose digital computer that operates the program using a computer-readable medium. Further, the structure of the data used in the above-described method may be recorded on a computer-readable medium through various means. It is to be understood that a recording medium for recording executable computer programs or codes for performing various methods of the present invention does not include temporary objects such as carrier waves or signals. The computer-readable medium may include a storage medium such as a magnetic storage medium (eg, ROM, floppy disk, hard disk, etc.), and an optical reading medium (eg, CD-ROM, DVD, etc.).

Although the embodiments have been described above, these are only examples and do not limit the present invention, and those of ordinary skill in the art to which the present invention pertains will not be exemplified above without departing from the essential characteristics of the present embodiment. It will be seen that various modifications and applications are possible. For example, each component specifically shown in the embodiment may be modified and implemented. And differences related to these modifications and applications should be construed as being included in the scope of the present invention defined in the appended claims.

100: emotional development device 110: input unit
120: processing unit 130: band characteristic determination unit
140: output unit 150: control unit
400: ear 405: eardrum

Claims (9)

In the emotional development device,
An input unit for receiving a signal including a vital sound of a specific person and audio content;
A processing unit for extracting a vital sound from a signal including the vital sound of the specific person and processing the voice content;
A band characteristic determination unit determining band characteristics of the vital sound and the audio content;
An output unit for independently outputting the vital sound and the audio content through a frequency band allocated to each; And
And a control unit for allocating the frequency band corresponding to each of the vital sound and the band characteristic of the voice content. The method of claim 1,
The vital sound includes a plurality of sub vital sounds,
The control unit,
Emotional development apparatus for selecting at least one suitable for the band characteristic of the voice content from among the plurality of sub vital sounds. The method of claim 1,
The audio content includes a plurality of sub audio content,
The control unit,
Emotion development apparatus for selecting at least one suitable for the band characteristic of the vital sound from among the plurality of sub-audio contents. The method of claim 1,
The audio content includes a plurality of sub audio content by different subjects,
The control unit,
An emotional development device that selects one of the plurality of sub-audio contents by a specific subject. The method of claim 1,
The specific person,
An emotional development device comprising at least one of a person who is psychologically or emotionally attached and bonded to the target infant, a specific object for which the infant has curiosity, and a specific object for which the infant has intimacy. The method of claim 1,
The signal containing the vital sound of the specific person,
An emotional development device including at least one of a specific person's conversation, singing, breathing, and sleeping sounds. The method of claim 1,
The band characteristic includes at least one of a frequency band, an amplitude, and a period. In the emotional development method,
Receiving a signal including a vital sound of a specific person and audio content;
Extracting a vital sound from the signal including the vital sound of the specific person and processing the voice content;
Determining band characteristics of the vital sound and the audio content;
Allocating a frequency band corresponding to each of the vital sound and the band characteristic of the voice content; And
And independently outputting the vital sound and the audio content through the frequency bands allocated to each of the vital sounds. A computer-readable recording medium on which a program for implementing the method of claim 8 is recorded.

Images