KR102575697B1 - Common device, method and computer program for controlling sound - Google Patents

Abstract

The public terminal for controlling the sound includes a receiving unit that receives voice data including a voice command issued by a user, and when the voice command corresponds to an output switching command, a first unit before switching the output between the public terminal and an external device. A first noise value measuring unit measuring a noise value, an output switching unit converting an output between the common terminal and the external device based on the output switching command, and a second measuring a second noise value after the output is switched. A noise measurement unit, a comparison unit comparing the measured first and second noise values, and a control unit controlling sound between the common terminal and the external device based on a comparison result.

Description

Common terminal, method and computer program for controlling sound {COMMON DEVICE, METHOD AND COMPUTER PROGRAM FOR CONTROLLING SOUND}

The present invention relates to a common terminal for controlling sound, a method and a computer program.

An intelligent personal assistant is a software agent that handles tasks requested by users and provides specialized services to users. The intelligent personal assistant collects and provides customized information to the user based on an artificial intelligence (AI) engine and voice recognition, and performs various functions such as schedule management, email transmission, and restaurant reservation according to the user's voice command. It has the advantage of improving convenience.

These intelligent personal assistants are mainly provided in the form of customized personal services in smartphones, and representatively include Apple's Siri, Google's Now, and Samsung's Bixby. In this regard, Korea Patent Publication No. 2016-0071111, which is a prior art, discloses a method for providing a personal assistant service in an electronic device.

Recently, as users are provided with content services such as music, YouTube, and VOD through intelligent personal assistants, the need for audio output switching between AI terminals and external devices is gradually expanding. However, if the user arbitrarily switches the audio output without considering the specifications of the speaker of the AI terminal and the speaker of the external device, the sound suddenly increases or decreases even if the volume is the same according to the specifications of each speaker. Due to this, there is a problem in that the user has to adjust the volume again through the remote controller, which is inconvenient.

It is intended to provide a common terminal, method, and computer program for controlling sound so that the output is switched between the public terminal and the external device by selecting either one of output from the public terminal to a built-in display and speaker or output through an external device. do.

When the output is switched between the public terminal and the external device, the loudness of the sound changes due to the difference between the specifications of the speaker built in the common terminal and the speaker of the external device, thereby improving the problem that the user has to adjust the sound again through the remote control. It is intended to provide a common terminal, method, and computer program for controlling sound that can be performed.

An object of the present invention is to provide a common terminal, method, and computer program for controlling sound so that an output between a common terminal and an external device is switched by efficiently using a user's situation and speaker specifications of the public terminal and an external device.

An object of the present invention is to provide a common terminal, method, and computer program for controlling sound to minimize a sense of difference in sound felt by a user when output is switched between a public terminal and an external device.

However, the technical problem to be achieved by the present embodiment is not limited to the technical problems described above, and other technical problems may exist.

As a means for achieving the above-described technical problem, an embodiment of the present invention provides a receiver for receiving voice data including a voice command issued by a user, and the public terminal when the voice command corresponds to an output conversion command. A first noise value measuring unit for measuring a first noise value before switching the output between the external device and an output switching unit for switching the output between the common terminal and the external device based on the output switching command, the output A second noise value measurement unit for measuring the second noise value after conversion, a comparison unit for comparing the measured first and second noise values, and sound between the public terminal and the external device based on the comparison result. A common terminal including a control unit for controlling may be provided.

Another embodiment of the present invention is the step of receiving voice data including a voice command spoken by a user, if the voice command corresponds to an output switching command, prior to switching the output between the public terminal and an external device. 1 measuring a noise value, switching the output between the common terminal and the external device based on the output switching command, measuring a second noise value after the output is switched, the measured first noise It is possible to provide a sound control method comprising comparing a sound value and the second noise value, and controlling sound between the public terminal and the external device based on the comparison result.

Another embodiment of the present invention, when the computer program is executed by a computing device, receives voice data including a voice command uttered from a user, and when the voice command corresponds to an output conversion command, the common terminal and Measuring a first noise value before switching an output between external devices, switching an output between the common terminal and the external device based on the output switching command, and measuring a second noise value after switching the output; , a computer program stored in a computer readable medium including a sequence of instructions for comparing the measured first noise value and the second noise value, and controlling sound between the common terminal and the external device based on the comparison result can provide.

The above-described means for solving the problems is only illustrative and should not be construed as limiting the present invention. In addition to the exemplary embodiments described above, there may be additional embodiments described in the drawings and detailed description.

According to any one of the problem solving means of the present invention described above, the user selects any one of output from a public terminal to a built-in display and speaker or output through an external device so that the output is switched between the public terminal and the external device It is possible to provide a common terminal, method and computer program for controlling sound.

When the output is switched between the public terminal and the external device, the loudness of the sound changes due to the difference between the specifications of the speaker built in the common terminal and the speaker of the external device, thereby improving the problem that the user has to adjust the sound again through the remote control. It is possible to provide a common terminal, method and computer program for controlling sound that can be used.

It is possible to provide a common terminal, a method, and a computer program for controlling sound to switch an output between a public terminal and an external device by efficiently using a user's situation and speaker specifications of the public terminal and the external device.

It is possible to provide a common terminal, a method, and a computer program for controlling sound to minimize a sense of difference in sound felt by a user when an output is switched between a public terminal and an external device.

1 is a configuration diagram of a sound control system according to an embodiment of the present invention.
2 is a configuration diagram of a public terminal according to an embodiment of the present invention.
3A to 3C are exemplary diagrams for explaining a process of changing an EQ parameter based on user context information according to an embodiment of the present invention.
4 is a flowchart of a method for controlling sound in a public terminal according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail so that those skilled in the art can easily practice the present invention with reference to the accompanying drawings. However, the present invention may be embodied in many different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is said to be "connected" to another part, this includes not only the case where it is "directly connected" but also the case where it is "electrically connected" with another element interposed therebetween. . In addition, when a part "includes" a certain component, this means that it may further include other components, not excluding other components, unless otherwise stated, and one or more other characteristics. However, it should be understood that it does not preclude the possibility of existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

In this specification, a "unit" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Further, one unit may be realized using two or more hardware, and two or more units may be realized by one hardware.

In this specification, some of the operations or functions described as being performed by a terminal or device may be performed instead by a server connected to the terminal or device. Likewise, some of the operations or functions described as being performed by the server may also be performed in a terminal or device connected to the corresponding server.

Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a configuration diagram of a sound control system according to an embodiment of the present invention. Referring to FIG. 1 , the sound control system 1 may include a public terminal 110 , an external device 120 and a conversation server 130 . The public terminal 110, the external device 120, and the conversation server 130 are components that can be controlled by the sound control system 1 by way of example.

Each component of the sound control system 1 of FIG. 1 is generally connected through a network. For example, as shown in FIG. 1 , the public terminal 110 may be connected to the chat server 130 simultaneously or at intervals.

A network refers to a connection structure capable of exchanging information between nodes such as terminals and servers, such as a local area network (LAN), a wide area network (WAN), and the Internet (WWW: World Wide Web), wired and wireless data communication network, telephone network, and wired and wireless television communication network. Examples of wireless data communication networks include 3G, 4G, 5G, 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), World Interoperability for Microwave Access (WIMAX), Wi-Fi, Bluetooth communication, infrared communication, ultrasonic communication, visible light communication (VLC: Visible Light Communication), LiFi, and the like, but are not limited thereto.

The control device 100 of the public terminal 110 may be configured as a hardware device having a built-in microphone and a communication module (eg, a Bluetooth communication module). The control device 100 may receive a voice spoken by a user through a microphone and transmit the input voice data to the public terminal 110 . At this time, the input voice may be stored in the memory for a predetermined time. In addition, the control device 100 may measure noise through a microphone and transmit the measured noise measurement information to the public terminal 110 . The control device 100 may transmit voice data and noise measurement information to the public terminal 110 through Bluetooth communication.

The public terminal 110 may receive voice data including a voice command uttered by a user. For example, the public terminal 110 may receive voice data including a voice command uttered by a user through the control device 100 of the public terminal 110 .

The public terminal 110 may perform text conversion on the received voice data and transmit the converted text result to the chat server 130 . The public terminal 110 may receive a voice command analysis result analyzed based on the text result from the chat server 130 .

The public terminal 110 may measure the signal strength of the control device 100 and measure the user's voice frequency value from voice data. For another example, voice data including a voice command spoken by a user may be received through a microphone built into the public terminal 110 .

When receiving a voice command input through the control device 100 of the public terminal 110, the public terminal 110 requests noise measurement to the control device 100 based on the output conversion command, and the control device 100 ) may receive noise measurement information measured from.

The public terminal 110 may detect reference signal information of sound being output from the public terminal 110 or the external device 120 based on the output conversion command.

When the voice command corresponds to an output switching command, the public terminal 110 may measure a first noise value before switching the output between the public terminal 110 and the external device 120 . For example, the public terminal 110 may measure a first noise value by comparing noise measurement information and sound reference signal information.

The public terminal 110 may switch an output between the public terminal 110 and the external device 120 based on an output conversion command.

The common terminal 110 may measure the second noise value after the output is switched. For example, the public terminal 110 may measure the second noise value by comparing noise measurement information and sound reference signal information.

The common terminal 110 may compare the measured first noise value and the second noise value. At this time, the public terminal 110 may determine whether the second noise value corresponds to a predetermined approximate range from the first noise value.

The public terminal 110 may control sound between the public terminal 110 and the external device 120 based on the comparison result.

According to an embodiment, when sound and video are being output from the common terminal 110, the output of sound and video may be switched to the external device 120. For example, when sound is being output from the public terminal 110 before the output is switched, and the second noise value measured after the output is switched does not fall within a predetermined approximate range from the first noise value, the public terminal ( 110) may control the volume of the external device 120.

According to another embodiment, while sound and video are being output from the external device 120 , the output of sound and video can be switched to the common terminal 110 . For example, when sound is being output from the external device 120 before the output is switched, and the second noise value measured after the output is switched does not fall within a predetermined approximate range from the first noise value, the public terminal ( 110) may control the volume of the public terminal 110.

The public terminal 110 may determine user context information based on the measured signal strength and voice frequency values. Here, the context information may include the user's age, gender, location, and the like.

When the second noise value is within a predetermined approximate range from the first noise value, the public terminal 110 may derive an EQ parameter change value based on the determined situation information. The public terminal 110 may change the EQ parameter of the external device 120 or the public terminal 110 based on the derived EQ parameter change value.

The common terminal 110 is a hardware device including a display module and a speaker module, and may be executed by a computer program stored in a medium including a sequence of commands for controlling sound. When the computer program is executed by the computing device, it receives voice data including a voice command spoken by the user, and when the voice command corresponds to an output switching command, output between the public terminal 110 and the external device 120. A first noise value before conversion is measured, an output between the common terminal 110 and the external device 120 is switched based on an output conversion command, a second noise value after the output is switched is measured, and the measured It may include a sequence of commands for comparing the first noise value and the second noise value and controlling the sound between the public terminal 110 and the external device 120 based on the comparison result.

The external device 120 is a device having a display and a speaker, and can output video and audio. The external device 120 may be connected to the common terminal 110 through an HDMI port, and the external device 120 may include, for example, a TV, a monitor, and the like.

2 is a configuration diagram of a public terminal according to an embodiment of the present invention. Referring to FIG. 2 , the public terminal 110 includes a receiver 201, a requester 202, a detector 203, a first noise value measurement unit 204, an output conversion unit 205, and a second noise value measurement unit. It may include a unit 206, a comparison unit 207, a control unit 208, a signal strength measurement unit 209, a sound frequency measurement unit 210, a determination unit 211 and a derivation unit 212.

The receiving unit 201 may receive voice data including a voice command uttered by a user.

The receiving unit 201 may receive noise measurement information measured from the control device 100 .

When the receiving unit 201 receives a voice command input through the control device 100 of the public terminal 110, the requester 202 may request noise measurement to the control device 100 based on the output conversion command. there is.

The detection unit 203 may detect reference signal information of the sound being output from the public terminal 110 or the external device 120 based on the output conversion command.

When the voice command corresponds to an output switching command, the first noise value measurement unit 204 may measure a first noise value before switching the output between the common terminal 110 and the external device 120 . For example, the first noise value measuring unit 204 may measure the first noise value by comparing the noise measurement information and the sound reference signal information.

The output conversion unit 205 may switch the output between the common terminal 110 and the external device 120 based on an output conversion command. For example, the output conversion unit 205 may convert audio and video being output from the public terminal 110 to the external device 120 . For another example, the output conversion unit 205 may convert audio and video being output from the external device 120 to the common terminal 110 .

The output conversion unit 205 may change the EQ parameter of the external device 120 or the public terminal 110 based on the EQ parameter change value derived from the derivation unit 212 .

The second noise value measuring unit 206 may measure the second noise value after the output is switched. For example, the second noise value measurement unit 206 may measure the second noise value by comparing noise measurement information and sound reference signal information.

The comparator 207 may compare the measured first noise value and the second noise value. At this time, the comparator 207 may determine whether the second noise value corresponds to a predetermined approximate range from the first noise value. Here, the setting of the predetermined approximation range may be changed according to the usage book of the public terminal 110 .

The controller 208 may control sound between the common terminal 110 and the external device 120 based on the comparison result.

According to an embodiment, when sound and video are being output from the common terminal 110, the output of sound and video may be switched to the external device 120. For example, when sound is being output from the common terminal 110 before the output is switched and the second noise value measured after the output is switched does not fall within a predetermined approximate range from the first noise value, the control unit 208 ) may control the volume of the external device 120. At this time, the controller 208 may control the volume of the external device 120 by transmitting an IR signal capable of controlling the external device 120 .

According to another embodiment, while sound and video are being output from the external device 120 , the output of sound and video can be switched to the common terminal 110 . For example, when sound is being output from the external device 120 before the output is switched and the second noise value measured after the output is switched does not fall within a predetermined approximate range from the first noise value, the controller 208 ) may control the volume of the built-in speaker of the public terminal 110.

The signal strength measurement unit 209 may measure the signal strength of the control device 100 .

The voice frequency measurement unit 210 may measure a user's voice frequency value from voice data.

The determination unit 211 may determine the user's context information based on the measured signal strength value and the voice frequency value. Here, the context information may include the user's age, gender, location, and the like. For example, the determination unit 211 may determine whether the user is located at a short distance or a long distance from the public terminal 110 based on the measured signal strength and voice frequency values. In this way, the reason for determining the context information is that the user's audible frequency varies according to the user's age, gender, and location.

When the second noise value is within a predetermined approximation range from the first noise value, the derivation unit 212 may derive an EQ parameter change value based on the determined situation information. For example, when the user is located at a short distance from the public terminal 110, the derivation unit 212 derives an EQ parameter change value in which a high-pitched tone is enhanced over a low-pitched tone, and when the user is located at a distance from the public terminal 110, An EQ parameter change value in which the bass sound is enhanced more than the treble sound may be derived. At this time, the derived EQ parameter change value may vary depending on the structure and speaker specifications of the public terminal 110 and the external device 120.

3A to 3C are exemplary diagrams for explaining a process of changing an EQ parameter based on user context information according to an embodiment of the present invention.

3A is an exemplary diagram for explaining a process of changing an EQ parameter when a user is located in a short distance from a public terminal and an external device according to an embodiment of the present invention. Referring to FIG. 3A , the public terminal 110 may determine that the user 300 is located in a short distance from the public terminal 110 through the signal strength of the control device 100 of the public terminal 110 . At this time, the approximation range between the second noise value and the first noise value may be set widely.

After the output between the public terminal 110 and the external device 120 is switched, the public terminal 110 sets the EQ parameter change value so that the bass sound is enhanced rather than the treble in order to effectively deliver sound to the user 300 located at a short distance. It is derived, and the EQ parameter may be changed based on the derived EQ parameter change value.

3B is an exemplary diagram for explaining a process of changing an EQ parameter when a user is located far from a public terminal and an external device according to an embodiment of the present invention. Referring to FIG. 3B , the public terminal 110 may determine that the user 310 is located far away from the public terminal 110 through the signal strength of the control device 100 of the public terminal 110 . In this case, the approximation range between the second noise value and the first noise value may be narrowly set.

After the output between the public terminal 110 and the external device 120 is switched, the public terminal 110 has an EQ parameter change value that enhances high-pitched sounds rather than low-pitched sounds in order to effectively deliver sound to a user 310 located at a distance. It is possible to derive and change the EQ parameter based on the derived EQ parameter change value.

3C is an exemplary diagram for explaining a process of changing volume and EQ parameters when a user is located outside according to an embodiment of the present invention. Referring to FIG. 3C , when the user 320 is located outside but wants to output and switch audio or video for a companion dog in the house, the user 320 uses a public terminal through a service app installed on the user terminal (not shown). An output conversion command may be transmitted to (110).

After the output between the public terminal 110 and the external device 120 is switched, the public terminal 110 requests noise measurement from the control device 100 based on an output conversion command received from a user terminal (not shown). And, by receiving noise measurement information from the control device 100, the volume can be adjusted. In addition, the public terminal 110 may derive an EQ parameter change value and change the EQ parameter based on the derived EQ parameter change value.

4 is a flowchart of a method for controlling sound in a public terminal according to an embodiment of the present invention. The method for controlling sound in the public terminal 110 shown in FIG. 4 includes steps processed time-sequentially by the embodiments shown in FIGS. 1 to 3C. Therefore, even if the content is omitted below, it is also applied to the method of controlling sound in the public terminal 110 according to the embodiment shown in FIGS. 1 to 3c.

In step S410, the public terminal 110 may receive voice data including a voice command uttered by the user.

In step S420, when the voice command corresponds to the output switching command, the public terminal 110 may measure a first noise value before switching the output between the public terminal 110 and the external device 120.

In step S430, the public terminal 110 may switch the output between the public terminal 110 and the external device 120 based on the output switching command.

In step S440, the common terminal 110 may measure the second noise value after the output is switched.

In step S450, the common terminal 110 may compare the measured first noise value and the second noise value.

In step S460, the public terminal 110 may control sound between the public terminal 110 and the external device 120 based on the comparison result.

In the above description, steps S410 to S460 may be further divided into additional steps or combined into fewer steps, depending on the implementation of the present invention. Also, some steps may be omitted as needed, and the order of steps may be switched.

In the above description, steps S410 to S460 may be further divided into additional steps or combined into fewer steps, depending on the implementation of the present invention. Also, some steps may be omitted as needed, and the order of steps may be switched.

The method for controlling sound in a common terminal described with reference to FIGS. 1 to 4 may be implemented in the form of a computer program stored in a medium executed by a computer or a recording medium including instructions executable by a computer. In addition, the method for controlling sound in a common terminal described with reference to FIGS. 1 to 4 may be implemented in the form of a computer program stored in a medium executed by a computer.

Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. Also, computer readable media may include computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

The above description of the present invention is for illustrative purposes, and those skilled in the art can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, the embodiments described above should be understood as illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is indicated by the following claims rather than the detailed description above, and all changes or modifications derived from the meaning and scope of the claims and equivalent concepts should be construed as being included in the scope of the present invention. do.

100: control device
110: public terminal
120: external device
201: receiver
202: requesting unit
203: detection unit
204: first noise value measuring unit
205: output conversion unit
206: second noise value measuring unit
207: comparison unit
208: control unit
209: signal strength measuring unit
210: voice frequency measuring unit
211: judgment unit
212: extraction unit

Claims (17)

In a public terminal for controlling sound,
a receiving unit for receiving voice data including a voice command uttered by a user;
a first noise value measuring unit measuring a first noise value before switching the output between the common terminal and an external device when the voice command corresponds to an output switching command;
an output conversion unit for switching output between the common terminal and the external device based on the output conversion command;
a second noise value measuring unit measuring a second noise value after the output is switched;
a comparison unit comparing the measured first noise value and the second noise value; and
and a control unit controlling sound between the public terminal and the external device based on a comparison result.
According to claim 1,
When the receiver receives the voice command input through the control device of the public terminal, further comprising a request unit requesting noise measurement to the control device based on the output conversion command,
Wherein the receiving unit receives the noise measurement information measured from the control device, the public terminal.
According to claim 2,
The public terminal further comprising a detection unit for detecting reference signal information of sound being output from the public terminal or the external device based on the output switching command.
According to claim 3,
The first noise value measurement unit and the second noise value measurement unit compare the noise measurement information and the reference signal information of the sound to measure the first noise value and the second noise value, respectively;
Wherein the comparator determines whether the second noise value corresponds to a predetermined approximation range from the first noise value.
According to claim 4,
When the sound is being output from the public terminal before the output is switched, and the second noise value measured after the output is switched does not fall within a predetermined approximation range from the first noise value,
Wherein the control unit controls the volume of the external device, the public terminal.
According to claim 4,
When the sound is being output from the external device before the output is switched, and the second noise value measured after the output is switched does not fall within a predetermined approximation range from the first noise value,
Wherein the control unit controls the volume of the public terminal.
According to claim 2,
a signal strength measurement unit for measuring the signal strength of the control device; and
The public terminal further comprising a voice frequency measuring unit for measuring a voice frequency value of the user from the voice data.
According to claim 7,
The public terminal further comprising a determination unit for determining the user's context information based on the measured signal strength value and voice frequency value.
According to claim 8,
Wherein the context information includes at least one of age, gender, and location of the user.
According to claim 9,
The public terminal further comprising a derivation unit for deriving an EQ parameter change value based on the determined situation information when the second noise value is within a predetermined approximation range from the first noise value.
According to claim 10,
Wherein the output conversion unit changes an EQ parameter of the external device or the public terminal based on the derived EQ parameter change value.
A method for controlling sound through a public terminal,
Receiving voice data including a voice command spoken by a user;
measuring a first noise value before switching the output between the common terminal and an external device when the voice command corresponds to an output switching command;
switching an output between the common terminal and the external device based on the output switching command;
measuring a second noise value after the output is switched;
comparing the measured first noise value and the second noise value; and
and controlling sound between the public terminal and the external device based on a comparison result.
According to claim 12,
requesting a noise measurement to the control device of the public terminal based on the output conversion command when the voice command is received through the control device of the public terminal;
Receiving noise measurement information measured from the control device;
detecting reference signal information of sound being output from the public terminal based on the output switching command; and
Further comprising comparing the noise measurement information and the reference signal information of the sound, the sound control method.
According to claim 12,
Wherein the comparing step determines whether the second noise value corresponds to a predetermined approximation range from the first noise value.
15. The method of claim 14,
When the sound is being output from the public terminal before the output is switched, and the second noise value measured after the output is switched does not fall within a predetermined approximation range from the first noise value,
The controlling of the sound comprises controlling a volume of the external device.
15. The method of claim 14,
When the sound is being output from the external device before the output is switched, and the second noise value measured after the output is switched does not fall within a predetermined approximation range from the first noise value,
The controlling of the sound comprises controlling the volume of the public terminal.
In the computer program stored in a computer readable recording medium containing a sequence of instructions for controlling sound through a public terminal,
When the computer program is executed by a computing device mounted on a user terminal,
Receiving voice data including a voice command uttered by a user;
When the voice command corresponds to an output switching command, measuring a first noise value before switching the output between the common terminal and an external device;
Switching an output between the common terminal and the external device based on the output switching command;
Measuring a second noise value after the output is switched;
Comparing the measured first noise value and the second noise value;
A computer program stored in a computer readable recording medium comprising a sequence of instructions for controlling sound between the public terminal and the external device based on a comparison result.

Images