KR20190055535A - Sound Device with Function of Whistle Sound Recognition - Google Patents

Abstract

According to the present invention, a sound device for recognition of a whistle sound comprises: a sound module including a sound input unit to receive a sound signal and a sound output unit to output a sound signal; and a communication module including at least one communication unit connected to a communication network. The mountable sound device further comprises a control module including: a sound processing unit to buffer sound data corresponding to a sound signal of an audible frequency band inputted through the sound input unit in a designated buffer area or check sound data buffered in a designated buffer area; a whistle sound recognition unit to read the buffered sound data to recognize a specific whistle sound corresponding to at least one designated whistle sound frequency band and corresponding to at least one whistle sound pattern to recognize a whistle sound designated to determine a specific situation in a non-linguistic sound or noise which can be created in a designated space; and a service control unit to activate at least s (1<=s<=S) service functions related to the whistle sound among S (S>=1) designated service functions if the whistle sound is recognized.

Description

[0001] The present invention relates to a sound device having a whistling sound recognition function,

The present invention relates to a stationary sound apparatus having a sound module for inputting and outputting a sound signal and a communication module for connecting to a communication network, the sound data corresponding to the sound signal of the audible frequency band inputted through the sound module is read, Corresponding to at least one whistle sound frequency band designated for recognizing at least one whistle sound specified for a specific repayment of non-verbal sounds or noises and / or to at least one whistle sound pattern designated for recognizing the whistle sound (Or a combination of the two) of at least one of the sound module and the communication module when the user recognizes and attempts to recognize a specific whistling sound of the whistling sound, To provide a sound device.

Recently, a stationary sound device has been sold which recognizes a user's voice and provides a service corresponding to the recognized voice. For example, stationary sound devices such as 'echo' from Amazon, 'who' from SK Telecom, and 'Kigajini' from KT are sold.

However, the conventional stationary sound device is a combination of a sound source service and a speech recognition technology. The conventional stationary sound device operates mainly on a service for providing or reproducing a desired sound source through voice recognition, and has a difficulty in being used in other fields.

In order to solve the above problems, an object of the present invention is to provide a communication module including a sound module including a sound input unit for receiving a sound signal and a sound output unit for outputting a sound signal, and at least one communication unit for connecting to a communication network And at least one of at least one specified whistle sound for recognizing a specific non-audible sound or noise that can be generated in the designated space by reading the sound data corresponding to the sound signal of the audible frequency band inputted through the sound input unit, (S &gt; = 1) service functions specified when it recognizes and recognizes a specific whistling sound corresponding to one whistling sound frequency band and / or at least one whistle sound pattern designated for recognizing the whistling sound Enemies related to whistling There is also a s (1≤s≤S) equipped with equipped with a whistling sound recognition consisting of a control module to enable the function of the service to provide the sound device.

A sound device provided with a whistling sound recognition function according to the present invention includes a sound module including a sound input unit for receiving a sound signal and a sound output unit for outputting a sound signal and at least one communication unit for connecting to a communication network, A sound processing unit for buffering sound data corresponding to a sound signal of an audible frequency band inputted through the sound input unit in a designated buffer area or for checking sound data buffered in a designated buffer area; Corresponding to at least one whistle sound frequency band designated for recognizing a whistle sound designated for determining a specific situation of a non-verbal sound or noise that can be generated in the designated space by reading the sound data, (1? S? S) service functions related to the whistling sound among S (S? 1) service functions designated when the whistle sound is recognized, And a control module including a service control unit.

According to the present invention, the service control unit checks whether a whistling sound is not recognized for a predetermined period of time or a user's utterance is not recognized for a predetermined period of time or longer, and if a whistling sound or a user's utterance is not recognized for a predetermined period of time And a function of setting the operation mode of the sound device to a sleep mode.

According to the present invention, the whistling sound recognizing unit recognizes a whistling sound in a sleep mode, and when the whistling sound is recognized, the service controlling unit wakes up and displays s service functions related to the whistling sound May be included.

According to the present invention, the sleep mode may include a state in which the buffered sound data is read and the function of providing the service based on the recognized speech content is recognized by recognizing the user's speech content.

According to the present invention, the whistling sound recognizing unit may include a function of recognizing a whistling sound corresponding to a whistling sound frequency band of a whistling sound source and corresponding to a whistling sound pattern of the whistling sound generating source.

According to the present invention, the control module includes M whistle sound frequency band information corresponding to M (M? 1) whistle sound frequency bands and N whistle sound pattern information corresponding to N (N? 1) whistle sound patterns To the designated storage area.

According to the present invention, the whistle sound recognizing unit reads the buffered sound data and generates at least one whistle sound pattern corresponding to at least one whistle sound frequency band among the M whistle sound frequency bands, And a function of recognizing a corresponding whistling sound.

According to the present invention, the control module generates whistle sound frequency distribution information corresponding to at least i (i? 2) valid recognized whistle sound frequency distributions for a predetermined period using the M whistle sound frequency band information (1 &amp;le; m &amp;le; M) whistling sounds that are optimized (or fitted) to the whistling sound of the whistling sound source in the space in which the sound device is mounted, by statistically processing the generated whistle sound frequency distribution information And an information determination unit for determining m pieces of whistle sound frequency band information corresponding to the frequency band.

According to the present invention, the information storage unit may further comprise a function of newly setting or updating and storing the determined m number of whistle sound frequency bands as a whistle sound frequency band to be read first, and the whistle sound recognizing unit may store the buffered sound data And recognizing a whistle sound corresponding to at least one whistle sound frequency band among the stored m number of whistle sound frequency bands.

According to the present invention, the control module generates a whistling sound pattern distribution information corresponding to at least j (j? 2) valid recognized whistle sound pattern distributions for a predetermined period using the N whistle sound pattern information (1 &amp;le; n &amp;le; N) whistling sound patterns that are optimized (or fitted) to a whistling sound of a whistling sound source in a space in which the sound device is mounted, by statistically processing the generated whistling sound pattern distribution information And an information determination unit for determining n pieces of whistle sound pattern information corresponding to the n whistle sound pattern information.

According to the present invention, the information storage unit further includes a function of newly setting or updating and storing the determined n whistling sound patterns as a whistling sound pattern to be read out, and the whistling sound recognizing unit reads the buffered sound data And a function of first recognizing a whistling sound corresponding to at least one whistling sound pattern among the stored n whistling sound patterns.

According to the present invention, the control module may include a speech content recognition unit for reading the buffered sound data, recognizing the user's speech uttered by the user, processing natural language words and recognizing the speech content information corresponding to the user's speech content, A recognition determination unit for determining whether the user's utterance is recognized or recognized during a certain period of time after recognition of the whistle sound is recognized; And an intelligent processing unit for processing the recognized contents of the user in association with the s service functions related to the whistling sound when the contents of the speech are recognized.

According to the present invention, the service control unit may include a function of activating a specific service function corresponding to the whistling sound and corresponding to the uttered contents of the recognized user.

According to the present invention, the s services include a server interlocking service provided in cooperation with an operating server on a communication network through the communication module, a sound based service provided through the sound module, And at least one of the multiple services provided by the service provider.

According to the present invention, the server interworking service may include a calling service using wireless terminal information, a status notification service using wireless terminal information, a calling service using an application installed in the wireless terminal, a status notification service using an application installed in the wireless terminal, A video service providing video information photographed through a camera of the mobile terminal to an application installed in a wireless terminal, and a video service providing video information photographed through at least one camera to a designated IPTV device.

According to the present invention, the sound-based service may include a noise output service for outputting a designated service sound through a sound output unit of the sound module at a designated signal output intensity.

According to the present invention, the signal output intensity may include a signal intensity inversely proportional to the signal input intensity of the whistling sound.

According to the present invention, the composite service recognizes the user's utterance contents within a certain period of time during or after the whistling sound is recognized, and based on a result of analyzing the utterance contents of the user in association with a service function related to the whistling sound And services provided through an operating server on the network.

According to the present invention, the sound device provided with the whistling sound recognition function further includes a near-field camera device and a short-range module for performing short-range wireless communication, and the service controller communicates with the camera device via the short- And a function of activating a video service function for photographing a sound source generating the recognized whistle sound through the camera device.

According to the present invention, the communication module includes a short-distance network communication unit for connecting a camera apparatus in a short distance and a short-range wireless network-based wireless communication, and the service control unit communicates with the camera apparatus through the short- And activating a video service function for photographing a sound source that generates the recognized whistle sound.

According to the present invention, the sound device equipped with the whistling sound recognition function further includes a camera module for acquiring image information of a photographed subject, wherein the service control unit controls the camera module to generate the recognized whistle sound And a function of activating a video service function for photographing a sound source.

According to the present invention, the control module may further include a service providing unit for providing a service corresponding to the activated service function.

According to the present invention, in the case where at least one whistle sound designated for specific repayment determination among non-verbal sounds or noises that can be generated in a designated space is not recognized, the at least one whistle sound designated in order to recognize the whistle sound Recognizes a specific whistle sound corresponding to a frequency band and / or at least one whistle sound pattern designated for recognizing the whistle sound, and automatically wakes up in a sleep mode to recognize at least one service related to the whistling sound There is an advantage to provide a sound device that activates a function or provides a service related to the whistling sound.

1 is a functional block diagram of a sound device having a whistling sound recognition function according to an embodiment of the present invention.
2 is a functional block diagram of a sound device and an operation server according to another embodiment of the present invention.
FIG. 3 illustrates an embodiment for activating a service related to a whistling sound by recognizing a whistling sound according to an embodiment of the present invention.
FIG. 4 illustrates an embodiment of optimizing (or customizing) a whistle sound frequency band for recognizing a whistle sound according to an embodiment of the present invention to a whistle sound sound of a whistle sound source.
FIG. 5 illustrates an embodiment of optimizing (or customizing) a whistling sound pattern for recognizing a whistling sound to a whistling sound of a whistling sound generating source according to another embodiment of the present invention.
FIG. 6 illustrates an embodiment of activating a service related to a whistling sound in accordance with another embodiment of the present invention in which a whistling sound and a speaking content are associated with each other.

The operation principle of the preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings and description. It should be understood, however, that the drawings and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention, and are not to be construed as limiting the present invention.

In other words, the following embodiments correspond to the preferred embodiment of the preferred embodiment of the present invention. In the following embodiments, a specific configuration (or step) is omitted, or a specific configuration (or step) (Or steps), or an embodiment that incorporates functions implemented in more than one configuration (or step) into any one configuration (or step), a particular configuration (or step) It will be apparent that the present invention is not limited to the embodiments described below. Therefore, it should be clearly stated that various embodiments corresponding to subsets or combinations based on the following embodiments can be subdivided based on the filing date of the present invention.

In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. The terms used below are defined in consideration of the functions of the present invention, which may vary depending on the user, intention or custom of the operator. Therefore, the definition should be based on the contents throughout the present invention.

As a result, the technical idea of the present invention is determined by the claims, and the following embodiments are merely means for effectively explaining the technical idea of the present invention to a person having ordinary skill in the art to which the present invention belongs Only.

1 is a diagram showing a functional configuration of a sound device 100 having a whistling sound recognition function according to an embodiment of the present invention.

1 is a block diagram of a communication system including a sound module 105 including a sound input unit 105a for receiving a sound signal and a sound output unit 105b for outputting a sound signal and at least one communication unit for connecting to a communication network. A sound processing unit having a module 120 and buffering sound data corresponding to a sound signal of an audible frequency band inputted through the sound input unit 105a into a designated buffer area or confirming buffered sound data in a designated buffer area 140) and at least one whistle sound frequency band designated for recognizing at least one whistle sound designated for determining a specific situation of non-verbal sounds or noises that may occur in the designated space by reading the buffered sound data and / At least one designated frequency A whistle sound recognition unit 145 for recognizing a specific whistle sound corresponding to the sound pattern and at least s (1? S? 1) associated with the whistling sound among the S (S? 1) S) service functions of the sound device 100. The control module 130 includes a service controller 150 that activates service functions of the sound device 100, It is possible to refer to and / or modify the FIGURE 1 to derive various implementations (e.g., some of the components may be omitted, or fragmented, or combined) with respect to the sound device 100, The present invention is not limited to the above-described embodiments.

1, the sound apparatus 100 includes a sound module 105 including a sound input unit 105a for receiving a sound signal and a sound output unit 105b for outputting a sound signal, And a communication module (120) including at least one communication unit for connecting to a communication network. The communication module (120) includes a sound input unit (105a) for reading sound data corresponding to a sound signal of an audible frequency band, Corresponding to at least one whistle sound frequency band designated for recognizing at least one whistle sound designated for a specific situation of sound or noise and / or corresponding to at least one whistle sound pattern designated for recognizing the whistle sound When it is recognized and attempted to recognize a specific whistling sound, at least one It comprises a control module (130) comprising a configuration of one or more features for providing a given service activation function or the specified service function, and a power module (115) for supplying operation power. The sound device 100 may include at least one of a near field camera module 185 and a near field module 125 for processing short range wireless communication and a camera module 110 for acquiring image information of a subject (Not shown) including a key button or a touch pad for receiving a user's operation, and / or an LED or a display for outputting various operation states or information, (Not shown) including an output unit (not shown). On the other hand, in the embodiment of FIG. 1, the name "module" is a term for distinguishing and describing the function and role of the sound device 100 for convenience, but it does not itself refer to any independent hardware configuration I will.

The sound module 105 is a collective term for a sound input / output related component including at least one sound input portion 105a for receiving a sound signal from among the components of the sound device 100 and a sound output portion 105b for outputting a sound signal The sound input unit 105a and the sound output unit 105b can input or output sound signals of at least an audible frequency band and the sound input unit 105a and the sound output unit 105b can be connected to the control module 130, And an interface unit (not shown) for interfacing with the interface unit.

The sound input unit 105a is a collective term for receiving a sound signal. The sound input unit 105a encodes one or more microphones that receive a sound signal obtained by detecting the vibration of air and convert the sound into an electrical signal, and a sound signal according to a specified encoding rule And a program (and / or circuit) module for generating sound data. Preferably, the sound input unit 105a receives a sound signal of an audio frequency band (for example, a sound signal including a speech signal generated by the user) through the microphone, receives the input audio frequency band And provide the sound data generated by encoding the sound signal to the control module 130.

According to an embodiment of the present invention, the sound input unit 105a includes one or more directional microphones for searching for a direction in which the whistling sound is generated when a whistling sound is recognized in a space where the sound device 100 is mounted And the present invention is not limited thereto.

The sound output unit 105b is a collective term for outputting a sound signal and includes at least one speaker for outputting a sound signal and sound data to be outputted through the speaker and decoding the sound signal output through the speaker And a program (and / or circuit) module for controlling the signal output intensity and the output quality of the sound signal. Preferably, the sound output unit 105b outputs the sound signal generated by decoding the sound data requested to output sound through the control module 130 through the speaker, Amplifies or reduces the output intensity to a specified signal intensity (e.g., to a signal intensity that is set to be receivable (or audible) at a signal strength greater than or equal to a specified signal reception intensity at a distance greater than or equal to a specified reference distance, and / Amplified or reduced to a signal strength set to be capable of being received (or listened to) at a signal strength greater than or equal to the specified signal strength at a specified distance, and / or received at a signal strength greater than or equal to the specified signal strength at a specified distance, (Or listening) to a set signal strength (For example, speaker parameters such as Fs, Qts, Vas, etc.) of the sound output and / or blocking or suppressing the sound distortion as much as possible, The output quality of the sound is controlled so as to block / suppress the sound distortion caused by the resonance so that the sound component corresponding to the segmented sound on the sound signal is clearly defined so that the audibility (or audibility) The output quality of the sound is controlled so as to block or suppress the frequency at which the bit stream is encoded or the signal intensity when the bit stream is encoded and output, .

The communication module 120 collectively refers to a component for processing connection of a communication network of the sound apparatus 100. The communication module 120 preferably connects a designated server (or device) via a wireless network (e.g., a mobile communication network, a portable Internet, (Or a wireless LAN) via a wireless AP or a repeater, and a short-range wireless communication unit that communicates with a designated server (or device) via a communication channel, And a network communication unit 120b, and further includes an interface unit (not shown) for interfacing the communication unit with the control module 130. [

The wireless network communication unit 120a collectively refers to a communication unit that connects the sound device 100 to a wide area wireless network (e.g., a mobile communication network) via a base station. The wireless network communication unit 120a includes an antenna for transmitting and receiving a radio frequency signal of a designated frequency band, An RF module, a baseband module, and a signal processing module, and is connected to the controller 130a to transmit operation results corresponding to wireless communication among the various operation results of the controller 130a through a wireless network Or receives data through the wireless network and transmits the data to the controller 130a, and performs connection, registration, communication, and handoff procedures of the wireless communication.

According to an embodiment of the present invention, when the wireless network connected through the wireless network communication unit 120a is a mobile communication network, the wireless network communication unit 120a accesses a mobile communication network according to at least one mobile communication standard, , Call processing, call connection, data communication, and handoff. Meanwhile, according to the intention of those skilled in the art, the wireless network communication unit 120a may perform at least one of connection to a wide area wireless network other than the mobile communication network (e.g., portable Internet according to the IEEE 802.16 standard), location registration, data communication, And it is clear that the present invention is not limited by the wireless communication configuration provided by the wireless network communication unit 120a. That is, the wireless network communication unit 120a may provide wireless communication of packet communication based on the sound device 100 via a cell-based base station in a wireless network regardless of a frequency band of a wireless section, a type of a communication network, or a protocol It is a generic term for the components that connect to the data network.

The short-range network communication unit 120b communicates with a network access device (for example, a wireless AP or the like) provided near by using a radio frequency signal as a communication medium within a predetermined distance (for example, within 10m or within 30m) And a communication network for connecting the sound device 100 to a communication network to which the network access device is connected through a short-range wireless network for connecting the session. The communication resource is preferably a Wi-Fi based short range communication, a Bluetooth short range communication, A short-range wireless communication session between the sound device 100 and a network access device provided at a short distance through at least one of communication, UWB-based local area network communication, and public wireless communication, It can be connected to the communication network to which the network connection apparatus is connected.

According to an embodiment of the present invention, when the short-range wireless communication network 120b is connected to a short-range wireless communication session with a network access device located within a predetermined distance from the sound device 100, And connects the sound apparatus 100 to a data network that provides wireless data communication based on packet communication via a network connection device of the short-range wireless network. Hereinafter, for convenience, the network communication function of the sound apparatus 100 will be described focusing on an embodiment using the wireless network communication unit 120a. However, the present invention is not limited thereto, and the network communication function using the short- Is also provided.

Meanwhile, according to one embodiment of the present invention, the short-range network communication unit 120b transmits a short-range wireless network-based wireless signal to the camera device 185 located near the sound device 100 via the short- Communication can be processed. When the near-field communication unit 120b processes wireless communication based on the near-field wireless network with the near-field camera apparatus 185, the sound apparatus 100 and the camera apparatus 185 can communicate wirelessly based on the near- The sound device 100 and the camera device 185 can exchange key values for encryption communication at the time of storing the key value for the encrypted communication or connecting the wireless communication based on the local area wireless network, It is possible to perform encrypted communication using the key value.

The near-field module 125 is a collective term for a short-range wireless communication of the sound apparatus 100. The near-field module 125 preferably includes a short-range wireless unit 125a for connecting short-range wireless communication of a specified standard, 125a and an interface unit (not shown) for interfacing the control module 130 with each other. For example, the short range wireless unit 125a may process Bluetooth based short range wireless communication according to the Bluetooth standard. However, it is clear that the standard for the short-range wireless communication of the short-range wireless unit 125a is not limited to the Bluetooth standard but may include all the short-range wireless communication standards including Wi-Fi, ZigBee or UWB. Meanwhile, the near-field wireless unit 125a may be the near-field communication unit 120b according to an embodiment of the present invention.

The short-range wireless unit 125a is a collective term for a unit for processing short-range wireless communication of a specified standard, and may preferably include a Bluetooth unit for processing Bluetooth-based short-range wireless communication according to the Bluetooth standard. However, the short range wireless communication related configuration of the short range wireless unit 125a is not limited to the Bluetooth based short range wireless communication according to the Bluetooth standard, and it is possible to use short range wireless communication of various standards other than Bluetooth according to the intention of those skilled in the art , Wi-Fi-based short-range wireless communication according to Wi-Fi standard, ZigBee-based short-range wireless communication according to ZigBee standard, and UWB-based short-range wireless communication according to UWB standard. Available). For the sake of convenience, the short range wireless unit 125a processes the Bluetooth based short range wireless communication according to an embodiment of the present invention. However, the present invention is not limited thereto.

According to the embodiment of the present invention, the near-field module 125 (or the short-range wireless unit 125a) processes the short-range wireless communication of the designated standard with the camera apparatus 185 provided in the vicinity of the sound apparatus 100 . When the near-field module 125 (or the near-field wireless unit 125a) processes near-field wireless communication with the near-field camera apparatus 185, the sound apparatus 100 and the camera apparatus 185 can perform near- The sound device 100 and the camera device 185 can exchange key values for encrypted communication at the time of storing the key value for the encrypted communication or connecting the short distance wireless communication. It is possible to perform encrypted communication.

According to the embodiment of the present invention, when the sound device 100 is mapped to an application of a wireless terminal used by a user (for example, when an application specified in a user wireless terminal is installed and executed for the first time (or before mapping registration) The device identification information for identifying the sound device 100 and the identification information of the user wireless terminal (or the unique identification information of the user wireless terminal) are registered in the designated operation server 200 in the app of the terminal, The short range wireless unit 125a connects the short range wireless communication with the application of the matched user wireless terminal and transmits various identification information or processing information designated for processing a specific service Exchangeable. For example, information received in an application of a user wireless terminal in a designated operation server 200 or inputted or extracted or generated through an application of the user wireless terminal may be transmitted to the user via the short- Or transmitted to the control module 130 and processed (e.g., sent to the sound output or operational server 200) and / or received at the designated operating server 200 to the sound device 100, May be transmitted to the app of the user wireless terminal through the short-range wireless communication and processed (e.g., output to the screen or transmitted to the operation server 200).

The camera module 110 is a collective term for a camera section of the sound apparatus 100 and is preferably a camera section for acquiring image information (for example, an image) or image information And an interface unit (not shown) for interfacing the control unit 130 with the camera unit 110a. Meanwhile, when the camera module 110 (or the camera unit 110a) can be interlocked with the near-field camera device 185 through the near-field module 125 (or the near-field wireless unit 125a) and / The present invention is not limited thereto.

The camera unit 110a includes at least one lens unit for receiving an optical signal reflected from a subject, an image sensor unit for detecting an optical signal input through the lens unit and converting the optical signal into an electrical image signal, (For example, an infrared filter or the like) between the lens unit and the image sensor unit according to an embodiment of the present invention, . Meanwhile, the camera unit 110a includes an image signal processor (ISP) which processes the image information or image information according to a designated procedure for improving the quality of image information or image information generated through the image sensor unit .

Meanwhile, when the sound module 100 is provided with the camera module 110, the camera module 110 includes a driver for changing a photographing direction of the camera module 110a, and the control module 130 Or the camera module 110) controls the driving unit to read image information or image information generated through the image sensor unit of the camera unit 110a while changing the photographing direction of the camera unit 110a, (E.g., a person or a thing that generates a whistling sound) in a space such as a stationary space, and drives the driving unit to photograph the sound source through the camera unit 110a. If the sound input unit 105a included in the sound module 105 includes one or more directional microphones, the control module 130 (or the camera module 110) 105a to detect a whistling sound direction detected by the at least one directional microphone and drive the driving unit to photograph the whistling sound direction confirmed through the camera unit 110a.

The control module 130 is a collective term for controlling various operations of the sound device 100. The control module 130 preferably generates image data through the camera module 110, (Operation server 200) via the communication module 120, or a combination of two or more of the operations of the controller 130a and the controller 130a And a memory unit for storing various information and program codes necessary for the operation of the controller 130a.

The control unit 130a is a generic term for controlling the operation of the sound device 100. The control unit 130a may include at least one processor and an execution memory and / or may be configured to include various chips or control circuits, (E.g., a bus (BUS), etc.) with each component provided in the apparatus 100. [ According to the present invention, the control unit 130a loads at least one program code included in the sound apparatus 100 into the execution memory through the processor, and outputs the result through at least one configuration And controls the operation of the sound apparatus 100. [0033] FIG. The functional configuration of the present invention may be implemented in the form of a program code and / or a chip or a control circuit. For convenience of explanation, the program configuration and / Or a control circuit according to the present invention will be described with reference to the control unit 130a.

The memory unit is a general term of a nonvolatile memory corresponding to a storage resource of the sound device 100 and stores at least one program code executed through the control unit 130a and at least one data set used by the program code Respectively. The memory unit basically comprises a system program code and a system data set corresponding to the operating system of the sound apparatus 100, a communication program code and a communication data set for processing a wireless communication connection of the sound apparatus 100, and at least one application program Code and an application data set, and a program code and a data set corresponding to the functional configuration implementing the present invention can also be stored in the memory unit.

The power module 115 is a collective term for supplying / supplying power required for operation of the sound apparatus 100 and preferably includes an external power source (for example, an AC power source, a DC power source rectifying an AC power source, a USB power source, etc.) When the voltage value or the current value of the external power source is different from the voltage value or the current value required for the operation of the sound apparatus 100, (Not shown) for converting the power source voltage into an operating power source having a current value. Meanwhile, when the external power is supplied through the power supply unit or the external power is converted into the operation power through the power conversion unit, the power module 115 charges the external power or the operation power, And a power charging unit (not shown) that applies the charged power when the external power is not supplied.

According to the first embodiment of the present invention, the sound device 100 includes a dedicated sound device 100 designed for a whistling sound recognition-based service that recognizes a specified whistling sound in a designated space and provides a service related to the whistling sound, Lt; / RTI &gt;

According to a second embodiment of the present invention, the sound device 100 is provided with a speech recognition mode of operation for providing a known speech recognition based service, wherein a specific setting through a predetermined input provided in the sound device 100 The mode switching sound device 100 may be switched from the voice recognition mode to the whistle sound recognition mode for whistling sound recognition based on the specific voice recognition based on input or voice recognition.

According to the third embodiment of the present invention, the sound device 100 may be a composite sound device (not shown) manufactured to provide a well-known speech recognition-based service and simultaneously recognize a whistling sound according to the present invention, (100).

Referring to FIG. 1, the control module 130 recognizes recognition target information to be recognized for starting or processing a specific service among speech content information recognized through a speech recognition unit of the control module 130 and obtained through natural language processing And an information storage unit 135 for storing the information in a designated storage area of the memory unit.

When it is necessary to recognize the user's utterance contents in order to determine the initiation or processing of a specific service, the information storage unit 135 stores the recognition target information including the utterance content to be recognized from the utterance of the user, And mapping the service providing information for starting or processing of the specific service.

According to the embodiment of the present invention, the recognition object information to be mapped with the service provision information may be specified including the predetermined speech content, and / or may be provided to the user through the sound output section 105b of the sound apparatus 100 After the speech content to be used as the recognition object information is requested, it is input through the sound input unit 105a and can be acquired and registered / updated through natural language processing. Meanwhile, according to an embodiment of the present invention, the recognition object information can be registered / updated through an application of a user wireless terminal mapped to the sound device 100, and thus the present invention is not limited thereto.

Referring to FIG. 1, the control module 130 buffers sound data corresponding to a sound signal of an audible frequency band inputted through the sound input unit 105a in a designated buffer area or sound data corresponding to sound data And at least one whistle sound frequency designated to recognize at least one whistle sound specified for determining a specific one of the non-acoustic sounds or noises that can be generated in the designated space by reading the buffered sound data, A whistle sound recognition unit (145) for recognizing a specific whistle sound corresponding to at least one whistle sound pattern corresponding to the band and / or the whistle sound pattern specified for recognizing the whistle sound; S? 1) service functions, at least s (1? S S) service functions and / or set the operation mode of the sound apparatus 100 to a sleep mode when a whistling sound or a user's utterance is not recognized for a predetermined period of time or longer, And a service providing unit 180 for providing a service corresponding to the activated service function. The whistling sound recognizing unit 145 may be configured to receive the at least one of the service controlling unit 150 and the service providing unit 180. The at least one of the whistling sound recognizing unit 145, If the whistle sound recognition unit 145 is implemented in the operation server 200, the sound processing unit 140 may transmit the sound data buffered in the designated buffer area to the operation server 200 Alternatively, sound data determined to correspond to whistling sound among the buffered sound data may be selectively extracted and provided to the operation server 200. [ 1 for the sake of convenience, the features of the present invention will be described with reference to an embodiment in which the whistling sound recognition unit 145, the service control unit 150, and the service providing unit 180 are implemented through the sound apparatus 100 . If the whistle sound recognition unit 145, the service control unit 150 and the service providing unit 180 are implemented through the sound device 100, the whistle sound recognition unit 145, the service control unit 150, The study 180 may be implemented in the form of a program code and a chip or a control circuit in a form of a combination of at least one or both of the whistle sound recognition unit 145 and the service control unit 150 and the service providing unit 180 And the present invention is not limited by the method of implementation or the module to be implemented.

After the operating power is applied to the sound device 100 through the power module 115, the sound processor 140 receives the sound data corresponding to the sound signal of the audio frequency band input through the sound input unit 105a, (Or repeats) the process of buffering the buffered sound data in the designated buffer area and / or checking the buffered sound data in the designated buffer area. The whistle sound recognition unit 145 reads the buffered sound data, At least one whistle sound frequency band corresponding to at least one whistle sound frequency band designated for recognizing at least one whistle sound specified for a specific situation among non-verbal sounds or noises that can be generated and / (Or repeats) the process of recognizing a specific whistling sound corresponding to All. When the whistle sound recognition unit 145 is implemented in the operating server 200, the sound processing unit 140 provides the buffered sound data to the operating server 200 or the buffered sound data It is possible to selectively extract the sound data corresponding to the whistling sound and to provide the extracted sound data to the operation server 200. Accordingly, the present invention is not limited thereto.

The service controller 150 determines whether a whistling sound is recognized for a predetermined period of time after the operation power is applied to the sound device 100 and / or confirms a whistling sound through the whistling sound recognition unit 145 And / or to check whether the whistling sound of the user has been recognized for a predetermined period of time or longer after the operating power is applied to the sound device 100, and / or (For example, when the whistle sound is recognized through the whistle sound recognizing unit 145 and the user's utterance is recognized within a certain period of time after the recognition of the user's utterance is performed) Can not be recognized. If the whistle sound is not recognized for a predetermined period of time or the user's speech content is not recognized for a predetermined period of time or longer, the service controller 150 sets the operation mode of the sound device 100 (or the control module 130) And a function of setting a sleep mode. Here, the sleep mode reads the buffered sound data and recognizes the whistling sound even if the user's utterance is recognized. The sleep mode wakes up in the sleep mode and / or pre-specified specific utterance information (e.g., whistling sound (E.g., specific speaking information set to wake up the sound apparatus 100), and recognizes a service (e.g., a sound source or a beep sound as a sound based on the speaking content of the recognized user before waking up in the sleep mode) And a sound-based service for outputting sound). Hereinafter, the features of the present invention will be described focusing on an embodiment in which a whistle sound is recognized for a sake of convenience and wakes up in a sleep mode.

According to the embodiment of the present invention, the sound processing unit 140 buffers the sound data corresponding to the sound signal of the audible frequency band inputted through the sound input unit 105a in the sleep mode in the designated buffer area and / It is preferable that the process of confirming the buffered sound data in the designated buffer area is continued (or repeated), and the whistle sound recognition unit 145 also reads the buffered sound data in the sleep mode, Corresponding to at least one whistle sound frequency band designated for recognizing at least one whistle sound designated for a specific situation of sound or noise and / or corresponding to at least one whistle sound pattern designated for recognizing the whistle sound The process of recognizing a specific whistling sound It is preferable that in (or repeat). Preferably, when the whistle sound is effectively recognized through the whistle sound recognition unit 145 in the sleep mode, the service control unit 150 may wake up to activate s service functions related to the whistling sound, The service providing unit 180 may perform a procedure of providing a service corresponding to the activated s service functions.

Meanwhile, when two or more service functions related to a whistling sound are activated through the service control unit 150, the service providing unit 180 performs a procedure of providing a service corresponding to the activated service function in a designated order And / or a process of providing at least one service according to a predetermined condition among the activated service functions (for example, a condition for recognizing a user's utterance).

According to the method of the present invention, the whistle sound recognizing unit 145 recognizes a whistling sound corresponding to the whistling sound frequency band of the whistling sound generating source and / or a whistling sound unique to the whistling sound generating source corresponding to the whistling sound pattern of the whistling sound generating source The control module 130 may recognize at least one whistle sound frequency band specific to the whistle sound source and / or at least one whistle sound pattern specific to the whistle sound source .

Referring to FIG. 1, the control module 130 stores M whistle sound frequency band information corresponding to M (M? 1) whistle sound frequency bands in a designated storage area and / or N The whistle sound recognizing unit 145 recognizes the whistle sound pattern information corresponding to the whistle sound patterns stored in the designated storage area, The whistling sound can be recognized using information and / or whistling sound pattern information. According to another embodiment of the present invention, at least one component of the information storage unit 135 and the whistling sound recognition unit 145 is implemented through the operation server 200 on the communication network interlocked with the sound apparatus 100 . However, for the sake of convenience, the features of the present invention will be described with reference to an embodiment in which the information storage unit 135 and the whistling sound recognition unit 145 are implemented through the sound apparatus 100. [ If the information storage unit 135 and the whistle sound recognition unit 145 are implemented through the sound device 100, the information storage unit 135 and the whistle sound recognition unit 145 may store the program code form, Circuit type, or a combination of two or more. The present invention is not limited to the embodiments in which the information storage unit 135 and the whistling sound recognition unit 145 are implemented or a module is implemented.

The information storage unit 135 stores M pieces of whistle sounds corresponding to M (M? 1) whistle sound frequency bands in a designated storage area of the memory unit at the time of manufacturing the control module 130 (or the sound device 100) Frequency band information can be stored. The whistle sound designated for determining a specific situation among the non-verbal sounds or noises that can be generated in the space designated in the present invention may be varied in accordance with the kind of sound or the sound source (or a frequency difference between the lowest frequency and the highest frequency is at least 100 Hz) Frequency band. Accordingly, the present invention can divide the frequency band of the whistling sound into M frequency bands (for example, uniformly divided or selectively divided based on a plurality of frequency bands in which whistling sound is concentrated experimentally) May store M whistle sound frequency band information corresponding to the divided M whistle sound frequency bands in a designated storage area.

The information storage unit 135 stores N whistle sound patterns corresponding to N (N? 1) whistling sound patterns in a designated storage area of the memory unit at the time of manufacturing the control module 130 (or the sound device 100) Information can be stored in the designated storage area. The present invention first generates whistling sound pattern information through a qualitative analysis and / or a quantitative analysis process for the whistling sound patterns confirmed through the sample experiment, and the information storage unit 135 stores the generated whistling sound patterns Information can be stored in the designated storage area.

Meanwhile, according to the method of the present invention, the sound device 100 (or the control module 130) can recognize the whistle sound and then transmit the recognized whistle sound information to the designated operation server 200, The server 200 performs a normalization process of collecting whistle sound information from each sound device 100 (or the control module 130), normalizing the individual sound characteristics of each sound source in the collected whistle sounds, Or whiteness pattern information can be refined or diversified through qualitative analysis and / or quantitative analysis for each case, and the precise or diversified whistle sound pattern information can be provided to each sound device 100 (130). The information storage unit 135 receives the refined or diversified whistle sound pattern information from the operation server 200 and stores N whistle sound pattern information including the received whistle sound pattern information Can be stored in a designated storage area.

The information storage unit 135 matches the generated whistle sound pattern information with one or more context determination attribute information for determining a specific situation in a specified space at a time when the sound device 100 recognizes the whistling sound, Can be stored in the storage area.

Here, the specific situation may be an emergency situation, a returning state of a specific person, a visiting situation of a specific person, and the like, but various situations may be suggested in the course of the practice of a person skilled in the art.

According to an embodiment of the present invention, M whistle sound frequency band information corresponding to M whistle sound frequency bands is stored in the designated storage area and / or N whistle sound patterns corresponding to N whistle sound patterns are stored in the designated storage area When the sound pattern information is stored, the whistle sound recognizing unit 145 reads the buffered sound data and corresponds to at least one whistle sound frequency band among the stored M whistle sound frequency bands and / It is preferable to recognize a whistling sound corresponding to at least one whistling sound pattern among the whistling sound patterns.

Meanwhile, the M whistle sound frequency band information and / or the N whistle sound pattern information stored in the designated storage area are not optimized (or customized) to the whistling sound of the whistling sound generating source, but the frequency band of the statistical whistling sound and / Information corresponding to the pattern. Accordingly, in order to recognize the whistle sound of the whistle sound source present in the space where the sound device 100 is mounted and / or prevent (or minimize) the recognition error, the stored whistle sound frequency band information and / It is necessary to optimize (or customize) the pattern information to the whistling sound of the whistling sound source.

Referring to FIG. 1, the control module 130 determines whether or not a whistle sound frequency corresponding to at least i (i? 2) valid recognized whistle sound frequency distributions for a predetermined period using the M whistle sound frequency band information Generating distribution information to generate whistling sound pattern distribution information corresponding to at least j (j? 2) valid recognized whistle sound pattern distributions for a predetermined period using the N whistle sound pattern information and / (1 &lt; / = m &lt; / = M) optimized for (or customized to) the whistling sound of the whistling sound source in the space where the sound device 100 is mounted, ) Whistle sound frequency band information corresponding to the number of whistle sound frequency bands corresponding to the number of whistle sound frequency band information and / (1? N? N) whistle sound patterns optimized (or customized) to the whistling sound of the whistling sound source in the space where the sound device 100 is placed And an information determination unit 160. According to another embodiment of the present invention, at least one component of the distribution generating unit 155 and the information determining unit 160 is implemented through the operating server 200 on the communication network interlocked with the sound apparatus 100 . 1 for the sake of convenience, the characteristics of the present invention will be described mainly with reference to an embodiment in which the distribution generating unit 155 and the information determining unit 160 are implemented through the sound apparatus 100. FIG. If the distribution generating unit 155 and the information determining unit 160 are implemented through the sound apparatus 100, the distribution generating unit 155 and the information determining unit 160 may be implemented in the form of a program code and a chip or a control circuit And the present invention is not limited to the method of implementing the distribution generating unit 155 and the information determining unit 160 and the implemented modules.

If the M whistle sound frequency band information corresponding to the M whistle sound frequency bands is stored in the storage area designated through the information storage unit 135, the distribution generating unit 155 generates the M whistle sound frequency band information, The frequency band information of the effectively recognized whistle sound can be stored in the designated storage area whenever the whistle sound is effectively recognized using the sound frequency band information. The distribution generating unit 155 generates at least i (i? 2) valid recognized i whistle sound frequency bands for a predetermined period based on the whistle sound frequency band that is effectively recognized and stored through the M whistle sound frequency band information And generate whistle sound frequency distribution information corresponding to the distribution of the identified i whistle sound frequency bands.

Meanwhile, when the whistle sound frequency distribution information corresponding to the whistle sound frequency distribution that has been effectively recognized at least i times for a predetermined period is generated through the distribution generating unit 155, the information determining unit 160 determines that the generated whistle sound frequency (Or customized) to the whistling sound of the whistling sound source in the space through which the sound device 100 is placed, thereby to quickly recognize (or minimize) the whistling sound of the whistling sound source, M whistle sound frequency band information corresponding to m (1? M? M) whistle sound frequency bands corresponding to the number of whistle sound frequency bands. Here, the m whistle sound frequency bands may be any of the M whistle sound frequency bands, or may include a newly defined whistle sound frequency band within the whistle sound frequency band. If the m number of whistle sound frequency band information is determined through the information determination unit 160, the information storage unit 135 sets the determined m number of whistle sound frequency bands to a whistle sound frequency band to be read first, Area, or may update and store the whistle sound frequency band information stored in the storage area. Then, the whistle sound recognition unit 145 may read the buffered sound data and recognize the whistle sound corresponding to at least one whistle sound frequency band among the m or new updated frequency bands.

If the N whistle sound pattern information corresponding to the N whistle sound patterns is stored in the storage area designated through the information storage unit 135, the distribution generating unit 155 generates the N whistle sound patterns stored in the designated storage area The sophisticated pattern of the effectively recognized whistle sound can be stored in the designated storage area whenever the whistle sound is effectively recognized using the pattern information. The distribution generating unit 155 checks at least j (j? 2) validly recognized j whistling sound patterns for a predetermined period based on the whistle sound pattern information effectively recognized and stored through the N whistle sound pattern information And generate whistling sound pattern distribution information corresponding to the distribution of the identified j number of whistling sound patterns.

If the whistle sound pattern distribution information corresponding to the whistle sound pattern distribution that is effectively recognized at least j times is generated during the predetermined period through the distribution generating unit 155, the information determining unit 160 determines the whistling sound pattern (Or customized) to the whistling sound of the whistling sound source in the space through which the sound device 100 is placed, thereby to quickly recognize (or minimize) the whistling sound of the whistling sound source, N whistling sound pattern information corresponding to n (1? N? N) whistling sound patterns for determining the whistling sound pattern information. Here, the n whistling sound patterns may be any one of the N whistling sound patterns, or a combination of two or more whistling sound patterns or a new whistling sound pattern. When the n whistle sound patterns are determined through the information determination unit 160, the information storage unit 135 sets the determined n whistle sound patterns as a whistle sound pattern to be read out first, and newly stores the whistle sound patterns in a designated storage area The whistle sound frequency band information stored in the storage area can be updated and stored. Then, the whistle sound recognition unit 145 may read the buffered sound data and recognize a whistling sound corresponding to at least one whistling sound pattern out of the n whistling sound patterns.

Referring to FIG. 1, the control module 130 includes a speech recognition unit (speech recognition unit) 130 that reads the buffered sound data and recognizes the user's speech utterance and processes the speech in a natural language to recognize utterance content information corresponding to the utterance contents of the user A recognition unit 170 for recognizing whether the user's utterance is recognized while the whistle sound is recognized or whether the user's utterance is recognized within a predetermined period of time after the recognition of the whistle sound is recognized; And an intelligent processing unit (175) for processing the contents of the user's utterance in association with s service functions related to the whistling sound when the utterance contents of the user are recognized within a predetermined period of time have. According to another embodiment of the present invention, at least one of the speech recognition unit 165, the recognition determination unit 170, and the intelligent processing unit 175 may be connected to an operating server (not shown) If the speech recognition unit 165 is implemented in the operation server 200, the sound processing unit 140 may transmit the sound data buffered in the designated buffer area to the operation server 200 Or selectively extract sound data determined to correspond to a user utterance among the buffered sound data and provide the sound data to the operation server 200. [ 1, the features of the present invention will be described with reference to an embodiment in which the speech recognition unit 165, the recognition determination unit 170, and the intelligent processing unit 175 are implemented through the sound apparatus 100 . If the speech recognition unit 165, the recognition determination unit 170, and the intelligent processing unit 175 are implemented through the sound device 100, the speech recognition unit 165, the recognition determination unit 170, The processing unit 175 may be implemented in the form of a program code and a chip or a control circuit in a form of a combination of at least one or both of the program codes and the speech recognition unit 165, the recognition / determination unit 170, and the intelligent processing unit 175 And the present invention is not limited by the method of implementation or the module to be implemented.

The whistling sound recognition unit 145 reads the buffered sound data and recognizes a whistling sound, and the speech recognition unit 165 reads the buffered sound data, And performs a process of recognizing the utterance contents information corresponding to the utterance contents of the user. When the speech recognition unit 165 is implemented in the operating server 200, the sound processing unit 140 provides the buffered sound data to the operating server 200 or the buffered sound data The sound data determined to correspond to the user's utterance (including, for example, segmented sounds) can be selectively extracted and provided to the operation server 200, so that the present invention is not limited thereto.

According to the embodiment of the present invention, the speech recognition unit 165 analyzes the buffered sound data through a designated speech recognition algorithm, recognizes and texts the speech uttered by the user, and performs a morphological analysis, a semantic analysis, The user can generate the utterance content information that recognizes the uttered utterance through the natural language processing procedure in the analysis.

Meanwhile, according to the embodiment of the present invention, the whistling sound recognizing unit 145 recognizes the whistling sound and determines that the operating mode of the service device is in the sleep mode through the service controlling unit 150 It is desirable to perform the function of recognizing the user's utterance contents when the user wakes up. If the operation mode of the sound device 100 is set to the sleep mode by the service controller 150, the speech recognition unit 165 may not perform the function of recognizing the user's utterance, Even if the user's speech content is recognized, it can be processed so as not to be used for the service.

Meanwhile, when the user's utterance is recognized through the utterance recognition unit 165, the recognition determiner 170 recognizes the utterance of the user while the whistle sound is recognized through the whistle sound recognition unit 145 Or whether or not the user's utterance is recognized within a predetermined period of time after the recognition of the whistle sound is completed through the whistle sound recognition unit 145. [

If it is confirmed that the user's utterance is recognized within a certain period of time before or after the whistling sound is recognized through the recognition determination unit 170, the intelligent processing unit 175 recognizes the utterance content of the user, So that the specific service function corresponding to the speech content among the s service functions related to the whistling sound can be determined. In this case, the service control unit 150 may activate a specific service function corresponding to the specific sound and at the same time, the specific service function corresponding to the recognized user's utterance, and the service providing unit 180 may transmit the activated specific service function The procedures provided may be performed according to specified procedures.

If the user's utterance is not recognized within a predetermined period of time during or after the whistling sound is recognized through the recognition determination unit 170, the intelligent processing unit 175 receives the sleep mode through the service control unit 150, And / or performing a process of being woken up in the sleep mode by the whistling sound.

According to an embodiment of the present invention, the s services related to the whistling sound activated by the service control unit 150 and / or provided through the service providing unit 180 may be transmitted through the communication module 120, A server-interlocking service provided in cooperation with the operation server 200, a sound based service provided through the sound module 105, and a composite service providing a combined use of the sound module 105 and the communication module 120 And / or &lt; / RTI &gt;

Meanwhile, among the s services related to the whistling sound, the server interworking service may include a paging service using wireless terminal information, a status notification service using wireless terminal information, a paging service using an application installed in the wireless terminal, A status notification service, a video service for providing video information photographed through at least one camera to an application installed in a wireless terminal, and a video service for providing video information photographed through at least one camera to a designated IPTV device . &Lt; / RTI &gt;

Meanwhile, the sound-based service among the s services related to the whistling sound may include a noise output service for outputting a designated service sound through a sound output unit 105b of the sound module 105 at a designated signal output intensity, Preferably, the signal output intensity of the sound-based service includes a signal intensity in inverse proportion to the signal input intensity of the whistling sound.

Meanwhile, among the s services related to the whistling sound, the composite service recognizes the user's utterance contents within a certain period of time during or after the whistling sound is recognized and correlates the utterance contents of the user with the service functions related to the whistling sound And a service provided through the operation server 200 on the communication network based on the result.

In the meantime, according to the first camera embodiment of the present invention, the sound device 100 is provided with a camera device 185 in the vicinity and a short-range module 125 for processing short-range wireless communication, When the whistle sound is recognized through the whistle sound recognition unit 145, the service control unit 150 determines whether the whistle sound is received by the camera module 185 through the near- The user can activate s service functions including a video service function for communicating with the device 185 and photographing a sound source that generates the recognized whistling sound through the camera device 185, Communicates with the camera device 185 through the near field module 125 and receives image information photographed through the camera device 185 to receive the image information through the camera device 185 and to receive Providing a video service and / or that can provide at least one image of the video service IPTV service provided by the specified device. On the other hand, when the camera apparatus 185 can provide the image service, the service provider 180 may process the image service function of the camera apparatus 185 to operate through the near field module 125.

Alternatively, a short-range wireless network-based wireless communication may be performed with the near-field camera device 185 through the short-range network communication unit 120b of the communication module 120 provided in the sound device 100 according to the second camera embodiment of the present invention. The service control unit 150 communicates with the camera device 185 via the local area network communication unit 120b to recognize the whistling sound through the whistling sound recognition unit 145. The camera device 185 The service providing unit 180 may activate the s service functions including a video service function for photographing a sound source generating the recognized whistle sound through the short distance network communication unit 120b A video service that communicates with the camera device 185 and receives image information photographed through the camera device 185 and provides the appended image to an application installed in the wireless terminal through the operation server 200 and / Of the video service provided by the IPTV system can provide the at least one video service. On the other hand, when the camera apparatus 185 can provide the image service, the service provider 180 can process the image service function of the camera apparatus 185 through the near-field communication unit 120b.

Alternatively, in the case where the camera module 110 for acquiring image information of a subject photographed by the sound device 100 is provided according to the third camera embodiment of the present invention, the service control unit 150 may include the whistle sound recognition unit 145), the service providing unit 180 may activate a video service function for photographing a sound source that generates the recognized whistle sound through the camera module 110, A video service for providing video information photographed through the camera module 110 to an application installed in a wireless terminal through the operation server 200 and / or a video service for providing to a designated IPTV device can be provided have.

2 is a functional block diagram of a sound device 100 and an operation server 200 according to another embodiment of the present invention.

2 illustrates an embodiment in which at least a functional configuration of a functional configuration of the control module 130 of the sound apparatus 100 shown in FIG. 1 is implemented on the operation server 200 side, Those skilled in the art will appreciate that the embodiments of FIGS. 1 and 2 may be modified at least in part by reference to and / or modified from FIG. 2 Some of the functional configurations implemented in the operating server 200 may be directly implemented in the operating server 200 but a part of the functional configurations may be implemented in the control module 130 of the sound device 100, A part of the functional configuration implemented in the control module 130 as it is but a part of the functional configuration implemented in the operating server 200 side is omitted in the figure, and a part of the configuration shown in FIG. 1 and FIG. 2 is omitted, Alternatively, ) Would be able to infer, the present invention includes all embodiments wherein the method is inferred as the scope, not limited that the technical features of only the exemplary method shown in the figure 1 and the drawing 2.

Referring to FIG. 2, the operation server 200 includes a sound receiving unit 205 for receiving sound data input through a sound input unit 105a of a designated sound device 100 and temporarily storing the sound data in a designated storage medium, Read out the received sound data to correspond to at least one whistle sound frequency band designated for recognizing at least one whistle sound specified for determining a specific situation among non-loud sounds or noises that may occur in the designated space, and / A whistle sound recognizing unit 145 for recognizing a specific whistle sound corresponding to at least one whistle sound pattern designated for recognizing a whistling sound, a whistling sound among S (S? 1) service functions designated when the whistling sound is recognized, Activating at least s (1? S? S) service functions and / or whistling And a service controller 150 for setting an operation mode of the sound device 100 to a sleep mode when no sound or a user's utterance is recognized, and a service corresponding to the activated service function is provided And a service providing unit 180.

The sound receiving unit 205 receives the sound data transmitted from the sound apparatus 100 and temporarily stores the sound data in the designated storage medium in the designated sound apparatus 100. [ Can be stored. On the other hand, in the case where the sound device 100 selectively transmits sound data corresponding to a whistle sound or sound data corresponding to a user utterance, the sound receiving unit 205 receives the sound data from the sound device 100 The sound data selectively transmitted may be received and temporarily stored in a designated storage medium.

The whistle sound recognizing unit 145 reads the received sound data and generates at least one whistle sound frequency band designated to recognize at least one whistle sound specified for determining a specific situation among non- (Or repeats) the process of recognizing a specific whistling sound corresponding to at least one whistling sound pattern designated to recognize the whistling sound and / or to recognize the whistling sound.

The service controller 150 determines whether a whistling sound is recognized for a predetermined period of time after the operation power is applied to the sound device 100 and / or confirms a whistling sound through the whistling sound recognition unit 145 And / or to check whether the whistling sound of the user has been recognized for a predetermined period of time or longer after the operating power is applied to the sound device 100, and / or (For example, when the whistle sound is recognized through the whistle sound recognizing unit 145 and the user's utterance is recognized within a certain period of time after the recognition of the user's utterance is performed) Can not be recognized. If the whistling sound is not recognized for a predetermined period of time or the user's speech is not recognized for a predetermined period of time or longer, the service control unit 150 sets the operation mode of the sound device 100 to a sleep mode And the like.

According to an embodiment of the present invention, the sound device 100 can transmit the input sound data in a sleep mode, and the sound receiver 205 can receive sound data in a sleep mode, The whistle sound recognition unit 145 reads the received sound data in a state where the operation mode of the sound device 100 is in the sleep mode and outputs the non-acoustic sound or noise Corresponding to at least one whistle sound frequency band designated for recognizing at least one whistle sound designated for a specific situation determination and / or a specific whistle sound corresponding to at least one whistle sound pattern designated for recognizing the whistle sound (Or repeats) the process of recognizing the user. Preferably, when the whistle sound is effectively recognized through the whistle sound recognition unit 145 in the sleep mode, the service control unit 150 wakes up the sound device 100, And the service providing unit 180 may perform a procedure of providing a service corresponding to the activated s service functions.

Meanwhile, when two or more service functions related to a whistling sound are activated through the service control unit 150, the service providing unit 180 performs a procedure of providing a service corresponding to the activated service function in a designated order And / or a process of providing at least one service according to a predetermined condition among the activated service functions (for example, a condition for recognizing a user's utterance).

According to the method of the present invention, the whistle sound recognizing unit 145 recognizes a whistling sound corresponding to the whistling sound frequency band of the whistling sound generating source and / or a whistling sound unique to the whistling sound generating source corresponding to the whistling sound pattern of the whistling sound generating source The operating server 200 may recognize at least one whistle sound frequency band specific to the whistle sound source and / or at least one whistle sound pattern specific to the whistle sound source .

Referring to FIG. 2, the operation server 200 may store M whistle sound frequency band information corresponding to M (M? 1) whistle sound frequency bands in a designated storage medium and / or N ) Whistling sound pattern information corresponding to the number of whistle sound patterns in the specified storage medium, and the whistle sound recognition unit (145) The whistling sound can be recognized using information and / or whistling sound pattern information.

The information storage unit 135 may store M whistle sound frequency band information corresponding to M (M? 1) whistle sound frequency bands in a designated storage medium. The whistle sound designated for determining a specific situation among the non-verbal sounds or noises that can be generated in the space designated in the present invention may be varied in accordance with the kind of sound or the sound source (or a frequency difference between the lowest frequency and the highest frequency is at least 100 Hz) Frequency band. Accordingly, the present invention can divide the frequency band of the whistling sound into M frequency bands (for example, uniformly divided or selectively divided based on a plurality of frequency bands in which whistling sound is concentrated experimentally) May store M whistle sound frequency band information corresponding to the divided M whistle sound frequency bands in a designated storage medium.

The information storage unit 135 may store N whistle sound pattern information corresponding to N (N? 1) whistle sound patterns in a designated storage medium in a designated storage medium. The present invention first generates whistling sound pattern information through a qualitative analysis and / or a quantitative analysis process for the patterns of whistling sounds confirmed through sample experiments, and the information storage unit 135 stores the generated whistling sound patterns Information can be stored in the designated storage medium.

According to an embodiment of the present invention, the sound device 100 may recognize the whistle sound and then transmit the recognized whistle sound information to the designated operation server 200. The intelligent processing unit 175 of the operation server 200 ) Collects whistle sound information from each sound device 100, and performs a normalization process for normalizing individual sound characteristics of each sound source in the collected whistle sounds and / or a normalization process for each case and / Through the analysis process, the whistling sound pattern information can be refined or diversified. The information storage unit 135 receives the refined or diversified whistle sound pattern information through the above process and stores the N whistle sound pattern information including the received whistle sound pattern information in a designated storage medium .

According to an embodiment of the present invention, M whistle sound frequency band information corresponding to M whistle sound frequency bands is stored in the designated storage medium and / or N whistle sound patterns corresponding to N whistle sound patterns are stored in the designated storage medium When the sound pattern information is stored, the whistle sound recognizing unit 145 reads the received sound data, and corresponds to at least one whistle sound frequency band among the stored M whistle sound frequency bands and / It is preferable to recognize a whistling sound corresponding to at least one whistling sound pattern among the whistling sound patterns.

On the other hand, the M whistle sound frequency band information and / or N whistle sound pattern information stored in the designated storage medium are not optimized (or customized) to the whistling sound of the whistling sound source, but are frequency bands of the statistical whistling sound and / Information corresponding to the pattern. Accordingly, in order to recognize the whistle sound of the whistle sound source present in the space where the sound device 100 is mounted and / or prevent (or minimize) the recognition error, the stored whistle sound frequency band information and / It is necessary to optimize (or customize) the pattern information to the whistling sound of the whistling sound source.

Referring to FIG. 2, the operation server 200 determines whether a whistle sound frequency corresponding to at least i (i? 2) valid recognized whistle sound frequency distributions for a predetermined period of time using the M whistle sound frequency band information Generating distribution information to generate whistling sound pattern distribution information corresponding to at least j (j? 2) valid recognized whistle sound pattern distributions for a predetermined period using the N whistle sound pattern information; (1 &lt; / = m &lt; / = M) optimized for (or customized to) the whistling sound of the whistling sound source in the space where the sound device 100 is placed, ) Whistle sound frequency band information corresponding to the number of whistle sound frequency bands corresponding to the number of whistle sound frequency band information and / (1? N? N) whistle sound patterns optimized (or customized) to the whistling sound of the whistling sound source in the space where the sound device 100 is placed And an information determination unit 160.

If the M whistle sound frequency band information corresponding to the M whistle sound frequency bands is stored in the storage medium designated through the information storage unit 135, the distribution generating unit 155 generates the M whistle sound frequency band information, (I) a valid whistle sound frequency band of at least i (i 2) times for a predetermined period of time using the sound frequency band information, and a whistle sound frequency distribution corresponding to the identified distribution of the whistle sound frequency band Information can be generated.

Meanwhile, when the whistle sound frequency distribution information corresponding to the whistle sound frequency distribution that has been effectively recognized at least i times for a predetermined period is generated through the distribution generating unit 155, the information determining unit 160 determines that the generated whistle sound frequency (Or customized) to the whistling sound of the whistling sound source in the space through which the sound device 100 is placed, thereby to quickly recognize (or minimize) the whistling sound of the whistling sound source, M whistle sound frequency band information corresponding to m (1? M? M) whistle sound frequency bands corresponding to the number of whistle sound frequency bands. Here, the m whistle sound frequency bands may be any of the M whistle sound frequency bands, or may include a newly defined whistle sound frequency band within the whistle sound frequency band. If the m number of whistle sound frequency band information is determined through the information determination unit 160, the information storage unit 135 sets the determined m number of whistle sound frequency bands to a whistle sound frequency band to be read first, It may be newly stored in the medium or the whistle sound frequency band information stored in the storage medium may be updated and stored. Then, the whistle sound recognizing unit 145 may recognize the whistle sound corresponding to at least one whistle sound frequency band among the m or whichever newly-stored frequency bands by reading the received sound data.

Meanwhile, when N whistle sound pattern information corresponding to N whistler sound patterns is stored in the storage medium designated through the information storage unit 135, the distribution generating unit 155 generates the N whistle sound pattern information, The j-th whistling sound pattern recognized at least j (j? 2) times in a predetermined period by using the sound pattern information is generated, and whistling sound pattern distribution information corresponding to the distribution of the identified j whistling sound patterns is generated can do.

If the whistle sound pattern distribution information corresponding to the whistle sound pattern distribution that is effectively recognized at least j times is generated during the predetermined period through the distribution generating unit 155, the information determining unit 160 determines the whistling sound pattern (Or customized) to the whistling sound of the whistling sound source in the space through which the sound device 100 is placed, thereby to quickly recognize (or minimize) the whistling sound of the whistling sound source, N whistling sound pattern information corresponding to n (1? N? N) whistling sound patterns for determining the whistling sound pattern information. Here, the n whistling sound patterns may be any one of the N whistling sound patterns, or a combination of two or more whistling sound patterns or a new whistling sound pattern. When the n whistle sound patterns are determined through the information determination unit 160, the information storage unit 135 stores the determined n whistle sound patterns as a whistle sound pattern to be read first, The whistle sound frequency band information stored in the storage medium can be updated and stored. Then, the whistle sound recognizing unit 145 may recognize the whistle sound corresponding to at least one whistle sound pattern among the n whistle sound patterns by reading the received sound data.

Referring to FIG. 2, the operation server 200 includes a speech recognition unit (e.g., a speech recognition unit) for recognizing the user's speech uttered by the received sound data and performing natural language processing to recognize speech content information corresponding to the user's utterance A recognition unit 170 for recognizing whether the user's utterance is recognized while the whistle sound is recognized or whether the user's utterance is recognized within a predetermined period of time after the recognition of the whistle sound is recognized; And an intelligent processing unit (175) for processing the contents of the user's utterance in association with s service functions related to the whistling sound when the utterance contents of the user are recognized within a predetermined period of time have.

The whistling sound recognition unit 145 reads out the received sound data and recognizes the whistling sound. The speaking-content recognition unit 165 reads the received sound data, And performs a process of recognizing the utterance contents information corresponding to the utterance contents of the user.

According to the embodiment of the present invention, the speech recognition unit 165 analyzes the received sound data through a specified speech recognition algorithm, recognizes and texts the speech uttered by the user, and performs a morphological analysis, a semantic analysis, The user can generate the utterance content information that recognizes the uttered utterance contents through the natural language processing procedure in the analysis.

Meanwhile, according to the embodiment of the present invention, the whistling sound recognizing unit 145 recognizes the whistling sound and determines that the operating mode of the service device is in the sleep mode through the service controlling unit 150 It is desirable to perform the function of recognizing the user's utterance contents when the user wakes up. If the operation mode of the sound device 100 is set to the sleep mode by the service controller 150, the speech recognition unit 165 may not perform the function of recognizing the user's utterance, Even if the user's speech content is recognized, it can be processed so as not to be used for the service.

Meanwhile, when the user's utterance is recognized through the utterance recognition unit 165, the recognition determiner 170 recognizes the utterance of the user while the whistle sound is recognized through the whistle sound recognition unit 145 Or whether or not the user's utterance is recognized within a predetermined period of time after the recognition of the whistle sound is completed through the whistle sound recognition unit 145. [

If it is confirmed that the user's utterance is recognized within a certain period of time before or after the whistling sound is recognized through the recognition determination unit 170, the intelligent processing unit 175 recognizes the utterance content of the user, So that the specific service function corresponding to the speech content among the s service functions related to the whistling sound can be determined. In this case, the service control unit 150 may activate a specific service function corresponding to the specific sound and at the same time, the specific service function corresponding to the recognized user's utterance, and the service providing unit 180 may transmit the activated specific service function The procedures provided may be performed according to specified procedures.

If the user's utterance is not recognized within a predetermined period of time during or after the whistling sound is recognized through the recognition determination unit 170, the intelligent processing unit 175 receives the sleep mode through the service control unit 150, And / or performing a process of being woken up in the sleep mode by the whistling sound.

Meanwhile, according to the method of the present invention, the s services activated by the service control unit 150 of the operation server 200 and / or associated with the whistling sound that can be provided through the service providing unit 180, 200), and a composite service provided in cooperation with the sound apparatus 100. The server-based service may include a server-based service,

Among the s services related to the whistling sound, the server-based service may include a calling service using wireless terminal information, a status notification service using wireless terminal information, a calling service using an application installed in the wireless terminal, A status notification service, a video service for providing video information photographed through at least one camera to an application installed in a wireless terminal, and a video service for providing video information photographed through at least one camera to a designated IPTV device . &Lt; / RTI &gt;

Meanwhile, among the s services related to the whistling sound, the composite service recognizes the user's utterance contents within a certain period of time during or after the whistling sound is recognized and correlates the utterance contents of the user with the service functions related to the whistling sound And a service provided through the operation server 200 on the communication network based on the result.

FIG. 3 illustrates an embodiment for activating a service related to a whistling sound by recognizing a whistling sound according to an embodiment of the present invention.

In more detail, FIG. 3 illustrates an example of recognizing a whistle sound using M whistle sound frequency band information and / or N whistle sound pattern information stored in a designated storage area to activate a service related to the recognized whistle sound 3, it is possible to refer to and / or modify the FIG. 3 to various methods of recognizing the whistling sound or activating the service (for example, some steps are omitted) However, it should be understood that the present invention is not limited to the above-described embodiments, and various modifications may be made without departing from the scope of the present invention. 3 may be provided through the sound device 100 or may be provided through the operation server 200 or may be provided in a distributed form through interlocking of the sound device 100 and the operation server 200 For convenience, FIG. 3 illustrates features of the present invention with reference to a process that is provided through the sound apparatus 100. FIG.

3, the sound device 100 stores (300) the M whistle sound frequency band information corresponding to the M whistle sound frequency bands for recognizing the whistle sound in a designated storage area and / or N whistling sound pattern information corresponding to N whistling sound patterns for recognizing the whistling sound is stored in the designated storage area (300). Thereafter, the sound apparatus 100 receives sound data corresponding to the sound signal of the audio frequency band through the sound input unit 105a, buffers the sound data in the designated buffer area (305), reads the buffered sound data, A whistling sound corresponding to at least one whistle sound frequency band designated for recognizing the specified at least one whistle sound and / or corresponding to a specific whistle sound corresponding to at least one whistle sound pattern designated for recognizing the whistle sound A recognition procedure is performed (310).

According to one embodiment of the present invention, the sound device 100 reads the buffered sound data and corresponds to at least one whistle sound frequency band among the stored M whistle sound frequency bands and / A whistling sound corresponding to at least one whistling sound pattern among the whistling sound patterns can be recognized (310). According to another embodiment of the present invention, the number of m whistle sound frequencies (or frequencies) optimized (or customized) to the whistling sound of the whistling sound source in the space where the sound device 100 is mounted through the process of FIG. 4 and / When the band information is determined and stored in the designated storage area and / or n whistle sound pattern information optimized (or customized) to the whistling sound of the whistling sound source is determined and stored in the designated storage area, Reads out the buffered sound data and generates a whistling sound corresponding to at least one whistle sound frequency band corresponding to at least one whistle sound frequency band among the stored m whistle sound frequency bands and / A unique whistling sound of the source can be recognized (310).

If the operation mode of the sound device 100 is the sleep mode at the time when the whistling sound is recognized, the sound device 100 may be woken up in the sleep mode (315).

On the other hand, when the whistling sound is recognized and / or when the operating mode of the sound device 100 is woken up in the sleep mode, the sound device 100 is associated with whistling sound among the designated S (S? 1) At least s (1? S? S) service functions may be activated (320) and a procedure may be performed (325) to provide at least one service function among the activated s service functions according to a designated procedure.

On the other hand, if the sound data is not read and the whistle sound is not recognized, the sound device 100 checks whether the whistle sound is effectively recognized for a predetermined period of time (330). If the whistling sound is not recognized effectively for a predetermined period of time, the sound apparatus 100 may set the operation mode of the sound apparatus 100 to the sleep mode (335).

FIG. 4 illustrates an embodiment for optimizing (or customizing) a whistle sound frequency band for recognizing a whistle sound to a whistle sound of a whistle sound source according to an embodiment of the present invention.

FIG. 4 shows the whistle sound frequency distribution information corresponding to the effectively recognized whistle sound frequency distribution for at least i (i? 2) times for a predetermined period using M whistle sound frequency band information previously stored in the designated storage area (1 &lt; / = m &lt; = M) m (1) mapped to the whistling sound source generated by the whistling sound source in the space where the sound device 100 is placed, M whistle sound frequency band information corresponding to the whistle sound frequency band is determined and newly / updated stored in a designated storage area. As a person skilled in the art, Referring to and / or modifying FIG. 4, various methods for optimizing (or customizing) the whistling sound frequency band The present invention is not limited to the above embodiments, but may be applied to other embodiments of the present invention. For example, Or more. 4 may be provided through the sound apparatus 100 or may be provided through the operation server 200 or may be provided in a distributed form through interlocking of the sound apparatus 100 and the operation server 200 For convenience, FIG. 4 illustrates features of the present invention with reference to a process provided through the sound apparatus 100. FIG.

Referring to FIG. 4, the sound device 100 recognizes a whistle sound using M whistle sound frequency band information previously stored in a designated storage area, and then recognizes the whistle sound used for effectively recognizing the whistle sound The frequency band information is stored and managed in a designated storage area (400).

If i (i? 2) whistle sound frequency band information used for effectively recognizing the whistle sound for a predetermined period of time is stored in the storage area 405, the sound device 100 stores at least i (i (Step 410), and the generated whistle sound frequency distribution information is statistically processed to obtain the whistle sound frequency distribution information corresponding to the whistle sound frequency distribution information After determining m pieces of whistle sound frequency band information corresponding to the m (1? M? M) whistle sound frequency bands optimized (or customized) to the whistling sound source of the whistling sound source 415, the determined m number of whistle sound frequencies The band is first set to the whistle sound frequency band to be read first and then updated / stored in the designated storage area (420), and then the sound device 100 stores the m Whistle sound frequency band information of the whistle sound can be recognized.

FIG. 5 illustrates an embodiment of optimizing (or customizing) a whistling sound pattern for recognizing a whistling sound to a whistling sound of a whistling sound generating source according to another embodiment of the present invention.

More specifically, FIG. 5 shows whistling sound pattern distribution information corresponding to a whistling sound pattern distribution that is recognized at least j (j? 2) times for a predetermined period using N whistle sound pattern information previously stored in a designated storage area (1 &amp;le; n &amp;le; N) whistles that are optimized (or customized) to the whistling sound of the whistling sound source in the space where the sound device 100 is mounted, by statistically processing the generated whistling sound pattern distribution information. The n whistle sound pattern information corresponding to the sound pattern is determined and newly / updated stored in the designated storage area. If the person skilled in the art is familiar with the present invention, (E.g., some steps may be omitted, or some of the steps may be omitted, and / or modified, for example) to optimize (or customize) the whistling sound pattern That would be able to infer the exemplary method) has been changed, the present invention is made, including any exemplary way in which the inference, to which the technical feature that is not limited to the exemplary method shown in the figure 5. 5 may be provided through the sound apparatus 100 or may be provided through the operation server 200 or may be provided in a distributed form through interlocking of the sound apparatus 100 and the operation server 200 For convenience, FIG. 5 illustrates the features of the present invention with reference to a process provided through the sound apparatus 100. FIG.

Referring to FIG. 5, the sound apparatus 100 recognizes the whistle sound using the N whistle sound pattern information previously stored in the designated storage area, and then recognizes the whistle sound pattern Information is stored in a designated storage area and managed (500).

If j (j? 2) whistle sound frequency band information used for effectively recognizing the whistle sound for a predetermined period of time is stored in the storage area (505), the sound device 100 is enabled for at least j times The whistle sound pattern distribution information corresponding to the recognized whistle sound pattern distribution is generated 510 and the generated whistle sound pattern distribution information is statistically processed to generate whistle sound pattern distribution information After determining n pieces of whistle sound pattern information corresponding to n (1? N? N) whistle sound patterns optimized for sound (515), the whistle sound patterns (520), and the sound device 100 then uses the stored n whistle sound pattern information to generate a pre- It can recognize the sound of the book.

FIG. 6 illustrates an embodiment of activating a service related to a whistling sound by associating the whistling sound with the speaking content according to another embodiment of the present invention.

6, when the user's utterance contents are recognized within a certain period of time before or after the whistle sound is recognized, the utterance contents of the recognized user are analyzed in association with s service functions related to the whistling sound, FIG. 6 is a flowchart illustrating a method for activating a whistling sound according to an exemplary embodiment of the present invention. Referring to FIG. 6, It will be understood that various implementations of the present invention (e.g., some steps omitted or alternatives in which the order is changed) may be deduced, but the present invention includes all of the above- The technical features are not limited by the method alone. 6 may be provided through the sound apparatus 100 or may be provided through the operation server 200 or may be provided in a distributed form through interlocking of the sound apparatus 100 and the operation server 200 For convenience, FIG. 6 illustrates features of the present invention with reference to a process provided through the sound apparatus 100. FIG.

Referring to the embodiment of FIG. 6, the sound apparatus 100 reads sound data buffered in a designated buffer area, recognizes the user's language utterance, processes it in natural language, and recognizes the utterance contents information corresponding to the utterance contents of the user (600). If the user's utterance is not recognized, the sound device 100 determines whether the user's utterance is not recognized for a predetermined period of time (605). If the user's utterance is not recognized for a predetermined period of time, the sound apparatus 100 may set the operation mode of the sound apparatus 100 to a sleep mode (operation 610).

Meanwhile, when the sound data is read and the user's utterance is recognized, the sound apparatus 100 confirms whether the operation mode of the sound apparatus 100 is the sleep mode (615). If the sleep mode is selected, it is preferable to recognize a whistling sound and perform a wake-up process.

On the other hand, if the operation mode of the sound apparatus 100 is not the sleep mode at the time of recognizing the user's utterance contents (for example, whistling sound is recognized during or before a predetermined time of the user's utterance is recognized, When the sleep mode is woken up), the sound device 100 confirms that the user's utterance is recognized while the whistle sound is recognized and / or the user's utterance It is checked whether the contents are recognized (620). If the user's utterance is not recognized within a certain period of time before or after the whistle sound is recognized, the sound device 100 preferably confirms the sleep mode or recognizes the whistle sound to perform a wake-up process Do.

On the other hand, when the user's utterance contents are recognized within a certain period of time before or after the whistling sound is recognized, the sound apparatus 100 interprets the uttered contents of the recognized user by s service functions related to the whistling sound (625). Based on this, a specific service function corresponding to the specific sound among the S service functions and corresponding to the speech contents of the recognized user may be activated (630), and the activated specific service function may be designated The procedure provided by the procedure may be performed (635).

100: sound device 105: sound module
105a: sound input unit 105b: sound output unit
110: camera module 110a:
115: power supply module 120: communication module
120a: wireless network communication unit 120b:
125: short-distance module 125a: short-
130: Control module 130a:
130b: memory unit 135: information storage unit
140: sound processing unit 145: whistle sound recognition unit
150: service control unit 155: distribution generating unit
160: information determination unit 165:
170: situation determination unit 175: intelligent processing unit
180: Service provisioner 185: Camera device
200: Operation server 205: Sound receiver

Claims (22)

There is provided a sound device including a sound module including a sound input section for receiving a sound signal and a sound output section for outputting a sound signal, and at least one communication section for connecting to a communication network,
A sound processing unit for buffering sound data corresponding to a sound signal of an audible frequency band inputted through the sound input unit in a designated buffer area or checking buffered sound data in a designated buffer area;
The at least one whistle sound frequency band corresponding to at least one whistle sound frequency band designated for recognizing a whistle sound designated for a specific situation among non-verbal sounds or noises that can be generated in the designated space by reading the buffered sound data, A whistle sound recognition unit for recognizing a specific whistling sound; And
And a service controller for activating at least s (1? S? S) service functions related to the whistling sound among S (S? 1) service functions designated when the whistling sound is recognized Sound device with whistling sound recognition function.
The method as claimed in claim 1,
Whether a whistle sound is not recognized for a predetermined period of time or a user's utterance is not recognized for a predetermined period of time or longer; and when a whistle sound or a user's utterance is not recognized for a predetermined period of time or longer, Sleep mode. The sound device according to claim 1, further comprising:
The method according to claim 1,
The whistle sound recognition unit recognizes a whistle sound in a sleep mode,
Wherein the service control unit includes a function of activating s service functions related to a whistling sound when the whistling sound is recognized by waking up the sounding device .
4. The method according to claim 2 or 3,
And a state in which the buffered sound data is read and the function of providing the service based on the recognized speech contents is disabled by recognizing the user's speech contents.
The apparatus according to claim 1,
And a function of recognizing a whistling sound corresponding to a whistling sound frequency band of the whistling sound generating source and a whistling sound unique to the whistling sound generating source corresponding to the whistling sound pattern of the whistling sound generating source Device.
The apparatus of claim 1,
M whistle sound frequency band information corresponding to M (M? 1) whistle sound frequency bands and N whistle sound pattern information corresponding to N (N? 1) whistle sound patterns are stored in a designated storage area Wherein the sound output unit is further provided with a whistling sound recognition function.
7. The apparatus of claim 6, wherein the whistle-
And reading out the buffered sound data to recognize a whistling sound corresponding to at least one whistling sound frequency band among the M whistling sound frequency bands and corresponding to at least one whistling sound pattern among the N whistling sound patterns And a sounding device for sounding the sound.
7. The apparatus of claim 6,
A distribution generating unit for generating whistle sound frequency distribution information corresponding to at least i (i? 2) valid recognized whistle sound frequency distributions for a predetermined period using the M whistle sound frequency band information; And
(1 &amp;le; m &amp;le; M) whistle sound frequency bands that are optimized (or customized) to the whistling sound of the whistling sound source in the space in which the sound device is mounted by statistically processing the generated whistle sound frequency distribution information and an information determiner for determining the m whistle sound frequency band information based on the detected whistle sound frequency band information.
9. The method of claim 8,
Wherein the information storage unit further comprises a function of newly setting or updating and storing the determined m number of whistle sound frequency bands as a whistle sound frequency band to be read first,
Wherein the whistle sound recognizing unit includes a function of reading the buffered sound data and first recognizing a whistle sound corresponding to at least one whistle sound frequency band among the stored m number of whistle sound frequency bands. Sound device with recognition function.
7. The apparatus of claim 6,
A distribution generator for generating whistle sound pattern distribution information corresponding to at least j (j? 2) valid recognized whistle sound pattern distributions for a predetermined period using the N whistle sound pattern information;
The generated whistle sound pattern distribution information is statistically processed to generate n (1? N? N) whistle sound patterns optimized (or customized) to the whistling sound of the whistle sound generating source in the space And an information determining unit for determining whistle sound pattern information of the whistle sound.
11. The method of claim 10,
Wherein the information storage unit further comprises a function of newly setting or updating and storing the determined n whistling sound patterns in a whistling sound pattern to be read first,
Wherein the whistle sound recognizing unit includes a function of reading the buffered sound data and recognizing a whistle sound corresponding to at least one whistle sound pattern among the stored n whistle sound patterns first The sound device comprising:
The apparatus of claim 1,
A speech recognition unit for reading the buffered sound data and recognizing a user's speech utterance and performing natural language processing to recognize utterance content information corresponding to the utterance contents of the user;
A recognition determining unit for determining whether the user's utterance is recognized during the recognition of the whistle sound or the user's utterance is recognized within a predetermined time after the recognition of the whistle sound is completed;
And an intelligent processing unit for processing the speech contents of the recognized user in association with s service functions related to the whistling sound when the speech contents of the user are recognized within a certain time period during or after the whistling sound is recognized And a sounding device for sounding the sound.
13. The method as claimed in claim 12,
And a function of activating a specific service function corresponding to the whistling sound and corresponding to the recognized user's utterance contents.
The method as claimed in claim 1,
A server interlocking service for interlocking with an operation server on a communication network through the communication module,
A sound based service provided through the sound module,
And a composite service for providing the combined use of the sound module and the communication module.
15. The system according to claim 14,
A paging service using wireless terminal information,
A status notification service using wireless terminal information,
A calling service using an application installed in a wireless terminal,
A status notification service using an application installed in a wireless terminal,
A video service for providing video information photographed through at least one camera to an application installed in a wireless terminal,
And a video service for providing video information photographed through at least one camera to a designated IPTV device.
15. The method of claim 14, wherein the sound-
And a noise output service for outputting a designated service sound through a sound output unit of the sound module at a designated signal output intensity.
The signal output apparatus according to claim 16,
And the signal strength of the whistling sound is inversely proportional to the signal input intensity of the whistling sound.
15. The method of claim 14,
A service provided through an operation server on a communication network on the basis of a result of recognizing the user's utterance contents within a predetermined time period during or after the whistling sound is recognized and analyzing the utterance contents of the user in association with a service function related to the whistling sound, And a sound output unit for outputting sound to the sound output unit.
The method according to claim 1,
And a short-range module for processing a short-range camera device and short-range wireless communication,
Wherein the service control unit includes a function of activating a video service function for communicating with the camera device through the near module to photograph the sound source that generated the recognized whistle sound through the camera device. Sound device with sound recognition function.
The method according to claim 1,
Wherein the communication module includes a short range network communication unit for connecting a short distance camera device and a short range wireless network based wireless communication,
Wherein the service control unit includes a function of activating a video service function for communicating with the camera device via the local network communication unit and photographing a sound source that generates the recognized whistle sound through the camera device Sound device with whistling sound recognition function.
The method according to claim 1,
Further comprising a camera module for acquiring image information of a photographed subject,
Wherein the service control unit includes a function of activating a video service function for photographing a sound source that generates the recognized whistle sound through the camera module.
The apparatus of claim 1,
Further comprising a service providing unit for providing a service corresponding to the activated service function.

Images