KR20190055520A - Sound Device for Entry Recognition - Google Patents

Abstract

The present invention relates to a sound device for entry recognition and, more specifically, relates to a stationary sound device including: a sound module including a sound input part receiving a sound signal and a sound output part outputting a sound signal; and a communication module including at least one communication part connected to a communication network. The sound device for entry recognition includes a control module including: a sound processing part buffering sound data, corresponding to a sound signal of an audible frequency band inputted through the sound input part, in a designated buffer area or confirming the sound data buffered in the designated buffer area; an entry sound recognition part recognizing a specific entry sound corresponding to at least one entry sound pattern and at least one entry sound frequency band to recognize at least one entry sound designated for entry recognition among non-verbal sounds or noises which can be generated in a designated space by decoding the buffered sound data; and a service control part activating at least s(1<=s<=S) service functions related with the entry sound among S(S>=1) designated service functions when recognizing the entry sound.

Description

Sound Device for Entry Recognition &quot;

The present invention relates to a sound device having a sound module for inputting and outputting a sound signal and a communication module for connecting to a communication network, the sound device corresponding to the sound signal of the audio frequency band inputted through the sound module, Corresponding to at least one access sound frequency band designated for recognizing at least one access sound designated for access during sound or noise, and / or for at least one access sound pattern designated for recognizing the access sound Activating at least one designated service function related to the access sound among the services available through at least one (or a combination of the two) of the sound module and the communication module when the entrance sound is recognized by attempting recognition or providing the designated service To see if it is To provide a sound device.

Recently, a stationary sound device has been sold which recognizes a user's voice and provides a service corresponding to the recognized voice. For example, stationary sound devices such as 'echo' from Amazon, 'who' from SK Telecom, and 'Kigajini' from KT are sold.

However, the conventional stationary sound device is a combination of a sound source service and a speech recognition technology. The conventional stationary sound device operates mainly on a service for providing or reproducing a desired sound source through voice recognition, and has a difficulty in being used in other fields.

In order to solve the above problems, an object of the present invention is to provide a communication module including a sound module including a sound input unit for receiving a sound signal and a sound output unit for outputting a sound signal, and at least one communication unit for connecting to a communication network And at least one non-verbal sound or noise specified in order to recognize at least one outgoing sound, which is designated as a non-audible sound or noise, which can be generated in the designated space by reading the sound data corresponding to the sound signal of the audible frequency band inputted through the sound input unit (S &gt; = 1) service functions which are specified when the user recognizes and recognizes a specific access sound corresponding to the access sound frequency band of the user and / or the at least one access sound pattern designated for recognizing the access sound At least s (1 ≤ s ≤ S) And a control module for activating the pass function.

The sound device for recognizing entrance / exit according to the present invention includes a sound module including a sound input section for receiving a sound signal and a sound output section for outputting a sound signal, and a communication module including at least one communication section for connecting to a communication network. A sound processing unit for buffering sound data corresponding to a sound signal of an audible frequency band inputted through the sound input unit in a designated buffer area or checking buffered sound data in a designated buffer area; Corresponding to at least one access sound frequency band designated for recognizing at least one access sound designated for accessing out of the non-verbal sounds or noises generated in the designated space and corresponding to at least one access sound pattern (S &amp;le; s &amp;le; S) service functions related to the access sound among S (S &gt; = 1) service functions designated when the access sound is recognized, And a control module.

According to the present invention, the entrance / exit sound may be a sound of unlocking a door lock of a door of a door designated to determine the home situation of a homeowner or a family member, a door opening sound of a doorway designated for determining a home owner or a home returning state, A buzzer sound, a buzzer sound, and a buzzer sound designed to determine a visitor or guest's visiting situation.

According to the present invention, the service control unit checks whether or not the entrance sound is recognized for a predetermined period of time or longer, or whether the user's utterance is not recognized for a predetermined period of time or longer. And a function of setting the operation mode of the sound device to a sleep mode.

According to the present invention, the access sound recognition unit recognizes an access sound in a sleep mode, and when the service control unit recognizes the access sound, the access sound recognition unit wakes up and transmits s service functions May be included.

According to the present invention, the sleep mode may include a state in which the buffered sound data is read and the function of providing the service based on the recognized speech content is recognized by recognizing the user's speech content.

According to the present invention, the access sound recognition unit may include a function of recognizing a unique access sound of the access sound source corresponding to the access sound frequency band of the access sound source and corresponding to the access sound pattern of the access sound source.

According to the present invention, the control module includes M outgoing sound frequency band information corresponding to M (M? 1) outgoing sound frequency bands and N outgoing sound pattern information corresponding to N (N? 1) outgoing sound patterns To the designated storage area.

According to the present invention, the access sound recognizing unit reads out the buffered sound data and corresponds to at least one access sound frequency band out of the M access sound frequency bands, and corresponds to at least one access sound pattern out of the N access sound patterns And recognizing a corresponding incoming sound.

According to the present invention, the control module generates access sound frequency distribution information corresponding to at least i (i 2) times of effectively recognized access sound frequency distribution for a predetermined period using the M outgoing sound frequency band information (1 &amp;le; m &amp;le; M) outgoing sounds optimized (or fitted) to the sound of the entrance / exit sound source in the space through which the sound device is mounted by statistically processing the generated / And an information determination unit for determining m pieces of access sound frequency band information corresponding to the frequency band.

According to the present invention, the information storage unit may further include a function of newly setting or updating and storing the determined m access sound frequency bands as an access sound frequency band to be read first, and the access sound recognizing unit stores the buffered sound data And a function of first recognizing an access sound corresponding to at least one access sound frequency band among m stored access sound frequency bands.

According to the present invention, the control module generates a distribution pattern for generating access sound pattern distribution information corresponding to a distribution of the recognized recognized access sound patterns at least j (j 2) times for a predetermined period using the N access sound pattern information (1 &amp;le; n &amp;le; N) outgoing sound patterns that are optimized (or fitted) to the sound of the entrance / exit sound source in the space where the sound device is mounted, Sound pattern information corresponding to the input / output sound pattern information.

According to the present invention, the information storage unit may further comprise a function of newly setting or updating and storing the determined n access sound patterns as an access sound pattern to be read first, and the access sound recognition unit reads the buffered sound data And a function of first recognizing an access sound corresponding to at least one access sound pattern out of the stored n access sound patterns.

According to the present invention, the control module may include a speech content recognition unit that reads the buffered sound data and recognizes the user's speech utterance, processes the word in natural language, and recognizes the utterance content information corresponding to the utterance contents of the user, A recognition judging unit for recognizing whether the user's utterance is recognized or the utterance contents of the user are recognized within a predetermined period of time after the recognition of the entrance and exit sound is recognized; And an intelligent processing unit which processes the recognized contents of the user in association with the s service functions related to the entrance and exit sounds when the contents of the speech are recognized.

According to the present invention, the service control unit may include a function of activating a specific service function corresponding to the outgoing sound and corresponding to the uttered contents of the recognized user.

According to the present invention, the s services include a server interlocking service provided in cooperation with an operating server on a communication network through the communication module, a sound based service provided through the sound module, And at least one of the multiple services provided by the service provider.

According to the present invention, the server interworking service may include a calling service using wireless terminal information, a status notification service using wireless terminal information, a calling service using an application installed in the wireless terminal, a status notification service using an application installed in the wireless terminal, A video service providing video information photographed through a camera of the mobile terminal to an application installed in a wireless terminal, and a video service providing video information photographed through at least one camera to a designated IPTV device.

According to the present invention, the sound-based service may include a noise output service for outputting a designated service sound through a sound output unit of the sound module at a designated signal output intensity.

According to the present invention, the signal output intensity may include a signal intensity inversely proportional to a signal input intensity of the input / output sound.

According to the present invention, the composite service recognizes the user's utterance contents within a certain period of time during or after the access sound is recognized, and based on a result of analyzing the utterance contents of the user in association with a service function related to the access sound And services provided through an operating server on the network.

According to the present invention, the sound device for recognizing the entrance / exit may further include a near camera module and a short range module for performing short range wireless communication, wherein the service controller communicates with the camera device via the near module, And a function of activating a video service function for photographing a sound source that generates the recognized entrance / exit sound.

According to the present invention, the communication module includes a short-distance network communication unit for connecting a camera apparatus in a short distance and a short-range wireless network-based wireless communication, and the service control unit communicates with the camera apparatus through the short- And a function of activating a video service function for photographing a sound source that generates the recognized entrance / exit sound.

According to the present invention, the sound device for recognizing the entrance / exit may further include a camera module for acquiring image information of a photographed object, and the service control unit may include a sound source for generating the recognized entrance / exit sound through the camera module And a function of activating a video service function for photographing.

According to the present invention, the control module may further include a service providing unit for providing a service corresponding to the activated service function.

According to the present invention, in a case where at least one access sound designated for accessing out of non-verbal sounds or noises generated in a designated space is not recognized, the sleep mode is operated in a sleep mode that does not react to the specific situation, And recognizes and recognizes a specific access sound corresponding to at least one access sound frequency band designated and / or at least one access sound pattern designated for recognizing the access sound, and automatically wakes up in the sleep mode, There is an advantage of providing a sound device that activates at least a service function related to an access sound or provides a service related to the access sound.

1 is a diagram showing a functional configuration of a sound device for recognition of access according to an embodiment of the present invention.
2 is a functional block diagram of a sound device and an operation server according to another embodiment of the present invention.
FIG. 3 illustrates an embodiment of activating a service related to access sound by recognizing an access sound according to an embodiment of the present invention.
FIG. 4 illustrates an embodiment of optimizing (or customizing) an access sound frequency band for recognizing an access sound according to an embodiment of the present invention with respect to the sound of an access sound source.
FIG. 5 illustrates an embodiment for optimizing (or customizing) an access sound pattern for recognizing an access sound according to another embodiment of the present invention to / from the sound of the access sound source.
FIG. 6 illustrates an embodiment of activating a service related to an incoming and outgoing sound in accordance with another embodiment of the present invention by recognizing the entrance sound and the speech contents in association with each other.

The operation principle of the preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings and description. It should be understood, however, that the drawings and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention, and are not to be construed as limiting the present invention.

In other words, the following embodiments correspond to the preferred embodiment of the preferred embodiment of the present invention. In the following embodiments, a specific configuration (or step) is omitted, or a specific configuration (or step) (Or steps), or an embodiment that incorporates functions implemented in more than one configuration (or step) into any one configuration (or step), a particular configuration (or step) It will be apparent that the present invention is not limited to the embodiments described below. Therefore, it should be clearly stated that various embodiments corresponding to subsets or combinations based on the following embodiments can be subdivided based on the filing date of the present invention.

In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. The terms used below are defined in consideration of the functions of the present invention, and may be changed according to the intention of the user, the intention or the custom of the operator. Therefore, the definition should be based on the contents throughout the present invention.

As a result, the technical idea of the present invention is determined by the claims, and the following embodiments are merely means for effectively explaining the technical idea of the present invention to a person having ordinary skill in the art to which the present invention belongs Only.

1 is a diagram showing a functional configuration of a sound apparatus 100 for recognition of access according to an embodiment of the present invention.

1 is a block diagram of a communication system including a sound module 105 including a sound input unit 105a for receiving a sound signal and a sound output unit 105b for outputting a sound signal and at least one communication unit for connecting to a communication network. A sound processing unit having a module 120 and buffering sound data corresponding to a sound signal of an audible frequency band inputted through the sound input unit 105a into a designated buffer area or confirming buffered sound data in a designated buffer area 140) and at least one access sound frequency band designated for recognizing at least one access sound designated for accessing out of non-verbal sounds or noises generated in the designated space by reading the buffered sound data and / At least one incoming sound pattern specified to recognize the incoming sound (S &amp;le; s &amp;le; S) service related to the access sound among the service functions S (S? 1) designated when recognizing the access sound And a control module 130 including a service control unit 150 for activating the functions of the stationary sound apparatus 100. As long as those skilled in the art are familiar with the present invention, It will be appreciated that various implementations of the stationary sound device 100 (e.g., some of the components may be omitted, or fragmented, or combined) may be inferred by referring to and / or modifying Figure 1, And all the methods to be inferred. The technical features of the present invention are not limited only by the method shown in FIG.

1, the stationary sound apparatus 100 includes a sound module 105 including a sound input unit 105a for receiving a sound signal and a sound output unit 105b for outputting a sound signal, And a communication module (120) including at least one communication unit for connecting to a communication network. The communication module (120) includes a sound input unit (105a) for reading sound data corresponding to a sound signal of an audible frequency band, Corresponds to at least one access sound frequency band designated for recognizing at least one access sound designated for a specific situation of non-verbal sounds or noise, and / or corresponds to at least one access sound pattern designated for recognizing the access sound And when it is recognized that the user has attempted to recognize a particular access sound, at least one designation And a control module 130 having at least one function unit for activating the service function or providing the designated service function. The power module 115 supplies operating power. The stationary sound apparatus 100 may include at least one of a near field camera device 185 and a near field module 125 for processing short range wireless communication and a camera module 110 for acquiring image information of a subject And may further include an input unit (not shown) including a keypad or a touchpad for receiving a user's operation, and / or an LED or a display for outputting various operation states or information And an output unit (not shown). On the other hand, in the embodiment of FIG. 1, the name " module &quot; is merely a term for distinguishing and describing the functions and roles of the stationary sound apparatus 100 for convenience, I will reveal.

The sound module 105 includes a sound input / output unit 105a including at least one sound input unit 105a that receives a sound signal from among the components of the stationary sound apparatus 100 and a sound output unit 105b that outputs a sound signal. The sound input unit 105a and the sound output unit 105b can input or output sound signals of at least an audible frequency band and the sound input unit 105a and the sound output unit 105b can be connected to the control module 130 And an interface unit (not shown) for interfacing with the interface unit.

The sound input unit 105a is a collective term for receiving a sound signal. The sound input unit 105a encodes one or more microphones that receive a sound signal obtained by detecting the vibration of air and convert the sound into an electrical signal, and a sound signal according to a specified encoding rule And a program (and / or circuit) module for generating sound data. Preferably, the sound input unit 105a receives a sound signal of an audio frequency band (for example, a sound signal including a speech signal generated by the user) through the microphone, receives the input audio frequency band And provide the sound data generated by encoding the sound signal to the control module 130.

According to an embodiment of the present invention, the sound input unit 105a includes one or more directional microphones for detecting a direction in which the entrance / exit sound is generated when the entrance / exit sound is recognized in the space where the sound device 100 is installed And the present invention is not limited thereto.

According to the method of the present invention, the entrance / exit sound may be a sound of unlocking a door lock of the entrance door of a door which is specified for a home owner or a family home, a sound of pressing a designated number key to open the entrance door, A door opening door sound, and a buzzer sound designated for the visitor or guest's visiting situation.

The sound output unit 105b is a collective term for outputting a sound signal and includes at least one speaker for outputting a sound signal and sound data to be outputted through the speaker and decoding the sound signal output through the speaker And a program (and / or circuit) module for controlling the signal output intensity and the output quality of the sound signal. Preferably, the sound output unit 105b outputs the sound signal generated by decoding the sound data requested to output sound through the control module 130 through the speaker, Amplifies or reduces the output intensity to a specified signal intensity (e.g., to a signal intensity that is set to be receivable (or audible) at a signal strength greater than or equal to a specified signal reception intensity at a distance greater than or equal to a specified reference distance, and / Amplified or reduced to a signal strength set to be capable of being received (or listened to) at a signal strength greater than or equal to the specified signal strength at a specified distance, and / or received at a signal strength greater than or equal to the specified signal strength at a specified distance, (Or listening) to a set signal strength (For example, speaker parameters such as Fs, Qts, Vas, etc.) of the sound output and / or blocking or suppressing the sound distortion as much as possible, The output quality of the sound is controlled so as to block / suppress the sound distortion caused by the resonance so that the sound component corresponding to the segmented sound on the sound signal is clearly defined so that the audibility (or audibility) The output quality of the sound is controlled so as to block or suppress the frequency at which the bit stream is encoded or the signal intensity when the bit stream is encoded and output, .

The communication module 120 is a collective term for a connection unit of the stationary sound apparatus 100. The communication module 120 preferably connects to a designated server (or device) via a wireless network (e.g., a mobile communication network, a portable Internet, (Or a wireless LAN) via a wireless AP or a repeater, and communicates with a designated server (or device) through a communication channel and communicates with the server And a local area network communication unit 120b, and an interface unit (not shown) for interfacing the communication unit with the control module 130. [

The wireless network communication unit 120a collectively refers to a communication unit that connects the stationary sound apparatus 100 to a wide area wireless network (e.g., a mobile communication network) via a base station. The wireless network communication unit 120a includes an antenna , An RF module, a baseband module, and a signal processing module. The controller 130a is connected to the controller 130a and transmits results of computation corresponding to wireless communication among the various computation results of the controller 130a through a wireless network Or receives data through a wireless network and transmits the data to the controller 130a, and also performs connection, registration, communication, and handoff procedures of the wireless communication.

According to an embodiment of the present invention, when the wireless network connected through the wireless network communication unit 120a is a mobile communication network, the wireless network communication unit 120a accesses a mobile communication network according to at least one mobile communication standard, , Call processing, call connection, data communication, and handoff. Meanwhile, according to the intention of those skilled in the art, the wireless network communication unit 120a may perform at least one of connection to a wide area wireless network other than the mobile communication network (e.g., portable Internet according to the IEEE 802.16 standard), location registration, data communication, And it is clear that the present invention is not limited by the wireless communication configuration provided by the wireless network communication unit 120a. That is, the wireless network communication unit 120a provides wireless data communication based on packet communication via the cell-based base station on the wireless network, regardless of the frequency band of the wireless section, the type or protocol of the communication network, To the data network to which the data is transmitted.

The short-range network communication unit 120b communicates with a network access device (for example, a wireless AP or the like) provided near by using a radio frequency signal as a communication medium within a predetermined distance (for example, within 10m or within 30m) And a communication network connecting the stationary sound apparatus 100 to the communication network to which the stationary sound apparatus 100 is connected through a short-range wireless network for connecting the station, the communication apparatus 100 preferably includes a Wi-Fi based short- A remote wireless communication session between the network connection device provided at a short distance through at least one of a network communication, a UWB-based local area network communication, and a public wireless communication is established between the stationary sound device 100 and the stationary sound device 100 100) to a communication network to which the network connection apparatus is connected.

According to the embodiment of the present invention, when the short-range wireless communication unit 120b is implemented with a short-range wireless communication session connecting a short-range wireless communication session with a network access device located within a predetermined distance from the stationary sound apparatus 100, And connects the stationary sound device 100 to a data network for providing wireless data communication based on packet communication via a network connection device of the short-range wireless network. Hereinafter, the network communication function of the stationary sound apparatus 100 will be described with reference to an embodiment using the wireless network communication unit 120a. However, the present invention is not limited thereto, and the network communication using the near field network communication unit 120b Function is also provided.

Meanwhile, according to one embodiment of the present invention, the short-range network communication unit 120b transmits a short-range wireless network-based wireless signal to the camera device 185 located near the sound device 100 via the short- Communication can be processed. The stationary sound apparatus 100 and the camera apparatus 185 may perform wireless communication based on a short-range wireless network when the near-field communication unit 120b processes wireless communication based on a short-range wireless network with a nearby camera apparatus 185 The key value for the encrypted communication can be exchanged or the key value for the encrypted communication can be exchanged at the time of connecting the wireless communication based on the short-range wireless network. As a result, the stationary sound device 100 and the camera device 185 can exchange key values, Can perform encrypted communication using the key value.

The near field module 125 is a collective term for the short range wireless communication of the stationary sound apparatus 100. The near field module 125 preferably includes a short range wireless unit 125a for connecting short range wireless communication of a specified standard, And an interface unit (not shown) that interfaces the control module 125a and the control module 130. For example, the short range wireless unit 125a may process Bluetooth based short range wireless communication according to the Bluetooth standard. However, it is clear that the standard for the short-range wireless communication of the short-range wireless unit 125a is not limited to the Bluetooth standard but may include all the short-range wireless communication standards including Wi-Fi, ZigBee or UWB. Meanwhile, the near-field wireless unit 125a may be the near-field communication unit 120b according to an embodiment of the present invention.

The short-range wireless unit 125a is a collective term for a unit for processing short-range wireless communication of a specified standard, and may preferably include a Bluetooth unit for processing Bluetooth-based short-range wireless communication according to the Bluetooth standard. However, the short range wireless communication related configuration of the short range wireless unit 125a is not limited to the Bluetooth based short range wireless communication according to the Bluetooth standard, and it is possible to use short range wireless communication of various standards other than Bluetooth according to the intention of those skilled in the art , Wi-Fi-based short-range wireless communication according to Wi-Fi standard, ZigBee-based short-range wireless communication according to ZigBee standard, and UWB-based short-range wireless communication according to UWB standard. Available). For the sake of convenience, the short range wireless unit 125a processes the Bluetooth based short range wireless communication according to an embodiment of the present invention. However, the present invention is not limited thereto.

According to the embodiment of the present invention, the near-field module 125 (or the short-range wireless unit 125a) processes the short-range wireless communication of the designated standard with the camera apparatus 185 provided in the vicinity of the sound apparatus 100 . The stationary sound device 100 and the camera device 185 may perform short-range wireless communication when the near-field module 125 (or the short-range wireless section 125a) processes near-field wireless communication with the near- The stationary sound device 100 and the camera device 185 can exchange the key value for the encrypted communication at the time of storing the key value for the encrypted communication or connecting the short distance wireless communication, Can be performed.

According to the embodiment of the present invention, when the stationary sound apparatus 100 is mapped to an application of a wireless terminal used by a user (for example, when an application specified in a user wireless terminal is installed and executed for the first time (or before mapping registration) The application of the wireless terminal registers the device identification information for identifying the stationary sound device 100 and the identification information of the user wireless terminal (or the unique identification information of the user wireless terminal) in the designated operation server 200, The short range wireless unit 125a may connect the short range wireless communication with the application of the matched user wireless terminal and may transmit various identification information designated for processing a specific service Processing information can be exchanged. For example, information received in an application of a user wireless terminal in a designated operation server 200 or inputted or extracted or generated through an application of the user wireless terminal may be transmitted to the user via the short- (E.g., sent to the sound output or operational server 200) and / or received at the designated operational server 200 to the stationary sound device 100 or to the control sound module 100 100 may be transmitted to the application of the user wireless terminal through the short-range wireless communication and processed (for example, output to the screen or transmitted to the operation server 200).

The camera module 110 is a collective term of a component for processing a camera photographing of the stationary sound apparatus 100 and is preferably a camera module for acquiring image information (e.g., image) or image information And an interface unit (not shown) for interfacing the control unit 130 with the camera unit 110a. Meanwhile, when the camera module 110 (or the camera unit 110a) can be interlocked with the near-field camera device 185 through the near-field module 125 (or the near-field wireless unit 125a) and / The present invention is not limited thereto.

The camera unit 110a includes at least one lens unit for receiving an optical signal reflected from a subject, an image sensor unit for detecting an optical signal input through the lens unit and converting the optical signal into an electrical image signal, (For example, an infrared filter or the like) between the lens unit and the image sensor unit according to an embodiment of the present invention, . Meanwhile, the camera unit 110a includes an image signal processor (ISP) which processes the image information or image information according to a designated procedure for improving the quality of image information or image information generated through the image sensor unit .

Meanwhile, when the sound module 100 is provided with the camera module 110, the camera module 110 includes a driver for changing a photographing direction of the camera module 110a, and the control module 130 Or the camera module 110) controls the driving unit to read image information or image information generated through the image sensor unit of the camera unit 110a while changing the photographing direction of the camera unit 110a, (For example, a person or a thing that generates a door sound) in a space such as a stationary space, and drives the driving unit to photograph the sound source through the camera unit 110a. If the sound input unit 105a included in the sound module 105 includes one or more directional microphones, the control module 130 (or the camera module 110) 105a, and drives the driving unit to photograph the direction of the sound coming in and out through the camera unit 110a.

The control module 130 is a collective term for controlling various operations of the stationary sound apparatus 100. The control module 130 preferably generates image data through the camera module 110, And an operation of communicating with a server designated by the communication module 120 (for example, the operation server 200), or a combination of two or more of the operations of the controller 130a And a memory unit for storing various information and program codes necessary for the operation of the controller 130a.

The control unit 130a is a generic term for controlling the operation of the stationary sound apparatus 100. The control unit 130a may include at least one processor and an execution memory and / or may include various chips or control circuits. (For example, a bus (BUS), etc.) with each component provided in the stationary sound apparatus 100. [ According to the present invention, the control unit 130a loads at least one program code included in the stationary sound apparatus 100 into the execution memory through the processor, and outputs the result to at least one And controls the operation of the stationary sound apparatus 100. [ The functional configuration of the present invention may be implemented in the form of a program code and / or a chip or a control circuit. For convenience of explanation, the program configuration and / Or a control circuit according to the present invention will be described with reference to the control unit 130a.

The memory unit 130b is a general term of a nonvolatile memory corresponding to a storage resource of the stationary sound apparatus 100 and includes at least one program code executed through the control unit 130a and at least one program code And stores the data set. The memory unit basically comprises a system program code and a system data set corresponding to the operating system of the stationary sound apparatus 100, a communication program code and a communication data set for processing a wireless communication connection of the stationary sound apparatus 100, An application program code and an application data set, and a program code and a data set corresponding to a functional configuration implementing the present invention may also be stored in the memory unit 130b.

The power supply module 115 is a collective term for supplying / supplying power required for operation of the stationary sound apparatus 100 and is preferably an external power supply (for example, an AC power source, a DC power source rectifying an AC power source, a USB power source, (Not shown) for supplying and receiving external power to the stationary sound apparatus 100. When the voltage value or the current value of the external power source is different from the voltage value or the current value required for the operation of the stationary sound apparatus 100, (Not shown) for converting the power supply voltage into an operating power having a value or a current value. Meanwhile, when the external power is supplied through the power supply unit or the external power is converted into the operation power through the power conversion unit, the power module 115 charges the external power or the operation power, (Not shown) for applying the charged power when the external power is not supplied to the battery.

According to the first embodiment of the present invention, the sound device 100 recognizes a specified sound input / output for a predetermined space and provides a service related to the sound input / output. Device 100 as shown in FIG.

According to a second embodiment of the present invention, the sound device 100 is provided with a speech recognition mode of operation for providing a known speech recognition based service, wherein a specific setting through a predetermined input provided in the sound device 100 The mode switching sound device 100 may be switched from the voice recognition mode to the access sound recognition mode for the access sound recognition based service according to the present invention based on specific voice recognition through input or voice recognition.

According to the third embodiment of the present invention, the sound device 100 is a composite sound device (hereinafter, referred to as &quot; sound device &quot;) manufactured to provide a known speech recognition based service, (100).

Referring to FIG. 1, the control module 130 recognizes recognition target information to be recognized for starting or processing a specific service among speech content information recognized through a speech recognition unit of the control module 130 and obtained through natural language processing And an information storage unit 135 for storing the information in a designated storage area of the memory unit.

When it is necessary to recognize the user's utterance contents in order to determine the initiation or processing of a specific service, the information storage unit 135 stores the recognition target information including the utterance content to be recognized from the utterance of the user, And mapping the service providing information for starting or processing of the specific service.

According to the embodiment of the present invention, the information to be mapped to be mapped to the service provision information is specified including the pre-designated speech content, and / or the sound output unit 105b of the stationary sound apparatus 100 May be input through the sound input unit 105a, and may be acquired and registered / updated through a natural language process after requesting a speech content to be used as the recognition object information. Meanwhile, according to an embodiment of the present invention, the recognition object information can be registered / updated through an application of a user wireless terminal mapped to the stationary sound device 100, and thus the present invention is not limited thereto.

Referring to FIG. 1, the control module 130 buffers sound data corresponding to a sound signal of an audible frequency band inputted through the sound input unit 105a in a designated buffer area or sound data corresponding to sound data A sound processing unit 140 for reading the buffered sound data and recognizing at least one access sound frequency specified for recognizing entrance / exit of non-verbal sounds or noises generated in the designated space, An entrance sound recognizing part 145 recognizing a specific entrance sound corresponding to at least one entrance sound pattern corresponding to the entrance / exit sound and / or the entrance / exit sound, and an S (S (1? S? S) service functions related to the access sound among the? And a service control unit (150) for setting an operation mode of the sound device (100) to a sleep mode when an incoming sound or a user's speech is not recognized for a predetermined period of time or longer, And a service providing unit 180 for providing a service corresponding to the service function. According to another embodiment of the present invention, at least one component of the access sound recognition unit 145, the service control unit 150 and the service providing unit 180 may be connected to an operating server (not shown) If the access sound recognition unit 145 is implemented in the operation server 200, the sound processing unit 140 may transmit the sound data buffered in the designated buffer area to the operation server 200 Alternatively, sound data determined to correspond to sound input / output among the buffered sound data may be selectively extracted and provided to the operation server 200. [ 1, the features of the present invention will be described with reference to an embodiment in which the access sound recognition unit 145, the service control unit 150, and the service providing unit 180 are implemented through the sound apparatus 100 . When the access sound recognition unit 145, the service control unit 150 and the service providing unit 180 are implemented through the sound apparatus 100, the access sound recognition unit 145, the service control unit 150, The studying unit 180 may be implemented in the form of a program code and a chip or a control circuit in a form of a combination of at least one or both of the program and the sound recognition unit 145. The studying unit 180 may include a service control unit 150 and a service providing unit 180 And the present invention is not limited by the method of implementation or the module to be implemented.

After the operating power is applied to the sound device 100 through the power module 115, the sound processor 140 receives the sound data corresponding to the sound signal of the audio frequency band input through the sound input unit 105a, (Or repeats) the process of checking the buffered sound data in the designated buffer area and / or checking the buffered sound data in the designated buffer area. The access sound recognition unit 145 reads the buffered sound data, Recognizes a specific access sound corresponding to at least one access sound frequency band designated for recognition of at least one access sound designated for accessibility and / or corresponding to at least one access sound pattern designated for recognizing the access sound Continue (or repeat) the process. When the access sound recognition unit 145 is implemented in the operation server 200, the sound processing unit 140 provides the buffered sound data to the operation server 200 or the buffered sound data It is possible to selectively extract the sound data corresponding to the incoming / outgoing sound and to provide the extracted sound data to the operation server 200, so that the present invention is not limited thereto.

The service controller 150 determines whether the sound is not recognized for a predetermined period of time or longer after the operation power is applied to the sound device 100 and / And / or to confirm that the speech uttered by the user for a specified period of time or longer after the operation power is applied to the sound device 100 is not recognized, and / or (For example, recognizing the user's utterance contents within a certain period of time during or after the entrance / exit sound is recognized through the entrance / exit sound recognition unit 145) in accordance with a designated procedure, Can not be recognized. The service control unit 150 determines the operation mode of the sound device 100 (or the control module 130) if the user does not recognize the access sound for a predetermined period of time or more, And a function of setting a sleep mode. Here, the sleep mode reads the buffered sound data and recognizes the sound of the user even if the user's speech is recognized. The sleep mode wakes up in a sleep mode and / or pre-specified specific speaking information (e.g., (E.g., specific speaking information set to wake up the sound apparatus 100), and recognizes a service (e.g., a sound source or a beep sound as a sound based on the speaking content of the recognized user before waking up in the sleep mode) And a sound-based service for outputting sound). Hereinafter, the features of the present invention will be described focusing on an embodiment in which a door sound is recognized for a sake of convenience and wakes up in a sleep mode.

According to the embodiment of the present invention, the sound processing unit 140 buffers the sound data corresponding to the sound signal of the audible frequency band inputted through the sound input unit 105a in the sleep mode in the designated buffer area and / It is preferable to continue (or repeat) the process of confirming the buffered sound data in the designated buffer area, and the access sound recognizing unit 145 also reads the buffered sound data in the sleep mode, Corresponding to at least one access sound frequency band designated for recognizing at least one access sound designated for access during sound or noise, and / or for at least one access sound pattern designated for recognizing the access sound Continue (or repeat) the process of recognizing the entrance sound It is preferred. Preferably, in the sleep mode, when the access sound is effectively recognized through the access sound recognition unit 145, the service control unit 150 may wake up to activate s service functions related to the access sound, The service providing unit 180 may perform a procedure of providing a service corresponding to the activated s service functions.

Meanwhile, when two or more service functions related to the incoming and outgoing sound are activated through the service control unit 150, the service providing unit 180 performs a procedure of providing a service corresponding to the activated service function in a designated order And / or a process of providing at least one service according to a predetermined condition among the activated service functions (for example, a condition for recognizing a user's utterance).

According to the embodiment of the present invention, the access sound recognizing unit 145 recognizes the access sound frequency band of the access sound source and / or the access sound unique to the access sound source corresponding to the access sound pattern of the access sound source The control module 130 may be configured to learn at least one access sound frequency band specific to an access sound source and / or to learn at least one access sound pattern specific to an access sound source .

Referring to FIG. 1, the control module 130 stores M outgoing / incoming sound frequency band information corresponding to M (M? 1) outgoing sound frequency bands in a designated storage area and / or N And an information storage unit (135) for storing N access sound pattern information corresponding to the access sound patterns of the plurality of access sound patterns in a designated storage area, wherein the access sound recognition unit (145) The sound of the entrance and exit can be recognized by using the information and / or the entrance sound pattern information. According to another embodiment of the present invention, at least one component of the information storage unit 135 and the access sound recognition unit 145 is implemented through the operation server 200 on the communication network interlocked with the sound device 100 . 1, the features of the present invention will be described with reference to an embodiment in which the information storage unit 135 and the entrance / exit sound recognition unit 145 are implemented through the sound device 100. FIG. When the information storing unit 135 and the entrance sound recognizing unit 145 are implemented through the sound device 100, the information storage unit 135 and the entrance sound recognizing unit 145 may store the program code form, The present invention is not limited to the embodiment in which the information storage unit 135 and the access sound recognition unit 145 are implemented or the module is implemented.

The information storage unit 135 stores M outgoing sounds corresponding to M (M &gt; = 1) sound frequency bands in a designated storage area of the memory unit at the time of manufacturing the control module 130 (or the sound device 100) Frequency band information can be stored. The non-verbal sounds that can be generated in the space designated in the present invention or the designated entrance and exit sounds for noise can be various frequencies depending on the type of sound or the sound source (or a frequency difference between the lowest frequency and the highest frequency is at least 100 Hz) Band. Accordingly, the present invention can divide the frequency band of the incoming and outgoing sound into M frequency bands (for example, equally divided or selectively divided on the basis of a plurality of frequency bands in which the incoming and outgoing sound are dense) May store M outgoing / incoming sound frequency band information corresponding to the divided M outgoing / incoming sound frequency bands in a designated storage area.

The information storage unit 135 stores N access sound patterns corresponding to N (N? 1) access sound patterns in a designated storage area of the memory unit at the time of manufacturing the control module 130 (or the sound device 100) Information can be stored in the designated storage area. The present invention firstly generates access sound pattern information through a qualitative analysis and / or a quantitative analysis process for the patterns of access sounds confirmed through sample experiments, and the information storage unit 135 stores the generated access sound patterns Information can be stored in the designated storage area.

Meanwhile, according to the embodiment of the present invention, the sound device 100 (or the control module 130) can recognize the access sound and then transmit the recognized access sound information to the designated operation server 200, The server 200 collects access sound information from each sound device 100 (or the control module 130), and performs a normalization process for normalizing individual sound characteristics of each sound source in the collected access sound, And / or quantitative analysis of qualities of each case, thereby finishing or diversifying the information of the sound pattern. The information of the sound pattern 100 (or control module) (130). The information storage unit 135 receives the access sound pattern information that is refined or diversified through the above process from the operation server 200, and stores N access sound pattern information including the received access sound pattern information Can be stored in a designated storage area.

According to an embodiment of the present invention, M outgoing sound frequency band information corresponding to M outgoing sound frequency bands is stored in the designated storage area and / or N outgoing sound frequency band information corresponding to N outgoing sound patterns is stored in the designated storage area When the sound pattern information is stored, the access sound recognizing unit 145 reads out the buffered sound data and corresponds to at least one access sound frequency band among the stored M access sound frequency bands and / It is preferable to recognize the entrance / exit sound corresponding to the entrance / exit sound pattern of at least one of the entrance / exit sound patterns.

On the other hand, the M outgoing sound frequency band information and / or N outgoing sound pattern information stored in the designated storage area are not optimized (or customized) to the incoming and outgoing sounds of the incoming and outgoing sound sources, but the frequency band and / Information corresponding to the pattern. Therefore, in order to quickly recognize the entrance / exit sound of the entrance / exit sound source existing in the space where the sound device 100 is installed and / or to prevent (or minimize) the recognition error, It is necessary to optimize (or customize) the pattern information to the sound of the entrance / exit sound source.

Referring to FIG. 1, the control module 130 calculates an access sound frequency corresponding to at least i (i? 2) valid recognized outgoing sound frequency distributions for a predetermined period using the M outgoing sound frequency band information Generating distribution information for generating access sound pattern distribution information corresponding to at least j (j? 2) valid recognized access pattern distributions for a predetermined period using the N access sound pattern information and / (M), which is optimized (or fitted) to the sound of the entrance / exit sound source in the space where the sound device 100 is placed, by statistically processing the generated entrance / ) Access sound frequency band information corresponding to the number of access sound frequency bands and / or statistical processing of the generated access sound pattern distribution information, An information determination unit 160 for determining n outgoing sound pattern information corresponding to n (1? N? N) outgoing sound patterns optimized (or customized) to the entrance and exit sound of the access sound source in the stationary space Respectively.

According to another embodiment of the present invention, at least one component of the distribution generating unit 155 and the information determining unit 160 is implemented through the operating server 200 on the communication network interlocked with the sound apparatus 100 . 1 for the sake of convenience, the characteristics of the present invention will be described mainly with reference to an embodiment in which the distribution generating unit 155 and the information determining unit 160 are implemented through the sound apparatus 100. FIG. If the distribution generating unit 155 and the information determining unit 160 are implemented through the sound apparatus 100, the distribution generating unit 155 and the information determining unit 160 may be implemented in the form of a program code and a chip or a control circuit And the present invention is not limited to the method of implementing the distribution generating unit 155 and the information determining unit 160 and the implemented modules.

When the M outgoing sound frequency band information corresponding to the M outgoing and incoming sound frequency bands is stored in the designated storage area through the information storage unit 135, the distribution generating unit 155 generates M outgoing / The frequency band information of the effectively recognized access sound can be stored in the designated storage area whenever the access sound is effectively recognized using the sound frequency band information. The distribution generating unit 155 generates at least i (i 2) times of recognized i sound frequency bands for a predetermined period based on the access sound frequency band that is effectively recognized and stored through the M outgoing sound frequency band information And generates the access sound frequency distribution information corresponding to the distribution of the identified i access sound frequency bands.

Meanwhile, when the access sound frequency distribution information corresponding to the effectively recognized access sound frequency distribution is generated at least for a predetermined period through the distribution generating unit 155, the information determining unit 160 determines whether the generated access sound frequency (Or adjusted) to the sound of the entrance and exit sound source in the space through which the sound device 100 is placed, thereby quickly recognizing (or minimizing) the entrance and exit sound of the entrance and exit sound source, M &lt; / RTI &gt; access sound frequency band information corresponding to m (1 &lt; = m &lt; M) Here, the m outgoing and incoming sound frequency bands may be any one of the M outgoing and incoming sound frequency bands, or may include a newly defined outgoing sound frequency band within the outgoing sound frequency band. When the m outgoing / incoming sound frequency band information is determined through the information determination unit 160, the information storage unit 135 sets the determined m outgoing / incoming sound frequency bands as an outgoing sound frequency band to be read first, Area, or may update and store the access sound frequency band information stored in the storage area. Then, the access sound recognizing unit 145 may read the buffered sound data and recognize first the access sound corresponding to at least one access sound frequency band out of the m or the newly stored access sound frequency bands.

Meanwhile, when N pieces of access sound pattern information corresponding to N access sound patterns are stored in the storage area designated through the information storage unit 135, the distribution generating unit 155 generates N access sound patterns It is possible to store the sophisticated pattern of the effectively recognized entrance / exit sound in the designated storage area whenever the entrance / exit sound is effectively recognized using the pattern information. The distribution generator 155 checks at least j (j? 2) times of recognized j access sound patterns for a predetermined period based on the access sound pattern information that is effectively recognized and stored through the N access sound pattern information , And can generate information on the sound pattern distribution of entrance and exit corresponding to the distribution of the j access sound patterns.

Meanwhile, when the access sound pattern distribution information corresponding to the access sound pattern distribution which is recognized at least j times for a predetermined period is generated through the distribution generating unit 155, the information determining unit 160 determines the access sound pattern (Or adjusted) to the sound of the entrance and exit sound source in the space through which the sound device 100 is placed, thereby quickly recognizing (or minimizing) the entrance and exit sound of the entrance and exit sound source, N access sound pattern information corresponding to n (1? N? N) access sound patterns for determining the access sound pattern information. Here, the n outgoing sound patterns may be any one of the N outgoing sound patterns, or a combination of two or more outgoing sound patterns or a new crying pattern. When the n outgoing / incoming sound patterns are determined through the information determination unit 160, the information storage unit 135 sets the determined n outgoing / incoming sound patterns as an outgoing sound pattern to be read first, The access sound frequency band information stored in the storage area can be updated and stored. Then, the access sound recognizing unit 145 may read the buffered sound data and recognize the access sound corresponding to at least one access sound pattern out of the n access sound patterns.

Referring to FIG. 1, the control module 130 includes a speech recognition unit (speech recognition unit) 130 that reads the buffered sound data and recognizes the user's speech utterance and processes the speech in a natural language to recognize utterance content information corresponding to the utterance contents of the user A recognition unit 170 for checking whether the user's utterance is recognized while the access sound is recognized or whether the user's utterance is recognized within a predetermined period of time after completion of recognition of the access sound, And the intelligent processing unit 175 processes the contents of the user's utterance in association with the s service functions related to the access sound when the utterance contents of the user are recognized within a predetermined period of time have. According to another embodiment of the present invention, at least one of the speech recognition unit 165, the recognition determination unit 170, and the intelligent processing unit 175 may be connected to an operating server (not shown) If the speech recognition unit 165 is implemented in the operation server 200, the sound processing unit 140 may transmit the sound data buffered in the designated buffer area to the operation server 200 Or selectively extract sound data determined to correspond to a user utterance among the buffered sound data and provide the sound data to the operation server 200. [ 1, the features of the present invention will be described with reference to an embodiment in which the speech recognition unit 165, the recognition determination unit 170, and the intelligent processing unit 175 are implemented through the sound apparatus 100 . If the speech recognition unit 165, the recognition determination unit 170, and the intelligent processing unit 175 are implemented through the sound device 100, the speech recognition unit 165, the recognition determination unit 170, The processing unit 175 may be implemented in the form of a program code and a chip or a control circuit in a form of a combination of at least one or both of the program codes and the speech recognition unit 165, the recognition / determination unit 170, and the intelligent processing unit 175 And the present invention is not limited by the method of implementation or the module to be implemented.

The input sound recognition unit 145 reads out the buffered sound data and recognizes an access sound. The speech recognition unit 165 reads the buffered sound data, And performs a process of recognizing the utterance contents information corresponding to the utterance contents of the user. When the speech recognition unit 165 is implemented in the operating server 200, the sound processing unit 140 provides the buffered sound data to the operating server 200 or the buffered sound data The sound data determined to correspond to the user's utterance (including, for example, segmented sounds) can be selectively extracted and provided to the operation server 200, so that the present invention is not limited thereto.

According to the embodiment of the present invention, the speech recognition unit 165 analyzes the buffered sound data through a specified speech recognition algorithm, recognizes and texts the speech uttered by the user, and performs a morphological analysis, a semantic analysis, The user can generate the utterance content information that recognizes the uttered utterance contents through the natural language processing procedure in the analysis.

Meanwhile, according to the embodiment of the present invention, the speech recognition unit 165 recognizes the entrance / exit sound by the entrance / exit sound recognition unit 145 and transmits the speech signal to the service control unit 150 through the service control unit 150 in the sleep mode It is desirable to perform the function of recognizing the user's utterance contents when the user wakes up. If the operation mode of the sound device 100 is set to the sleep mode by the service controller 150, the speech recognition unit 165 may not perform the function of recognizing the user's utterance, Even if the user's speech content is recognized, it can be processed so as not to be used for the service.

Meanwhile, when the user's utterance is recognized through the utterance recognition unit 165, the recognition determination unit 170 recognizes that the utterance contents of the user are recognized while the access sound is recognized through the access sound recognition unit 145 Or whether the user's utterance is recognized within a predetermined period of time after the recognition of the entrance / exit sound is completed through the entrance / exit sound recognition unit 145.

If it is confirmed that the user's utterance is recognized within a certain time period during or after the recognition of the entrance / exit sound through the recognition / determination unit 170, the intelligent processing unit 175 recognizes the utterance contents recognition unit 165, So that the specific service function corresponding to the utterance contents can be determined among the s service functions related to the sound of entrance and exit. In this case, the service control unit 150 may activate a specific service function corresponding to the speech sound of the recognized user while being related to the incoming and outgoing sound, and the service providing unit 180 may transmit the activated specific service function The procedures provided may be performed according to specified procedures.

If the user's utterance is not recognized within a certain period of time during or after the recognition of the entrance / exit sound through the recognition / determination unit 170, the intelligent processing unit 175 transmits the sleep mode And / or performing a process of waking up in the sleep mode by the incoming / outgoing sound.

Meanwhile, according to the method of the present invention, the s services related to the sound of entrance and exit that the service controller 150 can activate and / or provide through the service provider 180 can be transmitted through the communication module 120, A server-interlocking service provided in cooperation with the operation server 200, a sound-based service provided through the sound module 105, and a composite service providing a combined use of the sound module 105 and the communication module 120 And / or &lt; / RTI &gt;

Meanwhile, among the s services related to the access sound, the server interworking service may include a paging service using wireless terminal information, a status notification service using wireless terminal information, a paging service using an application installed in the wireless terminal, A status notification service, a video service for providing video information photographed through at least one camera to an application installed in a wireless terminal, and a video service for providing video information photographed through at least one camera to a designated IPTV device . &Lt; / RTI &gt;

Meanwhile, the sound-based service among the s services associated with the access sound may include a noise output service for outputting a designated service sound through a sound output unit 105b of the sound module 105 at a designated signal output intensity, Preferably, the signal output intensity of the sound-based service includes a signal intensity that is inversely proportional to the signal input intensity of the incoming and outgoing sound.

On the other hand, among the s services related to the access sound, the composite service recognizes the user's utterance contents within a certain period of time during or after the access sound is recognized, and correlates the utterance contents of the user with service functions related to the access sound And a service provided through the operation server 200 on the communication network based on the result.

In the meantime, according to the first camera embodiment of the present invention, the sound device 100 is provided with a camera device 185 in the vicinity and a short-range module 125 for processing short-range wireless communication, When the short distance wireless communication with the nearby camera device 185 is performed, the service control unit 150 recognizes the entrance / exit sound through the access sound recognition unit 145, The user can activate s service functions including a video service function for communicating with the device 185 and photographing a sound source that generates the recognized entrance and exit sound through the camera device 185, Communicates with the camera device 185 through the near field module 125 and receives image information photographed through the camera device 185 to receive the image information through an application installed in the wireless terminal through the operation server 200 A video service providing service and / or a video service providing service to a designated IPTV service. On the other hand, when the camera apparatus 185 can provide the image service, the service provider 180 may process the image service function of the camera apparatus 185 to operate through the near field module 125.

Alternatively, a short-range wireless network-based wireless communication may be performed with the near-field camera device 185 through the short-range network communication unit 120b of the communication module 120 provided in the sound device 100 according to the second camera embodiment of the present invention. The service control unit 150 may communicate with the camera device 185 through the local area network communication unit 120b to recognize the entrance / exit sound through the entrance / exit sound recognition unit 145, The service providing unit 180 may activate the s service functions including a video service function for photographing the sound source generating the recognized entrance / exit sound through the short distance network communication unit 120b A video service that communicates with the camera device 185 and receives image information photographed through the camera device 185 and provides the image information through an application installed in the wireless terminal through the operation server 200 and / V device to provide at least one video service. On the other hand, when the camera apparatus 185 can provide the image service, the service provider 180 can process the image service function of the camera apparatus 185 through the near-field communication unit 120b.

Alternatively, when the camera module 110 is provided to acquire image information of a subject photographed by the sound device 100 according to the third camera embodiment of the present invention, the service controller 150 controls the entrance / 145), the service providing unit 180 can activate a video service function for photographing a sound source that generates the recognized entrance / exit sound through the camera module 110, A video service for providing video information photographed through the camera module 110 to an application installed in a wireless terminal through the operation server 200 and / or a video service for providing to a designated IPTV device can be provided have.

2 is a functional block diagram of the stationary sound apparatus 100 and the operation server 200 according to another embodiment of the present invention.

2 shows an embodiment in which at least part of the functional configuration of the control module 130 of the stationary sound apparatus 100 shown in FIG. 1 is implemented on the operation server 200 side Those skilled in the art will be able to refer to and / or modify Figure 2 to implement an embodiment at least partially modifying the embodiment of Figures 1 and 2 Some of the functional configurations imple- mented on the operating server 200 of the stationary sound device 100 may be implemented in the operating server 200 as they are and some of them may be implemented in the control module 130 of the stationary sound device 100, 130, 130, and 130, but the present invention is not limited to the embodiments in which some of the components shown in FIG. 1 and FIG. 2 are omitted, Or subdivided, or summed Would be able to derive a binary exemplary method and the like), the present invention includes all embodiments wherein the method is inferred as the scope, not limited that the technical features of only the exemplary method shown in the figure 1 and the drawing 2.

Referring to FIG. 2, the operation server 200 includes a sound receiving unit 205 for receiving sound data input through a sound input unit 105a of a designated sound device 100 and temporarily storing the sound data in a designated storage medium, The sound data corresponding to at least one access sound frequency band designated for recognizing at least one access sound designated for accessing out of non-verbal sound or noise that can be generated in the designated space by reading the received sound data and / An entrance sound recognizing part 145 for recognizing a specific access sound corresponding to at least one access sound pattern designated for accessing the room, (1 &lt; s &lt; / = S) service functions and / or for a predetermined period of time or longer, And a service control unit 150 for setting the operation mode of the sound apparatus 100 to a sleep mode if it is not recognized, and a service providing unit 180 for providing a service corresponding to the activated service function .

The sound receiving unit 205 receives the sound data transmitted from the sound apparatus 100 and temporarily stores the sound data in the designated storage medium in the designated sound apparatus 100. [ Can be stored. On the other hand, in the case where the sound device 100 selectively transmits one or more pieces of sound data corresponding to the sound input or output sound or the sound data corresponding to the user's utterance, the sound receiving unit 205 receives the sound data from the sound device 100 The sound data selectively transmitted may be received and temporarily stored in a designated storage medium.

The access sound recognizing unit 145 reads the received sound data and transmits the sound data to at least one access sound frequency band designated for recognizing at least one access sound designated for accessing out of the non- (Or repeats) the process of recognizing a specific access sound corresponding to at least one access sound pattern corresponding to the access sound and / or recognizing the access sound.

The service controller 150 determines whether the sound is not recognized for a predetermined period of time or longer after the operation power is applied to the sound device 100 and / And / or to confirm that the speech uttered by the user for a specified period of time or longer after the operation power is applied to the sound device 100 is not recognized, and / or (For example, recognizing the user's utterance contents within a certain period of time during or after the entrance / exit sound is recognized through the entrance / exit sound recognition unit 145) in accordance with a designated procedure, Can not be recognized. The service control unit 150 sets the operation mode of the sound device 100 to the sleep mode in a remote mode if the sound is not recognized for a predetermined period of time or is not recognized for a predetermined period of time or more And the like.

According to an embodiment of the present invention, the sound device 100 can transmit the input sound data in a sleep mode, and the sound receiver 205 can receive sound data in a sleep mode, And the access sound recognition unit 145 also reads the received sound data in a state in which the operation mode of the sound device 100 is in the sleep mode and outputs the non-acoustic sound or noise Or at least one access sound sound pattern corresponding to at least one access sound frequency band designated for recognizing at least one access sound designated for recognition of outgoing / incoming, and / or at least one access sound pattern designated for recognizing the access sound The recognition process can be continued (or repeated). Preferably, the service control unit 150 wakes up the sound device 100 when s / he recognizes the access sound through the access sound recognition unit 145 in the sleep mode, And the service providing unit 180 may perform a procedure of providing a service corresponding to the activated s service functions.

Meanwhile, when two or more service functions related to the incoming and outgoing sound are activated through the service control unit 150, the service providing unit 180 performs a procedure of providing a service corresponding to the activated service function in a designated order And / or a process of providing at least one service according to a predetermined condition among the activated service functions (for example, a condition for recognizing a user's utterance).

According to the embodiment of the present invention, the access sound recognizing unit 145 recognizes the access sound frequency band of the access sound source and / or the access sound unique to the access sound source corresponding to the access sound pattern of the access sound source The operating server 200 may be configured to learn at least one access sound frequency band specific to the access sound source and / or to learn at least one access sound pattern specialized to the access sound source, .

Referring to FIG. 2, the operation server 200 stores M outgoing sound frequency band information corresponding to M (M? 1) outgoing sound frequency bands in a designated storage medium and / or N (N? 1 And an information storage unit 135 for storing N pieces of access sound pattern information corresponding to the access sound patterns of the plurality of access sound patterns in a designated storage medium, The sound of the entrance and exit can be recognized by using the information and / or the entrance sound pattern information.

The information storage unit 135 may store M outgoing sound frequency band information corresponding to M (M? 1) outgoing sound frequency bands in a designated storage medium. The non-verbal sounds that can be generated in the space designated in the present invention or the designated entrance and exit sounds for noise can be various frequencies depending on the type of sound or the sound source (or a frequency difference between the lowest frequency and the highest frequency is at least 100 Hz) Band. Accordingly, the present invention can divide the frequency band of the incoming and outgoing sound into M frequency bands (for example, equally divided or selectively divided on the basis of a plurality of frequency bands in which the incoming and outgoing sound are dense) May store M outgoing sound frequency band information corresponding to the divided M outgoing sound frequency bands in a designated storage medium.

The information storage unit 135 may store N outgoing sound pattern information corresponding to N (N &gt; = 1) outgoing sound patterns in a designated storage medium in a designated storage medium. The present invention firstly generates access sound pattern information through a qualitative analysis and / or a quantitative analysis process for the patterns of access sounds confirmed through sample experiments, and the information storage unit 135 stores the generated access sound patterns Information can be stored in the designated storage medium.

According to the embodiment of the present invention, the sound device 100 can recognize the access sound and transmit the recognized access sound information to the designated operation server 200. The intelligent processing unit 175 of the operation server 200 ) Collects access sound information from each sound device 100, and performs a normalization process for normalizing the individual sound characteristics of each sound source in the collected access sound and / or a normalization process for performing qualitative analysis and / Through the analysis process, the access sound pattern information can be refined or diversified. The information storage unit 135 may receive the access sound pattern information that has been refined or diversified through the above process and may store N access sound pattern information including the received access sound pattern information in a designated storage medium .

According to an embodiment of the present invention, M outgoing sound frequency band information corresponding to M outgoing sound frequency bands is stored in the designated storage medium and / or N outgoing sound frequency band information corresponding to N outgoing sound patterns When the sound pattern information is stored, the access sound recognizing unit 145 reads the received sound data and stores the received sound data in correspondence with at least one access sound frequency band among the stored M access sound frequency bands and / It is preferable to recognize the entrance / exit sound corresponding to the entrance / exit sound pattern of at least one of the entrance / exit sound patterns.

Meanwhile, the M outgoing sound frequency band information and / or the N outgoing sound pattern information stored in the designated storage medium are not optimized (or adjusted) to the sound of the specific sound source, but are stored in the frequency band of the statistical outgoing sound and / Information corresponding to the pattern. Accordingly, in order to quickly recognize the entrance / exit sound of a specific sound source present in the space where the sound device 100 is mounted and / or to prevent (or minimize) a recognition error, the stored access sound frequency band information and / It is necessary to optimize (or align) the pattern information with the sound of the specific sound source.

Referring to FIG. 2, the operation server 200 calculates an access sound frequency corresponding to at least i (i? 2) valid recognized access frequency distributions for a predetermined period using the M access frequency band information Generating distribution information for generating access sound pattern distribution information corresponding to at least j (j? 2) valid recognized access pattern distributions for a predetermined period using the N access sound pattern information and / M (1? M? M) which is optimized (or customized) to the sound of the entrance / exit sound source in the space where the sound device 100 is mounted, by statistically processing the generated entrance / ) Access sound frequency band information corresponding to the access sound frequency band and / or statistical processing of the generated access sound pattern distribution information, (1 &amp;le; n &amp;le; N) outgoing sound patterns optimized (or fitted) to the sound of the entrance / exit sound source in the space where the door / Respectively.

When the M outgoing sound frequency band information corresponding to the M outgoing sound frequency bands is stored in the storage medium designated through the information storage unit 135, the distribution generating unit 155 generates M outgoing sound frequency band information (I &gt; = 2) validated i &lt; th &gt; access sound frequency bands for a predetermined period using the sound frequency band information, and detects an i &lt; th &gt; access sound frequency band corresponding to the i & Information can be generated.

Meanwhile, when the access sound frequency distribution information corresponding to the effectively recognized access sound frequency distribution is generated at least for a predetermined period through the distribution generating unit 155, the information determining unit 160 determines whether the generated access sound frequency (Or adjusted) to the sound of the entrance and exit sound source in the space through which the sound device 100 is placed, thereby quickly recognizing (or minimizing) the entrance and exit sound of the entrance and exit sound source, M &lt; / RTI &gt; access sound frequency band information corresponding to m (1 &lt; = m &lt; M) Here, the m outgoing and incoming sound frequency bands may be any one of the M outgoing and incoming sound frequency bands, or may include a newly defined outgoing sound frequency band within the outgoing sound frequency band. When the m outgoing / incoming sound frequency band information is determined through the information determination unit 160, the information storage unit 135 sets the determined m outgoing / incoming sound frequency bands as an outgoing sound frequency band to be read first, It is possible to newly store in the medium or to update and store the access sound frequency band information stored in the storage medium. Then, the entrance sound recognizing unit 145 may recognize the entrance / exit sound corresponding to at least one of the access sound frequency bands among the m or new access sound frequency bands by reading the received sound data.

On the other hand, when N pieces of access sound pattern information corresponding to N access sound patterns are stored in the storage medium designated by the information storage unit 135, the distribution generating unit 155 generates the N access sound pattern information stored in the designated storage medium (J &amp;ge; 2) times for a predetermined period of time using the sound pattern information and generates access sound pattern distribution information corresponding to the distribution of the identified j access sound patterns can do.

Meanwhile, when the access sound pattern distribution information corresponding to the access sound pattern distribution which is recognized at least j times for a predetermined period is generated through the distribution generating unit 155, the information determining unit 160 determines the access sound pattern (Or customized) to the sound of the entrance / exit sound source in the space where the sound device 100 is placed, and thereby the entrance / exit sound of the entrance / exit sound source is recognized at a high speed or prevented (or minimized) N access sound pattern information corresponding to n (1? N? N) access sound patterns for determining the access sound pattern information. Here, the n access sound patterns may be any one of the N access sound patterns, or a combination of two or more access sound patterns or a new access sound pattern. When the n outgoing / incoming sound patterns are determined through the information determination unit 160, the information storage unit 135 stores the determined n outgoing / incoming sound patterns as an outgoing sound pattern to be read first, It is possible to update and store the access sound frequency band information stored in the storage medium. Then, the access sound recognizing unit 145 may recognize the access sound corresponding to at least one access sound pattern out of the n access sound patterns by reading the received sound data.

Referring to FIG. 2, the operation server 200 includes a speech recognition unit (e.g., a speech recognition unit) for recognizing the user's speech uttered by the received sound data and performing natural language processing to recognize speech content information corresponding to the user's utterance A recognition unit 170 for checking whether the user's utterance is recognized while the access sound is recognized or whether the user's utterance is recognized within a predetermined period of time after completion of recognition of the access sound, And the intelligent processing unit 175 processes the contents of the user's utterance in association with the s service functions related to the access sound when the utterance contents of the user are recognized within a predetermined period of time have.

The input sound recognition unit 145 reads out the received sound data and recognizes the incoming and outgoing sound. The speech recognition unit 165 reads the received sound data, And performs a process of recognizing the utterance contents information corresponding to the utterance contents of the user.

According to the embodiment of the present invention, the speech recognition unit 165 analyzes the received sound data through a designated speech recognition algorithm to recognize and characterize the speech uttered by the user, and performs a morphological analysis, a semantic analysis, The user can generate the utterance content information that recognizes the uttered utterance contents through the natural language processing procedure in the analysis.

Meanwhile, according to the embodiment of the present invention, the speech recognition unit 165 recognizes the entrance / exit sound by the entrance / exit sound recognition unit 145 and transmits the speech signal to the service control unit 150 through the service control unit 150 in the sleep mode It is desirable to perform the function of recognizing the user's utterance contents when the user wakes up. If the operation mode of the sound device 100 is set to the sleep mode by the service controller 150, the speech recognition unit 165 may not perform the function of recognizing the user's utterance, Even if the user's speech content is recognized, it can be processed so as not to be used for the service.

Meanwhile, when the user's utterance is recognized through the utterance recognition unit 165, the recognition determination unit 170 recognizes that the utterance contents of the user are recognized while the access sound is recognized through the access sound recognition unit 145 Or whether the user's utterance is recognized within a predetermined period of time after the recognition of the entrance / exit sound is completed through the entrance / exit sound recognition unit 145.

If it is confirmed that the user's utterance is recognized within a certain time period during or after the recognition of the entrance / exit sound through the recognition / determination unit 170, the intelligent processing unit 175 recognizes the utterance contents recognition unit 165, So that the specific service function corresponding to the utterance contents can be determined among the s service functions related to the sound of entrance and exit. In this case, the service control unit 150 may activate a specific service function corresponding to the specific sound and at the same time, the specific service function corresponding to the recognized user's utterance, and the service providing unit 180 may transmit the activated specific service function The procedures provided may be performed according to specified procedures.

If the user's utterance is not recognized within a certain period of time during or after the recognition of the entrance / exit sound through the recognition / determination unit 170, the intelligent processing unit 175 transmits the sleep mode And / or performing a process of waking up in the sleep mode by the incoming / outgoing sound.

According to the embodiment of the present invention, the s services activated by the service control unit 150 of the operating server 200 and / or related to the access sound that can be provided through the service providing unit 180, 200), and a composite service provided in cooperation with the sound apparatus 100. The server-based service may include a server-based service,

Meanwhile, the server-based service among the s services related to the access sound includes a call service using wireless terminal information, a situation notification service using wireless terminal information, a paging service using an application installed in the wireless terminal, A status notification service, a video service for providing video information photographed through at least one camera to an application installed in a wireless terminal, and a video service for providing video information photographed through at least one camera to a designated IPTV device . &Lt; / RTI &gt;

On the other hand, among the s services related to the access sound, the composite service recognizes the user's utterance contents within a certain period of time during or after the access sound is recognized, and correlates the utterance contents of the user with service functions related to the access sound And a service provided through the operation server 200 on the communication network based on the result.

FIG. 3 illustrates an embodiment for activating a service related to access sound by recognizing an access sound according to an embodiment of the present invention.

More specifically, FIG. 3 illustrates an embodiment of recognizing an access sound using the M access tone frequency band information and / or N access tone pattern information stored in a designated storage area and activating a service related to the recognized access sound The present invention is not limited to the above embodiments and various changes and modifications may be made by those skilled in the art with reference to and / However, it should be understood that the present invention is not limited to the above-described embodiments, and various modifications may be made without departing from the scope of the present invention. 3 may be provided through the sound device 100 or may be provided through the operation server 200 or may be provided in a distributed form through interlocking of the sound device 100 and the operation server 200 For convenience, FIG. 3 illustrates features of the present invention with reference to a process that is provided through the sound apparatus 100. FIG.

Referring to FIG. 3, the sound device 100 stores (M) 300 access sound frequency band information corresponding to M access sound frequency bands for recognizing an access sound in a designated storage area (300) and / or N pieces of access sound pattern information corresponding to N access sound patterns for recognizing the access sound are stored in the designated storage area (300). Thereafter, the sound apparatus 100 receives sound data corresponding to the sound signal of the audio frequency band through the sound input unit 105a, buffers the sound data in the designated buffer area (305), reads the buffered sound data, Or a specific access sound corresponding to at least one access sound frequency band designated for recognizing at least one access sound designated for specific situation judgment and / or corresponding to at least one access sound pattern designated for recognizing the access sound A process of recognizing a corresponding access sound is performed (310).

According to an embodiment of the present invention, the sound apparatus 100 reads the buffered sound data and stores the buffered sound data corresponding to at least one outgoing sound frequency band among the stored M outgoing sound frequency bands and / (310) can recognize the entrance / exit sound corresponding to at least one of the entrance / exit sound patterns. According to another embodiment of the present invention, m sound signals (sound signals) optimized (or fitted) to / from the sound of the sound source generated by the sound source in the space where the sound device 100 is mounted through the process of FIG. 4 and / When the n pieces of access sound pattern information determined and stored in the designated storage area and / or optimized (or adapted) to the access sound of the specific sound source are determined and stored in the designated storage area, Reads out the buffered sound data and outputs a specific sound corresponding to at least one outgoing sound frequency band of the stored m outgoing sound frequency bands and / or at least one outgoing sound pattern out of the stored n outgoing sound patterns The unique sound of the source can be recognized (310).

If the operation mode of the sound device 100 is the sleep mode at the time of recognizing the access sound, the sound device 100 may be woken up in the sleep mode (315).

On the other hand, when the entrance sound is recognized and / or when the operation mode of the sound device 100 is woken up in the sleep mode, the sound device 100 is associated with the entrance sound among the designated S (S? 1) At least s (1? S? S) service functions may be activated (320) and a procedure may be performed (325) to provide at least one service function among the activated s service functions according to a designated procedure.

On the other hand, if the sound data is not read and the sound is not recognized, the sound device 100 determines whether the sound is not effectively recognized for a predetermined period of time (330). If the sound is not recognized effectively for a predetermined period of time, the sound apparatus 100 may set the operation mode of the sound apparatus 100 to the sleep mode (335).

FIG. 4 illustrates an embodiment in which an access sound frequency band for recognizing an access sound according to an embodiment of the present invention is optimized (or customized) to the sound of an access sound source.

FIG. 4 is a block diagram showing an example of the sound frequency distribution information (sound frequency distribution information) corresponding to at least i (i? 2) valid recognized sound frequency distributions for a predetermined period of time using M outgoing sound frequency band information previously stored in a designated storage area M (1? M? M) m (m) optimized (or fitted) to the sound of the entrance and exit sound source in the space where the sound device 100 is placed, by statistically processing the generated access sound frequency distribution information M access tone frequency band information corresponding to the access sound frequency band is newly determined and stored in a designated storage area. If a person skilled in the art is familiar with the present invention, Referring to and / or modified with reference to FIG. 4, various implementations of the process of optimizing (or fitting) the incoming and outgoing sound frequency bands (e.g., , Or would be able to infer the order of the exemplary method is changed), the present invention is made, including any exemplary way in which the inference, to which the technical feature that is not limited to the exemplary method shown in the figure 4. 4 may be provided through the sound apparatus 100 or may be provided through the operation server 200 or may be provided in a distributed form through interlocking of the sound apparatus 100 and the operation server 200 For convenience, FIG. 4 illustrates features of the present invention with reference to a process provided through the sound apparatus 100. FIG.

Referring to FIG. 4, the sound apparatus 100 recognizes the entrance / exit sound using the M outgoing / incoming sound frequency band information previously stored in the designated storage area, and then recognizes the entrance / exit sound The frequency band information is stored and managed in a designated storage area (400).

If i (i? 2) access sound frequency band information used for effectively recognizing an access sound during a predetermined period of time is stored in the storage area (405), the sound device 100 stores at least i (i 2 &gt;) validated outgoing sound frequency distribution information (410), statistically processes the generated outgoing sound frequency distribution information, and outputs the outgoing sound frequency distribution information in a space in which the sound device (100) M outgoing sound frequency band information corresponding to the m (1? M? M) outgoing sound frequency bands optimized (or fitted) to the incoming and outgoing sounds of the incoming and outgoing sound sources is determined 415, The sound device 100 newly sets / stores the new / updated sound frequency band in the designated storage area by setting it as an access sound frequency band to be read first, Information can recognize the sound out with.

FIG. 5 illustrates an embodiment of optimizing (or fitting) an access sound pattern for recognizing an access sound according to another embodiment of the present invention to / from a specific sound source.

In more detail, FIG. 5 shows access sound pattern distribution information corresponding to an effectively recognized access sound pattern distribution at least j (j? 2) for a predetermined period using N access sound pattern information previously stored in a designated storage area (1 &amp; le &amp; n &amp;le; N) number of outgoing and incoming sound patterns distributed to the sound device 100, N sound pattern information corresponding to a sound pattern is determined and newly / updated stored in a designated storage area. Those skilled in the art will appreciate that the present invention is not limited to these embodiments. (For example, a step in which some steps are omitted or an order is changed) for optimizing (or fitting) the entrance / exit sound pattern by referencing and / It should be understood that the present invention includes all of the above-described embodiments, and the technical features of the present invention are not limited only by the method shown in FIG. 5 may be provided through the sound apparatus 100 or may be provided through the operation server 200 or may be provided in a distributed form through interlocking of the sound apparatus 100 and the operation server 200 For convenience, FIG. 5 illustrates the features of the present invention with reference to a process provided through the sound apparatus 100. FIG.

Referring to FIG. 5, the sound apparatus 100 recognizes the entrance / exit sound by using the N outgoing / incoming sound pattern information previously stored in the designated storage area, and then recognizes the entrance / exit sound pattern Information is stored in a designated storage area and managed (500).

If j (j? 2) outgoing sound frequency band information used for effectively recognizing an access sound during a predetermined period of time is stored in the storage area (505), the sound device (100) The access sound pattern distribution information corresponding to the recognized access sound pattern distribution is generated (510), and the generated access sound pattern distribution information is statistically processed so that the specific sound source in the space where the sound device (100) After determining n outgoing sound pattern information corresponding to n (1? N? N) outgoing sound patterns optimized (or fitted) to sound (515), the outgoing sound pattern (520) in the designated storage area, and then the sound device 100 can recognize the access sound using the stored n access sound pattern information.

FIG. 6 illustrates an embodiment of activating a service related to an access sound according to another embodiment of the present invention.

In more detail, in FIG. 6, when the user's utterance contents are recognized within a predetermined time period during or after the entrance sound is recognized, the uttered contents of the recognized user are analyzed in association with s service functions related to the access sound, The user can enjoy the services related to the entrance / exit sound recognition and / or service activation process by referring to and / or modifying the FIG. 6 if he / she is a person skilled in the art. It will be understood that various implementations of the present invention (e.g., some steps omitted or alternatives in which the order is changed) may be deduced, but the present invention includes all of the above- The technical features are not limited by the method alone. 6 may be provided through the sound apparatus 100 or may be provided through the operation server 200 or may be provided in a distributed form through interlocking of the sound apparatus 100 and the operation server 200 For convenience, FIG. 6 illustrates features of the present invention with reference to a process provided through the sound apparatus 100. FIG.

Referring to the embodiment of FIG. 6, the sound apparatus 100 reads sound data buffered in a designated buffer area, recognizes the user's language utterance, processes it in natural language, and recognizes the utterance contents information corresponding to the utterance contents of the user (600). If the user's utterance is not recognized, the sound device 100 determines whether the user's utterance is not recognized for a predetermined period of time (605). If the user's utterance is not recognized for a predetermined period of time, the sound apparatus 100 may set the operation mode of the sound apparatus 100 to a sleep mode (operation 610).

Meanwhile, when the sound data is read and the user's utterance is recognized, the sound apparatus 100 confirms whether the operation mode of the sound apparatus 100 is the sleep mode (615). If the sleep mode is selected, it is desirable to recognize the incoming sound and perform a process of waking up.

On the other hand, if the operation mode of the sound device 100 is not the sleep mode at the time of recognizing the user's utterance contents (for example, When the sleep mode is woken up), the sound device 100 confirms whether the user's utterance is recognized while the access sound is recognized, and / or if the user's utterance It is checked whether the contents are recognized (620). If the user's utterance is not recognized within a certain period of time during or after the entrance sound is recognized, the sound device 100 preferably confirms the sleep mode or recognizes the entrance sound to perform a wake-up process Do.

On the other hand, when the user's utterance contents are recognized within a certain period of time before or after the access sound is recognized, the sound apparatus 100 interprets the uttered contents of the recognized user as s service functions related to the entrance / exit sound (625). Based on this, a specific service function corresponding to the specific sound among the S service functions and corresponding to the speech contents of the recognized user may be activated (630), and the activated specific service function may be designated The procedure provided by the procedure may be performed (635).

100: sound device 105: sound module
105a: sound input unit 105b: sound output unit
110: camera module 110a:
115: power supply module 120: communication module
120a: wireless network communication unit 120b:
125: short-distance module 125a: short-
130: Control module 130a:
130b: memory unit 135: information storage unit
140: sound processing unit 145: entrance sound recognition unit
150: service control unit 155: distribution generating unit
160: information determination unit 165:
170: situation determination unit 175: intelligent processing unit
180: Service provisioner 185: Camera device
200: Operation server 205: Sound receiver

Claims (23)

There is provided a sound device including a sound module including a sound input section for receiving a sound signal and a sound output section for outputting a sound signal, and at least one communication section for connecting to a communication network,
A sound processing unit for buffering sound data corresponding to a sound signal of an audible frequency band inputted through the sound input unit in a designated buffer area or checking buffered sound data in a designated buffer area;
The at least one outgoing sound frequency band corresponding to at least one outgoing sound frequency band designated for recognizing out of the non-audible sounds or noises generated in the designated space by reading the buffered sound data, An access sound recognition unit for recognizing a specific access sound corresponding thereto; And
And a service controller for activating at least s (1? S? S) service functions related to the access sound among S (S? 1) service functions designated when the access sound is recognized Sound device for recognition of access.
The sound output apparatus according to claim 1,
The door lock unlocking sound of the designated entrance door for the judgment of the home owner or the family home,
The sound of door openings of designated entrance door for the judgment of home owner or family's home situation,
Pressing the designated number key to open the front door,
And a sound of at least one of the beacons sounded for the visitor or the guest to determine the visiting situation.
The method as claimed in claim 1,
And determines whether or not an access sound is not recognized for a predetermined period of time or that the user's utterance is not recognized for a predetermined period of time or longer. If the access sound or the user's utterance is not recognized for a predetermined period of time or longer, Sleep) mode in accordance with the input signal.
The method according to claim 1,
The access sound recognizing unit recognizes an access sound in a sleep mode,
Wherein the service control unit includes a function of activating s service functions wake-up and associated with an access sound when the access sound is recognized.
5. The method according to claim 3 or 4,
And a state in which the function of reading the buffered sound data to recognize a user's speech content and providing a service based on the recognized speech content is deactivated.
The portable telephone according to claim 1 or 2,
And a function of recognizing a unique access sound of the access sound source corresponding to the access sound frequency band of the access sound source and corresponding to the access sound pattern of the access sound source.
The apparatus of claim 1,
M outgoing sound frequency band information corresponding to M (M? 1) outgoing sound frequency bands and N outgoing sound pattern information corresponding to N (N? 1) outgoing sound patterns are stored in a designated storage area And a sound output unit for outputting sound.
8. The portable terminal according to claim 7,
And reading out the buffered sound data and recognizing an access sound corresponding to at least one access sound frequency band among the M access sound frequency bands and corresponding to at least one access sound pattern out of the N access sound patterns And a sound device for recognizing the entrance / exit.
8. The apparatus of claim 7,
A distribution generator for generating access sound frequency distribution information corresponding to at least i (i? 2) valid recognized outgoing sound frequency distributions for a predetermined period using the M outgoing sound frequency band information; And
(1 &amp;le; m &amp;le; M) access sound frequency bands optimized (or customized) to the sound of the entrance and exit sound source in the space where the sound device is mounted, by statistically processing the generated access sound frequency distribution information and an information determination unit for determining m outgoing sound frequency band information.
10. The method of claim 9,
Wherein the information storage unit further comprises a function of newly setting or updating and storing the determined m outgoing / incoming sound frequency bands as an outgoing / incoming sound frequency band to be read first,
Wherein the access sound recognition unit includes a function of reading out the buffered sound data and first recognizing an access sound corresponding to at least one access sound frequency band among the stored m access sound frequency bands. Lt; / RTI &gt;
8. The apparatus of claim 7,
A distribution generating unit for generating access sound pattern distribution information corresponding to a distribution of an effectively recognized access sound pattern at least j (j? 2) times for a predetermined period using the N access sound pattern information;
(1 &amp;le; n &amp;le; N) access sound patterns optimized (or customized) to the sound of the entrance and exit sound sources in the space in which the sound device is mounted by statistically processing the generated access sound pattern distribution information. And an information determiner for determining the number of access sound pattern information for the entrance and exit.
12. The method of claim 11,
Wherein the information storage unit further comprises a function of newly setting or updating and storing the determined n access sound patterns as an access sound pattern to be read first,
Wherein the access sound recognizing unit comprises a function of reading out the buffered sound data and first recognizing an access sound corresponding to at least one access sound pattern out of the stored n access sound patterns. Sound device.
The apparatus of claim 1,
A speech recognition unit for reading the buffered sound data and recognizing a user's speech utterance and performing natural language processing to recognize utterance content information corresponding to the utterance contents of the user;
A recognition determination unit for checking whether the user's utterance is recognized during the recognition of the access sound or the user's utterance is recognized within a predetermined period of time after completion of recognition of the access sound;
And an intelligent processing unit for processing the speech contents of the recognized user in association with s service functions related to the entrance and exit sounds when the speech contents of the user are recognized within a predetermined time period during or after the entrance / exit sound is recognized And a sound device for recognizing the entrance / exit.
14. The method as claimed in claim 13,
And a function of activating a specific service function corresponding to the outgoing sound and corresponding to the uttered contents of the recognized user.
The method as claimed in claim 1,
A server interlocking service for interlocking with an operation server on a communication network through the communication module,
A sound based service provided through the sound module,
And a composite service for providing the combined use of the sound module and the communication module.
The system according to claim 15,
A paging service using wireless terminal information,
A status notification service using wireless terminal information,
A calling service using an application installed in a wireless terminal,
A status notification service using an application installed in a wireless terminal,
A video service for providing video information photographed through at least one camera to an application installed in a wireless terminal,
And a video service for providing video information photographed through at least one camera to a designated IPTV device.
16. The method of claim 15,
And a noise output service for outputting a designated service sound through a sound output unit of the sound module at a designated signal output intensity.
The signal output apparatus according to claim 17,
And a signal strength inversely proportional to a signal input intensity of the input / output sound.
16. The method of claim 15,
A service provided through an operation server on a communication network based on a result of analyzing the user's utterance contents within a predetermined period of time during or after the access sound is recognized and analyzing the utterance contents of the user in association with a service function related to the entrance / And a sound output device for outputting sound.
The method according to claim 1,
And a short-range module for processing a short-range camera device and short-range wireless communication,
Wherein the service control unit includes a function of activating a video service function for communicating with the camera device through the near field module and photographing a sound source that generates the recognized entrance / exit sound through the camera device Sound device for recognition.
The method according to claim 1,
Wherein the communication module includes a short range network communication unit for connecting a short distance camera device and a short range wireless network based wireless communication,
Wherein the service control unit includes a function of activating a video service function for communicating with the camera device via the local network communication unit and photographing a sound source that generates the recognized entrance / exit sound through the camera device Sound device for recognition of access.
The method according to claim 1,
Further comprising a camera module for acquiring image information of a photographed subject,
Wherein the service control unit includes a function of activating a video service function for photographing a sound source that generates the recognized entrance / exit sound through the camera module.
The apparatus of claim 1,
Further comprising a service providing unit for providing a service corresponding to the activated service function.

Images